Electronic map display method and device, electronic equipment and storage medium

Abstract

The invention provides an electronic map display method and device, electronic equipment and a storage medium. The method comprises the following steps: acquiring view field information in an electronic map application, and determining a target geographic position based on the view field information; acquiring a real-time environment image collected at the target geographic position, and determining real-time meteorological information corresponding to the target geographic position based on the real-time environment image and the weather forecast data; determining meteorological display elements according to the real-time meteorological information and the real-time environment image; and determining a plurality of base map elements based on the field-of-view information, and rendering and displaying an electronic map interface corresponding to the field-of-view information according to the meteorological display element and the plurality of base map elements. According to the embodiment of the invention, the accuracy of displaying the weather information in the electronic map can be improved.

Description

Technical Field

[0001] This disclosure relates to the field of map technology, and in particular to a method, apparatus, electronic device, and storage medium for displaying electronic maps. Background Technology

[0002] An electronic map is a digitally stored and viewed map that can be displayed on electronic devices. Electronic maps not only display the field of view corresponding to a target geographical location, but also the weather information for that location, such as whether it is sunny, rainy, or experiencing a sandstorm. This improves the readability and intuitiveness of electronic maps, allowing users to plan their trips based on weather information about their target location.

[0003] However, among related technologies, the accuracy of displaying meteorological information in electronic maps is relatively low. Summary of the Invention

[0004] This disclosure provides a method, apparatus, electronic device, and storage medium for displaying electronic maps, which can improve the accuracy of displaying meteorological information in electronic maps.

[0005] According to one aspect of this disclosure, a method for displaying an electronic map is provided, comprising:

[0006] Obtain field-of-view information from electronic map applications and determine the target's geographical location based on the field-of-view information;

[0007] Acquire real-time environmental images collected at the target geographical location, and determine the real-time meteorological information corresponding to the target geographical location based on the real-time environmental images and weather forecast data;

[0008] Meteorological display elements are determined based on the real-time meteorological information and the real-time environmental image;

[0009] Based on the field of view information, multiple base map elements are determined, and an electronic map interface corresponding to the field of view information is rendered and displayed according to the meteorological display elements and the multiple base map elements.

[0010] According to one aspect of this disclosure, an electronic map display device is provided, comprising:

[0011] The acquisition unit is used to acquire field-of-view information in electronic map applications and determine the target geographical location based on the field-of-view information;

[0012] The first determining unit is used to acquire real-time environmental images collected at the target geographical location, and determine the real-time meteorological information corresponding to the target geographical location based on the real-time environmental images and weather forecast data.

[0013] The second determining unit is used to determine meteorological display elements based on the real-time meteorological information and the real-time environmental image.

[0014] The first rendering unit is used to determine multiple base map elements based on the field of view information, and to render and display the electronic map interface corresponding to the field of view information according to the meteorological display elements and the multiple base map elements.

[0015] Optionally, the second determining unit is specifically used for:

[0016] At least one meteorological display element is determined based on the real-time environmental image and real-time meteorological information;

[0017] The rendering position of each weather display element is determined based on the real-time environmental image.

[0018] The first rendering unit is specifically used for:

[0019] The electronic map interface corresponding to the field of view information is rendered and displayed based on the at least one meteorological display element, the rendering location, and the plurality of base map elements.

[0020] Optionally, in one implementation, the first rendering unit is specifically used for:

[0021] Based on the rendering position, multiple target base map elements are determined among the multiple base map elements;

[0022] Each meteorological display element is fused with its corresponding target base map element, and the fused element is rendered and displayed to obtain the electronic map interface corresponding to the field of view information.

[0023] Optionally, in one embodiment, the electronic map display device further includes:

[0024] The third determining unit is used to determine the sky display elements based on the real-time meteorological information and the real-time time information;

[0025] The second rendering unit is used to render and display the sky display elements in the electronic map interface corresponding to the field of view information.

[0026] Optionally, in one embodiment, the third determining unit is specifically used for:

[0027] When the real-time weather information indicates clear weather, the celestial elements are determined based on the time range of the real-time time information.

[0028] Calculate the star rendering position corresponding to the star element based on the real-time time information;

[0029] The second rendering unit is specifically used for:

[0030] The star element is rendered at the star rendering location in the electronic map interface corresponding to the field of view information.

[0031] Optionally, in one embodiment, the third determining unit is specifically used for:

[0032] The actual celestial position corresponding to the celestial element is obtained based on the real-time time information.

[0033] Calculate the azimuth and elevation angles of the target celestial body corresponding to the celestial element when observing it from the target geographical location, based on the actual celestial body position and the target geographical location.

[0034] The astronomical position of the astronomical element in the electronic map interface corresponding to the field of view information is calculated based on the azimuth angle and the elevation angle.

[0035] Optionally, in one embodiment, the electronic map display device further includes:

[0036] The fourth determining unit is specifically used to acquire real-time date information and determine the lunar phase information based on the real-time date information;

[0037] The second rendering unit is specifically used for:

[0038] The moon element is rendered at the star rendering position in the electronic map interface corresponding to the field of view information based on the lunar phase information.

[0039] Optionally, in one implementation, the second rendering unit is specifically used for:

[0040] The target sky pattern is determined based on the real-time time information;

[0041] The star elements are blended with the target sky style based on the star rendering position to obtain a sky image;

[0042] The sky image is displayed at the sky display location in the electronic map interface corresponding to the field of view information.

[0043] Optionally, in one implementation, the first determining unit is specifically used for:

[0044] The real-time environmental images are classified using a preset neural network model to obtain meteorological classification information;

[0045] Based on the meteorological classification information and the weather forecast data, the real-time meteorological information corresponding to the target geographical location is determined.

[0046] Optionally, in one implementation, the first determining unit is specifically used for:

[0047] The real-time environmental image is used to extract features using a preset neural network model to obtain weather features and road condition features.

[0048] Based on the weather characteristics and road condition characteristics, meteorological classification information is obtained.

[0049] Optionally, in one embodiment, the meteorological classification information includes multiple first category probabilities corresponding to multiple meteorological categories;

[0050] The first determining unit is specifically used for:

[0051] Determine multiple second-category probabilities from the multiple meteorological categories in the weather forecast data;

[0052] The real-time meteorological information corresponding to the target geographical location is determined based on the plurality of first category probabilities and the plurality of second category probabilities.

[0053] Optionally, in one implementation, the first determining unit is specifically used for:

[0054] Obtain the first weight corresponding to the meteorological classification information and the second weight corresponding to the weather forecast data;

[0055] Based on the first weight and the second weight, the multiple first category probabilities and the multiple second category probabilities are weighted and calculated to determine the real-time meteorological information corresponding to the target geographical location.

[0056] The electronic map display method in this embodiment of the present disclosure acquires field-of-view information from an electronic map application and determines the target geographical location based on the field-of-view information; acquires real-time environmental images collected at the target geographical location and determines real-time meteorological information corresponding to the target geographical location based on the real-time environmental images and weather forecast data; determines meteorological display elements based on the real-time meteorological information and the real-time environmental images; determines multiple base map elements based on the field-of-view information, and renders and displays the electronic map interface corresponding to the field-of-view information based on the meteorological display elements and the multiple base map elements.

[0057] Therefore, the electronic map display method of this embodiment renders the electronic map interface based on the selected field of view information in the electronic map application, and determines the real-time meteorological information of the target geographical location using real-time environmental images and weather forecast data corresponding to the field of view information. In this way, the real-time meteorological information is obtained through a comprehensive analysis of satellite meteorological forecasts and actual environmental conditions, resulting in high accuracy. After determining the real-time meteorological information, meteorological display elements are determined based on the real-time meteorological information and real-time environmental images. This allows the meteorological display elements to more accurately match the actual environment of the target geographical location, and the electronic map interface rendered by jointly displaying the meteorological display elements and multiple base map elements can more accurately reproduce the meteorological environment of the target geographical location. In other words, the electronic map display method of this embodiment can obtain accurate real-time meteorological information, and based on this, can accurately render an electronic map interface that can reproduce the actual meteorological environment of the target geographical location. Therefore, the electronic map display method of this embodiment can improve the accuracy of displaying meteorological information in electronic maps.

[0058] Other features and advantages of this disclosure will be set forth in the following description and will be apparent in part from the description or may be learned by practicing the disclosure. The objectives and other advantages of this disclosure may be realized and obtained by means of the structures particularly pointed out in the description, claims and drawings. Attached Figure Description

[0059] The accompanying drawings are provided to further understand the technical solutions of this disclosure and constitute a part of the specification. They are used together with the embodiments of this disclosure to explain the technical solutions of this disclosure and do not constitute a limitation on the technical solutions of this disclosure.

[0060] Figure 1 This is a system architecture diagram of the electronic map display method according to an embodiment of the present disclosure;

[0061] Figure 2A This is a schematic diagram of an interface applied to an electronic map navigation scenario according to an embodiment of this disclosure;

[0062] Figure 2B This is another schematic diagram of an interface applied to an electronic map navigation scenario according to an embodiment of this disclosure;

[0063] Figure 3 This is a flowchart of an electronic map display method according to an embodiment of the present disclosure;

[0064] Figure 4 This is a schematic diagram illustrating the determination of real-time meteorological information based on meteorological classification information and weather forecast data according to an embodiment of this disclosure;

[0065] Figure 5This is another schematic diagram illustrating the determination of real-time meteorological information based on meteorological classification information and weather forecast data according to an embodiment of this disclosure;

[0066] Figure 6 This is a schematic diagram of an image classification process using a preset neural network model according to an embodiment of the present disclosure;

[0067] Figure 7 This is a schematic diagram of rendering sky display elements in the sky area of ​​an electronic map interface according to an embodiment of the present disclosure;

[0068] Figure 8 This is a schematic diagram of the sun rising in the east and setting in the west according to an embodiment of the present disclosure;

[0069] Figure 9 This is a schematic diagram illustrating the determination of the solar altitude angle according to an embodiment of the present disclosure;

[0070] Figure 10 This is a schematic diagram of calculating the solar altitude angle according to an embodiment of the present disclosure;

[0071] Figure 11 This is a schematic diagram illustrating the determination of the solar azimuth angle according to an embodiment of the present disclosure;

[0072] Figure 12 This is a schematic diagram illustrating the rendering of celestial elements at celestial rendering positions in an electronic map interface corresponding to field-of-view information, according to an embodiment of this disclosure.

[0073] Figure 13 This is a schematic diagram of multiple sky styles according to an embodiment of the present disclosure;

[0074] Figure 14 This is a schematic diagram illustrating the sky display position in a target map interface for displaying a sky image, according to one embodiment of the present disclosure;

[0075] Figure 15 This is a schematic diagram of lunar phase changes according to one embodiment of the present disclosure;

[0076] Figure 16 This is a schematic diagram illustrating the change of the moon in the same position from new moon to full moon in days, according to one embodiment of the present disclosure.

[0077] Figure 17 This is a schematic diagram illustrating the hourly changes in the moon's altitude throughout the night, according to one embodiment of this disclosure.

[0078] Figure 18A This is a schematic diagram of a convex moon phase according to one embodiment of the present disclosure;

[0079] Figure 18B This is a schematic diagram of a full moon phase according to one embodiment of the present disclosure;

[0080] Figure 19 This is a schematic diagram of rendering dynamic elements in an electronic map interface according to one embodiment of the present disclosure;

[0081] Figure 20 This is a schematic diagram of rendering celestial elements in an electronic map interface according to one embodiment of the present disclosure;

[0082] Figure 21 This is a schematic diagram of rendering sky elements in an electronic map interface according to one embodiment of the present disclosure;

[0083] Figure 22 This is a schematic diagram of rendering heavy snow on an electronic map interface according to one embodiment of the present disclosure;

[0084] Figure 23 This is another schematic flowchart of an electronic map display method according to an embodiment of the present disclosure;

[0085] Figure 24 This is a schematic diagram of module interaction according to an embodiment of the present disclosure;

[0086] Figure 25 This is a schematic diagram illustrating the process of an element rendering network rendering based on meteorological information according to an embodiment of the present disclosure;

[0087] Figure 26A This is a rainy day illustration rendered according to an embodiment of the electronic map display method of the present disclosure;

[0088] Figure 26B This is a snowy weather illustration rendered according to an embodiment of the electronic map display method of this disclosure;

[0089] Figure 26C This is a schematic diagram of a sandstorm weather rendered according to an embodiment of the electronic map display method of the present disclosure;

[0090] Figure 27 This is a schematic diagram of the structure of an electronic map display device according to an embodiment of the present disclosure;

[0091] Figure 28 This is a terminal structure diagram for implementing various methods according to an embodiment of the present disclosure;

[0092] Figure 29 This is a server structure diagram illustrating the implementation of various methods according to an embodiment of the present disclosure. Detailed Implementation

[0093] To make the objectives, technical solutions, and advantages of this disclosure clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and are not intended to limit the scope of this disclosure.

[0094] Before providing a further detailed description of the embodiments of this disclosure, the terms and concepts used in these embodiments are explained, and they are subject to the following interpretations:

[0095] Field of view: In electronic maps, the field of view typically refers to the extent and angle at which the map is displayed on the electronic screen. The size and angle of the field of view determine the map content and level of detail that an object can see. Objects can change the size and position of the field of view through operations such as zooming and panning, thereby exploring different map areas.

[0096] Meteorology: Meteorology refers to all atmospheric physical phenomena that occur in the sky, such as wind, clouds, rain, snow, frost, dew, rainbows, halos, lightning, and thunder. These phenomena are closely related to factors such as climate, seasons, and geographical location on Earth, and are also influenced by astronomical factors such as solar radiation, Earth's rotation, and revolution. Meteorological information is of great significance to people's daily lives, agricultural production, and transportation.

[0097] Neural network models are computational models that mimic the structure and function of the human brain's nervous system. They process and learn data by simulating the connections and information transmission between a large number of neurons. A neural network consists of multiple layers, including input layers, hidden layers, and output layers, with each layer containing multiple nodes or neurons. Neural network models can be used for image recognition.

[0098] In related technologies, displaying meteorological information on electronic maps often relies solely on rendering the electronic map interface corresponding to the field of view by acquiring real-time meteorological information from a single dimension. For example, when rendering the electronic map interface corresponding to a specific location at a certain moment, weather forecast information is obtained, and the predicted meteorological information for that location at that moment is determined based on the weather forecast. Then, the corresponding meteorological layer is determined based on the predicted meteorological information, and this layer is overlaid on the electronic map interface to display the meteorological information at that moment. For example, if the weather forecast predicts rain at location A at the current moment, a rain layer is directly overlaid on the base map corresponding to location A. Another example is using meteorological editing styles corresponding to time periods to render corresponding meteorological scenes to address environmental changes caused by time variations. The accuracy of the real-time meteorological information obtained by the above methods is relatively low. In actual environments, weather forecast information may not match the actual meteorological environment, and meteorological information within a specific time period cannot reflect the constantly changing meteorological environment. Furthermore, after acquiring real-time meteorological information, simply overlaying layers or nesting templates cannot accurately recreate the actual meteorological environment on the electronic map interface. Therefore, the accuracy of related technologies in acquiring real-time meteorological information and reconstructing the actual meteorological environment is relatively low, resulting in low accuracy in displaying meteorological information on electronic maps. To address this, this disclosure provides a method for displaying electronic maps to improve the accuracy of meteorological information displayed on electronic maps.

[0099] System architecture and scenario description of the embodiments disclosed herein

[0100] Figure 1 This is a system architecture diagram applied to the electronic map display method according to embodiments of the present disclosure. It includes a terminal 140, an Internet 130, a gateway 120, a server 110, etc.

[0101] Terminal 140 can take various forms, including desktop computers, laptops, PDAs (personal digital assistants), mobile phones, in-vehicle terminals, home theater terminals, and dedicated terminals. Furthermore, it can be a single device or a collection of multiple devices. For example, multiple devices can be connected via a local area network, sharing a single display device to work collaboratively, forming a single terminal 140. Terminal 140 can also communicate with the Internet 130 via wired or wireless means to exchange data.

[0102] Server 110 refers to a computer system that can provide certain services to terminal 140. Compared to ordinary terminal 140, server 110 has higher requirements in terms of stability, security, and performance. Server 110 can be a single high-performance computer in a network platform, a cluster of multiple high-performance computers, a portion of a single high-performance computer (e.g., a machine), or a combination of portions of multiple high-performance computers (e.g., machines).

[0103] Gateway 120, also known as an internetwork connector or protocol converter, is a computer system or device that acts as a translator between two systems using different communication protocols, data formats, languages, or even completely different architectures. It enables network interconnection at the transport layer. Gateways can also provide filtering and security functions. Messages sent from terminal 140 to server 110 are forwarded to the corresponding server 110 through gateway 120. Messages sent from server 110 to terminal 140 are also forwarded to the corresponding terminal 140 through gateway 120.

[0104] The electronic map display method of this disclosure embodiment can be executed by an electronic device, which can be a terminal 140 or a server 110. That is, the electronic map display method can be executed by the terminal 140 or the server 110, or it can be executed by both the terminal 140 and the server 110.

[0105] The embodiments disclosed herein can be applied in various scenarios, such as Figures 2A-2B The scenarios shown include electronic map navigation.

[0106] like Figure 2A As shown, after obtaining the navigation route from location P1 to location P2 using the electronic map, the field of view information gradually changes as the cursor moves. The weather information displayed on the corresponding electronic map interface also changes accordingly. Figure 2A The weather forecast data and real-time environmental image corresponding to the target geographical location shown in the field of view are used to determine that the real-time meteorological information for the target geographical location is heavy snow. Snow accumulation on buildings is identified from the real-time environmental image. Therefore, based on the real-time meteorological information and the real-time environmental image, the meteorological display elements are determined to include heavy snow falling in the sky and snow accumulation on buildings.

[0107] like Figure 2B As shown, snow accumulation was identified in the originally planned driving lane from the real-time environmental image. Therefore, based on real-time weather information and the real-time environmental image, the weather display elements were determined to include snow falling from the sky, snow accumulation on buildings, and snow accumulation in the lane. These weather display elements were then rendered along with multiple base map elements, allowing users to clearly and intuitively see the snow accumulation in the lane and choose alternative lanes. The electronic map can also adjust routes based on road conditions when planning navigation routes, thereby ensuring driving safety.

[0108] Therefore, the electronic map display method of this disclosure can first obtain accurate real-time weather information, and secondly, accurately display the actual weather environment on the interface. Thus, in electronic map navigation scenarios, real-time traffic conditions can be accurately identified, improving the safety of navigation route planning.

[0109] General Description of Embodiments in this Disclosure

[0110] According to one embodiment of this disclosure, a method for displaying an electronic map is provided. The electronic map display method provided in this embodiment can be applied to, for example... Figures 2A-2B The scenarios shown include electronic map navigation. For example... Figure 3 The diagram shown is a flowchart illustrating a method for displaying an electronic map as provided in this disclosure. This method may include:

[0111] Step 310: Obtain the field of view information from the electronic map application and determine the target's geographical location based on the field of view information.

[0112] Electronic map applications can be used to display geographic location information on electronic devices. Field of view (FPV) can be the range and viewing angle displayed on the electronic map interface. The FPV in an electronic map application is obtained by determining the viewing angle corresponding to the current geographic location of the electronic device on the electronic map, based on a pre-set or user-selected display range. For example, if the electronic device displaying the map is currently at location P1, and the map scale is 1 cm:200 m (1 cm on the map corresponds to 200 meters in reality), then the FPV is the area on the electronic map centered on location P1, displayed at a 1 cm:200 m scale, based on the area that the electronic device can display. As the electronic device moves, the FPV in the electronic map application also changes.

[0113] The field of view information in electronic application maps can also be determined by the field of view that an object autonomously selects within the electronic map. The geographical location corresponding to the field of view information autonomously selected by the object is not necessarily the object's current geographical location. Within the electronic map interface, an object can adjust its field of view by dragging the interface or searching for a specific geographical location, and obtain the field of view information from the electronic map application based on the adjusted field of view. For example, if the object's current geographical location is P1, and the object wants to view the electronic map interface for location P2, it can search for location P2 on the electronic map to obtain the field of view information for location P2.

[0114] After acquiring the field of view information, the target geographical location can be determined based on it. Since the field of view information can be the current geographical location of the electronic device displaying the electronic map or the viewing range of a selected geographical location within the electronic map interface, the target geographical location can be either the current geographical location of the electronic device or the geographical location selected by the object. When an object wants to view the weather conditions of a certain geographical area by dragging the electronic map, the central geographical location in the electronic map interface can be determined based on the field of view information, and this central geographical location can be used as the target geographical location. When the object changes the field of view displayed in the electronic map interface, the target geographical location will also change accordingly.

[0115] Step 320: Acquire real-time environmental images collected at the target geographical location, and determine the real-time meteorological information corresponding to the target geographical location based on the real-time environmental images and weather forecast data.

[0116] After determining the target geographical location, real-time environmental images can be acquired at that location. These real-time environmental images display the real-time weather and environmental conditions at the target location. When the target geographical location is the current location of an electronic device displaying an electronic map, the real-time environmental image can be captured by the electronic device displaying the electronic map or by other image capture devices connected to it using a camera. For example, if the electronic device displaying the electronic map is a vehicle-mounted terminal, the real-time environmental image can be obtained by a camera capture device connected to the vehicle-mounted terminal capturing images of the surrounding environment.

[0117] Real-time environmental images can also be obtained online or in the cloud from environmental images of the target geographic location captured and uploaded by other objects or electronic devices. Electronic map applications can connect to cloud image libraries, which store real-time environmental images captured by electronic devices in different geographic locations for their respective locations. Electronic devices uploading environmental images to the cloud image library can be fixed road condition detection devices on roads or other mobile electronic devices, such as camera capture devices connected to other moving vehicles. Based on the target geographic location, the real-time environmental image corresponding to the target geographic location can be obtained from the cloud image library. Regardless of whether the target geographic location is the current geographic location of the electronic device displaying the electronic map, real-time environmental images can be obtained from the cloud image library.

[0118] Real-time environmental images can include multiple images. Because real-time environmental images may contain obstructions such as trees or buildings, making it impossible to accurately obtain real-time meteorological information from them, multiple images can be captured as the real-time environmental image. Multiple images can be multiple images captured consecutively from the same viewpoint. For example, while a vehicle is moving, a camera captures one image every second. When determining the real-time meteorological information corresponding to the target geographical location, the image captured at the current time, along with the preceding 10 consecutive images, can be used together as the real-time environmental image. Multiple images can also be multiple consecutive frames from a video captured by the camera. For example, if a video is captured while the vehicle is moving to the target geographical location, a segment can be selected as the real-time environmental image. Multiple images can also be multiple images captured from different directions of the target geographical location. For example, one image can be captured from each of the eight directions: east, south, west, north, southeast, northeast, southwest, and northwest, as the real-time environmental image.

[0119] After acquiring real-time environmental images, real-time meteorological information corresponding to the target geographical location can be determined based on the real-time environmental images and weather forecast data. Weather forecast data can be provided by a weather forecast service network, which can provide real-time weather forecasts, disaster warnings, meteorological cloud images, and other meteorological information for multiple geographical locations. When weather forecast data for a target geographical location is needed, the real-time meteorological information for that location can be directly retrieved from the weather forecast service network.

[0120] Weather forecasts provided by weather forecasting networks are based on meteorological data observed by meteorological stations, satellites, and radars. While they offer some reference value, they cannot accurately reflect the actual meteorological environment of a target location. For example, analyzing atmospheric temperature and cloud distribution might predict rain at 10 AM, but the actual weather might be sunny. Therefore, in addition to weather forecasts, real-time environmental images can be used to comprehensively analyze real-time meteorological information corresponding to a target location. Real-time environmental images can identify brightness, cloud cover, and meteorological markers (rain, snow, hail, etc.) at the target location. However, relying solely on real-time environmental images may not be sufficient to accurately analyze the real-time meteorological information of a target location. The actual environment at a target location can be complex, and real-time environmental images only show local environmental information. For example, the target location might actually be sunny, but tall buildings in the surrounding area might block sunlight, resulting in lower brightness in the real-time environmental image. Therefore, analyzing solely based on real-time environmental images might increase the likelihood of a "cloudy" weather pattern. In summary, the accuracy of real-time meteorological information for determining the geographical location of a target solely based on weather forecast data or real-time environmental images is relatively low. The method provided in this disclosure can comprehensively analyze weather forecast data and real-time environmental images, which helps to improve the accuracy of real-time meteorological information for determining the geographical location of a target.

[0121] In one implementation, determining real-time meteorological information corresponding to a target's geographical location based on real-time environmental images and weather forecast data includes:

[0122] A pre-defined neural network model is used to classify real-time environmental images to obtain meteorological classification information;

[0123] Real-time meteorological information corresponding to the target's geographical location is determined based on meteorological classification information and weather forecast data.

[0124] The preset neural network model can be a large model derived from a convolutional neural network, used for image classification.

[0125] Meteorological classification information can indicate the weather conditions of a target geographical location based on real-time environmental images, such as sunny, cloudy, rainy, snowy, etc.

[0126] In one implementation, a preset neural network model is used to classify real-time environmental images to obtain meteorological classification information, including:

[0127] The system uses a pre-defined neural network model to extract features from real-time environmental images, obtaining weather features and road condition features.

[0128] Meteorological classification information is obtained by classifying weather characteristics and road conditions.

[0129] Weather features can be characteristics used to indicate the weather. For example, on a sunny day, the sunlight is strong and the clouds are relatively thin; on a rainy day, the sunlight is weak, the clouds are thick and dark in color, and raindrops are present in the image. Weather features can include: cloud features (shape, size, texture, and color of clouds, etc.), light features (sunlight intensity, direction of sunlight, and distribution of shadows, etc.), weather marker features (e.g., raindrops representing rain, snowflakes representing snow, dust representing a sandstorm, etc.), and indirect weather features (e.g., umbrellas, people wearing raincoats, etc.).

[0130] Road condition features indicate the road surface conditions at a target geographical location, such as whether there is snow or water accumulation on the road surface. Road condition features can include road surface features, vegetation features, and building features.

[0131] The road conditions and weather at a target location may not match. For example, when the weather forecast indicates snow, there may not be snow accumulation on the road. Snow will gradually accumulate after a period of continuous snowfall. Similarly, when the weather changes from snowy to sunny, the snow on the road will not disappear immediately but will gradually disappear after a period of sunny weather. Therefore, sunny weather and snow accumulation can coexist. Thus, it is possible to extract both weather features and road condition features simultaneously to obtain more accurate meteorological information for the target location.

[0132] In one implementation, a preset neural network model is used to extract features from real-time environmental images to obtain weather features and road condition features, including:

[0133] The real-time environmental image is enhanced to obtain the enhanced image;

[0134] Feature extraction is performed on the enhanced image to obtain weather features and road condition features.

[0135] Enhancement processing of real-time environmental images can include denoising the real-time environmental images to improve image quality; increasing the contrast of the real-time environmental images to more clearly identify features in the real-time environmental images; and segmenting the background and foreground of the real-time environmental images, for example, segmenting features such as the sky and clouds in the real-time environmental images into multiple feature layers so that features can be extracted for each feature layer to obtain weather features and road condition features.

[0136] After acquiring weather and road condition features, classification can be performed based on these features to obtain meteorological classification information. The pre-set neural network model, after training, can learn feature patterns under different weather categories. For example, features corresponding to rainy days include: dark gray clouds, thick clouds, weak sunlight, road puddles, raindrops, and umbrellas. Therefore, the pre-set neural network model can determine the meteorological classification information corresponding to real-time environmental images based on the weather and road condition features extracted from them.

[0137] Meteorological classification information can include weather category information and road condition category information. Weather category information can directly indicate the weather at the target geographical location shown in the real-time environmental image, such as sunny, cloudy, rainy, snowy, etc. Road condition category information can indicate whether there is snow or water accumulation on the road, surrounding buildings, or vegetation.

[0138] Classifying weather and road conditions based on weather and road features allows for the determination of weather and road conditions, enabling separate rendering for each. This avoids discrepancies between weather and road conditions and improves the accuracy of recreating the actual environment on electronic maps.

[0139] After obtaining meteorological classification information, real-time meteorological information corresponding to the target geographical location can be determined based on the meteorological classification information and weather forecast data. Real-time meteorological information can be more accurate meteorological information about the target geographical location at the current moment, obtained by combining meteorological classification information with weather forecast data.

[0140] In one implementation, the meteorological classification information includes multiple first-category probabilities corresponding to multiple meteorological categories. The first-category probabilities corresponding to each meteorological category can be the probability of each meteorological category occurring, calculated based on real-time environmental images, for example, sunny: 90%, cloudy: 50%, rainy: 5%, ...

[0141] Based on this, real-time meteorological information corresponding to the target's geographical location is determined using meteorological classification information and weather forecast data, including:

[0142] Determine multiple secondary category probabilities from multiple meteorological categories in weather forecast data;

[0143] Real-time meteorological information corresponding to the target geographical location is determined based on multiple first-class probabilities and multiple second-class probabilities.

[0144] Weather forecast data can also include the probability of a second category occurring for each meteorological category, obtained through weather prediction. Therefore, real-time meteorological information corresponding to a target geographical location can be determined based on multiple first-category probabilities and multiple second-category probabilities.

[0145] In one implementation, determining the real-time meteorological information corresponding to a target geographical location based on multiple first-category probabilities and multiple second-category probabilities can be achieved by calculating the average of the first-category probability and the second-category probability for each meteorological category, and determining the real-time meteorological information corresponding to the target geographical location based on the meteorological category with the highest average probability.

[0146] For example Figure 4 As shown, in the meteorological classification information obtained based on real-time environmental images, the probability of the first category corresponding to sunny is 90%, the probability of the first category corresponding to cloudy is 60%, and the probability of the first category corresponding to rain is 10%. In the weather forecast data, the probability of the second category corresponding to sunny is 30%, the probability of the second category corresponding to cloudy is 50%, and the probability of the second category corresponding to rain is 70%. Calculating the average of the first and second category probabilities for each meteorological category, we can obtain that the average probability for sunny is (90% + 30%) / 2 = 60%, the average probability for cloudy is (60% + 50%) / 2 = 55%, and the average probability for rain is (10% + 70%) / 2 = 40%. Therefore, real-time meteorological information can indicate that the target geographical location is sunny.

[0147] Using the average of the first and second category probabilities corresponding to meteorological categories to determine real-time meteorological information can ensure that real-time environmental images and weather forecast data have the same impact on determining real-time meteorological information, thus improving the fairness of determining real-time meteorological information.

[0148] In another implementation, real-time meteorological information corresponding to the target geographical location is determined based on multiple first-category probabilities and multiple second-category probabilities, including:

[0149] Obtain the first weight corresponding to meteorological classification information and the second weight corresponding to weather forecast data;

[0150] Based on the first weight and the second weight, multiple first-category probabilities and multiple second-category probabilities are weighted and calculated to determine the real-time meteorological information corresponding to the target geographical location.

[0151] The first and second weights can respectively indicate the impact of meteorological classification information and weather forecast data on real-time meteorological information for determining the target's geographical location. The first and second weights can be preset.

[0152] After obtaining the first weight and the second weight, the probabilities of the first class and the second class can be weighted and calculated based on the first weight and the second weight.

[0153] For example Figure 5As shown, the first weight is 0.6 and the second weight is 0.4. Based on the first and second weights, a weighted average probability is calculated for the first and second category probabilities corresponding to each weather category. The weighted average probability for sunny weather is 90%*0.6 + 30%*0.4 = 66%, for cloudy weather it is 60%*0.6 + 50%*0.4 = 56%, and for rain it is 10%*0.6 + 70%*0.4 = 34%. Therefore, real-time weather information can indicate that the target geographical location is sunny.

[0154] By using a first weight and a second weight to calculate the probabilities of the first and second categories to determine real-time meteorological information, the first and second weights can be set according to the needs of actual applications. This adjusts the impact of real-time environmental images and weather forecast data on the determination of real-time meteorological information, improving the flexibility of determining real-time meteorological information for target geographical locations.

[0155] In one of the aforementioned embodiments, meteorological classification information can be obtained based on weather characteristics and road condition characteristics. This meteorological classification information can include weather category information and road condition category information. Therefore, meteorological categories can include not only the various weather categories mentioned above, but also road condition categories, such as water accumulation, no water accumulation, snow accumulation, and no snow accumulation. When determining real-time meteorological information based on multiple first-category probabilities and multiple second-category probabilities corresponding to multiple meteorological categories, real-time weather information can be determined based on these probabilities, and real-time road condition information can be determined based on these probabilities. For example, based on the multiple first-category probabilities and multiple second-category probabilities corresponding to multiple weather categories, the real-time weather information can be determined as sunny, and based on the multiple first-category probabilities and multiple second-category probabilities corresponding to multiple road condition categories, the real-time road condition information can be determined as having snow accumulation. Therefore, the real-time meteorological information includes: sunny and having snow accumulation.

[0156] The process of determining real-time weather information and real-time traffic information is the same as the process of determining real-time meteorological information in the aforementioned embodiments, and will not be repeated here. After determining the real-time weather information and real-time traffic information, the real-time weather information and real-time traffic information can together constitute the real-time meteorological information of the target geographical location.

[0157] Determining the real-time meteorological information corresponding to a target's geographical location by using the first category probability corresponding to real-time environmental images and the second category probability corresponding to weather forecast data is beneficial to improving the accuracy of determining real-time meteorological information based on meteorological classification information and weather forecast data.

[0158] The process of recognizing and classifying real-time environmental images using a pre-defined neural network model can be represented as follows: Figure 6 First, image preprocessing is performed on the real-time environmental image, then feature extraction is performed, and finally image recognition and classification are performed based on the image features to obtain relatively accurate meteorological classification information. Then, the real-time meteorological information corresponding to the target geographical location is determined based on the meteorological classification information and weather forecast data, which helps to improve the accuracy of determining real-time meteorological information based on real-time environmental images and weather forecast data.

[0159] In another implementation, determining the real-time meteorological information corresponding to the target's geographical location based on real-time environmental images and weather forecast data includes: determining the real-time meteorological information corresponding to the target's geographical location based on real-time environmental images, weather forecast data, and meteorological sensor data.

[0160] Real-time environmental images and weather forecast data have been described in detail in the foregoing embodiments and will not be repeated here. Meteorological sensor data can be data collected by meteorological-related sensors, such as light data collected by light sensors and rainfall data collected by rain sensors.

[0161] Meteorological sensor data can be used to evaluate relevant meteorological indicators. For example, light intensity can be determined based on light data, and rainfall amount can be determined based on rainfall data. By comprehensively evaluating meteorological sensor data, meteorological identification information can be obtained. For example, when light intensity is low and rainfall is heavy, the meteorological identification information can be determined as heavy rain.

[0162] After obtaining meteorological information results based on real-time environmental images, weather forecast data, and meteorological sensor data, the real-time meteorological information corresponding to the target geographical location can be determined based on these three meteorological information results. The determination of real-time meteorological information can be the same as the method described above for determining real-time meteorological information based on meteorological classification information and weather forecast data, and will not be repeated here.

[0163] In addition to real-time environmental images and weather forecast data, further collecting meteorological sensor data to determine real-time meteorological information can further improve the accuracy of determining real-time meteorological information.

[0164] Electronic map applications display environmental information about a target's geographical location, including not only real-time weather information but also sky information. Sky information can include cloud cover display methods, sun and moon display methods, and astronomical element display methods.

[0165] Therefore, in one embodiment, after acquiring real-time environmental images collected at the target geographical location and determining the real-time meteorological information corresponding to the target geographical location based on the real-time environmental images and weather forecast data, the method further includes:

[0166] The elements displayed in the sky are determined based on real-time weather information and real-time time information;

[0167] Sky elements are rendered and displayed on the electronic map interface corresponding to the field of view information.

[0168] Sky display elements can be elements displayed in the sky in an electronic map interface, such as the sun, moon, stars, and clouds.

[0169] Sky display information can reflect real-time weather information. For example, if real-time weather information indicates that the target location is currently experiencing clear weather, then the sun or moon should be visible in the sky above the target location. Therefore, the electronic map interface corresponding to the field of view information should display the sun or moon. The display of the sun and moon is determined by the time of day; the sun can be displayed during the day, and the moon at night. Therefore, sky display elements can be determined based on real-time weather information and real-time time information.

[0170] After determining the sky display elements, they can be rendered and displayed on the electronic map interface corresponding to the field of view information. Specifically, the sky display elements can be rendered and displayed within the sky area of ​​the electronic map interface. For example... Figure 7 As shown, at location P1, at 10:35, the sky display elements include the sun and clouds, which are rendered and displayed in the sky area of ​​the electronic map interface.

[0171] In one implementation, determining sky display elements based on real-time weather information and real-time time information includes:

[0172] When real-time weather information indicates clear weather, the celestial elements are determined based on the time range of the real-time time information.

[0173] The rendering position of the star element is calculated based on real-time time information.

[0174] Celestial elements can include the sun or the moon. When real-time weather information indicates cloudy, rainy, or snowy weather, the sun or moon may not be visible to the naked eye in the sky at the target geographical location. However, when real-time weather information indicates clear weather, celestial elements can be determined based on the time range of the real-time information.

[0175] Because the Earth rotates from west to east on its axis. At the target geographical location, such as... Figure 8 As shown, the sun rises in the east in the morning and sets in the west in the evening, followed by the moon rising in the east and setting in the west in the morning. Therefore, based on real-time time information, it can be determined whether the target's geographical location should currently be displaying the sun or the moon.

[0176] In one implementation, determining celestial elements based on the time range of the real-time time information includes:

[0177] The sun display time range and moon display time range are determined based on real-time date information and target geographical location.

[0178] The celestial elements are determined based on the time range of the real-time time information, the time range of the sun's display, and the time range of the moon's display.

[0179] The sun's displayed time for a target geographical location can range from sunrise to sunset, while the moon's displayed time can range from sunset to sunrise. The sunrise and sunset times for a target geographical location are affected by various factors, including the specific location and the current date. Sunrise and sunset times can be obtained using a pre-defined query tool based on the target geographical location's latitude and longitude and the current date. For example, if geographical location P1 experiences sunrise at 5:20 AM and sunset at 7:18 PM on August 1, 2024, then the sun's displayed time for geographical location P1 will range from 5:20 AM to 7:18 PM, and the moon's displayed time will range from 7:19 PM to 5:19 AM.

[0180] In real-world astronomical environments, the moon doesn't always appear immediately after sunset; it often appears some time later. Therefore, the range of time the moon is visible can be between sunset time plus a predetermined buffer period and sunrise time. For example, if the predetermined buffer period is 2 hours, sunrise is at 5:20 AM, and sunset is at 7:18 PM, then the range of time the moon is visible could be from 9:19 PM to 5:19 AM.

[0181] After determining the time ranges for the sun and moon, it's possible to determine whether the real-time time information falls within the sun's or moon's time range. If the real-time time information falls within the sun's time range, the celestial element is the sun; if it falls within the moon's time range, the celestial element is the moon. For example, if the sun's time range for the target location is 5:20 to 19:18, the moon's time range is 19:19 to 5:19, and the real-time time is 10:10, then the real-time time falls within the sun's time range, and the celestial element is the sun.

[0182] After identifying the celestial elements, their rendering positions can be calculated based on real-time time information. Since the sun and moon rise in the east and set in the west, their display positions differ at different times. For example... Figure 8As shown, the sun's altitude is lower at sunrise and sunset, and highest at midday. The same applies to the moon.

[0183] In one implementation, calculating the rendering position of the star element corresponding to the star element based on real-time time information includes:

[0184] Obtain the actual celestial position corresponding to the celestial element based on real-time time information;

[0185] Calculate the azimuth and elevation angles of the target celestial body when observing the celestial elements corresponding to the target celestial body from the target geographical location, based on the actual celestial body position and the target geographical location.

[0186] The azimuth and elevation angles are used to calculate the celestial rendering position of the celestial element in the electronic map interface corresponding to the field of view information.

[0187] The actual position of a celestial body can be the position data of the target celestial body relative to Earth, corresponding to the celestial element. For example, when the celestial element is the Sun, the actual position of the celestial body corresponding to the Sun can be the solar declination angle. The solar declination angle is the angle between the Earth's equatorial plane and the line connecting the Sun and the Earth's center. This angle moves within a range of +23 degrees 26 minutes and -23 degrees 26 minutes per year. When the celestial element is the Moon, the actual position of the celestial body corresponding to the Moon can be the lunar declination angle. The lunar declination angle is the angle between the Earth's equatorial plane and the line connecting the Moon and the Earth's center. Because the Moon and the Sun's trajectories relative to Earth are similar, their declination angles are usually the same in value but opposite in sign. For example, on the same day, the solar declination angle is +22 degrees 20 minutes, and the lunar declination angle is -22 degrees 20 minutes.

[0188] Since the actual positions of celestial bodies are influenced by the Earth's rotation and revolution, as well as the motion of the celestial bodies themselves, this conforms to astronomical laws. Therefore, the actual positions of celestial bodies can be determined based on real-time time information. Specifically, a preset position calculation model can be used, and the real-time time information can be substituted into the model for calculation. For example, when calculating the solar declination angle corresponding to a solar element, the real-time time information can be substituted into a preset solar declination angle calculation model.

[0189] After determining the actual position of the celestial body, the azimuth and elevation angles of the target celestial body corresponding to the celestial element observed from the target geographical location can be calculated based on the actual celestial body position and the target geographical location.

[0190] The elevation angle of a target celestial body can be defined as the angle between the direction of sunlight incident from the target celestial body to Earth and the horizontal plane. The elevation angle determines the apparent altitude of the target celestial body at the target's location. For example... Figure 9As shown, the target celestial body is the Sun. When the Sun's path from east to west is from U to R1 to D, when the Sun reaches its highest point R1, from the target geographical location O, the solar altitude angle is the angle between the incident ray of the Sun and the map plane, which is 90 degrees. When the Sun's path from east to west is from U to R2 to D, when the Sun reaches its highest point R2, from the target geographical location O, the solar altitude angle is angle α.

[0191] The altitude angle of a target celestial body can be calculated based on its actual position and its geographical location, which can be expressed as latitude and longitude. Taking the Sun as an example... Figure 10 As shown, the actual position of the Sun, i.e., the solar declination angle, is the angle δ between the line connecting the Sun and the Earth's center and the Earth's equatorial plateau; the target geographical location is point B, and the altitude angle formed by the Sun's illumination of point B is h; based on the actual position of point B, the latitude of B can be determined as φ; θ can represent the angle between the ray of sunlight illuminating point B and the ray of sunlight directly hitting the Earth's center. Since the distance between the Sun and the Earth is relatively large, θ can be ignored. Based on the principle that the sum of the interior angles of a triangle is 180 degrees, the above parameters have the relationship shown in Formula 1:

[0192] h+90+θ+(φ-δ)=180 (Formula 1).

[0193] Since θ can be ignored, the calculation process of the elevation angle h can be expressed as Formula 2:

[0194] h = 90 - (φ - δ) (Formula 2).

[0195] In other words, the solar altitude angle can be directly calculated based on the solar declination angle and the latitude of the target's geographical location.

[0196] In another implementation, the altitude angle of the target celestial body can also be obtained by using an altitude angle calculation model, which inputs the actual position of the celestial body and the geographical location of the target into the altitude angle calculation model.

[0197] The azimuth of a target celestial body is the angle between the projection of the target celestial body's rays incident on Earth onto the horizon and the north direction of the target's geographical location. The azimuth ranges from 0 degrees to 360 degrees, where 0 degrees represents north, 90 degrees represents east, 180 degrees represents south, and 270 degrees represents west. The azimuth of a target celestial body determines its apparent position at the target's geographical location. Taking the Sun as an example... Figure 11As shown, when the sun shines directly on the target geographical location point O, the projection of the sun's incident rays onto the horizon is line segment OQ. The angle between line segment OQ and the line segment ON, which is due north of the target geographical location point O, is the solar azimuth angle observed at the target geographical location point O. When the solar azimuth angle is 120 degrees, it means that the sun is southeast of the target geographical location point O, forming a 120-degree angle with due north.

[0198] The azimuth of a target celestial body can be calculated based on its actual position, the target's geographical location, and the solar altitude angle. Taking the Sun as an example, the azimuth of the Sun as observed from the target's geographical location can be calculated based on the Sun's declination, the target's latitude and longitude, and the solar altitude angle. Specifically, an azimuth calculation model can be used, inputting the Sun's declination, the target's latitude and longitude, and the solar altitude angle into the model to calculate the azimuth of the Sun as observed from the target's geographical location.

[0199] After determining the azimuth and elevation angles when observing the target star map from the target's geographical location, the rendering positions of celestial elements in the corresponding electronic map interface can be calculated based on these angles. Calculating the rendering positions of celestial elements using azimuth and elevation angles allows the projection of celestial elements from three-dimensional space onto a two-dimensional plane.

[0200] In one implementation, calculating the rendered position of a celestial element in the electronic map interface corresponding to the field of view information based on its azimuth and elevation angles includes:

[0201] Establish a spatial rectangular coordinate system with the target geographical location as the origin. The positive direction of the x-axis points due east, the positive direction of the y-axis points due north, and the positive direction of the z-axis is perpendicular to the x-axis and the y-axis and points upward.

[0202] The three-dimensional coordinates of celestial elements in three-dimensional space are determined based on azimuth and elevation angles;

[0203] Project the three-dimensional coordinates onto the plane rectangular shape constructed by the x-axis and y-axis, and determine the two-dimensional coordinates of the celestial elements in two-dimensional space;

[0204] The rendering position of celestial elements in the electronic map interface corresponding to the field of view information is determined based on two-dimensional coordinates.

[0205] The three-dimensional coordinates of a celestial element in three-dimensional space can be represented by spherical coordinates (a, b, c), where a can represent the distance from the origin to the target celestial body, b can represent the azimuth angle, and c can represent the supplementary angle of elevation.

[0206] Converting the three-dimensional coordinates to Cartesian coordinates (x, y, z), where x = a*sin(b)*cos(c), y = a*sin(b)*sin(c), and z = a*cos(c). Ignoring the z-coordinate, projecting the Cartesian coordinates onto the xy-plane yields the two-dimensional coordinates of the target celestial body in two-dimensional space.

[0207] Since two-dimensional coordinates are calculated based on the distance between the target geographical location and the target celestial body, when determining the celestial body rendering position of the celestial body element in the electronic map interface, the electronic map interface can be regarded as a plane rectangular coordinate system. The two-dimensional coordinates can be converted into map interface coordinates according to the predetermined map scale, thereby obtaining the celestial body rendering position of the celestial body element in the electronic map interface.

[0208] Calculating the azimuth and elevation angles of target celestial bodies observed from their geographical location to determine their rendered positions on electronic maps improves the realism and accuracy of the determination.

[0209] After calculating the star rendering position corresponding to the star element based on real-time time information, based on the above implementation method, the sky display element is rendered and displayed in the electronic map interface corresponding to the field of view information, including: rendering the star element at the star rendering position in the electronic map interface corresponding to the field of view information. For example Figure 12 As shown, at 3:30 PM at location P1, the sun is trending downwards. The altitude and azimuth of the sun element at this moment will be used to render the sun element. The rendering of celestial elements can be integrated with other elements in the electronic map interface corresponding to the field of view information. For example, if there are tall buildings in the electronic map interface, when rendering celestial elements, it can be considered whether the building elements obstruct the celestial elements, thus integrating the celestial elements with the building elements in the rendering.

[0210] In one implementation, celestial elements are rendered at their rendering locations on the electronic map interface corresponding to the field of view information, including:

[0211] Determine the target sky pattern based on real-time time information;

[0212] The star elements are blended with the target sky style based on the star rendering position to obtain a sky image;

[0213] The sky image is displayed at the sky display location in the electronic map interface corresponding to the field of view information.

[0214] On a clear day, the sky can appear different at different times of the day. The order of sky effects throughout the day can be: dawn, sunrise, early morning, morning, noon, afternoon, evening, dusk, and night. The visual effects of the sky differ at different times. For example, from 5:00 to 7:00 AM is sunrise; as the sun rises, the sky turns orange-red, and the sunlight is soft and warm. From 9:00 to 11:00 AM is morning; the sun rises, and the sky is blue with white clouds. From 3:00 PM to 7:00 PM is dusk; as the sun sets, the sky gradually transitions from orange, red, purple, or a mixture of colors, the sunlight appears golden, and the clouds show a layered structure. Therefore, in the rendering process of electronic map applications, different sky effects correspond to different sky styles, for example... Figure 13 As shown, from top to bottom, the sky patterns can represent dawn, sunrise, early morning (morning, noon, afternoon), evening, dusk, and night.

[0215] In the electronic map interface, the target sky pattern corresponding to the current sky effect can be determined based on real-time time information. Different target sky patterns directly correspond to different time ranges. For example, dawn corresponds to the time range of 4:01-5:30, sunrise to 5:31-7:00, early morning to 7:01-9:30, morning to 9:31-11:00, noon to 11:01-13:00, afternoon to 13:01-16:30, evening to 16:31-18:00, dusk to 18:01-19:30, and night to 19:31-4:00. When the real-time time information indicates that the current time is 6:30, the sky pattern corresponding to sunrise can be obtained as the target sky pattern.

[0216] After obtaining the target sky style, star elements can be merged with the target sky style based on the star rendering positions. Specifically, the target sky style can be used as a base map, and star map elements can be added to the map according to the star rendering positions to obtain a sky image; finally, the sky image is displayed at the sky display position in the electronic map interface corresponding to the field of view information. For example... Figure 14 As shown, the sun element is rendered onto the target sky style corresponding to sunrise to obtain a sky image, and then the sky image is displayed in the sky display position in the target map interface.

[0217] Determining the target sky style and blending the celestial rendering elements with it allows the electronic map interface to display the current sky shape, making the sky display more consistent with the actual sky scene of the target geographical location and improving the user experience of electronic map applications.

[0218] In another implementation, the celestial element is the moon element. Before rendering the celestial element at the celestial rendering position in the electronic map interface corresponding to the field of view information, the process includes: obtaining real-time date information and determining the lunar phase information based on the real-time date information. Therefore, rendering the celestial element at the celestial rendering position in the electronic map interface corresponding to the field of view information includes: rendering the moon element at the celestial rendering position in the electronic map interface corresponding to the field of view information based on the lunar phase information.

[0219] Lunar phases indicate the shape the moon appears to Earth when illuminated by the sun. As the moon moves a significant distance across the sky from east to west each day, its shape constantly changes; this is known as lunar phase variation. The moon shines by reflecting sunlight, therefore, its appearance on Earth varies depending on its relative position to the sun. Lunar phases are cyclical, with an average cycle of 29.5306 days. Within a single cycle, the moon's shape is different each day. Figure 15 As shown, the lunar phases change in the following order: New Moon (the dark side of the moon is away from the sun and is almost invisible, the first phase in the image), Crescent Moon (a sickle-shaped moon with its convex side facing the sun in the west), First Quarter Moon (a semicircular moon with its bright side facing west), Waxing Gibbon (the area of ​​the moon visible on its eastern side increases), Full Moon (a round moon with its entire bright side facing the earth), Waxing Gibbon (the convex side of the moon faces east, and the western part becomes dark), Last Quarter Moon (a semicircular moon with its bright side facing east), Waning Crescent Moon (a sickle-shaped moon with its convex side facing the sun in the east), and New Moon (almost invisible).

[0220] Since the changes in lunar phases follow a time-bound pattern, lunar phase information can be determined based on real-time date information. For example, according to the lunar phase cycle, the lunar phase on August 1, 2024, should be a waning crescent, and the lunar phase on August 10, 2024, should be a first quarter crescent.

[0221] After determining the lunar phase information, the moon element can be rendered based on its rendering position on the electronic map interface corresponding to the field of view. The moon's rendering position varies at different times on the same date. Therefore, rendering the moon requires considering both its phase and position. For example, Figure 16 The diagram shows the moon's position in the same place as it changes from new moon to full moon, measured in days. Figure 17 The diagram shown illustrates the hourly changes in the moon's altitude throughout the night.

[0222] For example, when the moon phase information is convex, the moon element is rendered according to the convex shape of the moon at its rendering position, such as... Figure 18AAs shown; when the moon phase information is full moon, the moon element is rendered according to the full moon's shape and its rendering position, such as... Figure 18B As shown.

[0223] Determining the lunar phase information and rendering the moon element based on the lunar phase information in the celestial rendering position in the electronic map interface can more accurately display the current shape of the moon, improve the accuracy of the real environment restoration of the target geographical location in the electronic map interface, and thus improve the user experience of the object using the electronic map application.

[0224] In clear weather, determining the celestial elements and their rendering positions allows the celestial elements to be displayed in the correct locations on the electronic map interface based on real-time information, improving the accuracy of determining sky display elements on the electronic map interface.

[0225] In cloudy weather, the sky image can directly display the sky display style corresponding to overcast weather.

[0226] In an electronic map interface, the sky display element can be rendered and can include various types of elements, such as star elements, dynamic elements, and sky color elements. Dynamic elements include... Figure 19 As shown, it can include dynamic clouds, birds, meteors, auroras, etc.; celestial elements such as Figure 20 As shown, it can include the display of the sun, moon, and stars; sky elements, such as... Figure 21 As shown, it can include skyline color and sky color, etc.

[0227] Sky elements are rendered and displayed in the electronic map interface corresponding to the field of view information, so that the content displayed in the electronic map interface is closer to the actual environment of the target geographical location, thus improving the user experience of the electronic map application.

[0228] Step 330: Determine the meteorological display elements based on real-time meteorological information and real-time environmental images.

[0229] Weather display elements can be elements used in electronic map interfaces to represent weather information. For example, when real-time weather information indicates that the target geographical location is currently experiencing heavy snow, the weather display elements can include snowflake elements. Weather display elements can be static, such as snow piled up on the ground; or they can be dynamic, such as drifting snowflakes.

[0230] Each weather condition may involve multiple weather display elements. For example, if real-time weather information indicates heavy snow at a target location, the corresponding weather display elements could include snowflakes and snow accumulation. Snow accumulation elements can have different types depending on the display location, such as vegetation snow accumulation, building snow accumulation, and road snow accumulation. Real-time environmental images can be used to determine which weather display elements corresponding to the real-time weather information should be displayed on the electronic map interface corresponding to the target location. For example, when real-time weather information indicates heavy snow at a target location with snow accumulation, and snow accumulation on roads can be identified from the real-time environmental image, then the determined weather display elements could include snowflakes and road snow accumulation. Since vegetation and building targets are not identified from the real-time environmental image, vegetation snow accumulation and building snow accumulation elements do not need to be displayed.

[0231] In one implementation, meteorological display elements are determined based on real-time meteorological information and real-time environmental images, including:

[0232] At least one meteorological display element is determined based on real-time environmental images and real-time meteorological information;

[0233] The rendering position of each weather display element is determined based on real-time environmental images.

[0234] When determining meteorological display elements, multiple candidate meteorological display elements corresponding to the real-time meteorological information can first be identified. For example, if the real-time meteorological information indicates heavy snow, then the candidate meteorological display elements may include: dynamic snowflake elements, vegetation snow accumulation elements, building snow accumulation elements, and road snow accumulation elements, etc. At least one meteorological display element is then determined from these multiple candidate elements by performing target recognition on the real-time environmental image. For example, target recognition on the real-time environmental image may identify large fluttering snowflakes, snow accumulation on vegetation, and snow accumulation on buildings. Therefore, the determined meteorological display elements may include dynamic snowflake elements, vegetation snow accumulation elements, and building snow accumulation elements.

[0235] After identifying the meteorological display elements, the rendering position of each meteorological display element on the corresponding electronic map display interface can be determined based on its location in the real-time environmental image. For example, if the real-time environmental image includes large flakes of drifting snowflakes, the rendering position of the dynamic snowflake element could be the entire interface; or, for instance, if there are three lanes on a highway at the target geographical location, and the real-time environmental image indicates that there is snow accumulation in the middle lane, then the rendering position of the highway snow accumulation element could be placed on the middle lane.

[0236] Real-time environmental images can be used to determine the rendering location of weather display elements. This allows the rendered electronic map interface to more accurately reproduce the actual weather conditions of the target geographical location, improving the accuracy of the rendering of the actual weather conditions on the electronic map interface. This enables users to plan their trips based on the electronic map interface, enhancing their user experience.

[0237] Step 340: Determine multiple base map elements based on the field of view information, and render and display the electronic map interface corresponding to the field of view information according to the meteorological display elements and the multiple base map elements.

[0238] Base map elements can be elements related to the displayed target geographic location as described in the field of view information. Examples include building elements, vegetation elements, road elements, and landmark elements. Base map elements can be pre-generated in the element database corresponding to the electronic map application and can be directly accessed. The element database can store various elements generated based on the actual environment.

[0239] After acquiring the base map elements, weather display elements can be merged and rendered with multiple map elements to obtain the electronic map interface corresponding to the field of view information. For example, weather display elements include dynamic snowflake elements and snow accumulation elements, while base map elements include building elements, vegetation elements, and road elements. This allows the snow accumulation elements to be merged and rendered separately with building elements, vegetation elements, and road elements, thus presenting the effect of snow accumulation on buildings, vegetation, and roads; alternatively, dynamic snowflake elements can be rendered across the entire electronic map interface to achieve a heavy snow effect. The rendered electronic map interface can be displayed as follows: Figure 22 As shown.

[0240] In one embodiment of step 330, the rendering position of each meteorological display element can be determined based on a real-time environmental image. Based on this, in one embodiment, an electronic map interface corresponding to the field of view information is rendered based on the meteorological display elements and multiple base map elements, including:

[0241] The electronic map interface is rendered and displayed based on at least one meteorological display element, the rendering location, and multiple base map elements, corresponding to the field of view information.

[0242] After determining the rendering location, the weather display elements and the base map elements can be merged and rendered based on the rendering location.

[0243] In one implementation, an electronic map interface corresponding to the field of view information is rendered and displayed based on at least one meteorological display element, a rendering location, and multiple base map elements, including:

[0244] Determine multiple target basemap elements among multiple basemap elements based on their rendering locations;

[0245] Each meteorological display element is fused with its corresponding target base map element, and the fused element is rendered and displayed to obtain the electronic map interface corresponding to the field of view information.

[0246] When blending weather display elements with base map elements, the specific map element to be blended with each weather display element can be determined based on the rendering location. For example, weather display elements may include road snow accumulation elements, whose corresponding rendering location is the middle lane of a highway. Each lane can correspond to an independent base map element. Therefore, the base map element corresponding to the middle lane can be used as the target base map element for the road snow accumulation element, and the road snow accumulation element can be blended with the base map element corresponding to the middle lane for rendering.

[0247] Dynamic rain and snowflake elements are displayed dynamically within the entire electronic map interface. Therefore, for these weather display elements, the interface view of the electronic map can be used as the target base map element. In this way, the weather display elements can be added to the interface view to achieve the effect of rain or snow.

[0248] By merging the target base map element corresponding to the rendering location with the weather display element, the accuracy of rendering the weather display element and the base map element according to the rendering location is improved.

[0249] In scenarios where electronic maps are used for navigation, after fusing base map elements with weather display elements based on the rendered location, the electronic map navigation system can also trigger navigation prompts based on the rendered location to alert users to dangers and help them plan routes in a timely manner. For example, if the weather display element is a snow accumulation on a road, and its rendered location is the middle lane, then after fusing the snow accumulation element with the map element corresponding to the middle lane, a navigation prompt can be triggered based on the distance between the snow accumulation location and the real-time location, such as "Snow accumulation in the middle lane 100 meters ahead, please be careful." This improves the accuracy of electronic map navigation, facilitates route planning, and enhances the user experience when using electronic maps for navigation.

[0250] By merging base map elements with meteorological display elements based on the rendering location, the rendered electronic map interface can better match the actual environment of the target geographical location, improve the accuracy of meteorological information displayed in the electronic map, and enhance the user experience of the electronic map application.

[0251] During the fusion rendering of meteorological display elements and base map elements, the display intensity of meteorological display elements can be determined based on real-time meteorological information. Display intensity indicates the display effect of meteorological display elements. For example, the amount of water accumulation corresponding to water accumulation elements, and the amount and dynamic speed of rainfall corresponding to rain elements. When real-time meteorological information indicates that the target geographical location is experiencing heavy to torrential rain, the rendered water accumulation in the electronic map interface corresponding to the field of view is larger, the particle density of rain elements is higher, and the rain particles fall faster. Conversely, when real-time meteorological information indicates that the target geographical location is experiencing light rain, the water accumulation is smaller, the particle density of rain elements is lower, and the rain particles fall slower.

[0252] In summary, the electronic map display method of this disclosure renders the electronic map interface based on the selected field of view information in the electronic map application, and determines the real-time meteorological information of the target geographical location using real-time environmental images and weather forecast data corresponding to the field of view information. Thus, the real-time meteorological information is obtained through a comprehensive analysis of satellite meteorological forecasts and actual environmental conditions, resulting in high accuracy. After determining the real-time meteorological information, meteorological display elements are determined based on the real-time meteorological information and real-time environmental images. This allows the meteorological display elements to more accurately match the actual environment of the target geographical location, and the electronic map interface rendered by jointly displaying the meteorological display elements and multiple base map elements can more accurately reproduce the meteorological environment of the target geographical location. In other words, the electronic map display method of this disclosure can obtain accurate real-time meteorological information, and based on this, can accurately render an electronic map interface that can reproduce the actual meteorological environment of the target geographical location. Therefore, the electronic map display method of this disclosure can improve the accuracy of displaying meteorological information in electronic maps.

[0253] This disclosure provides a detailed description of embodiments in conjunction with specific application scenarios.

[0254] like Figure 23 The diagram shown illustrates the specific process of applying the electronic map display method provided in this disclosure to an in-vehicle electronic map navigation scenario. The following section combines... Figure 24 The methods for displaying electronic maps are explained in detail below:

[0255] Step 2301: Obtain the field of view information from the in-vehicle electronic map application, and determine the target's geographical location based on the field of view information.

[0256] In-vehicle electronic map applications can be used for map display and route navigation while driving. Field of view information can refer to the range and viewing angle displayed on the in-vehicle electronic map interface. This field of view information can be the field of view corresponding to the vehicle's current geographical location, or it can be a field of view selected by the user. For example, if the user is at geographical location P1, the in-vehicle electronic map application can display the field of view information corresponding to geographical location P1 by default; if the user wants to view the geographical environment of geographical location P2, they can select the field of view information corresponding to geographical location P2 within the in-vehicle electronic map application.

[0257] The target geographic location corresponding to the field of view information can be the vehicle's current geographic location or a geographic location selected by the object. When the object does not select a geographic location but instead views a certain range of geographic environment by dragging the electronic map interface, the central geographic location in the electronic map interface can be determined based on the field of view information and used as the target geographic location. When the object changes the field of view displayed in the electronic map interface, the target geographic location will also change accordingly.

[0258] Step 2302: Obtain real-time environmental images and weather forecast data of the target geographical location.

[0259] In-vehicle electronic map applications can obtain weather forecast data for a target geographical location from weather forecast networks. The weather forecast data provided by these networks is based on meteorological data observed by meteorological stations, meteorological satellites, and weather radars. These networks can then return the weather forecast data for the target geographical location to the in-vehicle electronic map application.

[0260] Real-time environmental images of the target geographic location can be obtained by a camera capture device connected to a vehicle-mounted terminal. Since the camera capture device may be obstructed by trees or buildings, it can continuously capture multiple real-time environmental images of the target geographic location for use in weather identification.

[0261] Step 2303: Use a meteorological classification network to extract features from real-time environmental images to obtain weather features and road condition features; classify based on weather features and road condition features to obtain multiple first-class probabilities corresponding to multiple meteorological categories.

[0262] After acquiring real-time environmental images, in-vehicle electronic map applications can input these images into a meteorological classification network for meteorological classification. This meteorological classification network can be a neural network model.

[0263] Weather features can be characteristics used to indicate the weather. For example, on a sunny day, the sunlight is strong and the cloud cover is relatively thin; on a rainy day, the sunlight is weak, the cloud cover is thick and dark in color, and raindrops are visible in the image. Weather features can include: cloud features (shape, size, texture, and color of clouds, etc.), light features (sunlight intensity, direction of sunlight, and shadow distribution, etc.), weather sign features (e.g., raindrops representing rain, snowflakes representing snow, dust representing a sandstorm, etc.), and indirect weather features (e.g., umbrellas, people wearing raincoats, etc.). Road condition features can indicate the road conditions at a target geographical location, such as whether there is snow or water on the road. Road condition features can include: road surface features, vegetation features, and building features, etc.

[0264] Feature extraction from real-time environmental images using a meteorological classification network can include: denoising and improving the contrast of real-time environmental images; segmenting the background and foreground of real-time environmental images to obtain multiple feature layers; and extracting features from multiple feature layers to obtain weather features and road condition features.

[0265] After training, the meteorological classification network can learn feature patterns under different weather categories. For example, features corresponding to rainy days include: dark gray clouds, thick clouds, weak sunlight, road puddles, raindrops, and umbrellas. Therefore, the pre-set neural network model can determine the meteorological classification information corresponding to the real-time environmental image based on the weather features and road condition features extracted from the real-time environmental image.

[0266] Meteorological classification information can include multiple primary category probabilities corresponding to multiple meteorological categories. The primary category probabilities can be the probability of each meteorological category occurring, calculated based on real-time environmental images, for example, sunny: 90%, cloudy: 50%, rainy: 5%, and so on.

[0267] Step 2304: Determine multiple second-category probabilities for multiple meteorological categories from weather forecast data; determine real-time meteorological information corresponding to the target geographical location based on multiple first-category probabilities and multiple second-category probabilities.

[0268] Weather forecast data can include multiple secondary category probabilities for various predicted weather categories. In-vehicle electronic map applications can determine real-time weather information corresponding to a target geographical location based on multiple primary category probabilities and multiple secondary category probabilities for multiple weather categories.

[0269] Specifically, a first weight corresponding to meteorological classification information and a second weight corresponding to weather forecast data can be obtained. Based on the first and second weights, multiple first-category probabilities and multiple second-category probabilities are weighted and calculated to determine the real-time meteorological information corresponding to the target geographical location. The first and second weights can respectively indicate the influence of meteorological classification information and weather forecast data on determining the real-time meteorological information of the target geographical location. The first and second weights can be preset. After weighted calculation, the real-time meteorological information corresponding to the target geographical location can be determined based on the prediction scores of multiple meteorological categories.

[0270] Step 2305: Does the real-time weather information indicate sunny weather?

[0271] After determining real-time weather information, in-vehicle electronic map applications can input this information into a display strategy determination network. The function of this network is to determine the display strategy for the field of view information on the electronic map interface, such as sky display strategy and weather display strategy.

[0272] The preferred method for determining the display strategy network is to assess whether real-time weather information indicates that the target geographical location has sunny weather. If the target geographical location has sunny weather, proceed to step 2306; otherwise, proceed to step 2312.

[0273] Step 2306: Determine the celestial elements and their rendering positions based on real-time time information.

[0274] When real-time weather information indicates that the target location has clear weather, celestial elements can be displayed in the sky. These celestial elements can be the sun, the moon, or other similar objects.

[0275] Because the celestial elements displayed in the sky differ at different times—for example, the sun is only visible during the day, while the moon is only visible at night—the celestial elements to be displayed can be determined based on real-time time information. The time ranges for day and night can be preset; for example, 6:00 AM to 7:59 PM is defined as daytime, and 8:00 PM to 5:59 AM the following day is defined as nighttime. Therefore, when the real-time time information falls within the daytime range, the celestial element displayed is the sun; when the real-time time information falls within the nighttime range, the celestial element displayed is the moon.

[0276] Due to the Earth's rotation and revolution, both the sun and moon rise in the east and set in the west. Therefore, the sun's position changes continuously during the day, and the moon's position changes continuously at night. To improve the user experience, the rendering position of celestial elements on the corresponding electronic map interface can be determined based on the actual displayed positions of the sun and moon at the target geographical location. The actual displayed positions of the sun and moon at the target geographical location are determined by real-time time information.

[0277] Specifically, the actual position of the celestial element can be obtained based on real-time time information. When the celestial element is the Sun, the actual position can be the solar declination angle; when the celestial element is the Moon, the actual position can be the lunar declination angle. Based on the actual celestial position and the target geographical location, the azimuth and elevation angles of the target celestial element when observed from the target geographical location are calculated. Finally, the rendered position of the celestial element in the electronic map interface corresponding to the field of view information is calculated based on the azimuth and elevation angles.

[0278] Step 2307: Determine the target sky pattern based on real-time time information.

[0279] On a clear day, the sky can appear different at different times of the day. The order of sky appearance throughout the day can be: dawn, sunrise, early morning, morning, noon, afternoon, evening, dusk, and night. The visual effects of the sky differ at each time of day. Therefore, different sky styles can be used for different time periods. When determining the target sky style based on real-time time information, the target time period to which the real-time time information belongs can be identified, and the sky style corresponding to the target time period can be designated as the target sky style.

[0280] Step 2308: Is the celestial element the Moon?

[0281] Since the moon's appearance is affected by sunlight, its observed form on Earth varies depending on the relative positions of the sun, moon, and Earth. Therefore, to improve the realism of the sky image, step 2309 can be executed when the celestial element is the moon; otherwise, step 2311 can be executed.

[0282] Step 2309: Determine the lunar phase information based on the real-time date information.

[0283] Lunar phases indicate the shape the moon appears to Earth when illuminated by the sun. As the moon moves a considerable distance across the sky from east to west each day, its shape constantly changes; this is known as lunar phase variation. The moon shines by reflecting sunlight, therefore, its appearance on Earth varies depending on its relative position to the sun. Lunar phases are cyclical, with an average cycle of 29.5306 days. Within a single cycle, the moon's shape is different each day.

[0284] Since the changes in lunar phases follow a time-varying pattern, lunar phase information can be determined based on real-time date information.

[0285] The celestial elements, celestial rendering positions, target sky style, and lunar phase information determined in steps 2306-2309 above are all determined by the determination display strategy network. After the determination display strategy network determines the above sky information, it can send it to the element rendering network, which then performs the sky image rendering in steps 2310-2312 below. The element rendering network retrieves display elements from the display element library and performs the corresponding rendering.

[0286] Step 2310: Render the moon and the target sky pattern based on the lunar phase information to obtain a sky image.

[0287] After determining the lunar phase information, the moon shape indicated by the lunar phase information can be fused and rendered with the target sky pattern to obtain a sky image.

[0288] When performing blending rendering, the moon element can be blended into the position corresponding to the target sky style according to the rendering position of the element corresponding to the moon, so as to obtain the sky image.

[0289] Step 2311: Blend and render the celestial elements with the target sky style to obtain a sky image.

[0290] When the celestial element is not the moon, the celestial element can be blended into the position corresponding to the target sky style according to the element rendering position of the celestial element to obtain the sky image.

[0291] Step 2312: Display the sky image based on the cloudy sky style.

[0292] When real-time weather information indicates cloudy weather, the sky should be overcast. Therefore, we can obtain the cloud weather pattern and display the sky image based on the cloud weather pattern.

[0293] Step 2313: Determine at least one meteorological display element based on the real-time environmental image and real-time meteorological information; determine the rendering position of each meteorological display element based on the real-time environmental image.

[0294] The element rendering network can also determine meteorological display elements based on real-time weather information and real-time environmental images. Meteorological display elements can be elements used in electronic map interfaces to represent weather information. For example, when real-time weather information indicates that the target geographical location is currently experiencing heavy snow, the meteorological display elements may include snowflake elements. Meteorological display elements can be static, such as accumulated snow on the ground; or dynamic, such as drifting snowflakes.

[0295] After identifying the meteorological display elements, the rendering position of each meteorological display element on the electronic map display interface corresponding to the field of view can be determined based on the location of the meteorological display elements in the real-time environmental image. For example, if it is determined from the real-time environmental image that there is snow on the vegetation, the rendering position of the snow can be determined as the vegetation.

[0296] Step 2314: Determine multiple base map elements based on the field of view information, render and display the electronic map interface corresponding to the field of view information according to at least one meteorological display element, the rendering position and multiple base map elements, and display the sky image at the sky display position corresponding to the electronic map interface.

[0297] The element rendering network can determine multiple base map elements based on the field of view information and obtain base map elements and meteorological display elements through a display element library. Based on the rendering location, the corresponding meteorological display elements and the corresponding base map elements are fused and rendered to obtain the electronic map interface corresponding to the field of view information. The sky display location in the electronic map interface can display the sky image obtained in steps 2310-2312 above, depending on the specific situation.

[0298] The process of rendering elements based on meteorological information using a network rendering technique can be described as follows: Figure 25 As shown. First, the meteorological information is obtained based on real-time meteorological information, real-time time information, and the target's geographical location. For example, the meteorological information includes: the moon, the moon's azimuth angle, the moon's altitude angle, clear weather, and full moon. Based on the above meteorological information, the celestial elements, target sky elements, and clear weather display elements required for rendering can be determined. The corresponding meteorological display elements, target sky styles, and base map elements are obtained from the display element library. The sky image is obtained by rendering based on the target sky style and the moon's rendering position. Then, the meteorological display elements and base map elements are rendered based on the rendering position to obtain the electronic map interface corresponding to the field of view information.

[0299] The electronic map display method of this disclosure can be flexibly applied to different weather conditions. For example, it can display images such as... Figure 26A The electronic map interface shown is triggered when the real-time weather information indicates rain. Rain scenarios include: showers, thunderstorms, light rain, moderate rain, heavy rain, and downpours. The amount and speed of rainfall displayed on the electronic map interface can be adjusted for different types of rain scenarios. In snowy weather, the following can be obtained: Figure 26B The electronic map interface shown is available. It can be triggered when real-time weather information indicates snow. Snow scenarios include: snow, light snow, moderate snow, heavy snow, and blizzard. For different types of snow scenarios, the amount of snow and the speed of snowfall displayed on the electronic map interface can be adjusted. In dusty weather, the following can be obtained: Figure 26CThe electronic map interface shown. The dust particle density can be adjusted within the electronic map interface according to the dust intensity.

[0300] Therefore, the electronic map display method of this disclosure, when applied to in-vehicle electronic map navigation scenarios, can improve the accuracy of real-time weather information displayed by the in-vehicle electronic map application on the target geographical location. This allows users to plan their trips based on the weather information displayed in the in-vehicle electronic map application, thus improving the user experience of using the in-vehicle electronic map application.

[0301] Description of apparatus and devices according to embodiments of this disclosure

[0302] It is understood that although the steps in the above flowcharts are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated in this embodiment, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the above flowcharts may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages in other steps.

[0303] It should be noted that in various specific embodiments of this application, when processing is required based on data related to the characteristics of the target content, such as target content attribute information or attribute information sets, permission or consent from the target content provider will be obtained first. Furthermore, the collection, use, and processing of this data will comply with relevant laws, regulations, and standards. In addition, when embodiments of this application require obtaining target content attribute information, separate permission or consent from the target content provider will be obtained through pop-ups or redirection to a confirmation page. Only after obtaining the separate permission or consent from the target content provider will the necessary target content-related data for the normal operation of the embodiments of this application be obtained.

[0304] Figure 27 A schematic diagram of the structure of an electronic map display device 2700 provided in an embodiment of this disclosure. The electronic map display device 2700 includes:

[0305] The acquisition unit 2710 is used to acquire field of view information in electronic map applications and determine the target's geographical location based on the field of view information;

[0306] The first determining unit 2720 is used to acquire real-time environmental images collected at the target geographical location, and determine the real-time meteorological information corresponding to the target geographical location based on the real-time environmental images and weather forecast data.

[0307] The second determining unit 2730 is used to determine meteorological display elements based on real-time meteorological information and real-time environmental images;

[0308] The first rendering unit 2740 is used to determine multiple base map elements based on the field of view information, and to render and display the electronic map interface corresponding to the field of view information according to the meteorological display elements and the multiple base map elements.

[0309] Optionally, the second determining unit 2730 is specifically used for:

[0310] At least one meteorological display element is determined based on real-time environmental images and real-time meteorological information;

[0311] The rendering position of each weather display element is determined based on real-time environmental images;

[0312] The first rendering unit 2740 is specifically used for:

[0313] The electronic map interface is rendered and displayed based on at least one meteorological display element, the rendering location, and multiple base map elements, corresponding to the field of view information.

[0314] Optionally, in one embodiment, the first rendering unit 2740 is specifically used for:

[0315] Determine multiple target basemap elements among multiple basemap elements based on their rendering locations;

[0316] Each meteorological display element is fused with its corresponding target base map element, and the fused element is rendered and displayed to obtain the electronic map interface corresponding to the field of view information.

[0317] Optionally, in one embodiment, the electronic map display device 2700 further includes:

[0318] The third determining unit (not shown) is used to determine the sky display elements based on real-time meteorological information and real-time time information;

[0319] The second rendering unit (not shown) is used to render and display sky display elements in the electronic map interface corresponding to the field of view information.

[0320] Optionally, in one embodiment, the third determining unit (not shown) is specifically used for:

[0321] When real-time weather information indicates clear weather, the celestial elements are determined based on the time range of the real-time time information.

[0322] Calculate the rendering position of the star element based on real-time time information;

[0323] The second rendering unit (not shown) is specifically used for:

[0324] In the electronic map interface corresponding to the field of view information, the star elements are rendered at the star rendering positions.

[0325] Optionally, in one embodiment, the third determining unit (not shown) is specifically used for:

[0326] Obtain the actual celestial position corresponding to the celestial element based on real-time time information;

[0327] Calculate the azimuth and elevation angles of the target celestial body when observing the celestial elements corresponding to the target celestial body from the target geographical location, based on the actual celestial body position and the target geographical location.

[0328] The azimuth and elevation angles are used to calculate the celestial rendering position of the celestial element in the electronic map interface corresponding to the field of view information.

[0329] Optionally, in one embodiment, the electronic map display device 2700 further includes:

[0330] The fourth determining unit (not shown) is specifically used to acquire real-time date information and determine the lunar phase information based on the real-time date information;

[0331] The second rendering unit (not shown) is specifically used for:

[0332] The moon element is rendered in the electronic map interface corresponding to the field of view based on the lunar phase information, where the stars are rendered.

[0333] Optionally, in one implementation, the second rendering unit (not shown) is specifically used for:

[0334] Determine the target sky pattern based on real-time time information;

[0335] The star elements are blended with the target sky style based on the star rendering position to obtain a sky image;

[0336] The sky image is displayed at the sky display location in the electronic map interface corresponding to the field of view information.

[0337] Optionally, in one embodiment, the first determining unit 2720 is specifically used for:

[0338] A pre-defined neural network model is used to classify real-time environmental images to obtain meteorological classification information;

[0339] Real-time meteorological information corresponding to the target's geographical location is determined based on meteorological classification information and weather forecast data.

[0340] Optionally, in one embodiment, the first determining unit 2720 is specifically used for:

[0341] The system uses a pre-defined neural network model to extract features from real-time environmental images, obtaining weather features and road condition features.

[0342] Meteorological classification information is obtained by classifying weather characteristics and road conditions.

[0343] Optionally, in one implementation, the meteorological classification information includes multiple first category probabilities corresponding to multiple meteorological categories;

[0344] The first determining unit 2720 is specifically used for:

[0345] Determine multiple secondary category probabilities from multiple meteorological categories in weather forecast data;

[0346] Real-time meteorological information corresponding to the target geographical location is determined based on multiple first-class probabilities and multiple second-class probabilities.

[0347] Optionally, in one embodiment, the first determining unit 2720 is specifically used for:

[0348] Obtain the first weight corresponding to meteorological classification information and the second weight corresponding to weather forecast data;

[0349] Based on the first weight and the second weight, multiple first-category probabilities and multiple second-category probabilities are weighted and calculated to determine the real-time meteorological information corresponding to the target geographical location.

[0350] Reference Figure 28 , Figure 28 To implement the structural block diagram of a portion of the terminal 140 in this embodiment of the present disclosure, the terminal includes: a radio frequency (RF) circuit 2810, a memory 2815, an input unit 2830, a display unit 2840, a sensor 2850, an audio circuit 2860, a wireless fidelity (WiFi) module 2870, a processor 2880, and a power supply 2890, among other components. Those skilled in the art will understand that... Figure 28 The terminal 140 structure shown does not constitute a limitation on a mobile phone or computer, and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0351] The RF circuit 2810 can be used to receive and transmit signals during information transmission or calls. In particular, it receives downlink information from the base station and processes it with the processor 2880; in addition, it transmits uplink data to the base station.

[0352] The memory 2815 can be used to store software programs and modules. The processor 2880 executes various functional applications of the content terminal and displays electronic maps by running the software programs and modules stored in the memory 2815.

[0353] The input unit 2830 can be used to receive input numeric or character information, and to generate key signal inputs related to the settings and function control of the content terminal. Specifically, the input unit 2830 may include a touch panel 2831 and other input devices 2832.

[0354] The display unit 2840 can be used to display input or provided information, as well as various menus of the content terminal. The display unit 2840 may include a display panel 2841.

[0355] Audio circuitry 2860, speaker 2861, and microphone 2862 provide an audio interface.

[0356] In this embodiment, the processor 2880 included in the object terminal 140 can execute the electronic map display method of the previous embodiment.

[0357] The target terminal 140 in this disclosure includes, but is not limited to, mobile phones, computers, intelligent voice exchange devices, smart home appliances, vehicle terminals, and aircraft. This invention can be applied to various scenarios, including but not limited to electronic navigation and human-computer interaction.

[0358] Figure 29 This is a partial structural block diagram of a server 110 implementing an embodiment of the present disclosure. The server 110 can vary significantly due to different configurations or performance characteristics, and may include one or more central processing units (CPUs) 2922 (e.g., one or more processors) and memory 2932, and one or more storage media 2930 (e.g., one or more mass storage devices) for storing application programs 2942 or data 2944. The memory 2932 and storage media 2930 may be temporary or persistent storage. The program stored in the storage media 2930 may include one or more modules (not shown in the diagram), each module including a series of instruction operations on the server. Furthermore, the CPU 2922 may be configured to communicate with the storage media 2930 and execute the series of instruction operations stored in the storage media 2930 on the server.

[0359] Server 110 may also include one or more power supplies 2926, one or more wired or wireless network interfaces 2950, ​​one or more input / output interfaces 2958, and / or one or more operating systems 2941, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, etc.

[0360] The central processing unit 2922 in server 110 can be used to execute the electronic map display method of the present disclosure embodiments.

[0361] This disclosure also provides a computer-readable storage medium for storing program code for executing the electronic map display methods of the foregoing embodiments.

[0362] This disclosure also provides a computer program product comprising a computer program. The processor of an electronic device reads and executes the computer program, causing the electronic device to perform the above-described method for displaying an electronic map.

[0363] The terms “first,” “second,” “third,” “fourth,” etc. (if present) in this disclosure and the foregoing drawings are used to distinguish similar terms and are not necessarily used to describe a particular order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this disclosure described herein can be implemented, for example, in orders other than those illustrated or described herein. Furthermore, the terms “comprising” and “including,” and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that includes a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatuses.

[0364] It should be understood that in this disclosure, "at least one item" refers to one or more items, and "more than one item" refers to two or more items. "And / or" is used to describe the relationship between related content, indicating that three relationships can exist. For example, "A and / or B" can represent three cases: only A exists, only B exists, and both A and B exist simultaneously, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related content are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, and c can be single or multiple.

[0365] It should be understood that in the description of the embodiments disclosed herein, "multiple" means two or more, "greater than", "less than", "exceeding" etc. are understood to exclude the number itself, and "above", "below", "within" etc. are understood to include the number itself.

[0366] In this disclosure, the terms "module" or "unit" refer to a computer program or part of a computer program that has a predetermined function and works with other related parts to achieve a predetermined goal, and can be implemented wholly or partially using software, hardware (such as processing circuitry or memory), or a combination thereof. Similarly, a processor (or multiple processors or memory) can be used to implement one or more modules or units. Furthermore, each module or unit can be part of an overall module or unit that includes the functionality of that module or unit.

[0367] In the several embodiments provided in this disclosure, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces, indirect coupling or communication connection between apparatuses or units, and may be electrical, mechanical, or other forms.

[0368] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0369] Furthermore, the functional units in the various embodiments of this disclosure can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0370] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this disclosure, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this disclosure. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0371] It should also be understood that the various implementation methods provided in this disclosure can be combined arbitrarily to achieve different technical effects.

[0372] The above is a detailed description of the embodiments of this disclosure. However, this disclosure is not limited to the above embodiments. Those skilled in the art can make various equivalent modifications or substitutions without departing from the spirit of this disclosure. All such equivalent modifications or substitutions are included within the scope defined by the claims of this disclosure.

Claims

1. A display method of an electronic map, characterized by, The method comprises: obtaining field of view information in an electronic map application, and determining a target geographical location based on the field of view information; obtaining a real-time environment image collected at the target geographical location, and determining real-time weather information corresponding to the target geographical location based on the real-time environment image and weather forecast data; determining a weather display element according to the real-time weather information and the real-time environment image; determining a plurality of base map elements based on the field of view information, and rendering and displaying an electronic map interface corresponding to the field of view information according to the weather display element and the plurality of base map elements.

2. The method of claim 1, wherein, The method comprises: determining at least one weather display element according to the real-time environment image and real-time weather information; determining a rendering position of each weather display element based on the real-time environment image; The method comprises: rendering and displaying the electronic map interface corresponding to the field of view information according to the at least one weather display element, the rendering position, and the plurality of base map elements.

3. The method of claim 2, wherein, The method comprises: determining a plurality of target base map elements in the plurality of base map elements based on the rendering position; performing element fusion of each weather display element and a corresponding target base map element, and rendering and displaying the fused element to obtain the electronic map interface corresponding to the field of view information.

4. The method of claim 1, wherein, The method further comprises: determining a sky display element according to the real-time weather information and real-time time information; rendering and displaying the sky display element in the electronic map interface corresponding to the field of view information.

5. The method of claim 4, wherein, The method comprises: when the real-time weather information indicates clear weather, determining a star element according to a time range in which the real-time time information is located; calculating a star rendering position corresponding to the star element according to the real-time time information. The method comprises: rendering the star element at the star rendering position in the electronic map interface corresponding to the field of view information.

6. The method of claim 5, wherein, The method comprises: obtaining an actual star position corresponding to the star element according to the real-time time information; calculating an azimuth and an elevation angle for observing the star element corresponding to the star element from the target geographical location based on the actual star position and the target geographical location; calculating the star rendering position of the star element in the electronic map interface corresponding to the field of view information according to the azimuth and the elevation angle.

7. The method of claim 5, wherein, The celestial element is a moon element, and before the celestial element is rendered at the celestial rendering position in the electronic map interface corresponding to the field of view information, the method further includes: obtaining real-time date information and determining moon phase information according to the real-time date information; the celestial element is rendered at the celestial rendering position in the electronic map interface corresponding to the field of view information, including: determining the moon element in the electronic map interface corresponding to the field of view information according to the moon phase information.

8. The method of claim 5, wherein, The celestial element is rendered at the celestial rendering position in the electronic map interface corresponding to the field of view information, including: determining a target sky style according to the real-time time information; fusing the celestial element with the target sky style based on the celestial rendering position to obtain a sky image; displaying the sky image at a sky display position in the electronic map interface corresponding to the field of view information.

9. The method of claim 1, wherein, The real-time meteorological information corresponding to the target geographic location is determined based on the real-time environment image and the weather forecast data, including: classifying the real-time environment image by using a preset neural network model to obtain meteorological classification information; determining the real-time meteorological information corresponding to the target geographic location based on the meteorological classification information and the weather forecast data.

10. The method of claim 9, wherein, The real-time environment image is classified by using a preset neural network model to obtain meteorological classification information, including: extracting features of the real-time environment image by using a preset neural network model to obtain weather features and road environment features; classifying based on the weather features and the road environment features to obtain meteorological classification information.

11. The method of claim 9, wherein, The meteorological classification information includes a plurality of first category probabilities corresponding to a plurality of meteorological categories; The real-time meteorological information corresponding to the target geographic location is determined based on the meteorological classification information and the weather forecast data, including: determining a plurality of second category probabilities of the plurality of meteorological categories from the weather forecast data; determining the real-time meteorological information corresponding to the target geographic location based on the plurality of first category probabilities and the plurality of second category probabilities.

12. The method of claim 11, wherein, The real-time meteorological information corresponding to the target geographic location is determined based on the plurality of first category probabilities and the plurality of second category probabilities, including: obtaining a first weight corresponding to the meteorological classification information and a second weight corresponding to the weather forecast data; weighting the plurality of first category probabilities and the plurality of second category probabilities based on the first weight and the second weight to determine the real-time meteorological information corresponding to the target geographic location.

13. A display device of an electronic map, characterized by comprising: including: an acquisition unit configured to acquire field of view information in an electronic map application and determine a target geographic location based on the field of view information; a first determination unit configured to acquire a real-time environment image collected at the target geographic location and determine real-time meteorological information corresponding to the target geographic location based on the real-time environment image and weather forecast data; a second determination unit configured to determine meteorological display elements according to the real-time meteorological information and the real-time environment image; The first rendering unit is configured to determine a plurality of base map elements based on the field of view information, and render an electronic map interface corresponding to the field of view information according to the weather display element and the plurality of base map elements.

14. An electronic device comprising a memory and a processor, the memory storing a computer program, characterized in that, The computer program is executed by the processor to implement the display method of the electronic map according to any one of claims 1 to 12.

15. A storage medium storing a computer program, characterized in that, The computer program is executed by the processor to implement the display method of the electronic map according to any one of claims 1 to 12.

16. A computer program product comprising a computer program, which is read and executed by a processor of an electronic device, so that the electronic device performs the display method of the electronic map according to any one of claims 1 to 12.

Images