Weather data display method, device, electronic device and storage medium

By displaying three-dimensional weather models and playing audio and video data on the projector, the problem of single content of weather data display in the existing technology is solved, and more intuitive and interactive weather information display is achieved, improving the user experience.

CN114047992BActive Publication Date: 2024-11-01SHENZHEN HUOLE TECH DEV CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202111393414.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2021-03-16
Filing Date
2021-11-23
Publication Date
2024-11-01
Estimated Expiration
2041-11-23

AI Technical Summary

Technical Problem

The existing weather data display method has a single content, and it cannot effectively and intuitively display weather information, and lacks audio and video reminder functions, which affects the user experience.

Method used

By obtaining weather data and current time, determining three-dimensional weather model and audio and video data, performing perspective projection calculation and tailoring processing, generating two-dimensional images, and displaying weather data and playing audio and video data on the projector, and performing when display and playback conditions are met Projection display.

Benefits of technology

It improves the display effect and interest of weather data, provides a more intuitive and interactive way to display weather information, and enhances the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114047992B_ABST
    Figure CN114047992B_ABST
Patent Text Reader

Abstract

The disclosed embodiments relate to a weather data display method, device, electronic device and storage medium. The method obtains weather data and current time, determines the three-dimensional weather model and weather audio and video data corresponding to the current time according to the weather data, determines the interface to be displayed according to the two-dimensional image corresponding to the three-dimensional weather model, and projects the interface to be displayed when it is detected that the interface to be displayed meets the display conditions, and plays the weather audio and video data when it is detected that the weather audio and video data meets the playback conditions. When the disclosed embodiments are used for weather reminders, not only the interface to be displayed corresponding to the weather data is displayed, but also the weather audio and video data is played. The effect of weather data display is improved through visual display and audio and video display, and the technical problem of single weather data display content is solved. The reminder effect of weather reminders is also improved through audio and video.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This disclosure claims priority to an invention patent application filed on March 16, 2021, with application number 202110282230.1 and application name “Weather data display method, device, electronic device and storage medium”, and the contents of the prior application are incorporated into this disclosure by reference. Technical Field

[0002] The present disclosure relates to the field of projection display technology, and in particular to a weather data display method, device, electronic device and storage medium. Background Art

[0003] Weather data has a huge impact on life and plays an important role in individual or group travel arrangements. Currently, weather data is mostly presented through various weather forecast related applications (application programs, APPs). When viewing weather data through weather forecast APPs, target users need to open the APP to view it, and it only simply displays information such as temperature and weather conditions, accompanied by simple icons, and the displayed content is single. Summary of the invention

[0004] The embodiments of the present disclosure provide a weather data display method, device, electronic device and storage medium, which can alleviate the technical problem of single weather data display content.

[0005] The present disclosure provides a weather data display method, which is applied to a projector and includes:

[0006] Obtain weather data and current time, the weather data including weather data corresponding to the current time and / or weather data corresponding to a preset time in the future;

[0007] According to the weather data, determine the three-dimensional weather model and weather audio and video data corresponding to the current time;

[0008] Determine the interface to be displayed according to the two-dimensional image corresponding to the three-dimensional weather model; obtain the display layout interface, and fill the display layout interface according to the weather data and the three-dimensional weather model; perform perspective projection operation on the weather data and the three-dimensional weather model in the display layout interface to obtain a two-dimensional display screen; perform cropping processing on the two-dimensional display screen to obtain a two-dimensional image corresponding to the three-dimensional weather model, and determine the interface to be displayed according to the two-dimensional image;

[0009] When it is detected that the interface to be displayed meets the display conditions, the interface to be displayed is projected and displayed;

[0010] When it is detected that the weather audio and video data meets the playing condition, the weather audio and video data is played.

[0011] The present disclosure also provides a weather data display device, which is applied to a projector and includes:

[0012] An acquisition module is used to acquire weather data and current time, where the weather data includes weather data corresponding to the current time and / or weather data corresponding to a preset time in the future;

[0013] A first determination module is used to determine the three-dimensional weather model and weather audio and video data corresponding to the current time according to the weather data;

[0014] A second determination module is used to determine the interface to be displayed according to the two-dimensional image corresponding to the three-dimensional weather model, obtain a display layout interface, fill the display layout interface according to the weather data and the three-dimensional weather model, perform perspective projection operation on the weather data and the three-dimensional weather model in the display layout interface to obtain a two-dimensional display screen, perform cropping processing on the two-dimensional display screen to obtain a two-dimensional image corresponding to the three-dimensional weather model, and determine the interface to be displayed according to the two-dimensional image;

[0015] A display module, used for projecting and displaying the interface to be displayed when it is detected that the interface to be displayed meets the display conditions;

[0016] The playing module is used to play the weather audio and video data when it is detected that the weather audio and video data meets the playing conditions.

[0017] The embodiment of the present disclosure also provides a computer-readable storage medium, in which a plurality of instructions are stored, and the instructions are suitable for being loaded by a processor to execute the steps in any of the above-mentioned weather data display methods.

[0018] An embodiment of the present disclosure also provides an electronic device, including a processor and a memory, wherein the processor is electrically connected to the memory, the memory is used to store instructions and data, and the processor is used for the steps in any of the above-mentioned weather data display methods.

[0019] The weather data display method, device, electronic device and storage medium provided by the embodiments of the present disclosure obtain weather data and current time, determine a three-dimensional weather model and weather audio and video data corresponding to the current time according to the weather data, determine an interface to be displayed according to a two-dimensional image corresponding to the three-dimensional weather model, obtain a display layout interface, fill the display layout interface according to the weather data and the three-dimensional weather model, perform perspective projection operation on the weather data and the three-dimensional weather model in the display layout interface to obtain a two-dimensional display screen, perform cropping processing on the two-dimensional display screen to obtain a two-dimensional image corresponding to the three-dimensional weather model, and determine the interface to be displayed according to the two-dimensional image, and when it is detected that the interface to be displayed meets the display conditions, project and display the interface to be displayed, and when it is detected that the weather audio and video data meet the playback conditions, play the weather audio and video data. When displaying weather data, the disclosed embodiment not only displays the interface to be displayed corresponding to the weather data, but also plays weather audio and video data. The effect of weather data display is improved through visual display and audio and video display, and the technical problem of single weather data display content is solved. The reminder effect of weather reminder is also improved through audio and video, and the fun of weather reminder is increased. Moreover, the weather data in the disclosed embodiment is displayed and reminded through projection display, which is completely different from the way of checking / reminding the weather by opening the weather forecast APP. The projection display can improve the display effect of weather data. In addition, the three-dimensional weather model corresponding to the weather data is determined according to the current time, and the interface to be displayed is generated according to the three-dimensional weather model. The interface to be displayed is projected and displayed, that is, the weather data of the interface to be displayed is realized by the three-dimensional weather model. The three-dimensional weather model can be used to display the weather data more intuitively, thereby improving the display effect of the weather data and increasing the fun of the weather data reminder. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The technical solutions and other beneficial effects of the embodiments of the present disclosure will be made apparent by describing in detail the specific implementation modes of the embodiments of the present disclosure in conjunction with the accompanying drawings.

[0021] Figure 1 A schematic diagram of an application scenario for displaying weather data provided in an embodiment of the present disclosure.

[0022] Figure 2 A flowchart of a weather data display method provided in an embodiment of the present disclosure.

[0023] Figure 3 A schematic diagram of a display layout interface provided in an embodiment of the present disclosure.

[0024] Figure 4 A schematic diagram of a filled display layout interface provided in an embodiment of the present disclosure.

[0025] Figure 5A schematic diagram of perspective projection calculation provided for an embodiment of the present disclosure.

[0026] Figure 6 Another flowchart of the weather data display method provided in the embodiment of the present disclosure.

[0027] Figure 7 A schematic diagram of the structure of a weather data display device provided in an embodiment of the present disclosure.

[0028] Figure 8 A schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure.

[0029] Description of reference numerals:

[0030] 10-projector; 11-optical machine; 12-camera; 20-projection surface;

[0031] 400-electronic device; 401-processor; 402-memory;

[0032] A-viewpoint; p-viewing plane; N1-point on a three-dimensional object; N2-point on a three-dimensional object;

[0033] AN1-straight line; AN2-straight line; n1-intersection point of straight line AN1 and viewing plane p; n2-intersection point of straight line AN2 and viewing plane p. DETAILED DESCRIPTION

[0034] The following will be combined with the drawings in the embodiments of the present disclosure to clearly and completely describe the technical solutions in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the embodiments of the present disclosure.

[0035] The embodiments of the present disclosure provide a weather data display method, device, storage medium, and electronic device. Any weather data display device provided in the embodiments of the present disclosure can be integrated in an electronic device, and the electronic device can include various projectors, or a mobile terminal, PC, robot, etc. that can realize a projection function. The embodiments of the present disclosure are described by taking the electronic device as a projector as an example.

[0036] Figure 11 is a schematic diagram of an application scenario for displaying weather data provided by an embodiment of the present disclosure. The application scenario includes a projector 10 and a projection surface 20. The projector 10 is used to project the interface to be displayed corresponding to the weather data onto the projection surface 20, and is also used to play weather audio and video data, so as to display the weather data through the interface to be displayed, and play the weather audio and video data through the audio and video playback function, so as to improve the display effect of the weather data through visual display and audio and video display, solve the technical problem of the single content of the weather data display, and also improve the reminder effect of the weather reminder through the audio and video method. The projection surface 20 includes various surfaces that can be used to display the interface to be displayed corresponding to the weather data, such as a wall, a cabinet, a curtain, etc. The projection surface 20 can be determined according to the target user's focus area. For example, if the target user's focus area is a wall, the wall is used as the projection surface. The target user refers to the target user who is currently viewing the projected weather information. In the embodiment of the present disclosure, the projection surface 20 is illustrated by taking a surface of non-fixed size as an example, such as a wall, a cabinet, etc.

[0037] Furthermore, the projector 10 includes an optical machine 11 and a camera 12. Among them, the optical machine 11 integrates the display core, light source, lens optical path, heat dissipation and other functions, and is mainly used to project and display the interface to be displayed corresponding to the weather data; the camera 12 is used to capture the image corresponding to the target user, and the image can be used to further determine the emotional information of the target user, the human eye information of the target user, and so on. The camera 12 in the projector 10 faces the target user who is watching the interface to be displayed, and the optical machine 11 in the projector 10 faces the projection surface 20 to project on the projection surface 20 so that the target user can see the interface to be displayed corresponding to the weather data. Among them, the relative positions of the optical machine 11 and the camera 12 remain unchanged, but the specific positional relationship between the optical machine 11 and the camera 12 is not specifically limited. In the embodiment of the present disclosure, the projector 10 can be a short-focus projector, which is closer to the projection surface 20, or it can be other types of projectors.

[0038] exist Figure 1 In the illustrated embodiment, the optical engine 11 and the camera 12 are both disposed in the projector 10, and the relative positions of the optical engine 11 and the camera 12 remain unchanged. In other embodiments, the optical engine and the camera may be disposed separately, for example, the optical engine is disposed in the projector, and the camera is another independent camera, which can communicate with the projector. In other embodiments, the relative positions of the optical engine and the camera may be changed, etc., which are not specifically limited.

[0039] The following will be combined Figure 1To introduce the weather data display method, device, storage medium and electronic device in the embodiments of the present disclosure. Among them, the weather data display method can be run in an electronic device (such as a projector). The electronic device corresponds to a weather forecast APP, and the weather data display method can implement the corresponding function through the weather forecast APP; or the electronic device corresponds to a projection display component (such as a projection screen saver component, etc.), or a projection display APP, etc., and the weather data display method can implement the corresponding function through the projection display component, or the projection display APP; or other APPs / components similar to the weather forecast APP in the electronic device can implement the corresponding function.

[0040] See also Figure 2 , Figure 2 It is a flow chart of a weather data display method provided in an embodiment of the present disclosure, which is applied in an electronic device. The weather data display method includes the following steps.

[0041] Step 101, obtaining weather data and current time, where the weather data includes weather data corresponding to the current time and / or weather data corresponding to a preset time in the future.

[0042] The current time is based on the system time of the electronic device. Weather data can be obtained from the network / cloud in real time to improve the accuracy of weather data; it can also be obtained from the network / cloud in a timed cycle according to the system time, for example, once every hour, to reduce the power consumption of electronic devices.

[0043] Weather data includes weather data corresponding to the current time and / or weather data corresponding to a preset time in the future. Weather data corresponding to a preset time in the future includes: weather data corresponding to multiple hours in the future and / or weather data corresponding to multiple days in the future. Whether it is weather data corresponding to the current time or weather data corresponding to a preset time in the future, it includes temperature, weather conditions, wind information, precipitation information, and some other weather information.

[0044] The weather conditions include, but are not limited to, sunny, cloudy, overcast, haze, showers, light rain, rainstorms, thunderstorms, sleet, light snow, heavy snow, hail, sandstorms, etc. The wind information includes, but is not limited to, wind force (such as breeze level 3, gale level 6, etc.) and wind direction (such as wind force, southwest wind, north wind, southeast wind, etc.). The precipitation information can be expressed by percentage (0%) and / or precipitation amount, etc.

[0045] Step 102, determining the three-dimensional weather model and weather audio and video data corresponding to the current time according to the weather data.

[0046] The three-dimensional weather model may include a three-dimensional model corresponding to the weather conditions, or a three-dimensional model including weather conditions and wind information, or a three-dimensional model including weather conditions, wind information and other weather information. The three-dimensional weather model may be a static three-dimensional model or a dynamic three-dimensional model. For example, for light rain weather, the three-dimensional weather model may include a static model corresponding to light rain and dark clouds, or a dynamic model corresponding to light rain dripping down and slowly moving dark clouds. The three-dimensional model may be used to display weather data more intuitively and clearly.

[0047] For the same weather condition, multiple different three-dimensional weather models can be set according to the current time. For example, in the same cloudy weather, the corresponding three-dimensional clouds will be bright white in the morning, while in the evening the three-dimensional clouds will show the color of sunset.

[0048] The weather audio and video data corresponding to the weather data can be either weather audio data or weather video data. For example, for thunderstorm weather, in addition to displaying the three-dimensional weather model corresponding to the thunderstorm, the weather audio data of thunder can also be played, or the animation of thunder can be played, that is, weather video data. The weather audio and video data can be used to more intuitively display and remind the target user of the corresponding weather conditions.

[0049] Through the three-dimensional weather model and weather audio and video data, that is, through visual display and audio and video display, the display effect of weather display is improved, the reminder effect of weather reminder is improved, and the fun of weather reminder is increased.

[0050] In one embodiment, the step of determining the three-dimensional weather model and weather audio and video data corresponding to the weather data according to the current time includes: determining the time period to which the current time belongs; determining the corresponding three-dimensional weather model from a weather display library according to the weather data and the time period; determining the corresponding weather audio and video data from a weather audio and video library according to the weather data and the time period. This embodiment determines the three-dimensional weather model and weather audio and video data corresponding to the weather data according to the time period to which the current time belongs, so that there is no need to determine the three-dimensional weather model and weather audio and video data corresponding to the weather data in real time, thereby improving operating efficiency and reducing power consumption of electronic equipment (projectors).

[0051] Among them, the time period is divided into early morning, morning, afternoon, dusk, night, etc. according to the current time. The time period corresponding to the early morning can be set to 5:00-7:00, the time period corresponding to the morning can be set to 7:00-12:30, the time period set for the afternoon can be set to 12:30-16:30, the time period corresponding to dusk can be set to 16:30-19:00, and the time period corresponding to the night can be set to 19:00-5:00, etc.

[0052] The time periods corresponding to the above are only examples for easier understanding of the solutions in the embodiments of the present disclosure. The time periods can also be set to other more or fewer time periods, and can also be set to different time periods according to different seasons; the time range corresponding to each time period can also be set to other time ranges, and can also be set to different time ranges according to different seasons, etc.

[0053] After determining the time period to which the current time belongs, the corresponding three-dimensional weather model is determined from the weather display library according to the weather data and the time period. The three-dimensional weather model corresponding to the current weather data and the future weather data can be determined from the weather display library according to the current weather data, the future weather data, and the corresponding time period in the weather data. The weather display library stores different three-dimensional weather models corresponding to various weather data and different time periods.

[0054] Among them, the step of determining the three-dimensional weather model corresponding to the future weather data from the weather display library based on the future weather data and the corresponding time period includes: determining the future time period corresponding to the future weather data based on the time corresponding to the future weather data and the corresponding time period; determining the three-dimensional weather model corresponding to the future time period and the future weather data from the weather display library based on the future time period and the future weather data, that is, determining the three-dimensional weather model that matches the future time period and the future weather data.

[0055] Herein, a three-dimensional weather model including a three-dimensional model corresponding to weather conditions is used as an example for explanation. For example, if the determined time period is 11:00 a.m., and the current weather condition in the weather data is sunny, then the corresponding three-dimensional weather model is determined to be a three-dimensional sun; if the future time period corresponding to the next hour is also morning, and the corresponding weather condition is sunny, then the corresponding three-dimensional weather model is determined to be a three-dimensional sun; if the future time period corresponding to the next two hours is afternoon, and the corresponding weather condition is cloudy, then the corresponding three-dimensional weather model is determined to be a three-dimensional white cloud; if the weather data for the next day is light rain, then the corresponding three-dimensional weather model is determined to be a three-dimensional model of light rain plus dark clouds.

[0056] In this embodiment, the three-dimensional weather models corresponding to the current weather data and the future weather data are determined according to the three-dimensional models of the same display type, such as both are three-dimensional static models.

[0057] In one embodiment, the current weather data and future weather data may be displayed using three-dimensional weather models of different display types, respectively. Correspondingly, the above step of determining the three-dimensional weather model corresponding to the weather data from the display library based on the weather data and the time period includes: determining a three-dimensional weather model of a first display type from the weather display library based on the current weather data and the time period in the weather data; determining a three-dimensional weather model of a second display type from the weather display library based on the future weather data and the time period in the weather data. Among them, the first display type is determined based on the current weather data, and the second display type is determined based on the future weather data. The first display type can be a three-dimensional dynamic model, the second display type can be a three-dimensional static model, etc., to highlight the display effect corresponding to the current weather data.

[0058] The display type can be determined according to a static model and a dynamic model, and can also be determined according to a three-dimensional weather model and a non-three-dimensional weather model. For example, in one embodiment, the first display type is a three-dimensional weather model, and the second display type is a non-three-dimensional weather model, such as a two-dimensional weather model, so as to reduce the amount of calculation corresponding to the projection display. It can also be determined in other ways. For example, in one embodiment, the three-dimensional weather model corresponding to the first display type is determined according to the time period. For example, if the current time is evening and the weather condition is cloudy, the three-dimensional clouds are displayed as the color of the sunset; the three-dimensional weather model corresponding to the second display type corresponds to a general three-dimensional weather model, and no longer considers whether it is cloudy in the evening or cloudy in the morning. If it is cloudy, it is uniformly displayed as three-dimensional white clouds. In one embodiment, the three-dimensional weather model corresponding to the first display type may be a three-dimensional model that includes more weather information in addition to the weather condition, while the corresponding three-dimensional weather model of the second display type is a three-dimensional model that only includes the weather condition.

[0059] The step of determining the corresponding weather audio and video data from the weather audio and video library according to the weather data and the time period includes: determining the weather audio and video data matching the weather data and the time period from the weather audio and video library according to the weather data and the time period. The weather audio and video library includes weather audio and video data corresponding to different weather data and different time periods. In this embodiment, the corresponding weather audio and video data is matched for each weather data and time period in the weather data.

[0060] For example, if the time period is early morning and the current weather data is sunny, the weather audio and video data that matches the current weather data and time period is determined from the weather audio and video library to include audio and video data of birdsong. For example, if the time period is early morning and the current weather data is thunder and lightning weather, the weather audio and video data that matches the current weather data and time period is determined from the weather audio and video library to include audio and video data of lightning and thunder. The weather data is displayed and reminded through the weather audio and video data to improve the display effect and reminder effect of the weather data.

[0061] Among them, for the case where the weather data only includes current data, or includes both current weather data and future weather data, the weather audio and video data corresponding to the current weather data and time period can be played by default, and the weather audio and video data corresponding to the future weather data is not played by default to avoid confusion among target users. For the case where the weather data only includes future weather data, the weather audio and video data corresponding to the time closest to the current time in the future weather data is played by default. For example, if a certain interface to be displayed only displays future weather data and does not display current weather data, when the interface to be displayed is opened / refreshed, only the corresponding future weather data is obtained, and the weather audio and video data corresponding to the time closest to the current time in the future weather data can be played. Assuming that the future weather data includes weather data for the next day and weather data for the next two days; correspondingly, the weather audio and video data corresponding to the weather data for the next day are played.

[0062] In other embodiments, the corresponding weather audio and video data may be determined based on the weather data corresponding to the current focus position in the projected interface to be displayed. For example, the projected interface to be displayed includes both current weather data and future weather data, but the current focus position is the weather data corresponding to the next hour, then the corresponding weather audio and video data is determined based on the weather data corresponding to the next hour. The current focus position may be determined by the position in the interface to be displayed that is touched / clicked (such as a remote control click, etc.) by the target user.

[0063] In one embodiment, the step of determining corresponding weather audio and video data from the weather audio and video library according to the weather data and time period includes: when the weather data includes current weather data, determining weather audio and video data matching the current weather data and time period from the weather audio and video library according to the current weather data and time period in the weather data; when the weather data includes only future weather data, determining corresponding weather audio and video data from the weather audio and video library according to a time closest to the current time in the future weather data and the future weather data corresponding to the time. In this embodiment, only one of the weather data needs to be determined from the weather data, and the corresponding weather audio and video data is determined according to the determined one of the weather data and time period, so as to reduce the amount of calculation.

[0064] In this step, the three-dimensional weather model and weather audio and video data corresponding to the weather data are determined according to the current time, that is, the display effect of the weather display is improved according to the visual display and audio and video display methods, and the reminder effect of the weather reminder is also improved, and the interest of the weather reminder is increased.

[0065] Step 103, determine the interface to be displayed according to the two-dimensional image corresponding to the three-dimensional weather model, obtain the display layout interface, fill the display layout interface according to the weather data and the three-dimensional weather model, perform perspective projection operation on the weather data and the three-dimensional weather model in the display layout interface to obtain a two-dimensional display screen, crop the two-dimensional display screen to obtain a two-dimensional image corresponding to the three-dimensional weather model, and determine the interface to be displayed according to the two-dimensional image.

[0066] The interface to be displayed is determined according to the two-dimensional image corresponding to the three-dimensional weather model. The method of determining the interface to be displayed includes generating the interface to be displayed and / or updating the interface to be displayed.

[0067] In one embodiment, each time weather data is acquired and a three-dimensional weather model is determined, an interface to be displayed is generated according to a two-dimensional image corresponding to the three-dimensional weather model.

[0068] In one embodiment, the step of determining the interface to be displayed according to the two-dimensional image corresponding to the three-dimensional weather model includes: detecting whether the interface to be displayed exists in the memory of the electronic device; if the interface to be displayed does not exist, generating the interface to be displayed according to the two-dimensional image corresponding to the three-dimensional weather model; if the interface to be displayed already exists, updating the interface to be displayed according to the two-dimensional image corresponding to the three-dimensional weather model. The interface to be displayed is updated to save the generation time of the interface to be displayed.

[0069] Whether there is an interface to be displayed can be determined by the interface identifier of the interface to be displayed. Specifically, it is detected whether there is an interface identifier of the interface to be displayed in the memory of the electronic device (projector). If there is a corresponding interface identifier, it is determined that there is an interface to be displayed.

[0070] In one embodiment, each time a weather forecast APP is opened to perform weather projection or each time a projection display component / projection display APP is opened to perform weather projection (non-weather forecast content is not projected at this time), an interface to be displayed is generated based on weather data and a corresponding three-dimensional weather model, and when weather data is subsequently acquired and a three-dimensional weather model is determined, the interface to be displayed is updated using the weather data and the corresponding three-dimensional weather model.

[0071] In one embodiment, the step of determining the interface to be displayed based on the two-dimensional image corresponding to the three-dimensional weather model includes: obtaining a display layout interface; filling the display layout interface according to weather data and the three-dimensional weather model; performing display processing on the display layout interface to obtain a two-dimensional image corresponding to the three-dimensional weather model, and determining the interface to be displayed based on the two-dimensional image.

[0072] The display layout interface can be generated in advance and directly obtained; it can also be generated in real time. If generated in real time, correspondingly, the step of obtaining the display layout interface includes: obtaining display layout data, and generating the display layout interface according to the display layout data. The display layout data includes display tag data and display style data; the display tag data can be HyperText Markup Language (HTML) data, eXtensible HyperText Markup Language (XHTML) data, or eXtensible Markup Language (XML) data; the display style data can be Cascading Style Sheets (CSS) data, or other types of display style data.

[0073] like Figure 3 As shown, it is a schematic diagram of the display layout interface provided by the embodiment of the present disclosure. In the display layout interface, the left side is used to display the current weather data, the upper right part is used to display the weather data in the next multiple hours, and the lower right part is used to display the weather data in the next multiple days. Among them, the left side is used to display the temperature in the current weather data, the three-dimensional weather model corresponding to the current weather data, and the current time from top to bottom. The upper right part is used to display the weather data for the next hour, the next two hours, the next three hours, and the next four hours from left to right; the weather data corresponding to each hour in the future includes the specific time in the future (hour time), the three-dimensional weather model corresponding to the specific time, and the temperature corresponding to the specific time. The lower right part is used to display the weather data for the next day and the next two days from top to bottom; the weather data for each day in the future includes the specific time in the future (date), the three-dimensional weather model corresponding to the specific time, and the temperature corresponding to the specific time. It should be noted that this embodiment is only for illustrative purposes, and more or less weather data may be included in other embodiments.

[0074] After the display layout interface is determined, the display layout interface is filled according to the acquired weather data and the determined three-dimensional weather model. The display layout interface obtained after filling is as follows: Figure 4 shown. Figure 4The filled display layout interface is only for illustration and does not represent the display effect after rendering.

[0075] exist Figure 4 , the current time is 12 noon, and the left side of the display layout interface displays the weather data corresponding to 12 o'clock (the temperature is -4℃, and the three-dimensional weather model is heavy snow); the upper right corner of the display layout interface displays the weather data corresponding to 13 o'clock (the temperature is -4℃, and the three-dimensional weather model is heavy snow), the weather data corresponding to 14 o'clock (the temperature is -1℃, and the three-dimensional weather model is heavy snow), the weather data corresponding to 15 o'clock (the temperature is -3℃, and the three-dimensional weather model is heavy snow), and the weather data corresponding to 16 o'clock (the temperature is 0℃, and the three-dimensional weather model is heavy snow); the lower right corner of the display layout interface displays the weather data corresponding to tomorrow (the temperature is -2℃, and the three-dimensional weather model is heavy snow) and the weather data corresponding to the day after tomorrow (the temperature is -9℃, and the three-dimensional weather model is heavy snow) from top to bottom.

[0076] After obtaining the filled display layout interface, display processing is performed on the display layout interface to obtain a two-dimensional image corresponding to the three-dimensional weather model, and the interface to be displayed is determined according to the two-dimensional image.

[0077] In one embodiment, the step of performing display processing on the display layout interface to obtain a two-dimensional image corresponding to the three-dimensional weather model, and determining the interface to be displayed according to the two-dimensional image, includes: performing perspective projection operation on the weather data in the display layout interface and the three-dimensional weather model to obtain a two-dimensional display screen; performing clipping processing on the two-dimensional display screen to obtain a two-dimensional image corresponding to the three-dimensional weather model, and using the two-dimensional image as the interface to be displayed. The interface to be displayed is an interface that can be projected and displayed.

[0078] In one embodiment, the step of performing perspective projection operation on the weather data and the three-dimensional weather model in the display layout interface to obtain a two-dimensional display screen includes: performing perspective projection operation on the weather data and the three-dimensional weather model in the display layout interface according to the projection surface to obtain a two-dimensional display screen.

[0079] In one embodiment, the step of performing perspective projection operation on the weather data and the three-dimensional weather model in the display layout interface to obtain a two-dimensional display screen includes: determining the first distance information and the first relative position relationship between the projector and the projection surface; establishing a three-dimensional virtual coordinate system with the virtual projector corresponding to the projector as the origin; determining the position of the virtual projection surface corresponding to the projection surface in the three-dimensional virtual coordinate system according to the first distance information and the first relative position relationship; taking the virtual projector as the viewpoint and the virtual projection surface as the viewing plane, performing perspective projection operation on the weather data and the three-dimensional weather model in the display layout interface to obtain a two-dimensional display screen. Among them, the virtual projector uses a point to represent its corresponding position information. In other embodiments, the optical machine in the projector can also be used instead of the projector.

[0080] That is, the relationship between the projector (or optical machine) and the projection surface in the real world is reflected in the three-dimensional coordinate system, so that the scene in the real world is simulated through the three-dimensional virtual scene corresponding to the three-dimensional coordinate system. In the three-dimensional virtual scene, the projector (or optical machine) and the projection surface correspond to the virtual projector (or virtual optical machine) and the virtual projection surface respectively.

[0081] like Figure 5 As shown in FIG. 1 , it is a schematic diagram of perspective projection calculation in a three-dimensional virtual scene. Among them, the position information corresponding to the virtual projector is used as the viewpoint A (x, y, z), the virtual projection surface is used as the view plane p, and the points N1 (a, b, c) and N2 (d, e, f) are used as points on the three-dimensional weather model (such as a three-dimensional round moon). The intersection point of the straight line AN1 and the view plane p is n1, and the coordinates of the intersection point n1 are (x_n1, y_n1), and the intersection point of the straight line AN2 and the view plane p is n2, and the coordinates of the intersection point n2 are (x_n2, y_n2). The intersection points of other points on the three-dimensional object with the view plane p are calculated in the same way, and finally a two-dimensional display screen on the view plane is obtained.

[0082] In one embodiment, the step of clipping the two-dimensional display screen to obtain a two-dimensional image corresponding to the three-dimensional weather model includes: clipping the two-dimensional display screen according to the projection position of the optical machine on the projection surface to obtain a two-dimensional image corresponding to the three-dimensional weather model. The projection position may be a rectangular area, etc. The two-dimensional display screen is clipped to display the interface to be displayed using the projection position of the optical machine on the projection surface.

[0083] In one embodiment, the step of cropping the two-dimensional display screen according to the projection position of the optical machine on the projection surface to obtain a two-dimensional image corresponding to the three-dimensional weather model includes: determining the distance between the optical machine and the projection surface; determining the projection position of the optical machine on the projection surface according to the distance; cropping the two-dimensional display screen according to the projection position to obtain a two-dimensional image corresponding to the three-dimensional weather model. Among them, there is a distance detector in the optical machine / projector, and the distance detector can be used to detect the distance between the optical machine and the projection surface, and the detected distance is used as the distance between the optical machine and the projection surface. The projection position of the optical machine on the projection surface is determined according to the distance.

[0084] In one embodiment, the step of determining the projection position of the optical machine projection on the projection surface according to the distance includes: determining the projection size of the optical machine projection on the projection surface according to the distance; determining the specific projection position of the optical machine projection on the projection surface according to the projection parameters; and using the projection size and the specific projection position as the projection position of the optical machine projection on the projection surface.

[0085] In one embodiment, the step of clipping the two-dimensional display screen according to the projection position to obtain the two-dimensional image corresponding to the three-dimensional weather model includes: generating a virtual projection position in the three-dimensional virtual scene according to the projection position, wherein the virtual projection position is consistent with the projection position; and clipping the two-dimensional display screen according to the virtual projection position to obtain the two-dimensional image corresponding to the three-dimensional weather model. The two-dimensional display screen located in the virtual projection position is retained, and the two-dimensional display screen located outside the virtual projection position is clipped, and finally the two-dimensional image is obtained.

[0086] The final two-dimensional image is used as the interface to be displayed. The interface to be displayed is related to the projection position of the projector (the optical machine of the projector) on the projection surface, and the size corresponding to the projection position corresponding to different projectors will be different. Therefore, the two-dimensional display screen is cropped according to the projection position so that the interface to be displayed meets the display requirements of the corresponding projector.

[0087] Step 104: When it is detected that the interface to be displayed meets the display condition, the interface to be displayed is projected and displayed.

[0088] After obtaining the interface to be displayed, the interface to be displayed can be projected and displayed through a projector.

[0089] In one embodiment, step 104 includes: detecting whether the interface currently projected and displayed in the projector is the interface corresponding to the weather data; if so, determining that the interface to be displayed meets the display conditions, and projecting and displaying the interface to be displayed; if not, determining that the interface to be displayed does not meet the display conditions, and not projecting and displaying the interface to be displayed.

[0090] The interface corresponding to the weather data may be the interface corresponding to the weather forecast APP. If the currently projected interface is not the interface corresponding to the weather data, such as the movie playback interface, the interface to be displayed will not be projected to avoid affecting the current movie playback of the target user. If the currently projected interface is the interface corresponding to the weather data, the interface to be displayed will be projected and displayed in real time; when there is an update to the weather data, the interface to be displayed will be updated.

[0091] Step 105, when it is detected that the weather audio and video data meets the playing condition, the weather audio and video data is played.

[0092] In one embodiment, step 105 includes: detecting whether the interface currently projected and displayed in the projector is the interface corresponding to the weather data, and whether the first preset playback time has been reached; if so, determining that the weather audio and video data meets the playback conditions, and playing the weather audio and video data; if not, determining that the weather audio and video data does not meet the playback conditions, and not playing the weather audio and video data.

[0093] The first preset play time may correspond to a time period, such as the start time corresponding to the time period as the first preset play time; the first preset play time may also be determined in other ways. If the current projection does not display an interface corresponding to the weather data, the weather audio and video data will not be played to avoid affecting the use of the target user; if the first preset play time has not been reached, the weather audio and video data will not be played to avoid playing the weather audio and video data too frequently and reducing the target user experience; if the current projection does not display an interface corresponding to the weather data and the first preset play time has not been reached, the weather audio and video data will not be played.

[0094] When displaying weather data, the above method embodiment not only displays the interface to be displayed corresponding to the weather data, but also plays weather audio and video data. Through visual display and audio and video display, the display effect of the weather display is improved, the reminder effect of the weather reminder is also improved, and the interest of the weather reminder is increased. Moreover, the weather data in this embodiment is displayed by projection display, which is completely different from the method of checking / reminding the weather by opening the weather forecast APP. The display effect of the weather data can be improved by projection display. In addition, the three-dimensional weather model corresponding to the weather data is determined according to the current time, and the interface to be displayed is generated according to the three-dimensional weather model. The interface to be displayed is projected and displayed, that is, the display of the weather data is realized through the three-dimensional weather model. The three-dimensional weather model can be used to display the weather data more intuitively, thereby improving the display effect of the weather data and increasing the interest of the weather data reminder.

[0095] In one embodiment, the weather data display method further includes: determining weather impact information corresponding to the weather data according to the current time, and obtaining emotional information of the target user, wherein the weather impact information is used to characterize the impact of the weather data at the current time on the target user's emotions; and determining the adjusted audio and video data that matches the weather impact information and the emotional information. This embodiment can intelligently push the corresponding adjusted audio and video data while displaying the weather data according to the weather data and the target user's emotions, thereby enhancing the sense of integration between people and the environment, helping to improve people's inner emotions, and enhancing the target user experience.

[0096] Among them, the weather impact information corresponding to the current weather data in the weather data is determined according to the current time. Different weather data have different effects on the target user's emotions. For example, sunny days have a positive effect on the target user's emotions, cloudy days, light rain, light snow, etc. have a neutral effect on the target user's emotions, and cloudy days, showers, heavy rain, haze, etc. have a negative effect on the target user's emotions. For the convenience of description, the weather impact information is used to represent the effect of weather information on the target user's emotions.

[0097] In one embodiment, the step of determining the weather impact information corresponding to the weather data according to the current time includes: determining the current weather data in the weather data according to the current time; obtaining the weather impact information corresponding to the current weather data according to the mapping relationship between the current weather data and the weather impact information; wherein the weather impact information represents positive emotional impact, neutral emotional impact or negative emotional impact.

[0098] Specifically, the mapping relationship between the current weather data and the weather impact information can be saved in the form of a data table, as shown in Table 1 below:

[0099] Table 1 Mapping relationship between current weather data and weather impact information

[0100] Weather impact information Current weather data (weather conditions) front sunny neutral Cloudy, light rain, light snow Negative Cloudy, showers, heavy rain, haze, heavy snow, blizzard, sandstorm, etc.

[0101] It can be seen from the content of Table 1 that when the weather condition is sunny, the weather impact information is positive, which means that sunny weather has a positive impact on the target user's emotions; when the weather condition is cloudy, light rain or light snow, the weather impact information is neutral, which means that cloudy, light rain or light snow weather has a neutral impact on the target user's emotions; when the weather condition is cloudy, showers, rainstorms, haze, heavy snow, blizzards or sandstorms, the weather impact information is negative, which means that cloudy, showers, rainstorms, haze, heavy snow, blizzards or sandstorms have a negative impact on the target user's emotions. It should be noted that the specific content of the weather information recorded in Table 1 is only an example and should not be understood as a specific limitation on the weather information disclosed in this disclosure. Based on the corresponding relationship (mapping relationship) between the weather impact information and the current weather data in Table 1, the projector can determine the corresponding weather impact information based on Table 1 after obtaining the current weather data.

[0102] In one embodiment, the step of obtaining the target user's emotional information includes: collecting the target user's body feature information; and determining the target user's emotional information according to the body feature information.

[0103] Specifically, the projector can collect the facial image of the target user through a camera, and use other types of sensors to collect at least one of the target user's human characteristics information such as voice, blood pressure, heartbeat and limb movements, and then determine the target user's emotional information based on at least one of these human characteristics information.

[0104] Taking determining the target user's emotional information based on a facial image as an example, the projector can pre-record multiple facial images, and establish an emotional information library based on the facial expressions, facial feature points, micro-expressions and other feature information in the facial images. When the projector needs to determine the target user's emotional information based on a new facial image, it can search the emotional information library based on the feature information of the facial image to see if there is emotional information matching the new facial image, thereby determining the target user's emotional information. In actual applications, the multiple facial images pre-recorded by the projector may include several positive emotional pictures, several negative emotional pictures, and several neutral emotional pictures.

[0105] In one embodiment, the step of determining the target user's emotional information based on human feature information includes: inputting the human feature information into a pre-trained emotion classification model to obtain the emotion type output by the emotion classification model; and determining the target user's emotional information based on the emotion type.

[0106] Specifically, the projector can be pre-trained to obtain an emotion classification model, and after obtaining at least one of the human feature information such as facial image, voice, blood pressure, heartbeat and body movement, the obtained information is input into the emotion classification model for recognition, and the result output by the emotion classification model is the emotion type, such as happy, neutral, angry, sad, etc., which is not limited here. Then the projector can determine the emotion information of the current target user according to the emotion type.

[0107] In one embodiment, the step of determining the adjusted audio and video data matching the weather impact information and the emotional information includes: determining the audio and video data type matching the weather impact information and the emotional information; and obtaining the adjusted audio and video data matching the audio and video data type from the adjusted audio and video library. There is a mapping relationship between the weather impact information and the emotional information and the audio and video data type.

[0108] For example, when the weather impact information is a positive emotional impact (positive) or a neutral emotional impact (neutral), if the emotional information is determined to be happy or neutral, the matching audio and video data type is determined to be cheerful, soothing, exciting or neutral, and the first adjustment audio and video data matching the audio and video data type is randomly selected from the adjustment audio and video library; if the emotional information is determined to be angry, the matching audio and video data type is determined to be soothing, and the second adjustment audio and video data of the soothing type is randomly selected from the adjustment audio and video library; if the emotional information is determined to be sad, the matching audio and video data type is determined to be cheerful, soothing or a joke, and the third adjustment audio and video data of the cheerful, soothing or a joke type is randomly selected from the adjustment audio and video library.

[0109] When the weather impact information is a negative emotional impact (negative), if the emotional information is determined to be happy or neutral, the matching audio and video data type is determined to be cheerful, exciting or a joke, and the fourth adjusting audio and video data of the cheerful, exciting or a joke type is randomly selected from the adjusting audio and video library; if the emotional information is determined to be angry, the matching audio and video data type is determined to be cheerful or soothing, and the fifth adjusting audio and video data of the cheerful or soothing type is randomly selected from the adjusting audio and video library; if the emotional information is determined to be sad, the matching audio and video data type is determined to be cheerful, soothing, exciting or a joke, and the sixth adjusting audio and video data of the cheerful, soothing, exciting or a joke type is randomly selected from the adjusting audio and video library.

[0110] Furthermore, the weather data display method also includes: playing the adjustment audio and video data. In one embodiment, when it is detected that the adjustment audio and video data meets the adjustment condition, the adjustment audio and video data is played. Specifically, it is detected whether the current time reaches the second preset playback time. If so, it is determined that the adjustment audio and video data meets the adjustment condition, and the adjustment audio and video data is played. Among them, the second preset playback time may be the same as / different from the first preset playback time. When the same, the weather audio and video data can be played first, and then the adjustment audio and video data can be played; the weather audio and video data and the adjustment audio and video data can also be played at the same time, but the playback sound of the weather audio and video data is louder than the playback sound of the adjustment audio and video data.

[0111] In one embodiment, if Figure 6 As shown, it is another flow chart of the weather data display method provided in the embodiment of the present application, which specifically includes the following steps.

[0112] Step 201, obtaining weather data and current time.

[0113] Step 202, determining the three-dimensional weather model and weather audio and video data corresponding to the current time according to the weather data.

[0114] Step 203: determine a virtual projection surface corresponding to the three-dimensional weather model according to the target user's focus area.

[0115] Among them, the projection surface is determined according to the focus area of ​​the target user, and the virtual projection surface corresponding to the three-dimensional weather model is determined according to the projection surface.

[0116] The surface corresponding to the target user's focus area is used as the projection surface. For example, if the target user's focus area is a wall, the wall is used as the projection surface; if the target user's focus area is a cabinet surface, the cabinet surface is used as the projection surface. The projection surface refers to a real wall, cabinet surface, curtain, etc. in real life.

[0117] Among them, the camera, optical machine, projection surface, the relationship between the camera and the optical machine, the relationship between the projection surface and the camera / the relationship between the projection surface and the optical machine in the real interface are all reflected in the three-dimensional virtual scene. In this way, the scene in the real world is simulated through the three-dimensional virtual scene.

[0118] The step of determining the virtual projection surface corresponding to the three-dimensional weather model according to the target user's focus area includes: taking the surface corresponding to the target user's focus area as the projection surface; determining the distance between the optical machine and the projection surface; generating a virtual projection surface in the three-dimensional virtual scene according to the distance between the optical machine and the projection surface, the positional relationship between the optical machine and the projection surface, etc. Among them, the three-dimensional virtual scene includes a three-dimensional weather model. It can also be understood that a virtual projection surface identical to the projection surface is generated in the three-dimensional virtual scene, and the relative positional relationship between the virtual projection surface and the virtual camera and virtual optical machine in the three-dimensional virtual scene remains unchanged from the relative positional relationship between the projection surface and the human eye, camera, and optical machine in the real scene.

[0119] There is a distance detector / distance sensor in the optical machine / projector, which can detect the distance between the optical machine and the projection surface through the distance detector / distance sensor, and use the detected distance as the distance between the optical machine and the projection surface.

[0120] Step 204 , determining an interface to be displayed including a two-dimensional image corresponding to the three-dimensional weather model according to the real-time eye position of the target user and the virtual projection surface corresponding to the three-dimensional weather model.

[0121] In one embodiment, each time weather data is acquired, a three-dimensional weather model is determined, or a change in the real-time eye position of the target user is detected, an interface to be displayed including a two-dimensional image corresponding to the three-dimensional weather model is determined based on the real-time eye position of the target user and the virtual projection surface corresponding to the three-dimensional weather model.

[0122] In one embodiment, the step of determining an interface to be displayed including a two-dimensional image corresponding to a three-dimensional weather model based on the real-time eye position of the target user and the virtual projection surface corresponding to the three-dimensional weather model includes: obtaining a display layout interface; filling the display layout interface according to weather data and the three-dimensional weather model; and displaying the display layout interface according to the real-time eye position of the target user and the virtual projection surface corresponding to the three-dimensional weather model to obtain an interface to be displayed including a two-dimensional image corresponding to the three-dimensional weather model.

[0123] In one embodiment, the step of displaying the display layout interface according to the real-time eye position of the target user and the virtual projection surface corresponding to the three-dimensional weather model to obtain the interface to be displayed including the two-dimensional image corresponding to the three-dimensional weather model includes: mapping the real-time eye position of the target user to the three-dimensional virtual scene to obtain the real-time position information of the human eye; taking the real-time position information of the human eye in the three-dimensional virtual scene as the viewpoint and the virtual projection surface corresponding to the three-dimensional weather model as the viewing plane, performing perspective projection operation on the weather data and the three-dimensional weather model in the display layout interface to obtain a two-dimensional display screen; performing clipping processing on the two-dimensional display screen to obtain a two-dimensional image corresponding to the three-dimensional virtual scene, and using the two-dimensional image as the interface to be displayed. Among them, the interface to be displayed is an interface that can be projected and displayed.

[0124] The step of obtaining the real-time eye position of the target user includes: obtaining the target user image captured by the camera in real time, determining the two-dimensional coordinate information and depth information of the target user's eyes in the target user image, and determining the two-dimensional coordinate information and depth information as the real-time eye position (real-time eye coordinate information). The target user image captured by the camera is obtained in real time, and the eye position is determined in real time to capture the changes in the position information of the human eye in real time.

[0125] In one embodiment, the camera for collecting the target user image may be an ordinary camera, that is, a 2D camera, so that the acquired target user image does not contain depth information. After acquiring the target user image, the two-dimensional coordinate information (human eye recognition / human eye detection and other methods) and depth information (depth recognition method) of the human eye in the target user image are determined by other means. For example, the human eye in the target user image is identified by methods such as human eye recognition / human eye detection, and the two-dimensional coordinate information of the human eye in the target user image is determined, and the depth information of the human eye in the target user image is determined by a neural network model, so that the real-time human eye coordinate information of the target user is obtained. Among them, the neural network model can be a residual network (Residual Network) and a deep convolutional neural network (Deep Convolutional Neural Networks, DCNN), etc. In this way, the camera for collecting the target user image uses an ordinary 2D camera, which reduces the cost; and the neural network model is used to perform depth recognition on the target user image to improve the accuracy of determining the depth information of the human eye in the target user image.

[0126] In one embodiment, the camera that captures the target user image may be a depth camera, that is, a 3D camera, and the image captured by the 3D camera has depth information. After acquiring the target user image, the human eye in the target user image is identified by methods such as human eye recognition / human eye detection, and the two-dimensional coordinate information of the human eye in the target user image is determined; then the depth information corresponding to the two-dimensional coordinate information of the human eye in the target user image is obtained. Using a depth camera to determine the depth information of the human eye in the target user image improves the accuracy and efficiency of obtaining depth information.

[0127] In one embodiment, the camera for collecting the target user image may be an infrared camera, which may be either a 2D camera or a 3D camera. Among them, in the target user image collected by the 2D camera or the 3D camera, the method for determining the two-dimensional coordinate information and depth information of the human eye in the target user image can refer to the description above, and the beneficial effects achieved can also refer to the description above, which will not be repeated here. The use of an infrared camera is convenient for real-time acquisition of the target user's eye coordinate information in the case of strong ambient light (such as during the day or when the lights are on), and is also convenient for obtaining the target user's real-time eye coordinate information in the case of weak ambient light (such as at night, when the light is dim and the lights are not on, etc.), thereby improving applicability and improving the accuracy of determining the eye coordinate information.

[0128] In one embodiment, when a human eye is not recognized in a target user image, two-dimensional coordinate information and depth information of the human eye in at least one target user image and the at least one target user image collected before the target user image are obtained; the two-dimensional coordinate information and depth information of the human eye in the target user image are predicted using the at least one target user image and the at least one target user image to obtain predicted two-dimensional coordinate information and depth information; and the predicted two-dimensional coordinate information and depth information are used as the two-dimensional coordinate information and depth information of the human eye in the target user image.

[0129] The eye coordinate information of the target user mentioned above can be obtained by collecting the target user image through a camera, and then determining the eye coordinate information of the target user's eye in the target user image. It can be understood that it can also be achieved through other feasible ways.

[0130] Among them, mapping the real-time eye position (real-time human eye coordinate information) of the target user into the three-dimensional virtual scene includes: determining the real-time position information of the human eye in the three-dimensional virtual scene corresponding to the optical machine according to the real-time eye position (real-time human eye coordinate information) of the target user.

[0131] When the real-time human eye coordinate information is determined by the target user image captured by the camera, correspondingly, the step of determining the real-time position information of the human eye in the three-dimensional virtual scene corresponding to the optical machine based on the real-time human eye coordinate information includes: determining the real-time position information of the human eye in the three-dimensional virtual scene corresponding to the optical machine based on the second relative position relationship between the camera and the optical machine and the real-time human eye coordinate information.

[0132] The camera and the optical machine have a second relative position relationship. Since the target user image is taken by the camera, after the real-time human eye coordinate information is determined, the coordinate information corresponding to the real-time human eye coordinate information in the three-dimensional coordinate system with the camera as the origin can be determined, and then according to the second relative position relationship between the camera and the optical machine, the real-time position information of the real-time human eye coordinate information in the three-dimensional virtual scene corresponding to the optical machine can be determined.

[0133] That is, the camera, human eye, optical machine, the relationship between the camera and the human eye, and the relationship between the camera and the optical machine in the real world are all reflected in the three-dimensional virtual scene, so that the scene in the real world is simulated through the three-dimensional virtual scene. In the three-dimensional virtual scene, the camera and the optical machine correspond to the virtual camera and the virtual optical machine respectively. Among them, different points are used to represent the position information of the virtual camera, the position information of the human eye (referring to the virtual human eye), the position information of the virtual optical machine, etc. A three-dimensional virtual space is formed with the virtual camera in the three-dimensional virtual scene as the origin, and a three-dimensional virtual space is formed with the virtual optical machine as the origin. The human eye (referring to the virtual human eye) is located in the three-dimensional virtual space with the virtual camera as the origin. The real-time human eye coordinate information can be converted into real-time position information in the three-dimensional virtual scene with the virtual optical machine as the origin through matrix transformation.

[0134] Among them, the above-mentioned step of determining the real-time position information of the human eye in the three-dimensional virtual scene corresponding to the optical machine based on the second relative position relationship between the camera and the optical machine and the real-time human eye coordinate information includes: determining the real-time coordinate information of the human eye in the three-dimensional coordinate system where the camera is located based on the real-time human eye coordinate information; converting the real-time coordinate information of the human eye into real-time position information in the three-dimensional virtual scene corresponding to the optical machine based on the second relative position relationship between the camera and the optical machine.

[0135] Among them, the three-dimensional virtual scene corresponding to the optical machine refers to the three-dimensional virtual scene where the virtual optical machine corresponding to the optical machine is located.

[0136] After determining the real-time position information of the human eye, the real-time position information of the human eye in the three-dimensional virtual scene is used as the viewpoint, and the virtual projection surface corresponding to the three-dimensional weather model is used as the viewing plane. The weather data and the three-dimensional weather model in the display layout interface are subjected to perspective projection operation to obtain a two-dimensional display screen.

[0137] For specific perspective projection operations, please refer to the above Figure 5 Schematic diagram shown. Figure 5 The difference from the schematic diagram shown is that the viewpoint is no longer a virtual projector, but the position information of the human eye in the three-dimensional virtual scene.

[0138] The step of trimming the two-dimensional display screen to obtain a two-dimensional image corresponding to the three-dimensional virtual scene will not be repeated here.

[0139] Since the position information of the human eye will change, the calculated two-dimensional display screen will also change, and the interface to be displayed obtained by cropping the two-dimensional display screen will also change. In this way, the interface to be displayed changes according to the change of the real-time position information of the human eye, that is, the interface to be displayed changes according to the change of the viewing angle of the human eye, so as to achieve a realistic three-dimensional display effect of weather data and enhance the target user experience.

[0140] If the projection surface is replaced with a display screen, then when determining the two-dimensional display screen, perspective projection is performed according to the size of the display screen, and the two-dimensional display screen after perspective projection can be directly displayed; there is no need to determine the relative position relationship between the human eye and the projection surface, and there is no need to crop the two-dimensional display screen obtained after perspective projection. That is, the implementation principle of the display screen is different from that of the projector in the embodiment of the present disclosure.

[0141] Step 205: When it is detected that the interface to be displayed meets the display condition, the interface to be displayed is projected and displayed.

[0142] Step 206, when it is detected that the weather audio and video data meets the playing condition, the weather audio and video data is played.

[0143] For the same steps in this embodiment as in the above embodiment, please refer to the corresponding description in the above embodiment, which will not be repeated here. This embodiment determines the interface to be displayed according to the real-time eye position and the target user's focus area, so that the three-dimensional weather model in the determined interface to be displayed changes with the change of the real-time eye position, achieving a three-dimensional display effect. The three-dimensional weather model can be used to display weather data more intuitively, improve the weather data display effect, and increase the fun of weather data reminders; at the same time, the virtual projection surface is determined according to the target user's focus area, so that the interface to be displayed can be projected and displayed in the target user's focus area, such as a wall, etc., to improve the practicality of the projection display.

[0144] The above method embodiments can be combined with the characteristic that the projector can be always on in the home scene to convert weather data into wall decoration and atmosphere display in the home scene, and make the weather data in the projected display interface change with the target user's viewing angle, thereby improving the target user experience of the projector.

[0145] In one embodiment, after the step of obtaining the interface to be displayed, the weather data display method further includes: grayscale processing the interface to be displayed and the previous interface to be displayed respectively to obtain a first grayscale image and a second grayscale image; similarity calculation of the first grayscale image and the second grayscale image to obtain a similarity value; if the similarity value is less than a preset similarity value, the final interface to be displayed is determined according to the previous interface to be displayed and the interface to be displayed. Among them, the step of determining the final interface to be displayed according to the previous interface to be displayed and the interface to be displayed includes: determining the current target eye position information according to the eye coordinate information corresponding to the previous interface to be displayed and the eye coordinate information corresponding to the interface to be displayed; determining the target position information of the eye in the three-dimensional virtual scene corresponding to the optical machine according to the target eye coordinate information; performing perspective projection operation on the weather data and the three-dimensional weather model in the display layout interface according to the target position information and the projection surface to obtain a two-dimensional display screen; cropping the two-dimensional display screen to obtain a two-dimensional image corresponding to the three-dimensional weather model, and determining the two-dimensional image as the final interface to be displayed. This embodiment improves the display effect of the interface to be displayed by solving the problem that the interface to be displayed between the two frames of projection displayed before and after is greatly different due to processing exceptions.

[0146] According to the method described in the above embodiment, this embodiment will be further described from the perspective of a weather data display device, which can be implemented as an independent entity or integrated into an electronic device, which can include various projectors, or mobile terminals with projection functions, wearable devices, robots, etc.

[0147] See also Figure 7 , Figure 7 The weather data display device provided by the embodiment of the present disclosure is specifically described, which is applied to an electronic device. The weather data display device may include: an acquisition module 301, a first determination module 302, a second determination module 303, a display module 304 and a playback module 305. Among them:

[0148] The acquisition module 301 is used to acquire weather data and current time.

[0149] The first determination module 302 is used to determine the three-dimensional weather model and weather audio and video data corresponding to the current time according to the weather data.

[0150] The first determination module 302 is specifically used to determine the time period to which the current time belongs;

[0151] According to the weather data and the time period, a corresponding three-dimensional weather model is determined from a weather display library; according to the weather data and the time period, corresponding weather audio and video data is determined from a weather audio and video library.

[0152] Among them, the first determination module 302, when executing the step of determining the corresponding three-dimensional weather model from the weather display library according to the weather data and the time period, specifically performs: determining the three-dimensional weather model of the first display type from the weather display library according to the current weather data in the weather data and the time period; determining the three-dimensional weather model of the second display type from the weather display library according to the future weather data in the weather data and the time period.

[0153] The second determining module 303 is used to determine the interface to be displayed according to the two-dimensional image corresponding to the three-dimensional weather model.

[0154] Among them, the second determination module 303 is specifically used to obtain a display layout interface; fill the display layout interface according to the weather data and the three-dimensional weather model; display the display layout interface to obtain a two-dimensional image corresponding to the three-dimensional weather model, and determine the interface to be displayed based on the two-dimensional image.

[0155] Among them, the second determination module 303, when executing the step of performing display processing on the display layout interface to obtain a two-dimensional image corresponding to the three-dimensional weather model, specifically performs: performing perspective projection operation on the weather data and the three-dimensional weather model in the display layout interface to obtain a two-dimensional display screen; and performing cropping processing on the two-dimensional display screen to obtain a two-dimensional image corresponding to the three-dimensional weather model.

[0156] The display module 304 is used to project and display the interface to be displayed when it is detected that the interface to be displayed meets the display condition.

[0157] The playing module 305 is used to play the weather audio and video data when it is detected that the weather audio and video data meets the playing condition.

[0158] In one embodiment, the weather data display device further includes a third determination module. The acquisition module 301 is further used to determine the weather impact information corresponding to the weather data according to the current time, and to obtain the emotional information of the target user, wherein the weather impact information is used to characterize the impact of the weather data at the current time on the target user's emotions. The third determination module is used to determine the adjusted audio and video data matching the weather impact information and the emotional information. The playback module 305 is also used to play the adjusted audio and video data.

[0159] In one embodiment, the third determination module is specifically used to determine the type of audio and video data that matches the weather impact information and the emotion information; and obtain the adjustment audio and video data that matches the audio and video data type from the adjustment audio and video library.

[0160] In one embodiment, the weather data display device further includes a fourth determination module. The fourth determination module is used to determine the virtual projection surface corresponding to the three-dimensional weather model according to the focus area of ​​the target user. The second determination module 303 is also used to determine the interface to be displayed including the two-dimensional image corresponding to the three-dimensional weather model according to the real-time eye position of the target user and the virtual projection surface corresponding to the three-dimensional weather model.

[0161] During specific implementation, the above modules and / or units can be implemented as independent entities, or can be arbitrarily combined to be implemented as the same or several entities. The specific implementation of the above modules and / or units can refer to the previous method embodiments. The specific beneficial effects that can be achieved can also refer to the beneficial effects in the previous method embodiments, which will not be repeated here.

[0162] In addition, the embodiments of the present disclosure also provide an electronic device, which includes various projectors, or mobile terminals with projection functions, wearable devices, robots, etc. Figure 8 As shown, the electronic device 400 includes a processor 401, a memory 402, an optical machine 11, and a camera 12. The processor 401 is electrically connected to the memory 402, the optical machine 11 is respectively connected to the processor 401 and the memory 402, the camera 12 is respectively connected to the processor 401 and the memory 402, the data collected by the camera 12 is stored in the memory 402, and the optical machine 11 is connected to the camera 12.

[0163] The processor 401 is the control center of the electronic device 400. It uses various interfaces and lines to connect various parts of the entire electronic device. By running or loading applications stored in the memory 402 and calling data stored in the memory 402, it executes various functions of the electronic device and processes data, thereby monitoring the electronic device as a whole. The camera 12 is used to collect images. The optical machine 11 integrates display core, light source, lens optical path, heat dissipation and other functions.

[0164] In this embodiment, the processor 401 in the electronic device 400 loads instructions corresponding to the processes of one or more application programs into the memory 402 according to the following steps, and the processor 401 runs the application programs stored in the memory 402 to implement various functions:

[0165] Acquire weather data and current time; determine the three-dimensional weather model and weather audio and video data corresponding to the current time based on the weather data; determine the interface to be displayed based on the two-dimensional image corresponding to the three-dimensional weather model; when it is detected that the interface to be displayed meets the display conditions, project and display the interface to be displayed; when it is detected that the weather audio and video data meet the playback conditions, play the weather audio and video data.

[0166] In some embodiments, the electronic device 400 may further include at least one of an input module, a display module, at least one sensor (depth sensor, light sensor, etc.), an audio circuit, a transmission module, a power supply, and the like.

[0167] The electronic device can implement the steps in any embodiment of the weather data display method provided in the embodiments of the present disclosure, and therefore can achieve the beneficial effects that can be achieved by any weather data display method provided in the embodiments of the present disclosure. Please refer to the previous embodiments for details and will not be repeated here.

[0168] Those skilled in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructions, or by controlling related hardware through instructions, and the instructions can be stored in a computer-readable storage medium and loaded and executed by a processor. To this end, the present embodiment provides a storage medium, which stores a plurality of instructions, and the instructions can be loaded by a processor to execute the steps of any embodiment of the weather data display method provided in the present embodiment.

[0169] The storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0170] Since the instructions stored in the storage medium can execute the steps in any embodiment of the weather data display method provided in the embodiments of the present disclosure, the beneficial effects that can be achieved by any weather data display method provided in the embodiments of the present disclosure can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0171] The weather data display method, device, storage medium and electronic device provided by the embodiments of the present disclosure are introduced in detail above. The principles and implementation methods of the embodiments of the present disclosure are explained in this article using specific examples. The description of the above embodiments is only used to help understand the method and core idea of ​​the embodiments of the present disclosure. At the same time, for technical personnel in this field, according to the ideas of the embodiments of the present disclosure, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as a limitation on the embodiments of the present disclosure.

Claims

1. A weather data display method, applied to a projector, characterized in that: include: Acquire weather data and current time, wherein the weather data includes weather data corresponding to the current time and / or weather data corresponding to a preset time in the future; Determine, based on the weather data, a three-dimensional weather model and weather audio and video data corresponding to the current time; Determine an interface to be displayed according to the two-dimensional image corresponding to the three-dimensional weather model, obtain a display layout interface, fill the display layout interface according to the weather data and the three-dimensional weather model, perform perspective projection operation on the weather data and the three-dimensional weather model in the display layout interface to obtain a two-dimensional display screen, perform clipping processing on the two-dimensional display screen to obtain a two-dimensional image corresponding to the three-dimensional weather model, and determine the interface to be displayed according to the two-dimensional image; When it is detected that the interface to be displayed meets the display condition, projecting and displaying the interface to be displayed; When it is detected that the weather audio and video data meets the playing condition, playing the weather audio and video data; Among them, the step of determining the interface to be displayed according to the two-dimensional image includes: determining the interface to be displayed including the two-dimensional image corresponding to the three-dimensional weather model according to the real-time eye position of the target user and the virtual projection surface corresponding to the three-dimensional weather model; each time weather data is acquired, the three-dimensional weather model is determined, or a change in the real-time eye position of the target user is detected, determining the interface to be displayed including the two-dimensional image corresponding to the three-dimensional weather model according to the real-time eye position of the target user and the virtual projection surface corresponding to the three-dimensional weather model; wherein, the step of determining the interface to be displayed including the two-dimensional image corresponding to the three-dimensional weather model according to the real-time eye position of the target user and the virtual projection surface corresponding to the three-dimensional weather model includes: acquiring a display layout interface; filling the display layout interface according to the weather data and the three-dimensional weather model; displaying the display layout interface according to the real-time eye position of the target user and the virtual projection surface corresponding to the three-dimensional weather model, so as to obtain an interface to be displayed including the two-dimensional image corresponding to the three-dimensional weather model; The step of obtaining the real-time eye position of the target user includes: obtaining the target user image captured by the camera in real time, determining the two-dimensional coordinate information and depth information of the target user's eyes in the target user image, and determining the two-dimensional coordinate information and the depth information as the real-time eye position; obtaining the target user image captured by the camera in real time, determining the eye position in real time, so as to capture the changes in the position information of the human eye in real time.

2. The weather data display method according to claim 1, characterized in that: The step of performing perspective projection operation on the weather data and the three-dimensional weather model in the display layout interface to obtain a two-dimensional display screen includes: Determine first distance information and a first relative position relationship between the projector and the projection surface; Establishing a three-dimensional virtual coordinate system with the virtual projector corresponding to the projector as the origin; Determining the position of the virtual projection plane corresponding to the projection plane in the three-dimensional virtual coordinate system according to the first distance information and the first relative position relationship; Taking the virtual projector as the viewpoint and the virtual projection surface as the viewing plane, a perspective projection operation is performed on the weather data and the three-dimensional weather model in the display layout interface to obtain a two-dimensional display screen.

3. The weather data display method according to claim 1, characterized in that: The step of trimming the two-dimensional display screen to obtain a two-dimensional image corresponding to the three-dimensional weather model includes: Get the distance between the optical machine and the projection surface; Determining a projection position of the optical machine on the projection surface according to a distance between the optical machine and the projection surface; The two-dimensional display picture is cropped according to the projection position to obtain a two-dimensional image corresponding to the three-dimensional weather model.

4. The weather data display method according to claim 3, characterized in that: The step of trimming the two-dimensional display screen to obtain a two-dimensional image corresponding to the three-dimensional weather model includes: Generate a virtual projection position in a three-dimensional virtual scene according to the projection position, wherein the virtual projection position is consistent with the projection position; The two-dimensional display screen is cropped according to the virtual projection position, the two-dimensional display screen located in the virtual projection position is retained, and the two-dimensional display screen located outside the virtual projection position is cropped to obtain a two-dimensional image corresponding to the three-dimensional weather model.

5. The weather data display method according to claim 3, characterized in that: The step of determining the projection position of the optical machine on the projection surface according to the distance between the optical machine and the projection surface comprises: Determining the projection size of the light machine projected on the projection surface according to the distance between the light machine and the projection surface; Determining a specific projection position of the optical machine on the projection surface according to the projection parameters of the optical machine; The projection size and the specific projection position are used as the projection position of the optical machine projection on the projection surface.

6. The weather data display method according to claim 1, characterized in that: The step of determining the three-dimensional weather model and weather audio and video data corresponding to the current time according to the weather data comprises: Determine the time period to which the current time belongs; Determine, from a weather display library, a three-dimensional weather model corresponding to the current time according to the weather data and the time period; According to the weather data and the time period, the weather audio and video data corresponding to the current time is determined from a weather audio and video library.

7. The weather data display method according to claim 1, characterized in that: The step of determining the interface to be displayed according to the two-dimensional image corresponding to the three-dimensional weather model includes: Detecting whether there is an interface to be displayed in the memory of the electronic device; If the interface to be displayed does not exist, generating the interface to be displayed according to the two-dimensional image corresponding to the three-dimensional weather model; If the interface to be displayed already exists, the interface to be displayed is updated according to the two-dimensional image corresponding to the three-dimensional weather model.

8. A weather data display device, characterized in that: include: An acquisition module, used to acquire weather data and current time, wherein the weather data includes weather data corresponding to the current time and / or weather data corresponding to a preset time in the future; A first determination module, used to determine the three-dimensional weather model and weather audio and video data corresponding to the current time according to the weather data; A second determination module, used to determine the interface to be displayed according to the two-dimensional image corresponding to the three-dimensional weather model; Acquire a display layout interface, and fill the display layout interface according to the weather data and the three-dimensional weather model; perform perspective projection operation on the weather data and the three-dimensional weather model in the display layout interface to obtain a two-dimensional display screen; The two-dimensional display screen is trimmed to obtain a two-dimensional image corresponding to the three-dimensional weather model, and an interface to be displayed is determined according to the two-dimensional image; A display module, configured to project and display the interface to be displayed when it is detected that the interface to be displayed meets the display condition; A playing module, used for playing the weather audio and video data when it is detected that the weather audio and video data meets the playing condition; The second determination module is further specifically used to determine the interface to be displayed including the two-dimensional image corresponding to the three-dimensional weather model according to the real-time eye position of the target user and the virtual projection surface corresponding to the three-dimensional weather model; each time weather data is acquired, the three-dimensional weather model is determined, or a change in the real-time eye position of the target user is detected, the interface to be displayed including the two-dimensional image corresponding to the three-dimensional weather model is determined according to the real-time eye position of the target user and the virtual projection surface corresponding to the three-dimensional weather model; The second determination module is further specifically used to obtain a display layout interface; fill the display layout interface according to the weather data and the three-dimensional weather model; and perform display processing on the display layout interface according to the real-time eye position of the target user and the virtual projection surface corresponding to the three-dimensional weather model to obtain a to-be-displayed interface including a two-dimensional image corresponding to the three-dimensional weather model; The second determination module is also specifically used to acquire the target user image captured by the camera in real time, determine the two-dimensional coordinate information and depth information of the target user's eyes in the target user image, and determine the two-dimensional coordinate information and the depth information as the real-time eye position; acquire the target user image captured by the camera in real time, determine the eye position in real time, so as to capture the changes in the position information of the human eye in real time.

9. An electronic device, characterized in that: include: A processor and a memory, wherein the processor is electrically connected to the memory, the memory is used to store instructions and data, and the processor is used to execute the steps in the weather data display method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor to execute the steps in the weather data display method according to any one of claims 1 to 7.