Environmental state visualization method, apparatus, storage medium, and electronic device

Abstract

The application discloses an environment state visualization method and device, a storage medium and an electronic device, relates to the technical field of smart homes, and comprises the following steps: acquiring environment data, analyzing the environment data, determining data of multiple environment dimensions, classifying environment information, determining different dimension graphs for different dimension data in the subsequent process, and representing information of the corresponding environment dimension through the dimension graph. The dimension graphs of the multiple environment dimensions are subjected to image fusion to obtain an environment state graph. The information corresponding to the multiple environment dimensions can be represented through the environment state graph, and the content is more abundant. The environment state graph is determined according to the environment data, abstract data is converted into a figurative and materialized graph, the environment state graph is displayed through a target device, the user can intuitively and comprehensively understand the overall state of the environment, and the use experience of the user is improved.

Description

Technical Field

[0001] This application relates to the field of smart home technology, and in particular to a method, apparatus, storage medium and electronic device for visualizing environmental conditions. Background Technology

[0002] In existing technologies, environmental information is usually not displayed to users, or it is only displayed numerically, such as humidity being 45%. Users do not easily understand the relationship between numerical concepts and physical sensations, and therefore cannot easily understand the environmental conditions based on the displayed content.

[0003] Therefore, proposing a method for visualizing environmental conditions to allow users to intuitively understand the environmental state is an important research direction at present. Summary of the Invention

[0004] This application provides an environmental state visualization method, apparatus, storage medium, and electronic device to address the shortcomings of existing technologies where users cannot easily understand environmental states through numerical values. It aims to visualize and materialize environmental information, allowing users to intuitively understand environmental states through materialized graphics.

[0005] This application provides a method for visualizing environmental conditions, including:

[0006] Acquire environmental data;

[0007] Based on the environmental data, determine the environmental dimension data corresponding to each of the multiple environmental dimensions;

[0008] Based on the values ​​of the environmental dimension data, a dimension graphic corresponding to each environmental dimension is determined, wherein the dimension graphic is a skeuomorphic graphic that matches the environmental dimension data of the corresponding environmental dimension;

[0009] Based on the dimension graphics corresponding to multiple environmental dimensions, a graphic fusion is performed to generate an environmental state graphic, wherein the environmental state graphic is a skeuomorphic graphic that matches the environmental data of each of the environmental dimensions.

[0010] The environmental status graphic is sent to the target device for display.

[0011] According to the environmental state visualization method provided in this application, the step of determining the environmental dimension data corresponding to each of the multiple environmental dimensions based on the environmental data includes:

[0012] Based on the source of acquisition of the environmental data, the environmental data is classified to obtain environmental data corresponding to different acquisition sources;

[0013] Based on the mapping relationship between the acquisition source and the environmental dimension type, the environmental data corresponding to different acquisition sources are divided into environmental dimension data of multiple environmental dimensions.

[0014] According to the environmental state visualization method provided in this application, the step of determining a dimension graph corresponding to each environmental dimension based on the numerical values ​​of the environmental dimension data includes:

[0015] Based on the numerical value of the environmental dimension data, a target numerical range is determined from multiple preset numerical ranges corresponding to the environmental dimension.

[0016] Based on the target numerical range and a preset table showing the relationship between multiple numerical ranges and the corresponding materialized graphics, query the dimensional graphics corresponding to the environmental dimensional data.

[0017] According to the environmental state visualization method provided in this application, the step of performing graphic fusion based on the dimensional graphics corresponding to multiple environmental dimensions to generate an environmental state graphic includes:

[0018] Extract the virtual object feature information of the dimension graphic corresponding to each of the environmental dimensions, wherein the virtual object feature information is used to characterize the information of the environmental dimension and the information of the environmental dimension data corresponding to the environmental dimension;

[0019] Based on the feature information of multiple virtual objects, feature fusion is performed, and an environment state graph is generated based on the fused virtual object feature information. The environment state graph is used to represent information of multiple environmental dimensions and information of environmental dimension data corresponding to each environmental dimension.

[0020] According to the environmental state visualization method provided in this application, the step of extracting the virtual object feature information of the dimension graphic corresponding to each environmental dimension includes:

[0021] For each environmental dimension corresponding to a dimension graphic, input a pre-trained image recognition model to determine the virtual objects in the dimension graphic;

[0022] The virtual objects in the dimensional graph are input into a pre-trained image semantic model, and the corresponding virtual object semantic vectors are output as virtual object feature information.

[0023] According to the environmental state visualization method provided in this application, the step of performing feature fusion based on multiple virtual object feature information and generating an environmental state graph based on the fused virtual object feature information includes:

[0024] Multiple virtual object semantic vectors are concatenated to obtain a concatenated vector, which is then determined as the fused virtual object feature information.

[0025] The spliced ​​vector is input into a pre-trained image reconstruction model, and an environmental state graph is generated based on the spliced ​​vector.

[0026] According to the environmental status visualization method provided in this application, the acquisition of environmental data includes:

[0027] Acquire raw environmental data collected by at least one environmental information acquisition device;

[0028] The environmental data is determined by summarizing the original environmental data.

[0029] This application also provides an environmental status visualization device, including:

[0030] The acquisition unit is used to acquire environmental data;

[0031] The parsing unit is used to determine the environmental dimension data corresponding to each of the multiple environmental dimensions based on the environmental data.

[0032] A graphics unit is used to determine a dimension graphic corresponding to each of the environmental dimensions based on the values ​​of the environmental dimension data, wherein the dimension graphic is a skeuomorphic graphic that matches the environmental dimension data of the corresponding environmental dimension.

[0033] Based on the dimension graphics corresponding to multiple environmental dimensions, a graphic fusion is performed to generate an environmental state graphic, wherein the environmental state graphic is a skeuomorphic graphic that matches the environmental data of each of the environmental dimensions.

[0034] The control unit is used to send the environmental status graphics to the target device for display.

[0035] This application also provides an electronic device including a memory and a processor, wherein the memory stores a computer program and the processor is configured to execute the environmental state visualization method as described above through the computer program.

[0036] This application also provides a computer-readable storage medium comprising a stored program, wherein the program, when executed, implements the environment state visualization method as described above.

[0037] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the environment state visualization method as described above.

[0038] The environmental state visualization method, apparatus, storage medium, and electronic device provided in this application acquire environmental data, analyze the data, and determine multiple environmental dimensions to classify environmental information. This facilitates the subsequent determination of different dimensional graphics for different dimensional data, representing the information of the corresponding environmental dimensions through these graphics. By fusing the dimensional graphics of multiple environmental dimensions, a single environmental state graphic is obtained, which can represent information corresponding to multiple environmental dimensions, resulting in richer content representation. Determining the environmental state graphic based on environmental data transforms abstract data into concrete, materialized graphics. Displaying the environmental state graphic on a target device allows users to intuitively and comprehensively understand the overall state of the environment, enhancing the user experience. Attached Figure Description

[0039] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0040] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0041] Figure 1 This is a schematic diagram of the hardware environment of an environmental state visualization method according to an embodiment of this application;

[0042] Figure 2 This is a flowchart illustrating the environmental state visualization method provided in this application;

[0043] Figure 3 This is a schematic diagram of the environmental status visualization process provided in this application;

[0044] Figure 4 This is a schematic diagram of the environmental status visualization device provided in this application;

[0045] Figure 5 This is a schematic diagram of the electronic device provided in this application. Detailed Implementation

[0046] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.

[0047] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0048] According to one aspect of the embodiments of this application, an environmental state visualization method is provided. This environmental state visualization method is widely used in whole-house intelligent digital control application scenarios such as smart homes, smart home ecosystems, and intelligence house ecosystems. Optionally, in this embodiment, the above-mentioned environmental state visualization method can be applied to, for example... Figure 1 The hardware environment shown consists of terminal device 102 and server 104. For example... Figure 1 As shown, server 104 is connected to terminal device 102 via a network and can be used to provide services (such as application services) to the terminal or clients installed on the terminal. A database can be set up on the server or independently of the server to provide data storage services for server 104. Cloud computing and / or edge computing services can be configured on the server or independently of the server to provide data processing services for server 104.

[0049] The aforementioned network may include, but is not limited to, at least one of the following: wired network, wireless network. The aforementioned wired network may include, but is not limited to, at least one of the following: wide area network, metropolitan area network, local area network. The aforementioned wireless network may include, but is not limited to, at least one of the following: Wi-Fi (Wireless Fidelity), Bluetooth. The terminal device 102 may not be limited to PC, mobile phone, tablet computer, smart air conditioner, smart range hood, smart refrigerator, smart oven, smart stove, smart washing machine, smart water heater, smart washing equipment, smart dishwasher, smart projector, smart TV, smart clothes rack, smart curtains, smart audio-visual equipment, smart socket, smart speaker, smart speaker box, smart fresh air equipment, smart kitchen and bathroom equipment, smart bathroom equipment, smart robot vacuum cleaner, smart window cleaning robot, smart mopping robot, smart air purifier, smart steam oven, smart microwave oven, smart water heater, smart air purifier, smart water dispenser, smart door lock, etc.

[0050] This application provides a method for visualizing environmental conditions, such as... Figure 2 As shown, it includes:

[0051] S21. Obtain environmental data;

[0052] S22. Determine the environmental dimension data corresponding to each of the multiple environmental dimensions based on the environmental data;

[0053] S23. Based on the values ​​of the environmental dimension data, determine a dimension graphic corresponding to each environmental dimension, wherein the dimension graphic is a skeuomorphic graphic that matches the environmental dimension data of the corresponding environmental dimension;

[0054] S24. Based on the dimension graphics corresponding to the multiple environmental dimensions, perform graphic fusion to generate an environmental state graphic, wherein the environmental state graphic is a skeuomorphic graphic that matches the environmental data of each of the environmental dimensions.

[0055] S25. Send the environmental status graphic to the target device for display.

[0056] Specifically, environmental data is a collection of information including but not limited to temperature, humidity, concentration of specified gases in the air, and concentration of particulate matter. Environmental dimension data is a single type of data from the above collection. Virtual objects in the skeuomorphic graphics can include, but are not limited to, animals and / or plants.

[0057] Preferably, environmental data can be acquired in real time, and environmental dimension data and corresponding dimension graphics for multiple environmental dimensions can be determined in real time. Furthermore, environmental status graphics can be generated by real-time fusion of these multi-dimensional graphics and sent to the target device. The target device then displays the real-time environmental status.

[0058] Specifically, based on the environmental dimension data of an environmental dimension, a corresponding dimension graph can be determined, thereby realizing the visualization of the abstract environmental dimension data into a viewable graph.

[0059] Based on the dimensional graphs corresponding to multiple environmental dimensions, graph fusion is performed to generate an environmental state graph. Through this environmental state graph, the abstract environmental dimension data of each environmental dimension can be integrated and visualized into a viewable graph that is rich in content and can simultaneously express information from each environmental dimension.

[0060] In this embodiment, environmental data is acquired and analyzed to determine multiple environmental dimensions, enabling the classification of environmental information. This facilitates the subsequent determination of different dimensional graphics for different dimensions, which represent the information of each environmental dimension. The dimensional graphics of multiple environmental dimensions are then fused to obtain a single environmental state graphic. This single graphic can represent the information corresponding to multiple environmental dimensions, resulting in richer content representation. Determining the environmental state graphic based on environmental data transforms abstract data into concrete, realistic graphics. Displaying the environmental state graphic on the target device allows users to intuitively and comprehensively understand the overall state of the environment, enhancing the user experience.

[0061] According to the environmental state visualization method provided in this application, step S21 includes:

[0062] S211. Obtain raw environmental data collected by at least one environmental information acquisition device;

[0063] S212. Summarize the original environmental data to determine the original environmental data.

[0064] Specifically, raw environmental data can be collected through environmental information collection devices that users have pre-registered and bound. These devices include, but are not limited to, air conditioners, thermometers, hygrometers, dehumidifiers, humidifiers, and air purifiers. The raw environmental data can include, but is not limited to, temperature, humidity, concentration of specified gases in the air, and concentration of particulate matter.

[0065] For example, temperature data can be collected using a thermometer, humidity data can be collected using a hygrometer, and the concentration of a specified gas and particulate matter in the air can be collected using an air purifier. The collected environmental data can be summarized to obtain environmental data including temperature, humidity, concentration of the specified gas, and concentration of particulate matter.

[0066] In this embodiment of the application, raw environmental data is collected by environmental information collection devices and then aggregated to obtain environmental data. For raw environmental data collected by multiple environmental information collection devices, the aggregated environmental data is more accurate and has richer dimensions.

[0067] According to the environmental state visualization method provided in this application, step S22 includes:

[0068] S221. Classify the environmental data according to the source of acquisition to obtain environmental data corresponding to different acquisition sources;

[0069] S222. Based on the mapping relationship between the acquisition source and the environmental dimension type, the environmental data corresponding to different acquisition sources are divided into environmental dimension data of multiple environmental dimensions.

[0070] Specifically, environmental data can be classified according to different acquisition sources by setting preset classification rules, and then the classified environmental data can be divided into multiple environmental dimension data of different dimensions according to the acquisition source.

[0071] Specifically, environmental data is categorized based on the type of environmental data collection device, i.e., the source of acquisition. In one example, the environmental data includes environmental data A collected by a thermometer and environmental data B collected by a dehumidifier. The environmental data collected by the thermometer is pre-classified as environmental data of the "temperature" dimension, and the environmental data collected by the dehumidifier is environmental data of the "humidity" dimension. When categorizing environmental data according to the source of acquisition, environmental data A is designated as environmental data of the "temperature" dimension, and environmental data B is designated as environmental data of the "humidity" dimension.

[0072] A single data source can correspond to multiple environmental dimensions. For example, when classifying environmental data based on the data source, the environmental data collected by the air conditioner can be pre-defined as being classified into two environmental dimensions: "temperature" and "humidity." Specifically, environmental data can be classified according to the statistical unit of the data. In one example, the environmental data includes environmental data A collected by the air conditioner, with the statistical unit being ℃ (degrees Celsius); and environmental data B collected by the air conditioner, with the statistical unit being %rh (the percentage of water vapor in the gas compared to the saturated water vapor content of air under the same conditions). The environmental data with the pre-defined statistical unit of ℃ is classified as the "temperature" dimension, and the environmental data with the statistical unit of %rh is classified as the "humidity" dimension. When classifying environmental data based on the data source, environmental data A collected by the air conditioner is designated as the "temperature" dimension, and environmental data B collected by the air conditioner is designated as the "humidity" dimension.

[0073] In this embodiment of the application, environmental data is classified according to the source of acquisition, and environmental dimension data of different dimensions are determined. This simplifies and classifies the environmental data, determines the information of different dimensions, and facilitates the subsequent determination of the dimension graph corresponding to each environmental dimension based on the different dimensions.

[0074] According to the environmental state visualization method provided in this application, step S23 includes S231-S232:

[0075] S231. Based on the numerical value of the environmental dimension data, determine the target numerical range among the preset multiple numerical ranges of the corresponding environmental dimension.

[0076] S232. Based on the target numerical range and a preset table showing the relationship between multiple numerical ranges and the materialized graphics, query the dimensional graphics corresponding to the environmental dimensional data.

[0077] Specifically, multiple numerical ranges can be set for each environmental dimension according to actual needs. For example, for the temperature dimension, the range of values ​​greater than A is divided into a high-temperature range, the range of values ​​less than B is divided into a low-temperature range, and the range of values ​​greater than or equal to B and less than or equal to A is divided into a medium-temperature range. Corresponding realistic graphics are pre-defined for different numerical ranges, such as realistic graphic 1 for the high-temperature range, realistic graphic 2 for the medium-temperature range, and realistic graphic 3 for the low-temperature range.

[0078] If the value of the environmental dimension data in the temperature dimension is greater than or equal to the value of B and less than or equal to the value of A, then the medium temperature range is determined as the target value range, and the corresponding materialized graphic 2 is determined as the dimension graphic.

[0079] In this embodiment of the application, by presetting multiple numerical ranges and the numerical values ​​of environmental dimension data, the target numerical range of the dimension data can be determined easily and quickly. By querying the relationship table between the preset numerical ranges and the corresponding materialized graphics, the dimension graphics corresponding to the environmental dimension data can be determined quickly and accurately.

[0080] According to the environmental state visualization method provided in this application, step S24 includes:

[0081] S241. Extract the virtual object feature information of the dimension graphic corresponding to each of the environmental dimensions, wherein the virtual object feature information is used to characterize the information of the environmental dimension and the information of the environmental dimension data corresponding to the environmental dimension;

[0082] S242. Based on the multiple virtual object feature information, feature fusion is performed, and an environment state graph is generated based on the fused virtual object feature information. The environment state graph is used to represent information of multiple environmental dimensions and information of environmental dimension data corresponding to each environmental dimension.

[0083] Specifically, features can be extracted from each dimension of the image to obtain virtual object feature information for each dimension. This virtual object feature information can represent the corresponding environmental dimension, as well as environmental dimension data. For example, if the virtual object feature information is a withered flower, the state of being withered represents the environmental dimension of "humidity," and the degree of withering represents the environmental dimension data of "humidity value."

[0084] For example, environmental dimension data includes temperature and humidity. The defined graphic for the temperature dimension is A, and the extracted virtual object feature information is a flower with full petals. The defined graphic for the humidity dimension is B, and the extracted virtual object feature information is a brightly colored flower. Then, based on these two virtual object feature information—a flower with full petals and a brightly colored flower—graphic fusion is performed to generate graphic C, which represents a flower with both full petals and a bright color. Graphic C is then defined as the environmental state graphic. This achieves the fusion of concrete graphics from multiple dimensions to obtain a fused graphic with information from multiple dimensions, simultaneously representing information from multiple dimensions.

[0085] In this embodiment, the virtual object feature information of the dimensional graph corresponding to each environmental dimension is first extracted, and then an environmental state graph is generated based on the virtual object feature information corresponding to all dimensional graphs. This achieves the determination of a content-rich environmental state graph based on the factors of each environmental dimension, ensuring that the environmental state graph has rich information.

[0086] According to the environmental state visualization method provided in this application, step S241 includes:

[0087] S2411. For each dimension of the environment, input a pre-trained image recognition model to determine the virtual objects in the dimension graphics.

[0088] S2412. Input the virtual objects in the dimensional graphics into the pre-trained image semantic model, output the virtual object semantic vector corresponding to the virtual object, and determine it as the virtual object feature information.

[0089] Specifically, a pre-trained image recognition model can be used to identify the dimensional graphics corresponding to each environmental dimension, and to identify virtual objects within the dimensional graphics. This reduces the impact of other non-critical areas in the dimensional graphics, such as corner areas or blank areas, on the main content expressed by the image, thus identifying the virtual objects that represent the main content of the image.

[0090] By using a pre-trained image semantic model, features are extracted from virtual objects in dimensional graphics. The graphical data of virtual objects is quantized into semantic vectors, which can richly and accurately express the features of virtual objects in dimensional graphics.

[0091] In this embodiment, virtual objects in a dimensional graphic are identified by an image recognition model, and the virtual objects in the dimensional graphic are quantified into semantic vectors of virtual objects, which can richly and accurately express the characteristics of the virtual objects mainly expressed in the dimensional graphic.

[0092] According to the environmental state visualization method provided in this application, step S242 includes:

[0093] S2421. Concatenate multiple virtual object semantic vectors to obtain a concatenated vector, which is then determined as the fused virtual object feature information.

[0094] S2422. Input the splicing vector into the pre-trained image reconstruction model, and generate an environmental state graphic based on the splicing vector.

[0095] Specifically, the semantic vectors of virtual objects in the dimensional graphics corresponding to multiple environmental dimensions can be concatenated to obtain a concatenated vector. The concatenated vector can fully and completely express the characteristics of virtual objects in the dimensional graphics corresponding to each environmental dimension.

[0096] By using a pre-trained image reconstruction model, image reconstruction can be performed based on spliced ​​vectors. The comprehensive features of virtual objects in the dimensional graphics corresponding to each environmental dimension after fusion can be transformed from vector representation to image representation, generating an environmental state graphic. The environmental state graphic can then richly and accurately express the comprehensive features of virtual objects in the dimensional graphics corresponding to each environmental dimension through a visual image, i.e., the environmental dimension data corresponding to each environmental dimension.

[0097] In this embodiment, multiple virtual object semantic vectors are concatenated. The concatenated vectors fully and completely express the features of the virtual objects in the dimensional graphics corresponding to each environmental dimension through quantization. Based on an image reconstruction model, the concatenated vectors are used to reconstruct the image, generating a visualized environmental state graphic that richly and accurately represents the environmental dimension data corresponding to each environmental dimension.

[0098] In one example based on the above embodiments, the environmental status visualization process is as follows: Figure 3As shown. Raw environmental data is acquired through environmental information collection equipment and uploaded to a cloud server. The cloud server then aggregates the environmental data and divides it into temperature and humidity dimensions. The temperature dimension includes five preset numerical ranges: extremely high, high, moderate, low, and extremely low, with corresponding graphs 1-5. The humidity dimension includes five preset numerical ranges: extremely high, high, moderate, low, and dry, with corresponding graphs 6-10. Based on environmental data in both temperature and humidity dimensions, temperature dimension graph A and humidity dimension graph B are determined within their respective dimension ranges. A and B are then fused to obtain the final environmental state graph, which is sent to a target device with a screen. When the target device is in standby mode, the environmental state graph is displayed on the screen, intuitively conveying environmental information to the user and facilitating quick and appropriate decision-making. For example, if the ambient humidity is 10% RH, which physically means dry air, displaying a graph of withered flowers on the screen of the standby target device allows the user to quickly understand the current dryness and decide whether to turn on a humidifier.

[0099] The environmental state visualization device provided in this application is described below. The environmental state visualization device described below can be referred to in correspondence with the environmental state visualization method described above.

[0100] This application also provides an environmental status visualization device, such as... Figure 4 As shown, it includes:

[0101] Acquisition unit 41 is used to acquire environmental data;

[0102] The parsing unit 42 is used to determine the environmental dimension data corresponding to each of the multiple environmental dimensions based on the environmental data;

[0103] The graphics unit 43 is used to determine a dimension graphic corresponding to each of the environmental dimensions based on the values ​​of the environmental dimension data, wherein the dimension graphic is a skeuomorphic graphic that matches the environmental dimension data of the corresponding environmental dimension; and to perform graphic fusion based on the dimension graphics corresponding to multiple environmental dimensions to generate an environmental state graphic, wherein the environmental state graphic is a skeuomorphic graphic that matches the environmental data of each of the environmental dimensions.

[0104] The control unit 44 is used to send the environmental status graphics to the target device for display.

[0105] In this embodiment, environmental data is acquired and analyzed to determine multiple environmental dimensions, enabling the classification of environmental information. This facilitates the subsequent determination of different dimensional graphics for different dimensions, which represent the information of each environmental dimension. The dimensional graphics of multiple environmental dimensions are then fused to obtain a single environmental state graphic. This single graphic can represent the information corresponding to multiple environmental dimensions, resulting in richer content representation. Determining the environmental state graphic based on environmental data transforms abstract data into concrete, realistic graphics. Displaying the environmental state graphic on the target device allows users to intuitively and comprehensively understand the overall state of the environment, enhancing the user experience.

[0106] According to the environmental status visualization device provided in this application, the acquisition unit 41 is specifically used for:

[0107] Acquire raw environmental data collected by at least one environmental information acquisition device;

[0108] The environmental data is determined by summarizing the original environmental data.

[0109] According to the environmental state visualization device provided in this application, the analysis unit 42 is specifically used for:

[0110] Based on the source of acquisition of the environmental data, the environmental data is classified to obtain environmental data corresponding to different acquisition sources;

[0111] Based on the mapping relationship between the acquisition source and the environmental dimension type, the environmental data corresponding to different acquisition sources are divided into environmental dimension data of multiple environmental dimensions.

[0112] According to the environmental status visualization device provided in this application, the graphics unit 43 is specifically used for:

[0113] Based on the numerical value of the environmental dimension data, a target numerical range is determined from multiple preset numerical ranges corresponding to the environmental dimension.

[0114] Based on the target numerical range and a preset table showing the relationship between multiple numerical ranges and the corresponding materialized graphics, query the dimensional graphics corresponding to the environmental dimensional data.

[0115] According to the environmental status visualization device provided in this application, the graphics unit 43 is specifically used for:

[0116] Extract the virtual object feature information of the dimension graphic corresponding to each of the environmental dimensions, wherein the virtual object feature information is used to characterize the information of the environmental dimension and the information of the environmental dimension data corresponding to the environmental dimension;

[0117] Feature fusion is performed based on multiple virtual object feature information, and an environment state graph is generated based on the fused virtual object feature information. The environment state graph is used to represent information of multiple environmental dimensions and information of environmental dimension data corresponding to each environmental dimension.

[0118] According to the environmental status visualization device provided in this application, the graphics unit 43 is specifically used for:

[0119] For each environmental dimension corresponding to a dimension graphic, input a pre-trained image recognition model to determine the virtual objects in the dimension graphic;

[0120] The virtual objects in the dimensional graph are input into a pre-trained image semantic model, and the corresponding virtual object semantic vectors are output as virtual object feature information.

[0121] According to the environmental status visualization device provided in this application, the graphics unit 43 is specifically used for:

[0122] Multiple virtual object semantic vectors are concatenated to obtain a concatenated vector, which is then determined as the fused virtual object feature information.

[0123] The spliced ​​vector is input into a pre-trained image reconstruction model, and an environmental state graph is generated based on the spliced ​​vector.

[0124] Figure 5 An example is a schematic diagram of the physical structure of an electronic device, such as... Figure 5 As shown, the electronic device may include a processor 510, a communication interface 520, a memory 530, and a communication bus 540, wherein the processor 510, the communication interface 520, and the memory 530 communicate with each other via the communication bus 540. The processor 510 can call logical instructions in the memory 530 to execute an environmental state visualization method, which includes: acquiring environmental data; determining environmental dimension data corresponding to multiple environmental dimensions based on the environmental data; determining a dimension graphic corresponding to each environmental dimension based on the values ​​of the environmental dimension data, wherein the dimension graphic is a skeuomorphic graphic matching the environmental dimension data of the corresponding environmental dimension; performing graphic fusion based on the dimension graphics corresponding to multiple environmental dimensions to generate an environmental state graphic, wherein the environmental state graphic is a skeuomorphic graphic matching the environmental data of each environmental dimension; and sending the environmental state graphic to a target device for display.

[0125] Furthermore, the logical instructions in the aforementioned memory 530 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0126] On the other hand, this application also provides a computer program product, which includes a computer program that can be stored on a computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the environmental state visualization method provided by the above methods. The method includes: acquiring environmental data; determining environmental dimension data corresponding to multiple environmental dimensions based on the environmental data; determining a dimension graphic corresponding to each environmental dimension based on the values ​​of the environmental dimension data, wherein the dimension graphic is a skeuomorphic graphic that matches the environmental dimension data of the corresponding environmental dimension; performing graphic fusion based on the dimension graphics corresponding to multiple environmental dimensions to generate an environmental state graphic, wherein the environmental state graphic is a skeuomorphic graphic that matches the environmental data of each environmental dimension; and sending the environmental state graphic to a target device for display.

[0127] Furthermore, this application also provides a computer-readable storage medium, which includes a stored program, wherein the program executes the environmental state visualization method provided by the above methods when it runs. This method includes: acquiring environmental data; determining environmental dimension data corresponding to multiple environmental dimensions based on the environmental data; determining a dimension graphic corresponding to each environmental dimension based on the values ​​of the environmental dimension data, wherein the dimension graphic is a skeuomorphic graphic matching the environmental dimension data of the corresponding environmental dimension; performing graphic fusion based on the dimension graphics corresponding to multiple environmental dimensions to generate an environmental state graphic, wherein the environmental state graphic is a skeuomorphic graphic matching the environmental data of each environmental dimension; and sending the environmental state graphic to a target device for display.

[0128] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0129] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0130] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A method for visualizing environmental conditions, characterized in that, include: Acquire environmental data; Based on the environmental data, determine the environmental dimension data corresponding to each of the multiple environmental dimensions; Based on the values ​​of the environmental dimension data, a dimension graphic corresponding to each environmental dimension is determined, wherein the dimension graphic is a skeuomorphic graphic that matches the environmental dimension data of the corresponding environmental dimension; Based on the dimension graphics corresponding to multiple environmental dimensions, a graphic fusion is performed to generate an environmental state graphic, wherein the environmental state graphic is a skeuomorphic graphic that matches the environmental data of each of the environmental dimensions. The environmental status graphic is sent to the target device for display; The step of performing graphic fusion based on the dimensional graphics corresponding to multiple environmental dimensions to generate an environmental state graphic includes: Extract the virtual object feature information of the dimension graphic corresponding to each of the environmental dimensions, wherein the virtual object feature information is used to characterize the information of the environmental dimension and the information of the environmental dimension data corresponding to the environmental dimension; Based on multiple virtual object feature information, feature fusion is performed, and an environmental state graph is generated based on the fused virtual object feature information. The environmental state graph is used to represent information of multiple environmental dimensions and information of environmental dimension data corresponding to each environmental dimension; thereby realizing the determination of a content-rich environmental state graph based on factors of each environmental dimension, ensuring that the environmental state graph has rich information.

2. The environmental state visualization method according to claim 1, characterized in that, The step of determining the environmental dimension data corresponding to each of the multiple environmental dimensions based on the environmental data includes: Based on the source of acquisition of the environmental data, the environmental data is classified to obtain environmental data corresponding to different acquisition sources; Based on the mapping relationship between the acquisition source and the environmental dimension type, the environmental data corresponding to different acquisition sources are divided into environmental dimension data of multiple environmental dimensions.

3. The environmental state visualization method according to claim 1, characterized in that, The step of determining a dimension graph corresponding to each environmental dimension based on the numerical values ​​of the environmental dimension data includes: Based on the numerical value of the environmental dimension data, a target numerical range is determined from multiple preset numerical ranges corresponding to the environmental dimension. Based on the target numerical range and a preset table showing the relationship between multiple numerical ranges and the skeuomorphic graphics, query the dimensional graphics corresponding to the environmental dimensional data.

4. The environmental state visualization method according to claim 1, characterized in that, The step of extracting the virtual object feature information of the dimension graphic corresponding to each of the environmental dimensions includes: For each environmental dimension corresponding to a dimension graphic, input a pre-trained image recognition model to determine the virtual objects in the dimension graphic; The virtual objects in the dimensional graph are input into a pre-trained image semantic model, and the corresponding virtual object semantic vectors are output as virtual object feature information.

5. The environmental state visualization method according to claim 4, characterized in that, The step of performing feature fusion based on multiple virtual object feature information, and generating an environment state graph based on the fused virtual object feature information, includes: Multiple virtual object semantic vectors are concatenated to obtain a concatenated vector, which is then determined as the fused virtual object feature information. The spliced ​​vector is input into a pre-trained image reconstruction model, and an environmental state graph is generated based on the spliced ​​vector.

6. The environmental state visualization method according to claim 1, characterized in that, The acquisition of environmental data includes: Acquire raw environmental data collected by at least one environmental information acquisition device; The environmental data is determined by summarizing the original environmental data.

7. An environmental condition visualization device, characterized in that, include: The acquisition unit is used to acquire environmental data; The parsing unit is used to determine the environmental dimension data corresponding to each of the multiple environmental dimensions based on the environmental data. A graphics unit is used to determine a dimension graphic corresponding to each of the environmental dimensions based on the values ​​of the environmental dimension data, wherein the dimension graphic is a skeuomorphic graphic that matches the environmental dimension data of the corresponding environmental dimension. Based on the dimension graphics corresponding to multiple environmental dimensions, a graphic fusion is performed to generate an environmental state graphic, wherein the environmental state graphic is a skeuomorphic graphic that matches the environmental data of each of the environmental dimensions. The control unit is used to send the environmental status graphics to the target device for display. The step of performing graphic fusion based on the dimensional graphics corresponding to multiple environmental dimensions to generate an environmental state graphic includes: Extract the virtual object feature information of the dimension graphic corresponding to each of the environmental dimensions, wherein the virtual object feature information is used to characterize the information of the environmental dimension and the information of the environmental dimension data corresponding to the environmental dimension; Based on multiple virtual object feature information, feature fusion is performed, and an environmental state graph is generated based on the fused virtual object feature information. The environmental state graph is used to represent information of multiple environmental dimensions and information of environmental dimension data corresponding to each environmental dimension; thereby realizing the determination of a content-rich environmental state graph based on factors of each environmental dimension, ensuring that the environmental state graph has rich information.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored program, wherein the program, when executed, performs the environmental state visualization method according to any one of claims 1 to 6.

9. An electronic device comprising a memory and a processor, characterized in that, The memory stores a computer program, and the processor is configured to execute the environmental state visualization method according to any one of claims 1 to 6 through the computer program.

Images