Display method and device, electronic equipment and storage medium

Abstract

The invention discloses a display method and device, electronic equipment and a storage medium. According to the embodiment of the invention, household appliance model data is classified according to categories according to a cloud database; household appliance model data, household appliance model photos and household appliance display panel photos are stored in the cloud database; extracting element features corresponding to the household appliances of the same category; determining a user interface design template corresponding to the household appliances of the same category based on the element features; determining a first design template corresponding to the to-be-processed first equipment from the user interface design templates according to the user interface design templates and the model data of the to-be-processed first equipment; generating a display interface corresponding to the first equipment based on the first design template; and adapting the display interface to an application program interface corresponding to the electronic equipment based on the adaptation information and the self-adaptation component of the electronic equipment. According to the embodiment of the invention, while a personalized display interface is provided, the display efficiency is also improved.

Description

Technical Field

[0001] The present application belongs to the field of display technology, and specifically relates to a display method, device, electronic device and storage medium. Background Art

[0002] Nowadays, smart home appliances can generally be remotely controlled through mobile apps, which greatly improves the convenience of use. However, most apps on the market are equipped with standardized control plug-ins or themes, which can only meet basic operations such as switching, temperature adjustment, and timing. These universal designs lack personality and the interactive experience is inconsistent with different home appliance models, resulting in a greatly reduced user experience that is neither rich nor intuitive.

[0003] At present, the existing user interface design technology relies on fixed templates and cannot be dynamically adjusted according to the personalized needs of users. In addition, it lacks the ability to analyze real-time interactive data and cannot provide users with a personalized display interface, which reduces the display efficiency. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a display method, device, electronic device and storage medium, which can solve the problem of low display efficiency in the display process of related technologies and cannot provide users with a personalized display interface.

[0005] In a first aspect, an embodiment of the present application provides a display method, the method comprising:

[0006] Classify and process the home appliance model data according to categories according to a cloud database; the cloud database stores the home appliance model data, home appliance model photos, and home appliance display panel photos;

[0007] Extract the element features corresponding to the same category of home appliances;

[0008] Based on the element features, determining a user interface design template corresponding to the home appliances of the same category;

[0009] According to the user interface design template and the model data of the first device to be processed, determining a first design template corresponding to the first device to be processed from the user interface design template;

[0010] generating a display interface corresponding to the first device based on the first design template;

[0011] Based on the adaptation information and the self-adaptation component of the electronic device, the display interface is adapted to the application program interface corresponding to the electronic device.

[0012] In a second aspect, an embodiment of the present application provides a display device, the device comprising:

[0013] A classification module, used to classify the home appliance model data according to categories based on a cloud database; the cloud database stores the home appliance model data, home appliance model photos, and home appliance display panel photos;

[0014] The first extraction module is used to extract element features corresponding to home appliances of the same category;

[0015] A first determination module is configured to determine the user interface design template corresponding to the home appliances of the same category based on the element features; and determine the first design template corresponding to the first device to be processed from the user interface design template according to the user interface design template and the model data of the first device to be processed;

[0016] A first generating module, configured to generate a display interface corresponding to the first device based on the first design template;

[0017] The adaptation module is used to adapt the display interface to the application program interface corresponding to the electronic device based on the adaptation information and the self-adaptation component of the electronic device.

[0018] In a third aspect, an embodiment of the present application provides an electronic device, comprising a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other through the communication bus; the memory is used to store executable instructions, and the executable instructions enable the processor to execute the display method as described in any one of the above items.

[0019] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the display method as described in any one of the above items is implemented.

[0020] In an embodiment of the present application, a display method is provided, which classifies and processes home appliance model data according to categories based on a cloud database; the cloud database stores home appliance model data, home appliance model photos, and home appliance display panel photos; extracts element features corresponding to home appliances of the same category; based on the element features, determines the user interface design template corresponding to the home appliances of the same category; determines the first design template corresponding to the first device to be processed from the user interface design template based on the user interface design template and the model data of the first device to be processed; generates a display interface corresponding to the first device based on the first design template; based on the adaptation information of the electronic device and the self-adaptive component, adapts the display interface to the application program interface corresponding to the electronic device. During the display process, the first design template can be determined from the user interface design template based on the model data of the first device to be processed, so that a personalized display interface can be provided. Further, the server can generate the display interface corresponding to the first device based on the first design template, and then adapt the user interface, thereby improving the display efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 This is a step flow of a display method provided by an embodiment of the present application Figure 1 ;

[0022] Figure 2 This is a step flow of a display method provided by an embodiment of the present application Figure 2 ;

[0023] Figure 3 This is a step flow of a display method provided by an embodiment of the present application Figure 3 ;

[0024] Figure 4 A logic frame of a display device provided in an embodiment of the present application Figure 1 ;

[0025] Figure 5 A logic frame of a display device provided in an embodiment of the present application Figure 2 ;

[0026] Figure 6 A logic frame of a display device provided in an embodiment of the present application Figure 3 ;

[0027] Figure 7 A logic frame of a display device provided in an embodiment of the present application Figure 4 ;

[0028] Figure 8 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0029] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0030] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0031] Method Embodiment

[0032] The display method provided in the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0033] Reference Figure 1 , showing the steps of a display method provided by an embodiment of the present application Figure 1 ,like Figure 1 As shown, the method specifically includes steps 101 to 106:

[0034] Step 101: Classify the home appliance model data according to the category according to the cloud database; the cloud database stores the home appliance model data, home appliance model photos, and home appliance display panel photos.

[0035] The display method provided in the embodiment of the present application can be applied to a server, which can support both data collection and data processing functions, or only support data processing functions and establish a communication connection with other servers that support data collection functions.

[0036] In this step, the cloud database stores home appliance model data, home appliance model photos, and home appliance display panel photos, and the home appliance model data in the cloud database can be classified into the same category.

[0037] In this step, the home appliance model data may be the model uploaded to the home appliance system when the home appliance is produced. For example, the current smart home app will have a corresponding model when it is networked, which can be connected to the production system. The home appliance model data may include but is not limited to the home appliance model and photos of the home appliance model, as well as photos of the display panel corresponding to the home appliance, etc., and can be matched and displayed in the database based on the photo and model.

[0038] In this step, categories may include but are not limited to kitchen categories, household categories, personal care categories, audio-visual entertainment categories, communication categories, etc.

[0039] Exemplarily, the kitchen category may include, but is not limited to, rice cookers, refrigerators, microwave ovens, ovens, dishwashers, juicers, soymilk machines, coffee machines, electric kettles, etc. These appliances are mainly used for food preparation, cooking, preservation, and cleaning.

[0040] Exemplarily, the household category may include, but is not limited to, air conditioners, electric fans, heaters, humidifiers, dehumidifiers, air purifiers, vacuum cleaners, sweepers, washing machines, dryers, etc. These devices are mainly used for regulating the indoor environment, cleaning, and clothing processing.

[0041] For example, the personal care category may include, but is not limited to, hair dryers, shavers, electric toothbrushes, beauty devices, massagers, etc. These devices are mainly used for daily personal care and beauty.

[0042] Exemplarily, the audio-visual entertainment category may include, but is not limited to, televisions, stereos, DVD / Blu-ray players, projectors, game consoles, home theater systems, etc. These devices are mainly used for entertainment and leisure.

[0043] Exemplarily, the communication category may include but is not limited to telephones, fax machines, routers, modems, etc. These devices are mainly used for information exchange and communication.

[0044] In this step, the classification process may be a process of classifying the home appliances stored in the cloud database according to the same category.

[0045] For example, by classifying the devices stored in the database, such as rice cookers, refrigerators, microwave ovens, ovens, dishwashers, juicers, air conditioners, electric fans, heaters, humidifiers, dehumidifiers, air purifiers, vacuum cleaners, sweepers, washing machines, and dryers, two categories can be obtained, namely, kitchen categories and household categories.

[0046] In this step, the home appliance model data may be information about models or batches of different home appliances, such as refrigerators of the third batch of energy-saving series, electric blankets of the Xth batch of mite removal series, and the like.

[0047] The home appliance model photos may be captured from a recorded video of the home appliance, or pre-stored in the cloud, and the photos contain the home appliance model data.

[0048] Exemplarily, the photo of the home appliance display panel may be captured from a recorded video of the home appliance, or pre-stored in the cloud, and the photo includes data of the display panel.

[0049] In this step, the cloud database stores the model data of home appliances on the market, and the cloud database is expandable and can also be interfaced with electronic devices or image recognition engines.

[0050] In this step, the server can classify the home appliance model data of the same category into one category; for example: classifying the home appliance model data of the same category such as air conditioners, purifiers, humidifiers, etc. into the first category of data, which is not limited in the embodiments of the present application.

[0051] Furthermore, before classifying the home appliance model data by category according to the cloud database, the server can also obtain image information of the smart furniture; match the image information with the data information in the cloud database to determine the target model information of the smart furniture.

[0052] Exemplarily, the image information of the smart furniture can be obtained from real-time photos, or real-time videos, or pre-stored videos or pictures, which is not limited in the embodiments of the present application.

[0053] In this step, the process of determining the target model information of the smart furniture can be to search the data information in the cloud database, determine the model information that matches the image information, and determine its model information as the target model information of the smart furniture.

[0054] Exemplarily, in this step, when the electronic device matches the image information with the data information in the cloud database, it may access the cloud database by calling an interface, or by sending a query instruction to the cloud database, and traverse the cloud database according to the query instruction to determine the target model information.

[0055] In this step, in the process of determining the target model information of the smart furniture, the server can search in the cloud database based on the acquired image information, and determine the model information that matches the image information as the target model information of the smart furniture, that is, the actual model information of the smart home.

[0056] In this step, the image recognition engine can extract text information from the image, such as brand name and model, by using OCR (optical character recognition) technology. It can also analyze the texture and shape features of the image to assist in identifying specific models or design elements. The database is deployed on a server or cloud, and when a user uploads an image, the system automatically performs preprocessing, feature extraction, and recognition.

[0057] Step 102: extract element features corresponding to home appliances of the same category.

[0058] According to the display method provided in the embodiment of the present application, after classifying the home appliance model data according to the category according to the cloud database, the server can extract the element features corresponding to the home appliances of the same category.

[0059] In this step, the element features corresponding to the home appliances may include but are not limited to switches, modes, functions, etc. Home appliances of the same category have fixed interaction designs.

[0060] Exemplarily, in this step, element features such as switches and modes of household appliances of the same category, such as purifiers and humidifiers, are extracted. The element features are the same or similar, which is not limited in the embodiments of the present application.

[0061] Furthermore, when extracting element features corresponding to home appliances of the same category, the server may extract first model data corresponding to home appliances of the same category; extract the same elements in the first model data to obtain element features corresponding to home appliances of the same category.

[0062] Exemplarily, in this step, extracting the first model data corresponding to household appliances of the same category may be extracting model data of household appliances such as rice cookers, refrigerators, microwave ovens, ovens, dishwashers, juicers, soybean milk machines, coffee machines, and electric kettles.

[0063] Illustratively, in this step, the same elements of a microwave oven, oven or other device may include but are not limited to temperature settings, switches, time, etc., which are not limited in the embodiments of the present application.

[0064] In this step, in the process of extracting element features, the server can first extract the first model data of the same category, and then extract the same elements in the first model data, such as switches, gear change functions and other elements, and based on the same elements in the first model data, obtain the element features corresponding to the same category of home appliances.

[0065] Step 103: Based on the element features, determine the user interface design template corresponding to the home appliances of the same category.

[0066] The display method provided in the embodiment of the present application can, after extracting the element features corresponding to the home appliances of the same category, the server can determine the user interface design template corresponding to the home appliances of the same category based on the element features.

[0067] Exemplarily, in this step, in the process of determining the user interface design template corresponding to the same category of home appliances, the user interface design template for kitchen categories such as juicers, soymilk machines, and coffee machines can be determined. The user interface design template may include but is not limited to switches, modes, etc., which are not limited in the embodiments of the present application.

[0068] In this step, the actual interface of the corresponding home appliance can be identified by taking photos. The design specifications corresponding to the interface, such as a pre-designed user interface set of an air purifier, a certain function has a corresponding user interface element, and after identifying the model data of the air purifier, the corresponding user interface can be quickly generated.

[0069] Furthermore, when determining the corresponding user interface design templates for home appliances of the same category based on element features, the server can extract the design features corresponding to the user interface design template set through a learning algorithm; and generate a user interface design template based on the design features, element features and the interface style selected by the user.

[0070] In this step, the learning algorithm can be any machine learning algorithm for extracting features.

[0071] Among them, the design features may include but are not limited to colors, fonts, layouts, element sizes, etc. in the user interface design template set, which are not limited in the embodiments of the present application.

[0072] For example, a machine learning algorithm is a type of computing method that automatically learns and improves from data without being explicitly programmed to perform specific tasks. The core of a machine learning algorithm is to train the model through input data and corresponding labels, so that the model can recognize patterns and features in the data and then predict or classify future data.

[0073] Exemplarily, a deep learning model, such as a convolutional neural network (CNN), can be used to allow the model to learn the relationship between different design features, element features, and the interface style selected by the user.

[0074] Exemplarily, in the process of generating a user interface design template, a generative adversarial network (GAN) or other generative model can be used to input design features, element features, and a user-selected interface style into the model to output a user interface design template.

[0075] In this step, the interface style selected by the user may include but is not limited to simple style, retro style, etc., which is not limited in the embodiments of the present application.

[0076] In this step, in the process of generating user interface design templates, the server can first extract design features in the design template set through a learning algorithm, and then generate a personalized user interface design template based on the extracted design features and element features, as well as the interface style selected by the user. At the same time, the user interface design template can also be adaptively adjusted according to different users.

[0077] Step 104: According to the user interface design template and the model data of the first device to be processed, determine the first design template corresponding to the first device to be processed from the user interface design template.

[0078] The display method provided in the embodiment of the present application can determine the first design template corresponding to the first device to be processed from the user interface design template based on the user interface design template and the model data of the first device to be processed, after determining the user interface design template corresponding to the home appliances of the same category based on the element characteristics.

[0079] Exemplarily, in this step, the model data of the first device to be processed may be model data corresponding to any category of equipment, such as the first batch of energy-saving series of dryers, the second batch of voice-controlled door locks, etc.

[0080] In this step, the process of determining the first design template corresponding to the first device to be processed may be a process of determining the first design template matching the model data of the first device according to the model data of the first device.

[0081] In this step, when determining the first design template corresponding to the first device to be processed, the server can query in the user interface design template according to the model data of the first device to be processed, so as to determine the design template that matches the model data of the first device.

[0082] Furthermore, when determining the first design template corresponding to the first device to be processed from the user interface design template based on the user interface design template and the model data of the first device to be processed, the server may match the model data of the first device to be processed in the user interface design template; and determine the design template in the user interface design template that matches the model data of the first device as the first design template.

[0083] In this step, the matching process may be a process of searching in the user interface design templates during the process of determining the first design template to determine a design template that matches the model data of the first device.

[0084] Exemplarily, in this step, when the model data is the third batch of refrigerators in a certain brand's energy-saving series, the server can search in the user interface design template based on the model data to find the design template related to the third batch of refrigerators in the certain brand's energy-saving series, and then determine the matched design template as the first design template.

[0085] Step 105: Generate a display interface corresponding to the first device based on the first design template.

[0086] The display method provided in the embodiment of the present application can generate a display interface corresponding to the first device based on the first design template after determining the first design template corresponding to the first device to be processed from the user interface design template according to the user interface design template and the model data of the first device to be processed.

[0087] In this step, the display interface corresponding to the first device may be an interface capable of displaying switches, functions and other modules corresponding to the first device.

[0088] Exemplarily, in this step, the process of the server generating a display interface corresponding to the first device based on the first design template may include pre-designing a user interface set of the air conditioner, each function having its corresponding user interface element, and after identifying the model data of the device, the display interface can be generated based on the model data.

[0089] Step 106: Based on the adaptation information of the electronic device and the self-adaptation component, the display interface is adapted to the application program interface corresponding to the electronic device.

[0090] The display method provided in the embodiment of the present application can, after generating a display interface corresponding to the first device based on the first design template, enable the server to adapt the display interface to the application program interface corresponding to the electronic device based on the adaptation information and self-adaptation components of the electronic device.

[0091] In this step, the adaptation information of the electronic device may include but is not limited to the resolution of the screen, etc., which is not limited in the embodiments of the present application.

[0092] In this step, the self-adaptive component can be used to better adapt the display interface to the application interface.

[0093] In this step, the application program interface corresponding to the electronic device may be an interface for controlling home appliances.

[0094] In the process of adaptation, a flexible layout manager can be used according to different resolutions to dynamically allocate space according to the screen size. For example, some self-adaptive components and framework codes can be used for adaptation, which is not limited in the embodiments of the present application.

[0095] Furthermore, when the display interface is adapted to the application interface corresponding to the electronic device based on the adaptation information and self-adaptation components of the electronic device, the server can verify whether the display interface is consistent with the application interface and whether the display interface can adapt to the pixel data of the application interface based on the adaptation information and self-adaptation components of the electronic device; when the display interface is consistent with the application interface and the display interface can adapt to the pixel data of the application interface, the display interface will be adapted to the application interface corresponding to the electronic device.

[0096] Among them, the process of verifying whether the display interface is consistent with the application interface can be a process of comparing whether the two interfaces are misaligned, or a process of comparing whether different modules of the two interfaces are unable to align, etc., which is not limited in the embodiments of the present application.

[0097] It should be noted that the process of verifying whether the display interface can adapt to the pixel data of the application program interface can be the process of verifying whether the pixel data such as color data, brightness data, transparency data, etc. of the two interfaces are compatible.

[0098] For example, when the display interface is consistent with the application interface and the display interface can adapt to the pixel data of the application interface, it can be guaranteed to be compatible with different models of mobile phones to avoid problems such as misalignment.

[0099] In this step, during the adaptation of the user interface, the layout manager can be used according to the resolution to dynamically allocate space according to the screen size of different mobile phones, so that it can be better adapted to the mobile phone or any electronic device, which is not limited in the embodiments of the present application.

[0100] In summary, in an embodiment of the present application, a display method is provided, which classifies and processes home appliance model data according to categories based on a cloud database; the cloud database stores home appliance model data, home appliance model photos, and home appliance display panel photos; extracts element features corresponding to home appliances of the same category; based on the element features, determines the user interface design template corresponding to the home appliances of the same category; based on the user interface design template and the model data of the first device to be processed, determines from the user interface design template a first design template corresponding to the first device to be processed; generates a display interface corresponding to the first device based on the first design template; based on the adaptation information of the electronic device and the self-adaptive component, adapts the display interface to the application program interface corresponding to the electronic device. During the display process, the first design template can be determined from the user interface design template according to the model data of the first device to be processed, so that a personalized display interface can be provided. Furthermore, the server can generate a display interface corresponding to the first device based on the first design template, and then adapt the user interface, thereby improving the display efficiency.

[0101] Reference Figure 2 , showing the steps of a display method provided by an embodiment of the present application Figure 2 ,like Figure 2 As shown, the method specifically includes steps 201 to 210:

[0102] Step 201: Classify the home appliance model data according to the category according to the cloud database; the cloud database stores the home appliance model data, home appliance model photos, and home appliance display panel photos.

[0103] In this step, the cloud database stores home appliance model data, home appliance model photos, and home appliance display panel photos, and the home appliance model data in the cloud database can be classified into the same category.

[0104] In this step, the home appliance model data may be the model uploaded to the home appliance system when the home appliance is produced. For example, the current smart home app will have a corresponding model when it is networked, which can be connected to the production system. The home appliance model data may include but is not limited to the home appliance model and photos of the home appliance model, as well as photos of the display panel corresponding to the home appliance, etc., and can be matched and displayed in the database based on the photo and model.

[0105] In this step, the server can classify the home appliance model data of the same category into one category; for example: classifying the home appliance model data of the same category such as air conditioners, purifiers, humidifiers, etc. into the first category of data, which is not limited in the embodiments of the present application.

[0106] Step 202: extract first model data corresponding to home appliances of the same category.

[0107] According to the display method provided in the embodiment of the present application, after classifying the home appliance model data according to the category according to the cloud database, the server can extract the first model data corresponding to the home appliances of the same category.

[0108] Exemplarily, in this step, extracting the first model data corresponding to household appliances of the same category may be extracting model data of household appliances such as rice cookers, refrigerators, microwave ovens, ovens, dishwashers, juicers, soybean milk machines, coffee machines, and electric kettles.

[0109] In this step, in the process of extracting element features, the server can first extract the first model data of the same category, and then extract the same elements in the first model data, such as switches, gear change functions and other elements, and based on the same elements in the first model data, obtain the element features corresponding to the same category of home appliances.

[0110] Step 203: extract the same elements in the first model data to obtain element features corresponding to the same category of home appliances.

[0111] The display method provided in the embodiment of the present application can, after extracting the first model data corresponding to the home appliances of the same category, enable the server to extract the same elements in the first model data to obtain the element features corresponding to the home appliances of the same category.

[0112] Illustratively, in this step, the same elements of a microwave oven, oven or other device may include but are not limited to temperature settings, switches, time, etc., which are not limited in the embodiments of the present application.

[0113] Step 204: extract design features corresponding to the user interface design template set through a learning algorithm.

[0114] The display method provided in the embodiment of the present application, after extracting the same elements in the first model data and obtaining the element features corresponding to the home appliances of the same category, the server can extract the design features corresponding to the user interface design template set through a learning algorithm.

[0115] Among them, the design features may include but are not limited to colors, fonts, layouts, element sizes, etc. in the user interface design template set, which are not limited in the embodiments of the present application.

[0116] Step 205: Generate a user interface design template based on the design features, element features and the interface style selected by the user.

[0117] The display method provided in the embodiment of the present application can generate a user interface design template based on the design features, element features and interface style selected by the user after the server extracts the design features corresponding to the user interface design template set through a learning algorithm.

[0118] Exemplarily, a deep learning model, such as a convolutional neural network (CNN), can be used to allow the model to learn the relationship between different design features, element features, and the interface style selected by the user.

[0119] Exemplarily, in the process of generating a user interface design template, a generative adversarial network (GAN) or other generative model can be used to input design features, element features, and a user-selected interface style into the model to output a user interface design template.

[0120] In this step, the interface style selected by the user may include but is not limited to simple style, retro style, etc., which is not limited in the embodiments of the present application.

[0121] In this step, in the process of generating user interface design templates, the server can first extract design features in the design template set through a learning algorithm, and then generate a personalized user interface design template based on the extracted design features and element features, as well as the interface style selected by the user. At the same time, the user interface design template can also be adaptively adjusted according to different users.

[0122] Step 206: Match the model data of the first device to be processed in the user interface design template.

[0123] The display method provided in the embodiment of the present application generates a user interface design template according to design features, element features and the interface style selected by the user. The server can match the model data of the first device to be processed in the user interface design template.

[0124] In this step, the matching process may be a process of searching in the user interface design templates during the process of determining the first design template to determine a design template that matches the model data of the first device.

[0125] Exemplarily, in this step, when the model data is the third batch of refrigerators in a certain brand's energy-saving series, the server can search in the user interface design template based on the model data to find the design template related to the third batch of refrigerators in the certain brand's energy-saving series, and then determine the matched design template as the first design template.

[0126] Step 207: Determine the design template in the user interface design template that matches the model data of the first device as the first design template.

[0127] The display method provided in the embodiment of the present application, after matching the model data of the first device to be processed in the user interface design template, the server can determine the design template in the user interface design template that matches the model data of the first device as the first design template.

[0128] Step 208: Generate a display interface corresponding to the first device based on the first design template.

[0129] The display method provided in the embodiment of the present application can generate a display interface corresponding to the first device based on the first design template after determining the design template that matches the model data of the first device in the user interface design template as the first design template.

[0130] In this step, the display interface corresponding to the first device may be an interface capable of displaying switches, functions and other modules corresponding to the first device.

[0131] Exemplarily, in this step, the process of the server generating a display interface corresponding to the first device based on the first design template may include pre-designing a user interface set of the air conditioner, each function having its corresponding user interface element, and after identifying the model data of the device, the display interface can be generated based on the model data.

[0132] Step 209: Verify, based on the adaptation information and the self-adaptation component of the electronic device, whether the display interface is consistent with the application program interface and whether the display interface can adapt to the pixel data of the application program interface.

[0133] The display method provided in the embodiment of the present application can, after generating a display interface corresponding to the first device based on the first design template, enable the server to verify whether the display interface is consistent with the application interface and whether the display interface can adapt to the pixel data of the application interface according to the adaptation information and self-adaptation components of the electronic device.

[0134] In the process of adaptation, a flexible layout manager can be used according to different resolutions to dynamically allocate space according to the screen size. For example, some self-adaptive components and framework codes can be used for adaptation, which is not limited in the embodiments of the present application.

[0135] Among them, the process of verifying whether the display interface is consistent with the application interface can be a process of comparing whether the two interfaces are misaligned, or a process of comparing whether different modules of the two interfaces are unable to align, etc., which is not limited in the embodiments of the present application.

[0136] Step 210: When the display interface is consistent with the application program interface and the display interface can adapt to the pixel data of the application program interface, adapt the display interface to the application program interface corresponding to the electronic device.

[0137] The display method provided in the embodiment of the present application verifies whether the display interface is consistent with the application interface and whether the display interface can adapt to the pixel data of the application interface based on the adaptation information and self-adaptation component of the electronic device. Then, the server can adapt the display interface to the application interface corresponding to the electronic device when the display interface is consistent with the application interface and the display interface can adapt to the pixel data of the application interface.

[0138] It should be noted that the process of verifying whether the display interface can adapt to the pixel data of the application program interface can be the process of verifying whether the pixel data such as color data, brightness data, transparency data, etc. of the two interfaces are compatible.

[0139] In this step, during the adaptation of the user interface, the layout manager can be used according to the resolution to dynamically allocate space according to the screen size of different mobile phones, so that it can be better adapted to the mobile phone or any electronic device, which is not limited in the embodiments of the present application.

[0140] In summary, in an embodiment of the present application, a display method is provided, which classifies and processes home appliance model data according to categories based on a cloud database; the cloud database stores home appliance model data, home appliance model photos, and home appliance display panel photos; extracts element features corresponding to home appliances of the same category; based on the element features, determines the user interface design template corresponding to the home appliances of the same category; based on the user interface design template and the model data of the first device to be processed, determines from the user interface design template a first design template corresponding to the first device to be processed; generates a display interface corresponding to the first device based on the first design template; based on the adaptation information of the electronic device and the self-adaptive component, adapts the display interface to the application program interface corresponding to the electronic device. During the display process, the first design template can be determined from the user interface design template according to the model data of the first device to be processed, so that a personalized display interface can be provided. Furthermore, the server can generate a display interface corresponding to the first device based on the first design template, and then adapt the user interface, thereby improving the display efficiency.

[0141] Reference Figure 3 , showing the steps of a display method provided by an embodiment of the present application Figure 3 ,like Figure 3 As shown, the method specifically includes steps 301 to 307:

[0142] Step 301: The user starts the APP.

[0143] Users open the App and select the "Photo Recognition" function, then take photos of home appliances.

[0144] Step 302: The user uses the APP to take photos of home appliances.

[0145] Combined with the camera of smart devices, the App guides users to take photos of home appliances.

[0146] The image acquisition module captures the photo and transmits it to the image recognition engine.

[0147] Step 303: The module of the APP captures and processes the taken photos.

[0148] Step 304: Use a deep learning algorithm to identify features of home appliances.

[0149] Identify key information such as the brand and model of home appliances from the collected images. After receiving the photos, the built-in image recognition engine of the App uses deep learning algorithms to identify the brand, model and other features of the home appliances.

[0150] The image recognition engine analyzes photos and extracts characteristic information such as the brand and model of home appliances.

[0151] Step 305: Match the recognition result with the model information in the database.

[0152] The server needs to build a database of home appliance models, collect model data of home appliances on the market, establish a scalable database, and implement interface docking with the image recognition engine. The App accesses the home appliance model database in the cloud and matches the recognition results with the records in the database to confirm the specific model of the home appliance.

[0153] The identified feature information is matched with the appliance model database to determine the exact model of the appliance.

[0154] Step 306: Generate a corresponding user interface theme according to the matching result.

[0155] User interface theme generation, that is, designing a theme generation algorithm, selecting a preset theme or automatically generating a new theme using design rules based on the matched home appliance model information.

[0156] Classify according to the cloud home models established in the early stage, such as distinguishing by different categories, extracting the same elements of the same category, and planning UI design templates according to the interaction of home appliances. A large number of UI design samples are collected, and these samples are combined into App control interfaces, web page designs, icon sets, etc. Use machine learning algorithms to extract design features from the collected samples, such as color, font, layout, element size, etc. Then use deep learning models, such as convolutional neural networks (CNN), to let the model learn the relationship between different design elements and styles. Use generative adversarial networks (GAN) or other generative models to train the model to generate new UI design elements or entire themes. The final piece creates a set of reusable standard UI components and templates that can be adjusted according to different styles.

[0157] According to the matching result, the user interface theme generator selects or generates a user interface theme that matches the home appliance model.

[0158] Step 307: Adjust the APP interface to adapt to the generated theme.

[0159] User interface adaptation means applying the generated user interface theme to the App to ensure that the interface elements, layout, and style are consistent with the home appliance model.

[0160] After the theme is generated, users can remotely control the device through the new plug-in theme. At the same time, users can adjust the interface theme according to their personal preferences. The system learns user preferences and optimizes subsequent theme generation.

[0161] The user interface automatically adapts the app's interface elements, layout, and style to suit the newly generated theme.

[0162] In summary, by identifying the home appliance model, a personalized user interface theme matching the home appliance model is automatically generated to ensure that the interface style and operation logic of the home appliance and the intelligent control are consistent, providing a unified user experience and reducing the user's learning cost.

[0163] Device Embodiment

[0164] like Figure 4 As shown, Figure 4 The logic block diagram of a display device provided by an embodiment of the present application is shown. Figure 1 , the device comprises:

[0165] The classification module 1001 is used to classify the home appliance model data according to the category according to the cloud database; the cloud database stores the home appliance model data, home appliance model photos, and home appliance display panel photos;

[0166] The first extraction module 1002 is used to extract element features corresponding to home appliances of the same category;

[0167] The first determination module 1003 is used to determine the user interface design template corresponding to the home appliances of the same category based on the element features; and determine the first design template corresponding to the first device to be processed from the user interface design template according to the user interface design template and the model data of the first device to be processed;

[0168] A first generating module 1004, configured to generate a display interface corresponding to the first device based on the first design template;

[0169] The adaptation module 1005 is used to adapt the display interface to the application program interface corresponding to the electronic device based on the adaptation information and the self-adaptation component of the electronic device.

[0170] like Figure 5 As shown, Figure 5 The logic block diagram of a display device provided by an embodiment of the present application is shown. Figure 2 , the device further comprises:

[0171] An acquisition module 1006 is used to acquire image information of the smart furniture;

[0172] The second determination module 1007 is used to match the image information with the data information in the cloud database to determine the target model information of the smart furniture.

[0173] like Figure 6 As shown, Figure 6 The logic block diagram of a display device provided by an embodiment of the present application is shown. Figure 3 , the device further comprises:

[0174] The second extraction module 1008 is used to extract the first model data corresponding to the home appliances of the same category; extract the same elements in the first model data to obtain the element features corresponding to the home appliances of the same category.

[0175] like Figure 7 As shown, Figure 7 The logic block diagram of a display device provided by an embodiment of the present application is shown. Figure 4 , the device further comprises:

[0176] The third extraction module 1009 is used to extract the design features corresponding to the user interface design template set through a learning algorithm;

[0177] The second generating module 1010 is used to generate a user interface design template according to the design features, the element features and the interface style selected by the user.

[0178] Optionally, the first determining module further includes:

[0179] A matching module, used for matching the model data of the first device to be processed in the user interface design template;

[0180] The determination submodule is used to determine the design template that matches the model data of the first device in the user interface design template as the first design template.

[0181] Optionally, the adaptation module further includes:

[0182] A verification module, used to verify whether the display interface is consistent with the application interface and whether the display interface can adapt to the pixel data of the application interface according to the adaptation information and the self-adaptive component of the electronic device;

[0183] The adapter module is used to adapt the display interface to the application interface corresponding to the electronic device when the display interface is consistent with the application interface and the display interface can adapt to the pixel data of the application interface.

[0184] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0185] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0186] The display device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or it can be other devices other than a terminal. Exemplarily, the electronic device can be a GPU BOX, a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0187] The display device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, a Linux operating system, a Windows operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0188] The display device provided in the embodiment of the present application can achieve Figure 1 To avoid repetition, the various processes implemented by the method embodiment are not described here.

[0189] Alternatively, if Figure 8 As shown, an embodiment of the present application further provides an electronic device 1100, including a processor 1101 and a memory 1102, wherein the memory 1102 stores programs or instructions that can be executed on the processor 1101, and when the program or instructions are executed by the processor 1101, the various steps of the above-mentioned display method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.

[0190] In an embodiment of the present application, the memory 1102 may be used to store software programs and various data. The memory 1102 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1102 may include a volatile memory or a non-volatile memory, or the memory 1102 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1102 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0191] The processor 1101 may include one or more processing units; optionally, the processor 1101 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1101.

[0192] An embodiment of the present application also provides an electronic device, which includes a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus; the memory is used to store executable instructions, and the executable instructions enable the processor to execute the various processes of the display method embodiment as described above, and can achieve the same technical effect. To avoid repetition, they will not be repeated here.

[0193] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned display method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0194] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0195] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned display method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0196] It should be understood that the chip involved in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0197] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned display method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0198] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0199] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the relevant technology, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0200] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A display method, characterized in that: Applied to the server, the method includes: Classify and process the home appliance model data according to categories according to a cloud database; the cloud database stores the home appliance model data, home appliance model photos, and home appliance display panel photos; Extract the element features corresponding to the same category of home appliances; Based on the element features, determining a user interface design template corresponding to the home appliances of the same category; According to the user interface design template and the model data of the first device to be processed, determining a first design template corresponding to the first device to be processed from the user interface design template; generating a display interface corresponding to the first device based on the first design template; Based on the adaptation information and the self-adaptation component of the electronic device, the display interface is adapted to the application program interface corresponding to the electronic device.

2. The method according to claim 1, characterized in that Before classifying the home appliance model data according to categories according to the cloud database, the method further includes: Acquiring image information of the smart furniture; The image information is matched with the data information in the cloud database to determine the target model information of the smart furniture.

3. The method according to claim 1, characterized in that The extracting element features corresponding to the home appliances of the same category includes: Extract the first model data corresponding to the home appliances of the same category; The same elements in the first model data are extracted to obtain element features corresponding to the home appliances of the same category.

4. The method according to claim 1, characterized in that The determining, based on the element features, the user interface design template corresponding to the home appliances of the same category includes: Extract design features corresponding to the user interface design template set through learning algorithms; A user interface design template is generated according to the design features, the element features and the interface style selected by the user.

5. The method according to claim 1, characterized in that The step of determining, from the user interface design template, a first design template corresponding to the first device to be processed according to the user interface design template and the model data of the first device to be processed, comprises: Matching the model data of the first device to be processed in the user interface design template; A design template among the user interface design templates that matches the model data of the first device is determined as a first design template.

6. The method according to claim 1, characterized in that The step of adapting the display interface to an application program interface corresponding to the electronic device based on the adaptation information and the self-adaptation component of the electronic device includes: Verifying, according to the adaptation information and the self-adaptation component of the electronic device, whether the display interface is consistent with the application program interface and whether the display interface can adapt to the pixel data of the application program interface; When the display interface is consistent with the application interface and the display interface can adapt to the pixel data of the application interface, the display interface is adapted to the application interface corresponding to the electronic device.

7. A display device, characterized in that: The device comprises: A classification module, used to classify the home appliance model data according to categories based on a cloud database; the cloud database stores the home appliance model data, home appliance model photos, and home appliance display panel photos; The first extraction module is used to extract element features corresponding to home appliances of the same category; A first determination module is used to determine the user interface design template corresponding to the home appliances of the same category based on the element features; and determine the first design template corresponding to the first device to be processed from the user interface design template according to the user interface design template and the model data of the first device to be processed; A first generating module, configured to generate a display interface corresponding to the first device based on the first design template; The adaptation module is used to adapt the display interface to the application program interface corresponding to the electronic device based on the adaptation information and the self-adaptation component of the electronic device.

8. A display device, characterized in that: The device also includes: An acquisition module, used for acquiring image information of the smart furniture; The second determination module is used to match the image information with the data information in the cloud database to determine the target model information of the smart furniture.

9. A display device, characterized in that: The device also includes: The second extraction module is used to extract the first model data corresponding to the home appliances of the same category; extract the same elements in the first model data to obtain the element features corresponding to the home appliances of the same category.

10. A display device, characterized in that: The device also includes: A third extraction module is used to extract design features corresponding to the user interface design template set through a learning algorithm; The second generating module is used to generate a user interface design template according to the design features, the element features and the interface style selected by the user.

11. An electronic device, characterized in that: The electronic device comprises a processor, a memory, a communication interface and a communication bus, and the processor, the memory and the communication interface communicate with each other via the communication bus; The memory is used to store executable instructions, and the executable instructions enable the processor to execute the display method according to any one of claims 1 to 6.

12. A readable storage medium, characterized in that: The readable storage medium stores a program or an instruction, and when the program or the instruction is executed by a processor, the display method according to any one of claims 1 to 6 is implemented.

Images