Display control method and device
Through the smart host, the home style characteristics are determined and updated messages are generated, the problem of fixed style of traditional whole-house smart panel user interface is solved, and the dynamic matching of the panel user interface and home style is achieved, improving the user experience.
Patent Information
- Application Number
- CN202311103173.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-08-29
- Publication Date
- 2025-02-28
AI Technical Summary
The user interface style of the traditional whole-house smart panel is fixed and cannot be adjusted dynamically, resulting in discomfort with the home status and decoration style, and the user experience is poor.
Through the smart host, determine the characteristics of the home style and obtain relevant information, generate a message indicating the panel update user interface, and realize dynamic matching between the panel user interface and home style.
Improve the user experience, and dynamically adjust the panel user interface to adapt to the home style and status, enhancing the coordination and advanced experience of the whole house space.
Smart Images

Figure CN119536587A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of communication technology, and in particular to a display control method and device. Background Art
[0002] Whole-house intelligence requires the deployment of a large number of panels in the space to achieve whole-house intelligent control. Traditional whole-house intelligent panels present a fixed panel background effect by performing various artistic design processing on the material, texture and craftsmanship of the product. However, this not only seriously increases the cost of the panel, but also the actual display effect cannot meet the user's expectations, resulting in a poor user experience. Summary of the invention
[0003] The present application provides a display control method and device for adapting a user interface displayed on a panel to a home style, etc., thereby improving user experience.
[0004] In a first aspect, a display control method is provided, which can be applied to a smart host or a module in the smart host (such as a processor, a chip or a chip system, etc.). The method may include: determining a home style feature of a first space and acquiring first information; and determining a first message according to the home style feature of the first space and the first information, and then sending a first message to n panels in the first space, wherein the first message instructs the n panels in the first space to update a user interface, where n is an integer not less than 1.
[0005] In the above method, the panel is instructed to update the user interface based on the home style characteristics and the first information, so that the user interface displayed on the panel can be adapted to the home style, etc., thereby improving user experience.
[0006] In a possible design, the home style features of the first space can be determined by the following method: image data of the first space is acquired through a camera of the first space, and the home style features of the first space are determined according to the image data of the first space. In this way, the home style features of the first space can be accurately obtained based on the image data of the first space.
[0007] In a possible design, the home style features of the first space are determined according to the image data of the first space, and the method may be: obtaining a pre-trained home style model, and determining the home style features of the first space according to the home style model and the image data of the first space. In this way, accurate home style features can be matched in the home style model based on the image data of the first space.
[0008] In a possible design, the home style features include decoration color and decoration style.
[0009] In a possible design, the first message can be determined according to the home style characteristics of the first space and the first information by the following method: determining a user interface template corresponding to the home style characteristics of the first space; and determining the first message according to the user interface template and the first information. In this way, the user interface updated by the panel can be adapted to the home style, etc., and user experience can be improved.
[0010] In a possible design, the user interface template corresponding to the home style feature of the first space can be determined by the following method: obtaining a preset user interface template library, and determining the user interface template corresponding to the home style feature of the first space in the user interface template library. In this way, the user interface template corresponding to the home style feature of the first space can be obtained, and then the n panels in the first space can be updated with user interfaces.
[0011] In a possible design, the first information includes one or more of the following: space state information, space brightness information, weather information or time information. This allows the panel user interface and home style features to flexibly adapt to the first information, thereby improving the user experience.
[0012] In one possible design, the first message may include information for identifying the user interface template and second information, and the second information is obtained based on the first information. In this way, the subsequent panel can update the user interface of the panel according to the information for identifying the user interface template and the second information.
[0013] In one possible design, the first message can be transmitted wirelessly. For example, the first message can be sent to n panels in the first space through the following wireless communication technologies: wireless fidelity (Wi-Fi) technology, Bluetooth (BT) technology (for example, ordinary BT technology, Bluetooth low energy (BLE) technology), Greentooth technology, ZigBee technology, near field communication (NFC) technology or ultra wide band (UWB) technology, etc.
[0014] In a possible design, the first message may be transmitted via a wired manner, for example, the first message may be sent to n panels in the first space via power line communication (PLC).
[0015] The second aspect also provides a device, which can be applied to an intelligent host, and has the function of implementing the method in the first aspect or each possible design example of the first aspect. The function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions.
[0016] In one possible design, the structure of the device may include a unit or module for executing the method in the above-mentioned first aspect or various possible design examples of the first aspect.
[0017] In one possible design, the structure of the device includes a transceiver and one or more processors, and optionally one or more memories, the transceiver is used to send and receive instructions, data, messages or information, and to communicate and interact with other devices, and the processor is configured to support the device to perform the corresponding functions in the above-mentioned first aspect or each possible design example of the first aspect. The memory is coupled to the processor and stores the necessary program instructions and data for the device.
[0018] A third aspect provides a readable storage medium, which stores program instructions, and when the program instructions are run on the device, the device executes the method described in the first aspect of the embodiment of the present application and any possible design thereof. Exemplarily, the readable storage medium can be any available medium that the device can access. Taking this as an example but not limited to: the readable medium may include a non-transient computer-readable medium, a random access memory (random-access memory, RAM), a read-only memory (read-only memory, ROM), an electrically erasable programmable read-only memory (electrically EPROM, EEPROM), a CD-ROM or other optical disk storage, a disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of an instruction or data structure and can be accessed by the device.
[0019] A fourth aspect provides a program product, comprising instructions, which, when executed on a device, enable the method described in the first aspect or any possible design of the first aspect to be executed.
[0020] The fifth aspect also provides a device, including a processor, which is coupled to a memory and is used to read and execute program instructions stored in the memory so that the device implements the method described in the above-mentioned first aspect or any possible design of the first aspect. It should be understood that: the device includes a chip system.
[0021] For each of the above-mentioned aspects from the second to the fifth aspects and the technical effects that may be achieved by each of the aspects, please refer to the above-mentioned description of the technical effects that can be achieved by the first aspect or various possible schemes in the first aspect, and no further details will be given here. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] Figure 1 A schematic diagram of an application scenario provided for this application;
[0023] Figure 2 A flow chart of a display control method provided by the present application;
[0024] Figure 3 A process schematic diagram of a display control method provided by the present application;
[0025] Figure 4 A schematic diagram of a process of updating a user interface of a panel provided in this application;
[0026] Figure 5 A schematic diagram of a display of a user interface of a panel provided in the present application;
[0027] Figure 6 A schematic diagram of the structure of a device provided in this application;
[0028] Figure 7 A structural diagram of a device provided for this application. DETAILED DESCRIPTION
[0029] The present application will be described in further detail below in conjunction with the accompanying drawings.
[0030] The embodiment of the present application provides a display control method and device, which are used to adapt the user interface of the panel display to the home style, etc., and improve the user's physical examination. Among them, the method and device described in the present application are based on the same technical concept. Since the principles of solving problems by the method and the device are similar, the implementation of the device and the method can refer to each other, and the repeated parts will not be repeated.
[0031] In the description of this application, words such as “first” and “second” are only used for the purpose of distinguishing the description and cannot be understood as indicating or implying relative importance or order.
[0032] In the description of this application, "at least one" means one or more, and more means two or more. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can mean: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, c can be single or plural.
[0033] In the description of this application, "and / or" describes the association relationship of the associated objects, indicating that there may be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. " / " means "or", for example, a / b means a or b.
[0034] In order to more clearly describe the technical solution of the embodiment of the present application, the display control method and device provided by the embodiment of the present application are described in detail below in conjunction with the accompanying drawings.
[0035] Figure 1 A schematic diagram shows an application scenario to which the display control method provided in the present application is applicable. The application scenario may include at least one camera, at least one sensor, an intelligent host, at least one panel and a cloud server.
[0036] Among them, at least one camera can be a whole-house camera, and at least one camera is deployed at a set position in the whole house to collect image data of each space in the whole house. At least one camera can be managed by the smart host.
[0037] At least one sensor may include Figure 1 At least one artificial intelligence (AI) sensor and at least one brightness sensor are shown. The AI sensor can obtain information such as whether there are people in the space or not. The brightness sensor can obtain space brightness information.
[0038] The smart host can be the master control device of the home, and can also be called a central device or control center, etc. The smart host can make decisions on the user interface (UI) of at least one panel and control the UI update of at least one panel. Exemplarily, the smart host may include a first application, and the first application is used to make decisions on the user interface (UI) of at least one panel and control the UI update of at least one panel. Optionally, the first application may include a panel UI decision service function module and a central control module, and then the panel UI decision service function module can make decisions on the UI of at least one panel, and the central control module can control the UI update of at least one panel.
[0039] At least one panel may include all panels within the entire house, for example, at least one panel may include Figure 1At least one of the control panel, central control screen and smart screen shown. Among them, the control panel, which may also be referred to as an intelligent control panel, an intelligent switch control panel, etc., may be used for local function control and may include physical buttons. The central control screen, which may also be referred to as an intelligent central control screen, may be used for overall control of the whole house, and the whole house may include one or more central control screens. The smart screen can be understood as a smart screen, which is a smart home device similar to a TV and a tablet computer, but compared with a TV and a tablet computer, it has more diverse forms and application scenarios. Exemplarily, the central control screen and / or the smart screen may be implemented using a liquid crystal display (LCD).
[0040] The cloud server can provide the smart host with information collected by the cloud side, such as weather information.
[0041] It should be understood that Figure 1 The schematic diagrams of the application scenarios shown are only examples and are not intended to limit the present application.
[0042] At present, the panel uses a fixed or preset background style and cannot dynamically adjust the style. In this way, the user interface style of the panel is fixed, which is prone to aesthetic fatigue and coordination problems such as incompatibility with the home status and decoration style. Based on this, the present application proposes a display control method to make the panel naturally consistent with the home decoration style and home status, etc., and can be flexibly changed to enhance the high-level experience of the whole house space and improve the user experience.
[0043] In the following examples of this application, Figure 1 The intelligent host shown in the figure executes the display control method as an example.
[0044] Based on the above description, a display control method provided in an embodiment of the present application can be referred to Figure 2 As shown, the process of the method may include the following steps:
[0045] Step 201: The smart host determines the home style characteristics of the first space.
[0046] It should be understood that the first space may be the whole house space, or may be a part of the whole house space, for example, the first space may be one or more rooms in the whole house.
[0047] In an optional implementation, the smart host may determine the home style characteristics of the first space by the following method: the smart host obtains image data of the first space through a camera of the first space, and then determines the home style characteristics of the first space based on the image data of the first space.
[0048] In some embodiments, the user can pre-set the cameras that need to be turned on in the whole house and set the direction of the cameras on the smart life application (application, app). For example, the user can set all the cameras in the house to be turned on on the smart life app, and then the smart host can collect image data in the whole house through the cameras in the house. For another example, the user can set the camera of room 1 to be turned on on the smart life app, and then the smart host can collect image data in room 1 through the camera in room 1.
[0049] In some embodiments, the smart host may collect image data of the first space once or multiple times through the camera of the first space to improve image collection accuracy.
[0050] The image data of the first space may include an image or photo of the first space taken by a camera in the first space. Optionally, when the image or photo of the first space taken by the camera in the first space includes multiple images or photos, the image data of the first space may also be image data obtained by processing the image or photo of the first space taken by the camera.
[0051] In one possible approach, home style features may include decor colors and decor styles.
[0052] For example, the decoration color scheme may include warm white, gray, etc. Optionally, the decoration color scheme may be represented by red, green, blue (RGB) feature values.
[0053] The decoration style can include modern, classical, Chinese, European, luxury, etc. The decoration style can be reflected in style value or style label.
[0054] Furthermore, the smart host determines the home style characteristics of the first space based on the image data of the first space. The method may be: the smart host obtains a pre-trained home style model, and determines the decoration color and decoration style of the first space based on the home style model and the image data of the first space.
[0055] The home style model may be a home style AI model, and the home style model may be obtained by training based on a typical home style gallery.
[0056] Optionally, the process of determining the home style feature can be implemented by a first application in the smart host. For example, the process can be implemented by a panel UI decision service module in the first application.
[0057] Step 202: The smart host obtains first information.
[0058] Exemplarily, the first information may include one or more of the following: space state information, space brightness information, weather information or time information.
[0059] The space state information may include information about whether there are people or no people in the first space and / or the scene mode of the first space. The scene mode may include idle mode, meeting mode, sleeping mode, movie watching mode, entertainment mode, singing mode, etc.
[0060] The smart host can obtain information about whether there are people or no people in the first space through the AI sensor, and the smart host can determine the scene mode of the first space through the operating status information of the locally associated device. Exemplarily, the smart host can sense and fuse the information obtained by the AI sensor and the operating status information of the locally associated device to obtain the space status information.
[0061] In some embodiments, the scene mode can be turned on in the following ways: Method 1, the user manually chooses to turn on or off a scene mode, such as the user can set the scene mode to be turned on or off on the smart life app, etc. For example, the user can choose to turn on the current scene mode from at least one scene mode listed on the smart life app, etc., such as the user can choose to turn on the viewing mode. Method 2, the scene mode can be automatically turned on when the device meets the conditions for turning on the scene mode. Exemplarily, the smart host can determine that the current device meets the conditions for turning on the scene mode based on the operating status information of the device, and the smart host can automatically turn on the corresponding scene mode, such as when the smart host determines that the conditions for turning on the entertainment mode are met, the entertainment mode is automatically started. Optionally, before the smart host determines the scene mode, the user can first turn on the function of collecting the scene mode, for example, the user can turn on the function of collecting the scene mode on the smart life app, etc., so that the smart host can determine the scene mode based on the operating status information of the device in the first space.
[0062] For example, the smart host obtains the operating status information of the device in the first space (also called device status), including that the headlights in the first space are turned off and the curtains are closed. The smart host determines the sleep mode based on the operating status information of the device in the first space. For example, the smart host can determine through local configuration that the sleep mode is when the headlights in the first space are turned off and the curtains are closed.
[0063] The smart host can obtain spatial brightness information of the first space through the brightness sensor.
[0064] The smart host can obtain weather information and / or time information from the cloud server, etc. The process in which the smart host can obtain weather information and / or time information from the cloud server can be understood as external input.
[0065] The weather information may include rainy, sunny, cloudy, etc. The time information may include dates with special significance such as birthdays and festivals.
[0066] In an optional implementation, if part or all of the spatial state information, spatial brightness information, weather information or time information needs to be acquired, the spatial state information, spatial brightness information, weather information or time information are acquired in a descending order of priority. For example, in some scenarios, the spatial state information, spatial brightness information, weather information or time information needs to be acquired, and the smart host can first acquire the spatial state information, then acquire the spatial brightness information, and then acquire the weather information and / or time information. For another example, in some scenarios, the spatial state information, weather information or time information needs to be acquired, and the smart host can first acquire the spatial state information, and then acquire the weather information and / or time information.
[0067] In some embodiments, in some scene modes, such as sleeping mode or movie watching mode, the lights are usually off, and the spatial brightness information in such scenes can be understood as known, so the smart host does not need to obtain the spatial brightness information. For example, if the spatial status information obtained by the smart host is that there are people and it is in the lights-off movie watching mode, the smart host may no longer obtain the spatial brightness information through the brightness sensor.
[0068] Optionally, the process of acquiring the first information may be implemented by a first application in the intelligent host. For example, the process may be implemented by a panel UI decision service module in the first application.
[0069] Step 203: The smart host determines a first message according to the home style characteristics of the first space and the first information, where the first message is used to instruct n panels in the first space to update the user interface.
[0070] In an optional implementation, the smart host may determine a user interface template corresponding to the home style characteristics of the first space, and then determine the first message based on the user interface template and the first information.
[0071] As a possible approach, the smart host may determine the user interface template corresponding to the home style characteristics of the first space by the following method: the smart host may obtain a pre-set user interface template library, and determine the user interface template corresponding to the home style characteristics of the first space in the user interface template library.
[0072] Optionally, the user interface template library can be maintained in the cloud server, and the cloud server regularly updates the user interface template library. Alternatively, the smart host can also obtain the user interface template library from the cloud server and cache it locally. After the cloud server regularly updates the user interface template library, the smart host regularly synchronizes and updates the locally cached user interface template library.
[0073] Accordingly, when determining the user interface template corresponding to the home style feature of the first space, the smart host can obtain the user interface template library from the cloud server, or can also obtain the user interface template library cached this time.
[0074] The user interface template library may include template libraries of various home styles, and the decoration color scheme and decoration style are pre-set for each template library.
[0075] Exemplarily, the smart host may search the user interface template library for a user interface template that matches the decoration color scheme and decoration style of the first space according to the decoration color scheme and decoration style of the first space.
[0076] In some embodiments, the smart host can query multiple user interface templates that match the decoration color and decoration style of the first space, and then determine the final user interface template based on the user's selection instruction. For example, the smart host can present the selected multiple user interface templates on the smart life app for the user to choose, and the user can select one of the multiple user interface templates on the smart life app. After the smart host receives the selection instruction triggered by the user through the smart life app, it determines the final user interface template.
[0077] It should be understood that the above description only takes the Smart Life app as an example, and other applications or web pages (Web) that can realize the functions of the above Smart Life app can be applicable to this application, and this application does not limit this.
[0078] In an optional implementation, after determining the user interface template corresponding to the home style feature, the smart host includes information for identifying the user interface template in the first message. In addition, the smart host determines second information based on the specific content of the acquired first information, and includes the second information in the first message. That is, the first message may include information for identifying the user interface template and the second information. The second information may be used to adjust the user interface. For example, the second information may include one or more of the following information: weather information, time information, or spatial brightness information. Optionally, the information for identifying the user interface template may include an identifier of the user interface template, etc.
[0079] In some embodiments, the smart host may first determine whether to send the first message based on the presence or absence of someone in the spatial status information in the acquired first information. For example, if there is no one, the smart host determines that the first message may not be sent; if there is someone, the smart host sends the first message.
[0080] In other embodiments, after the intelligent host obtains the information of whether there is someone or no one, it can also convert the information of whether there is someone or no one into the second information corresponding to whether there is someone or no one and include it in the first message, wherein when the first message includes the second information of no one, the second information can instruct the n panels in the first space to close; when the first message includes the second information of someone, the second information can instruct the n panels in the first space to update the user interface, thereby causing the n panels to update the user interface based on the other content included in the first message. It can be understood that the closing of a panel can also be regarded as an update of the user interface of a panel.
[0081] In one possible manner, when the first information acquired by the smart host includes weather information and / or time information, the smart host converts the weather information into second information corresponding to the weather information and includes it in the first message, and / or the smart host converts the time information into second information corresponding to the time information and includes it in the first message.
[0082] In some examples, when the smart host obtains the scene mode of the first space, the smart host can convert the scene mode into corresponding second information and include it in the first message. For example, the first message can include one of the following second information: idle mode, meeting mode, sleeping mode, movie watching mode, entertainment mode or singing mode, etc.
[0083] Exemplarily, when the first information acquired by the smart host includes spatial brightness information, the smart host converts the spatial brightness information into corresponding second information of spatial brightness and includes it in the first message.
[0084] Optionally, when the scene mode of the first space obtained by the smart host is a scene mode such as a sleep mode that requires a darker brightness in the first space, at this time, regardless of whether the smart host obtains the spatial brightness information, the smart host can determine the corresponding spatial brightness information based on the sleep mode, and determine the second information corresponding to the spatial brightness information, and include the second information of the spatial brightness information in the first message.
[0085] Optionally, when the smart host includes the second information of no one in the first message, since the panel has been instructed to turn off, the subsequent panel does not need to update the user interface. Therefore, in this case, even if the first information also includes other information such as weather information, the smart host may no longer generate other second information based on other information such as weather information. In other words, in this case, the first message may only include the second information of no one, which can save power consumption of the smart host.
[0086] Therefore, the smart host can accurately determine the second information included in the first message according to the specific situation of the acquired first information, so that the panel can further adjust the user interface template corresponding to the home style.
[0087] Optionally, the determination process of the first message may be implemented by a first application in the smart host. For example, the process may be implemented by a panel UI decision service module in the first application.
[0088] Step 204: The smart host sends a first message to the n panels in the first space, so that the n panels in the first space update the user interface based on the first message.
[0089] For example, after the panel UI decision service module of the first application in the smart host determines the first message, it can send the first message (also called a user interface switching command) to the n panels in the first space through the central control module of the first application to control the n panels in the first space to update the user interface to match the current home style and home status.
[0090] In the present application, the user interface may include various types of components. For example, the user interface may include a background component, a button component, etc. The background component may be used to display a background image or animation effect of a panel, and the button component may enable a user to interact with the panel.
[0091] In one example, the smart host can send the first message to the n panels in the first space by wireless transmission. For example, the smart host can send the first message to the n panels in the first space by the following wireless communication technologies: Wifi technology, BT technology (for example, ordinary BT technology, BLE technology, etc.), Greentooth technology, ZigBee technology, NFC technology, UWB technology or other wireless communication technologies, etc.
[0092] In another example, the smart host may also send the first message to the n panels in the first space via wired transmission. For example, the smart host may send the first message to the n panels in the first space via PLC or other wired transmission methods.
[0093] Optionally, the smart host may send the first message to the n panels in the first space in a user interface profile format.
[0094] In some possible implementations, as described above, the first message may include information for identifying the user interface template and second information, whereby the n panels within the first space may update the user interface based on the information for identifying the user interface template and the second information included in the first message.
[0095] Optionally, when the first message includes the second information that no one is present, the n panels in the first space may directly determine to close the panels based on the second information that no one is present, that is, not displaying the user interface.
[0096] When the first message includes the second information of a person, the n panels in the first space can update the user interface based on the information for identifying the user interface template and other second information included in the first message. Alternatively, when the first message does not include the second information of a person or no person, the n panels in the first space can update the user interface based on the information for identifying the user interface template and the second information included in the first message.
[0097] Exemplarily, the n panels in the first space can obtain the resource package of the user interface corresponding to the information for identifying the user interface template in the user interface template library according to the information for identifying the user interface template. The resource package can be downloaded to the n panels. For example, if the user interface template corresponding to the home style feature of the first space is a European-style user interface template, the first message includes information for identifying the European-style user interface template. The n panels in the first space obtain the resource package of the European-style user interface template in the user interface template library according to the information for identifying the European-style user interface template.
[0098] Among them, the n panels of the first space can obtain the above-mentioned resource package from the user interface template library in the cloud server, or obtain the above-mentioned resource package from the user interface template library cached locally in the smart host, and this application does not limit this.
[0099] Optionally, the resource package may include relevant resources of all components of the whole house, such as pictures, animation effects, background music, etc. related to all components of the whole house. The content included in the resource package may be pre-designed, for example, the content in the resource package may be resources designed, defined and packaged in advance by a whole house scene engineer or designer.
[0100] In some possible implementations, the resources in the resource package can be divided into resource types according to the component type of the user interface, that is, different types of components can correspond to different resources. The panel can further obtain the resources corresponding to the component of this type in the resource package according to the type of component. For components of the same type, resources can be distinguished in the resource package through component identification. The component identification is used to distinguish components in components of the same type. The dimensions of the component distinction may include the size of the component, the shape of the component, etc., which are not limited in the embodiments of the present application. The representation of the component identification can be associated with the size information of the component, or the shape information of the component, etc., or it can be a preset number.
[0101] For example, since the sizes of the background components of each panel may be different, the resource package can distinguish between background components of different sizes through the component identifier of the background component. When the panel updates the background component, it can first determine the resources corresponding to the background component in the resource package according to the type of the component, and determine the resources of the background component corresponding to the panel according to the component identifier of the background component, thereby implementing the update of the background component. For example, if the size of the background component of the panel is 3:4, the component identifier of the background component can be "3:4", and the panel obtains the resources corresponding to the background component in the resource package according to the component identifier "3:4".
[0102] Similarly, since the shapes of button components of each panel may be different, the resource package can distinguish button components of different shapes through the component identifier of the button component. When the panel updates the button component, it can first determine the resources corresponding to the button component in the resource package according to the type of the component, and determine the resources of the button component corresponding to the panel according to the component identifier, thereby implementing the update of the button component. For example, if the shape of the button component to be updated in the panel is circular, the component identifier of the button component can be "circle", and the panel obtains the resources corresponding to the button component in the resource package according to the component identifier "circle".
[0103] In another possible implementation, the resources in the resource package can be directly distinguished according to the component identifier. For example, the component identifier of the background component can be "background component-3:4", and the component identifier of the button component can be "button component-circle".
[0104] The second information in the first message can be used to adjust the user interface. If the second information is weather information or time information, the panel can obtain the resources corresponding to the weather information or time information in the obtained resource package. The panel updates the background component according to the resources corresponding to the weather information or time information and the resources of the background component. For example, when the first message includes information and weather information for identifying the European-style user interface template, the weather information is represented as rain. The panel can obtain the resource package of the European-style user interface template according to the information for identifying the European-style user interface template, and obtain the European-style picture resource corresponding to the background component according to the component type or component identification of the background component of the panel. If the resource package includes a background animation resource of rain, the panel can obtain the background animation resource of rain in the resource package according to the weather information. The panel can combine resources according to the background animation resource of rain and the European-style picture resource corresponding to the background component, for example, superimpose the background animation of rain on the obtained European-style picture, and update the background component to a European-style user interface with rainy day special effects. If the second information is a scene mode, the panel can obtain the resources corresponding to the scene mode in the obtained resource package, and the panel updates the background component according to the resources corresponding to the scene mode and the resources of the background component. For example, when the scene mode is the guest mode, and the first message includes information for identifying the European-style user interface template and the scene mode, the scene mode is the guest mode. The panel can obtain the resource package of the European-style user interface template based on the information for identifying the European-style user interface template, and obtain the European-style image resource corresponding to the background component based on the component type or component identification of the background component of the panel. If the resource package includes background image resources for the guest mode, the panel can obtain the background image resources for the guest mode in the resource package based on the guest mode. Furthermore, the panel can combine resources based on the background image resources for the guest mode and the European-style image resources corresponding to the background component, for example, superimposing the background image resources for the guest mode on the European-style image, and updating the background component to the European-style user interface of the guest mode.
[0105] If the second information includes spatial brightness information, the panel may update the brightness of the user interface of the panel according to the spatial brightness information.
[0106] It should be understood that the second information in the first message may also contain multiple information at the same time, such as at least one of scene mode (such as meeting mode), weather information (such as rain), time information (such as festivals) and space brightness information. The update of the user interface of the n panels in the first space can refer to the above examples or the superposition of examples, and this application will no longer list various situations one by one.
[0107] Based on the above display control method, the user interface of the panel can be adaptively matched with the home status and home style to improve the user experience.
[0108] Based on the above embodiments, the following describes an example of the display control method provided in the present application by taking the first space as the entire house space as an example.
[0109] Exemplarily, the display control method provided in the embodiment of the present application may exemplarily include the following three processes:
[0110] 1. Home style collection, select the user interface template of the panel of the whole house space
[0111] Exemplarily, the process can be as follows Figure 3 The UI style matching process shown includes the following steps:
[0112] Step 1: Obtain image data of the entire house space through the whole-house camera.
[0113] In some embodiments, image data of the entire house space can be collected once or multiple times through the whole-house camera to improve image accuracy.
[0114] The whole-house space image data may include images or photos of the whole-house space taken by the whole-house camera, which may also be referred to as home space images.
[0115] Step 2: According to the home style AI model, match the image data of the entire house space to obtain the home style characteristics.
[0116] Exemplarily, home style features may include decoration colors and decoration styles.
[0117] For example, the decoration color scheme is warm white, gray, etc. Optionally, the decoration color scheme can be represented by RGB feature values.
[0118] For example, the decoration style may be modern, classical, Chinese, European, luxurious, etc. The decoration style may be embodied as a style value or a style label.
[0119] Step 3: Get the user interface template library of the panel.
[0120] The user interface template library includes template libraries of various home styles, and the decoration color scheme and decoration style are pre-set for each template library.
[0121] It should be understood that Figure 3 In the example, the first application obtains the user interface template library from the cloud server. Optionally, the first application can also obtain the user interface template library cached locally.
[0122] Step 4: The first application searches the UI template library for a matching UI template that needs to be used for the entire house based on the decoration color and decoration style. For example, the first application selects a UI template from the UI template library based on RGB and decoration style, and then includes information for identifying the selected UI template in the first message.
[0123] Optionally, step 4 may be implemented by a panel UI decision service module in the first application.
[0124] II. Acquisition of First Information and Determination of Second Information in First Message
[0125] First, obtain Figure 3 For the space status information shown, the first application can obtain the space status information of the whole house by perceiving and fusing the information of whether there are people or no people in the space obtained by the AI sensor with the scene mode determined based on the device status. Furthermore, the first application can first determine that the corresponding second information is included in the first message based on the information of whether there are people or no people.
[0126] Afterwards, obtain Figure 3 The spatial brightness information shown, the first application can obtain the spatial brightness information of the whole house through the brightness sensor. Furthermore, the first application can determine the spatial brightness information as the corresponding second information included in the first message.
[0127] Afterwards, obtain Figure 3 The weather information and / or time information shown may be external information such as weather information and / or time information obtained by the first application through external input, for example, the first application may obtain external information such as weather information and / or time information from a cloud server. Furthermore, the first application may determine the weather information and / or time information as corresponding second information to be included in the first message.
[0128] Optionally, in some scene modes, the current spatial brightness of the whole house can be determined through the scene mode, and the operation of obtaining the spatial brightness information of the whole house through the brightness sensor can be omitted. For example, when the first application obtains the spatial status information that there are people and the scene mode is off-lights viewing, in this case, since the scene mode of off-lights viewing can determine that the current spatial brightness of the whole house is dark, the first application no longer needs to obtain the spatial brightness of the whole house through the brightness sensor, and can directly determine the second information corresponding to the spatial brightness information contained in the first message according to the scene mode.
[0129] Based on this, the first application (eg, through a panel UI decision service module of the first application) may determine the first message.
[0130] 3. The first application sends a first message to the panel of the entire house space to control the synchronous switching of the UI status of the entire house.
[0131] like Figure 3 As shown, the first application can send a first message to Panel 1, Panel 2, Panel 3, and Panel 4, so that Panel 1, Panel 2, Panel 3, and Panel 4 update the user interface based on the first message.
[0132] For example, the panel UI decision service module of the first application sends a first message to panel 1, panel 2, panel 3, and panel 4 through the central control module of the first application.
[0133] Optional, such as Figure 4 As shown, the first message may include information for identifying the UI template and the following second information: whether someone is present, weather information, time information, and spatial brightness information. The panels of the entire house can obtain the resource package of the UI corresponding to the UI template based on the information for identifying the UI template, and adjust the user interface based on the second information in the first message. For example, Figure 4 As shown, the panels of the whole house can match the space status, for example, determine whether to update or not display the user interface according to the second information of whether there is someone or no one included in the first message. Figure 4 If the second information is that there is no one, the user interface is not displayed, and the user interface of the panel in the whole house space is closed. If the second information is that there is someone, the user interface is updated. Figure 4 The panels of the whole house can be matched with special effects. For example, if the second information is weather information and the weather information is raining, rainy day special effects can be displayed, such as raindrops or umbrellas; if the second information is weather information and the weather information is sunny, sunny day special effects can be displayed, such as the sun; if the second information is time information and the time information is birthday, birthday special effects can be displayed, such as birthday cakes. Finally, Figure 4 As shown, the panels of the whole house can perform spatial brightness matching, such as updating the brightness of the panel user interface according to the second information of the spatial brightness information included in the first message. It should be understood that the method for updating the user interface of the panels of the whole house can be the method described in detail in the aforementioned step 204, which will not be described in detail here.
[0134] Exemplarily, the panel UI decision service module of the first application can push the first message through the central control module of the first application in real time according to the acquired user interface template and the first information, and control the synchronous switching of the panel UI state of the whole house. In other words, the panel UI decision service module of the first application can push the first message through the central control module of the first application while determining the first message based on the user interface template and the first information, so that the update of the user interface matches the current space.
[0135] Based on the above description of the method of the present application, an example of a home decoration in European style is used below. Based on the above method of the present application, the image data obtained by the whole-house camera can determine that the decoration color is warm white and the decoration style is European style, and then automatically select a European-style UI template for the user.
[0136] When the user is at home, the panel UI is uniformly updated to a European-style background interface, which is in harmony with the decoration style of the user's home. When the scene mode acquisition is not started, or the scene mode does not involve the brightness of the space, the panel can change in real time according to the brightness in the space. For example, when the light is bright during the day, the panel displays bright, and when the light is dim at dusk, the panel display dims synchronously.
[0137] Optionally, if the first application of the smart host obtains weather information, the panel background components and other UI can update weather-related effects. If it is sunny that day, the panel background components and other UI can synchronously update the sun background effect of the day. According to the time of the day, the sun background effect can also change its position in real time, such as sunrise time, noon time and sunset time. The sun icon can be in different positions on the panel. For example, the display diagram of the panel user interface can be as follows Figure 5 The interface diagram corresponding to sunrise, noon and sunset is shown in FIG. If it is rainy that day, the background component of the panel and other UI can be synchronized to update the rainy background animation of that day. For example, the display diagram of the panel user interface can be as follows: Figure 5 Schematic diagram of the interface corresponding to raining shown.
[0138] When the user leaves home, the panel can automatically turn off the UI to save energy.
[0139] In some embodiments, when different rooms in the house have different home styles, the user interface updates of the corresponding panels can be implemented for different rooms. For example, the decoration style and color scheme of room 1 can be obtained through the camera in room 1, and then the user interface template of room 1 can be matched. At the same time, the message 1 for room 1 can be determined in combination with the spatial state information, brightness information, weather or time information of room 1, and then the smart host sends the message 1 to each panel in room 1. The same is true for other rooms. Finally, the first application of the smart host can send corresponding message commands to the panels of the corresponding rooms respectively, so that the panels of each room can update the corresponding user interface.
[0140] It should be understood that in the description of this application, the update of the panel combined with the spatial state information, spatial brightness information, weather information or time information is only an exemplary description. Optionally, the spatial state information, spatial brightness information, weather information or time information may exist in full, in part, or not at all, or other information may exist in addition to the above information, and this application does not limit this.
[0141] Based on the above embodiments, the present application also provides a device, referring to Figure 6 As shown, the apparatus 600 may include a memory 601 and at least one processor 602. The processor 602 may call a program stored in the memory 601 to enable the apparatus 600 to implement the above display control method.
[0142] Specifically, the processor 602 may be a central processing unit (CPU), a network processor (NP) or a combination of a CPU and a NP. The processor 602 may further include a hardware chip. The hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD) or a combination thereof. The PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL) or any combination thereof.
[0143] The memory 601 and the processor 602 are interconnected. Optionally, the memory 601 and the processor 602 are interconnected via a bus 603; the bus 603 may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 6 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.
[0144] In an optional implementation, the program stored in the memory 601 may include a program code, which includes a computer operation instruction. The memory 601 may include a RAM, or may also include a non-volatile memory, such as one or more disk memories.
[0145] Exemplarily, the device 600 may be a chip or a chip system, etc.
[0146] Based on the above embodiments, the present application also provides a device, referring to Figure 7 As shown, the device 700 may include a transceiver 701 and at least one processor 702. Optionally, the device 700 may further include at least one memory 703. The memory 703 may be disposed inside the device 700 or outside the device 700. The processor 702 may control the transceiver 701 to receive and send instructions, messages, information or data, etc. The transceiver may include a communication interface, etc.
[0147] Specifically, the processor 702 may be a central processing unit (CPU), a network processor (NP) or a combination of a CPU and a NP. The processor 702 may further include a hardware chip. The hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD) or a combination thereof. The PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL) or any combination thereof.
[0148] The transceiver 701, the processor 702 and the memory 703 are interconnected. Optionally, the transceiver 701, the processor 702 and the memory 703 are interconnected via a bus 704; the bus 704 may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 7 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.
[0149] In an optional implementation, the memory 703 is used to store programs, etc. Specifically, the program may include a program code, and the program code includes a computer operation instruction. The memory 703 may include a RAM, and may also include a non-volatile memory (non-volatile memory), such as one or more disk memories. The processor 702 executes the application stored in the memory 703 to implement the above functions, thereby realizing the functions of the device 700.
[0150] Exemplarily, the device 700 may be the intelligent host in the above-mentioned embodiment.
[0151] The device 700 can implement the functions of the smart host in the above embodiment. Specifically, when implementing the functions of the smart host in the above embodiment, the transceiver 701 can implement the transceiver operation performed by the smart host in the above embodiment; the processor 702 can implement other operations performed by the smart host in the above embodiment except the transceiver operation. For specific related descriptions, please refer to the related descriptions in the above embodiment, which will not be described in detail here.
[0152] Based on the above embodiments, an embodiment of the present application further provides a readable storage medium, wherein the readable storage medium is used to store a program. When the program is executed by a device, the device can implement a display control method provided by the above method embodiment.
[0153] An embodiment of the present application also provides a computer program product, which is used to store a program. When the program is executed by a device, the device can implement a display control method provided by the above method embodiment.
[0154] An embodiment of the present application also provides a chip, including a processor, wherein the processor is coupled to a memory and is used to call a program in the memory so that the chip implements a display control method provided by the above method embodiment.
[0155] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a program product implemented in one or more available storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain program code.
[0156] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and program products according to the present application. It should be understood that each flow and / or box in the flow chart and / or block diagram, as well as the combination of the flow chart and / or box in the flow chart and / or block diagram, can be implemented by program instructions.
[0157] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.
Claims
1. A display control method, characterized in that: include: Determine the home style characteristics of the first space; Obtaining first information; Determine a first message according to the home style feature of the first space and the first information, where the first message is used to instruct n panels in the first space to update user interfaces, where n is an integer not less than 1; The first message is sent to the n panels in the first space.
2. The method according to claim 1, characterized in that Determine the home style characteristics of the first space, including: Acquire image data of the first space through a camera of the first space; The home style feature of the first space is determined according to the image data of the first space.
3. The method according to claim 2, characterized in that Determining the home style feature of the first space according to the image data of the first space includes: Get a pre-trained home style model; A home style feature of the first space is determined according to the home style model and the image data of the first space.
4. The method according to any one of claims 1 to 3, characterized in that: The home style features include decoration color and decoration style.
5. The method according to any one of claims 1 to 4, characterized in that: Determining a first message according to the home style feature of the first space and the first information includes: Determine a user interface template corresponding to the home style feature of the first space; The first message is determined according to the user interface template and the first information.
6. The method according to claim 5, characterized in that Determining a user interface template corresponding to the home style feature of the first space includes: Get a library of pre-set user interface templates; The user interface template corresponding to the home style feature of the first space is determined in the user interface template library.
7. The method according to any one of claims 1 to 6, characterized in that: The first information includes one or more of the following: space state information, space brightness information, weather information or time information.
8. The method according to any one of claims 1 to 7, characterized in that: The first message includes information for identifying a user interface template and second information, where the second information is obtained based on the first information.
9. A device, characterized in that: The device comprises at least one processor, which is coupled to at least one memory, and the at least one processor is used to read the program stored in the at least one memory so that the device executes the method according to any one of claims 1 to 8.
10. A readable storage medium, characterized in that: The readable storage medium stores instructions, and when the instructions are called by a device, the method according to any one of claims 1 to 8 is executed.
11. A program product, characterized in that Contains instructions, which, when executed on a device, cause the method according to any one of claims 1 to 8 to be executed.
Citation Information
Patent Citations
Method and device for determining home control application theme and computer storage medium
CN110806696A
Storage medium, intelligent panel and equipment control method based on intelligent panel
CN111240221A
Storage medium, intelligent panel and personalized setting method thereof
CN111596580A
Arranging a Set of Panels in a First Application Environment Via Arrangement of the Set of Panels in a Second Application Environment for a Multi-Modal Device
US20130311888A1
Method and apparatus for controlling smart device
US20160226674A1