Interface display method and device, smart home equipment, electronic equipment and medium

Abstract

The invention discloses an interface display method and device, smart home equipment, electronic equipment and a medium. The method comprises the following steps: detecting that the system resource occupancy rate of the equipment is greater than a preset threshold value; target equipment is determined in the smart home equipment capable of communicating with the equipment, the performance evaluation score of the target equipment is higher than that of the equipment, and the target equipment meets remote rendering conditions; a rendering task is sent to the target device, and the rendering task is obtained through prediction according to the use habit of a user; receiving and storing a rendering result returned by the target equipment; and when an operation instruction is received, calling a corresponding rendering result to display an interface corresponding to the operation instruction. Through remote pre-rendering, the resource burden of the device is reduced, the real-time performance of display of the next interface can be guaranteed, the problem that the operation interface of the display screen is prone to being blocked when the low-performance device is used is solved, and the interaction fluency and the operation stability of the display screen of the low-performance device are improved.

Description

Technical Field

[0001] The present invention relates to the field of smart home technology, and in particular to an interface display method, device, smart home equipment, electronic equipment and medium. Background Art

[0002] In the application scenario of home smart control, there will be multiple display screens that interact with users, such as refrigerator display screens, TV display screens, washing machine display screens, etc. Due to product positioning and cost considerations, the performance gap between different products is large. When users use low-performance products, their display screens are prone to interface freezes. For example, washing machines are low-performance devices, and their display screens are prone to interface freezes. However, the interaction of high-performance devices such as refrigerators and TVs is relatively smooth. Summary of the invention

[0003] The embodiments of the present invention provide an interface display method, device, smart home device, electronic device and medium, so as to at least solve the problem in the prior art that low-performance devices are prone to display screen operation interface freezes when in use.

[0004] In order to solve the above technical problems, an embodiment of the present invention provides an interface display method, which is applied to smart home devices, including:

[0005] It is detected that the system resource usage of this device is greater than the preset threshold;

[0006] Determine a target device among smart home devices that can communicate with the current device, wherein the performance evaluation score of the target device is higher than that of the current device and satisfies the remote rendering condition;

[0007] Sending a rendering task to the target device, wherein the rendering task is predicted based on the user's usage habits;

[0008] Receive and save the rendering result returned by the target device;

[0009] When an operation instruction is received, the corresponding rendering result is called to display the interface corresponding to the operation instruction.

[0010] Optionally, determining a target device among smart home devices that can communicate with the present device includes:

[0011] Displaying the smart home devices that can communicate with the device;

[0012] Determine a candidate device from the smart home devices that can communicate with the device according to a preset rule and establish a communication connection;

[0013] Sending the performance evaluation score and current system resource occupancy rate of the device to the candidate device, so that the candidate device can determine whether it meets the remote rendering conditions;

[0014] If a confirmation message returned by the candidate device is received, the candidate device is used as the target device;

[0015] If a rejection message returned by the candidate device is received, the communication connection with the candidate device is disconnected, and the next candidate device is re-determined according to the preset rule and a communication connection is established for judgment, and so on, until the target device is determined.

[0016] Optionally, before sending the rendering task to the target device, the method further includes:

[0017] During operation, the number of operations on each control on each interface is recorded in real time according to the user's operation behavior;

[0018] For the current interface, obtaining the operation count of each control on the current interface from the recorded information;

[0019] The operations are sorted in descending order to generate a rendering task queue, so as to send each rendering task to the target device one by one in sequence, and the next rendering task is sent after each rendering result is returned.

[0020] Optionally, while sending the rendering task to the target device, the method further includes:

[0021] Real-time detection of network quality parameters between the device and the target device;

[0022] When the network quality parameter does not meet the requirement, switch to local rendering and stop sending the rendering task to the target device.

[0023] Optionally, the above-mentioned interface display method also includes: real-time display of rendering mode marking information, and / or real-time display of network quality parameters between the present device and the target device, wherein the first marking information corresponds to remote rendering and the second marking information corresponds to local rendering.

[0024] Optionally, before detecting that the system resource occupancy rate of the device is greater than a preset threshold, it also includes: turning on a remote rendering function; correspondingly, the remote rendering function of the target device is also turned on.

[0025] Optionally, after determining the target device among the smart home devices that can communicate with the present device, the method further includes:

[0026] It is detected that the display screen of this device is unusable;

[0027] Transmitting the interface layout and control information of the display screen of the present device to the target device, so that the target device displays the interface of the present device and receives user operations;

[0028] Execute corresponding actions according to the control instruction returned by the target device to continue running.

[0029] Optionally, it also includes:

[0030] Receive performance evaluation scores and current system resource usage from any other device;

[0031] Calculate the estimated resource occupancy value of the device when providing assistance according to the performance evaluation score and current system resource occupancy rate of the device and the performance evaluation score and current system resource occupancy rate of any device;

[0032] If the estimated resource usage value is less than a preset ratio of the performance evaluation score of the device, it is determined that the device meets the remote rendering condition, and a confirmation message is returned to the arbitrary device;

[0033] If the estimated resource occupancy value is greater than or equal to a preset proportion of the performance evaluation score of the device, it is determined that the device does not meet the remote rendering conditions, and a rejection message is returned to the arbitrary device.

[0034] Optionally, the estimated resource occupancy value R of the device when providing assistance is calculated according to the following formula:

[0035] R=the performance evaluation score of the device×the current system resource occupancy rate of the device+the performance evaluation score of any device×the current system resource occupancy rate of any device.

[0036] Optionally, it also includes:

[0037] Receiving interface layout and control information sent by any device;

[0038] Display the interface of any device and receive user operations;

[0039] Return a control instruction to the arbitrary device so that the arbitrary device performs a corresponding action.

[0040] The embodiment of the present invention further provides an interface display device, which is applied to a smart home device, comprising:

[0041] A detection module, used to detect that the system resource usage of the device is greater than a preset threshold;

[0042] A determination module, configured to determine a target device among smart home devices that can communicate with the current device, wherein the performance evaluation score of the target device is higher than that of the current device and satisfies the remote rendering condition;

[0043] A sending module, used to send a rendering task to the target device, wherein the rendering task is predicted according to the user's usage habits;

[0044] A receiving module, used for receiving and saving the rendering result returned by the target device;

[0045] The display module is used to call the corresponding rendering result to display the interface corresponding to the operation instruction when an operation instruction is received.

[0046] The embodiment of the present invention further provides a smart home device, including: the interface display device described in the embodiment of the present invention.

[0047] An embodiment of the present invention further provides an electronic device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the interface display method described in the embodiment of the present invention when executing the computer program.

[0048] The embodiment of the present invention further provides a non-volatile computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the interface display method described in the embodiment of the present invention is implemented.

[0049] By applying the technical solution of the present invention, when the smart home device has insufficient system resources, it can predict the rendering tasks that may need to be processed in the current interface based on the user's usage habits, and send the predicted rendering tasks in advance to a smart home device with higher performance and meeting certain conditions for remote rendering, receive and save the rendering results, and when an operation instruction is received, the corresponding rendering results can be called to directly display the corresponding interface. Through remote pre-rendering, the resource burden of the device is reduced and the real-time display of the next interface can be guaranteed, which solves the problem that the display operation interface of low-performance devices is prone to freeze when in use, improves the interactive smoothness and operating stability of the display screen of low-performance devices, and improves the interactive experience of low-performance devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] Figure 1 is a flow chart of an interface display method provided by an embodiment of the present invention;

[0051] Figure 2 is an interface display flow chart provided by an embodiment of the present invention;

[0052] Figure 3 is a structural block diagram of an interface display device provided by an embodiment of the present invention;

[0053] Figure 4 It is a schematic diagram of the hardware structure of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0054] In order to make the purpose, technical scheme and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0055] It should be noted that the terms "first", "second", etc. in the specification, claims and drawings of the present invention are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0056] It should be noted that the steps shown in the flowcharts of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and that, although a logical order is shown in the flowcharts, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0057] It should be understood that the term "and / or" used in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0058] The optional embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0059] An embodiment of the present invention provides an interface display method, which is applied to a smart home device. The smart home device may be equipped with an interactive display screen. Figure 1 is a flow chart of an interface display method provided by an embodiment of the present invention, such as Figure 1 As shown, the method comprises the following steps:

[0060] S101, detecting that the system resource usage of the device is greater than a preset threshold.

[0061] S102, determining a target device among smart home devices that can communicate with the current device, wherein the performance evaluation score of the target device is higher than that of the current device and satisfies a remote rendering condition.

[0062] S103: Send the rendering task to the target device, wherein the rendering task is predicted according to the user's usage habits.

[0063] S104: Receive and save the rendering result returned by the target device.

[0064] S105: When an operation instruction is received, a corresponding rendering result is called to display an interface corresponding to the operation instruction.

[0065] The system resource usage rate may be the CPU usage rate and / or the memory usage rate. The preset threshold is used to measure whether the system resource usage rate is too high, and the preset threshold can be set according to the actual situation. If the system resource usage rate is too high, it will affect the timely processing of the graphics rendering task, and the display screen operation interface will freeze. When the system resource usage rate of the device is less than or equal to the preset threshold, real-time rendering can be performed locally on the device. When the system resource usage rate of the device is greater than the preset threshold, the possible subsequent rendering tasks can be predicted based on the user's usage habits, and other smart home devices with higher performance and meeting certain conditions can assist in remote rendering to achieve pre-processing of the rendering task. In this case, the device does not need to perform the rendering task, and saves the rendering result returned by the target device. If the user clicks a button, the data can be loaded immediately, and the corresponding interface can be displayed, reducing the waiting time and avoiding the operation interface from freezing. A device that meets the remote rendering conditions indicates that it can provide assistance.

[0066] In the process of sending the rendering task to the target device for remote rendering, if it is detected that the system resource usage of the device is less than or equal to a preset threshold, it can be switched to local rendering.

[0067] The performance evaluation score of smart home devices can be evaluated and determined before the devices leave the factory. The performance of smart home devices can be known based on the performance evaluation score. Specifically, for each smart home device, its performance indicators are obtained, including but not limited to: CPU performance, GPU performance, memory bandwidth and IO performance, and the scores are given according to the principle of high performance and high score, and the scores corresponding to each indicator are determined; the weight of each indicator is obtained, and the weighted sum is calculated to obtain the performance evaluation score of the device. In this way, the performance indicators of the device can be quantified.

[0068] In the case of insufficient system resources of the smart home device of this embodiment, the smart home device predicts the rendering tasks that may need to be processed in the current interface based on the user's usage habits, and sends the predicted rendering tasks in advance to a smart home device with higher performance and meeting certain conditions for remote rendering, receives and saves the rendering results, and when an operation instruction is received, the corresponding rendering results can be called to directly display the corresponding interface. Through remote pre-rendering, the resource burden of the device is reduced and the real-time display of the next interface can be guaranteed, which solves the problem that the display operation interface of low-performance devices is prone to freeze when in use, improves the interactive smoothness and operating stability of the display screen of low-performance devices, and improves the interactive experience of low-performance devices.

[0069] In an optional embodiment, determining a target device among smart home devices that can communicate with the present device includes: displaying the smart home devices that can communicate with the present device; determining a candidate device from the smart home devices that can communicate with the present device according to preset rules and establishing a communication connection; sending the performance evaluation score of the present device and the current system resource occupancy rate to the candidate device, so that the candidate device determines whether it meets the remote rendering conditions; if a confirmation message returned by the candidate device is received, using the candidate device as the target device; if a rejection message returned by the candidate device is received, disconnecting the communication connection with the candidate device, re-determining the next candidate device according to the preset rules and establishing a communication connection for judgment, and so on, until the target device is determined.

[0070] Among them, the preset rules can consider factors such as performance evaluation score, signal strength, and whether it has a GPU (Graphics Processing Unit) to select candidate devices. For example, for other devices with a performance evaluation score higher than this device, they are connected and judged in order from high to low according to the signal strength. For another example, for other devices with a performance evaluation score higher than this device, devices with GPUs are given priority to establish connections. Low-performance devices often do not have GPUs, and their CPUs consume a lot of resources to process graphics rendering tasks. If the graphics rendering tasks are handed over to devices with GPUs for processing, the CPU can perform more other system tasks, which can greatly improve the overall performance of the device. Exemplarily, when a smart home device is connected to the network for the first time, its performance evaluation score can be obtained, and the performance evaluation scores of all smart home devices in the network can be sorted and marked, so that this device can know which devices have higher performance than this device. If the target device is not determined, an error message can be prompted, and the target device can be re-determined after a certain time interval.

[0071] This implementation can quickly determine the target device for performing pre-remote rendering, and ensure that the target device does not affect the data processing of the device itself when performing remote rendering.

[0072] After establishing a communication connection with the candidate device, this device can first perform verification, and only after the verification is passed can normal data transmission be allowed. For example, send your own device identification information (such as MAC address, serial number, etc.) to the other party, and after receiving the other party's device identification information, upload the received device identification information to the server for verification. If the server receives a verification pass message, it means that the other party's device is legal. This can ensure security.

[0073] In an optional embodiment, before sending the rendering task to the target device, it also includes: during the running process, recording the operation times of each control on each interface in real time according to the user operation behavior; for the current interface, obtaining the operation times of each control on the current interface from the recorded information; sorting in descending order according to the operation times, generating a rendering task queue, and sending each rendering task to the target device one by one in sequence, and sending the next rendering task after each rendering result is returned.

[0074] The controls here can be operable controls such as input boxes, buttons, sliders, etc. on the interface. For multiple operable controls on any interface, the controls with more historical operations are more likely to be operated by the user at the current time. The graphical interface displayed on the display screen is not static, and it may be necessary to switch interfaces, change animation effects, etc. For example, there are three buttons that can be clicked on the current interface, and different interfaces will change when different buttons are pressed. This device sorts these three buttons from high to low according to the number of historical operations, generates a rendering task queue, and sends these three graphics rendering tasks to the target device in advance. The sending order is determined by the user's usage habits, that is, the rendering task corresponding to the control with the most historical operations is sent to the target device first.

[0075] This implementation can more accurately predict the order in which the controls on the current interface are likely to be operated based on user usage habits, thereby generating rendering tasks to be pre-processed, which are sent to the target device for processing in sequence, thus realizing the pre-processing of rendering tasks and ensuring the real-time display of the interface to the greatest extent.

[0076] In actual applications, the interface displayed on the display screen has many elements. When a control on the interface is operated, the corresponding new interface is displayed, but some content of the new interface may not have changed compared with the previous interface. Therefore, after receiving the first graphics rendering task sent by the other party, the target device can cache the basic graphics data (this is frequently accessed data, and multiple rendering tasks may involve it), so that the device does not need to transmit these repeated data every time, and can only transmit the data that has changed, thereby reducing the amount of data transmission and improving the response speed.

[0077] Remote rendering is highly dependent on a stable network connection. If the network is unstable or the bandwidth is insufficient, the data transmission speed may be slowed down, resulting in a freeze in the display interface. In an optional embodiment, while sending the rendering task to the target device, it also includes: real-time detection of the network quality parameters between the device and the target device; when the network quality parameters do not meet the requirements, switch to local rendering and stop sending the rendering task to the target device.

[0078] The network quality parameters may include: network delay and / or packet loss rate. If the network delay is greater than the time threshold or the packet loss rate is greater than the packet loss rate threshold, it means that the network quality parameters do not meet the requirements. The time threshold and the packet loss rate threshold depend on the refresh rate of the display screen of the device. The higher the refresh rate, the smaller the required display delay and the more stringent the packet loss rate requirement. Therefore, the higher the refresh rate, the smaller the time threshold and the packet loss rate threshold.

[0079] This implementation method evaluates the network connection quality between the device and the target device in real time. When the network quality is poor, it switches to local rendering in a timely manner to ensure the smoothness of the device interaction experience as much as possible.

[0080] In order to facilitate users to understand the network status and / or rendering mode, the above-mentioned interface display method also includes: real-time display of rendering mode marking information, and / or, real-time display of network quality parameters between the present device and the target device, wherein the first marking information corresponds to remote rendering, and the second marking information corresponds to local rendering. For example, the network delay value is displayed in real time in the upper right corner of the display screen interface to facilitate users to understand the network status, and the rendering mode is distinguished by the numerical color. When the network delay value is green, it means that the current rendering is remote, and when the network delay value is red, it means that the current rendering is local.

[0081] In specific implementation, the on / off control entry of the remote rendering function can be set on the smart home device (for example, there are operation controls on the display screen, or physical buttons are set), so that users can control it according to actual needs. For a smart home device, if the user does not turn on its remote rendering function, the device will always perform local rendering and will not provide remote rendering assistance to other devices; if the user turns on its remote rendering function, the device can use a device with higher performance and remote rendering function turned on to help itself achieve remote rendering, and can also provide remote rendering assistance to devices with lower performance.

[0082] Specifically, before detecting that the system resource occupancy rate of the device is greater than a preset threshold, the remote rendering function is also turned on; accordingly, the remote rendering function of the target device is also turned on. In this embodiment, the user can turn on and off the remote rendering function according to actual needs, thereby improving the user control experience.

[0083] The display screen of a smart home device may be damaged or aged, making it unusable. In this case, a higher-performance device may be used to assist in device control so that the device can operate normally. Specifically, after determining the target device among the smart home devices that can communicate with this device, it also includes: detecting that the display screen of this device is unusable; transmitting the interface layout and control information of the display screen of this device to the target device, so that the target device displays the interface of the device and receives user operations; and executing corresponding actions according to the control instructions returned by the target device to continue operation. In this embodiment, when the display screen of this device is unusable, a higher-performance target device is used to draw and display the interface of this device, and the user can control this device by operating the interface displayed by the target device.

[0084] When this device provides remote rendering assistance as a higher-performance device, this device receives the performance evaluation score and its current system resource occupancy rate sent by any other device; based on the performance evaluation score and current system resource occupancy rate of this device and the performance evaluation score and current system resource occupancy rate of any device, calculate the estimated resource occupancy value of this device when providing assistance; if the estimated resource occupancy value is less than the preset ratio of the performance evaluation score of this device, it is determined that this device meets the remote rendering conditions, and a confirmation message is returned to the arbitrary device; if the estimated resource occupancy value is greater than or equal to the preset ratio of the performance evaluation score of this device, it is determined that this device does not meet the remote rendering conditions, and a rejection message is returned to the arbitrary device. The preset ratio can be set according to actual conditions, for example, the preset ratio is set to 80%.

[0085] This implementation determines whether a device meets the remote rendering conditions by calculating the estimated resource occupancy value, thereby preventing the device from affecting its own normal control and display due to assisting remote rendering.

[0086] Specifically, the estimated resource occupancy value R of the device in the case of providing assistance can be calculated according to the following formula: R = performance evaluation score of the device × current system resource occupancy rate of the device + performance evaluation score of any device × current system resource occupancy rate of any device. This calculation method can effectively and quickly calculate the estimated resource occupancy value.

[0087] When this device provides remote rendering assistance as a higher-performance device, in the case where the display screen of other devices cannot be used due to damage or aging, it can receive the interface layout and control information sent by the arbitrary device; display the interface of the arbitrary device and receive user operations; return control instructions to the arbitrary device so that the arbitrary device performs the corresponding action. In this way, the interface of other devices can be drawn and displayed, and the user can realize normal control of the corresponding device by operating the interface.

[0088] The above interface display method is described below in conjunction with a specific embodiment. However, it is worth noting that this specific embodiment is only for better illustrating the present application and does not constitute an improper limitation on the present application. The explanation of terms that are the same or corresponding to the above embodiment will not be repeated in this embodiment.

[0089] This embodiment establishes a communication network within a local area network, connects all smart home devices to the same network, and ensures that the devices can communicate with each other. Specifically, a WiFi module can be set for each smart home device during the design phase. Devices that support WiFi direct connection can be directly connected to each other, while those that do not support it need to establish communication through a router.

[0090] like Figure 2 As shown, the interface display method includes the following steps:

[0091] S201, the user turns on the remote rendering function of device A.

[0092] S202, device A determines whether its own CPU usage is greater than a preset threshold, if so, enters S203, if not, enters S213.

[0093] S203, device A queries and displays other devices that can be connected in the local area network, and establishes network connections with them one by one. Specifically, the devices with performance evaluation scores higher than device A can be connected in sequence according to signal strength. After the devices are connected, device A can send its own performance evaluation score and current system resource occupancy rate to the device it is currently connected to.

[0094] S204, the currently connected device calculates an estimated resource occupancy value.

[0095] S205, the currently connected device determines whether the estimated resource occupancy value is greater than 80% of its performance evaluation score, if so, proceed to S206, if not, determine the currently connected device as the target device, and proceed to S210.

[0096] S206, device A disconnects the connection and establishes a connection with the next device.

[0097] S207, device A records the user's operating habits.

[0098] S208, device A generates a sorted list of controls in different interfaces according to the hit probability of each control in each interface.

[0099] S209: Device A generates a rendering task queue according to the sorted list of controls on the current interface, wherein the rendering task of a control with a greater hit probability is placed at the front.

[0100] S210, device A sends rendering tasks to the target device in sequence. Each time a rendering result is returned, the next rendering task is sent. That is, the graphics rendering task corresponding to the next operation that the user may perform in the current interface is sent to the target device for processing in advance.

[0101] S211, device A saves the rendering result returned by the target device locally.

[0102] S212, determine whether the network quality between device A and the target device meets the requirements. If not, proceed to S213. If so, return to S210 to continue sending the rendering task.

[0103] S213: Device A performs local rendering.

[0104] Of course, in addition to rendering tasks, the target device can also assist in data analysis, calculation, decision-making, etc.

[0105] This embodiment provides a method for displaying the interface of a smart home device based on a local area network. The low-performance device can send the predicted rendering tasks that may need to be processed to the target device with sufficient performance in advance for remote rendering according to the user's usage habits, and improve the interactive smoothness and operation stability of the display screen of the low-performance device through the preprocessing mechanism. By evaluating the quality of the network connection in real time, remote rendering and local rendering can be switched in time, so that even if the network is suddenly interrupted, the real-time nature of the next interface change can be guaranteed, reducing the freeze of the display screen.

[0106] Based on the same inventive concept, an embodiment of the present invention further provides an interface display device, which is applied to smart home devices and can be used to implement the interface display method described in the above embodiment. The interface display device can be implemented by software and / or hardware, and the interface display device can generally be integrated into smart home devices.

[0107] Figure 3 is a structural block diagram of an interface display device provided by an embodiment of the present invention, such as Figure 3 As shown, the interface display device includes:

[0108] A detection module 31 is used to detect that the system resource occupancy rate of the device is greater than a preset threshold;

[0109] A determination module 32, configured to determine a target device among smart home devices that can communicate with the current device, wherein the performance evaluation score of the target device is higher than that of the current device and satisfies the remote rendering condition;

[0110] A sending module 33, used to send the rendering task to the target device, wherein the rendering task is predicted according to the user's usage habits;

[0111] A receiving module 34 is used to receive and save the rendering result returned by the target device;

[0112] The display module 35 is used to call the corresponding rendering result to display the interface corresponding to the operation instruction when receiving the operation instruction.

[0113] Optionally, the determination module 32 includes:

[0114] A display unit, used to display the smart home devices that can communicate with the device;

[0115] A first determining unit, configured to determine a candidate device from the smart home devices that can communicate with the device according to a preset rule and establish a communication connection;

[0116] A sending unit, configured to send the performance evaluation score and current system resource occupancy rate of the device to the candidate device, so that the candidate device determines whether it meets the remote rendering condition;

[0117] The second determination unit is used to, if a confirmation message returned by the candidate device is received, use the candidate device as the target device; and if a rejection message returned by the candidate device is received, disconnect the communication connection with the candidate device, re-determine the next candidate device according to the preset rules and establish a communication connection for judgment, and so on, until the target device is determined.

[0118] Optionally, the interface display device further includes:

[0119] The recording module is used to record the number of operations on each control on each interface in real time according to the user's operation behavior during operation;

[0120] An acquisition module, used for acquiring the operation times of each control on the current interface from the recorded information;

[0121] The generation module is used to sort the operations in descending order to generate a rendering task queue, so as to send each rendering task to the target device in sequence, and send the next rendering task after each rendering result is returned.

[0122] Optionally, the interface display device further includes:

[0123] A network detection module, used to detect network quality parameters between the device and the target device in real time while sending the rendering task to the target device;

[0124] A switching module is used to switch to local rendering and stop sending rendering tasks to the target device when the network quality parameters do not meet the requirements.

[0125] Optionally, the interface display device also includes: an information display module, used to display rendering mode marking information in real time, and / or, to display network quality parameters between the present device and the target device in real time, wherein the first marking information corresponds to remote rendering and the second marking information corresponds to local rendering.

[0126] Optionally, the interface display device also includes: an activation module, used to activate the remote rendering function before detecting that the system resource occupancy rate of the device is greater than a preset threshold; accordingly, the remote rendering function of the target device is also in an activated state.

[0127] Optionally, the interface display device further includes:

[0128] A display screen detection module, used to detect that the display screen of the device is unusable after determining the target device among the smart home devices that can communicate with the device;

[0129] A transmission module, used to transmit the interface layout and control information of the display screen of the present device to the target device, so that the target device displays the interface of the present device and receives user operations;

[0130] The control module is used to execute corresponding actions according to the control instructions returned by the target device to continue running.

[0131] Optionally, the interface display device further includes:

[0132] A data receiving module is used to receive the performance evaluation scores and current system resource occupancy rates sent by any other device;

[0133] a calculation module, configured to calculate an estimated resource occupancy value of the device when providing assistance, based on the performance evaluation score and current system resource occupancy rate of the device and the performance evaluation score and current system resource occupancy rate of any device;

[0134] A return module is used to determine that the device meets the remote rendering conditions if the estimated resource occupancy value is less than a preset proportion of the performance evaluation score of the device, and return a confirmation message to the arbitrary device; and if the estimated resource occupancy value is greater than or equal to the preset proportion of the performance evaluation score of the device, determine that the device does not meet the remote rendering conditions, and return a rejection message to the arbitrary device.

[0135] Optionally, the calculation module calculates the estimated resource occupation value R of the device when providing assistance according to the following formula:

[0136] R=the performance evaluation score of the device×the current system resource occupancy rate of the device+the performance evaluation score of any device×the current system resource occupancy rate of any device.

[0137] Optionally, the interface display device further includes:

[0138] An information receiving module, used for receiving the interface layout and control information sent by any device;

[0139] An interface display module, used to display the interface of any device and receive user operations;

[0140] The instruction module is used to return a control instruction to the arbitrary device so that the arbitrary device performs a corresponding action.

[0141] The above interface display device can execute the interface display method provided by the embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method. For technical details not described in detail in this embodiment, please refer to the interface display method provided by the embodiment of the present invention.

[0142] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0143] An embodiment of the present invention further provides a smart home device, comprising: the interface display device described in the above embodiment.

[0144] An embodiment of the present invention further provides a non-volatile computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the interface display method described in the above embodiment is implemented.

[0145] An embodiment of the present invention further provides an electronic device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the interface display method described in the above embodiment when executing the computer program.

[0146] Figure 4 is a schematic diagram of the hardware structure of an electronic device provided by an embodiment of the present invention, such as Figure 4 As shown, the electronic device includes:

[0147] One or more processors 410 and memory 420, Figure 4 A processor 410 is taken as an example.

[0148] The electronic device may further include: an input device 430 and an output device 440 .

[0149] The processor 410, the memory 420, the input device 430 and the output device 440 may be connected via a bus or other means. Figure 4 The example of connecting through bus is taken in the following.

[0150] The memory 420 is a non-volatile computer-readable storage medium that can be used to store non-volatile software programs, non-volatile computer executable programs and modules, such as program instructions / modules corresponding to the interface display method in the embodiment of the present invention. The processor 410 executes various functional applications and data processing by running the non-volatile software programs, instructions and modules stored in the memory 420, that is, implementing the above-mentioned interface display method.

[0151] The memory 420 may include a program storage area and a data storage area, wherein the program storage area may store an application required for operating the device and at least one function; the data storage area may store threshold data, rendering results, etc. In addition, the memory 420 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage devices.

[0152] The input device 430 can receive input digital or character information and generate key signal input related to user settings and function control of the electronic device. The output device 440 can include a display device such as a display screen.

[0153] The one or more modules are stored in the memory 420, and when executed by the one or more processors 410, the above-mentioned interface display method is executed.

[0154] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0155] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. An interface display method, applied to smart home devices, characterized in that: include: It is detected that the system resource usage of this device is greater than the preset threshold; Determine a target device among smart home devices that can communicate with the current device, wherein the performance evaluation score of the target device is higher than that of the current device and satisfies the remote rendering condition; Sending a rendering task to the target device, wherein the rendering task is predicted based on the user's usage habits; Receive and save the rendering result returned by the target device; When an operation instruction is received, the corresponding rendering result is called to display the interface corresponding to the operation instruction.

2. The method according to claim 1, characterized in that: Identify target devices among the smart home devices that this device can communicate with, including: Displaying the smart home devices that can communicate with the device; Determine a candidate device from the smart home devices that can communicate with the device according to a preset rule and establish a communication connection; Sending the performance evaluation score and current system resource occupancy rate of the device to the candidate device, so that the candidate device can determine whether it meets the remote rendering conditions; If a confirmation message returned by the candidate device is received, the candidate device is used as the target device; If a rejection message returned by the candidate device is received, the communication connection with the candidate device is disconnected, and the next candidate device is re-determined according to the preset rule and a communication connection is established for judgment, and so on, until the target device is determined.

3. The method according to claim 1, characterized in that Before sending the rendering task to the target device, the method further includes: During operation, the number of operations on each control on each interface is recorded in real time according to the user's operation behavior; For the current interface, obtaining the operation count of each control on the current interface from the recorded information; The operations are sorted in descending order to generate a rendering task queue, so as to send each rendering task to the target device one by one in sequence, and the next rendering task is sent after each rendering result is returned.

4. The method according to claim 1, characterized in that: When sending the rendering task to the target device, it also includes: Real-time detection of network quality parameters between the device and the target device; When the network quality parameter does not meet the requirement, switch to local rendering and stop sending the rendering task to the target device.

5. The method according to claim 1, characterized in that Also includes: Display rendering mode marking information in real time, and / or display network quality parameters between the present device and the target device in real time, wherein the first marking information corresponds to remote rendering and the second marking information corresponds to local rendering.

6. The method according to claim 1, characterized in that Before detecting that the system resource occupancy rate of the device is greater than a preset threshold, it also includes: turning on the remote rendering function; correspondingly, the remote rendering function of the target device is also in the turned-on state.

7. The method according to claim 1, characterized in that After determining the target device among the smart home devices that can communicate with this device, it also includes: It is detected that the display screen of this device is unusable; Transmitting the interface layout and control information of the display screen of the present device to the target device, so that the target device displays the interface of the present device and receives user operations; Execute corresponding actions according to the control instruction returned by the target device to continue running.

8. The method according to any one of claims 1 to 7, characterized in that Also includes: Receive performance evaluation scores and current system resource usage from any other device; Calculate the estimated resource occupancy value of the device when providing assistance according to the performance evaluation score and current system resource occupancy rate of the device and the performance evaluation score and current system resource occupancy rate of any device; If the estimated resource usage value is less than a preset ratio of the performance evaluation score of the device, it is determined that the device meets the remote rendering condition, and a confirmation message is returned to the arbitrary device; If the estimated resource occupancy value is greater than or equal to a preset proportion of the performance evaluation score of the device, it is determined that the device does not meet the remote rendering conditions, and a rejection message is returned to the arbitrary device.

9. The method according to claim 8, characterized in that The estimated resource occupancy value R of the device when providing assistance is calculated according to the following formula: R=the performance evaluation score of the device×the current system resource occupancy rate of the device+the performance evaluation score of any device×the current system resource occupancy rate of any device.

10. The method according to claim 8, characterized in that Also includes: Receiving interface layout and control information sent by any device; Display the interface of any device and receive user operations; Return a control instruction to the arbitrary device so that the arbitrary device performs a corresponding action.

11. An interface display device, applied to smart home equipment, characterized in that: include: A detection module, used to detect that the system resource usage of the device is greater than a preset threshold; A determination module, configured to determine a target device among smart home devices that can communicate with the current device, wherein the performance evaluation score of the target device is higher than that of the current device and satisfies the remote rendering condition; A sending module, used to send a rendering task to the target device, wherein the rendering task is predicted according to the user's usage habits; A receiving module, used for receiving and saving the rendering result returned by the target device; The display module is used to call the corresponding rendering result to display the interface corresponding to the operation instruction when an operation instruction is received.

12. A smart home device, characterized in that: include: The interface display device as claimed in claim 11.

13. An electronic device, comprising: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the interface display method according to any one of claims 1 to 10 when executing the computer program.

14. A non-volatile computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the interface display method according to any one of claims 1 to 10 is implemented.

Images