Equipment monitoring method and device based on intelligent home appliances

Abstract

The present invention discloses a device monitoring method and apparatus based on smart home appliances, the method comprising: when a user is detected approaching a smart home appliance, the smart home appliance obtains the status information of each target smart home appliance in at least one predetermined target smart home appliance; the smart home appliance outputs the status information of each target smart home appliance to the user; wherein the status information of each target smart home appliance includes the real-time status information of each target smart home appliance and / or the historical status information of each target smart home appliance. It can be seen that the present invention can output the status information of the corresponding smart home appliance to the user when the user approaches the smart home appliance, so that the user can obtain the status information of the smart home appliance in time, which is conducive to improving the user's efficiency in obtaining the status information of the smart home appliance, enriching the functions of the smart home appliance, and further conducive to improving the user's experience.

Description

Technical Field

[0001] The present invention relates to the technical field of smart home appliances, and in particular to a device monitoring method and apparatus based on smart home appliances. Background Art

[0002] With the rapid development of electronic technology, more and more home appliances are moving towards intelligence. Based on the advantages of convenient and fast operation, saving time and effort, the application of smart home appliances in life scenarios is becoming more and more popular and more and more important.

[0003] In actual applications, users usually monitor and control smart home appliances through corresponding APPs or mini-programs, and when smart home appliances are abnormal or their status changes, the corresponding status information will be pushed to the corresponding APPs or mini-programs in the user terminal so that users can know. However, since users do not often check their phones, this will cause users to miss the status information of smart home appliances (such as abnormal status, current working status, etc.), reducing the efficiency of users in obtaining status information. Summary of the invention

[0004] The present invention provides a device monitoring method and device based on smart home appliances, which can output status information of a target smart home appliance to a user when the user approaches the smart home appliance, so that the user can obtain the status information of the smart home appliance in a timely manner, which is beneficial to improving the user's efficiency in obtaining the status information of the smart home appliance.

[0005] In order to solve the above technical problems, the first aspect of the present invention discloses a device monitoring method based on a smart home appliance, the method comprising:

[0006] When it is detected that a user is approaching the smart home appliance, the smart home appliance acquires status information of each of at least one predetermined target smart home appliance;

[0007] The smart home appliance device outputs the status information of each of the target smart home appliances to the user;

[0008] The status information of each of the target smart home appliances includes the real-time status information of each of the target smart home appliances and / or the historical status information of each of the target smart home appliances.

[0009] As an optional implementation, in the first aspect of the present invention, after detecting that the user is approaching the smart home appliance, before the smart home appliance acquires the status information of each of the at least one predetermined target smart home appliance, the method further includes:

[0010] The smart home appliance determines at least one target smart home appliance according to the target information;

[0011] The smart home appliance determines at least one target smart home appliance according to the target information, including:

[0012] The smart home appliance acquires at least one target smart home appliance having a monitoring binding relationship with the smart home appliance according to a pre-established monitoring binding relationship; or,

[0013] The smart home appliance determines, based on the collected attribute information of the user close to the smart home appliance, at least one target smart home appliance that matches the attribute information; or,

[0014] The smart home appliance selects at least one target smart home appliance that matches the functional attribute of the smart home appliance from the determined smart home appliance set according to the functional attribute of the smart home appliance.

[0015] As an optional embodiment, in the first aspect of the present invention, the method further comprises:

[0016] The smart home appliance detects a control operation triggered by a user on a certain smart home appliance among all the target smart home appliances, and generates a control instruction according to the control operation;

[0017] The smart home appliance sends the control instruction to the certain smart home appliance, so that the certain smart home appliance performs an operation matching the control instruction; or,

[0018] The smart home appliance sends the control instruction to the control server, so that the control server sends the control instruction to the smart home appliance.

[0019] As an optional implementation, in the first aspect of the present invention, after detecting that the user is approaching the smart home appliance, before the smart home appliance acquires the status information of each of the at least one predetermined target smart home appliance, the method further includes:

[0020] The smart home appliance collects a moving direction of a user approaching the smart home appliance, and decomposes the moving direction in a pre-established coordinate system to obtain a subcomponent of the moving direction in a direction perpendicular to the smart home appliance on a horizontal plane;

[0021] The smart home appliance determines whether the subcomponent is empty, and when it is determined that the subcomponent is not empty, performs the operation of acquiring the status information of each of the at least one predetermined target smart home appliance.

[0022] As an optional implementation manner, in the first aspect of the present invention, after determining that the subcomponent is not empty, the method further includes:

[0023] The smart home appliance determines whether an acute angle between the motion direction and a direction on the horizontal plane and parallel to the smart home appliance is greater than or equal to a predetermined angle threshold;

[0024] When it is determined that the acute angle is greater than or equal to the angle threshold, the operation of acquiring the status information of each of the at least one predetermined target smart home appliance is performed.

[0025] As an optional implementation manner, in the first aspect of the present invention, before the smart home appliance outputs the status information of each of the target smart home appliances to the user, the method further includes:

[0026] The smart home appliance collects a facial image of a user approaching the smart home appliance, and analyzes the viewing direction of the user's eyes according to the facial image;

[0027] The smart home appliance determines whether the eye viewing direction is toward the smart home appliance, and when it is determined that the eye viewing direction is toward the smart home appliance, performs the operation of outputting the status information of each target smart home appliance to the user;

[0028] The smart home appliance outputs the status information of each target smart home appliance to the user, including:

[0029] The smart home appliance controls its display screen to display the status information of each target smart home appliance to the user.

[0030] As an optional implementation, in the first aspect of the present invention, the status information of each of the target smart home appliances is collected by the smart home appliances; or, the status information of each of the target smart home appliances is collected by the control server and then pushed to the smart home appliances.

[0031] A second aspect of the present invention discloses a device monitoring apparatus based on a smart home appliance, the device being applied to the smart home appliance, the device comprising:

[0032] A detection module, used to detect whether a user is close to the smart home appliance;

[0033] an acquisition module, configured to acquire status information of each of at least one predetermined target smart home appliance when the detection module detects that a user is approaching the smart home appliance;

[0034] An output module, used to output the status information of each target smart home appliance to the user;

[0035] The status information of each of the target smart home appliances includes the real-time status information of each of the target smart home appliances and / or the historical status information of each of the target smart home appliances.

[0036] As an optional implementation, in the second aspect of the present invention, the device further includes:

[0037] a determination module, configured to determine at least one target smart home appliance according to the target information after the detection module detects that the user is approaching the smart home appliance and before the acquisition module acquires the status information of each of the at least one target smart home appliance determined in advance;

[0038] The specific method in which the determination module determines at least one target smart home appliance according to the target information is:

[0039] According to the pre-established monitoring binding relationship, obtaining at least one target smart home appliance device that has a monitoring binding relationship with the smart home appliance device; or,

[0040] Determine at least one target smart home appliance that matches the attribute information according to the collected attribute information of the user close to the smart home appliance; or

[0041] According to the functional attributes of the smart home appliance, at least one target smart home appliance matching the functional attributes of the smart home appliance is screened from the determined smart home appliance set.

[0042] As an optional implementation, in the second aspect of the present invention, the detection module is further used to detect a control operation triggered by a user on a certain smart home appliance among all the target smart home appliances;

[0043] And, the device further comprises:

[0044] A generating module, used for generating a control instruction according to the control operation;

[0045] A processing module is used to send the control instruction to the certain smart home appliance device so that the certain smart home appliance device performs an operation matching the control instruction; or, send the control instruction to a control server so that the control server sends the control instruction to the certain smart home appliance device.

[0046] As an optional implementation, in the second aspect of the present invention, the device further includes:

[0047] A first collection module, configured to collect a moving direction of a user approaching the smart home appliance after the detection module detects that the user is approaching the smart home appliance;

[0048] A decomposition module, used for decomposing the moving direction in a pre-established coordinate system to obtain a sub-component of the moving direction in a direction perpendicular to the smart home appliance device on a horizontal plane;

[0049] The judging module is used to judge whether the sub-component is empty. When it is judged that the sub-component is not empty, the obtaining module is triggered to execute the operation of obtaining the status information of each of the at least one predetermined target smart home appliance.

[0050] As an optional embodiment, in the second aspect of the present invention, the judgment module is also used to judge whether the acute angle between the movement direction and the direction on the horizontal plane and parallel to the smart home appliance is greater than or equal to a predetermined angle threshold after judging that the sub-component is not empty; when it is judged that the acute angle is greater than or equal to the angle threshold, trigger the acquisition module to execute the operation of acquiring the status information of each of the at least one predetermined target smart home appliance.

[0051] As an optional implementation, in the second aspect of the present invention, the device further includes:

[0052] A second acquisition module, used to acquire a face image of a user approaching the smart home appliance;

[0053] An image analysis module, used for analyzing the user's eye viewing direction based on the face image;

[0054] a direction determination module, configured to determine whether the eye viewing direction is toward the smart home appliance, and trigger the output module to execute the operation of outputting the status information of each target smart home appliance to the user when it is determined that the eye viewing direction is toward the smart home appliance;

[0055] The specific manner in which the output module outputs the status information of each target smart home appliance to the user is as follows:

[0056] Control its display screen to display the status information of each target smart home appliance device to the user.

[0057] As an optional implementation, in the second aspect of the present invention, the status information of each of the target smart home appliances is collected by the smart home appliances; or, the status information of each of the target smart home appliances is collected by the control server and then pushed to the smart home appliances.

[0058] The third aspect of the present invention discloses another device monitoring apparatus based on a smart home appliance, the device is applied to the smart home appliance, and the device comprises:

[0059] A memory storing executable program code;

[0060] a processor coupled to the memory;

[0061] The processor calls the executable program code stored in the memory to execute part or all of the steps in any one of the device monitoring methods based on smart home appliances disclosed in the first aspect of the present invention.

[0062] The fourth aspect of the present invention discloses a computer storage medium, which stores computer instructions. When the computer instructions are called, they are used to execute part or all of the steps in any device monitoring method based on smart home appliances disclosed in the first aspect of the present invention.

[0063] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:

[0064] In an embodiment of the present invention, when it is detected that a user is approaching a smart home appliance, the smart home appliance obtains the status information of each target smart home appliance among at least one predetermined target smart home appliance; the smart home appliance outputs the status information of each target smart home appliance to the user; wherein the status information of each target smart home appliance includes the real-time status information of each target smart home appliance and / or the historical status information of each target smart home appliance. It can be seen that the present invention can output the status information of the corresponding smart home appliance to the user when the user is approaching the smart home appliance, so that the user can obtain the status information of the smart home appliance in time, which is conducive to improving the user's efficiency in obtaining the status information of the smart home appliance, enriching the functions of the smart home appliance, and further conducive to improving the user's experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0065] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0066] Figure 1 is a schematic diagram of an application scenario disclosed in an embodiment of the present invention;

[0067] Figure 2 It is a flow chart of a device monitoring method based on smart home appliances disclosed in an embodiment of the present invention;

[0068] Figure 3 It is a flow chart of another device monitoring method based on smart home appliances disclosed in an embodiment of the present invention;

[0069] Figure 4 It is a structural schematic diagram of a device monitoring apparatus based on a smart home appliance disclosed in an embodiment of the present invention;

[0070] Figure 5 It is a structural schematic diagram of another device monitoring device based on smart home appliances disclosed in an embodiment of the present invention;

[0071] Figure 6 It is a structural schematic diagram of another device monitoring device based on smart home appliances disclosed in an embodiment of the present invention;

[0072] Figure 7 It is a structural schematic diagram of a smart home appliance disclosed in an embodiment of the present invention. DETAILED DESCRIPTION

[0073] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0074] The terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish different objects rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, device, product or end including a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units that are not listed, or may optionally include other steps or units inherent to these processes, methods, products or ends.

[0075] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present invention. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0076] The present invention discloses a device monitoring method and apparatus based on smart home appliances, which can output the status information of the corresponding smart home appliances to the user when the user approaches the smart home appliances, so that the user can obtain the status information of the smart home appliances in time, which is conducive to improving the user's acquisition efficiency of the status information of the smart home appliances, enriching the functions of the smart home appliances, and further conducive to improving the user's use experience. The following are detailed descriptions.

[0077] In order to better understand the device monitoring method and apparatus based on smart home appliances disclosed in the present invention, the application scenarios to which the device monitoring method based on smart home appliances described in the present invention is applicable are first described. Among them, the application scenario may include multiple smart home appliances, wherein one or more smart home appliances can be used as centralized control devices for the remaining smart home appliances. When there is only one smart home appliance as a centralized control device, the smart home appliance can monitor and control some or all of the remaining smart home appliances; when two or more smart home appliances are used as centralized control devices, each centralized control device can monitor and control the corresponding smart home appliances respectively. Furthermore, the smart home appliances monitored and controlled by different centralized control devices may be completely different, or there may be partial overlap. Furthermore, when a smart home appliance device acts as a centralized control device to monitor and control multiple smart home appliances, it can specifically monitor and control multiple smart home appliances through a corresponding control server (such as a cloud server), that is: the smart home appliance device can report its own status information to the control server, and the control server pushes the status information of the smart home appliance device to the smart home appliance device acting as a centralized control device, and the smart home appliance device acting as a centralized control device outputs the status information of the smart home appliance device it monitors for the user to know, and when the smart home appliance device acting as a centralized control device detects a control operation on the smart home appliance device it monitors, it generates a corresponding control instruction and sends the control instruction to the control server, and the control server controls the corresponding smart home appliance device to perform a matching operation according to the control instruction, or directly sends the control instruction to the corresponding smart home appliance device to enable the corresponding smart home appliance device to perform a matching operation.

[0078] Optionally, the application scenario of taking the smart refrigerator as an example of a smart home appliance as a centralized control device can be as follows Figure 1 As shown, that is, the smart refrigerator can monitor and control other smart home appliances (smart home appliances 1-n) through the cloud server, and other smart home appliances can report their own status information to the cloud server, which will then push the status information to the smart refrigerator. When the smart refrigerator detects that a user is approaching, the smart refrigerator displays the status information of other smart home appliances to the user through its display screen; when the smart refrigerator detects a control operation triggered by the user, the smart refrigerator generates a control instruction and sends it to the cloud server, which controls the corresponding smart home appliance to perform the matching operation.

[0079] The device monitoring method and apparatus based on smart home appliances described in the present invention are described in detail below.

[0080] Embodiment 1 (method side embodiment)

[0081] See also Figure 2 , Figure 2 1 is a flow chart of a device monitoring method based on smart home appliances disclosed in an embodiment of the present invention. Figure 2 The described method can be applied to smart home appliances. Figure 2 As shown, the device monitoring method based on smart home appliances may include the following operations:

[0082] 101. When it is detected that a user is approaching a smart home appliance, the smart home appliance obtains status information of each target smart home appliance among at least one predetermined target smart home appliance.

[0083] In the embodiment of the present invention, the status information of each target smart home appliance includes the real-time status information of each target smart home appliance and / or the historical status information of each target smart home appliance, and the real-time status information and the historical status information of the target smart home appliance can be abnormal status information, normal working status information, or status switching information, which is not limited in the embodiment of the present invention. Further, optionally, the status information of the target smart home appliance can be collected by the smart home appliance, or can be collected by the control server and then pushed to the smart home appliance, which is not limited in the embodiment of the present invention.

[0084] Further optionally, when the status information of the target smart home appliance device includes its historical status information, the smart home appliance device acquiring the status information of the target smart home appliance device may include:

[0085] The smart home appliance obtains the status information of the target smart home appliance from all the status information pre-stored / cached. Optionally, all the status information pre-stored / cached by the smart home appliance may be pre-pushed to the smart home appliance by the control server, which is conducive to improving the efficiency of the smart home appliance in obtaining the status information of the target smart home appliance; or

[0086] The smart home appliance obtains the status information of the target smart home appliance from the control server side. The way of storing the status information of the target smart home appliance in the control server can reduce the memory of the smart home appliance occupied by the status information of the target smart home appliance.

[0087] Further optionally, when the status information of the target smart home appliance device includes its real-time status information, the smart home appliance device obtains the status information of the target smart home appliance device, including:

[0088] The smart home appliance obtains the status information of the target smart home appliance from the target smart home appliance; or,

[0089] The smart home appliance device obtains the status information of the target smart home appliance device collected by the control server from the control server.

[0090] It can be seen that the embodiments of the present invention provide a variety of status information acquisition methods, which is conducive to smart home appliances to select appropriate status information acquisition methods according to actual conditions, and further conducive to expanding the application scenarios of the method described in the embodiments of the present invention and improving its universal applicability.

[0091] It should be noted that all the determined target smart home appliances may include at least one smart home appliance that can be monitored by the above-mentioned smart home appliance, and may also include the above-mentioned smart home appliance itself, that is, when detecting the approach of a user, the smart home appliance may output the status information of other smart home appliances, or may output its own status information separately or together. And for different target smart home appliances, the corresponding status information may be the same type of status information, or may be different types of status information, for example, for target smart home appliance A, the smart home appliance may output the real-time status information of target smart home appliance A, for target smart home appliance B, the smart home appliance may output the real-time status information of target smart home appliance B, or may output the historical status information of target smart home appliance B, which is not limited in the embodiment of the present invention. Further, for a single target smart home appliance, the type of the output status information may be determined according to the type of status information collected for the target smart home appliance, or may be determined according to the device type of the target smart home appliance, or may be determined according to the user approaching the smart home appliance, which is not limited in the embodiment of the present invention.

[0092] 102. The smart home appliance outputs status information of each target smart home appliance to the user.

[0093] As an optional implementation manner, the smart home appliance outputs the status information of each target smart home appliance to the user, which may include:

[0094] The smart home appliance outputs the status information of each target smart home appliance in an output mode that matches each target smart home appliance.

[0095] In this optional implementation, each target smart home appliance has a status information output method that matches it. Outputting the status information of the target smart home appliance through the output method that matches the target smart home appliance not only enables personalized output of the status information, but also enables the user to directly determine the target smart home appliance to which the status information belongs based on the output method when the relevant identification of the target smart home appliance is not output.

[0096] As another optional implementation, the smart home appliance outputs the status information of each target smart home appliance to the user, which may include:

[0097] The smart home appliance outputs the status information of each target smart home appliance in an output manner that matches the status information of each smart home appliance.

[0098] In this optional implementation, different types of status information may correspond to different output methods. The type of status information may be divided according to whether the status information is real-time status information, specifically divided into real-time type and historical type. Alternatively, the type of status information may be divided according to whether the status information is abnormal information, specifically divided into abnormal type and non-abnormal type. This not only enables personalized output of status information, but also enables users to obtain the type of status information in a timely manner according to the output method of the status information, thereby facilitating users to timely and accurately control the target smart home appliances.

[0099] As another optional implementation manner, the smart home appliance outputs the status information of each target smart home appliance to the user, which may include:

[0100] The smart home appliance outputs the status information of each target smart home appliance in an output manner that matches a user approaching the smart home appliance.

[0101] In this optional implementation, the output method that matches the user close to the smart home appliance device can be understood as an output method that matches the attribute information of the user close to the smart home appliance device. The user's attribute information may include one or more combinations of the user's age, the user's gender, the user's role in the family, and the user's audio-visual health status, etc. This not only enables personalized output of status information, but also enables interesting output of status information, which is beneficial for users to quickly and accurately obtain status information of target smart home appliances.

[0102] As another optional implementation manner, the smart home appliance outputs the status information of each target smart home appliance to the user, which may include:

[0103] The smart home appliance outputs the status information of each target smart home appliance in an output manner that matches each target smart home appliance, the status information of each target smart home appliance, and a user close to the smart home appliance.

[0104] Specifically, each target smart home appliance, each target smart home appliance status information, and a user close to the smart home appliance have a corresponding priority, and the smart home appliance determines an output mode that matches each target smart home appliance, each target smart home appliance status information, and a user close to the smart home appliance, which may include:

[0105] For any target smart home appliance, the smart home appliance first determines the output mode set that matches the high-priority target information, and further determines the output mode set that matches the adjacent low-priority target information from the output mode set that matches the high-priority target information, and so on, until the output mode set that matches the target information with the lowest priority is obtained; when the output mode set that matches the target information with the lowest priority includes one output mode, the output mode is determined as the matching output mode; when the output mode set that matches the target information with the lowest priority includes two or more output modes, the smart home appliance determines the output mode with the highest feedback rate as the output mode of the status information of the target smart home appliance based on the statistical feedback rate of users for each output mode.

[0106] It can be seen that this optional implementation can intelligently determine the matching output mode through the combination of two or more target information and output the status information of the target smart home appliance device based on the determined output mode. While realizing the personalized output of the status information, it is beneficial to increase the probability of the output status information being perceived, and thus helps to improve the user's efficiency in handling abnormal conditions.

[0107] It can be seen that the method described in the embodiment of the present invention can be implemented so that the smart home appliance can output the status information of the corresponding smart home appliance to the user when the user is close to the smart home appliance, so that the user can obtain the status information of the smart home appliance in time, which is conducive to improving the user's efficiency in obtaining the status information of the smart home appliance, enriching the functions of the smart home appliance, and thus helping to improve the user's experience. In addition, when the status information of the target smart home appliance is output through the smart home appliance, it can be output through a matching output method, realizing the personalized output of the status information of the target smart home appliance by the smart home appliance, which is not only conducive to the interesting output of the status information, but also can improve the user's cognitive efficiency of the status information. In addition, by using the smart home appliance as a centralized control device to monitor and control multiple other smart home appliances, there is no need for the user to download the corresponding APP or register the corresponding applets for different smart home appliances, which improves the convenience of monitoring and controlling the smart home appliances.

[0108] In an optional embodiment, after detecting that the user is approaching the smart home appliance and before acquiring the status information of each target smart home appliance in at least one predetermined target smart home appliance, the method may further include the following operations:

[0109] The smart home appliance determines at least one target smart home appliance according to the target information.

[0110] Further optionally, the smart home appliance determines at least one target smart home appliance according to the target information, which may include:

[0111] The smart home appliance obtains at least one target smart home appliance having a monitoring binding relationship with the smart home appliance according to the pre-established monitoring binding relationship; or,

[0112] The smart home appliance determines at least one target smart home appliance that matches the attribute information based on the collected attribute information of the user close to the smart home appliance. Optionally, the attribute information of the user may include one or more combinations of the user's age, the user's gender, the user's role in the family, and the user's audiovisual health status; or,

[0113] The smart home appliance selects at least one target smart home appliance that matches the functional attribute of the smart home appliance from the determined smart home appliance set according to the functional attribute of the smart home appliance.

[0114] Taking determining the target smart home appliances based on the attribute information of the user who is close to the smart home appliances as an example, if the user's attribute information includes the user's role in the family - child, the matching target smart home appliances may include all the smart home appliances in the child's room, or all the smart home appliances that the child has permission to use.

[0115] Taking determining the target smart home appliances according to the functional attributes of the smart home appliances as an example, if the functional attributes of the smart home appliances indicate that they have refrigeration and freezing functions, the matching target smart home appliances may include one or more combinations of range hoods, water purifiers, microwave ovens, induction cookers, etc.

[0116] It can be seen that this optional embodiment can provide a method for determining multiple target smart home appliances while realizing centralized monitoring of other smart home appliances based on smart home appliances, further enriching the intelligent functions of smart home appliances, and can also expand the application scenarios of the method described in the embodiment of the present invention, which is conducive to improving the universal applicability of the method described in the embodiment of the present invention.

[0117] In another optional embodiment, after detecting that the user is approaching the smart home appliance and before acquiring the status information of each target smart home appliance in at least one predetermined target smart home appliance, the method may further include the following operations:

[0118] The smart home appliance collects the moving direction of the user approaching the smart home appliance, and decomposes the moving direction in a pre-established coordinate system to obtain a sub-component of the moving direction in a direction perpendicular to the smart home appliance on a horizontal plane;

[0119] The smart home appliance determines whether the subcomponent is empty. When it is determined that the subcomponent is not empty, the above-mentioned operation of acquiring the status information of each target smart home appliance in at least one predetermined target smart home appliance is performed.

[0120] The pre-established coordinate system is established on a horizontal plane with the direction perpendicular to the smart home appliance and the direction parallel to the smart home appliance as two coordinate axes. In practical applications, perpendicular to the smart home appliance can be understood as perpendicular to a surface of the smart home appliance, and parallel to the smart home appliance can be understood as parallel to the surface of the smart home appliance. It should be noted that for household smart home appliances, the surface facing the user can be determined as a vertical or parallel reference plane, and in some cases, the smart home appliance can determine the reference plane as follows:

[0121] The smart home appliance determines a reference plane according to a moving direction of a user approaching the smart home appliance, so as to improve the accuracy of a coordinate system constructed before decomposing the moving direction.

[0122] For example, when a user passes in front of a smart home appliance, the smart home appliance can also detect the process of the user approaching the smart home appliance. The smart home appliance can intelligently predict the user's movement trend based on the sub-component of the user's movement direction in the horizontal plane perpendicular to the smart home appliance. If the sub-component is empty, it is determined that the user's approach to the smart home appliance is only an accidental and short process, and no subsequent operations are required.

[0123] It can be seen that this optional embodiment can also intelligently determine the way in which the user approaches the smart home appliance based on the sub-component of the moving direction on a certain axis in the coordinate system when detecting that the user is approaching the smart home appliance. If the sub-component is not empty, subsequent operations are performed; if the sub-component is empty, there is no need to perform subsequent operations. This is beneficial to improving the accuracy and reliability of smart home appliances in detecting user approach operations, reducing the situation where smart home appliances perform unnecessary operations, and is beneficial to improving the reliability of smart home appliances in monitoring other smart home appliances. It can also reduce the power consumption of smart home appliances.

[0124] In this optional embodiment, further optionally, after determining that the subcomponent is not empty, the method further includes:

[0125] The smart home appliance determines whether the acute angle between the motion direction and the direction on the horizontal plane and parallel to the smart home appliance is greater than or equal to a predetermined angle threshold;

[0126] When it is determined that the acute angle is greater than or equal to the angle threshold, the smart home appliance performs the above-mentioned operation of acquiring the status information of each target smart home appliance in at least one predetermined target smart home appliance.

[0127] It can be seen that this optional embodiment can also, when it is determined that the sub-component is not empty, further predict the probability that the user is actually approaching the smart home appliance by the size of the acute angle between the moving direction and the direction on the horizontal plane and parallel to the smart home appliance. If the acute angle is larger, the predicted probability that the user is actually approaching the smart home appliance is larger; if the acute angle is smaller, the predicted probability that the user is actually approaching the smart home appliance is smaller, which is beneficial to further improve the accuracy and reliability of smart home appliances in detecting user approach operations.

[0128] In yet another optional embodiment, before the smart home appliance outputs the status information of each target smart home appliance to the user, the method further includes:

[0129] The smart home appliance collects a facial image of a user approaching the smart home appliance, and analyzes the user's eye viewing direction based on the facial image. Optionally, the collected facial image may include one or more facial images, preferably multiple images, to improve the accuracy of the analyzed eye viewing direction.

[0130] The smart home appliance determines whether the eye viewing direction is toward the smart home appliance. When it is determined that the eye viewing direction is toward the smart home appliance, the above-mentioned operation of outputting the status information of each target smart home appliance to the user is performed.

[0131] Optionally, the smart home appliance outputs status information of each target smart home appliance to the user, including:

[0132] The smart home appliance device controls its display screen to display the status information of each target smart home appliance device to the user.

[0133] Furthermore, the display method of the smart home appliance controlling its display screen to display the status information of each target smart home appliance to the user can refer to the relevant description in step 102, and will not be repeated in this embodiment of the present invention.

[0134] It can be seen that this optional embodiment can also determine the user's eye viewing direction by performing intelligent analysis on the facial image. When the user's eye viewing direction is toward the smart home appliance, the acquired status information of each target smart home appliance is displayed, thereby increasing the probability of the displayed status information being viewed by the user, and thereby helping to improve the reliability and effectiveness of smart home appliances displaying the status information of other smart home appliances.

[0135] In yet another optional embodiment, the method may further include the following operations:

[0136] The smart home appliance detects a control operation triggered by a user on a certain smart home appliance among all target smart home appliances, and generates a control instruction according to the control operation;

[0137] The smart home appliance sends the control instruction to a certain smart home appliance, so that the certain smart home appliance performs an operation matching the control instruction; or,

[0138] The smart home appliance sends the control instruction to the control server, so that the control server sends the control instruction to a smart home appliance.

[0139] It can be seen that this optional embodiment can also realize intelligent control of other smart home appliances by smart home appliances while outputting status information of other smart home appliances through smart home appliances, further enriching the intelligent functions of smart home appliances, and helping to further improve the user experience of smart home appliances.

[0140] Embodiment 2 (method side embodiment)

[0141] See also Figure 3 , Figure 3 is a flow chart of another device monitoring method based on smart home appliances disclosed in an embodiment of the present invention. Figure 3 The described method is specifically described by taking the example of a smart refrigerator monitoring multiple smart home appliances through a cloud server. Figure 3 As shown, the method may include the following operations:

[0142] 201. When the status of the smart home appliance device changes, the smart home appliance device reports the status information of the smart home appliance device to the cloud server.

[0143] 202. The cloud server receives status information reported by the smart home appliance.

[0144] 203. The cloud server pushes status information of the smart home appliance to the smart refrigerator.

[0145] 204. The smart refrigerator receives the status information of the smart home appliance pushed by the cloud server and caches the status information of the smart home appliance.

[0146] 205. The smart refrigerator detects whether a user is approaching. When the detection result is no, the process can be ended. When the detection result is yes, step 206 can be triggered.

[0147] 206. The smart refrigerator displays the cached status information of the smart home appliances.

[0148] Furthermore, the method may also include the following operations:

[0149] Smart refrigerator detects the user's control operation on a smart home appliance;

[0150] The smart refrigerator generates a control instruction based on the control operation, and sends the generated control instruction to the cloud server, which controls the corresponding smart home appliance to perform the corresponding operation according to the control instruction; or, sends the generated control instruction directly to the corresponding smart home appliance to enable the corresponding smart home appliance to perform the corresponding operation.

[0151] It should be noted that the steps performed by the smart refrigerator can be used as a separate embodiment.

[0152] It can be seen that the method described in the embodiment of the present invention can report the status information of the smart home appliance to the cloud server in time when the status of the smart home appliance changes, and the cloud server pushes the status information of the smart home appliance to the smart refrigerator. When the smart refrigerator detects the presence of a user, the status information of the smart home appliance is displayed on the display screen of the smart refrigerator, enriching the intelligent functions of the smart refrigerator, which can not only improve the display efficiency of the status information of the smart home appliance, but also facilitate users to obtain the status information of the smart home appliance in time, which is conducive to improving the efficiency of users to obtain the status information of the smart home appliance. In addition, the smart refrigerator can also control other smart home appliances, further enriching the intelligent functions of the smart refrigerator, and thus helping to improve the user experience of the smart refrigerator.

[0153] Embodiment 3 (device side embodiment)

[0154] See also Figure 4 , Figure 4 Schematic diagram of a device monitoring device based on smart home appliances disclosed in an embodiment of the present invention. Figure 4 The described device can be applied to smart home appliances. Figure 4 As shown, the device may include:

[0155] The detection module 301 is used to detect whether a user is close to the smart home appliance.

[0156] The acquisition module 302 is used to acquire the status information of each target smart home appliance in at least one predetermined target smart home appliance when the detection module 301 detects that a user is approaching the smart home appliance.

[0157] The output module 303 is used to output the status information of each target smart home appliance to the user.

[0158] The status information of each target smart home appliance includes real-time status information of each target smart home appliance and / or historical status information of each target smart home appliance.

[0159] It can be seen that implementation Figure 4 The described device can enable the smart home appliance to output status information of the corresponding smart home appliance to the user when the user approaches the smart home appliance, so that the user can obtain the status information of the smart home appliance in a timely manner, which is beneficial to improving the user's efficiency in obtaining the status information of the smart home appliance, enriching the functions of the smart home appliance, and further beneficial to improving the user's usage experience.

[0160] In an optional embodiment, if Figure 5 As shown, the device may also include:

[0161] The determination module 304 is used to determine at least one target smart home appliance according to the target information after the detection module 301 detects that the user is approaching the smart home appliance and before the acquisition module 301 acquires the status information of each target smart home appliance in at least one predetermined target smart home appliance.

[0162] Further optionally, the determining module 304 determines at least one target smart home appliance according to the target information, which may include:

[0163] According to the pre-established monitoring binding relationship, obtaining at least one target smart home appliance device that has a monitoring binding relationship with the smart home appliance device; or,

[0164] Determine at least one target smart home appliance that matches the attribute information based on the collected attribute information of the user close to the smart home appliance; or

[0165] According to the functional attributes of the smart home appliance, at least one target smart home appliance matching the functional attributes of the smart home appliance is selected from the determined set of smart home appliances; or,

[0166] At least one target smart home appliance is determined based on at least two of the following information: a pre-established monitoring binding relationship, collected attribute information of a user close to the smart home appliance, and functional attributes of the smart home appliance.

[0167] It can be seen that implementation Figure 5 The described device can also provide a method for determining multiple target smart home appliances while realizing centralized monitoring of other smart home appliances based on smart home appliances, further enriching the intelligent functions of smart home appliances, and expanding the application scenarios of smart home appliances, which is conducive to improving the universal applicability of smart home appliances.

[0168] In another optional embodiment, the detection module 301 is further used to detect a control operation triggered by a user on a certain smart home appliance among all target smart home appliances. Figure 4 As shown, the device may also include:

[0169] The generating module 305 is used to generate a control instruction according to the control operation.

[0170] The processing module 306 is used to send the control instruction to a smart home appliance so that the smart home appliance performs an operation matching the control instruction; or send the control instruction to the control server so that the control server sends the control instruction to the smart home appliance.

[0171] It can be seen that implementation Figure 5 The described device can also realize intelligent control of other smart home appliances by smart home appliances while outputting status information of other smart home appliances through smart home appliances, further enriching the intelligent functions of smart home appliances and helping to further improve the user experience of smart home appliances.

[0172] In yet another optional embodiment, Figure 5 As shown, the device may also include:

[0173] The first collection module 307 is used to collect the moving direction of the user approaching the smart home appliance after the detection module 301 detects that the user is approaching the smart home appliance.

[0174] The decomposition module 308 is used to decompose the moving direction in a pre-established coordinate system to obtain sub-components of the moving direction in a direction perpendicular to the smart home appliance on a horizontal plane.

[0175] The judging module 309 is used to judge whether the subcomponent is empty. When it is judged that the subcomponent is not empty, the obtaining module 302 is triggered to execute the above-mentioned operation of obtaining the status information of each target smart home appliance in at least one predetermined target smart home appliance.

[0176] In this optional embodiment, further optionally, the judgment module 309 can also be used to judge whether the acute angle between the movement direction and the direction on the horizontal plane and parallel to the smart home appliance is greater than or equal to a predetermined angle threshold after judging that the above-mentioned sub-component is not empty; when it is judged that the acute angle is greater than or equal to the angle threshold, the acquisition module 302 is triggered to perform the above-mentioned operation of obtaining the status information of each target smart home appliance in at least one predetermined target smart home appliance.

[0177] It can be seen that implementation Figure 5The described device can also intelligently determine the way in which the user approaches the smart home appliance according to the subcomponent of the moving direction on a certain axis in the coordinate system when detecting that the user is approaching the smart home appliance. If the subcomponent is not empty, the corresponding module performs the subsequent operation. If the subcomponent is empty, the corresponding module does not need to perform the subsequent operation, which is beneficial to improving the accuracy and reliability of the smart home appliance in detecting the user's approaching operation, reducing the situation in which the smart home appliance performs unnecessary operations, and improving the reliability of the smart home appliance in monitoring other smart home appliances, and can also reduce the power consumption of the smart home appliance. In addition, when it is determined that the subcomponent is not empty, the probability of the user actually approaching the smart home appliance can be further predicted by the size of the acute angle between the moving direction and the direction on the horizontal plane and parallel to the smart home appliance. If the acute angle is large, the predicted probability of the user actually approaching the smart home appliance is large, and if the acute angle is small, the predicted probability of the user actually approaching the smart home appliance is small, which is beneficial to further improving the accuracy and reliability of the smart home appliance in detecting the user's approaching operation.

[0178] In yet another optional embodiment, Figure 5 As shown, the device may also include:

[0179] The second acquisition module 310 is used to acquire a facial image of a user approaching a smart home appliance.

[0180] The image analysis module 311 is used to analyze the user's eye viewing direction based on the face image.

[0181] The direction determination module 312 is used to determine whether the eye viewing direction is toward the smart home appliance. When it is determined that the eye viewing direction is toward the smart home appliance, the output module 303 is triggered to perform the above-mentioned operation of outputting the status information of each target smart home appliance to the user.

[0182] It can be seen that implementation Figure 5 The described device can also determine the user's eye viewing direction by performing intelligent analysis on facial images. Only when the user's eye viewing direction is toward the smart home appliance will the acquired status information of each target smart home appliance be displayed, thereby increasing the probability that the displayed status information can be viewed by the user, which in turn is beneficial to improving the reliability and effectiveness of the smart home appliance displaying the status information of other smart home appliances, and also to a certain extent increases the probability that the output status information can be obtained by the user.

[0183] In the embodiment of the present invention, it should be noted that for other functions of the smart home appliance, reference can be made to the steps and related descriptions performed by the smart home appliance in Embodiment 1, and the embodiment of the present invention will not be repeated. Optionally, the smart home appliance may be a smart refrigerator, and further, the smart refrigerator may be a smart refrigerator with a large screen.

[0184] Embodiment 4

[0185] See also Figure 6 , Figure 6 is a structural diagram of another device monitoring device based on smart home appliances disclosed in an embodiment of the present invention. Figure 6 The described method can be applied in smart home appliances.

[0186] like Figure 6 As shown, the device may include:

[0187] A memory 401 storing executable program codes;

[0188] a processor 402 coupled to the memory 401;

[0189] The processor 402 calls the executable program code stored in the memory 402 to execute part or all of the steps executed by the smart home appliance or smart refrigerator in the above method embodiment.

[0190] Embodiment 5

[0191] The embodiment of the present invention discloses a smart home appliance device, which can be used to execute some or all steps of the device monitoring method based on the smart home appliance device disclosed in the first embodiment, or, Figure 7 As shown, the smart home appliance may include any device monitoring device based on a smart home appliance disclosed in Embodiment 3 or Embodiment 4. It should be noted that for a detailed description of the steps performed by the smart home appliance or the modules, devices, etc. included, please refer to the above embodiments, and the embodiments of the present invention will not be repeated. Further, the smart home appliance may be a smart refrigerator, and further, the smart refrigerator may be a smart refrigerator with a large screen.

[0192] Embodiment 6

[0193] An embodiment of the present invention discloses a computer storage medium, which stores computer instructions. When the computer instructions are called, they are used to execute some or all of the steps executed by the smart home appliance or smart refrigerator in the above method embodiment.

[0194] The device embodiments described above are only illustrative, wherein the modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, i.e., they may be located in one place, or they may be distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Those of ordinary skill in the art may understand and implement it without creative work.

[0195] Through the specific description of the above embodiments, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on such an understanding, the above technical solution can be essentially or partly contributed to the prior art in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, and the storage medium includes a read-only memory (ROM), a random access memory (RAM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a one-time programmable read-only memory (OTPROM), an electronically erasable rewritable read-only memory (EEPROM), a compact disc (CD-ROM) or other optical disc storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.

[0196] Finally, it should be noted that the device monitoring method and apparatus based on smart home appliances disclosed in the embodiments of the present invention are only preferred embodiments of the present invention, and are only used to illustrate the technical solution of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, it should be understood by those skilled in the art that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features therein may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A device monitoring method based on smart home appliances, characterized in that: The method comprises: When it is detected that a user is approaching the smart home appliance, the smart home appliance determines at least one target smart home appliance that matches the attribute information based on the collected attribute information of the user approaching the smart home appliance; or, based on the functional attributes of the smart home appliance, selects at least one target smart home appliance that matches the functional attributes of the smart home appliance from the determined smart home appliance set, and obtains the status information of each of the target smart home appliances; wherein the target smart home appliances are other smart home appliances; The smart home appliance device outputs the status information of each of the target smart home appliances to the user; The status information of each of the target smart home appliances includes the real-time status information of each of the target smart home appliances and / or the historical status information of each of the target smart home appliances.

2. The device monitoring method based on smart home appliances according to claim 1, characterized in that: The method further comprises: The smart home appliance detects a control operation triggered by a user on a certain smart home appliance among all the target smart home appliances, and generates a control instruction according to the control operation; The smart home appliance sends the control instruction to the certain smart home appliance, so that the certain smart home appliance performs an operation matching the control instruction; or, The smart home appliance sends the control instruction to the control server, so that the control server sends the control instruction to the smart home appliance.

3. The device monitoring method based on smart home appliances according to claim 1, characterized in that: After detecting that the user is approaching the smart home appliance, before the smart home appliance acquires the status information of each of the at least one predetermined target smart home appliance, the method further includes: The smart home appliance collects a moving direction of a user approaching the smart home appliance, and decomposes the moving direction in a pre-established coordinate system to obtain a subcomponent of the moving direction in a direction perpendicular to the smart home appliance on a horizontal plane; The smart home appliance determines whether the subcomponent is empty, and when it is determined that the subcomponent is not empty, performs the operation of acquiring the status information of each of the at least one predetermined target smart home appliance.

4. The device monitoring method based on smart home appliances according to claim 3 is characterized in that: After determining that the subcomponent is not empty, the method further includes: The smart home appliance determines whether an acute angle between the moving direction and a direction on the horizontal plane and parallel to the smart home appliance is greater than or equal to a predetermined angle threshold; When it is determined that the acute angle is greater than or equal to the angle threshold, the smart home appliance performs the operation of acquiring the status information of each of the at least one predetermined target smart home appliance.

5. The device monitoring method based on smart home appliances according to any one of claims 1 to 4, characterized in that: Before the smart home appliance outputs the status information of each of the target smart home appliances to the user, the method further includes: The smart home appliance collects a facial image of a user approaching the smart home appliance, and analyzes the viewing direction of the user's eyes according to the facial image; The smart home appliance determines whether the eye viewing direction is toward the smart home appliance, and when it is determined that the eye viewing direction is toward the smart home appliance, performs the operation of outputting the status information of each target smart home appliance to the user; The smart home appliance outputs the status information of each target smart home appliance to the user, including: The smart home appliance controls its display screen to display the status information of each target smart home appliance to the user.

6. The device monitoring method based on smart home appliances according to claim 5, characterized in that: The status information of each target smart home appliance is collected by the smart home appliance; or, the status information of each target smart home appliance is collected by the control server and then pushed to the smart home appliance.

7. An equipment monitoring device based on smart home appliances, characterized in that: The device is applied to the smart home appliance, and the device includes: A detection module, used to detect whether a user is close to the smart home appliance; a determination module, configured to determine, after the detection module detects that the user is approaching the smart home appliance, at least one target smart home appliance that matches the attribute information according to the collected attribute information of the user approaching the smart home appliance; or, based on the functional attributes of the smart home appliance, select at least one target smart home appliance that matches the functional attributes of the smart home appliance from the determined smart home appliance set; wherein the target smart home appliance is other smart home appliance; An acquisition module, configured to acquire status information of each of the target smart home appliances when the detection module detects that a user is approaching the smart home appliance; An output module, used to output the status information of each target smart home appliance to the user; The status information of each of the target smart home appliances includes the real-time status information of each of the target smart home appliances and / or the historical status information of each of the target smart home appliances.

8. An equipment monitoring device based on smart home appliances, characterized in that: The device is applied to the smart home appliance, and the device includes: A memory storing executable program code; a processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the device monitoring method based on the smart home appliance as described in any one of claims 1-6.

9. A computer storage medium, characterized in that The computer storage medium stores computer instructions, and when the computer instructions are called, they are used to execute the device monitoring method based on smart home appliances as described in any one of claims 1-6.

Images