Household equipment control device and method based on sensing user state

Abstract

The invention provides a household equipment control device and method based on user state sensing, and relates to the technical field of household equipment control. The device comprises a base and a functional panel mounted on the base. The function panel comprises a processor, a memory, a controller, at least two sensors and a sensing signal interface. The sensor is used for sensing an environment and / or a user state to obtain environment information and / or user state information. The control device can be installed in the space environment area where the home equipment is located and is associated with the home equipment, the control device is provided with the processor, the storage and the controller, and control over the home equipment can be achieved locally. Moreover, the device is provided with various sensors, various data are obtained according to sensing of the various sensors to control adjustment of the working state of the household equipment, and integrated control of various household equipment is achieved. In addition, a sensing signal interface is further arranged and can be used for being externally connected with more types of sensors, the flexibility of sensor adding is improved, and the integration degree is further improved.

Description

Technical Field

[0001] The present invention relates to the technical field of home appliance control, and in particular to a home appliance control device and method based on sensing user status. Background Art

[0002] A smart home system is a home system that integrates multiple smart devices and achieves automation, remote control, and intelligent management through network connection. Its system consists of sensors, controllers, and actuators, and has functional features such as automated control, remote monitoring, and energy management.

[0003] In the current smart home system, users can control home appliances through the operating interface provided by the application program corresponding to the software / firmware provided by each smart device service provider. Smart home appliances contain some sensors, which are similar to triggers to activate other home appliances, but require home users to constantly purchase new sensor devices. The placement of such post-installed sensor devices is relatively scattered and requires plugging in power or batteries, which also brings about installation and wiring problems, space occupation and greater power consumption waste, the need for complex network configuration, and the configuration interface becomes complicated as the number of devices increases. In addition, with the continuous development of network technology, the cloud application end is also constantly upgraded. Therefore, as the number of home appliances continues to increase, it will cause network burden and some unnecessary event types to be reported, resulting in data waste and occupation of network bandwidth.

[0004] Therefore, it is necessary to provide users with a device for actively controlling the working status of home appliances that can improve integration properties and localized deployment capabilities to solve the above problems. Summary of the invention

[0005] The purpose of the present invention is to provide a home appliance control device and method based on sensing user status, which has built-in data storage capability and multiple sensing capabilities to achieve integrated and localized control of various home appliances.

[0006] To achieve the above object, the present invention provides the following technical solutions:

[0007] In a first aspect, the present invention provides a home appliance control device based on sensing user status, which is arranged in a spatial environment area where the home appliance is located and is associated with the home appliance, and includes a base and a function panel installed on the base; the inner cavity of the base is provided with a power control module, and the power control module supplies power to the function panel; the function panel includes: a processor, a memory electrically connected to the processor, a controller, at least two sensors and a sensor signal interface; the sensor is used to sense the environment and / or user status to obtain environmental information and / or user status information; the processor processes and analyzes the environmental information and / or user status information obtained by the sensor to generate a control instruction; the controller controls the corresponding home appliance to adjust the working status according to the control instruction; the memory stores the user status information and environmental information sensed by the sensor, and / or stores the information processed and analyzed by the processor; the sensor signal interface is used to connect another sensor externally.

[0008] To ensure the safety and reliability of the device, the present invention provides a preferred solution in the first aspect, wherein the base also includes a cover plate, which is snap-fitted to encapsulate the inner cavity of the base; the cover plate is provided with a power interface for powering the functional panel; the base also includes a mounting plate, and the functional panel is detachably connected to the base through the mounting plate.

[0009] To facilitate the subsequent installation of diversified sensors, the present invention provides a preferred solution in the first aspect, wherein a main circuit board is installed in the functional panel, the processor includes a main processor, and the memory, main processor and sensor are all integrated on the main circuit board; the functional panel also includes a sub-circuit board, the sub-circuit board is stacked on the main circuit board, and is connected to the main circuit board circuit, and the sensor signal interface is integrated on the main circuit board and / or the sub-circuit board; the processor also includes a coprocessor, the coprocessor is integrated on the sub-circuit board, and the coprocessor is communicatively coupled to the main processor.

[0010] In order to improve the reliability of circuit board installation inside the functional panel, the present invention provides a preferred solution in the first aspect, wherein the functional panel also includes a panel frame, and a boss is provided on the inner edge of the panel frame, and the main circuit board and / or auxiliary circuit board are installed and fixed in the boss.

[0011] In order to further improve the reliability of the installation of the main circuit board, the present invention provides a preferred solution in the first aspect, wherein a lining plate is encapsulated on the back of the panel frame, and the lining plate is provided with a cavity for accommodating and positioning some circuit components on the back of the main circuit board; the lining plate is provided with a power interface groove for accommodating the power interface.

[0012] In order to improve and optimize the installation of sensors, the present invention provides a preferred solution in the first aspect, wherein an avoidance gap is provided on the boss, and at least one of the sensors is located in the avoidance gap.

[0013] To improve the visualization and interactivity of the device, the present invention provides a preferred solution in the first aspect, wherein a display is encapsulated on the front of the panel frame, and the display includes a display area and a light-transmitting area; and the sensor is located on the back of the light-transmitting area.

[0014] In a second aspect, the present invention provides a method for controlling household appliances based on sensing user status, based on the above-mentioned control device, comprising: acquiring a first sensing object and / or a second sensing object through at least two sensors, wherein the first sensing object is at least associated with a second sensing object, environmental information and household appliances, and the second sensing object is associated with user status information; according to changes in the second sensing object determined by the sensor, adjusting the action of the household appliance associated with the first sensing object, while maintaining sensing of the second sensing object, so that at least part of the household appliances associated with the first sensing object maintain the action and determine whether the action needs to be adjusted again.

[0015] Compared with the prior art, the above technical solution has the following advantages:

[0016] The home appliance control device based on sensing the user status of the present invention can be installed in the spatial environment area where the home appliance is located and associated with the home appliance. It has its own processor, memory, and controller, and can realize the control of the home appliance locally, which can avoid the network burden caused by uploading data to the cloud. In addition, the device also has a variety of sensors, which can control the adjustment of the working status of the home appliance according to the various data sensed by the various sensors, thereby realizing the integrated control of various home appliances. In addition, a sensor signal interface is also provided, which can be used to connect more types of sensors, improve the flexibility of sensor installation, and further improve the integration. Therefore, the home appliance control device based on sensing the user status of the present invention is a device that actively controls the working status of home appliances and can improve the integration attributes and localized deployment capabilities. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying creative work.

[0018] Figure 1 A schematic diagram of the structure of a home appliance control device based on sensing user status provided by a specific embodiment of the present invention;

[0019] Figure 2 A flowchart of a household device control method based on sensing user status provided by a specific embodiment of the present invention;

[0020] Figure 3 A flowchart of a household appliance control method based on sensing user status is provided in yet another specific embodiment of the present invention.

[0021] Figure numerals: base 100, mounting plate 110, cover plate 120, power control module 130, power interface 140, inner cavity 150, functional panel 200, lining plate 210, power interface slot 211, recessed cavity 212, main circuit board 220, first sensor 221, second sensor 222, main processor 223, signal transmission interface 214, sensor signal interface 215, hook 216, auxiliary circuit board 230, coprocessor 231, panel frame 240, boss 241, avoidance gap 242, display 250, display area 251, light-transmitting area 252. DETAILED DESCRIPTION

[0022] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0023] The home appliance control device based on sensing the user status of the present invention can be designed as software / firmware (such as an external / peripheral device, a near field communication device, etc.) or a complete set of wall-mounted products or desktop products. The device forms are various and not limited to this. In general, the home appliance control device based on sensing the user status of the present invention can be set in a local hub device that can be connected to a remote cloud controller or as a separate device that runs independently.

[0024] Embodiment 1

[0025] As an example, a home appliance control device based on sensing user status is provided, which is separately arranged as an independently operated device in the spatial environment area where the home appliance is located and is associated with the home appliance, and is applied to the wall decoration surface in the form of a complete set of wall-mounted products, and is mainly composed of the following components and devices: a base 100 and a functional panel 200 installed on the base 100; the inner cavity 150 of the base 100 is provided with a power control module 130, and the power control module 130 supplies power to the functional panel 200; the functional panel 200 includes: a processor, a memory electrically connected to the processor, a controller, a plurality of sensors and a sensor signal interface 215; the sensor is used to sense the environment and user status to obtain environmental information and user status information; the processor processes and analyzes the environmental information and user status information obtained by the sensor, and generates control instructions; the controller controls the corresponding home appliance to adjust the working status according to the control instructions; the memory stores the user status information and environmental information sensed by the sensor, and stores the information processed and analyzed by the processor; the sensor signal interface 215 is used to connect another sensor externally.

[0026] The home appliance control device based on sensing the user status provided in the above-mentioned implementation manner can be installed in the spatial environment area where the home appliance is located and associated with the home appliance. It has its own processor, memory, and controller, and can realize the control of the home appliance locally, which can avoid the network burden caused by uploading data to the cloud. In addition, the device also has a variety of sensors, which can control the adjustment of the working status of the home appliance according to the various data sensed by the various sensors, so as to realize the integrated control of various home appliances. In addition, a sensor signal interface 215 is also provided, which can be used to connect more types of sensors, improve the flexibility of sensor installation, and further improve the integration. In short, the home appliance control device based on sensing the user status provided in the above-mentioned implementation manner is a device that actively controls the working status of home appliances and can improve the integration attributes and localized deployment capabilities.

[0027] Embodiment 2

[0028] Based on the first embodiment, a more preferred implementation is provided, which specifically refines the specific structure of the whole set of wall-mounted products, especially the internal structure, as follows: a cover plate 120 is provided on the base 100, and the cover plate 120 is buckled to encapsulate the inner cavity 150 of the base 100; the cover plate 120 is provided with a power interface 140 for supplying power to the functional panel 200. More specifically, the base 100 can be installed in the wall decoration surface, and the base 100 has an inner cavity 150 encapsulated by the cover plate 120, which is used to install the power control module 130 (a conventional switching power supply design can be adopted, not shown in the figure) to connect the AC power line from the wall. Thus, the power supply part can be physically isolated and encapsulated in the inner cavity 150 to avoid electric shock of the device. The cover plate 120 is provided with a power interface 140 for an electrical connector, which is used to output weak power / logic level signals to the outside. This implementation scheme safely encapsulates the power supply in the base 100, improves the safety of the base 100, and makes the base 100 adaptable to more deployment scenarios.

[0029] The base 100 is also provided with a mounting plate 110, and the functional panel 200 is detachably connected to the base 100 through the mounting plate 110. More specifically, the mounting plate 110 provided on the front surface of the base 100 is used to assemble the functional panel 200, and the mounting plate 110 enables the functional panel 200 to be more firmly and conveniently mounted on the base 100. Please refer to Figure 1 , Figure 1 The embodiment shown describes the improved structure inside in more detail in the form of an exploded view. A main circuit board 220 is installed in the functional panel 200, and the processor includes a main processor 223, and the memory, the main processor 223 and the sensor are all integrated on the main circuit board 220. Further, the main circuit board 220 also provides one or more sensor signal interfaces 215 for externally connecting various sensor elements. In order to synchronously identify the logical electrical signals of these sensor elements, some of the sensors can also be directly welded to the main circuit board 220, which is considered according to the space design needs in the functional panel 200. And according to one embodiment of the present invention, the number and size of the sensors can also be considered according to the internal volume of the functional panel 200 (such as thickness value, etc.) to consider whether it needs to be designed into a stacked form and as close to the external environment as possible or a more suitable radiation angle without causing electric shock problems. For example, the acoustic sensor can be fixedly plugged through the sensor signal interface 215 and the acoustic device is attached to the sound hole (not shown in the figure) on the side wall of the functional panel 200.

[0030] When multiple sensor devices are provided, in one embodiment, a sub-circuit board 230 is further provided in the function panel 200, and the sub-circuit board 230 is stacked on the main circuit board 220 and is connected to the main circuit board 220 circuit. The sensor signal interface 215 is integrated on the main circuit board 220 and / or the sub-circuit board 230; the processor also includes a coprocessor 231, which is integrated on the sub-circuit board 230, and the coprocessor 231 is coupled to the main processor 223 in communication. Specifically, the main circuit board 220 can be stacked with a sub-circuit board 230 in the thickness direction of the function panel 200, and the sub-circuit board 230 can be fixedly connected to the surface of the main circuit board 220 through an electrical connector (such as a pin header), which is a fixing method of the sub-circuit board 230. On the sub-circuit board 230, a coprocessor 231 (such as a graphics processing unit GPU, an algorithm driving unit, etc.) coupled to the main processor 223 can be provided. Preferably, the sub-circuit board 230 can obtain operating power from the main circuit board 220, and can also obtain power separately from the power interface 140 of the base 100. This solution not only improves the device's ability to process information sensed by sensors, creating feasibility for later optimization and improvement of capabilities, but also improves the integration, optimizes the installation space of sensors, and improves the ability to add sensors, thereby improving the ability to diversify sensing needs and providing more information support for centralized control of furniture equipment.

[0031] certainly, Figure 1 The embodiment shown is an electrical accessory product that can be used and sold independently, or it can be a product to be optimized and upgraded. When this home appliance control device is installed as firmware / software in one or more local hub devices (such as local gateways, repeaters / routers, audio and video equipment, etc.) or Figure 1 This type of wall-mounted product as an example can be used in the local hub device within one or more home space environment areas or in home devices near the local hub device (the space environment area is at least framed by the effective sensing area sensed by the sensor where the user enters).

[0032] When multiple sensor devices are provided, in another embodiment, the auxiliary circuit board 230 can also have another fixing method, and its installation height can be fixed in a hanging manner through a boss 241 added on the inner wall of the functional panel 200, that is, a panel frame 240 is provided in the functional panel 200, and a boss 241 is provided on the inner edge of the panel frame 240, and the auxiliary circuit board 230 is installed and fixed in the boss 241. An avoidance notch 242 is provided at a corresponding position on the functional platform, and the sensor (in the figure, the second sensor 222) is preferably positioned by a hook 216. This solution provides sufficient installation positions for the sensor in the functional panel 200, and provides a stable installation effect for the sensor in the functional panel 200, further improving the sensor installation capability. The functional panel 200 preferably uses a display 250 with a touch-sensitive element layer to provide input and information display. The main circuit board 220 is arranged at the rear side of the display 250, and the display 250 and the main circuit board 220 realize signal transmission through a number of signal transmission interfaces 214 (such as cable encoding interfaces or electrical connectors). At the same time, the display 250 is packaged on the front side of the panel frame 240, and the display 250 includes a display area 251 and a light-transmitting area 252; the sensor is located on the back side of the light-transmitting area 252. More specifically, when the display 250 is packaged as the front surface of the functional panel 200, the display 250 can be divided into a display area 251 and a strip area extending therefrom, and the edge of the strip area is flush with the inner frame surface of the functional panel 200. The strip area can be made of the same material as the display area 251 (transparent / translucent glass, polycarbonate (PC), acrylic (PMMA) or other transparent antistatic materials, etc.), as the light-transmitting area 252, so that the sensor can emit rays when it is laid on the back side of the area, and when the LCD display 250 is used in the display area 251, its metal packaging surface may shield or reflect the rays. The setting of the display 250 diversifies the interaction mode between the device and the user, and is applicable to more deployment scenarios. At the same time, the transparent strip area provides support for the good operation of the sensor, avoiding the setting of the display 250 affecting the operation of the sensor.

[0033] When multiple sensor devices are provided, in a more preferred embodiment, the main circuit board 220 may be provided with one or more solid-state memories (not shown in the conventional device figure) on the back side for temporarily storing the data content corresponding to each of the above sensors. For example, when the second sensor 222 is a camera, it is necessary to temporarily store the image information within a preset period of time locally so that the main processor 223 or the coprocessor 231 can perform actions such as image algorithm recognition. Therefore, the lining plate 210 of the functional panel 200 can be provided with a cavity 212 to accommodate and position the above-listed devices. The main circuit board 220 is provided with the above-mentioned electrical connector through the power interface slot 211 provided on the lining plate 210 to obtain power and transmit logical electrical signals. This solution facilitates the installation and positioning of the main circuit board 220, provides a sufficient installation position and a stable installation effect for the main circuit board 220 in the functional panel 200, improves the stability of the overall structure, and improves the installation applicability of the device. The above-mentioned second sensor 222 can be a temperature and humidity sensor, a near-infrared sensor or a proximity sensor, which is used to sense the temperature and humidity indicators of the current spatial environment; or it can be a camera, which is used to sense the image recognition parameters of the current spatial environment area; or it can be a millimeter-wave radar sensor, which is used to sense at least one of the position, trajectory tracking, number of people and whether a human body has fallen in the current spatial environment area.

[0034] Embodiment 3

[0035] As another example, the home appliance control device of this embodiment is installed as firmware / software in one or more local hub devices (such as a local gateway, repeater / router, audio and video equipment, etc.), and can be used in the local hub device within one or more home space environment areas or in home appliances near the local hub device (the space environment area is at least framed by the effective sensing area sensed by the sensor as the user enters).

[0036] To this end, this embodiment provides a home appliance control method based on sensing the user status. Based on the above control device, please refer to Figure 2 , mainly achieved through the following steps:

[0037] S11 is achieved by at least two sensors (such as Figure 1 The first sensor 221 and the second sensor 222 in the embodiment of the present invention acquire the first sensing object and / or the second sensing object, wherein the first sensing object is at least associated with the second sensing object, the environmental information and the home device, and the second sensing object is associated with the user status information;

[0038] S21 adjusts the action of the home appliance associated with the first sensing object according to the change of the second sensing object determined by the sensor, while maintaining the sensing of the second sensing object, so that at least part of the home appliance associated with the first sensing object maintains the action and determines whether the action needs to be adjusted again.

[0039] The local hub device in which the control device is provided is further configured to: S12 determine the position information of the user in the effective sensing area. For example, determining whether it includes acquiring a second sensing object from a sensor in the direction of the user, and determining the position information in the sensing area based on the second sensing object sensed by the sensor.

[0040] In one embodiment, the local hub device is configured to: S22 display the sensed second sensing object on the home device according to the determined sensed location information.

[0041] In addition, the local hub device is also configured to: receive user input to determine the user's vital sign status; and in response to determining that the sensed position information corresponds to sensing the second sensing object, adjust the operating status of the home device associated with the first sensing object.

[0042] The user input includes body posture, gesture, voice input, or input using a wearable controller. Determining the sensed position information may include determining sensing orientation information, and wherein determining the position information corresponds to sensing a first sensing object or a second sensing object, and determining that the sensing is directed toward the first sensing object or the second sensing object.

[0043] Wherein, determining that the sensing direction is directed to the first sensing object or the second sensing object is based at least in part on an angular radiation analysis of the sensing direction, determining a sensing depth, and the sensed position information corresponds to sensing the second sensing object, determining the sensing depth corresponds to a radiation frequency of the second sensing object presented in the spatial environment area. Determining the sensing position includes using ray casting to determine the sensing position. Wherein the casting includes using an angular range, wherein the angular range is based on an angular resolution of the sensing direction associated with the sensing position. According to determining that the sensing position corresponds to sensing the first sensing object, the transparency of the second sensing object is increased while maintaining the display of the first sensing object.

[0044] A person skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above methods. The storage medium can be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.

[0045] The technical features of the above-described embodiments can be combined arbitrarily. In order to make the description concise, all possible combinations of the technical features in the above-described embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification. The above-described embodiments only express several implementation methods of the present invention, and their descriptions are relatively specific and detailed, but they cannot be understood as limiting the scope of the present invention. It should be pointed out that for those of ordinary skill in the art, without departing from the concept of the present invention, several variations and improvements can be made, which all belong to the protection scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the attached claims.

Claims

1. A home appliance control device based on sensing user status, which is arranged in a spatial environment area where the home appliance is located and is associated with the home appliance, characterized in that: It includes a base and a functional panel installed on the base; The inner cavity of the base is provided with a power control module, and the power control module supplies power to the functional panel; the functional panel includes: a processor, a memory electrically connected to the processor, a controller, at least two sensors and a sensor signal interface; The sensor is used to sense the environment and / or user status to obtain environmental information and / or user status information; the processor processes and analyzes the environmental information and / or user status information obtained by the sensor to generate control instructions; the controller controls the corresponding home appliances to adjust the working status according to the control instructions; the memory stores the user status information and environmental information sensed by the sensor, and / or stores the information processed and analyzed by the processor.

2. The home appliance control device based on sensing user status according to claim 1, characterized in that: The base also includes a cover plate, which is snap-fitted to encapsulate the inner cavity of the base; the cover plate is provided with a power interface for supplying power to the functional panel; the base also includes a mounting plate, through which the functional panel is detachably connected to the base.

3. The home appliance control device based on sensing user status according to claim 2, characterized in that: A main circuit board is installed in the functional panel, the processor includes a main processor, and the memory, the main processor and the sensor are all integrated on the main circuit board.

4. The home appliance control device based on sensing user status according to claim 3, characterized in that: The functional panel also includes a secondary circuit board, which is stacked on the main circuit board and connected to the main circuit board circuit. The sensor signal interface is integrated on the main circuit board and / or the secondary circuit board. The processor also includes a coprocessor, which is integrated on the secondary circuit board and is communicatively coupled to the main processor.

5. A household appliance control device based on sensing user status according to claim 4, characterized in that: The functional panel further comprises a panel frame, an inner edge of the panel frame is provided with a boss, and the main circuit board and / or the auxiliary circuit board are installed and fixed in the boss.

6. According to claim 5, a home appliance control device based on sensing user status, the back of the panel frame is encapsulated with a lining plate, the lining plate is provided with a cavity for accommodating and positioning some circuit components on the back of the main circuit board; the lining plate is provided with a power interface slot for accommodating the power interface.

7. A household appliance control device based on sensing user status according to claim 6, characterized in that: The boss is provided with an avoidance gap, and at least one of the sensors is located in the avoidance gap.

8. The home appliance control device based on sensing user status according to claim 7, characterized in that: A display is packaged on the front of the panel frame, and the display includes a display area and a light-transmitting area; the sensor is located on the back of the light-transmitting area.

9. The home appliance control device based on sensing user status according to any one of claims 1 to 8, characterized in that: At least one of the sensors is a temperature and humidity sensor, a near infrared sensor or a proximity sensor, which is used to sense and obtain temperature and humidity indicators of the current space environment; Or it is a camera for sensing image recognition parameters of the current spatial environment area; or it is a millimeter wave radar sensor for sensing at least one of the position, trajectory tracking, number of people and whether a human body has fallen in the current spatial environment area.

10. A method for controlling household appliances based on sensing user status, based on the control device according to any one of claims 1 to 9, characterized in that: include: Acquire a first sensing object and / or a second sensing object by at least two sensors, wherein the first sensing object is at least associated with the second sensing object, environmental information and home equipment, and the second sensing object is associated with user status information; According to the change of the second sensing object determined by the sensor, the action of the home appliance associated with the first sensing object is adjusted, while the sensing of the second sensing object is maintained, so that at least part of the home appliances associated with the first sensing object maintains the action and determines whether the action needs to be adjusted again.

Images