Intelligent household appliance control method and device, storage medium and electronic device

Abstract

The invention discloses an intelligent household electrical appliance control method and device, a storage medium and an electronic device. The method comprises the following steps: acquiring at least two user gesture images through a camera device; identifying a gesture action in the user gesture image, and determining a gesture action identifier corresponding to the gesture action; generating household appliance control information according to the time sequence of the user gesture image and the gesture action identifier; and if the household appliance control information does not belong to the local preset control information of the equipment, sending the household appliance control information to a control center, so that the control center controls the corresponding intelligent household appliance according to the household appliance control information. According to the scheme of the embodiment of the invention, the efficiency of controlling the intelligent household appliance can be improved, and user operation is facilitated.

Description

Technical Field

[0001] This application relates to the field of smart homes, and more specifically, to a smart home appliance control method, device, storage medium, and electronic device. Background Technology

[0002] Smart home appliances are increasingly appearing in homes, and some of these appliances allow users to control certain functions using gestures.

[0003] In existing technologies, smart home appliances can recognize preset gestures to control their functions. However, each smart appliance can only recognize gestures it supports, requiring users to learn which gestures are supported by different appliances. Furthermore, a single user may own multiple smart appliances. When a smart home system contains multiple devices, these devices are often located in different rooms or different positions within the same room. For a user to control a smart appliance via gestures, the corresponding smart appliance needs to be able to detect the location of the user's gesture, which can be inconvenient for the user. Summary of the Invention

[0004] This application provides a smart home appliance control method, device, storage medium, and electronic device, with the aim of enabling the control of target home appliances in a smart home through gestures from any smart home appliance.

[0005] According to one aspect of the embodiments of this application, a smart home appliance control method is provided, comprising: Acquire at least two user gesture images using a camera device; Identify the hand gestures in the user's hand gesture image and determine the hand gesture identifier corresponding to the hand gesture; Based on the timing of the user's gesture images and the gesture action identifiers, control information for home appliances is generated. If the control information of the home appliance is not the preset control information of the device, the control information of the home appliance is sent to the control center so that the control center controls the corresponding smart home appliance according to the control information of the home appliance.

[0006] In an optional implementation, before recognizing the gesture action in the user gesture image and determining the gesture action identifier corresponding to the gesture action, the method further includes: The system receives and stores a gesture recognition model sent by the server, wherein the gesture recognition model is configured to recognize a preset gesture and output a gesture identifier corresponding to the preset gesture.

[0007] In an optional implementation, recognizing the gesture action in the user's gesture image and determining the gesture action identifier corresponding to the gesture action includes: The local gesture recognition model is invoked to recognize the gesture in the user's gesture image; If the gesture action in the user's gesture image is successfully recognized, the gesture action identifier output by the gesture action recognition model is obtained.

[0008] In an optional implementation, generating home appliance control information based on the timing of the user gesture image and the gesture action identifier includes: Arrange the corresponding gesture action identifiers into an identifier string according to the time sequence of the user gesture images; A preset separator is inserted between adjacent gesture action icons to obtain the control information of the home appliance.

[0009] In an optional implementation, the step of sending the home appliance control information to the control center if the control information does not belong to the device's local preset control information includes: Determine whether the preset position gesture action identifier in the home appliance control information is the same as the device identifier on the local device. If the preset position gesture action identifier is different from the device identifier, it is determined that the home appliance control information does not belong to the preset control information local to the device.

[0010] In an optional implementation, after determining whether the preset position gesture action identifier in the home appliance control information is the same as the device identifier locally on the device, the method further includes: If the preset position gesture action identifier is the same as the device identifier, it is determined that the home appliance control information belongs to the preset control information local to the device. Obtain at least one gesture action identifier other than the preset position gesture action identifier in the control information of the home appliance, and match it with the preset operation identifier of the device to obtain the operation identifier matching result; Based on the operation identifier matching result, execute the device function corresponding to the preset operation identifier.

[0011] In an optional implementation, after invoking the local gesture recognition model to recognize the gesture in the user gesture image, the method further includes: If the gesture action in the user gesture image is not successfully recognized, at least two user gesture images will be sent to the server; Obtain the gesture recognition results from the server.

[0012] According to another aspect of the embodiments of this application, a smart home appliance control device is provided, comprising: A gesture image acquisition module is used to acquire at least two user gesture images via a camera device; The gesture action identifier determination module is used to identify the gesture action in the user gesture image and determine the gesture action identifier corresponding to the gesture action; The home appliance control information generation module is used to generate home appliance control information based on the timing of the user's gesture image and the gesture action identifier. The home appliance control information sending module is used to send the home appliance control information to the control center if the home appliance control information does not belong to the preset control information of the device, so that the control center can control the corresponding smart home appliance according to the home appliance control information.

[0013] In one optional implementation, the smart home appliance control device further includes: The gesture recognition model storage module is used to receive and store a gesture recognition model sent by the server before recognizing the gesture in the user's gesture image and determining the gesture identifier corresponding to the gesture. The gesture recognition model is set to recognize a preset gesture and output the gesture identifier corresponding to the preset gesture.

[0014] In an optional implementation, the gesture action identification module is specifically used for: The local gesture recognition model is invoked to recognize the gesture in the user's gesture image; If the gesture action in the user's gesture image is successfully recognized, the gesture action identifier output by the gesture action recognition model is obtained.

[0015] In one optional implementation, the home appliance control information generation module is specifically used for: Arrange the corresponding gesture action identifiers into an identifier string according to the time sequence of the user gesture images; A preset separator is inserted between adjacent gesture action icons to obtain the control information of the home appliance.

[0016] In one optional implementation, the home appliance control information sending module includes: The device identification determination unit is used to determine whether the preset position gesture action identifier in the control information of the home appliance is the same as the device identifier in the local device; The first local information matching and determination unit is used to determine that the home appliance control information does not belong to the preset control information of the device locality if the preset position gesture action identifier is not the same as the device identifier.

[0017] In one optional implementation, the smart home appliance control device further includes: The second local information matching and determination module is used to determine, after determining whether the preset position gesture action identifier in the home appliance control information is the same as the device identifier in the local device, that the home appliance control information belongs to the preset control information in the local device if the preset position gesture action identifier is the same as the device identifier. The operation identifier matching result determination module is used to obtain at least one gesture action identifier other than the preset position gesture action identifier in the control information of the home appliance, and match it with the preset operation identifier of the device to obtain the operation identifier matching result. The device function execution module is used to execute the device function corresponding to the preset operation identifier according to the operation identifier matching result.

[0018] In one optional implementation, the smart home appliance control device further includes: The user gesture image sending module is used to send at least two user gesture images to the server after the local gesture action recognition model is invoked to recognize the user gesture action in the user gesture image. If the user gesture action in the user gesture image is not successfully recognized, the module is used to send the user gesture image to the server. The gesture recognition result acquisition module is used to acquire the gesture recognition results of the server.

[0019] According to another aspect of the embodiments of this application, a computer-readable storage medium is provided, the computer-readable storage medium including a stored program, wherein the program, when executed, performs the smart home appliance control method provided in any embodiment of the present invention.

[0020] According to another aspect of the present application, an electronic device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to execute the intelligent home appliance control method provided in any embodiment of the present invention through the computer program.

[0021] This application provides a smart home appliance control method, device, storage medium, and electronic device. It acquires and recognizes user gestures from smart home appliances to determine which smart home appliances need to be controlled. When the smart home appliance to be controlled is not the user's own device, the control information is sent to a control center to enable control of the corresponding smart home appliance. This solves the problem of the inconvenience of controlling multiple smart home appliances individually with gestures, allowing users to control a target smart home appliance using gestures from any smart home appliance in the home. This improves the efficiency of controlling smart home appliances and facilitates user operation. Attached Figure Description

[0022] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0023] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0024] Figure 1 This is a schematic diagram of the hardware environment of a smart home appliance control method according to an embodiment of this application; Figure 2 This is a flowchart of a smart home appliance control method provided in an embodiment of the present invention; Figure 3 This is a schematic diagram illustrating the configuration of gestures in a smart home appliance control method provided in an embodiment of the present invention; Figure 4 This is a schematic diagram of the structure of an intelligent home appliance control device provided in an embodiment of the present invention; Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. Detailed Implementation

[0025] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.

[0026] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0027] According to one aspect of the embodiments of this application, a smart home appliance control method is provided. This smart home appliance control method is widely used in whole-house intelligent digital control application scenarios such as smart homes, smart home ecosystems, smart home device ecosystems, and smart house ecosystems. Optionally, in this embodiment, the above-mentioned smart home appliance control method can be applied to, for example... Figure 1 The hardware environment shown consists of terminal device 102 and server 104. For example... Figure 1 As shown, server 104 is connected to terminal device 102 via a network and can be used to provide services (such as application services) to the terminal or clients installed on the terminal. A database can be set up on the server or independently of the server to provide data storage services for server 104. Cloud computing and / or edge computing services can be configured on the server or independently of the server to provide data processing services for server 104.

[0028] The aforementioned network may include, but is not limited to, at least one of the following: wired network, wireless network. The aforementioned wired network may include, but is not limited to, at least one of the following: wide area network, metropolitan area network, local area network. The aforementioned wireless network may include, but is not limited to, at least one of the following: Wi-Fi (Wireless Fidelity), Bluetooth. The terminal device 102 may not be limited to PC, mobile phone, tablet computer, smart air conditioner, smart range hood, smart refrigerator, smart oven, smart stove, smart washing machine, smart water heater, smart washing equipment, smart dishwasher, smart projector, smart TV, smart clothes rack, smart curtains, smart audio-visual equipment, smart socket, smart speaker, smart speaker box, smart fresh air equipment, smart kitchen and bathroom equipment, smart bathroom equipment, smart robot vacuum cleaner, smart window cleaning robot, smart mopping robot, smart air purifier, smart steam oven, smart microwave oven, smart water heater, smart air purifier, smart water dispenser, smart door lock, etc.

[0029] This embodiment provides a smart home appliance control method, applied to scenarios where users control smart home appliances through gestures in a home environment. Figure 2 A flowchart of a smart home appliance control method provided in an embodiment of the present invention includes the following steps: Step 220: Acquire at least two user gesture images using a camera device.

[0030] Smart home appliances can be equipped with cameras, or cameras installed in the same room as the smart appliances. The cameras can be pre-paired with the smart appliances, allowing them to access the camera's image to capture user gestures. The camera can capture user gestures by recording video and extracting image frames containing the user's gestures. Users control smart appliances through gestures, typically requiring pre-defined gesture meanings. These can be factory-preset default gestures with default meanings, or user-defined gestures. For users to control smart appliances through gestures, especially by controlling a target smart appliance from any device in the home, the gestures must indicate the target smart appliance and the desired function. Therefore, at least two gestures are needed to identify the target smart appliance and the function. The target smart appliance can be represented by one or more gestures, and similarly, the function can be represented by one or more gestures. If there are many smart home appliances, then representing a single smart appliance with a single gesture would require more gestures, but the number of gestures that can be made is limited. In this case, it's necessary to use two or more combined gestures to represent a single smart appliance. Similarly, two or more combined gestures can represent a single function. Let's take an example where the target smart appliance and its function are both represented by a single gesture. Figure 3In this system, users can use the gesture control configuration interface on their user terminals to map gestures to devices and functions, thus defining the meaning of each gesture. After setting the mapping relationship between gestures and smart home appliances and functions on the user terminal, the user terminal uploads this mapping relationship to a cloud-based control center (e.g., a cloud server) or a local control center (e.g., a smart home gateway device). The control center stores this mapping relationship. This allows users to freely change the mapping relationship between gestures and smart home appliances and functions on their user terminals to meet their specific needs. Furthermore, users may require a single smart home appliance to perform multiple functions. For example, a user might need to adjust the fan speed and temperature of an air conditioner. To facilitate user control, users can use gestures to control multiple functions of a single smart home appliance. In other words, the user's gestures will indicate a target smart home appliance, but the indicated functions can be multiple. Therefore, the number of user gesture images will be more than two.

[0031] Step 240: Identify the gesture action in the user gesture image and determine the gesture action identifier corresponding to the gesture action.

[0032] In this context, smart home appliances can be represented by identifiers. Similarly, the functions that smart home appliances can perform can also be simplified into identifiers. For example, a smart home appliance can be assigned a device identifier (devID) to represent it, and the function commands can be simplified into function identifiers. After the user defines the relationship between a gesture pattern and the corresponding device or function control, the corresponding gesture recognition algorithm and the identifier information output by the recognized gesture can be sent to all smart home appliances that support gesture recognition capabilities via the cloud. For smart home appliances that support gesture recognition, the gesture recognition algorithm configured by the user is pre-installed in the smart home appliance. This allows the user to perform gesture actions within the camera recognition range of any smart home appliance that supports gesture recognition, thereby controlling the target smart home appliance. This facilitates user control of smart home appliances in the home environment. It is understood that the target smart home appliance can be either a smart home appliance that supports gesture recognition or one that does not, as long as it is connected to the smart home system. Gesture actions and gesture action identifiers are pre-assigned. Gesture action identifiers can be defined by the user or automatically defined according to certain rules. Understandably, each gesture action identifier is unique within the smart home system.

[0033] Step 260: Generate home appliance control information based on the timing of the user gesture image and the gesture action identifier.

[0034] The process involves recognizing the user's gesture in the image and outputting the corresponding gesture identifier. This identifier then indicates the target smart home appliance and its corresponding function. Whether the gesture indicates the target smart home appliance first or the function control first can be a system default or user-defined. In one implementation, if the gesture indicating the target smart home appliance and the gesture indicating the function control are separate, the order of the gestures does not need to be specified. For example, typically, following the usual practice of controlling devices, the target smart home appliance is indicated first, followed by the function control. The gesture identifiers are then sorted according to the order in which the user performs the gestures to obtain the appliance control information; that is, the appliance control signal includes both the target smart home appliance and the function control.

[0035] Step 280: If the home appliance control information does not belong to the preset control information of the device, the home appliance control information is sent to the control center so that the control center controls the corresponding smart home appliance according to the home appliance control information.

[0036] Users can control smart home appliances by making gestures. Therefore, the smart home appliance receiving the gesture first determines whether the user's gesture indicates a direct control of the device itself or another smart home appliance. The device stores preset control information locally, including its own device identifier and its functional identifiers. The gesture indicating the target smart home appliance is compared to the device's local identifier to determine if the gesture instructs the device to perform the corresponding function. If the control information does not instruct the device to perform the corresponding function, it is not part of the device's preset control information. In other words, if the user wants to control a smart home appliance other than the device itself, the device will send the control information to a control center, which will then control the corresponding smart home appliance based on the information. The control center can be a cloud server or a control device within the home system.

[0037] In an optional implementation, before recognizing the gesture action in the user gesture image and determining the gesture action identifier corresponding to the gesture action, the method further includes: The system receives and stores a gesture recognition model sent by the server, wherein the gesture recognition model is configured to recognize a preset gesture and output a gesture identifier corresponding to the preset gesture.

[0038] The gesture recognition algorithms for multiple gestures can be compiled into a single gesture action recognition model, which is deployed locally on each smart home appliance that supports gesture recognition. After recognizing the user's gesture action, the gesture action recognition model outputs a gesture action identifier corresponding to the preset gesture action. Gestures can be static or dynamic (i.e., gesture transformations), and accordingly, the gesture action recognition model can include a static gesture recognition module and a dynamic gesture recognition module.

[0039] In an optional implementation, recognizing the gesture action in the user's gesture image and determining the gesture action identifier corresponding to the gesture action includes: The local gesture recognition model is invoked to recognize the gesture in the user's gesture image; If the gesture action in the user's gesture image is successfully recognized, the gesture action identifier output by the gesture action recognition model is obtained.

[0040] This involves acquiring the gesture recognition model's output gesture identifiers to generate control information for home appliances.

[0041] In an optional implementation, generating home appliance control information based on the timing of the user gesture image and the gesture action identifier includes: Arrange the corresponding gesture action identifiers into an identifier string according to the time sequence of the user gesture images; A preset separator is inserted between adjacent gesture action icons to obtain the control information of the home appliance.

[0042] If gestures indicating the target smart home appliance and gestures indicating functions are not isolated, then the order of these gestures needs to be defined. This improves gesture utilization and reduces the user's learning curve. In this case, the corresponding gesture action identifiers need to be arranged into an identifier string according to the sequence of the user's gesture images to determine the meaning of the gesture action instructions in order. To distinguish multiple gestures, a preset separator is inserted between adjacent gesture action identifiers; the preset separator can be a comma or a space.

[0043] In an optional implementation, the step of sending the home appliance control information to the control center if the control information does not belong to the device's local preset control information includes: Determine whether the preset position gesture action identifier in the home appliance control information is the same as the device identifier on the local device. If the preset position gesture action identifier is different from the device identifier, it is determined that the home appliance control information does not belong to the preset control information local to the device.

[0044] The preset position gesture action identifier is determined according to the order of the gestures used to indicate the target smart home appliance and the gestures used to indicate the function. If the target smart home appliance is indicated first, the preset position gesture action identifier is the first gesture action identifier; if the target smart home appliance is indicated later, the preset position gesture action identifier is the last gesture action identifier.

[0045] In an optional implementation, after determining whether the preset position gesture action identifier in the home appliance control information is the same as the device identifier locally on the device, the method further includes: If the preset position gesture action identifier is the same as the device identifier, it is determined that the home appliance control information belongs to the preset control information local to the device. At least one gesture action identifier other than the preset position gesture action identifier in the control information of the home appliance is obtained and matched with the preset operation identifier of the device to obtain the operation identifier matching result; wherein, the preset operation identifier of the device is the identifier corresponding to the function supported by the device itself.

[0046] Based on the operation identifier matching result, execute the device function corresponding to the preset operation identifier.

[0047] In an optional implementation, after invoking the local gesture recognition model to recognize the gesture in the user gesture image, the method further includes: If the gesture action in the user gesture image is not successfully recognized, at least two user gesture images will be sent to the server; Obtain the gesture recognition results from the server.

[0048] Due to the limited computing power of smart home appliances, gesture recognition may fail. There's also the issue of outdated gesture recognition algorithms; some smart home appliances may not have received the latest version of the gesture recognition model. Therefore, if gesture recognition fails, the smart home appliance sends the user's gesture image to a server for recognition. The server then returns the gesture recognition result. If the server succeeds, the result is the corresponding gesture identifier. If the server also fails, it indicates that the gesture itself may be incorrect, or the quality of the user's gesture image may not meet recognition requirements, and the user can be prompted to repeat the gesture.

[0049] According to another aspect of the embodiments of this application, such as Figure 4The diagram shows the structure of a smart home appliance control device, which includes: The gesture image acquisition module 420 is used to acquire at least two user gesture images through a camera device; The gesture action identifier determination module 440 is used to identify the gesture action in the user gesture image and determine the gesture action identifier corresponding to the gesture action; The home appliance control information generation module 460 is used to generate home appliance control information based on the timing of the user's gesture image and the gesture action identifier. The home appliance control information sending module 480 is used to send the home appliance control information to the control center if the home appliance control information does not belong to the preset control information of the device, so that the control center can control the corresponding smart home appliance according to the home appliance control information.

[0050] In one optional implementation, the smart home appliance control device further includes: The gesture recognition model storage module is used to receive and store a gesture recognition model sent by the server before recognizing the gesture in the user's gesture image and determining the gesture identifier corresponding to the gesture. The gesture recognition model is set to recognize a preset gesture and output the gesture identifier corresponding to the preset gesture.

[0051] In an optional implementation, the gesture action identification module is specifically used for: The local gesture recognition model is invoked to recognize the gesture in the user's gesture image; If the gesture action in the user's gesture image is successfully recognized, the gesture action identifier output by the gesture action recognition model is obtained.

[0052] In one optional implementation, the home appliance control information generation module is specifically used for: Arrange the corresponding gesture action identifiers into an identifier string according to the time sequence of the user gesture images; A preset separator is inserted between adjacent gesture action icons to obtain the control information of the home appliance.

[0053] In one optional implementation, the home appliance control information sending module includes: The device identification determination unit is used to determine whether the preset position gesture action identifier in the control information of the home appliance is the same as the device identifier in the local device; The first local information matching and determination unit is used to determine that the home appliance control information does not belong to the preset control information of the device locality if the preset position gesture action identifier is not the same as the device identifier.

[0054] In one optional implementation, the smart home appliance control device further includes: The second local information matching and determination module is used to determine, after determining whether the preset position gesture action identifier in the home appliance control information is the same as the device identifier in the local device, that the home appliance control information belongs to the preset control information in the local device if the preset position gesture action identifier is the same as the device identifier. The operation identifier matching result determination module is used to obtain at least one gesture action identifier other than the preset position gesture action identifier in the control information of the home appliance, and match it with the preset operation identifier of the device to obtain the operation identifier matching result. The device function execution module is used to execute the device function corresponding to the preset operation identifier according to the operation identifier matching result.

[0055] In one optional implementation, the smart home appliance control device further includes: The user gesture image sending module is used to send at least two user gesture images to the server after the local gesture action recognition model is invoked to recognize the user gesture action in the user gesture image. If the user gesture action in the user gesture image is not successfully recognized, the module is used to send the user gesture image to the server. The gesture recognition result acquisition module is used to acquire the gesture recognition results of the server.

[0056] According to another aspect of the embodiments of the present invention, Figure 5 A schematic diagram of the structure of an electronic device provided in an embodiment of the present invention, such as... Figure 5 As shown, the electronic device includes a processor 510, a memory 520, an input device 530, and an output device 540; the number of processors 510 in the electronic device can be one or more. Figure 5 Taking a processor 510 as an example; the processor 510, memory 520, input device 530, and output device 540 in the electronic device can be connected via a bus or other means. Figure 5 Taking the example of a connection between China and Israel via a bus.

[0057] The memory 520, as a computer-readable storage medium, can be used to store software programs, computer-executable programs, and modules, such as program instructions / modules corresponding to the voice interaction method in this embodiment of the invention (e.g., feature acquisition module 410, rejection judgment module 420, and interaction response module 430 in the voice interaction device). The processor 510 executes various functional applications and data processing of the electronic device by running the software programs, instructions, and modules stored in the memory 520, thereby realizing the above-mentioned intelligent home appliance control method.

[0058] The memory 520 may primarily include a program storage area and a data storage area. The program storage area may store the operating system and at least one application program required for a given function; the data storage area may store data created based on terminal usage. Furthermore, the memory 520 may include high-speed random access memory and non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state storage device. In some instances, the memory 520 may further include memory remotely located relative to the processor 510, which can be connected to the electronic device via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

[0059] Input device 530 can be used to receive input digital or character information, and generate key signal inputs related to user settings and function control of the electronic device. It can also be a camera for acquiring images and a sound pickup device for acquiring audio data. Output device 540 may include display devices such as a screen, and audio devices such as a speaker. It should be noted that the specific composition of input device 530 and output device 540 can be set according to actual conditions. Processor 510 executes various functional applications and data processing of the electronic device by running software programs, instructions, and modules stored in memory 520.

[0060] According to another aspect of the present invention, the present invention also provides a computer-readable storage medium comprising a stored program, wherein the program, when executed, performs the following intelligent home appliance control method: Acquire at least two user gesture images using a camera device; Identify the hand gestures in the user's hand gesture image and determine the hand gesture identifier corresponding to the hand gesture; Based on the timing of the user's gesture images and the gesture action identifiers, control information for home appliances is generated. If the control information of the home appliance is not the preset control information of the device, the control information of the home appliance is sent to the control center so that the control center controls the corresponding smart home appliance according to the control information of the home appliance.

[0061] Of course, the computer-executable instructions provided in the embodiments of the present invention are not limited to the method operations described above, but can also perform related operations in the smart home appliance control method provided in any embodiment of the present invention.

[0062] Based on the above description of the implementation methods, those skilled in the art can clearly understand that the present invention can be implemented using software and necessary general-purpose hardware, and of course, it can also be implemented using hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as a computer floppy disk, read-only memory (ROM), random access memory (RAM), flash memory, hard disk, or optical disk, etc., including several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0063] It is worth noting that in the embodiments of the above-mentioned intelligent home appliance control device, the various units and modules included are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the scope of protection of the present invention.

[0064] The above description is only a preferred embodiment of this application. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of this application, and these improvements and modifications should also be considered within the scope of protection of this application.

Claims

1. A method for controlling intelligent home appliances, characterized in that, include: Acquire at least two user gesture images using a camera device; Identify the hand gestures in the user's hand gesture image and determine the hand gesture identifier corresponding to the hand gesture; Based on the timing of the user's gesture images and the gesture action identifiers, control information for home appliances is generated. If the control information of the home appliance is not the preset control information of the device, the control information of the home appliance is sent to the control center so that the control center controls the corresponding smart home appliance according to the control information of the home appliance.

2. The intelligent home appliance control method according to claim 1, characterized in that, Before recognizing the gesture action in the user gesture image and determining the gesture action identifier corresponding to the gesture action, the method further includes: The system receives and stores a gesture recognition model sent by the server, wherein the gesture recognition model is configured to recognize a preset gesture and output a gesture identifier corresponding to the preset gesture.

3. The intelligent home appliance control method according to claim 2, characterized in that, The step of recognizing gesture actions in the user's gesture image and determining the gesture action identifier corresponding to the gesture action includes: The local gesture recognition model is invoked to recognize the gesture in the user's gesture image; If the gesture action in the user's gesture image is successfully recognized, the gesture action identifier output by the gesture action recognition model is obtained.

4. The intelligent home appliance control method according to claim 1, characterized in that, The step of generating home appliance control information based on the timing of the user's gesture image and the gesture action identifier includes: Arrange the corresponding gesture action identifiers into an identifier string according to the time sequence of the user gesture images; A preset separator is inserted between adjacent gesture action icons to obtain the control information of the home appliance.

5. The intelligent home appliance control method according to claim 1, characterized in that, If the control information of the home appliance is not the preset control information of the device, the control information of the home appliance will be sent to the control center, including: Determine whether the preset position gesture action identifier in the home appliance control information is the same as the device identifier on the local device. If the preset position gesture action identifier is different from the device identifier, it is determined that the home appliance control information does not belong to the preset control information local to the device.

6. The intelligent home appliance control method according to claim 5, characterized in that, After determining whether the preset position gesture action identifier in the home appliance control information is the same as the device identifier locally on the device, the method further includes: If the preset position gesture action identifier is the same as the device identifier, it is determined that the home appliance control information belongs to the preset control information local to the device. Obtain at least one gesture action identifier other than the preset position gesture action identifier in the control information of the home appliance, and match it with the preset operation identifier of the device to obtain the operation identifier matching result; Based on the operation identifier matching result, execute the device function corresponding to the preset operation identifier.

7. The intelligent home appliance control method according to claim 3, characterized in that, After calling the local gesture recognition model to recognize the gesture in the user's gesture image, the method further includes: If the gesture action in the user gesture image is not successfully recognized, at least two user gesture images will be sent to the server; Obtain the gesture recognition results from the server.

8. A smart home appliance control device, characterized in that, include: A gesture image acquisition module is used to acquire at least two user gesture images via a camera device; The gesture action identifier determination module is used to identify the gesture action in the user gesture image and determine the gesture action identifier corresponding to the gesture action; The home appliance control information generation module is used to generate home appliance control information based on the timing of the user's gesture image and the gesture action identifier. The home appliance control information sending module is used to send the home appliance control information to the control center if the home appliance control information does not belong to the preset control information of the device, so that the control center can control the corresponding smart home appliance according to the home appliance control information.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored program, wherein the program, when executed, performs the smart home appliance control method according to any one of claims 1 to 7.

10. An electronic device comprising a memory and a processor, characterized in that, The memory stores a computer program, and the processor is configured to execute the smart home appliance control method according to any one of claims 1 to 7 through the computer program.

Images