Method and device for refrigerator control, refrigerator
The user's gestures and body area information are obtained through image recognition technology, and the door body on the refrigerator is accurately positioned, which solves the problem of difficulty in accurately positioning and controlling multiple refrigerator door bodies in the prior art, and realizes efficient contactless control and intelligent operation of the refrigerator.
Patent Information
- Application Number
- CN202010348275.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-04-28
- Publication Date
- 2025-05-30
- Estimated Expiration
- 2040-04-28
AI Technical Summary
It is difficult to accurately locate each door body in the refrigerator and then perform contactless control, especially when there are multiple areas on the refrigerator.
By obtaining the video information of the user within the set range of the refrigerator, performing image recognition, determining the user's current gesture information and body area information, and then matching the door to be controlled on the refrigerator and controlling it.
It realizes non-contact control of the refrigerator, accurately locates and individually controls different doors on the refrigerator, improving the convenience and intelligence of refrigerator control and improving user experience.
Smart Images

Figure CN113568496B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the technical field of intelligent devices, for example, a method and device for refrigerator control, and a refrigerator. Background Art
[0002] With the continuous development of intelligent technology, the functions of refrigerators are becoming more and more powerful, and the user experience is getting better and better. When users are cooking in the kitchen, sometimes it is not convenient to directly operate the refrigerator with greasy hands, so a non-contact operation method is needed to control the refrigerator.
[0003] Currently, there are various ways to control the refrigerator non-contact, such as: through a remote control device, a hand-worn sensing device, or gesture control. However, with the development of precise temperature control technology for refrigerators, the refrigerator may be divided into two or more areas, and each area corresponds to a door body, for example: a refrigerating door body, a freezing door body, and a variable-temperature door body. At present, it is still difficult to accurately locate each door body by current gesture control, and then perform corresponding non-contact control. Summary of the Invention
[0004] To have a basic understanding of some aspects of the disclosed embodiments, a simple summary is given below. The summary is not a general review, nor is it intended to identify key / important constituent elements or delineate the protection scope of these embodiments, but rather serves as a preface to the subsequent detailed description.
[0005] Embodiments of the present disclosure provide a method, device, and refrigerator for refrigerator control to solve the technical problem of non-contact control of a refrigerator with at least two doors.
[0006] In some embodiments, the method includes:
[0007] Obtain video information of a user within a set range of the refrigerator;
[0008] Perform image recognition on the video information to determine the current gesture information and body area information of the user;
[0009] Determine a door to be controlled on the refrigerator that matches the gesture action area according to the current gesture information and the body area information;
[0010] Control the operation of the door to be controlled according to the current gesture information.
[0011] In some embodiments, the device includes:
[0012] A video acquisition module configured to obtain video information of a user within a set range of the refrigerator;
[0013] An identification and determination module, configured to perform image recognition on the video information to determine the current gesture information and body area information of the user;
[0014] A door body determination module, configured to determine the door to be controlled on the refrigerator that matches the gesture action area according to the current gesture information and the body area information;
[0015] A control module, configured to control the operation of the door to be controlled according to the current gesture information.
[0016] In some embodiments, the device for refrigerator control includes a processor and a memory storing program instructions. The processor is configured to execute the above-mentioned method for refrigerator control when executing the program instructions.
[0017] In some embodiments, the refrigerator includes the above-mentioned device for refrigerator control.
[0018] The method, device and refrigerator for refrigerator control provided by the embodiments of the present disclosure can achieve the following technical effects:
[0019] Through image recognition, not only can the gesture information of the refrigerator user be determined, but also the gesture action area of the gesture relative to the user's body can be determined. In this way, according to the gesture information, the door on the refrigerator that matches the gesture action area can be controlled to run independently. Thus, not only can non-contact control of the refrigerator be achieved, but also each door body in the refrigerator can be accurately positioned, and then different door bodies on the refrigerator can be controlled separately, further improving the convenience and intelligence of refrigerator control and also improving the user experience.
[0020] The above general description and the following description are only exemplary and explanatory, and are not used to limit the present application. Description of the Drawings
[0021] One or more embodiments are exemplarily illustrated by corresponding drawings. These exemplary illustrations and the drawings do not constitute a limitation on the embodiments. Elements with the same reference numerals in the drawings are shown as similar elements. The drawings do not constitute a scale limitation, and among them:
[0022] Figure 1 is a schematic flowchart of a method for refrigerator control provided by an embodiment of the present disclosure;
[0023] Figure 2 is a schematic diagram of a body rectangular area and a refrigerator door provided by an embodiment of the present disclosure;
[0024] Figure 3 is a schematic flowchart of a method for refrigerator control provided by an embodiment of the present disclosure;
[0025] Figure 4 It is a schematic structural diagram of a refrigerator control device provided by an embodiment of the present disclosure;
[0026] Figure 5 It is a schematic structural diagram of a refrigerator control device provided by an embodiment of the present disclosure;
[0027] Figure 6 It is a schematic structural diagram of a refrigerator control device provided by an embodiment of the present disclosure. Detailed implementation manners
[0028] In order to be able to understand the features and technical content of the embodiments of the present disclosure in more detail, the implementation of the embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. The accompanying drawings are only for reference and illustration purposes and are not used to limit the embodiments of the present disclosure. In the following technical descriptions, for the sake of explanation, numerous details are provided to give a thorough understanding of the disclosed embodiments. However, one or more embodiments may still be implemented without these details. In other cases, well-known structures and devices may be shown in a simplified manner to simplify the drawings.
[0029] In the embodiments of the present disclosure, terms such as "first" and "second" in the specification, claims and the above-mentioned drawings are used to distinguish similar objects and do not necessarily need to describe a specific order or sequence. It should be understood that such data can be interchanged under appropriate circumstances so as to implement the embodiments of the present disclosure described herein. In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion.
[0030] Unless otherwise specified, the term "plurality" means two or more.
[0031] In the embodiments of the present disclosure, the character " / " indicates that the objects before and after are in an "or" relationship. For example, A / B means: A or B.
[0032] The term "and / or" is an associative relationship describing objects and indicates that three relationships can exist. For example, A and / or B means: A or B, or, A and B these three relationships.
[0033] In the embodiments of the present disclosure, there are two or more doors in the refrigerator. According to different gestures of the refrigerator user, different movements of the doors can be controlled, such as: opening or closing. Moreover, the individual movement of each door body can also be controlled by gestures, further improving the convenience and intelligence of refrigerator control and also improving the user experience.
[0034] Figure 1 It is a schematic flowchart of a refrigerator control method provided by an embodiment of the present disclosure. As Figure 1 shown, the process for refrigerator control includes:
[0035] Step 101: Obtain the video information of users within the set range of the refrigerator.
[0036] Currently, an image acquisition device can be configured on the refrigerator to collect the video information of users within the set range. For example, the video information of users within the set range of the refrigerator can be obtained through a camera embedded in the refrigerator panel.
[0037] The image acquisition device can collect the video information of users in real time or be activated only after meeting the set conditions. Therefore, in some embodiments, when the human body sensor configured on the refrigerator determines that there is a user within the set range of the refrigerator, the image acquisition device is activated to obtain the corresponding video information of the user. Among them, the human body sensor can include: an infrared sensor, a photoelectric sensor, etc., and will not be listed one by one here.
[0038] Step 102: Perform image recognition on the video information to determine the current gesture information and body area information of the user.
[0039] Performing image recognition on each frame of the obtained video information can not only determine the hand position information of the hand in each frame of the image, but also determine the position information of other parts of the body, such as: head position information, shoulder position information, waist position information, and leg position information, etc., one, two or more of these information. Then, according to the hand position information in each frame of the image, the hand movement estimation information, that is, the current gesture information, can be obtained. Then, according to the position information of the body parts in each frame of the image, the body area information can be determined, which can include: the position information of each feature point, such as: the highest position information, the lowest position information, the leftmost position information, and the rightmost position information, etc.; or, the position information at the top of the head, the boundary position information at the fingertips, the knee joint position information, etc.
[0040] Existing image recognition processes can all be applied to this step and will not be listed one by one here.
[0041] Step 103: Determine the door to be controlled on the refrigerator that matches the gesture action area according to the current gesture information and the body area information.
[0042] After obtaining the current gesture information and the body area information, the action area of the gesture relative to the body can be determined. For example: the hand moves within the upper half range of the body, that is, the action area of the gesture relative to the body is the upper body area, or the action area of the gesture relative to the body is the lower body area. Of course, this embodiment is not limited to this. Different area divisions of the body can determine different gesture action areas. For example: it can be divided into two areas, three areas, four areas, six areas, etc.
[0043] The body area can be divided according to the model of the refrigerator. Further, the body area can be divided according to the door body of the refrigerator. Therefore, in the embodiments of the present disclosure, the correspondence between the body area and the refrigerator door can also be configured and saved. The body area can specifically be rectangular, square or circular. In some embodiments, the first correspondence between the rectangular body area and the refrigerator door can be saved.
[0044] Figure 2 It is a schematic diagram of a rectangular body area and a refrigerator door in the embodiments of the present disclosure. As Figure 2 shown, the human body can be divided into six body areas, namely: the upper left rectangular body area ①, the upper right rectangular body area ②, the left middle rectangular body area ③, the right middle rectangular body area ④, the lower left rectangular body area ⑤, and the lower right rectangular body area ⑥. And there are four doors on the refrigerator, namely the upper left refrigerating door ①, the upper right refrigerating door ②, the variable temperature control door ③, and the freezing door ④.
[0045] Table 1 is the first correspondence between the rectangular body area and the refrigerator door in the embodiments of the present disclosure.
[0046]
[0047] Table 1
[0048] After saving the first correspondence between the rectangular body area and the refrigerator door, determining the door to be controlled on the refrigerator that matches the gesture action area can include: forming at least two rectangular body areas according to the body area information; determining the current rectangular body area of the gesture relative to the body in the current gesture information; and determining the door to be controlled that matches the current rectangular body area according to the saved first correspondence.
[0049] For example: if the correspondence shown in Table 1 is saved, six rectangular body areas can be formed according to the body area information, which can include forming six rectangular body areas as Figure 2 shown according to the feature point position information such as the position information at the top of the head, the boundary position information at the fingertips, and the knee joint position information in the body area information. Then, count the position information of the hand in the current gesture information, and determine the current rectangular body area of the gesture relative to the body as the rectangular body area where the hand position information appears most frequently. Finally, determine the door to be controlled that matches the current rectangular body area according to the first correspondence in Table 1. Among them, if the current rectangular body area is the left middle rectangular body area ③, the variable temperature control door ③ is the door to be controlled; if the current rectangular body area is the lower left rectangular body area ⑤, the freezing door ④ is the door to be controlled.
[0050] Step 104: Control the operation of the door to be controlled according to the current gesture information.
[0051] In the embodiments of the present disclosure, a second correspondence between gesture information and door control instructions can be saved. In this way, after determining the door to be controlled, the current door control instruction matching the current gesture information can be determined according to the second correspondence; and the current door control instruction is sent to the driving device corresponding to the door to be controlled to drive the door to be controlled.
[0052] Table 2 shows a first correspondence between gesture information and door control instructions in the embodiments of the present disclosure.
[0053] Gesture information Door control instruction Wave from top to bottom, or, palm open, or,... Opening instruction Wave from bottom to top, or, palm closed, or,... Closing instruction … …
[0054] Table 2
[0055] As shown in Table 2, if the gesture information is a wave from top to bottom, it can be determined that the opening instruction is the current door control instruction; and if the gesture information is the palms closing together, it can be determined that the closing instruction is the current door control instruction. Of course, the embodiments of the present disclosure are not limited to this, and will not be enumerated one by one.
[0056] The movement of the door body is specifically controlled by the corresponding driving device, that is, after determining the current door control instruction according to the second correspondence, the current door control instruction can be sent to the driving device corresponding to the door to be controlled to drive the door to be controlled.
[0057] It can be seen that in this embodiment, through image recognition, not only the gesture information of the refrigerator user can be determined, but also the gesture action area of the gesture relative to the user's body can be determined. In this way, according to the gesture information, the door on the refrigerator matching the gesture action area can be controlled to run independently. Thus, not only the non-contact control of the refrigerator can be realized, but also different door bodies on the refrigerator can be separately controlled, further improving the convenience and intelligence of refrigerator control, and also improving the user experience.
[0058] Of course, in this embodiment, a second correspondence can be configured for the entire refrigerator, or different second correspondences can be configured for each door body of the refrigerator. In this way, different gestures can control different movements of different doors, further improving the flexibility of gesture control of the refrigerator.
[0059] Next, the operation process will be incorporated into specific embodiments to illustrate the refrigerator control process provided by the embodiments of the present invention.
[0060] In an embodiment of the present disclosure, there are four doors in the refrigerator as Figure 2 shown, and a camera and an infrared human body sensor are embedded in the panel, and the corresponding relationships shown in Table 1 and Table 2 are saved.
[0061] Figure 3 is a schematic flow chart of a method for refrigerator control provided by the embodiments of the present disclosure. Combining Figure 3 , the process for refrigerator control includes:
[0062] Step 301: Determine whether there is a user within the set range of the refrigerator through an infrared human sensor. If so, execute Step 302; otherwise, return to Step 308.
[0063] Step 302: Activate the camera to obtain the video information of the user.
[0064] Step 303: Perform image recognition on each frame of the video information to determine the current gesture information and body area information of the user.
[0065] Step 304: According to the body area information, form six body rectangular areas and determine the current body rectangular area of the gesture relative to the body in the current gesture information.
[0066] Step 305: According to the first correspondence relationship between the saved body rectangular area and the refrigerator door, determine the door to be controlled that matches the current rectangular body area.
[0067] Step 306: According to the second correspondence relationship between the saved gesture information and the door control instruction, determine the current door control instruction that matches the current gesture information.
[0068] Step 307: Send the current door control instruction to the drive device corresponding to the door to be controlled to drive the door to be controlled.
[0069] Step 308: Keep the camera in the off state.
[0070] In this embodiment, for example, when the user's hand waves from top to bottom in the upper right of the body, according to the first correspondence relationship in Table 1, the upper right refrigerating door ② can be determined as the door to be controlled. According to the second correspondence relationship in Table 2, the opening instruction can be determined as the current door control instruction. Thus, the upper right refrigerating door on the refrigerator can be controlled to open.
[0071] It can be seen that in this embodiment, there are six doors in the refrigerator. According to different gestures of the user in different areas, the individual movement of each door can be controlled, improving the convenience and intelligence of refrigerator control and also enhancing the user experience.
[0072] According to the above process for refrigerator control, a device for refrigerator control can be constructed.
[0073] Figure 4 It is a schematic structural diagram of a device for refrigerator control provided by an embodiment of the present disclosure. As Figure 4 shown, the device for refrigerator control includes: a video acquisition module 410, an identification and determination module 420, a door body determination module 430, and a control module 440.
[0074] The video acquisition module 410 is configured to acquire the video information of the user located within the set range of the refrigerator.
[0075] An identification and determination module 420, configured to perform image recognition on video information to determine the current gesture information and body area information of the user.
[0076] A door body determination module 430, configured to determine the door to be controlled on the refrigerator that matches the gesture action area according to the current gesture information and body area information.
[0077] A control module 440, configured to control the operation of the door to be controlled according to the current gesture information.
[0078] In some embodiments, the device further includes: a configuration saving module, configured to save a first correspondence between the body rectangular area and the refrigerator door, and save a second correspondence between the gesture information and the door control instruction.
[0079] In some embodiments, the door body determination module 430 is specifically configured to form at least two body rectangular areas according to the body area information; determine the current body rectangular area of the gesture relative to the body in the current gesture information; and determine the door to be controlled that matches the current rectangular body area according to the saved first correspondence.
[0080] In some embodiments, the control module 440 is specifically configured to determine the current door control instruction that matches the current gesture information according to the second correspondence; and send the current door control instruction to the driving device corresponding to the door to be controlled to drive the door to be controlled.
[0081] The following is an example to illustrate the refrigerator control process using the refrigerator control device provided by the embodiments of the present disclosure.
[0082] Figure 5 It is a schematic structural diagram of a refrigerator control device provided by the embodiments of the present disclosure. As Figure 5 shown, the refrigerator control device includes: a video acquisition module 410, an identification and determination module 420, a door body determination module 430, a control module 440, and a configuration saving module 450.
[0083] Among them, the refrigerator may include two or more doors. Thus, the configuration saving module 450 can save a first correspondence between the body rectangular area and the refrigerator door according to the refrigerator door body information. Of course, it can also save a second correspondence between the gesture information and the door control instruction.
[0084] In this way, the video acquisition unit 410 can obtain the video information of the user within the set range of the refrigerator in real time. Thus, the recognition and determination module 420 can perform image recognition on each frame of the video information to determine the current gesture information and body area information of the user. Therefore, the door determination module 430 first forms six body rectangular areas based on the body area information and determines the current body rectangular area of the gesture relative to the body in the current gesture information. Then, according to the first correspondence relationship between the body rectangular area saved by the configuration storage module 450 and the refrigerator door, it determines the door to be controlled that matches the current rectangular body area. Therefore, the control module 440 can first determine the current door control instruction that matches the current gesture information according to the second correspondence relationship between the gesture information saved by the configuration storage module 450 and the door control instruction, and then send the current door control instruction to the drive device corresponding to the door to be controlled to drive the door to be controlled.
[0085] It can be seen that in this embodiment, the refrigerator control device can, through image recognition, not only determine the gesture information of the refrigerator user, but also determine the gesture action area of the gesture relative to the user's body. In this way, according to the gesture information, the door on the refrigerator that matches the gesture action area can be controlled to operate independently. Thus, not only can non-contact control of the refrigerator be realized, but also different doors on the refrigerator can be controlled separately, further improving the convenience and intelligence of refrigerator control and also enhancing the user experience.
[0086] An embodiment of the present disclosure provides a device for refrigerator control, the structure of which is as Figure 6 shown, including:
[0087] A processor 100 and a memory 101, and may further include a communication interface 102 and a bus 103. Among them, the processor 100, the communication interface 102, and the memory 101 can complete mutual communication through the bus 103. The communication interface 102 can be used for information transmission. The processor 100 can call the logic instructions in the memory 101 to execute the method for refrigerator control in the above embodiment.
[0088] In addition, when the logic instructions in the above-mentioned memory 101 are implemented in the form of a software functional unit and sold or used as an independent product, they can be stored in a computer-readable storage medium.
[0089] The memory 101, as a computer-readable storage medium, can be used to store software programs and computer-executable programs, such as the program instructions / modules corresponding to the method in the embodiment of the present disclosure. The processor 100 executes functional applications and data processing by running the program instructions / modules stored in the memory 101, that is, implements the method for refrigerator control in the above method embodiment.
[0090] The memory 101 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system and application programs required for at least one function; the data storage area may store data created according to the use of the terminal device, etc. In addition, the memory 101 may include a high-speed random access memory and may also include a non-volatile memory.
[0091] An embodiment of the present disclosure provides a refrigerator including the above-mentioned device for controlling a refrigerator.
[0092] An embodiment of the present disclosure provides a computer-readable storage medium storing computer-executable instructions, and the computer-executable instructions are configured to execute the above-mentioned method for controlling a refrigerator.
[0093] An embodiment of the present disclosure provides a computer program product. The computer program product includes a computer program stored on a computer-readable storage medium. The computer program includes program instructions, and when the program instructions are executed by a computer, the computer is caused to execute the above-mentioned method for controlling a refrigerator.
[0094] The above-mentioned computer-readable storage medium may be a transient computer-readable storage medium or a non-transient computer-readable storage medium.
[0095] The technical solution of the embodiment of the present disclosure may be embodied in the form of a software product. The computer software product is stored in a storage medium and includes one or more instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in the embodiment of the present disclosure. The foregoing storage medium may be a non-transient storage medium, including: various media such as a USB flash drive, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk, or an optical disc that can store program codes, or may also be a transient storage medium.
[0096] The above description and the accompanying drawings fully illustrate the embodiments of the present disclosure, enabling those skilled in the art to practice them. Other embodiments may include structural, logical, electrical, process, and other changes. The embodiments merely represent possible variations. Unless explicitly required, individual components and functions are optional, and the order of operations may vary. Parts and features of some embodiments may be included in or replace parts and features of other embodiments. The scope of the embodiments of the present disclosure includes the entire scope of the claims and all available equivalents of the claims. When used in this application, although terms such as "first", "second", etc. may be used in this application to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, without changing the meaning of the description, the first element may be called the second element, and similarly, the second element may be called the first element, as long as all occurrences of "the first element" are consistently renamed and all occurrences of "the second element" are consistently renamed. The first element and the second element are both elements, but they may not be the same element. Moreover, the terms used in this application are only for describing the embodiments and are not used to limit the claims. As used in the description of the embodiments and the claims, unless the context clearly indicates otherwise, the singular forms "a", "an", and "the" are intended to also include the plural forms. Similarly, as used in this application, the term "and / or" refers to any and all possible combinations including one or more of the associated listed items. Additionally, when used in this application, the term "comprise" and its variants "comprises" and / or "comprising" etc. mean the presence of the stated features, wholes, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components, and / or groups thereof. Without further limitation, an element defined by the statement "comprising one..." does not exclude the presence of additional identical elements in the process, method, or device comprising the element. In this article, what each embodiment focuses on may be the differences from other embodiments, and the same or similar parts among the embodiments may be referred to each other. For the methods, products, etc. disclosed in the embodiments, if they correspond to the method part disclosed in the embodiments, the relevant parts may refer to the description of the method part.
[0097] Those skilled in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed in a hardware or software manner may depend on the specific application and design constraints of the technical solution. The skilled person can use different methods for each specific application to implement the described functions, but such implementation should not be considered to exceed the scope of the embodiments of the present disclosure. The skilled person can clearly understand that for the convenience and conciseness of description, the specific working processes of the systems, devices, and units described above can refer to the corresponding processes in the foregoing method embodiments and will not be elaborated herein.
[0098] In the embodiments disclosed herein, the disclosed methods, products (including but not limited to devices, equipment, etc.) can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units can be merely a logical function division, and there can be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Additionally, the displayed or discussed couplings or direct couplings or communication connections to each other can be through some interfaces. The indirect couplings or communication connections of devices or units can be in electrical, mechanical, or other forms. The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they can be located in one place or distributed to multiple network units. Some or all of the units can be selected according to actual needs to implement this embodiment. Additionally, in the embodiments of the present disclosure, the various functional units can be integrated in one processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit.
[0099] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a segment of code, or a portion thereof that contains one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions noted in the blocks may occur in a different order than noted in the accompanying drawings. For example, two consecutive blocks may actually be executed substantially in parallel, or they may sometimes be executed in the reverse order, depending on the functions involved. In the descriptions corresponding to the flowcharts and block diagrams in the accompanying drawings, the operations or steps corresponding to different blocks may also occur in a different order than disclosed in the description, and sometimes there is no specific order between different operations or steps. For example, two consecutive operations or steps may actually be executed substantially in parallel, or they may sometimes be executed in the reverse order, depending on the functions involved. Each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented by a dedicated hardware-based system that performs the specified functions or actions, or can be implemented by a combination of dedicated hardware and computer instructions.
Claims
1. A method for refrigerator control, characterized in that, the refrigerator includes at least two doors, including: Obtain video information of the user within the set range of the refrigerator; Perform image recognition on the video information to determine the current gesture information and body area information of the user; According to the current gesture information and the body area information, determine the door to be controlled on the refrigerator that matches the gesture action area; Control the operation of the door to be controlled according to the current gesture information; Wherein, the determination of the door to be controlled on the refrigerator that matches the gesture action area includes: According to the body area information, form at least two body rectangular areas; determine the current body rectangular area of the gesture relative to the body in the current gesture information; according to the saved first correspondence between the body rectangular area and the refrigerator door, determine the door to be controlled that matches the current rectangular body area, wherein the body area is rectangular.
2. The method according to claim 1, characterized in that, Before obtaining the video information of the user within the set range of the refrigerator, it further includes: Save the first correspondence between the body rectangular area and the refrigerator door, and save the second correspondence between the gesture information and the door control instruction.
3. The method according to claim 2, characterized in that, The control of the operation of the door to be controlled includes: According to the second correspondence, determine the current door control instruction that matches the current gesture information; Send the current door control instruction to the driving device corresponding to the door to be controlled to drive the door to be controlled.
4. A device for refrigerator control, characterized in that, the refrigerator includes at least two doors, including: A video acquisition module configured to acquire video information of the user within the set range of the refrigerator; An identification and determination module configured to perform image recognition on the video information to determine the current gesture information and body area information of the user; A door body determination module configured to determine the door to be controlled on the refrigerator that matches the gesture action area according to the current gesture information and the body area information; A control module configured to control the operation of the door to be controlled according to the current gesture information; The door body determination module is specifically configured to form at least two body rectangular areas according to the body area information; determine the current body rectangular area of the gesture relative to the body in the current gesture information; according to the saved first correspondence between the body rectangular area and the refrigerator door, determine the door to be controlled that matches the current rectangular body area, wherein the body area is rectangular.
5. The device according to claim 4, characterized in that, It further includes: A configuration saving module configured to save the first correspondence between the body rectangular area and the refrigerator door, and save the second correspondence between the gesture information and the door control instruction.
6. The device according to claim 5, characterized in that, The control module is specifically configured to determine the current door control instruction that matches the current gesture information according to the second correspondence; send the current door control instruction to the driving device corresponding to the door to be controlled to drive the door to be controlled.
7. A device for refrigerator control, the device comprising a processor and a memory storing program instructions, wherein, the processor is configured to execute the method for refrigerator control according to any one of claims 1 to 3 when executing the program instructions.
8. A refrigerator, wherein, it includes the device for refrigerator control according to claim 4 or 7.
Citation Information
Patent Citations
Method for controlling smart home by gesture and system thereof
CN109143875A