Method, device, equipment and storage medium for moving items in refrigerator
By obtaining the characteristic information of items in the refrigerator and generating a recommendation list, controlling the rotation of internal components of the refrigerator, moving items in the refrigerator to the target position, solving the problem of inconvenient acquisition of items in the refrigerator, achieving fast and convenient item acquisition, and enhancing users Experience.
Patent Information
- Application Number
- CN202211742683.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-12-29
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2042-12-29
AI Technical Summary
When using a refrigerator, users need to find and remove ingredients by themselves, especially when there is a lot of food in the refrigerator, they cannot quickly get the food, which is very inconvenient.
By obtaining the characteristic information of the target object in the preset area, a recommendation list of items in the refrigerator is generated, and the target components inside the refrigerator are controlled to rotate, and the target items in the recommended list are moved to the target position to quickly obtain the required items.
It improves the speed and convenience of users to acquire items in the refrigerator, saves user time, and improves user experience.
Smart Images

Figure CN116045602B_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present invention relate to the field of smart home technology, and in particular to a method, device, equipment and storage medium for moving items in a refrigerator. Background Art
[0002] With the continuous development of household appliances, more and more household appliances have entered thousands of households. Among them, refrigerators are products that keep food or other items at a constant low temperature. Due to their functions of making ice and keeping fresh, they are widely used by people.
[0003] Currently, when using a refrigerator, the user needs to search for and take out ingredients from the refrigerator to cook. When there are a lot of foods in the refrigerator, it is very inconvenient to not be able to quickly take out the food. Summary of the invention
[0004] In view of this, in order to solve the above-mentioned technical problem of the inconvenience of taking food from the refrigerator, the embodiments of the present invention provide a method, device, equipment and storage medium for moving items in a refrigerator.
[0005] In a first aspect, an embodiment of the present invention provides a method for moving items in a refrigerator, comprising:
[0006] Obtain feature information of target objects in a preset area;
[0007] generating a recommendation list of items in the refrigerator according to the characteristic information;
[0008] The target component inside the refrigerator is controlled to rotate so as to move the target item in the recommendation list to a target position through the target component.
[0009] In a possible implementation, generating a recommendation list of items in the refrigerator according to the feature information includes:
[0010] Generate a correspondence between a plurality of feature information and a plurality of objects;
[0011] Determine a first item corresponding to the characteristic information from the corresponding relationship;
[0012] When the first item exists in the refrigerator, generating the recommendation list according to the first item;
[0013] or,
[0014] When the first item does not exist in the refrigerator, the recommendation list is generated according to the second item, and prompt information is generated according to the first item and the second item to perform a prompt operation, and the similarity between the second item and the first item is greater than a set threshold.
[0015] In a possible implementation manner, obtaining feature information of a target object in a preset area includes:
[0016] Acquire an image of a target object within a preset area;
[0017] The body features and / or facial features of the target object are extracted from the image as the feature information.
[0018] In a possible implementation, the method further includes:
[0019] determining at least one target item in the refrigerator according to the recommendation list;
[0020] When the target object enters a preset area around the refrigerator, a robotic arm in the refrigerator is controlled to place at least one of the target objects at a target position around the refrigerator door.
[0021] In a possible implementation, the method further includes:
[0022] Obtaining the first moment when the target object is placed in the refrigerator;
[0023] Obtaining a second time at which the recommendation list is generated;
[0024] Determining a storage time of the target item according to the first time and the second time;
[0025] When there are multiple target objects, the target object with the longest storage time is moved to the target location.
[0026] In a possible implementation, the method further includes:
[0027] When the storage time of the plurality of target items is greater than a set threshold, a prompt message is generated to perform a prompt operation;
[0028] The recommendation list is updated according to non-target items, the storage time of the non-target items is less than or equal to the set threshold, and the similarity between the non-target items and the target items is greater than the set threshold.
[0029] In a possible implementation, the method further includes:
[0030] Acquire page information browsed by the target object in a target terminal, where the target terminal corresponds to the refrigerator;
[0031] Extracting keywords corresponding to the items in the refrigerator from the page information;
[0032] generating the recommendation list according to the keyword;
[0033] or,
[0034] Obtaining climate information of the area where the refrigerator is located;
[0035] The recommendation list is generated according to the climate information.
[0036] In a second aspect, an embodiment of the present invention provides a device for moving items in a refrigerator, comprising:
[0037] An acquisition module, used to acquire feature information of a target object in a preset area;
[0038] A processing module, used for generating a recommendation list of items in the refrigerator according to the characteristic information;
[0039] A control module is used to control the rotation of a target component inside the refrigerator so as to move the target item in the recommendation list to a target position through the target component.
[0040] In a third aspect, an embodiment of the present invention provides a device, comprising: a processor and a memory, wherein the processor is used to execute a refrigerator item moving program stored in the memory to implement the refrigerator item moving method described in any one of the first aspects above.
[0041] In a fourth aspect, an embodiment of the present invention provides a storage medium, wherein the storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the method for moving items in a refrigerator as described in any one of the first aspects above.
[0042] The solution for moving items in a refrigerator provided by an embodiment of the present invention obtains characteristic information of target objects in a preset area; generates a recommendation list of items in the refrigerator based on the characteristic information; controls the rotation of a target component inside the refrigerator to move the target items in the recommendation list to a target position through the target component, so as to quickly move the target items required by the user in the refrigerator to the target position, making it convenient for the user to use. BRIEF DESCRIPTION OF THE DRAWINGS
[0043] Figure 1 A schematic diagram of a flow chart of a method for moving items in a refrigerator provided by an embodiment of the present invention;
[0044] Figure 2 A schematic flow chart of another method for moving items in a refrigerator provided by an embodiment of the present invention;
[0045] Figure 3 A schematic flow chart of another method for moving items in a refrigerator provided by an embodiment of the present invention;
[0046] Figure 4A schematic diagram of the structure of a device for moving items in a refrigerator provided by an embodiment of the present invention;
[0047] Figure 5 A schematic diagram of the structure of another device for moving items in a refrigerator provided by an embodiment of the present invention;
[0048] Figure 6 A schematic structural diagram of another device for moving items in a refrigerator provided by an embodiment of the present invention;
[0049] Figure 7 A schematic diagram of the structure of a device provided in an embodiment of the present invention. DETAILED DESCRIPTION
[0050] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0051] To facilitate understanding of the embodiments of the present invention, specific embodiments will be further explained below in conjunction with the accompanying drawings. The embodiments do not constitute a limitation on the embodiments of the present invention.
[0052] Figure 1 A schematic diagram of a flow chart of a method for moving items in a refrigerator provided by an embodiment of the present invention, such as Figure 1 As shown, the method specifically includes:
[0053] S11. Acquire feature information of a target object in a preset area.
[0054] The method for moving items in a refrigerator provided by an embodiment of the present invention is applied to a smart refrigerator, and can also be applied to devices with storage functions, including: storage boxes, lockers, refrigeration equipment, freezer equipment, freezing equipment, etc. Specifically, the refrigerator is controlled by the user's characteristic information to move the target item corresponding to the user to the target position.
[0055] In this embodiment, a preset area is pre-divided, and the preset area can be understood as a recognizable area, that is, the items in the refrigerator can be moved only when the target object appears in the preset area. The area may include but is not limited to the door of the room where the refrigerator is located, the area near the refrigerator, the entrance of the user's house, etc. The location and size of the area can be defined according to actual needs, and this embodiment does not make specific restrictions (for example, a sector-shaped area, a circular area, a square area, etc.).
[0056] The target object is the user of the refrigerator. The facial image (physical image) of the target object is pre-stored inside the refrigerator. When the refrigerator recognizes that the facial image in the preset area is more similar to the pre-stored facial image than the set threshold, it is determined that there is a target object in the preset area.
[0057] The characteristic information is used to characterize the characteristics of the current state of the target object. The user characteristic information can be obtained through an image acquisition device (camera), a temperature acquisition device (temperature sensor), etc. For example, by acquiring a user image, it is determined that the user sweats a lot, which means that the user currently feels hot; by acquiring a user image, it is determined that the user wears thick clothes, which means that the user currently feels cold; by acquiring the user's body temperature, it is determined that the user's body temperature is low, which means that the user currently feels cold.
[0058] Specifically, when an object is detected entering a preset area, the facial image of the object is obtained through the camera and the facial image is sent to the refrigerator. The refrigerator processor determines whether the object is the target object based on the facial image. When the judgment result is yes, the feature information of the target object is obtained through the acquisition device set in the preset area and sent to the refrigerator.
[0059] S12: Generate a recommendation list of items in the refrigerator according to the feature information.
[0060] In this embodiment, the correspondence between characteristic information and items is pre-generated in the refrigerator, and each characteristic information corresponds to at least one item in the refrigerator. The item corresponding to the characteristic information can be set according to the user's preferences (for example, the user's preference is to eat mutton in cold weather, so when the characteristic information is that the user feels cold, the corresponding item is mutton, and the recommendation list generated based on mutton includes mutton and the method of making mutton). The item corresponding to the characteristic information is determined as the target item currently needed by the target object, and a recommendation list is generated for the target item. The recommendation list is used to recommend to the user the target item currently needed by the user in the refrigerator, as well as the method of using the target item. For example, the recommendation list may include: the name of the ingredient, the method of making the ingredient, the method of eating it, a recipe, a menu, etc.
[0061] In one possible implementation, after the recommendation list is generated, the recommendation list is displayed on the screen of the refrigerator or sent to the user's terminal for display. The items in the recommendation list may include items stored in the refrigerator and items not stored in the refrigerator. When an item in the recommendation list is not stored, the item is marked when the recommendation list is displayed (for example, the item is marked in red, or a note is placed behind the item that it is out of stock, etc.). When there are multiple items in the displayed recommendation list, the user's selection operation can be received, and the recommendation list can be updated according to the item selected by the user.
[0062] S13, controlling the target component inside the refrigerator to rotate, so as to move the target item in the recommendation list to a target position through the target component.
[0063] In this embodiment, a rotatable target component is arranged above the partition in each compartment inside the refrigerator and parallel to the partition. The component may be a tray (for example, a circular tray, the area where the tray area is located can be mapped to the area where the partition area is located, and the tray and the partition are connected by bearings so that the tray can be placed on the partition and rotate horizontally. The structure of the tray is similar to that of a revolving dining table, where the tray is a rotatable panel above the revolving dining table, and the partition is the table below the panel). The tray can be driven to rotate by a motor inside the refrigerator, and the tray is divided into multiple areas for placing items, and the shape of the area is not specifically limited.
[0064] Specifically, after the recommendation list is generated, the target compartment where the target item in the recommendation list is located is determined, as well as the position of the target item in the tray in the target compartment, and the tray is controlled to rotate so that the target item is rotated to a target position close to the periphery of the refrigerator door, while driving the items placed on the tray to move to the target position. The target position is a position that is convenient for the user to see and take the target item, so that the user can see the target item at the first time when opening the door.
[0065] The location of the target item can be determined by obtaining an image of the items inside the refrigerator through an image acquisition device inside the refrigerator, searching for the target item from the item image, and then determining the location of the target item in the compartment and the tray. Alternatively, when the user puts the item into the refrigerator, the compartment and the location of each item in the tray are recorded.
[0066] In one possible implementation, the feature information may be sent to a server, and after the recommendation information is generated in the server, it is sent to the refrigerator or the user's terminal for display, and a control instruction is sent to the refrigerator through the server to control the refrigerator to move the target item.
[0067] As an example, when the target object enters the preset area at the entrance, the target object image is obtained, and the current target object feature information is determined based on the image: sweating a lot, feeling hot. At this time, a recommendation list corresponding to the feature information is generated as cola or fruit, and the cola and fruit are sent to the target object's terminal at the same time. The target object's choice is cola, and the tray where the cola is located is controlled to rotate so that the tray rotates the position of the cola to the refrigerator door.
[0068] The method for moving items in a refrigerator provided in an embodiment of the present invention obtains characteristic information of target objects in a preset area; generates a recommendation list of items in the refrigerator based on the characteristic information; controls the rotation of a target component inside the refrigerator to move the target items in the recommendation list to a target position through the target component, so as to quickly generate a recommendation list of target items needed by a user in the refrigerator and move the target items to the target position, making it convenient for the user to find and take items, saving the user's time and improving the user experience.
[0069] Figure 2 A schematic diagram of a flow chart of another method for moving items in a refrigerator provided by an embodiment of the present invention, such as Figure 2 As shown, the method specifically includes:
[0070] S21, obtaining page information browsed by the target object in the target terminal; extracting keywords corresponding to the items in the refrigerator from the page information; and generating the recommendation list according to the keywords.
[0071] In this embodiment, the target terminal is the terminal used by the target object (for example, a smart TV, mobile phone, tablet computer, etc.). The target terminal is associated with the refrigerator or connected via wireless communication. When the characteristic information of the target object cannot be obtained, the needs of the target object can be determined based on the information browsed by the target object and a recommendation list can be generated.
[0072] Specifically, after obtaining the acquisition authority of the target terminal, the information browsed by the user in the previous cycle is obtained as page information at a preset interval (for example, text on the browsed page, images on the browsed page, and audio extracted from the browsed video), and it is determined whether there is information in the page information that is similar to the name of the item stored in the refrigerator. When the judgment result is yes, the keywords corresponding to the items in the refrigerator are extracted from the page information (for example, there is scrambled eggs with tomatoes in the text, audio or image on the page, and the items stored in the refrigerator include tomatoes and eggs, then tomatoes and eggs are used as keywords). A recommendation list is generated based on the keywords.
[0073] In a possible implementation, when the keyword cannot be obtained from the page information, the climate information of the area where the refrigerator is located is obtained; and the recommendation list is generated according to the climate information.
[0074] Specifically, a correspondence between climate information and recommendation lists is pre-generated (for example, the recommendation list corresponding to rainy weather is noodles and methods of making noodles, and the recommendation list corresponding to hot weather is watermelon and cola), the weather of the day in the area where the refrigerator is located is obtained from the network as climate information, and the recommendation list corresponding to the weather information is determined from the correspondence.
[0075] S22. Determine at least one target item in the refrigerator according to the recommendation list; when the target object enters a preset area around the refrigerator, control a robotic arm in the refrigerator to place at least one of the target items at a target position around the refrigerator door.
[0076] In this embodiment, there are multiple partitions inside the refrigerator, dividing the space of the refrigerator into multiple compartments, and a robotic arm is set at the top of each compartment of the refrigerator (the bottom of the upper partition corresponding to the current partition). The robotic arm can move to above multiple target areas in the current partition. The robotic arm can grab objects placed in the target area and move the objects to the target position around the door body.
[0077] Specifically, the partition is divided into multiple item placement areas in advance, and when an item is placed in the refrigerator, the partition and placement area where the item is located are recorded. After the recommendation list is generated, an item is obtained from the recommendation list as the target item, and the target partition where the target item is located is determined, and the target placement area of the target item in the partition is determined. When the target object is detected to enter the preset area around the refrigerator, it means that the target object has approached the refrigerator, and the robot arm is controlled to move to the target placement area and grab the target item. After the target object is moved to the target position around the refrigerator door, the target object is placed down.
[0078] As an example, when the page information of the target terminal includes Coke and Coke is stored in the refrigerator, Coke is taken as the target item. When the target object approaches the refrigerator, a recommendation list of Coke is generated and sent to the terminal of the target object. At this time, the robotic arm is controlled to move the Coke to the door of the refrigerator.
[0079] The method for moving items in a refrigerator provided by an embodiment of the present invention obtains the page information browsed by the target object in the target terminal; extracts keywords corresponding to the items in the refrigerator from the page information; generates the recommendation list according to the keywords; determines at least one target item in the refrigerator according to the recommendation list; when the target object enters the preset area around the refrigerator, controls the mechanical arm in the refrigerator to place at least one target item at a target position around the refrigerator door. In this way, the items needed by the user can be moved to the target position according to the information browsed by the user. It is convenient for users to use and makes the refrigerator more intelligent.
[0080] Figure 3 A schematic diagram of a flow chart of another method for moving items in a refrigerator provided by an embodiment of the present invention, such as Figure 3 As shown, the method specifically includes:
[0081] S31, obtaining an image of a target object in a preset area; extracting the body features and / or facial features of the target object from the image as the feature information.
[0082] In this embodiment, the facial image and body image of the target object are acquired by the image acquisition device, and the expression features and object status of the target object can be extracted from the facial image (for example, the expression feature of the target object in the facial image is facial sweating, and the expression is the expression of the target object stored in advance when the body feels hot. At this time, the state of the target object is that the body feels hot or the body temperature is high or needs to be cooled down.) The body features and object status of the object can be extracted from the body image (for example, the body feature of the target object in the body image is the action of wiping sweat or the clothes worn are summer clothes, and the expression is the expression of the target object stored in advance when the body feels cold. At this time, the state of the target object is that the body feels cold or the body temperature is low or needs to be warmed up), and the body features and / or expression features are used as feature information.
[0083] S32: Determine a first item corresponding to the characteristic information from the corresponding relationship; when the first item exists in the refrigerator, generate the recommendation list according to the first item.
[0084] In this embodiment, a correspondence relationship between multiple feature information and multiple items is pre-generated; each feature information corresponds to at least one item. After acquiring the feature information, the corresponding first item is determined from the correspondence relationship, and it is determined whether the refrigerator contains the first item. When the refrigerator contains the first item, a recommendation list is generated according to the first item. The determination method may include but is not limited to: acquiring images of all items in the refrigerator, and determining whether the image contains the first item. Or, when the item is placed in the refrigerator, the refrigerator logo or name is recorded, and it is determined whether the logo or name of the first item is included.
[0085] In one possible implementation, when the first item does not exist in the refrigerator, a second item in the refrigerator whose similarity with the first item is greater than a set threshold is selected, or a second item of the same type as the first item is selected (for example, the first item is a can of cola, and the second item is a can of Sprite), a recommendation list is generated based on the second item, and a prompt operation is performed based on the first item and the second item (for example, the prompt information may be: the recommended item Coke is out of stock and has been replaced by Sprite), and the prompt operation may be to send the prompt information to the user's terminal for display, or to display it on the screen of the refrigerator.
[0086] S33, obtaining the first moment when the target item is placed in the refrigerator; obtaining the second moment when the recommendation list is generated; determining the storage time of the target item according to the first moment and the second moment; when there are multiple target items, moving the target item with the longest storage time to the target position.
[0087] In this embodiment, when the target item is placed in the refrigerator, the current moment is recorded as the first moment, the moment when the recommendation list is generated is recorded as the second moment, and the storage time is obtained by subtracting the first moment from the second moment. When there are multiple target items stored in the refrigerator (for example, there are two tomatoes in the refrigerator), the target item with the longest storage time is moved to the target position.
[0088] In one possible implementation, when an item is placed in the refrigerator, the shelf life of the item is obtained, and the time until the item expires is determined based on the second moment and the shelf life. When there are multiple target items stored in the refrigerator, the target item with the shortest time until expiration is moved to the target position.
[0089] In one possible implementation, when the storage time of multiple target items is greater than a set threshold, it indicates that the items may be expired. At this time, a prompt message is generated to perform a prompt operation to remind the user that the item is expired. The expired items can be moved to the target location for the convenience of user cleaning. The recommendation list is updated based on non-target items, the storage time of which is less than or equal to the set threshold (for example, one month), and the similarity between the non-target items and the target items is greater than the set threshold.
[0090] As an example, the target object feature is a cold state. From the corresponding relationship, it is determined that the recommended list corresponding to cold is noodle soup and the method of making noodle soup. It is determined that the first item is noodles. The storage time of noodles is one month, which exceeds the preset time of fifteen days. Therefore, instant noodles are selected as the second item and moved to the refrigerator door.
[0091] As an example, the climate characteristic obtained is hot. From the corresponding relationship, it is determined that the recommended list corresponding to heat is cola. There are two bottles of cola A and B in the refrigerator. It is determined that the storage time of A is one week and the storage time of B is two weeks. Therefore, B is selected and moved to the door of the refrigerator.
[0092] The method for moving items in a refrigerator provided by an embodiment of the present invention is as follows: acquiring an image of a target object in a preset area; extracting the physical features and / or facial features of the target object from the image as the feature information; determining the first item corresponding to the feature information from the corresponding relationship; generating the recommendation list according to the first item when the first item exists in the refrigerator; acquiring the first moment when the target item is placed in the refrigerator; acquiring the second moment when the recommendation list is generated; determining the storage time of the target item according to the first moment and the second moment; and when there are multiple target items, moving the target item with the longest storage time to the target position. In this way, it is possible to move the items needed by the user to the target position according to the information browsed by the user, and select the target item according to the storage time, thereby reducing food waste, preventing users from eating expired food, facilitating user use, and making the refrigerator more intelligent.
[0093] Figure 4 A schematic diagram of the structure of a device for moving items in a refrigerator provided by an embodiment of the present invention is shown in FIG. Figure 4 As shown, the device includes: a target component, a partition, a refrigerator door, an object A and an object B, Figure 4 This is a top view of a compartment inside a refrigerator. The target component is a rotatable tray. The tray is divided into five sector-shaped areas for placing items. The tray is above the partition and connected to the partition through bearings. It can rotate above the partition to move the target item to the vicinity of the refrigerator door through rotation.
[0094] The device for moving items in a refrigerator provided in this embodiment can be as follows Figure 4 The device shown in FIG. 1 may perform the following steps: Figure 1 Or all steps of the method of moving items in the refrigerator in 3, so as to achieve Figure 1 Or the technical effect of the method for moving items in the refrigerator shown in 3, please refer to Figure 1 Or 3 related descriptions are omitted here for the sake of brevity.
[0095] Figure 5 A schematic diagram of the structure of another device for moving items in a refrigerator provided by an embodiment of the present invention is shown in FIG. Figure 5 As shown, the device includes: a partition A, a partition B, an object A, an object B and a robotic arm. Figure 5 This is the main view inside a compartment of the refrigerator. Items A and B are placed in the preset area above partition B. The robotic arm is set at the bottom of partition A. It can move to the top of the area where item A or item B is located, and extend downward to a position where it can grab the object, so that the robotic arm can grab the target object and move it to the vicinity of the refrigerator door.
[0096] The device for moving items in a refrigerator provided in this embodiment can be as follows Figure 5 The device shown in FIG. 1 may perform the following steps: Figure 2 Or all steps of the method of moving items in the refrigerator in 3, so as to achieve Figure 2 Or the technical effect of the method for moving items in the refrigerator shown in 3, please refer to Figure 2 Or 3 related descriptions are omitted here for the sake of brevity.
[0097] Figure 6 A schematic diagram of the structure of another device for moving items in a refrigerator provided by an embodiment of the present invention is shown in FIG. Figure 6 As shown, the device specifically includes:
[0098] An acquisition module 61 is used to acquire feature information of a target object in a preset area;
[0099] A processing module 62, configured to generate a recommendation list of items in the refrigerator according to the feature information;
[0100] The control module 63 is used to control the rotation of the target component inside the refrigerator so as to move the target item in the recommendation list to a target position through the target component.
[0101] In a possible implementation, the processing module 62 is specifically configured to generate a correspondence between a plurality of feature information and a plurality of items;
[0102] Determine a first item corresponding to the characteristic information from the corresponding relationship;
[0103] When the first item exists in the refrigerator, generating the recommendation list according to the first item;
[0104] or,
[0105] When the first item does not exist in the refrigerator, the recommendation list is generated according to the second item, and prompt information is generated according to the first item and the second item to perform a prompt operation, and the similarity between the second item and the first item is greater than a set threshold.
[0106] In a possible implementation, the acquisition module 61 is specifically used to acquire an image of a target object in a preset area;
[0107] The processing module 62 is specifically configured to extract the body features and / or facial features of the target object from the image as the feature information.
[0108] In a possible implementation, the processing module 62 is further configured to determine at least one target item in the refrigerator according to the recommendation list;
[0109] The control module 63 is also used to control the robotic arm in the refrigerator to place at least one of the target items at a target position around the refrigerator door when the target object enters a preset area around the refrigerator.
[0110] In a possible implementation, the acquisition module 61 is further configured to acquire the first moment when the target object is placed in the refrigerator;
[0111] Obtaining a second time at which the recommendation list is generated;
[0112] The processing module 62 is further used to determine the storage time of the target item according to the first moment and the second moment;
[0113] The control module 63 is further configured to move the target object with the longest storage time to the target position when there are multiple target objects.
[0114] In a possible implementation, the processing module 62 is further configured to generate a prompt message to perform a prompt operation when the storage time of the plurality of target items is greater than a set threshold;
[0115] The recommendation list is updated according to non-target items, the storage time of the non-target items is less than or equal to the set threshold, and the similarity between the non-target items and the target items is greater than the set threshold.
[0116] In a possible implementation, the acquisition module 61 is further used to acquire page information browsed by the target object in a target terminal, where the target terminal corresponds to the refrigerator;
[0117] The processing module 62 is further used to extract keywords corresponding to the items in the refrigerator from the page information;
[0118] generating the recommendation list according to the keyword;
[0119] or,
[0120] The acquisition module 61 is also used to acquire climate information of the area where the refrigerator is located;
[0121] The processing module 62 is further configured to generate the recommendation list according to the climate information.
[0122] The device for moving items in a refrigerator provided in this embodiment can be as follows Figure 6 The device shown in FIG. 1 may perform the following steps: Figure 1-3 All steps of the method for moving items in the refrigerator are implemented Figure 1-3 For details, please refer to the technical effect of the method for moving items in the refrigerator. Figure 1-3 For the sake of brevity, the relevant description is not repeated here.
[0123] Figure 7 A schematic diagram of a device provided in an embodiment of the present invention is provided. Figure 7 The device 700 shown includes: at least one processor 701, a memory 702, at least one network interface 704 and other user interfaces 703. The various components in the device 700 are coupled together via a bus system 705. It is understood that the bus system 705 is used to achieve connection and communication between these components. In addition to the data bus, the bus system 705 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the bus system 705 is not shown in FIG. Figure 7 Various buses are labeled as bus system 705 .
[0124] The user interface 703 may include a display, a keyboard, or a pointing device (eg, a mouse, a trackball, a touch pad, or a touch screen).
[0125] It can be understood that the memory 702 in the embodiment of the present invention can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM) and direct RAM bus random access memory (DRRAM). The memory 702 described herein is intended to include, but is not limited to, these and any other suitable types of memory.
[0126] In some implementations, the memory 702 stores the following elements, executable units or data structures, or a subset thereof, or an extended set thereof: an operating system 7021 and an application 7022 .
[0127] The operating system 7021 includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., which are used to implement various basic services and process hardware-based tasks. The application 7022 includes various application programs, such as a media player (Media Player), a browser (Browser), etc., which are used to implement various application services. The program for implementing the method of the embodiment of the present invention can be included in the application 7022.
[0128] In the embodiment of the present invention, by calling the program or instruction stored in the memory 702, specifically, the program or instruction stored in the application 7022, the processor 701 is used to execute the method steps provided by each method embodiment, for example, including:
[0129] Obtain feature information of target objects in a preset area;
[0130] generating a recommendation list of items in the refrigerator according to the characteristic information;
[0131] The target component inside the refrigerator is controlled to rotate so as to move the target item in the recommendation list to a target position through the target component.
[0132] In a possible implementation, a correspondence between a plurality of feature information and a plurality of objects is generated;
[0133] Determine a first item corresponding to the characteristic information from the corresponding relationship;
[0134] When the first item exists in the refrigerator, generating the recommendation list according to the first item;
[0135] or,
[0136] When the first item does not exist in the refrigerator, the recommendation list is generated according to the second item, and prompt information is generated according to the first item and the second item to perform a prompt operation, and the similarity between the second item and the first item is greater than a set threshold.
[0137] In a possible implementation manner, obtaining feature information of a target object in a preset area includes:
[0138] Acquire an image of a target object within a preset area;
[0139] The body features and / or facial features of the target object are extracted from the image as the feature information.
[0140] In a possible implementation, the method further includes:
[0141] determining at least one target item in the refrigerator according to the recommendation list;
[0142] When the target object enters a preset area around the refrigerator, a robotic arm in the refrigerator is controlled to place at least one of the target objects at a target position around the refrigerator door.
[0143] In a possible implementation, the method further includes:
[0144] Obtaining the first moment when the target object is placed in the refrigerator;
[0145] Obtaining a second time at which the recommendation list is generated;
[0146] Determining a storage time of the target item according to the first time and the second time;
[0147] When there are multiple target objects, the target object with the longest storage time is moved to the target location.
[0148] In a possible implementation, the method further includes:
[0149] When the storage time of the plurality of target items is greater than a set threshold, a prompt message is generated to perform a prompt operation;
[0150] The recommendation list is updated according to non-target items, the storage time of the non-target items is less than or equal to the set threshold, and the similarity between the non-target items and the target items is greater than the set threshold.
[0151] In a possible implementation, obtaining page information browsed by the target object in a target terminal, where the target terminal corresponds to the refrigerator;
[0152] Extracting keywords corresponding to the items in the refrigerator from the page information;
[0153] generating the recommendation list according to the keyword;
[0154] or,
[0155] Obtaining climate information of the area where the refrigerator is located;
[0156] The recommendation list is generated according to the climate information.
[0157] The method disclosed in the above embodiment of the present invention can be applied to the processor 701, or implemented by the processor 701. The processor 701 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit in the processor 701 or the instruction in the form of software. The above processor 701 can be a general processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a field programmable gate array (Field Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present invention can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiment of the present invention can be directly embodied as a hardware decoding processor to execute, or the hardware and software units in the decoding processor can be executed. The software unit can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 702, and the processor 701 reads the information in the memory 702 and completes the steps of the above method in combination with its hardware.
[0158] It is understood that the embodiments described herein may be implemented in hardware, software, firmware, middleware, microcode, or a combination thereof. For hardware implementation, the processing unit may be implemented in one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPDevice, DSPD), programmable logic devices (PLD), field programmable gate arrays (FPGA), general purpose processors, controllers, microcontrollers, microprocessors, other electronic units for performing the functions described in the present application, or a combination thereof.
[0159] For software implementation, the technology described herein can be implemented by a unit that performs the functions described herein. The software code can be stored in a memory and executed by a processor. The memory can be implemented in the processor or outside the processor.
[0160] The device provided in this embodiment can be Figure 7 The device shown in , can be executed as Figure 1-3 All steps of the method for moving items in the refrigerator are implemented Figure 1-3 For details, please refer to the technical effect of the method for moving items in the refrigerator. Figure 1-3 For the sake of brevity, the relevant description is not repeated here.
[0161] The embodiment of the present invention also provides a storage medium (computer-readable storage medium). The storage medium here stores one or more programs. The storage medium may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a read-only memory, a flash memory, a hard disk or a solid-state drive; the memory may also include a combination of the above-mentioned types of memory.
[0162] When one or more programs in the storage medium can be executed by one or more processors, the method of moving items in the refrigerator executed on the device side can be implemented.
[0163] The processor is used to execute the refrigerator object moving program stored in the memory to implement the following steps of the refrigerator object moving method executed on the device side:
[0164] Obtain feature information of target objects in a preset area;
[0165] generating a recommendation list of items in the refrigerator according to the characteristic information;
[0166] The target component inside the refrigerator is controlled to rotate so as to move the target item in the recommendation list to a target position through the target component.
[0167] In a possible implementation, a correspondence between a plurality of feature information and a plurality of objects is generated;
[0168] Determine a first item corresponding to the characteristic information from the corresponding relationship;
[0169] When the first item exists in the refrigerator, generating the recommendation list according to the first item;
[0170] or,
[0171] When the first item does not exist in the refrigerator, the recommendation list is generated according to the second item, and prompt information is generated according to the first item and the second item to perform a prompt operation, and the similarity between the second item and the first item is greater than a set threshold.
[0172] In a possible implementation manner, obtaining feature information of a target object in a preset area includes:
[0173] Acquire an image of a target object within a preset area;
[0174] The body features and / or facial features of the target object are extracted from the image as the feature information.
[0175] In a possible implementation, the method further includes:
[0176] determining at least one target item in the refrigerator according to the recommendation list;
[0177] When the target object enters a preset area around the refrigerator, a robotic arm in the refrigerator is controlled to place at least one of the target objects at a target position around the refrigerator door.
[0178] In a possible implementation, the method further includes:
[0179] Obtaining the first moment when the target object is placed in the refrigerator;
[0180] Obtaining a second time at which the recommendation list is generated;
[0181] Determining a storage time of the target item according to the first time and the second time;
[0182] When there are multiple target objects, the target object with the longest storage time is moved to the target location.
[0183] In a possible implementation, the method further includes:
[0184] When the storage time of the plurality of target items is greater than a set threshold, a prompt message is generated to perform a prompt operation;
[0185] The recommendation list is updated according to non-target items, the storage time of the non-target items is less than or equal to the set threshold, and the similarity between the non-target items and the target items is greater than the set threshold.
[0186] In a possible implementation, obtaining page information browsed by the target object in a target terminal, where the target terminal corresponds to the refrigerator;
[0187] Extracting keywords corresponding to the items in the refrigerator from the page information;
[0188] generating the recommendation list according to the keyword;
[0189] or,
[0190] Obtaining climate information of the area where the refrigerator is located;
[0191] The recommendation list is generated according to the climate information.
[0192] The professionals should further realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to the function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.
[0193] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
[0194] The specific implementation methods described above further illustrate the objectives, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above description is only a specific implementation method of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.
Claims
1. A method for moving items in a refrigerator, It is characterized in that include: Acquire feature information of a target object in a preset area, the preset area including: the door of the room where the refrigerator is located, the feature information is a feature characterizing the current state of the target object, and the feature information includes: the physical features and facial features of the target object; generating a recommendation list of items in the refrigerator according to the characteristic information; When it is detected that the target object enters a preset area around the refrigerator, determining that the target object has approached the refrigerator; The target component inside the refrigerator is controlled to rotate so as to move the target item in the recommendation list to a target position through the target component.
2. The method according to claim 1, It is characterized in that Generating a recommendation list of items in the refrigerator according to the characteristic information includes: Generate a correspondence between a plurality of feature information and a plurality of objects; Determine a first item corresponding to the characteristic information from the corresponding relationship; When the first item exists in the refrigerator, generating the recommendation list according to the first item; or, When the first item does not exist in the refrigerator, the recommendation list is generated according to the second item, and prompt information is generated according to the first item and the second item to perform a prompt operation, and the similarity between the second item and the first item is greater than a set threshold.
3. The method according to claim 1, It is characterized in that The step of obtaining characteristic information of a target object in a preset area includes: Acquire an image of a target object within a preset area; The body features and / or facial features of the target object are extracted from the image as the feature information.
4. The method according to claim 1, It is characterized in that The method further comprises: determining at least one target item in the refrigerator according to the recommendation list; When the target object enters a preset area around the refrigerator, a robotic arm in the refrigerator is controlled to place at least one of the target objects at a target position around the refrigerator door.
5. The method according to claim 1, It is characterized in that The method further comprises: Obtaining the first moment when the target object is placed in the refrigerator; Obtaining a second time at which the recommendation list is generated; Determining a storage time of the target item according to the first time and the second time; When there are multiple target objects, the target object with the longest storage time is moved to the target location.
6. The method according to claim 5, It is characterized in that The method further comprises: When the storage time of the plurality of target items is greater than a set threshold, a prompt message is generated to perform a prompt operation; The recommendation list is updated according to non-target items, the storage time of the non-target items is less than or equal to the set threshold, and the similarity between the non-target items and the target items is greater than the set threshold.
7. The method according to claim 1, It is characterized in that The method further comprises: Acquire page information browsed by the target object in a target terminal, where the target terminal corresponds to the refrigerator; Extracting keywords corresponding to the items in the refrigerator from the page information; generating the recommendation list according to the keyword; or, Obtaining climate information of the area where the refrigerator is located; The recommendation list is generated according to the climate information.
8. A device for moving items in a refrigerator, It is characterized in that include: An acquisition module, configured to acquire feature information of a target object in a preset area, wherein the preset area includes: the doorway of the room where the refrigerator is located, and the feature information is a feature characterizing a current state of the target object, and the feature information includes: a physical feature and an expression feature of the target object; A processing module, used for generating a recommendation list of items in the refrigerator according to the characteristic information; When it is detected that the target object enters a preset area around the refrigerator, determining that the target object has approached the refrigerator; A control module is used to control the rotation of a target component inside the refrigerator so as to move the target item in the recommendation list to a target position through the target component.
9. A device, It is characterized in that include: A processor and a memory, wherein the processor is used to execute a refrigerator item moving program stored in the memory to implement the refrigerator item moving method according to any one of claims 1 to 7.
10. A storage medium, It is characterized in that The storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the method for moving items in a refrigerator according to any one of claims 1 to 7.
Citation Information
Patent Citations
Control method of display screen of refrigerator
CN106352642A
Refrigerator capable of automatically storing and delivering food materials
CN107975997A
User personalized diet recommendation method and device, electronic equipment and storage medium
CN110504019A
Food clearing method and device, storage medium, electronic equipment and refrigerator
CN112595019A
Recipe recommendation method and device, electronic equipment and storage medium
CN112786154A
