Article storage method, storage device, storage medium and refrigerator

Abstract

The present application provides an article storage method and a storage device, a storage medium and a refrigerator, wherein the article storage method is applied to a refrigerator, the refrigerator includes a display screen, and the method includes: identifying characteristic information of articles to be placed; obtaining corresponding characteristic graphics according to the characteristic information; displaying the placement space in the refrigerator on the display screen; inserting the characteristic graphics into the free placement area in the placement space, and generating a storage strategy according to the arrangement information of the articles in the placement space. The present application obtains corresponding characteristic graphics by identifying characteristic information of articles to be placed, inserts the characteristic graphics into the corresponding free placement area in the refrigerator, and generates a storage strategy according to the arrangement information of the articles in the placement space. The user places the articles to be placed according to the placement position of the characteristic graphics in the refrigerator space, thereby realizing intelligent management of the articles and improving the user experience.

Description

[Technical field]

[0001] The present invention relates to the field of electronics, and in particular to an article storage method and a storage device, a storage medium and a refrigerator. [Background technology]

[0002] At present, with the rapid development of computer network technology, digital signal processing technology and modern communication technology, the intelligence of home has gradually become a hot topic. Smart home refers to connecting various information devices and residential devices through the network to meet the needs of users in their home life, work, entertainment and communication. Among them, the storage of items in the smart refrigerator is an important function.

[0003] However, the storage of items in current smart refrigerators is not intelligent enough, resulting in a poor user experience.

[0004] Therefore, it is necessary to provide an article storage method and a storage device, a storage medium and a refrigerator to solve the above problems. [Summary of the invention]

[0005] The purpose of the embodiments of the present application is to provide an item storage method and a storage device, a storage medium and a refrigerator, so as to solve the problem that the item storage in the user's smart refrigerator is not intelligent enough, resulting in a poor user experience.

[0006] The technical solution of the embodiment of the present application is as follows: a method for storing items, the method is applied to a refrigerator, the refrigerator includes a display screen, the method includes:

[0007] Identify characteristic information of items to be placed;

[0008] Obtaining a corresponding characteristic graph according to the characteristic information;

[0009] Displaying the storage space in the refrigerator on the display screen;

[0010] Inserting the characteristic pattern into an empty placement area in the placement space;

[0011] A storage strategy is generated according to the arrangement information of the items in the placement space.

[0012] Optionally, after inserting the characteristic pattern into an idle placement area in the placement space, the method further includes: when a control instruction corresponding to the characteristic pattern is received, moving the characteristic pattern to other idle placement areas.

[0013] Optionally, when receiving the control instruction, moving the characteristic pattern to another idle placement area includes:

[0014] When a sliding instruction corresponding to the characteristic graphic is received, the characteristic graphic is dragged to another free placement area according to the sliding instruction; or

[0015] When a voice control instruction corresponding to the characteristic graphic is received, the characteristic graphic is moved to another free placement area according to the voice control instruction;

[0016] When a click instruction corresponding to the characteristic graphic is received, the characteristic graphic is moved to other idle placement areas according to the click instruction.

[0017] Optionally, before inserting the characteristic pattern into an idle placement area in the placement space, the method further includes:

[0018] Graphics of placed items are displayed in the placement space.

[0019] Optionally, before inserting the characteristic pattern into an idle placement area in the placement space, the method further includes:

[0020] When a control instruction corresponding to the graphic of the placed objects is received, the graphic of the placed objects is moved to other free placement areas.

[0021] Optionally, before inserting the characteristic pattern into an idle placement area in the placement space, the method further includes:

[0022] Dividing the idle placement area into a plurality of sub-areas according to the characteristic information of the items to be placed, and placing priorities of different sub-areas are different;

[0023] Different prompt information is set in different sub-areas.

[0024] Optionally, inserting the characteristic pattern into an idle placement area includes:

[0025] Determining, from the graphics of the placed objects, a target object whose similarity to the characteristic graphics is greater than a similarity threshold; and / or

[0026] Determine, from the pattern of placed objects, a target object having a regular size similar to the characteristic pattern;

[0027] The characteristic pattern is inserted into an empty placement area around the target object.

[0028] Optionally, the placement space is divided into a plurality of placement intervals according to the feature information, and each placement interval corresponds to a different preset feature;

[0029] Matching the characteristic information of the object to be placed with the preset characteristics of each of the placement areas;

[0030] The placement interval that matches the characteristic information of the object to be placed is used as the target placement interval;

[0031] Insert the characteristic pattern corresponding to the object to be placed into the target placement interval.

[0032] Optionally, when it is detected that the characteristic pattern or the pattern of the placed objects is placed unreasonably, a prompt message is issued; and / or

[0033] Move the unreasonable feature graphics or graphics of placed objects to other placement areas until the feature graphics or graphics of placed objects are reasonably placed.

[0034] The present application also provides an article storage device, including:

[0035] A recognition module, used to recognize characteristic information of items to be placed;

[0036] A generating module, used for obtaining a corresponding characteristic graph according to the characteristic information processing;

[0037] A display module, used to display the placement space in the refrigerator;

[0038] A control module, used for inserting the characteristic pattern into an empty placement area in the placement space;

[0039] Optionally, the article storage device further includes:

[0040] The adjustment module is used to move the characteristic pattern to other idle placement areas when receiving a control instruction corresponding to the characteristic pattern.

[0041] An embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed on a computer, the computer executes any of the above-mentioned object storage methods.

[0042] The present application also provides a refrigerator, comprising:

[0043] Door body,

[0044] A box body, the box body being movably connected to the door body;

[0045] An identification unit, the identification unit is arranged on the door body, and is used to identify objects to be placed and obtain characteristic information of the objects to be placed;

[0046] A camera unit, which is disposed in the box and is electrically connected to the recognition unit and is used to recognize the placement space in the box;

[0047] A display screen, which is arranged on the door body and is electrically connected to the camera unit and is used to display the placement space in the refrigerator;

[0048] A main control board is arranged on the box body and is electrically connected to the display screen, and is used to obtain a corresponding characteristic pattern according to the characteristic information processing, and insert the characteristic pattern into an idle placement area in the placement space.

[0049] The beneficial effect of the embodiment of the present application is that the embodiment of the present application identifies the characteristic information of the items to be placed, obtains the corresponding characteristic graphics according to the characteristic information, inserts the characteristic graphics into the corresponding free placement area in the refrigerator, and generates a storage strategy according to the arrangement information of the items in the placement space. The user places the items to be placed in the corresponding position of the refrigerator according to the generated storage strategy, thereby realizing intelligent management of the items and improving the user experience.

Brief Description of the Drawings

[0050] Figure 1 A schematic diagram of a first process flow of an item storage method provided in an embodiment of the present application;

[0051] Figure 2 A second flow chart of the method for storing items provided in an embodiment of the present application;

[0052] Figure 3 A schematic diagram of the structure of a storage device provided in an embodiment of the present application;

[0053] Figure 4 A schematic diagram of the structure of a refrigerator provided in an embodiment of the present application;

[0054] Figure 5 A schematic diagram of a first scene displayed on a display screen of a refrigerator provided in an embodiment of the present application; Figure 6 A schematic diagram of a second scene displayed on the display screen of the refrigerator provided in an embodiment of the present application. [Specific implementation method]

[0055] The accompanying drawings are part of this application and are used to provide a further understanding of the present invention. The illustrative embodiments of the present invention and their descriptions are used to explain the present invention, but do not constitute an improper limitation of the present invention. Obviously, the drawings described below are only some embodiments. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. The present invention is further described below in conjunction with the accompanying drawings and embodiments.

[0056] Home appliances are used more and more frequently in daily life, and the smart home has gradually become a hot topic. Smart home refers to connecting various information devices and residential devices through the network to meet the needs of users in their home life, work, entertainment and communication. Among them, the storage of items in smart refrigerators is an important function. However, when users usually use refrigerators, they often place items in the refrigerator at random, which makes it difficult for users to find items when they need them. In addition, the space in the refrigerator is limited. When there are many items that need to be put into the refrigerator, many items will be difficult to put in, affecting the user experience.

[0057] Therefore, the present invention provides an article storage method and a storage device thereof, a refrigerator and a computer device. The present invention identifies the articles to be placed, obtains the characteristic information of the articles to be placed, processes the characteristic information to obtain the corresponding characteristic graphics, and inserts the characteristic graphics into the corresponding free placement area. The user can place the articles to be placed in the corresponding position of the refrigerator according to the displayed characteristic graphics, thereby realizing intelligent management of the articles and improving the user experience. Moreover, when the user feels that the placement position of the articles displayed on the display screen is unreasonable, the user can move the characteristic graphics to other free placement areas by dragging according to his or her own wishes, thereby realizing more intelligent management of the articles. The article storage method and the storage device thereof, the refrigerator and the computer device are described in detail below in conjunction with the accompanying drawings.

[0058] See also Figure 1 , Figure 1 The first flow diagram of the method for storing items provided in the embodiment of the present application is shown in FIG. This embodiment provides a method for storing items, which is applied to a refrigerator. The refrigerator includes a display screen. The specific method is described as follows.

[0059] 101. Identify characteristic information of items to be placed.

[0060] Before the items to be placed are put into the refrigerator, the recognition device of the refrigerator recognizes the items to be placed and obtains relevant feature information.

[0061] It is understandable that the method of identifying the items to be placed can be arbitrary and is not limited in this application. For example, the identification of the items to be placed can be through the camera to identify the items, and the type of the items can be identified by using the database in the server to directly obtain the volume, shape, size and other characteristic information of the items. It should be noted that when it is difficult to identify the items with one picture, the camera can be used to shoot and scan the entire object.

[0062] Identifying the items to be placed can be done by scanning and identifying the items through a 3D scanner, identifying the volume and other information of the items based on the images scanned by the scanner, and obtaining the production date, shelf life, and type of the items, etc. The data of the items can also be directly retrieved from the server database based on the identified specific items. For example, if the item is identified as Nongfu Spring 550ml, the volume information of the item can be directly obtained from the server database.

[0063] Identifying the items to be placed can also be done by scanning a QR code, label or barcode on the item with a specific scanner to obtain characteristic information such as the item's shelf life, type, and requirements for temperature and humidity.

[0064] Identifying the items to be placed can also be done by using an RFID reader to identify the RFID tags on the items and obtain characteristic information such as the origin, production date, weight and size of the items.

[0065] Identifying the items to be placed can also be done by inputting the information of the items through the user's voice. For example, if the user says milk, 550 ml, watermelon, 3 jin, about 30 cm long, about 25 cm high, etc., the information of the items can be directly obtained according to the user's voice information and uploaded to the server.

[0066] The identification of the items to be placed can also be achieved by the user inputting the information of the items by text input on the screen. For example, the user directly inputs milk, 550 ml, watermelon 3 jin, about 30 cm long, about 25 cm high, etc. This function can be realized on a terminal with a screen connected to the refrigerator.

[0067] Among them, the items to be placed can be meat, fruits, vegetables, beans, beverages, ice cream, cosmetics, etc. There is no specific restriction on the specific items to be placed, as long as they can be placed in the refrigerator.

[0068] It should be noted that the characteristic information of the items to be placed may include the volume, size, shelf life, production date and type of the items to be placed, including the shape information of the items to be placed, such as rectangle, circle, square, triangle, sector or irregular shape, etc. It also includes the hardness of the items to be placed, etc. There is no specific limitation on the characteristic information of the items to be placed.

[0069] 102. Obtain a corresponding feature graphic according to the feature information.

[0070] According to the acquired characteristic information of the object to be placed, the corresponding characteristic graphic is displayed on the display screen. The characteristic graphic can be a reduced version of the object shape corresponding to the object to be placed. For example, when the acquired object to be placed is a watermelon, the processor displays the characteristic graphic of the watermelon on the display screen after processing.

[0071] The characteristic pattern can be an icon corresponding to each of the items to be placed. For example, when the identified item to be placed is mineral water, the processor will display the icon of mineral water on the display screen after processing.

[0072] The characteristic graphic can also be obtained by obtaining a corresponding color block based on the characteristic information of the object to be placed, wherein the color block generally has the color characteristics of the object, or can be unified into a certain color, or have no color characteristics and only show its volume characteristics. For example, when the object to be placed is a watermelon, the processor will display a green color block on the display screen after processing. It should be noted that the size, shape, etc. of the color block will correspond one-to-one with the identified object to be placed according to the characteristic information.

[0073] It is understandable that the color block can be a three-dimensional color block that can intuitively show the volume characteristics of the object. Generally, after the object is identified, a corresponding three-dimensional stereogram is generated, which is presented on the screen after being reduced by a certain ratio. The reduction ratio should correspond to the screen display area, and the reduction ratio of all objects to be placed should be the same. For example, after scanning a watermelon, the three-dimensional color block of the watermelon is displayed in the color block display area according to a certain ratio.

[0074] 103. Display the storage space in the refrigerator on the display screen.

[0075] Among them, displaying the placement space in the refrigerator includes obtaining information about the storage room in the refrigerator and displaying the placement space in the refrigerator.

[0076] It should be noted that, in some embodiments, obtaining the information of the storage chambers in the refrigerator includes obtaining the number of storage chambers, space information, and graphic information of items placed in the refrigerator. In some other embodiments, obtaining the information of the storage chambers in the refrigerator does not include graphic information of items placed in the refrigerator. For example, when a user has just purchased a new refrigerator and is preparing to store or cleaning the refrigerator, etc., and no items are placed in the refrigerator, obtaining the information of the storage chambers in the refrigerator does not include graphic information of items placed in the refrigerator.

[0077] Specifically, after the information is processed in the cloud, a three-dimensional image of the placement space in the refrigerator is displayed on the screen. The refrigerator includes at least one placement area.

[0078] The acquisition of graphic information of items placed in the refrigerator includes: the camera unit acquires item information and coordinate information of each item placed in each placement interval, and displays the food information at a position corresponding to the coordinate information on the display screen of the refrigerator according to the food information and coordinate information of the food in each placement interval.

[0079] 104. Insert the characteristic graphic into the vacant placement area in the placement space.

[0080] The main control board inserts the generated feature graphics into the free placement area in the refrigerator placement space according to the corresponding feature information, and displays the placement strategy of the items to be placed on the display screen. For example, the feature graphics are inserted into the free placement area according to the similarity between the feature graphics and the graphics of the items already placed, or according to the specifications and dimensions of the items to be placed. Alternatively, the feature graphics are inserted into the free placement area according to the shelf life of the items to be placed and the temperature and humidity requirements of the items to be placed.

[0081] Specifically, inserting the characteristic pattern into the vacant placement area includes determining a target object having a similarity with the characteristic pattern greater than a similarity threshold from the pattern of placed objects; and inserting the characteristic pattern into the vacant placement area around the target object.

[0082] In some embodiments, inserting the characteristic graphic into the vacant placement area includes determining a graphic object of the placed objects with a regular size similar to the characteristic graphic from the graphics of the placed objects; and inserting the characteristic graphic into the vacant placement area around the graphic object of the placed objects.

[0083] In some embodiments, inserting the characteristic pattern into the vacant placement area includes dividing the placement space into multiple shelf life areas, each shelf life area corresponding to a different shelf life; matching the shelf life of the items to be placed with the shelf life of each shelf life area; using the shelf life area that matches the shelf life of the items to be placed as the target shelf life area; and inserting the characteristic pattern corresponding to the items to be placed into the target shelf life area.

[0084] In some other embodiments, inserting the characteristic pattern into the vacant placement area also includes dividing the placement space into multiple placement intervals, each placement interval corresponding to a different temperature and humidity; matching the temperature and humidity requirements of the items to be placed with the temperature and humidity of each placement interval; using the placement interval that matches the temperature and humidity requirements of the items to be placed as the target placement interval; and inserting the characteristic pattern corresponding to the items to be placed into the target placement interval.

[0085] Specifically, a 3D image of the storage room can be presented on the display screen, as well as a list of the order in which items are input after the placement strategy is generated. For example, the items are numbered and input in sequence according to the numbers. The display screen can be a refrigerator screen or a terminal screen.

[0086] In some embodiments, the corresponding stacking pictures of the items in the refrigerator can be displayed on the display screen in real time. For example, after the first item, a watermelon, is stacked, a real-time picture of the watermelon will appear on the display screen, which helps the user to understand the placement in time and make adjustments.

[0087] Users can also generate placement strategies according to their own wishes. For example, if they issue a voice command "Put the eggs in the lower left corner, the milk in the middle, and the vegetables on the outside", the server will insert the feature graphics into the free placement area in the placement space according to the command to generate a placement strategy that meets the user's intention. It is understandable that the method of generating strategies is not limited to voice control. Users can also input text or operate the screen. For example, the spatial information of the refrigerator is generated on the screen, and the three-dimensional space is divided into different areas and numbered to generate identification information of the items to be placed, such as color blocks containing text information or picture information such as milk, eggs, meat and vegetables. By dragging, the color blocks are placed in each area. If the placement is successful, the next step can be performed directly. If the volume of the items contained in the color block does not match the area space it enters, the refrigerator or terminal will issue a reminder, and the user will make adjustments based on the reminder.

[0088] It should be noted that multiple objects can be placed in the same area. However, when a position in the spatial display area is occupied, the newly filled feature pattern cannot occupy it repeatedly. That is, the feature patterns in the spatial display area cannot overlap.

[0089] It is understandable that when generating a placement strategy for items to be placed, if there are items in the refrigerator in advance, the items that have been placed can be identified, and then the information of the items that have been placed can be input into the server, and the placement strategy can be regenerated for the items and the items to be placed as a whole. Alternatively, the positions of the items that have been placed can be left unchanged, and a placement strategy can be generated based on the remaining space and the information of the items to be placed, and the characteristic graphics of the items to be placed can be directly moved to the free placement area.

[0090] 105. Generate a storage strategy based on the arrangement information of items in the placement space.

[0091] When the characteristic graphics of the objects are inserted into the free placement area in the placement space, the main control board generates a storage strategy according to the arrangement information of the objects in the placement space.

[0092] It should be noted that, in some embodiments, the arrangement information of the items in the placement space only includes the arrangement information of the items to be placed in the placement space. That is, when the characteristic graphics of the items to be placed are inserted into the placement space, the items already placed in the placement space are not moved. In some embodiments, the arrangement information of the items in the placement space includes the arrangement information of the items to be placed in the placement space and the arrangement information of the graphic changes of the already placed items. In some other embodiments, the arrangement information of the items in the placement space includes the arrangement information of all the items in the placement space, that is, the arrangement information of the items to be placed and the already placed items in the placement space. It is understandable that the arrangement information of the items in the placement space can be set according to the actual situation and is not specifically limited here.

[0093] Among them, in some embodiments, generating a storage strategy includes generating a 3D image from the arrangement information in the placement space and displaying it on a display screen or sending the 3D image to the user's mobile phone or tablet, etc., so that the user can place the items to be placed according to the 3D image. In some embodiments, generating a storage strategy includes the arrangement information in the placement space can be an arrangement list of the order of placing the items, and the user can place the items according to the arrangement list. In some other embodiments, generating a storage strategy includes numbering the characteristic graphics, marking the numbers on a photo with a coordinate diagram, and the user places the items according to the photo. It should be noted that generating a storage strategy can be any other method, which is not specifically limited here.

[0094] It should be noted that before generating a storage strategy according to the arrangement information of the objects in the placement space, when a control instruction is received, the characteristic pattern is moved to another placement area.

[0095] When the user is not satisfied with the placement strategy, the user can adjust the strategy according to his / her own will. The characteristic graphics are moved to other placement areas. Specifically, a control instruction is sent to the controller, and when the controller receives the control instruction, the characteristic graphics are moved.

[0096] The method of inserting the characteristic graphic into the free placement area in the placement space can be dragging or clicking. For example, first click the characteristic graphic, then click the corresponding position on the screen, the characteristic graphic enters the space display area, and then the position of the characteristic graphic is adjusted by dragging in the space display area, or it is directly dragged to enter the space display area and adjusted.

[0097] The method of inserting the characteristic pattern into the free placement area in the placement space can be controlled by voice, for example, issuing instructions such as "place the watermelon after the milk" or "place the egg in the lower left corner" or "place the tomato in the second place".

[0098] It should be noted that the method of issuing instructions is not limited to text input, voice command or screen manipulation.

[0099] See also Figure 2 , Figure 2 A second flow chart of the item storage method provided in an embodiment of the present application.

[0100] 301. Identify characteristic information of items to be placed.

[0101] See step 101 for details, which will not be described again here.

[0102] 302. Obtain a corresponding feature graphic according to the feature information.

[0103] See step 102 for details, which will not be described again here.

[0104] 303. Display the storage space inside the refrigerator.

[0105] See step 103 for details, which will not be described again here.

[0106] 304. When a control instruction corresponding to the graphic of the placed object is received, the graphic of the placed object is moved to another free placement area.

[0107] When a control instruction corresponding to a graphic of an already placed object is received and the objects to be placed and the already placed objects need to be adjusted as a whole, some of the graphics of the already placed objects need to be moved to other free placement areas.

[0108] It is understandable that moving the characteristic pattern to another placement area can swap the position of the characteristic pattern of the object to be placed with the pattern of the placed object. Specifically, the pattern of the placed object is first moved to an empty placement area, and then the characteristic pattern is moved to the original position of the pattern of the placed object.

[0109] 305. Divide the idle placement area into multiple sub-areas according to the characteristic information of the items to be placed, and different sub-areas have different placement priorities; and set different prompt information in different sub-areas.

[0110] Before placing the items to be placed, the free placement area is divided into different sub-areas according to the characteristic information. For example, the free placement area is divided into the first-level placement area, the second-level placement area, the third-level placement area, the fourth-level placement area, etc. according to the temperature and humidity, softness and hardness, shelf life and size of the items to be placed. The items to be placed are placed in different sub-areas in turn. Different prompt information will be set in each sub-area so that users can understand the specific situation of the items at any time.

[0111] For example, in actual applications, if there are too many items and the refrigerator is too small to accommodate all the items, the priority of placement should be considered when generating a placement strategy, with the shelf life of the items as the first priority, and items that are easy to expire should be placed first. For items without a clear expiration date, such as vegetables and fruits, the server calculates their expiration date based on the attribute information of the goods, for example, the general expiration date of apples is 10 days, and then generates a placement strategy based on this.

[0112] 306. When a control instruction corresponding to a characteristic graphic is received, the characteristic graphic is moved to other free placement areas.

[0113] See step 104 for details, which will not be described again here.

[0114] 307. When it is detected that the characteristic pattern or the pattern of the placed objects is placed unreasonably, a prompt message is issued; and / or the characteristic pattern or the pattern of the placed objects that is placed unreasonably is moved to another placement area until the characteristic pattern or the pattern of the placed objects is placed unreasonably.

[0115] In some embodiments, when an unreasonable placement is detected, a prompt message can be displayed through the display screen of the refrigerator, a prompt sound corresponding to the prompt message can be emitted by the refrigerator, and the prompt message can also be pushed to the user's mobile terminal.

[0116] In some embodiments, when it is detected that the characteristic pattern or the pattern of the placed items is not placed properly, the refrigerator will issue a prompt message. The characteristic pattern or the pattern of the placed items that are not placed properly can also be moved to other placement areas until the characteristic pattern or the pattern of the placed items is placed properly.

[0117] Please continue reading Figure 3 , Figure 3 This is a schematic diagram of the structure of the storage device provided in the embodiment of the present application. This embodiment also provides an article storage device 20, which includes an identification module 210, a generation module 220, a display module 230, a control module 240 and an adjustment module 250.

[0118] The identification module 210 is used to identify the objects to be placed and obtain the characteristic information of the objects to be placed. The identification module 210 can be composed of any one of a camera, a 3D scanner, an RFID reader and a barcode scanner, etc. The specific composition of the identification module 210 is not limited in this application.

[0119] The generating module 220 is used to obtain corresponding feature graphics according to feature information processing.

[0120] The display module 230 is used to display the placement space in the refrigerator and the graphics of the placed items. It should be noted that the display module 230 can be a display screen installed on the refrigerator, or a display screen connected to a terminal such as a mobile phone and a computer.

[0121] The control module 240 is used to insert the characteristic pattern into the vacant placement area in the placement space.

[0122] The adjustment module 250 is used to move the characteristic pattern to other free placement areas when receiving a control instruction.

[0123] In addition, each module in each embodiment of the present invention may be integrated into one processing module, or each module may exist physically separately, or two or more modules may be integrated into one module. The above integrated modules may be implemented in the form of hardware or in the form of software function modules.

[0124] Please combine Figure 4 , Figure 4 A schematic diagram of a refrigerator provided in an embodiment of the present application. The embodiment of the present application also provides a refrigerator 40. The refrigerator 40 includes a door 401, a box 402, an identification unit 403, a camera unit 404, a display screen 405, and a main control board 406. The door 401 and the box 402 are connected by hinges.

[0125] The identification unit 403 may be disposed on the box body 402 or on the door body 401 , and is used to identify objects to be placed and obtain feature information of the objects to be placed.

[0126] The camera unit 404 is disposed in the box 402 and is electrically connected to the identification unit 403, and is used to identify the placement space in the box 402. It should be noted that, in some embodiments, the camera unit 404 is used to identify the placement space in the box 402 and the placed items.

[0127] The display screen 405 is disposed on the door body 401 and is electrically connected to the camera unit 404 to display the placement space in the refrigerator 40 and characteristic graphics of the placed items. It should be noted that the display screen 405 may include a color block display area and a space display area.

[0128] The main control board 406 is arranged on the box body 402 and is electrically connected to the display screen 405. It is used to obtain corresponding characteristic graphics according to characteristic information processing, and insert the characteristic graphics into the vacant placement area in the placement space. When receiving a control instruction, the characteristic graphics are moved to other placement areas, and a storage strategy is generated according to the arrangement information of the objects in the placement space.

[0129] Please continue reading Figure 5 and Figure 6 , Figure 5 This is a schematic diagram of a first scene displayed on a display screen of a refrigerator provided in an embodiment of the present application. Figure 6 A schematic diagram of a second scene displayed on the display screen of a refrigerator provided in an embodiment of the present application. Exemplarily, when the display screen 405 is a two-dimensional flat display, the display screen 405 displays a two-dimensional graphic of the placed items 60 and the specific location of the placed items 60 in the refrigerator. When the display screen 405 is a three-dimensional display, the display screen 405 displays a three-dimensional graphic of the placed items 60 and the specific location of the placed items 60 in the refrigerator. The user can change the location to be placed by dragging or moving the graphic of the placed items.

[0130] In some embodiments, the refrigerator 40 also includes a module with wifi or bluetooth or other network connection, which is connected to the server and can also be connected to terminals such as mobile phones and computers. It is used to send the specific location where the generated graphic of the placed items is inserted to terminals such as mobile phones, which can be viewed in real time. When an unreasonable placement is detected, a prompt message can be displayed on the display screen 405 of the refrigerator 40, a prompt sound corresponding to the prompt message can be emitted by the refrigerator 40, and the prompt message can also be pushed to the user's mobile terminal.

[0131] The embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed on a computer device, the computer executes so that a computer device executes all or part of the steps of the methods of various embodiments of the present invention. It is understood that the computer device may include a memory, a processor, and a computer program stored on the storage medium and executable on the processor. It should be noted that the executing computer device may also be a personal computer, a server, or a network device, etc.

[0132] The storage medium includes: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and other media that can store program codes.

[0133] The above is a detailed introduction to the article storage method and storage device thereof, refrigerator, and computer-readable storage medium provided in the embodiments of the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present application, and the description of the above embodiments is only used to help understand the present application. At the same time, for those skilled in the art, according to the ideas of the present application, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as limiting the present application.

Claims

1. A method for storing items, the method being applied to a refrigerator, the refrigerator comprising a display screen, characterized in that: The method comprises: Identify characteristic information of items to be placed; Obtaining a corresponding characteristic graph according to the characteristic information; Displaying the storage space in the refrigerator on the display screen; Inserting the characteristic pattern into an empty placement area in the placement space; When receiving a control instruction, the characteristic pattern is moved to another free placement area; A storage strategy is generated according to the arrangement information of the items in the placement space.

2. The method according to claim 1, characterized in that When receiving the control instruction, moving the characteristic pattern to other idle placement areas includes: When a sliding instruction corresponding to the characteristic graphic is received, the characteristic graphic is dragged to another free placement area according to the sliding instruction; or When a voice control instruction corresponding to the characteristic graphic is received, the characteristic graphic is moved to another free placement area according to the voice control instruction; When a click instruction corresponding to the characteristic graphic is received, the characteristic graphic is moved to other idle placement areas according to the click instruction.

3. The method according to claim 1, characterized in that Before inserting the characteristic pattern into an idle placement area in the placement space, the method further includes: Graphics of placed items are displayed in the placement space.

4. The method according to claim 3, characterized in that Before inserting the characteristic pattern into an idle placement area in the placement space, the method further includes: When a control instruction corresponding to the graphic of the placed objects is received, the graphic of the placed objects is moved to other free placement areas.

5. The method according to claim 3, characterized in that: Before inserting the characteristic pattern into an idle placement area in the placement space, the method further includes: Dividing the idle placement area into a plurality of sub-areas according to the characteristic information of the items to be placed, and placing priorities of different sub-areas are different; Different prompt information is set in different sub-areas.

6. The method according to claim 3, characterized in that The inserting the characteristic pattern into the idle placement area comprises: Determining, from the graphics of the placed objects, a target object whose similarity to the characteristic graphics is greater than a similarity threshold; and / or Determine, from the pattern of placed objects, a target object having a regular size similar to the characteristic pattern; The characteristic pattern is inserted into an empty placement area around the target object.

7. The method according to claim 1, characterized in that The inserting the characteristic pattern into the idle placement area also includes: Dividing the placement space into a plurality of placement intervals according to the characteristic information, each placement interval corresponding to a different preset characteristic; Matching the characteristic information of the objects to be placed with the preset characteristics of each placement interval; The placement interval that matches the characteristic information of the object to be placed is used as the target placement interval; Insert the characteristic pattern corresponding to the object to be placed into the target placement interval.

8. The method according to claim 3, characterized in that The method further comprises: When it is detected that the characteristic pattern or the pattern of the placed objects is placed unreasonably, a prompt message is issued; and / or Move the unreasonable feature graphics or graphics of placed objects to other placement areas until the feature graphics or graphics of placed objects are reasonably placed.

9. An article storage device, characterized in that: include: A recognition module, used to recognize characteristic information of items to be placed; A generating module, used for obtaining a corresponding characteristic graph according to the characteristic information processing; A display module, used to display the placement space in the refrigerator; A control module, used for inserting the characteristic pattern into an empty placement area in the placement space; The adjustment module is used to move the characteristic pattern to other idle placement areas when receiving a control instruction.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed on a computer, the computer is caused to execute the article storage method according to any one of claims 1 to 8.

11. A refrigerator, characterized in that: include: Door body, A box body, the box body being movably connected to the door body; An identification unit, the identification unit is arranged on the door body, and is used to identify objects to be placed and obtain characteristic information of the objects to be placed; A camera unit, which is disposed in the box and is used to identify the placement space in the box; A display screen, which is arranged on the door body and is electrically connected to the camera unit and is used to display the placement space in the refrigerator; A main control board is arranged on the box body and is electrically connected to the display screen and the identification unit, and is used to obtain a corresponding characteristic pattern according to the characteristic information processing, insert the characteristic pattern into an idle placement area in the placement space, and when a control instruction is received, move the characteristic pattern to other idle placement areas, and generate a storage strategy according to the arrangement information of the objects in the placement space.

Images