Storage equipment control method and device and storage equipment

Abstract

The invention discloses a storage equipment control method and device and storage equipment, and belongs to the field of storage equipment. The storage equipment control method comprises the following steps: under the condition that a door of the storage equipment is opened, acquiring video stream data acquired by an image sensor arranged on the storage equipment; based on the video stream data, detecting change information of a storage object in the storage equipment; and adjusting environmental parameters of the storage equipment based on the change information. According to the storage equipment control method, the environmental parameters can be automatically changed based on the change of the storage objects placed in the corresponding area, the automation degree and response timeliness are high, the control precision and accuracy are high, and the use experience of a user can be improved.

Description

Technical Field

[0001] The present application belongs to the field of storage equipment, and in particular, relates to a storage equipment control method, device and storage equipment. Background Art

[0002] As people's living standards improve, the functional requirements for storage devices are getting higher and higher. In the related art, for some storage devices, such as refrigerators, the ambient temperature and humidity values ​​of their functional compartments often need to be manually set by the user. Once set, if the user does not manually adjust the values, the ambient temperature and humidity of the functional compartment will remain unchanged, and the stored food cannot achieve the best preservation effect, thereby affecting the preservation effect of the food and the user's experience. Summary of the invention

[0003] The present application aims to solve at least one of the technical problems existing in the prior art. To this end, the present application proposes a storage device control method, device and storage device, which can enable environmental parameters to automatically change based on changes in storage objects placed in the corresponding area, have a high degree of automation and timely response, and have high control precision and accuracy, which helps to improve the user experience.

[0004] In a first aspect, the present application provides a storage device control method, the method comprising:

[0005] When the door of the storage device is open, obtaining video stream data collected by an image sensor disposed in the storage device;

[0006] Based on the video stream data, detecting change information of the stored object in the storage device; the change information includes a change position and a category of at least one stored object at the change position;

[0007] Based on the change information, the environmental parameters of the storage device are adjusted.

[0008] According to the storage device control method of the present application, the change information of the storage objects in the storage device is detected by the video stream data collected by the image sensor, so that the environmental parameters of the storage device are adjusted based on the change information. The environmental parameters can be automatically changed based on the changes of the storage objects placed in the corresponding area. It has a high degree of automation and timely response, and the control precision and accuracy are high, which helps to improve the user experience.

[0009] According to an embodiment of the present application, adjusting the environmental parameters of the storage device based on the change information includes:

[0010] Based on the changed position, determining a target area in the storage device where the change occurs;

[0011] Based on the category of at least one storage object at the changed position, determining a target environmental parameter corresponding to the category;

[0012] Based on the target environmental parameter, the environmental parameter of the target area is adjusted.

[0013] According to one embodiment of the present application, the environmental parameters include: at least one of temperature, humidity, oxygen content, lighting mode and deodorizing mode.

[0014] According to an embodiment of the present application, detecting change information of the object stored in the storage device based on the video stream data includes:

[0015] Performing image recognition on at least two video frames in the video stream data to obtain content changes of the at least two video frames;

[0016] Based on the content change, the change information is determined.

[0017] According to an embodiment of the present application, determining the change information based on the content change includes:

[0018] Based on the content change, determining the storage object that has changed;

[0019] The change information is determined based on at least one of a category of the changed storage object, a changed position corresponding to the changed storage object, and an access action corresponding to the changed storage object.

[0020] According to an embodiment of the present application, after acquiring the video stream data collected by the image sensor disposed on the storage device, the method further includes:

[0021] When it is determined based on the video stream data that the storage object in the storage device has not changed, the environmental parameters of the storage device are kept unchanged.

[0022] According to an embodiment of the present application, the storage device includes at least two compartments, each compartment is provided with an image sensor, and when the door of the storage device is opened, obtaining video stream data collected by the image sensor provided in the storage device includes:

[0023] When a door corresponding to a target compartment among the at least two compartments is opened, video stream data collected by an image sensor disposed in the target compartment is acquired.

[0024] According to an embodiment of the present application, after adjusting the environmental parameters of the storage device based on the change information, the method further includes:

[0025] The change information and at least one of the environmental parameters before and after adjustment are outputted in the form of voice broadcast and / or image display.

[0026] In a second aspect, the present application provides a storage device control device, the device comprising:

[0027] A first processing module, configured to obtain video stream data collected by an image sensor disposed on the storage device when the door of the storage device is opened;

[0028] A second processing module is used to detect change information of the stored object in the storage device based on the video stream data; the change information includes a change position and a category of at least one stored object at the change position;

[0029] The third processing module is used to adjust the environmental parameters of the storage device based on the change information.

[0030] According to the storage device control device of the present application, the change information of the storage objects in the storage device is detected through the video stream data collected by the image sensor, so that the environmental parameters of the storage device are adjusted based on the change information. The environmental parameters can be automatically changed based on the changes of the storage objects placed in the corresponding area. It has a high degree of automation and timely response, and the control precision and accuracy are both high, which helps to improve the user experience.

[0031] In a third aspect, the present application provides a storage device, comprising:

[0032] Cabinet;

[0033] An image sensor, wherein the image sensor is disposed in the cabinet;

[0034] As described in the first aspect, the storage device control device is electrically connected to the image sensor.

[0035] In a fourth aspect, the present application provides a non-transitory computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the storage device control method as described in the first aspect above.

[0036] In a fifth aspect, the present application provides a computer program product, including a computer program, which, when executed by a processor, implements the storage device control method as described in the first aspect above.

[0037] The above one or more technical solutions in the embodiments of the present application have at least one of the following technical effects:

[0038] The video stream data collected by the image sensor is used to detect the change information of the storage objects in the storage device, so as to adjust the environmental parameters of the storage device based on the change information. This allows the environmental parameters to automatically change based on the changes of the storage objects placed in the corresponding area. It has a high degree of automation and timely response, and has high control precision and accuracy, which helps to improve the user experience.

[0039] Furthermore, by determining the target area through changing the position, and determining the optimal environmental parameters corresponding to the category based on the category of the actual storage object after the change, so as to adjust the environmental parameters of the target area to the optimal environmental parameters, precise control of the internal environmental parameters of the storage device can be achieved, effectively improving the preservation effect of food and other items, and improving storage quality.

[0040] Furthermore, by outputting the change information and at least one of the environmental parameters before and after adjustment through voice broadcast or image display, the user can be reminded in time of the latest working status of the storage device and the information of each storage object stored in the storage device, thereby realizing human-computer interaction, facilitating user management, and further improving the user experience.

[0041] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0043] Figure 1 It is one of the flow charts of the storage device control method provided in the embodiment of the present application;

[0044] Figure 2 This is the second flow chart of the storage device control method provided in the embodiment of the present application;

[0045] Figure 3 is a schematic diagram of an interface of a storage device control method provided in an embodiment of the present application;

[0046] Figure 4 is a structural schematic diagram of a storage device control device provided in an embodiment of the present application;

[0047] Figure 5 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0048] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0049] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0050] The storage device control method, storage device control apparatus, storage device and readable storage medium provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and their application scenarios.

[0051] The storage device control method may be applied to a terminal, and may be specifically executed by hardware or software in the terminal.

[0052] The terminal includes but is not limited to portable communication devices such as mobile phones or tablet computers. It should also be understood that in some embodiments, the terminal may not be a portable communication device, but a desktop computer.

[0053] The storage device control method provided in the embodiment of the present application may be executed by a storage device, or a functional module or functional entity in the storage device that can implement the storage device control method, or may be an electronic device that is communicatively connected to the storage device. The electronic devices mentioned in the embodiment of the present application include but are not limited to mobile phones, tablet computers, computers, cameras, and wearable devices. The storage device control method provided in the embodiment of the present application is described below using a storage device as an example of the execution subject.

[0054] like Figure 1 As shown, the storage device control method includes: step 110, step 120 and step 130.

[0055] Step 110: When the door of the storage device is open, obtain video stream data collected by an image sensor disposed in the storage device;

[0056] In this step, the storage equipment may include refrigerators, freezers, vending machines and other equipment.

[0057] It is understandable that one or more compartments may be provided in the storage device for storing items.

[0058] In the case of including multiple compartments, different compartments may correspond to different functions. Taking a refrigerator as an example, the refrigerator may include a freezer compartment, a fresh-keeping compartment, a refrigerator compartment, a humidity control drawer, and the like.

[0059] Different compartments may correspond to the same or different environmental parameters.

[0060] In some embodiments, the environmental parameters may include at least one of temperature, humidity, oxygen content, lighting mode, and deodorization mode.

[0061] The image sensor is arranged in the storage device and is used for collecting image information in the storage device.

[0062] The number of image sensors may be one or more.

[0063] In some embodiments, there may be multiple image sensors, which are respectively disposed at different positions of the storage device to collect image information in different compartments.

[0064] For example, taking a refrigerator as an example, image sensors can be set in the refrigerating chamber and the freezing chamber respectively to collect video stream data corresponding to the refrigerating chamber and the freezing chamber respectively.

[0065] In the actual implementation process, Figure 2 As shown, continuing to take a refrigerator as an example, when the refrigerator door is opened, the image sensor set in the refrigerator is started to collect video stream data.

[0066] The collected video stream data can be stored locally or in a cloud server and retrieved when needed.

[0067] In some embodiments, when the storage device includes at least two compartments and each compartment is provided with an image sensor, step 110 may include: when a door corresponding to a target compartment among the at least two compartments is opened, acquiring video stream data collected by the image sensor provided in the target compartment.

[0068] In this embodiment, the target compartment may be any compartment of the at least two compartments.

[0069] The number of target compartments can be one or more.

[0070] For example, taking a refrigerator as an example, an image sensor may be disposed above the door of the freezer compartment to collect video stream data of the freezer compartment, and an image sensor may be disposed on the top of the interior of the refrigerator compartment to collect video stream data of the refrigerator compartment.

[0071] For any compartment, when it is detected that the door of the compartment is opened, the video stream data corresponding to the compartment can be collected by the image sensor arranged in the compartment.

[0072] According to the storage device control method provided in the embodiment of the present application, by setting corresponding image sensors in different compartments to collect video stream data in the corresponding compartments, the precision and accuracy of the collected video stream data can be improved, thereby helping to improve the accuracy of subsequent judgment and control.

[0073] Step 120: Detect change information of the stored object in the storage device based on the video stream data;

[0074] In this step, the storage objects are objects placed in the storage device, including but not limited to food, daily necessities and other items.

[0075] The number of storage objects can be one or more.

[0076] The stored objects may include stored objects and objects to be stored.

[0077] The change information is used to indicate changes in the positions of the storage objects in the storage device.

[0078] For example, take oranges out of the refrigerator or put tomatoes in the humidity drawer.

[0079] The change information may include a change position and a category of at least one storage object at the change position.

[0080] The changed position refers to the position where the placed storage object changes.

[0081] For example, the variable positions may include a refrigerator, a specific function drawer (such as a temperature-changing drawer, a humidity-adjusting drawer, a vegetable and fruit drawer, etc.), and a freezer, etc.

[0082] In some embodiments, the category of the storage object may also be expressed as the name of the storage object.

[0083] In some embodiments, the change information may also include: an access action corresponding to the change position.

[0084] Among them, access actions include: putting in and taking out.

[0085] In some embodiments, the change information may also include: a device identification.

[0086] In this embodiment, the device identifier is an identity feature identifier of the storage device.

[0087] The identifier may be the name, ID or number of the storage device, etc., and this application does not limit this.

[0088] In some embodiments, the format of the change information may be: (device ID, change location, access action, storage object name)

[0089] For example, when the change information is (refrigerator 1, fresh-keeping room, put in, apple), it indicates that apples are newly put into the fresh-keeping room at this time; for another example, when the change information is (refrigerator 1, freezer, take out, fish), it indicates that fish is taken out of the freezer at this time.

[0090] In the actual implementation process, the video stream data can be processed by an image recognition algorithm or a pre-trained neural network model to obtain change information.

[0091] In some embodiments, step 110 and step 120 may also be implemented through edge computing, that is, autonomous computing on the storage device side; or may also be executed through the cloud.

[0092] In some embodiments, step 120 may include:

[0093] Performing image recognition on at least two video frames in the video stream data to obtain content changes of at least two video frames;

[0094] Determine the change information based on the content changes.

[0095] In this embodiment, the video stream data includes a plurality of consecutive video frames.

[0096] The content change is used to characterize the changes in the category, quantity, and position of the storage objects included in the previous and next video frames.

[0097] In the actual implementation process, image recognition can be performed on the video frames based on any achievable image recognition algorithm to obtain the feature images included in each video frame, and the feature images are compared to obtain content changes.

[0098] In some embodiments, based on the content change situation, determining the change information includes:

[0099] Based on the content changes, determine the storage objects that have changed;

[0100] The change information is determined based on the category of the changed storage object, the changed position corresponding to the changed storage object, and the access action corresponding to the changed storage object.

[0101] In this embodiment, the changed storage object may be an object newly placed in from outside the storage device; or it may be an object taken out from the storage device; or it may be an object whose position has changed in the storage device, such as moving food from a refrigerator to a freezer.

[0102] The following description will be made taking the refrigerator compartment as an example.

[0103] After the refrigerator door is opened, the image sensor installed on the top of the fresh-keeping room collects the internal video stream data of the refrigerator room, and performs image recognition on the previous and next multiple video frames to determine the content changes of the previous and next multiple video frames. For example, if there is no apple in the fresh-keeping room in the previous frame, but an apple appears in the fresh-keeping room in the next frame, it means that the user has put the apple into the fresh-keeping room, and thus the change information can be determined as (refrigerator 1, fresh-keeping room, put in, apple).

[0104] A similar method can be used to identify each compartment to determine the change information corresponding to the objects stored in each compartment.

[0105] According to the storage device control method provided in the embodiment of the present application, the change information is determined by the content changes of at least two video frames. The algorithm is simple, the calculation efficiency is high, and it has high recognition precision and accuracy.

[0106] Continue to refer Figure 2 In some embodiments, the method may further include: updating the storage list corresponding to each compartment based on content changes.

[0107] In this embodiment, the storage list is used to store change information corresponding to the storage objects in each room, time information of the change, location information of the storage objects that have not changed, and the category of each storage object.

[0108] The storage list is updated in real time.

[0109] In actual execution, the storage list may be stored in a cloud server that is in communication with the storage device.

[0110] Step 130: Adjust environmental parameters of the storage device based on the change information.

[0111] In this step, the environmental parameters are used to control the environment-related values ​​in the storage device.

[0112] Environmental parameters may include, but are not limited to: temperature, humidity, oxygen content, odor-free mode, and lighting mode.

[0113] Among them, the lighting mode is used to indicate whether the lighting is turned on.

[0114] The odor-free mode is used to indicate whether the odor-free function is turned on.

[0115] It can be understood that, when the storage device includes multiple compartments, the environmental parameters corresponding to each compartment can be independent of each other, that is, the environmental parameters corresponding to each compartment can be adjusted independently.

[0116] For example, when new food that needs to be quickly frozen is placed, the temperature and humidity of the placement area may need to be adjusted to allow the new food to be quickly frozen.

[0117] For another example, when it is detected that all the food in a certain chamber has been taken out, the temperature of that chamber can be adaptively increased to reduce energy loss.

[0118] During the research and development process, the inventors discovered that in the related technologies, for the compartments of storage devices, such as the refrigerator's refrigerator compartment, functional drawers (such as variable temperature drawers) and freezer compartment, the storage environment often needs to be manually set by the user; when the ingredients change, the user generally does not know whether they need to be reset, and what kind of environment is optimal for the currently stored ingredients, which affects the preservation and storage effects of the ingredients, and also affects the user's experience.

[0119] In the present application, the change information of the storage objects in the storage device is detected by the video stream data collected by the image sensor, so as to adjust the environmental parameters of the storage device based on the change information, so that the storage device can automatically detect the changes of the storage objects placed at each position, and adjust the environmental parameters of the changed area accordingly based on the changes, so that the environmental parameters can automatically change based on the changes of the storage objects placed in the corresponding area, without the need for manual setting by the user, and have a high degree of automation; in addition, the best storage environment can be calculated based on the latest storage situation to adjust the environmental parameters such as temperature and humidity of the storage device, so as to achieve the best storage effect, significantly improve the preservation effect of food, etc., and the response is timely, and the control precision and accuracy are high.

[0120] According to the storage device control method provided in the embodiment of the present application, the video stream data collected by the image sensor is used to detect the change information of the storage objects in the storage device, so that the environmental parameters of the storage device are adjusted based on the change information. This allows the environmental parameters to automatically change based on the changes of the storage objects placed in the corresponding area. It has a high degree of automation and timely response, and the control precision and accuracy are both high, which helps to improve the user experience.

[0121] Continue to refer Figure 2 In some embodiments, step 130 may further include:

[0122] Based on the changed position, determine the target area in the storage device where the change occurred;

[0123] Based on the category of at least one storage object at the changed position, determining a target environmental parameter corresponding to the category;

[0124] Based on the target environmental parameters, the environmental parameters of the target area are adjusted.

[0125] In this embodiment, the target environment parameter is an optimal storage environment parameter, which is used to achieve the best preservation effect for the stored object.

[0126] In some embodiments, the target environment parameters may be determined based on freshness, so that the food stored in the target area can achieve the best freshness preservation effect.

[0127] Of course, in other embodiments, the target environmental parameters may also be determined based on the categories of food that are prioritized for preservation, etc., and may be specifically determined based on actual conditions, and this application does not limit this.

[0128] The target area may be a specific compartment where a change in the storage object occurs.

[0129] It should be noted that the number of target areas can be one or more.

[0130] In actual implementation, multiple target areas can be determined simultaneously.

[0131] For example, based on the change information (refrigerator 1, fresh-keeping room, put in, apple), the changed position can be determined as the fresh-keeping room, and the fresh-keeping room can be determined as the target area; based on the change information (refrigerator 1, freezer, take out, fish), the freezer can be determined as the target area.

[0132] Then, the categories of all the storage objects currently stored in the fresh-keeping room are obtained, and based on the newly obtained information such as the categories, the optimal environmental parameters corresponding to all the storage objects currently stored are recalculated.

[0133] It can be understood that the method of the present application can support the simultaneous change of multiple locations and multiple ingredients, such as the user can take out oranges from the refrigerator and put tomatoes into the humidity control drawer at one time.

[0134] According to the storage device control method provided in the embodiment of the present application, the target area is determined by changing the position, and the optimal environmental parameters corresponding to the category are determined based on the category of the actual storage object after the change, so that the environmental parameters of the target area are adjusted to the optimal environmental parameters. This can achieve precise control of the internal environmental parameters of the storage device, effectively improve the preservation effect of food and other items, and improve storage quality.

[0135] In some embodiments, after step 110, the method may further include:

[0136] When it is determined based on the video stream data that the storage object in the storage device has not changed, the environmental parameters of the storage device are kept unchanged.

[0137] In this embodiment, the storage objects have not changed may include: no new storage objects to be placed in the storage device; no storage objects are taken out of the storage device; or the positions of the storage objects originally placed in the compartments in the storage device have not changed.

[0138] When it is determined that the storage objects at various locations in the storage device have not changed, the environmental parameters of the storage device can be kept unchanged to reduce energy consumption.

[0139] According to the storage device control method provided in the embodiment of the present application, by maintaining the environmental parameters of the storage device unchanged while ensuring that the storage objects at various positions in the storage device have not changed, the energy loss of the storage device can be reduced, thereby saving energy and electricity.

[0140] Continue to refer Figure 2 In some embodiments, after step 130, the method may further include:

[0141] At least one of the change information and the environmental parameters before and after adjustment is outputted by voice broadcast and / or image display.

[0142] In this embodiment, the environmental parameters before and after adjustment may include but are not limited to: temperature before and after adjustment, humidity before and after adjustment, oxygen content before and after adjustment, lighting on status before and after adjustment, and odor removal on status before and after adjustment.

[0143] The change information may include: a change location, a category of at least one storage object at the change location, and an access action, etc.

[0144] The output change information may be output in at least one of the following ways.

[0145] First, at least one of the change information and the environmental parameters before and after the adjustment is output through voice broadcast.

[0146] In this embodiment, the relevant information can be broadcasted through a voice device provided in the storage device.

[0147] For example, the user may be prompted by voice that new optimal freshness-keeping parameters have been set for the refrigerator.

[0148] Alternatively, the relevant information may be sent to a user terminal electrically connected to the storage device, such as to a user's mobile phone, so that the mobile phone can perform voice broadcasting.

[0149] Second, display at least one of the change information and the environmental parameters before and after adjustment.

[0150] In this embodiment, the relevant information may be displayed on a display panel disposed on the storage device.

[0151] like Figure 3As shown, the refrigerator displays the information of the changed ingredients at each changed position, as well as the environmental parameters "8℃→6℃" before and after the adjustment of the position through the display panel.

[0152] Alternatively, the relevant information may be sent to a user terminal electrically connected to the storage device, such as a user's mobile phone, so as to be displayed on a mobile phone screen.

[0153] In some embodiments, a corresponding control may also be set on the display panel, and a corresponding operation may be performed by receiving user input on the target control.

[0154] For example, after outputting at least one of the change information and the environmental parameters before and after adjustment, receiving a user input to the target control;

[0155] In response to the input, the target instruction is executed.

[0156] In this embodiment, the input is used to select whether to perform automatic intelligent settings or retain the original environmental parameters.

[0157] Based on the user's input, the refrigerator enters automatic intelligent setting mode or retains the original environmental parameters.

[0158] Third, at least one of the change information and the environmental parameters before and after the adjustment is output in text form.

[0159] In this embodiment, the relevant information may be output in the form of a document or a table.

[0160] Of course, in other embodiments, at least one of the change information and the environmental parameters before and after adjustment may be output based on other methods, which is not limited in the present application.

[0161] According to the storage device control method provided in the embodiment of the present application, the change information and at least one of the environmental parameters before and after adjustment are outputted by voice broadcast or image display, and the change content is actively prompted, which can timely remind the user of the latest working status of the storage device and the information of each storage object stored in the storage device, realize human-computer interaction, facilitate user management, bring users an intelligent experience, and further improve the user's usage experience.

[0162] In some embodiments, continue to refer to Figure 2 After detecting that the door of the storage device is closed, the corresponding image sensor can be turned off to wait for the next round of detection.

[0163] The method of the present application is described in detail below using a refrigerator as an example.

[0164] Continue to refer Figure 2,When the refrigerator door opening signal is detected, the corresponding camera is started to capture the ,video signal and continuously upload it to the video detection server until the refrigerator door is closed and the ,upload stops.

[0165] Among them, the camera corresponding to the refrigerator room is the camera above the refrigerator room, and the camera corresponding to the freezer room is the camera embedded in the refrigerator room door.

[0166] The video detection server collects the video stream and determines where the food has changed.

[0167] If there is no change, do nothing.

[0168] If there are any changes, the change information will be sent to the environment setting server.

[0169] The environment setting server reads the change information and reads the ingredient storage list of the current changed location of the device from the ingredient storage database.

[0170] The environment setting server recalculates the new food storage list for each location of the current device based on the change list: it traverses each storage location that has changed, and if food is placed in the location, it adds the food to the storage food list of the location; if food is taken out, it deletes the food from the storage list of the location.

[0171] Write the new storage list to the food storage database.

[0172] For storage locations where ingredients have changed, the optimal preservation environment parameters are calculated based on the new ingredient storage list. The parameters include temperature, humidity, oxygen content, whether the light is turned on, and whether the odor removal function is turned on.

[0173] The environment setting server sends the change information of each changed position and the new preservation parameters to the refrigerator.

[0174] The refrigerator displays the changed ingredients in each changed position through the screen, such as Figure 3 The new fresh-keeping parameters for the location are displayed, and the electronic control command is sent to change the parameters, and the voice prompts the user that the new optimal fresh-keeping parameters have been set for the refrigerator.

[0175] The storage device control method provided in the embodiment of the present application can be executed by a storage device control apparatus. In the embodiment of the present application, the storage device control apparatus provided in the embodiment of the present application is described by taking the storage device control apparatus executing the storage device control method as an example.

[0176] The embodiment of the present application also provides a storage device control device.

[0177] like Figure 4 As shown, the storage device control device includes: a first processing module 410, a second processing module 420 and a third processing module 430.

[0178] The first processing module 410 is used to obtain video stream data collected by an image sensor disposed in the storage device when the door of the storage device is opened;

[0179] The second processing module 420 is used to detect change information of the storage object in the storage device based on the video stream data; the change information includes a change position and a category of at least one storage object at the change position;

[0180] The third processing module 430 is used to adjust the environmental parameters of the storage device based on the change information.

[0181] According to the storage device control device provided in the embodiment of the present application, the change information of the storage objects in the storage device is detected by using the video stream data collected by the image sensor, so as to adjust the environmental parameters of the storage device based on the change information. The environmental parameters can be automatically changed based on the changes of the storage objects placed in the corresponding area. The device has a high degree of automation and timely response, and the control precision and accuracy are both high, which helps to improve the user experience.

[0182] In some embodiments, the third processing module 430 may also be used to:

[0183] Based on the changed position, determine the target area in the storage device where the change occurred;

[0184] Based on the category of at least one storage object at the changed position, determining a target environmental parameter corresponding to the category;

[0185] Based on the target environmental parameters, the environmental parameters of the target area are adjusted.

[0186] In some embodiments, the second processing module 420 may also be used to:

[0187] Performing image recognition on at least two video frames in the video stream data to obtain content changes of at least two video frames;

[0188] Determine the change information based on the content changes.

[0189] In some embodiments, the second processing module 420 may also be used to:

[0190] Based on the content changes, determine the storage objects that have changed;

[0191] The change information is determined based on the category of the changed storage object, the changed position corresponding to the changed storage object, and the access action corresponding to the changed storage object.

[0192] In some embodiments, the apparatus may further include: a fourth processing device, configured to:

[0193] After acquiring the video stream data collected by the image sensor disposed in the storage device, when it is determined based on the video stream data that the storage object in the storage device has not changed, the environmental parameters of the storage device are kept unchanged.

[0194] In some embodiments, the storage device includes at least two compartments, each compartment is provided with an image sensor, and the first processing module 410 can also be used to:

[0195] When a door corresponding to a target compartment among the at least two compartments is opened, video stream data collected by an image sensor disposed in the target compartment is acquired.

[0196] In some embodiments, the apparatus may further include: a fifth processing device, configured to:

[0197] After adjusting the environmental parameters of the storage device based on the change information, at least one of the change information and the environmental parameters before and after the adjustment is outputted through voice broadcast and / or image display.

[0198] The storage device control device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc. It can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., and the embodiment of the present application is not specifically limited.

[0199] The storage device control device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an IOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0200] The storage device control device provided in the embodiment of the present application can achieve Figures 1 to 3To avoid repetition, the various processes implemented by the method embodiment are not described here.

[0201] The embodiment of the present application also provides a storage device.

[0202] The storage device comprises: a cabinet, an image sensor and a storage device control device as described in any of the above embodiments.

[0203] In this embodiment, the image sensor is disposed in the cabinet to collect image information.

[0204] The storage device control apparatus is electrically connected to the image sensor, and is used to execute the storage device control method described in any of the above embodiments.

[0205] According to the storage device provided in the embodiment of the present application, the change information of the storage objects in the storage device is detected through the video stream data collected by the image sensor, so that the environmental parameters of the storage device are adjusted based on the change information. The environmental parameters can be automatically changed based on the changes of the storage objects placed in the corresponding area. It has a high degree of automation and timely response, and the control precision and accuracy are both high, which helps to improve the user experience.

[0206] In some embodiments, Figure 5 As shown, an embodiment of the present application also provides an electronic device 500, including a processor 501, a memory 502, and a computer program stored in the memory 502 and executable on the processor 501. When the program is executed by the processor 501, each process of the above-mentioned storage device control method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be described here.

[0207] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0208] An embodiment of the present application also provides a non-transitory computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the various processes of the above-mentioned storage device control method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0209] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0210] An embodiment of the present application also provides a computer program product, including a computer program, which implements the above-mentioned storage device control method when executed by a processor.

[0211] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0212] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned storage device control method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0213] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0214] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0215] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0216] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

[0217] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "illustrative embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials, or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0218] Although the embodiments of the present application have been shown and described, those skilled in the art will appreciate that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present application, and that the scope of the present application is defined by the claims and their equivalents.

Claims

1. A storage device control method, characterized in that: include: When the door of the storage device is open, obtaining video stream data collected by an image sensor disposed in the storage device; Based on the video stream data, detecting change information of the stored object in the storage device; the change information includes a change position and a category of at least one stored object at the change position; Based on the change information, the environmental parameters of the storage device are adjusted.

2. The storage device control method according to claim 1, characterized in that: The adjusting the environmental parameters of the storage device based on the change information includes: Based on the changed position, determining a target area in the storage device where the change occurs; Based on the category of at least one storage object at the changed position, determining a target environmental parameter corresponding to the category; Based on the target environmental parameter, the environmental parameter of the target area is adjusted.

3. The storage device control method according to claim 1, characterized in that: The environmental parameters include: at least one of temperature, humidity, oxygen content, lighting mode and deodorization mode.

4. The storage device control method according to any one of claims 1 to 3, characterized in that: The detecting, based on the video stream data, change information of the stored object in the storage device comprises: Performing image recognition on at least two video frames in the video stream data to obtain content changes of the at least two video frames; Based on the content change, the change information is determined.

5. The storage device control method according to claim 4, characterized in that: The determining the change information based on the content change includes: Based on the content change, determining the storage object that has changed; The change information is determined based on the category of the changed storage object, the changed position corresponding to the changed storage object, and the access action corresponding to the changed storage object.

6. The storage device control method according to any one of claims 1 to 3, characterized in that: After acquiring the video stream data collected by the image sensor disposed on the storage device, the method further includes: When it is determined based on the video stream data that the storage object in the storage device has not changed, the environmental parameters of the storage device are kept unchanged.

7. The storage device control method according to any one of claims 1 to 3, characterized in that: The storage device comprises at least two compartments, each compartment is provided with an image sensor, and when the door of the storage device is opened, obtaining video stream data collected by the image sensor provided in the storage device comprises: When a door corresponding to a target compartment among the at least two compartments is opened, video stream data collected by an image sensor disposed in the target compartment is acquired.

8. The storage device control method according to any one of claims 1 to 3, characterized in that: After adjusting the environmental parameters of the storage device based on the change information, the method further includes: The change information and at least one of the environmental parameters before and after adjustment are outputted in the form of voice broadcast and / or image display.

9. A storage device control device, characterized in that: include: A first processing module, configured to obtain video stream data collected by an image sensor disposed on the storage device when the door of the storage device is opened; A second processing module is used to detect change information of the stored object in the storage device based on the video stream data; the change information includes a change position and a category of at least one stored object at the change position; The third processing module is used to adjust the environmental parameters of the storage device based on the change information.

10. A storage device, characterized in that: include: Cabinet; An image sensor, wherein the image sensor is disposed in the cabinet; The storage device control device as described in claim 9, wherein the storage device control device is electrically connected to the image sensor.

11. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the storage device control method as described in any one of claims 1 to 8 is implemented.

12. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the storage device control method according to any one of claims 1 to 8 is implemented.

Images