Control methods, devices and refrigeration equipment

Abstract

This application discloses a control method, apparatus, and refrigeration equipment for a refrigeration device, belonging to the technical field of refrigeration equipment. The control method includes: when a preset processing program corresponding to a target object is initiated in a target room of at least one of the at least one compartment, controlling the image sensor in the target room to acquire multiple video frames corresponding to the target object; based on at least one of the time nodes corresponding to the preset processing program, user input, and feature changes of the target object in each of the video frames, selecting at least a subset of video frames from the multiple video frames; and outputting the at least a subset of video frames. The control method for the refrigeration equipment of this application eliminates the need for the user to open the refrigeration equipment, ensures the processing effect of the target object, and provides a simple and convenient viewing method, improving the user experience.

Description

Technical Field

[0001] This application belongs to the field of refrigeration equipment technology, and particularly relates to a control method, device and refrigeration equipment for refrigeration equipment. Background Technology

[0002] With the diversification of user needs, refrigeration equipment has a wider range of applications, such as food processing. In related technologies, during food processing, users need to manually and frequently open and close the door of the refrigeration equipment to check the status of the food. However, this method affects the processing effect and is cumbersome, impacting the user experience. Summary of the Invention

[0003] This application aims to address at least one of the technical problems existing in the related art. To this end, this application proposes a control method, apparatus, and refrigeration equipment that eliminates the need for the user to open the refrigeration equipment, ensuring the processing effect of the target object, and providing a simple and convenient viewing method, thus improving the user experience.

[0004] In a first aspect, this application provides a control method for a refrigeration device, the refrigeration device including at least one compartment, wherein an image sensor is disposed in the compartment; the method includes:

[0005] When it is determined that a preset processing program corresponding to the target object is started in the target room of at least one of the rooms, the image sensor in the target room is controlled to acquire multiple video frames corresponding to the target object;

[0006] Based on at least one of the time nodes corresponding to the preset processing program, user input, and feature changes of the target object in each video frame, at least a portion of the video frames are selected from the multiple video frames.

[0007] Output at least a portion of the video frames.

[0008] According to the control method of the refrigeration equipment of this application, the image sensor is controlled to acquire multiple video frames corresponding to the target object. Based on one or more of the following: the time node corresponding to the preset processing program, user input, and the characteristic changes of the target object in each video frame, at least some of the more critical video frames are selected from the multiple video frames so that the user can view the status of the target object through at least some video frames. This eliminates the need for the user to turn on the refrigeration equipment, ensuring the processing effect of the target object. The viewing method is simple and convenient, improving the user experience.

[0009] According to the control method of the refrigeration equipment of this application, the step of selecting at least a portion of video frames from the multiple video frames based on at least one of the time node corresponding to the preset processing program, user input, and feature changes of the target object in each of the video frames includes:

[0010] If the acquisition time of the first video frame in each of the video frames matches the time node corresponding to the target first sub-process in at least one processing step included in the preset processing program, the first video frame is determined to be one of the at least some video frames; the time node corresponding to the target first sub-process includes: the start node corresponding to the target first sub-process and the end node corresponding to the target first sub-process.

[0011] According to the control method of the refrigeration equipment of this application, the step of selecting at least a portion of video frames from the multiple video frames based on at least one of the time node corresponding to the preset processing program, user input, and feature changes of the target object in each of the video frames includes:

[0012] Receive the user's first input;

[0013] In response to the first input, determine the query time node corresponding to the user input;

[0014] If the acquisition time corresponding to the second video frame in each of the video frames matches the query time node, the second video frame is determined to be one of the at least some video frames.

[0015] According to the control method of the refrigeration equipment of this application, the step of selecting at least a portion of video frames from the multiple video frames based on at least one of the time node corresponding to the preset processing program, user input, and feature changes of the target object in each of the video frames includes:

[0016] If the difference between the features of the target object in the third video frame and the fourth video frame is greater than the difference threshold, the fourth video frame is determined as one of the at least some video frames; the third video frame and the fourth video frame are video frames acquired within the same time node corresponding to the same processing procedure, and the acquisition time corresponding to the fourth video frame is after the acquisition time corresponding to the third video frame.

[0017] According to the control method of the cooling device of this application, after outputting the at least partial video frames, the method further includes:

[0018] When it is determined that the preset processing procedure corresponding to the target object has ended, based on the start node of each processing step included in the preset processing procedure, the end node of each processing step, the temperature information of the target room under each processing step, and the at least part of the video frames during the operation of the preset processing procedure, a processing report information is generated.

[0019] Output the processing report information.

[0020] According to the control method of the refrigeration equipment of this application, the step of determining the target room in the at least one compartment to start the preset processing program corresponding to the target object includes:

[0021] Receive the user's second input;

[0022] In response to the second input, it is determined that the target room in the at least one room will start the preset processing program corresponding to the target object.

[0023] According to the control method of the refrigeration equipment of this application, after the image sensor in the target compartment acquires multiple video frames corresponding to the target object, the method further includes:

[0024] If the video frame detects that the feature of the target object is not present or the feature completeness of the target object is less than the feature completeness threshold, a prompt message is output; the prompt message is used to instruct the target object to adjust its position in the target room, and after adjusting the position of the target object in the target room, the image sensor is controlled to acquire multiple video frames corresponding to the target object.

[0025] Secondly, this application provides a control device for a refrigeration device, the refrigeration device including at least one compartment, wherein an image sensor is disposed in the compartment; the device includes:

[0026] The first processing module is used to control the image sensor in the target room to acquire multiple video frames corresponding to the target object when it is determined that the target room in the at least one room has started a preset processing program corresponding to the target object.

[0027] The second processing module is used to filter at least a portion of the video frames from the multiple video frames based on at least one of the time nodes corresponding to the preset processing program, user input, and feature changes of the target object in each of the video frames.

[0028] The third processing module is used to output the at least some of the video frames.

[0029] According to the control device of the refrigeration equipment of this application, the image sensor is controlled to acquire multiple video frames corresponding to the target object. Based on one or more of the time nodes corresponding to the preset processing program, user input, and the characteristic changes of the target object in each video frame, at least some of the more critical video frames are selected from the multiple video frames so that the user can view the status of the target object through at least some video frames. This eliminates the need for the user to turn on the refrigeration equipment, ensuring the processing effect of the target object. The viewing method is simple and convenient, improving the user experience.

[0030] Thirdly, this application provides a refrigeration device, comprising:

[0031] At least one room;

[0032] A door, which is installed in the at least one room in an opening and closing manner;

[0033] An image sensor, wherein the image sensor is disposed in each of the compartments;

[0034] Based on the control device of the refrigeration equipment as described in the second aspect, the control device of the refrigeration equipment is electrically connected to the image sensor.

[0035] Fourthly, this application provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the control method for the refrigeration device as described in the first aspect above.

[0036] Fifthly, this application provides a computer program product, including a computer program that, when executed by a processor, implements the control method for the refrigeration equipment as described in the first aspect above.

[0037] The above-described one or more technical solutions in the embodiments of this application have at least one of the following technical effects:

[0038] By controlling the image sensor to acquire multiple video frames corresponding to the target object, and based on one or more of the time nodes corresponding to the preset processing program, user input, and the characteristic changes of the target object in each video frame, at least some of the more critical video frames are selected from the multiple video frames so that the user can view the status of the target object through at least some video frames. This eliminates the need for the user to turn on the cooling equipment, ensuring the processing effect of the target object, and the viewing method is simple and convenient, improving the user experience.

[0039] Furthermore, by determining that the acquisition time corresponding to the first video frame matches the time node corresponding to the first sub-process of the target, the first video frame is identified as at least a portion of the video frames, effectively filtering out at least a portion of the key video frames from multiple video frames, thereby improving the accuracy and relevance of the feedback on the target object status.

[0040] Furthermore, by receiving the user's first input and responding to it, the system effectively obtains the query time node corresponding to the user's input, identifies the second video frame whose acquisition time matches the query time node, and determines it as at least a portion of the video frames. This effectively filters out the video frames required by the user, satisfies the user's status query needs, and improves the user experience.

[0041] Furthermore, by determining that the difference between the features of the target object in the third and fourth video frames is greater than the difference threshold, the fourth video frame is identified as at least a partial video frame. This effectively filters out at least a partial video frame in which the features of the target object change significantly during the processing, thereby prompting the user to pay attention to the changes in the state of the target object in a timely manner.

[0042] Additional aspects and advantages of this application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of this application. Attached Figure Description

[0043] The above and / or additional aspects and advantages of this application will become apparent and readily understood from the description of the embodiments taken in conjunction with the following drawings, in which:

[0044] Figure 1 This is one of the flowcharts illustrating the control method for a refrigeration device provided in the embodiments of this application;

[0045] Figure 2 This is a second schematic flowchart of the control method for the refrigeration equipment provided in the embodiments of this application;

[0046] Figure 3 This is the third flowchart illustrating the control method for the refrigeration equipment provided in the embodiments of this application;

[0047] Figure 4 This is a schematic diagram of the structure of the control device for the refrigeration equipment provided in the embodiments of this application;

[0048] Figure 5 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application;

[0049] Figure 6 This is a schematic diagram of the structure of the refrigeration equipment provided in the embodiments of this application. Detailed Implementation

[0050] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0051] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0052] The following description, in conjunction with the accompanying drawings, details the control method, control device, refrigeration equipment, electronic equipment, and readable storage medium for the refrigeration equipment provided in this application, through specific embodiments and application scenarios.

[0053] The control method for the refrigeration equipment can be applied to the terminal, and can be executed by the hardware or software in the terminal.

[0054] The terminal includes, but is not limited to, portable communication devices such as mobile phones or tablets. It should also be understood that, in some embodiments, the terminal may not be a portable communication device, but rather a desktop computer.

[0055] The following embodiments describe a terminal including a display and a touch-sensitive surface. However, it should be understood that the terminal may include one or more other physical user interface devices such as a physical keyboard, mouse, and joystick.

[0056] The control method for a refrigeration device provided in this application embodiment can be executed by the refrigeration device itself, or by the controller of the refrigeration device installed on the refrigeration device, or by a server electrically connected (wired or wirelessly connected) to the refrigeration device, or by a user terminal communicatively connected to the refrigeration device, including but not limited to mobile terminals and non-mobile terminals.

[0057] like Figure 1 As shown, the control method of the refrigeration equipment includes steps 110, 120 and 130.

[0058] Refrigeration equipment can be understood as a broad category of refrigeration and storage equipment, including but not limited to refrigerators, freezers, display cases, beverage cabinets, wine cabinets, refrigerated display cases, and refrigerated vending machines. Refrigeration equipment has diverse structural forms and a wide range of applications.

[0059] The refrigeration equipment includes at least one compartment.

[0060] Image sensors are installed in the room.

[0061] The specific installation location of the image sensor can be determined based on the actual situation, and this application does not impose any restrictions.

[0062] Step 110: When it is determined that the preset processing program corresponding to the target object is started in at least one of the target rooms, control the image sensor in the target room to acquire multiple video frames corresponding to the target object;

[0063] In this embodiment, the target room is any one of one or more rooms.

[0064] The target object is an object that needs to be processed by refrigeration equipment.

[0065] The target products include, but are not limited to, ingredients, cold drinks, and homemade food.

[0066] The specific type of the target object can be determined based on the actual situation, and this application does not impose any restrictions.

[0067] The number of target objects can be one or more.

[0068] For example, the target could be 5 pears, 3 bunches of grapes, and a plate of homemade chocolates.

[0069] The preset machining program is a program for a pre-defined target object.

[0070] Preset processing programs can be used to control the temperature of different chambers and the duration of a certain temperature.

[0071] The preset processing program may include the execution order of one or more sub-processes, the duration of each sub-process, and the temperature set for each sub-process.

[0072] It should be noted that different target objects may have different preset processing procedures.

[0073] For example, the processing temperatures and processing times required to process pears and grapes to obtain frozen pears and frozen grapes may differ.

[0074] A variety of different preset processing programs can be set in refrigeration equipment.

[0075] Multi-frame video frames are video frames obtained by capturing images of the target object during the processing.

[0076] In actual execution, the target object can be photographed continuously or at certain time intervals, such as every 5 or 10 seconds.

[0077] The specific value of the time interval can be determined based on the rate of change of the target object's processing, or based on user-defined parameters; this application does not impose any limitations on this.

[0078] like Figure 2 As shown, in actual execution, the user can place the target object into the compartment of the refrigeration equipment and start the preset processing program corresponding to the target object. After confirming that the refrigeration equipment door is closed or the preset processing program is started, the image sensor is controlled to start shooting the target object to collect multiple video frames corresponding to the target object. The multiple video frames collected by the image sensor can be uploaded to the cloud.

[0079] In some embodiments, after an image sensor in the target compartment acquires multiple video frames corresponding to the target object, the method may further include:

[0080] If the video frame detects that the target object's features are not present or that the feature completeness of the target object is less than the feature completeness threshold, a prompt message is output. The prompt message is used to instruct the target object to adjust its position in the target room, and after adjusting the target object's position in the target room, the image sensor is controlled to acquire multiple video frames corresponding to the target object.

[0081] In this embodiment, the characteristics of the target object are those of the object that matches the processing object corresponding to the preset processing program.

[0082] Feature completeness refers to the feature that characterizes whether the target object is complete.

[0083] Feature completeness can be obtained by performing feature recognition on target objects in video frames.

[0084] For example, if half of the target object is captured in a video frame, the feature completeness of the target object can be 50%.

[0085] The feature completeness threshold is the feature value used to determine whether a target object in a video frame is complete.

[0086] The feature completeness threshold can be user-defined or determined based on actual circumstances; this application does not impose any restrictions.

[0087] In practical applications, when users need to process a target object, they place the target object in a room. However, the location where the user places the target object may be a blind spot for the image sensor, meaning that the video frames captured by the image sensor do not contain the features of the target object, or the video frames captured by the image sensor of the target object are incomplete.

[0088] In actual execution, feature extraction can be performed on video frames acquired by image sensors to determine whether the video frame contains features of the target object, or whether the feature completeness of the target object is less than the feature completeness threshold.

[0089] If the target object's features are not present in the video frame, or if the feature completeness of the target object is less than the feature completeness threshold, the video frame acquired by the characterizing image sensor cannot completely record the processing of the target object. In this case, a prompt message can be output to prompt the user to adjust the position of the target object in the target compartment.

[0090] After the user adjusts the position of the target object, the image sensor is controlled to continue acquiring multiple video frames corresponding to the target object in order to record the processing of the target object.

[0091] In some embodiments, the user can also adjust the shooting angle of the image sensor so that the entire target object is within the field of view of the image sensor.

[0092] In other embodiments, when the user starts a preset processing program and the image sensor detects that there are other items in the room besides the target object to be processed, a processing prompt message can be output to prompt the user to move the other items, so as to reduce the loss caused by the temperature in the room during the processing being unfavorable to the storage of other items.

[0093] According to the control method of the cooling device provided in the embodiments of this application, when the feature of the target object is not detected in the video frame or the feature completeness of the target object is less than the feature completeness threshold, a prompt message is output so that the user can adjust the position of the target object in the target chamber in a timely manner, thereby improving the quality and availability of the multi-frame video frames subsequently acquired by the image sensor.

[0094] Step 120: Based on at least one of the following: the time node corresponding to the preset processing program, user input, and the feature changes of the target object in each video frame, at least a portion of the video frames are selected from multiple video frames.

[0095] In this step, the time nodes corresponding to the preset processing program are the time nodes when one or more processing steps included in the preset processing program begin processing and the time nodes when processing ends.

[0096] The time point can be a duration, for example, a time point can be 5 seconds or 10 seconds.

[0097] The specific duration of a time point can be user-defined or determined based on actual circumstances; this application does not impose any restrictions.

[0098] It is understandable that when the preset processing steps include multiple processing steps, the preset processing steps may include multiple time points.

[0099] The user input is the time point in time at which the user wants to query the status of the target object.

[0100] The user can input either the current data collection time or a custom query time.

[0101] The feature change refers to the change in the features of the target object at the current acquisition time relative to the features between the current acquisition time and the previous acquisition time.

[0102] In actual execution, at least some video frames can be selected from multiple video frames by pre-setting the time nodes corresponding to the processing program, user input, and the feature changes of the target object in each video frame.

[0103] For example, selecting at least a portion of video frames from multiple video frames that match the time nodes corresponding to a preset processing procedure.

[0104] Filter from multiple video frames at least a subset of the video frames that the user wants to view, based on user input.

[0105] Based on the feature changes of the target object between adjacent video frames or between video frames with an interval of a target number, at least a portion of the video frames are selected from multiple video frames.

[0106] The target number is a preset value for selecting a certain number of video frames.

[0107] The specific number of targets can be determined based on the actual situation, and this application does not impose any restrictions.

[0108] For example, the time interval between the user input time node and the preset processing program time node can be calculated. If the time interval is less than the time threshold, at least a portion of the video frames between the user input time node and the preset processing program time node can be output.

[0109] It is also possible to filter at least some video frames corresponding to the time nodes of the preset processing program, at least some video frames corresponding to user input, and at least some video frames corresponding to feature changes from multiple video frames.

[0110] It should be noted that, based on one or more of the time nodes corresponding to the preset processing program, user input, and the feature changes of the target object in each video frame, at least some video frames selected from multiple video frames are at least some video frames that are highly representative of the state of the target object during the processing.

[0111] In actual execution, video frames of various sample processing objects during the processing can be collected in advance. Through machine learning algorithms or neural network algorithms, the processing process can be learned to learn the characteristics of at least some video frames with high representativeness of the target object's state from the video frames. Based on the learned characteristics, at least some video frames can be selected from multiple video frames in the future.

[0112] Step 130: Output at least some of the video frames.

[0113] In this step, after filtering out at least some video frames from multiple video frames, at least some video frames can be output so that the user can determine the state of the target object by viewing at least some video frames.

[0114] Users can determine the color, volume, and appearance of the target object by at least some of the output video frames, and determine whether the cooling equipment's processing of the target object meets the requirements.

[0115] If the user determines from experience that the refrigeration equipment meets the processing requirements of the target object, the refrigeration equipment can continue processing based on the preset processing program.

[0116] If a user determines, based on experience, that the refrigeration equipment does not meet the processing requirements of the target object, the user can adjust the relevant parameters of the preset processing program to speed up or slow down the processing.

[0117] For example, further reduce the temperature of the refrigeration equipment, or extend the processing time of the refrigeration equipment.

[0118] In some embodiments, at least some of the output video frames can be displayed on the display device of the cooling equipment, and can also be displayed on a user terminal that is communicatively connected to the cooling equipment, and at least some of the video frames can be displayed on the APP of the user terminal.

[0119] Understandably, when a user views at least some video frames through an app on a user terminal that communicates with the cooling equipment, the user does not need to be located at the location of the cooling equipment. The user can view video frames that the cooling equipment deems important anytime and anywhere, without being limited by space or time.

[0120] Continue to refer to Figure 2In actual execution, after the image sensor collects multiple video frames and uploads them to the cloud, the cloud analyzes the multiple video frames to identify the target objects in each video frame. Based on the settings of the preset processing program, the cloud monitors the processing process in real time. Based on one or more of the time nodes corresponding to the preset processing program, user input, and the characteristic changes of the target objects in each video frame, the cloud selects and outputs at least a portion of the video frames from the multiple video frames. The cloud can save the selected at least a portion of the video frames and output the saved at least a portion of the video frames.

[0121] During the research and development process, the inventors discovered that in related technologies, users need to manually and frequently open and close the door of the refrigeration equipment to check the status of the processed food during the food processing process; however, the above-mentioned checking method affects the processing effect of the food and is complicated to operate, which affects the user experience.

[0122] This application, by installing an image sensor within a refrigeration device, controls the image sensor to acquire multiple video frames corresponding to the target object when a preset processing program for the target object is initiated. This allows for real-time acquisition of video frames depicting the target object's processing process without opening the refrigeration device. Based on one or more factors, including the time point corresponding to the preset processing program, user input, and changes in the target object's characteristics across the video frames, at least a subset of video frames are selected from the multiple frames and output. This visualizes the target object's processing process, providing users with key video frames, enhancing their understanding of the processing, reducing the difficulty of querying the target object's processing process, and ensuring the processing effect of the refrigeration device without opening it, thus improving the user experience.

[0123] According to the control method of the refrigeration equipment provided in the embodiments of this application, the image sensor is controlled to acquire multiple video frames corresponding to the target object. Based on one or more of the time nodes corresponding to the preset processing program, user input, and feature changes of the target object in each video frame, at least some of the more critical video frames are selected from the multiple video frames so that the user can view the status of the target object through at least some video frames. This eliminates the need for the user to turn on the refrigeration equipment, ensuring the processing effect of the target object. The viewing method is simple and convenient, improving the user experience.

[0124] In some embodiments, step 120 may further include:

[0125] If the acquisition time of the first video frame in each video frame matches the time node corresponding to the target first sub-process in at least one processing step included in the preset processing program, the first video frame is determined to be at least a partial video frame; the time node corresponding to the target first sub-process includes: the start node corresponding to the target first sub-process and the end node corresponding to the target first sub-process.

[0126] In this embodiment, the first video frame is any one of the multiple video frames.

[0127] The first video frame can be a single video frame or a video frame within a target time period.

[0128] The target time period is a preset value that limits the duration of the first video frame.

[0129] The specific value of the target time period can be based on user-defined values ​​or determined based on actual conditions. For example, the target time period can be 5 seconds or 10 seconds, etc. This application does not impose any restrictions.

[0130] The acquisition time corresponding to the first video frame is the time when the image sensor acquires the first video frame.

[0131] The processing procedure is a sub-operation within a preset processing procedure.

[0132] The first sub-process of the target is any process in the processing process.

[0133] The time nodes corresponding to the first sub-process of the target include: the start node and the end node of the first sub-process of the target.

[0134] The starting node corresponding to the first sub-process of the target is the time node at which the target object begins processing based on its current state at the time of data collection.

[0135] The termination node corresponding to the first sub-process of the target is the time node when the target object ends processing the first sub-process after it has been continuously processed for a certain period of time based on the start node corresponding to the first sub-process of the target.

[0136] In actual execution, if the acquisition time corresponding to the first video frame matches the time node corresponding to the first sub-process of the target, the first video frame will be determined as at least a portion of the video frames.

[0137] Matching the acquisition time of the first video frame with the time node corresponding to the target first sub-process includes, but is not limited to: the acquisition time of the first video frame being the same as the time node corresponding to the target first sub-process; the acquisition time of the first video frame being within the time node corresponding to the target first sub-process; and the time interval between the acquisition time of the first video frame and the time node corresponding to the target first sub-process not exceeding the first duration.

[0138] The first duration is a preset value that compares the time interval between the acquisition time corresponding to the first video frame and the time node corresponding to the first sub-process of the target.

[0139] The specific value of the first duration can be based on user-defined values ​​or determined based on actual circumstances. For example, the target time period can be 5 seconds or 10 seconds, etc. This application does not impose any restrictions.

[0140] For example, if the acquisition time of the first video frame is between 10:20:20 and 10:20:25, and the starting node of the target first sub-process is between 10:20 and 10:21, it can be considered that the acquisition time of the first video frame matches the time node of the target first sub-process.

[0141] For example, if the acquisition time corresponding to the first video frame is 3 seconds before the time node corresponding to the first sub-process of the target, it can be approximately considered that the acquisition time corresponding to the first video frame matches the time node corresponding to the first sub-process of the target.

[0142] Continuing with the example of processing pears into frozen pears using a preset processing procedure, taking the first sub-process as the initial freezing process as an example, at the starting node corresponding to the first sub-process, the target object is a pear at room temperature. At this time, the pear skin may have a high gloss and the stem color is relatively bright. At the ending node corresponding to the first sub-process, the target object is a frozen pear. At this time, the pear skin has a low gloss, the stem color is relatively dull, and it may have ice crystals.

[0143] Understandably, the video frames captured at the start node and the end node of the first sub-process of the target record the state of the target object before and after the first sub-process of the target, respectively. The video frames captured at the time node corresponding to the first sub-process of the target are more representative in providing state information of the target object.

[0144] It is understandable that, in the case of the next processing step after the first sub-process of the target, the state of the target object before the start of the next processing step is the same as the state of the target object after the first sub-process of the target.

[0145] Continue to refer to Figure 2 The cloud can determine whether the acquisition time of each video frame matches the start or end node in the processing procedure based on the acquired preset processing program information. If the first video frame in each video frame matches the start or end node, then at least some of the video frames are saved and output so that users can view the status of the target object.

[0146] According to the control method of the refrigeration equipment provided in the embodiments of this application, by determining that the acquisition time corresponding to the first video frame matches the time node corresponding to the target first sub-process, the first video frame is determined as at least a portion of the video frames, effectively filtering out at least a portion of the key video frames among multiple video frames, thereby improving the accuracy and relevance of the feedback on the target object status.

[0147] In some embodiments, step 120 may further include:

[0148] Receive the user's first input;

[0149] In response to the first input, determine the query time point corresponding to the user input;

[0150] If the acquisition time corresponding to the second video frame in each video frame matches the query time node, the second video frame is determined to be at least a partial video frame.

[0151] In this embodiment, the first input is used to input a user's instruction to query the status of the target object.

[0152] The first input can be in at least one of the following ways:

[0153] Firstly, the first input can be a touch operation, including but not limited to click, swipe, and press operations.

[0154] In this embodiment, receiving the user's first input can be receiving the user's touch operation on the display area of ​​the terminal screen.

[0155] To reduce the rate of user error, the effective area of ​​the first input can be limited to a specific area, such as the upper middle area of ​​the status query interface; or, while the status query interface is displayed, a target control can be displayed on the current interface, and touching the target control will enable the first input; or the first input can be set to a series of taps on the display area within a target time interval.

[0156] Secondly, the first input can be a physical button input.

[0157] In this embodiment, the terminal is equipped with physical buttons on its body that correspond to the status of the target object being queried. The first input received by the user can be the user pressing the corresponding physical button; the first input can also be a combination of pressing multiple physical buttons simultaneously.

[0158] Thirdly, the first input can be voice input.

[0159] In this embodiment, when the terminal receives a voice message such as "Check the status of the pears in the freezer," it can trigger a status query interface to display at least some video frames.

[0160] Of course, in other embodiments, the first input may also be in other forms, including but not limited to character input, etc., which can be determined according to actual needs, and this application embodiment does not limit it.

[0161] The query time point is the time point at which the user wants to query the status of the target object.

[0162] The query time point can be the current collection time or any time entered by the user.

[0163] The second video frame is any one of the multiple video frames.

[0164] The second video frame can be a single video frame or a video frame within the target time period.

[0165] If the acquisition time corresponding to the second video frame matches the query time node, the second video frame is determined to be at least a partial video frame.

[0166] The method for determining whether the acquisition time corresponding to the second video frame matches the query time node can be the same as the method for determining whether the acquisition time corresponding to the first video frame matches the time node corresponding to the target first sub-process. To avoid repetition, it will not be elaborated here.

[0167] If the user inputs a query time point that corresponds to a video frame that has not yet been captured, the user input can be recorded, and the capture time of subsequently captured video frames can be continuously compared with the query time point.

[0168] According to the control method of the refrigeration equipment provided in the embodiments of this application, by receiving the first input from the user, responding to the first input, effectively obtaining the query time node corresponding to the user input, determining the second video frame whose acquisition time matches the query time node in each video frame as at least a part of the video frames, effectively filtering out the video frames required by the user, satisfying the user's status query needs, and improving the user experience.

[0169] In some embodiments, step 120 may further include:

[0170] If the difference between the features of the target object in the third and fourth video frames is greater than the difference threshold, the fourth video frame is determined to be at least a partial video frame.

[0171] In this embodiment, the third video frame and the fourth video frame are video frames acquired within the same time node corresponding to the same processing step, and the acquisition time corresponding to the fourth video frame is after the acquisition time corresponding to the third video frame.

[0172] Similarly, the third and fourth video frames can be a single video frame or video frames within the target time period.

[0173] The difference is the difference between the features of the target object in the third video frame and the features of the target object in the fourth video frame.

[0174] The difference threshold is a preset value used to determine the degree of difference between the target video frame and the starting video frame.

[0175] The specific value of the difference threshold can be based on user-defined criteria or determined based on actual circumstances; this application does not impose any restrictions.

[0176] In actual execution, during the acquisition of multiple video frames, the third video frame can be determined based on the acquisition time of each video frame and the start time of each processing step. Feature extraction is then performed on the third video frame and the fourth video frame that follows the third video frame. The difference between the third video frame and the fourth video frame is compared. If the difference between the features of the target object in the third video frame and the features of the target object in the fourth video frame is greater than the difference threshold, the fourth video frame is determined as at least a partial video frame.

[0177] In other embodiments, the state changes of the target object can also be monitored by a laser sensor or other types of sensors to determine whether the state of the target object has changed significantly. If the state of the target object has changed significantly, at least a portion of the video frames can be selected from multiple video frames based on the time when the state of the target object has changed significantly.

[0178] Continue to refer to Figure 2 In actual execution, if the difference between the features of the target object in the third video frame and the features of the target object in the fourth video frame is greater than the difference threshold, it can be approximately assumed that the features of the target object have changed significantly, and at least some video frames corresponding to the fourth video frame are saved.

[0179] According to the control method of the refrigeration equipment provided in the embodiments of this application, when the difference between the features of the target object in the third video frame and the fourth video frame is greater than the difference threshold, the fourth video frame is determined as at least a part of the video frames, effectively filtering out at least a part of the video frames with large changes in the features of the target object during the processing, so as to promptly prompt the user to pay attention to the status changes of the target object.

[0180] Continue to refer to Figure 2 In some embodiments, after step 130, the method may further include:

[0181] When the preset processing procedure corresponding to the target object is determined to be completed, a processing report is generated based on the start node, end node and temperature information of the target chamber under each processing step in the preset processing procedure, as well as at least some video frames, during the operation of the preset processing procedure.

[0182] Output processing report information.

[0183] In this embodiment, the preset processing program ends when the processing operation on the target object is stopped.

[0184] The processing report contains various information related to the entire processing of the target object.

[0185] Understandably, after the preset processing program is completed, the refrigeration equipment can return to a temperature suitable for storing the target object.

[0186] In actual execution, the end of the preset processing program can be determined by judging the duration of the preset processing program or the temperature of the refrigeration equipment.

[0187] It should be noted that the selected video frames can be at least some video frames collected in multiple different time periods.

[0188] At least some video frames may include: at least some video frames corresponding to the starting points of each processing step, at least some video frames corresponding to the ending points of each processing step, at least some video frames determined based on user input, and at least some video frames determined based on the difference between the third and fourth video frames.

[0189] In actual execution, the starting node, ending node, and temperature information of the target chamber under each processing step, as well as at least some video frames, can be summarized to summarize the key information in the entire processing process.

[0190] The processing report information may include: at least some video frames, the starting node corresponding to each processing step included in the preset processing program, the ending node corresponding to each processing step included in the preset processing program, and the temperature information of the refrigeration equipment under each processing step.

[0191] Continue to refer to Figure 2 Once the preset processing program is completed, a processing report can be generated based on the operation of the preset processing program and the state changes of the target object. After the processing report is generated, the image sensor is turned off, and the relevant compartments of the refrigeration equipment are restored to their normal working state.

[0192] According to the control method of the refrigeration equipment provided in the embodiments of this application, by determining the end of the preset processing program, based on the start node, end node and temperature information of the target room under each processing step during the operation of the preset processing program, as well as at least some video frames, processing report information is generated to provide users with concise and comprehensive processing information and improve the user experience.

[0193] like Figure 3 As shown, in some embodiments, determining that the target room in at least one compartment initiates the preset processing program corresponding to the target object may further include steps 310 and 320.

[0194] Step 310: Receive the user's second input;

[0195] Step 320: In response to the second input, determine that the target room in at least one of the rooms starts the preset processing program corresponding to the target object.

[0196] In this embodiment, the second input is used to input operations on a preset processing program.

[0197] The second input can include the first sub-input and the second sub-input.

[0198] The first sub-input is used to select the preset processing program corresponding to the target object.

[0199] The second sub-input is the user input of the control commands corresponding to the preset processing program.

[0200] Control commands include, but are not limited to: commands to start the preset processing program corresponding to the target object and the target room controlled by the preset processing program.

[0201] The second input can be the same as the first input, such as touch input, physical button input, voice input, character input, or any other feasible input, which will not be elaborated here.

[0202] In actual execution, the preset processing program corresponding to the target object can be started by receiving the second input and responding to the second input, thereby determining the start of the preset processing program corresponding to the target object.

[0203] According to the control method of the refrigeration equipment provided in the embodiments of this application, the preset processing program corresponding to the target object is determined by the user's second input. The determination method is simple and easy to operate.

[0204] The control method for refrigeration equipment provided in this application can be executed by a control device for the refrigeration equipment. This application uses the control device of the refrigeration equipment executing the control method as an example to illustrate the control device for the refrigeration equipment provided in this application.

[0205] This application also provides a control device for a refrigeration equipment.

[0206] The cooling equipment includes an image sensor.

[0207] like Figure 4 As shown, the control device of the refrigeration equipment includes: a first processing module 410, a second processing module 420 and a third processing module 430.

[0208] The first processing module 410 is used to control the image sensor in the target room to acquire multiple video frames corresponding to the target object when a preset processing program corresponding to the target object is started in at least one target room.

[0209] The second processing module 420 is used to filter at least a portion of video frames from multiple video frames based on at least one of the time nodes corresponding to the preset processing program, user input, and feature changes of the target object in each video frame.

[0210] The third processing module 430 is used to output at least a portion of the video frames.

[0211] According to the control device of the refrigeration equipment provided in the embodiments of this application, the image sensor is controlled to acquire multiple video frames corresponding to the target object. Based on one or more of the time nodes corresponding to the preset processing program, user input, and feature changes of the target object in each video frame, at least some of the more critical video frames are selected from the multiple video frames so that the user can view the status of the target object through at least some video frames. This eliminates the need for the user to turn on the refrigeration equipment, ensuring the processing effect of the target object. The viewing method is simple and convenient, improving the user experience.

[0212] In some embodiments, the second processing module 420 may also be used for:

[0213] If the acquisition time of the first video frame in each video frame matches the time node corresponding to the target first sub-process in at least one processing step included in the preset processing program, the first video frame is determined to be at least a partial video frame; the time node corresponding to the target first sub-process includes: the start node corresponding to the target first sub-process and the end node corresponding to the target first sub-process.

[0214] In some embodiments, the second processing module 420 may also be used for:

[0215] Receive the user's first input;

[0216] In response to the first input, determine the query time point corresponding to the user input;

[0217] If the acquisition time corresponding to the second video frame in each video frame matches the query time node, the second video frame is determined to be at least a partial video frame.

[0218] In some embodiments, the second processing module 420 may also be used for:

[0219] If the difference between the features of the target object in the third video frame and the fourth video frame is greater than the difference threshold, the fourth video frame is determined to be at least a partial video frame; the third video frame and the fourth video frame are video frames acquired within the time node corresponding to the same processing procedure, and the acquisition time corresponding to the fourth video frame is after the acquisition time corresponding to the third video frame.

[0220] In some embodiments, the device may further include a fourth processing module for:

[0221] When the preset processing procedure corresponding to the target object is determined to be completed, a processing report is generated based on the start node, end node and temperature information of the target chamber under each processing step in the preset processing procedure, as well as at least some video frames, during the operation of the preset processing procedure.

[0222] Output processing report information.

[0223] In some embodiments, the first processing module 410 may also be used for:

[0224] Receive the user's second input;

[0225] In response to the second input, at least one target room in the chamber is determined to initiate the preset processing program corresponding to the target object.

[0226] In some embodiments, the device may further include a fifth processing module for:

[0227] If the video frame detects that the target object's features are not present or that the feature completeness of the target object is less than the feature completeness threshold, a prompt message is output. The prompt message is used to instruct the target object to adjust its position in the target room, and after adjusting the target object's position in the target room, the image sensor is controlled to acquire multiple video frames corresponding to the target object.

[0228] The control device for the refrigeration equipment in this application embodiment can be the refrigeration equipment itself, or an electronic device communicatively connected to the refrigeration equipment, or a component within the refrigeration equipment or electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices besides a terminal. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television (TV), ATM, or self-service machine, etc. This application embodiment does not specifically limit the scope of the device.

[0229] The control device for the refrigeration equipment in this application embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit the specific operating system used.

[0230] The control device for the refrigeration equipment provided in this application embodiment can achieve... Figures 1 to 3 The various processes implemented in the method implementation examples will not be described again here to avoid repetition.

[0231] In some embodiments, such as Figure 5 As shown, this application embodiment also provides an electronic device 500, including a processor 501, a memory 502, and a computer program stored in the memory 502 and executable on the processor 501. When the program is executed by the processor 501, it implements the various processes of the above-described control method embodiment for the refrigeration device and achieves the same technical effect. To avoid repetition, it will not be described again here.

[0232] It should be noted that the electronic devices in the embodiments of this application include the mobile electronic devices and non-mobile electronic devices described above.

[0233] like Figure 6 As shown in the figure, this application embodiment also provides a refrigeration device.

[0234] In some embodiments, the refrigeration equipment includes at least one compartment, a door, an image sensor, and a control device based on the refrigeration equipment described in any of the above embodiments.

[0235] In this embodiment, the compartments may include, but are not limited to, a freezer compartment, a refrigerator compartment, and a fresh food compartment.

[0236] The target object can be placed in the appropriate compartment, such as the freezer or refrigerator.

[0237] The door is installed in the room in a way that allows it to be opened and closed.

[0238] The image sensor is located in the compartment.

[0239] Image sensors can be installed in different rooms.

[0240] The control unit of the refrigeration equipment is electrically connected to the image sensor.

[0241] In some embodiments, the cooling device may further include a display device.

[0242] In this embodiment, the display device can be installed on the door of the refrigeration equipment.

[0243] The display device can be used to display at least a portion of the output video frames and the generated processing report.

[0244] According to the refrigeration device provided in the embodiments of this application, the image sensor is controlled to acquire multiple video frames corresponding to the target object. Based on one or more of the time nodes corresponding to the preset processing program, user input, and the characteristic changes of the target object in each video frame, at least some of the more critical video frames are selected from the multiple video frames so that the user can view the status of the target object through at least some video frames. This eliminates the need for the user to turn on the refrigeration device, ensuring the processing effect of the target object. The viewing method is simple and convenient, improving the user experience.

[0245] This application also provides a non-transitory computer-readable storage medium storing a computer program. When the computer program is executed by a processor, it implements the various processes of the control method embodiment of the above-described refrigeration device and achieves the same technical effect. To avoid repetition, it will not be described again here.

[0246] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0247] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the control method for the above-described refrigeration equipment.

[0248] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0249] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the above-described control method embodiment for the refrigeration device, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0250] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0251] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0252] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the related technology, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0253] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

[0254] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "illustrative embodiment," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of this application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples.

[0255] Although embodiments of this application have been shown and described, those skilled in the art will understand that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of this application, the scope of which is defined by the claims and their equivalents.

Claims

1. A control method for a refrigeration device, characterized in that, The refrigeration equipment includes at least one compartment, and an image sensor is installed in the compartment; the method includes: When it is determined that a preset processing program corresponding to the target object is started in the target room of at least one of the rooms, the image sensor in the target room is controlled to acquire multiple video frames corresponding to the target object; Based on at least one of the time nodes corresponding to the preset processing program, user input, and feature changes of the target object in each video frame, at least a portion of the video frames are selected from the multiple video frames. Output at least a portion of the video frames.

2. The control method for the refrigeration equipment according to claim 1, characterized in that, The step of selecting at least a subset of video frames from the multiple video frames based on at least one of the time nodes corresponding to the preset processing program, user input, and feature changes of the target object in each of the video frames includes: If the acquisition time of the first video frame in each of the video frames matches the time node corresponding to the target first sub-process in at least one processing step included in the preset processing program, the first video frame is determined to be one of the at least some video frames; the time node corresponding to the target first sub-process includes: the start node corresponding to the target first sub-process and the end node corresponding to the target first sub-process.

3. The control method for the refrigeration equipment according to claim 1, characterized in that, The step of selecting at least a subset of video frames from the multiple video frames based on at least one of the time nodes corresponding to the preset processing program, user input, and feature changes of the target object in each of the video frames includes: Receive the user's first input; In response to the first input, determine the query time node corresponding to the user input; If the acquisition time corresponding to the second video frame in each of the video frames matches the query time node, the second video frame is determined to be one of the at least some video frames.

4. The control method for the refrigeration equipment according to claim 1, characterized in that, The step of selecting at least a subset of video frames from the multiple video frames based on at least one of the time nodes corresponding to the preset processing program, user input, and feature changes of the target object in each of the video frames includes: If the difference between the features of the target object in the third video frame and the fourth video frame is greater than the difference threshold, the fourth video frame is determined as one of the at least some video frames; the third video frame and the fourth video frame are video frames acquired within the same time node corresponding to the same processing procedure, and the acquisition time corresponding to the fourth video frame is after the acquisition time corresponding to the third video frame.

5. The control method for the refrigeration equipment according to any one of claims 1-4, characterized in that, After outputting the at least some video frames, the method further includes: When it is determined that the preset processing procedure corresponding to the target object has ended, based on the start node of each processing step included in the preset processing procedure, the end node of each processing step, the temperature information of the target room under each processing step, and the at least part of the video frames during the operation of the preset processing procedure, a processing report information is generated. Output the processing report information.

6. The control method for the refrigeration equipment according to any one of claims 1-4, characterized in that, The step of determining the target room in the at least one compartment to initiate the preset processing program corresponding to the target object includes: Receive the user's second input; In response to the second input, it is determined that the target room in the at least one room will start the preset processing program corresponding to the target object.

7. The control method for the refrigeration equipment according to any one of claims 1-4, characterized in that, After the image sensor in the control room acquires multiple video frames corresponding to the target object, the method further includes: If the video frame detects that the feature of the target object is not present or the feature completeness of the target object is less than the feature completeness threshold, a prompt message is output; the prompt message is used to instruct the target object to adjust its position in the target room, and after adjusting the position of the target object in the target room, the image sensor is controlled to acquire multiple video frames corresponding to the target object.

8. A control device for a refrigeration equipment, characterized in that, The refrigeration equipment includes at least one compartment, and an image sensor is installed in the compartment; the device includes: The first processing module is used to control the image sensor in the target room to acquire multiple video frames corresponding to the target object when it is determined that the target room in the at least one room has started a preset processing program corresponding to the target object. The second processing module is used to filter at least a portion of the video frames from the multiple video frames based on at least one of the time nodes corresponding to the preset processing program, user input, and feature changes of the target object in each of the video frames. The third processing module is used to output the at least some of the video frames.

9. A refrigeration device, characterized in that, include: At least one room; A door, which is installed in the at least one room in an opening and closing manner; An image sensor, wherein the image sensor is disposed in each of the compartments; Based on the control device of the refrigeration equipment as described in claim 8, the control device of the refrigeration equipment is electrically connected to the image sensor.

10. The refrigeration equipment according to claim 9, characterized in that, Also includes: The display device is disposed on the door body.

11. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that, When executed by a processor, the computer program implements the control method for the refrigeration equipment as described in any one of claims 1-7.

12. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the control method of the refrigeration equipment as described in any one of claims 1-7.

Images