Refrigerator, method and device for controlling refrigerator and computer readable storage medium

Abstract

The invention relates to the technical field of intelligent household appliances, and discloses a refrigerator. The guide rail is arranged on the inner wall of the box body; the image recognition module is connected with the guide rail; and the driving module is connected with the image recognition module so as to drive the image recognition module to move out of the box body or move into the box body under the guidance of the guide rail. Thus, when the image recognition module is driven to move out of the refrigerator body, the image recognition module can collect images of other partition layers, and then the full view of food materials stored in the refrigerator is obtained. The invention further discloses a method and device for controlling the refrigerator and a computer readable storage medium.

Description

Technical Field

[0001] The present application relates to the technical field of smart home appliances, for example, to a refrigerator, a method and device for controlling a refrigerator, and a computer-readable storage medium. Background Art

[0002] With the widespread use of refrigerators, users have more and more diverse demands for refrigerator functions. For example, they need to know the ingredients stored in the refrigerator without opening it.

[0003] In order to solve and meet the above-mentioned needs of users, the relevant technology discloses a refrigerator, including a camera module. Several camera mounting parts are arranged in the refrigerator. The camera module can be detachably installed on any one of the camera mounting parts. When the camera module is placed on the camera mounting part, the camera module is communicatively connected with the control system of the refrigerator.

[0004] In the process of implementing the embodiments of the present disclosure, it is found that there are at least the following problems in the related art:

[0005] Although the related technology uses a camera fixed inside the box to obtain the food in the refrigerator, the collection range of this camera is limited, and it can often only collect data on the food in the same compartment, but cannot obtain the overall picture of the food stored in the refrigerator.

[0006] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present application, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention

[0007] In order to provide a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. The summary is not an extensive review, nor is it intended to identify key / critical components or delineate the scope of protection of these embodiments, but rather serves as a prelude to the detailed description that follows.

[0008] Embodiments of the present disclosure provide a refrigerator, a method for controlling a refrigerator, an apparatus, and a computer-readable storage medium to improve the integrity of refrigerator screen recognition.

[0009] In some embodiments, the refrigerator includes: a box body; a guide rail arranged on the inner wall of the box body; an image recognition module connected to the guide rail; and a driving module connected to the image recognition module to drive the image recognition module to move outside the box body or inside the box body under the guidance of the guide rail.

[0010] In some embodiments, the refrigerator further includes: a door, which is connected to the cabinet body in an openable and closable manner; the method for controlling the refrigerator includes: determining the open / closed state of the door; determining the target position of the image recognition module according to the open / closed state of the door; controlling the driving module to drive the image recognition module to move to the target position.

[0011] In some embodiments, the device for controlling the refrigerator includes: a processor and a memory storing program instructions, and the processor is configured to execute the aforementioned method for controlling the refrigerator when running the program instructions.

[0012] In some embodiments, the refrigerator includes: a refrigerator body; the aforementioned device for controlling the refrigerator, which is installed on the refrigerator body; wherein, the refrigerator body includes: a guide rail, which is arranged on the inner wall of the cabinet; an image recognition module, which is connected to the guide rail; a driving module, which is connected to the image recognition module to drive the image recognition module to move outside or inside the cabinet under the guidance of the guide rail.

[0013] In some embodiments, the computer-readable storage medium stores program instructions, and the program instructions execute the aforementioned method for controlling the refrigerator when running.

[0014] The refrigerator, the method, device and computer-readable storage medium for controlling the refrigerator provided by the embodiments of the present disclosure can achieve the following technical effects:

[0015] The inner wall of the cabinet is provided with a guide rail, and the image recognition module is connected to the guide rail to move under the guidance of the guide rail. The driving module is connected to the image recognition module to drive the image recognition module to move outside or inside the cabinet. When the image recognition module is driven to move outside the cabinet, the image recognition module can collect images of other compartments, and then obtain an overall view of the ingredients stored in the refrigerator.

[0016] The above general description and the following description are only exemplary and explanatory, and are not used to limit the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] One or more embodiments are exemplarily illustrated by corresponding drawings. These exemplary illustrations and the drawings do not constitute a limitation on the embodiments. Elements with the same reference numerals in the drawings are shown as similar elements. The drawings do not constitute a scale limitation, and among them:

[0018] Figure 1 is an internal schematic view of one perspective of the refrigerator provided by the embodiments of the present disclosure;

[0019] Figure 2 is an internal schematic view of another perspective of the refrigerator provided by the embodiments of the present disclosure;

[0020] Figure 3 It is a partial schematic diagram of the refrigerator provided by the embodiment of the present disclosure;

[0021] Figure 4 It is a schematic diagram when the door of the refrigerator provided by the embodiment of the present disclosure is opened;

[0022] Figure 5 It is a schematic diagram of the top of the refrigerator provided by the embodiment of the present disclosure;

[0023] Figure 6 It is a schematic diagram of a method for controlling a refrigerator provided by the embodiment of the present disclosure;

[0024] Figure 7 It is a schematic diagram of another method for controlling a refrigerator provided by the embodiment of the present disclosure;

[0025] Figure 8 It is a schematic diagram of another method for controlling a refrigerator provided by the embodiment of the present disclosure;

[0026] Figure 9 It is a schematic diagram of another method for controlling a refrigerator provided by the embodiment of the present disclosure;

[0027] Figure 10 It is a schematic diagram of a device for controlling a refrigerator provided by the embodiment of the present disclosure;

[0028] Figure 11 It is a schematic diagram of another device for controlling a refrigerator provided by the embodiment of the present disclosure;

[0029] Figure 12 It is a schematic diagram of a refrigerator provided by the embodiment of the present disclosure.

[0030] Reference numerals:

[0031] 10, box body; 11, top wall; 12, left side wall; 13, right side wall; 14, front side wall; 15, rear side wall; 20, guide rail; 21, track; 211, slide rail; 22, slider; 221, groove; 30, image recognition module; 31, connecting part; 311, connecting plate; 312, protruding part; 32, camera module; 40, driving module; 41, transmission part; 411, transmission plate; 412, chute; 42, motor; 421, power output shaft; 422, connecting ear; 43, fixing part; 50, door; 60, partition; 61, notch; 70, automatic door opening mechanism; 80, magnetic induction module;

[0032] 100, device for controlling a refrigerator; 101, first determination module; 102, second determination module; 103, control module; 110, device for controlling a refrigerator; 111, processor; 112, memory; 113, communication interface; 114, bus; 120, refrigerator. Detailed implementation manners

[0033] In order to understand the features and technical content of the embodiments of the present disclosure in more detail, the implementation of the embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. The accompanying drawings are for reference and illustration purposes only and are not used to limit the embodiments of the present disclosure. In the following technical description, for the sake of explanation, multiple details are provided to provide a full understanding of the disclosed embodiments. However, one or more embodiments can still be implemented without these details. In other cases, well-known structures and devices can be shown in a simplified manner to simplify the drawings.

[0034] In the specification and claims of the embodiments of the present disclosure and the above-mentioned accompanying drawings, terms such as "first", "second", etc. are used to distinguish similar objects and do not necessarily need to describe a specific order or sequence. It should be understood that such data can be interchanged under appropriate circumstances so as to implement the embodiments of the present disclosure described herein. In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion.

[0035] Unless otherwise specified, the term "plurality" means two or more.

[0036] In the embodiments of the present disclosure, the character " / " indicates that the objects before and after are in an "or" relationship. For example, A / B means: A or B.

[0037] The term "and / or" is a description of the association relationship of an object, indicating that three relationships can exist. For example, A and / or B means: A or B, or, the three relationships of A and B.

[0038] The term "corresponding" can refer to an association relationship or a binding relationship. A corresponding to B means that there is an association relationship or a binding relationship between A and B.

[0039] Combined with Figures 1 to 3 As shown, the embodiments of the present disclosure provide a refrigerator, including: a box body 10, a guide rail 20, an image recognition module 30, and a driving module 40. The guide rail 20 is provided on the inner wall of the box body 10. The image recognition module 30 is connected to the guide rail 20, and the guide rail 20 can provide a guiding function for the moving path of the image recognition module 30. The driving module 40 is connected to the image recognition module 30. Under the guidance of the guide rail 20, the driving module 40 can drive the image recognition module 30 to move outside the box body 10 or move inside the box body 10 according to the opening and closing state of the box door 50 under the guidance of the guide rail 20.

[0040] When the door 50 of the refrigerator is in different states, the position of the image recognition module 30 is different. When the door 50 is in the closed state or the opening angle does not reach the preset angle threshold, the image recognition module 30 should be completely located inside the box body 10. Here, the image recognition module 30 being completely located inside the box body 10 means that the side of the image recognition module 30 facing the door 50 is located inside the box body 10 or is flush with the side of the box body 10 facing the door 50. In this way, the image recognition module 30 can only collect and recognize the images inside the box body 10 below it. When the opening angle of the door 50 reaches the angle threshold, the image recognition module 30 should be partially or completely located outside the box body 10. At this time, the image recognition module 30 can not only collect the images of the compartment where it is located, but also collect the images of other compartments and the inner side of the door 50, so as to obtain the overall picture of the ingredients stored in the refrigerator. In this way, when the door 50 is opened, the image recognition module 30 can recognize the images of the ingredients placed in and taken out of the door 50, and send the images to the control module in time, so as to accurately record the situation of the ingredients in the refrigerator.

[0041] Using the refrigerator provided by the embodiment of the present disclosure, a guide rail 20 is provided on the inner wall of the box body 10, and the image recognition module 30 is connected to the guide rail 20 to move under the guidance of the guide rail 20. The driving module 40 is connected to the image recognition module 30 to drive the image recognition module 30 to move outside or inside the box body 10. When the image recognition module 30 is driven to move outside the box body 10, the image recognition module 30 can collect the images of other compartments, so as to obtain the overall picture of the ingredients stored in the refrigerator.

[0042] Optionally, the image acquisition angle of the image recognition module 30 is 135°, and it will not recognize user privacy. And after the door 50 is closed, the image recognition module 30 returns to the inside of the box body 10, and it will not violate user privacy either.

[0043] Optionally, referring again to Figure 3 , the guide rail 20 includes: a track 21 and a slider 22. The track 21 is arranged inside the box body 10. Optionally, the guiding direction of the track 21 is the depth direction of the box body 10. In this way, the image recognition module 30 can be guided to move along the depth direction of the box body 10, that is, to guide the image recognition module 30 to "enter" / "exit" the box body 10. Optionally, the bottom of the track 21 is fixed to the inner wall of the side wall of the box body 10 on the door opening side of the door 50. In this way, referring to Figure 4 , when the door 50 is opened, the image recognition module 30 can move outside the box body 10 under the guidance of the guide rail 20 without interfering with the door 50.

[0044] The rail 21 is provided with a raised sliding rail 211, and the surface of the slider 22 is provided with a groove 221. The sliding rail 211 is slidably embedded in the groove 221. The slider 22 is connected to the image recognition module 30. In this way, the slider 22 can slide on the rail 21, thereby driving the image recognition module 30 to move.

[0045] Optionally, referring again to Figure 3 , the image recognition module 30 includes: a connecting portion 31 and a camera module 32. The first end (top end) of the connecting portion 31 is connected to the driving module 40, and the side surface is connected to the slider 22 of the guide rail 20. The top of the camera module 32 is connected to the second end (bottom end) of the connecting portion 31. In this way, the driving module 40 transmits the driving force to the connecting portion 31. Due to the limitation of the sliding direction of the slider 22 by the rail 21, the connecting portion 31 together with the camera module 32 moves along the guiding direction of the rail 21. In this way, the driving of the camera module 32 to "enter" / "exit" the box body 10 can be realized.

[0046] Optionally, the connecting portion 31 includes: a connecting plate 311 and a protruding portion 312. The side surface of the connecting plate 311 is connected to the slider 22. The first end (top end) of the connecting portion 31 is connected to the bottom of the protruding portion 312. The second end (bottom end) of the connecting plate 311 is connected to the top of the camera module 32. The protruding portion 312 is connected to the driving module 40.

[0047] Optionally, referring again to Figure 3 , the driving module 40 includes: a transmission portion 41 and a motor 42. The transmission portion 41 abuts against the image recognition module 30. The power output shaft 421 of the motor 42 is connected to the transmission portion 41 to transmit the driving force to the transmission portion 41, and then transmitted from the transmission portion 41 to the connecting portion 31 of the image recognition module 30. In this way, the transmission of the driving force of the motor 42 is realized through the transmission portion 41.

[0048] Optionally, the motor 42 is a motor 42 that can rotate forward or backward. When the motor 42 rotates forward, the motor 42 drives the image recognition module 30 to move out of the box body 10. When the motor 42 rotates backward, the motor 42 drives the image recognition module 30 to move into the box body 10.

[0049] Optionally, the power output shaft 421 of the motor 42 is fixed to the transmission portion 41 through a fixing member 43.

[0050] Optionally, both sides of the housing of the motor 42 are provided with connecting ears 422, and the motor 42 is connected to the top wall 11 of the box body 10 through the connecting ears 422.

[0051] Optionally, referring again to Figure 3, the transmission part 41 includes: a transmission plate 411. A chute 412 is formed in the transmission plate 411 along its length direction, and the chute 412 penetrates the thickness direction of the transmission plate 411. The protruding part 312 provided at the top of the image recognition module 30 is inserted into the chute 412, and the protruding part 312 can slide along the chute 412 and abut against the inner wall of the chute 412.

[0052] Optionally, the protruding part 312 is of a columnar structure to facilitate its insertion into the chute 412.

[0053] When the motor 42 rotates forward, the power output shaft 421 of the motor 42 rotates counterclockwise, thereby driving the transmission plate 411 to rotate counterclockwise (with the connection point between the transmission plate 411 and the power output shaft 421 as the rotation center). The protruding part 312 moves along the chute 412 in the direction close to the motor 42. At the same time, since the inner wall of the chute 412 abuts against the protruding part 312, the transmission plate 411 will exert a thrust on the entire connecting part 31 towards the outside of the box body 10, thereby causing the connecting part 31 to drive the camera module 32 to move towards the outside of the box body 10.

[0054] When the motor 42 rotates reversely, the power output shaft 421 of the motor 42 rotates clockwise, thereby driving the transmission plate 411 to rotate clockwise (with the connection point between the transmission plate 411 and the power output shaft 421 as the rotation center). The protruding part 312 moves along the chute 412 in the direction away from the motor 42. At the same time, since the inner wall of the chute 412 abuts against the protruding part 312, the transmission part 41 will exert a thrust on the entire connecting part 31 towards the inside of the box body 10, thereby causing the connecting part 31 to drive the camera module 32 to move towards the inside of the box body 10.

[0055] Optionally, the refrigerator further includes: a control module. The control module is communicatively connected to the driving module 40, and can thereby control the driving parameters of the driving module 40 according to the opening and closing state of the box door 50. Optionally, the driving parameters include the rotation direction and rotation angle of the motor 42. The rotation direction of the motor 42 can determine the moving direction of the image recognition module 30. The rotation angle of the motor 42 can determine the moving distance of the image recognition module 30.

[0056] Optionally, refer to Figure 5, the refrigerator further includes: a partition 60. The partition 60 is horizontally disposed within the cabinet 10 and is disposed near the top wall 11 of the cabinet 10. A notch 61 is provided on one side of the partition 60 to provide an installation space for the camera module 32 without interfering with the camera module 32. The top surface of the partition 60 is flush with the top surface of the camera module 32. In this way, the top surface of the partition 60, the top surface of the camera module 32, and the top wall 11, the left side wall 12, the right side wall 13, the front side wall 14, and the rear side wall 15 of the cabinet 10 together enclose an accommodation space. The guide rail 20, the connecting portion 31, and the driving module 40 are all located in the accommodation space. In this way, the user can only visually see the camera module 32 disposed in the compartment of the refrigerator, which is beautiful and simple.

[0057] Optionally, referring again to Figure 5 , the refrigerator further includes: an automatic door opening mechanism 70, which is disposed in the accommodation space to automatically open the door 50 when the user is in front of the refrigerator.

[0058] Optionally, referring again to Figure 2 and Figure 4 , the refrigerator further includes: a magnetic induction module 80 disposed on the cabinet 10 for sensing magnetic signals. When the door 50 is closed, the door 50 is attracted to the cabinet 10, and the magnetic induction module 80 can sense the magnetic force and send a magnetic signal. When the opening angle of the door 50 does not reach the angle threshold, the magnetic induction module 80 can still sense the magnetic force and send a magnetic signal. When the opening angle of the door 50 reaches the angle threshold, the magnetic induction module 80 cannot sense the magnetic force and does not send a magnetic signal.

[0059] Optionally, the magnetic induction module 80 is disposed on the front side wall 14 of the cabinet 10. In this way, the magnetic induction module 80 is kept at a relatively close distance from the door 50 to ensure the accuracy of magnetic induction.

[0060] Optionally, the control module is communicatively connected to the magnetic induction module 80. The control module can receive the magnetic signal sent by the magnetic induction module 80 and then control the driving parameters of the driving module 40.

[0061] Optionally, the maximum distance that the camera module 32 moves out of the cabinet 10 is 60 mm, which can ensure that the camera module 32 completely moves out of the cabinet 10.

[0062] Combined with Figure 6 shown, the embodiments of the present disclosure provide a method for controlling a refrigerator, including:

[0063] S601, the refrigerator determines the open / closed state of the door.

[0064] S602, the refrigerator determines the target position of the image recognition module according to the open / closed state of the door.

[0065] In S603, the refrigerator control and drive module drives the image recognition module to move to the target position.

[0066] As in the refrigerator structure described above, a magnetic induction module is provided on the cabinet body. The magnetic induction module is used to determine the open / closed state of the refrigerator door. According to the open / closed state of the refrigerator door, the target position of the image recognition module is determined. For example, when the refrigerator door is closed, the image recognition module should be completely inside the refrigerator body, so the target position of the image recognition module is determined as the initial position. The control and drive module is operated to drive the image recognition module to move to the target position.

[0067] By using the method for controlling a refrigerator provided in the embodiments of the present disclosure, based on the image recognition module that can move inside and outside the refrigerator body, and in combination with the open / closed state of the refrigerator door, the target position of the image recognition module is determined. Furthermore, the control and drive module is operated to drive the image recognition module to run to the target position. In this way, the position of the image recognition module is matched with the open / closed state of the refrigerator door, and thus the image recognition module can obtain the overall view of the ingredients stored in the refrigerator.

[0068] Combined with Figure 7 As shown, the embodiments of the present disclosure provide another method for controlling a refrigerator, including:

[0069] In S611, the refrigerator obtains the magnetic force signal sensed by the magnetic induction module.

[0070] In S621, when the refrigerator obtains the magnetic force signal, it determines that the refrigerator door is in a state where the preset opening degree has not been reached.

[0071] In S631, when the refrigerator does not obtain the magnetic force signal, it determines that the refrigerator door is in a state where the preset opening degree has been reached.

[0072] In S602, the refrigerator determines the target position of the image recognition module according to the open / closed state of the refrigerator door.

[0073] In S603, the refrigerator controls the drive module to drive the image recognition module to move to the target position.

[0074] The control module is inductively communicatively connected to the magnetic induction module to obtain the magnetic force signal sensed by the magnetic induction module. If the box door is closed or the opening angle of the box door is small, the magnetic induction module will sense the magnetic force signal. Then the control module can obtain the magnetic force signal, and it is determined that the box door is in a state where the preset opening degree is not reached. If the opening angle of the box door is large, the magnetic induction module will not sense the magnetic force signal. Then the control module cannot obtain the magnetic force signal, and it is determined that the box door is in a state where the preset opening degree is reached. Specifically, a preset angle threshold is used to determine whether the box door reaches the preset opening degree based on the angle threshold. If the opening angle of the box door is less than the angle threshold, it is determined that the box door does not reach the preset opening degree. If the opening angle of the box door is greater than or equal to the angle threshold, it is determined that the box door reaches the preset opening degree. Optionally, the angle threshold is 25°.

[0075] Combined with Figure 8 As shown, the embodiments of the present disclosure provide another method for controlling a refrigerator, including:

[0076] S601, the refrigerator determines the open / closed state of the box door.

[0077] S612, when the box door is in a state where the preset opening degree is not reached, the refrigerator determines the target position of the image recognition module as the initial position; wherein, the initial position is the position where the image recognition module is completely inside the box.

[0078] S622, when the box door is in a state where the opening reaches the preset opening degree, the refrigerator determines the target position of the image recognition module according to the opening angle of the box door.

[0079] S603, the refrigerator controls the drive module to drive the image recognition module to move to the target position.

[0080] If the box door is in a state where the preset opening degree is not reached, that is, the opening angle of the box door is less than the angle threshold, at this time the image recognition module does not need to move outside the box. Therefore, the target position of the image recognition module is determined as the initial position. When the image recognition module is at the initial position, it is completely inside the box. If the box door is in a state where the preset opening degree is reached, that is, the opening angle of the box door is greater than or equal to the angle threshold, at this time the image recognition module needs to move outside the box to obtain the full view of the refrigerator. Therefore, according to the opening angle of the box door, that is, whether the opening angle reaches the preset opening degree, the target position of the image recognition module is determined. In this way, the target position of the image recognition module can be matched with the opening angle of the box door so that the image recognition module can obtain the full view of the refrigerator.

[0081] Optionally, in S622, the refrigerator determines the target position of the image recognition module according to the opening angle of the box door, including:

[0082] The refrigerator determines the target position of the image recognition module corresponding to the opening angle of the door according to the correlation between the opening angle and the position.

[0083] The control module pre-stores the correlation between the opening angle and the position. Based on the correlation, the target position of the image recognition module corresponding to the opening angle of the door is determined. Optionally, the opening angle is positively correlated with the distance between the target position and the initial position. The larger the opening angle, the larger the distance between the target position and the initial position. In other words, the larger the angle at which the door is opened, the greater the distance the image recognition module moves outside the box. In this way, on the one hand, it is beneficial for the image recognition module to identify changes in food at the door; on the other hand, it is beneficial for the image recognition module to identify changes in food in other compartments. Furthermore, it is ensured that the image recognition module can obtain a full picture of the refrigerator.

[0084] Combination Figure 9 As shown, the embodiment of the present disclosure provides another method for controlling a refrigerator, comprising:

[0085] S601, the refrigerator determines the open / closed state of the door.

[0086] S602, the refrigerator determines the target position of the image recognition module according to the open and closed state of the refrigerator door.

[0087] S613, the refrigerator obtains the current position of the image recognition module.

[0088] S623, when the target position of the refrigerator is the initial position and the target position is different from the current position, the control driving module drives the image recognition module to move into the cabinet and move to the initial position.

[0089] S633, when the target position of the refrigerator is outside the cabinet and the target position is closer to the cabinet than the current position, the control driving module drives the image recognition module to move into the cabinet and move to the target position.

[0090] S643, when the target position of the refrigerator is outside the cabinet and the target position is farther from the cabinet than the current position, the control driving module drives the image recognition module to move outside the cabinet and move to the target position.

[0091] As in the refrigerator structure mentioned above, the direction of movement of the image recognition module is controlled by the direction of rotation of the motor. When the motor rotates forward, the image recognition module is driven to move outside the box, and when the motor rotates reversely, the image recognition module is driven to move inside the box. When the target position has been determined, the current position of the image recognition module must also be obtained, and combined with the target position and the current position, the control module determines how to drive the image recognition module to move.

[0092] If the target position is the initial position and the target position is not the same as the current position, it indicates that part or all of the image recognition module is outside the box. Then control the motor of the drive module to reverse to drive the image recognition module to move into the box and move to the initial position.

[0093] If the target position is a position outside the box and the target position is closer to the box compared to the current position, it indicates that the image recognition module needs to move in the direction of the inside of the box. Then control the motor of the drive module to reverse to drive the image recognition module to move into the box and move to the target position.

[0094] If the target position is a position outside the box and the target position is farther from the box compared to the current position, it indicates that the image recognition module needs to move in the direction of the outside of the box. Then control the motor of the drive module to rotate forward to drive the image recognition module to move outside the box and move to the target position.

[0095] If the target position is the same as the current position, do not control the motor to rotate.

[0096] The control module can calculate the target angle that the motor needs to rotate based on the distance between the target position and the current position. In this way, the motor of the drive module can be controlled to rotate the target angle to move the image recognition module to the target position.

[0097] Combined with Figure 10 As shown, an apparatus 100 for controlling a refrigerator provided by an embodiment of the present disclosure includes: a first determination module 101, a second determination module 102, and a control module 103. The first determination module 101 is configured to determine the opening and closing state of the refrigerator door. The second determination module 102 is configured to determine the target position of the image recognition module according to the opening and closing state of the refrigerator door. The control module 103 is configured to control the drive module to drive the image recognition module to move to the target position.

[0098] Using the apparatus 100 for controlling a refrigerator provided by the embodiment of the present disclosure is beneficial to determining the target position of the image recognition module based on the image recognition module that can move inside and outside the box and combining the opening and closing state of the refrigerator door. Furthermore, control the drive module to operate to drive the image recognition module to run to the target position. In this way, the position of the image recognition module is matched with the opening and closing state of the refrigerator door, and thus the image recognition module can obtain the overall view of the ingredients stored in the refrigerator.

[0099] Combined with Figure 11As shown in the figure, an embodiment of the present disclosure provides a device 110 for controlling a refrigerator, including a processor 111 and a memory 112. Optionally, the device 110 may further include a communication interface 113 and a bus 114. Among them, the processor 111, the communication interface 113, and the memory 112 can complete mutual communication through the bus 114. The communication interface 113 can be used for information transmission. The processor 111 can call the logical instructions in the memory 112 to execute the method for controlling the refrigerator in the above embodiment.

[0100] In addition, when the logical instructions in the above-mentioned memory 112 are implemented in the form of a software functional unit and sold or used as an independent product, they can be stored in a computer-readable storage medium.

[0101] The memory 112, as a computer-readable storage medium, can be used to store software programs and computer-executable programs, such as the program instructions / modules corresponding to the method in the embodiment of the present disclosure. The processor 111 executes functional applications and data processing by running the program instructions / modules stored in the memory 112, that is, implements the method for controlling the refrigerator in the above embodiment.

[0102] The memory 112 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system and application programs required for at least one function; the data storage area can store data created according to the use of the terminal device, etc. In addition, the memory 112 may include a high-speed random access memory and may also include a non-volatile memory.

[0103] Combined Figure 12 As shown in the figure, an embodiment of the present disclosure provides a refrigerator 120, including: a refrigerator body, and the above-mentioned device 100 (110) for controlling the refrigerator. The device 100 (110) for controlling the refrigerator is installed on the refrigerator body. The installation relationship described here is not limited to being placed inside the refrigerator body, but also includes installation connections with other components of the refrigerator 120, including but not limited to physical connections, electrical connections, or signal transmission connections, etc. Those skilled in the art can understand that the device 100 (110) for controlling the refrigerator can be adapted to a feasible refrigerator body, and further implement other feasible embodiments.

[0104] Among them, the refrigerator body includes a box body, a guide rail, an image recognition module, a driving module, and other structures.

[0105] An embodiment of the present disclosure provides a computer-readable storage medium storing computer-executable instructions, and the computer-executable instructions are set to execute the above method for controlling the refrigerator.

[0106] The technical solution of the embodiments of the present disclosure can be embodied in the form of a software product, which is stored in a storage medium and includes one or more instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in the embodiments of the present disclosure. The aforementioned storage medium may be a non-transitory storage medium, such as: a USB flash drive, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk, or an optical disc, etc., which are various media that can store program codes.

[0107] The above description and the accompanying drawings fully illustrate the embodiments of the present disclosure, enabling those skilled in the art to practice them. Other embodiments may include structural, logical, electrical, process, and other changes. Embodiments merely represent possible variations. Unless explicitly required, separate components and functions are optional, and the order of operations may vary. Parts and features of some embodiments may be included in or substituted for parts and features of other embodiments. Moreover, the terms used in this application are only for describing embodiments and are not used to limit the claims. As used in the description of the embodiments and the claims, unless the context clearly indicates otherwise, the singular forms "a", "an", and "the" are intended to also include the plural forms. Similarly, as used in this application, the term "and / or" refers to any and all possible combinations including one or more of the associated listed items. Additionally, when used in this application, the term "comprise" and its variants "comprises" and / or "comprising", etc., mean the presence of the stated features, wholes, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components, and / or groups thereof. Without further limitation, an element defined by the statement "comprising one..." does not exclude the presence of additional identical elements in the process, method, or device comprising the element. In this document, what each embodiment focuses on may be the differences from other embodiments, and the same or similar parts among the various embodiments may be referred to each other. For the methods, products, etc. disclosed in the embodiments, if they correspond to the method part disclosed in the embodiments, the relevant parts may refer to the description of the method part.

[0108] Those skilled in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed in a hardware or software manner may depend on the specific application and design constraints of the technical solution. The skilled person can use different methods for each specific application to implement the described functions, but such implementation should not be considered to exceed the scope of the embodiments of the present disclosure. The skilled person can clearly understand that for the convenience and simplicity of description, the specific working processes of the systems, devices, and units described above can refer to the corresponding processes in the foregoing method embodiments and will not be elaborated herein.

[0109] In the embodiments disclosed herein, the disclosed methods, products (including but not limited to devices, equipment, etc.) can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units can be merely a logical function division, and there may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Additionally, the displayed or discussed couplings or direct couplings or communication connections to each other can be through some interfaces. The indirect couplings or communication connections of devices or units can be electrical, mechanical, or other forms. The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they can be located in one place or distributed to multiple network units. Some or all of the units can be selected according to actual needs to implement this embodiment. Additionally, in the embodiments of the present disclosure, the functional units can be integrated in one processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit.

[0110] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a segment of code, or a part thereof, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions noted in the blocks may occur in a different order than noted in the accompanying drawings. For example, two consecutive blocks may actually be executed substantially in parallel, or they may sometimes be executed in the reverse order, depending on the functions involved. In the descriptions corresponding to the flowcharts and block diagrams in the accompanying drawings, the operations or steps corresponding to different blocks may also occur in a different order than disclosed in the description, and sometimes there is no specific order between different operations or steps. For example, two consecutive operations or steps may actually be executed substantially in parallel, or they may sometimes be executed in the reverse order, depending on the functions involved. Each block in the block diagram and / or flowchart, and combinations of blocks in the block diagram and / or flowchart, can be implemented by a dedicated hardware-based system that performs the specified functions or actions, or can be implemented by a combination of dedicated hardware and computer instructions.

Claims

1. A refrigerator, characterized in that, Comprising: A box body; A guide rail, arranged on the inner wall of the box body; An image recognition module, connected to the guide rail; A driving module, connected to the image recognition module to drive the image recognition module to move outside or inside the box body under the guidance of the guide rail.

2. The refrigerator according to claim 1, wherein The guide rail includes: A track, arranged inside the box body, and the guiding direction of the track is the depth direction of the box body; A slider, slidably embedded in the track; Wherein, the image recognition module is connected to the slider.

3. The refrigerator according to claim 1, characterized in that, The image recognition module includes: A connecting part, its first end is connected to the driving module, and its side is connected to the guide rail; A camera module, connected to the second end of the connecting part; Wherein, the driving module drives the connecting part to move under the guidance of the guide rail, and then drives the camera module to move.

4. The refrigerator according to claim 1, wherein The driving module includes: A transmission part, in contact with the image recognition module; A motor, its power output shaft is connected to the transmission part, and it transmits the driving force to the transmission part; Wherein, the transmission part converts the driving force into a driving force applied to the image recognition module.

5. The refrigerator according to claim 4, characterized in that, The transmission part includes: A transmission plate, provided with a chute penetrating its thickness direction; Wherein, a convex part is arranged on the top of the image recognition module, the convex part penetrates through the chute, can slide along the chute and is in contact with the inner wall of the chute.

6. The refrigerator according to any one of claims 1 to 5, characterized in that, It further includes: A control module, communicatively connected to the driving module to control the driving parameters of the driving module according to the opening and closing state of the box door.

7. A method for controlling a refrigerator, characterized in that, Applied to the refrigerator according to any one of claims 1 to 6, the refrigerator further includes: a box door, which is connected to the box body in an openable and closable manner; the method includes: Determine the opening and closing state of the box door; According to the opening and closing state of the box door, determine the target position of the image recognition module; Control the driving module to drive the image recognition module to move to the target position.

8. The method according to claim 7, wherein The box body is provided with a magnetic induction module, which can sense magnetic signals; Determining the opening and closing state of the box door includes: Obtain the magnetic signal sensed by the magnetic induction module; In the case of obtaining the magnetic signal, determine that the box door is in a state where it has not reached the preset opening degree; In the case of not obtaining the magnetic signal, determine that the box door is in a state where it has reached the preset opening degree.

9. The method according to claim 7, characterized in that, According to the opening and closing state of the box door, determining the target position of the image recognition module includes: In the case that the box door is in a state where it has not reached the preset opening degree, determine that the target position of the image recognition module is the initial position; wherein, the initial position is the position where the image recognition module is completely inside the box; In the case that the box door is in a state where it has been opened to reach the preset opening degree, determine the target position of the image recognition module according to the opening angle of the box door.

10. The method according to claim 9, wherein According to the opening angle of the box door, determining the target position of the image recognition module includes: According to the correlation between the opening angle and the position, determine the target position of the image recognition module corresponding to the opening angle of the box door.

11. The method according to claim 10, characterized in that, Determining the opening degree of the box door includes: In the case that the opening angle is less than the angle threshold, determine that the box door has not reached the preset opening degree; In the case that the opening angle is greater than or equal to the angle threshold, determine that the box door has reached the preset opening degree.

12. The method according to any one of claims 7 to 11, characterized in that, Controlling the driving module to drive the image recognition module to move to the target position includes: Obtain the current position of the image recognition module; When the target position is the initial position and the target position is different from the current position, control the driving module to drive the image recognition module to move into the box and move to the initial position; When the target position is a position outside the box and the target position is closer to the box than the current position, control the driving module to drive the image recognition module to move into the box and move to the target position; When the target position is a position outside the box and the target position is farther from the box than the current position, control the driving module to drive the image recognition module to move outside the box and move to the target position.

13. A device for controlling a refrigerator, comprising a processor and a memory storing program instructions, characterized in that, The processor is configured to execute the method for controlling a refrigerator according to any one of claims 7 to 12 when running the program instructions.

14. A refrigerator, characterized in that, Comprising: The box body; The device for controlling a refrigerator according to claim 13, installed on the refrigerator body; Wherein, the refrigerator body includes: A guide rail provided on the inner wall of the box; An image recognition module connected to the guide rail; A driving module connected to the image recognition module to drive the image recognition module to move outside or inside the box under the guidance of the guide rail.

15. A computer-readable storage medium storing program instructions, characterized in that, When the program instructions are running, they are used to cause the computer to execute the method for controlling a refrigerator according to any one of claims 7 to 12.

Images