Control method and control system of a refrigeration appliance panel and refrigeration appliance

Abstract

The application discloses a control method of a panel of a refrigeration equipment, comprising the following steps: determining a home decoration style of an environment where the refrigeration equipment is located; acquiring a user face and identifying the user; acquiring user personal information; acquiring refrigeration equipment information; and controlling the panel of the refrigeration equipment to select a panel image to display from a plurality of panel images; wherein the panel image displayed by the panel of the refrigeration equipment is determined according to the home decoration style, the user personal information and the refrigeration equipment information. The panel image displayed is determined according to the home decoration style of the environment where the refrigeration equipment is located, the user personal information and the refrigeration equipment information, so that the probability that the displayed panel image conforms to the personal preference of the user is increased, the possibility that the user switches the panel image is reduced, and the user experience is improved.

Description

Technical Field

[0001] This invention relates to the field of refrigeration equipment, and in particular to a control method, control system and refrigeration equipment panel for refrigeration equipment. Background Technology

[0002] Refrigeration equipment panels, such as refrigerators, typically display a default image as their interface. However, a household usually has multiple users with different preferences. The default image displayed on the panel may displease users, who are highly likely to manually change the panel image, thus affecting their experience. Summary of the Invention

[0003] The purpose of this invention is to provide a control method for a refrigeration equipment panel that determines the panel image displayed on the panel based on home decoration style, user personal information, and refrigeration equipment information, as well as a control system for the refrigeration equipment panel and a refrigeration equipment.

[0004] To achieve one of the above-mentioned objectives, one embodiment of the present invention provides a control method for a refrigeration equipment panel, comprising the following steps:

[0005] Determine the interior design style of the environment where the refrigeration equipment is located;

[0006] Obtain the user's face and identify the user;

[0007] Obtaining user personal information;

[0008] Obtain information about refrigeration equipment;

[0009] The panel controlling the refrigeration equipment selects one panel image from a plurality of panel images for display; wherein the panel image displayed by the refrigeration equipment panel is determined based on the home decoration style, user personal information, and refrigeration equipment information.

[0010] As a further improvement to one embodiment of the present invention, the following is included before the step of "obtaining the home decoration style of the environment in which the refrigeration equipment is located":

[0011] The user's voice control signal was detected.

[0012] As a further improvement to one embodiment of the present invention, the step of "determining the home decoration style of the environment in which the refrigeration equipment is located" specifically refers to:

[0013] The video acquisition device is controlled to record video of the environment in which the refrigeration equipment is located;

[0014] The video is then subjected to shading processing;

[0015] Extract multiple images from the video at different times;

[0016] The home décor style of the environment in which the refrigeration equipment is located is determined based on a plurality of the images described.

[0017] As a further improvement to one embodiment of the present invention, the step of "determining the home decoration style of the environment in which the refrigeration equipment is located based on the plurality of images" specifically means:

[0018] Based on a single image, the type, location, and color of furniture and / or appliances in the environment where the refrigeration equipment is located are identified, thereby identifying the home decoration style corresponding to the image content;

[0019] The interior design style of the environment in which the refrigeration equipment is located is determined by identifying the interior design style of the multiple images.

[0020] As a further improvement to one embodiment of the present invention, the step of "determining the home decoration style of the environment in which the refrigeration equipment is located by identifying the home decoration style from a plurality of images" specifically means:

[0021] The goal is to identify the most frequent home decoration style among the multiple home decoration styles identified from multiple images as the home decoration style of the environment where the refrigeration equipment is located.

[0022] As a further improvement to one embodiment of the present invention, after the step of "determining the home decoration style of the environment in which the refrigeration equipment is located based on the plurality of images", the following is also included:

[0023] Obtain the color of the furniture or appliance that most closely resembles the refrigeration equipment;

[0024] In the phrase "the panel controlling the refrigeration equipment selects one panel image from a plurality of panel images for display", the color of the panel image is matched to the color of the furniture or appliance most closely associated with the refrigeration equipment.

[0025] As a further improvement to one embodiment of the present invention, after the step of "the panel controlling the refrigeration equipment selects one panel image from a plurality of panel images for display", the following is also included:

[0026] Determine whether user feedback signals have been received;

[0027] If not, the control panel of the cooling device maintains the displayed panel image;

[0028] If so, the video acquisition device is rotated by a certain angle, the home decoration style of the environment where the refrigeration equipment is located is redefined, and the panel of the refrigeration equipment is controlled to select another panel image from multiple panel images for display.

[0029] As a further improvement to one embodiment of the present invention, the "obtaining user personal information" specifically refers to:

[0030] Obtain the user's personal information pre-entered in the mobile terminal corresponding to the user;

[0031] Alternatively, user personal information can be identified based on the user's facial image;

[0032] The user's personal information includes the user's age and gender.

[0033] As a further improvement of one embodiment of the present invention, the refrigeration equipment information includes the refrigeration equipment model, the location of the refrigeration equipment, and information on the food ingredients placed inside the refrigeration equipment at a certain time.

[0034] As a further improvement to one embodiment of the present invention, the phrase "the panel image displayed on the panel of the refrigeration equipment is determined according to the home decoration style, user personal information, and refrigeration equipment information" specifically means:

[0035] Each panel image is assigned a different first selection parameter based on the home decoration style;

[0036] Based on the user's personal information and refrigeration equipment information, obtain the panel images displayed on the panels of refrigeration equipment of multiple similar users whose similarity to the user is above a preset threshold;

[0037] The second selection parameter for each panel image is obtained by summing the similarity scores of similar users for the same panel image. The third selection parameter for each panel image is obtained by normalizing the second selection parameters of all panel images.

[0038] The first and third selection parameters of the same panel image are added together to obtain the fourth selection parameter, and the panel of the refrigeration device displays the panel image with the highest fourth selection parameter.

[0039] To achieve one of the above-mentioned objectives, one embodiment of the present invention provides a control system for a refrigeration equipment panel, comprising:

[0040] The controller includes a memory and a processor, the memory storing a computer program that can run on the processor, the processor executing the program to implement the steps of the control method for the refrigeration equipment panel described in the above embodiments;

[0041] A panel is used to display panel images.

[0042] To achieve one of the above-mentioned objectives, one embodiment of the present invention provides a refrigeration device, including a housing, a door mounted on the housing for opening or closing the housing, and a control system for the refrigeration device panel described in the above embodiment, wherein the panel is mounted on the door.

[0043] Compared with the prior art, the beneficial effects of the present invention are as follows: by simultaneously determining the panel image to be displayed on the panel based on the home decoration style of the environment in which the refrigeration equipment is located, the user's personal information, and the refrigeration equipment information, the probability of the displayed panel image matching the user's personal preferences is increased, the possibility of the user switching the panel image is reduced, thereby improving the user experience. Attached Figure Description

[0044] Figure 1 This is a schematic diagram of the structure of a refrigeration device according to an embodiment of the present invention;

[0045] Figure 2 This is a schematic diagram of a control method for a refrigeration equipment panel according to an embodiment of the present invention;

[0046] Figure 3 This is a schematic diagram of some steps of a control method for a refrigeration equipment panel according to an embodiment of the present invention;

[0047] Figure 4 This is a schematic diagram of some steps of a control method for a refrigeration equipment panel according to an embodiment of the present invention;

[0048] Among them, 10 is the cabinet; 20 is the door; 30 is the panel; and 40 is the video acquisition device. Detailed Implementation

[0049] The present invention will now be described in detail with reference to the specific embodiments shown in the accompanying drawings. However, these embodiments do not limit the present invention, and any structural, methodological, or functional modifications made by those skilled in the art based on these embodiments are included within the scope of protection of the present invention.

[0050] It should be noted that the term "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. In the various figures of this invention, for ease of illustration, certain dimensions of structures or portions are enlarged relative to other structures or portions; therefore, only the basic structure of the subject matter of this invention is used to illustrate the invention.

[0051] The present invention provides a control system for a refrigeration equipment panel, including a controller, a panel 30 and a video acquisition device 40.

[0052] This invention provides a refrigeration device. The refrigeration device includes refrigerators, freezers, wine cabinets, and other equipment used for refrigerating and / or freezing items.

[0053] The refrigeration equipment includes a housing 10, a control system for the refrigeration equipment panel, and a door 20 mounted on the housing 10 to open or close the housing 10. A panel 30 is mounted on the door 20, and a video acquisition device 40 is mounted on either the housing 10 or the door 20. The panel 30 displays the internal temperature of the refrigeration equipment and other buttons for controlling the refrigeration equipment, as well as a panel image serving as the panel's skin. The video acquisition device 40 includes a camera for acquiring video of the environment in which the refrigeration equipment is located.

[0054] The controller includes a memory and a processor. The memory stores a computer program that can run on the processor. When the processor executes the program, it displays an image on the control panel.

[0055] The present invention also provides a control method for a refrigeration equipment panel, wherein the processor executes the program to implement the steps of the control method for the refrigeration equipment panel.

[0056] The control method for the refrigeration equipment panel includes the following steps:

[0057] S10: User's voice control signal has been detected;

[0058] The controller has a voice recognition module. After the voice recognition module recognizes the user, the refrigeration equipment begins to execute the following steps.

[0059] S20. Determine the home décor style of the environment where the refrigeration equipment is located;

[0060] S30. Obtain the user's face and identify the user;

[0061] S40. Obtaining user personal information;

[0062] S50, Obtain information about refrigeration equipment;

[0063] S60. The panel of the refrigeration equipment is controlled to select one panel image from a plurality of panel images for display; wherein the panel image displayed by the refrigeration equipment is determined according to the home decoration style, user personal information, and refrigeration equipment information.

[0064] This invention determines the panel image to be displayed by simultaneously considering the home décor style of the environment where the refrigeration equipment is located, the user's personal information, and the refrigeration equipment information. This increases the probability that the displayed panel image matches the user's personal preferences and reduces the likelihood of the user switching the panel image, thereby improving the user experience.

[0065] The order of steps S40 and S50 can be switched, or they can be performed simultaneously.

[0066] Furthermore, the phrase "determining the home décor style of the environment where the refrigeration equipment is located" specifically refers to:

[0067] S21. Control the video acquisition device to record video of the environment where the refrigeration equipment is located;

[0068] S22. Perform shake reduction processing on the video;

[0069] S23. Extract a plurality of images from the video at different times;

[0070] S24. Determine the home decoration style of the environment in which the refrigeration equipment is located based on the plurality of images.

[0071] Users typically use voice commands to display images on the panel when they are standing in front of the refrigeration equipment, and users usually do not maintain the same posture in front of the refrigeration equipment. To improve the accuracy of home decoration style recognition, a preferred embodiment of the present invention involves recording a video, decluttering the video, and then taking screenshots of multiple images from the video for recognition to determine the home decoration style. This approach prevents image blurring caused by user movement from affecting the image recognition results, and utilizes user movement to expose as many details of the home decoration as possible in multiple images, thereby improving the accuracy of image recognition. Decluttering can employ existing de-shaking algorithms, which will not be specifically described in this invention.

[0072] Furthermore, the phrase "determining the home decoration style of the environment where the refrigeration equipment is located based on the plurality of images" specifically refers to:

[0073] S241. Based on a single image, identify the type, location, and color of furniture and / or appliances in the environment where the refrigeration equipment is located, thereby identifying the home decoration style corresponding to the image content;

[0074] S242. Determine the home decoration style of the environment in which the refrigeration equipment is located by identifying the home decoration style from multiple images.

[0075] Specifically, in step S241, the image recognition can be trained by a large number of samples to make the model converge, and the type of furniture and / or home appliances can be determined by comparing with the model. Then, the home decoration style can be determined based on the position and color of the furniture and / or home appliances in the image.

[0076] Home decoration styles include, but are not limited to, European, Chinese, and Japanese styles. The furniture includes, but is not limited to, sofas, coffee tables, and kitchen cabinets, while the appliances include, but are not limited to, televisions, range hoods, and water dispensers.

[0077] Specifically, the phrase "determining the home decoration style of the environment where the refrigeration equipment is located by identifying home decoration styles from multiple images" means: determining the home decoration style with the highest frequency among the multiple home decoration styles identified from multiple images as the home decoration style of the environment where the refrigeration equipment is located.

[0078] Due to user movement, the home decoration style identified in some images is inaccurate. By selecting the home decoration style that appears most frequently among the multiple home decoration styles identified in multiple images, the home decoration style of the environment where the refrigeration equipment is located can be determined, thereby improving the accuracy of image recognition.

[0079] The process of "determining the home décor style of the environment in which the refrigeration equipment is located based on the plurality of images" also includes:

[0080] S243. Obtain the color of the furniture or appliance that is closest to the refrigeration equipment;

[0081] In the step of “controlling the panel of the refrigeration equipment to select one panel image to display from a plurality of panel images”, the color of the panel image is matched with the color of the furniture or home appliance that is closest to the refrigeration equipment.

[0082] By following the steps above, the panel color can be well integrated with the home decoration style, enhancing the user's visual experience.

[0083] Furthermore, in one embodiment, "obtaining user personal information" specifically means: obtaining user personal information pre-recorded in the mobile terminal corresponding to the user.

[0084] Before using the cooling device, the user binds their mobile terminal to the device and registers their facial data and personal information on the mobile terminal. After acquiring the user's face, the cooling device compares the facial data and then connects to the corresponding mobile terminal, at which point the cooling device can access the user's personal information on the mobile terminal.

[0085] In another embodiment, the "obtaining user personal information" specifically refers to: identifying user personal information based on the user's facial image; wherein, the user personal information includes the user's age and gender.

[0086] The user's facial image can be obtained from the video in S21, or the user can be photographed again by the image acquisition device.

[0087] Furthermore, the refrigeration equipment information in step S50 includes the refrigeration equipment model, the location of the refrigeration equipment, and information about the food ingredients placed inside the refrigeration equipment at a certain time. The food ingredient information can be obtained using existing food ingredient identification methods, which will not be specifically described in this invention.

[0088] The phrase "controlling the panel of the refrigeration equipment to select one panel image from a plurality of panel images for display, wherein the panel image displayed by the refrigeration equipment panel is determined based on the home decoration style, user personal information, and refrigeration equipment information" specifically means:

[0089] S61. Assign different first selection parameters to each panel image according to the home decoration style.

[0090] Preferably, the sum of the first selection parameters for all panel images corresponding to a certain home decoration style is 1. The first selection parameters can be set manually by the refrigeration equipment manufacturer after a survey, reflecting the probability that users of a particular home decoration style will choose a certain panel image. For example, users of a Chinese-style home decoration style are more likely to choose an antique-style image as their panel image, thus making the first selection parameter for the antique-style image greater than the first selection parameters for other panel images.

[0091] S62. Based on the user's personal information and the refrigeration equipment information, obtain the panel images displayed on the panels of the refrigeration equipment of a plurality of similar users whose similarity to the user is above a preset threshold;

[0092] Data from other users is obtained through a server connected to the mobile terminal. The similarity between multiple users is calculated using their personal information and refrigeration equipment information. Users with a similarity score above a preset threshold are selected as similar users. Existing similarity algorithms can be used for similarity calculation, and this invention does not provide specific details about them.

[0093] S63. The similarity of similar users in the same panel image is added together to obtain the second selection parameter of each panel image. The second selection parameter of all panel images is normalized to obtain the third selection parameter of each panel image.

[0094] After step S62, multiple similar users with a certain degree of similarity are obtained, as well as the panel image selected by each similar user. That is, a panel image has no similar user selection or corresponds to at least one similar user. Step S63 obtains the third selection parameter of each panel by adding the similarity of similar users of the same panel image and performing normalization processing. If the panel image has no similar user, the third selection parameter is 0.

[0095] S64. The first selection parameter and the third selection parameter of the same panel image are added together to obtain the fourth selection parameter, and the panel of the refrigeration equipment displays the panel image with the highest fourth selection parameter.

[0096] Step S63, the normalization process, ensures that the range of the third selection parameter is greater than or equal to 0 and less than 1. Preferably, step S63 makes the sum of the third selection parameters equal to 1. Here, the normalization process involves adding the second selection parameters of all panel images to obtain a sum of second selection parameters, and then dividing the second selection parameter of each panel image by this sum to obtain the third selection parameter for that panel image. The purpose of normalization is to make the values ​​of the first and third selection parameters close, reducing the influence of the third selection parameter on the selection result of the panel image, and preventing the value of the third selection parameter of the panel image from being too large, thus preventing the first selection parameter from affecting the selection result of the panel image.

[0097] Following the statement "the panel controlling the refrigeration equipment selects one panel image from a plurality of panel images for display", the following is also included:

[0098] S70. Determine whether user feedback signals have been obtained;

[0099] If not, proceed to step S80: control the panel of the cooling device to maintain the displayed panel image;

[0100] If so, then execute step S90: control the video acquisition device to rotate a certain angle; then return to step S20, and control the panel of the cooling device to select another panel image from the plurality of panel images to display, so that the panel image displayed after the second execution of the control method is different from the first one; for example, the panel image displayed after the second execution of the control method is the panel image with the second highest fourth selection parameter.

[0101] The feedback signal represents the user's dissatisfaction, and this signal can be a voice signal. For example, when the voice recognition module detects a user making a dissatisfied sound, it indicates that it has obtained the user's feedback signal.

[0102] The cooling equipment also includes a drive motor, whose output shaft extends vertically. The front end of the video acquisition device is the shooting end, and the rear end of the video acquisition device is connected to the output shaft of the drive motor. When the drive motor starts, its output shaft drives the video acquisition device to rotate by a certain angle.

[0103] The detailed descriptions listed above are merely specific descriptions of feasible embodiments of the present invention, and are not intended to limit the scope of protection of the present invention. All equivalent embodiments or modifications made without departing from the spirit of the present invention should be included within the scope of protection of the present invention.

Claims

1. A control method for a refrigeration equipment panel, characterized in that, Includes the following steps: Determine the interior design style of the environment where the refrigeration equipment is located; Obtain the user's face and identify the user; Obtaining user personal information; Obtain information about refrigeration equipment; The control panel of the refrigeration equipment selects one panel image from a plurality of panel images for display; wherein, each panel image is assigned a different first selection parameter according to the home decoration style; panel images displayed by the panels of refrigeration equipment of a plurality of similar users whose similarity to the user is above a preset threshold are obtained according to the user's personal information and refrigeration equipment information; the similarity of similar users of the same panel image is added to obtain a second selection parameter for each panel image; and the second selection parameters of all panel images are normalized to obtain a third selection parameter for each panel image. The first and third selection parameters of the same panel image are added together to obtain the fourth selection parameter; the panel controlling the refrigeration equipment displays the panel image with the highest fourth selection parameter.

2. The control method for the refrigeration equipment panel according to claim 1, characterized in that, The section preceding "determining the home décor style of the environment where the refrigeration equipment is located" also includes: The user's voice control signal was detected.

3. The control method for the refrigeration equipment panel according to claim 1, characterized in that, The specific meaning of "determining the home decoration style of the environment where the refrigeration equipment is located" is as follows: The video acquisition device is controlled to record video of the environment in which the refrigeration equipment is located; The video is then subjected to shading processing; Extract multiple images from the video at different times; The home décor style of the environment in which the refrigeration equipment is located is determined based on a plurality of the images described.

4. The control method for the refrigeration equipment panel according to claim 3, characterized in that, The phrase "determining the home décor style of the environment in which the refrigeration equipment is located based on the plurality of images" specifically refers to: Based on a single image, the type, location, and color of furniture and / or appliances in the environment where the refrigeration equipment is located are identified, thereby identifying the home decoration style corresponding to the image content; The interior design style of the environment in which the refrigeration equipment is located is determined by identifying the interior design style of the multiple images.

5. The control method for the refrigeration equipment panel according to claim 4, characterized in that, The phrase "determining the home decoration style of the environment where the refrigeration equipment is located by identifying home decoration styles from multiple images" specifically refers to: The home decoration style with the highest frequency among the multiple home decoration styles identified from multiple images is determined as the home decoration style of the environment where the refrigeration equipment is located.

6. The control method for the refrigeration equipment panel according to claim 4, characterized in that, The process of "determining the home décor style of the environment in which the refrigeration equipment is located based on the plurality of images" also includes: Obtain the color of the furniture or appliance that most closely resembles the refrigeration equipment; The color of the panel image in the phrase "the panel controlling the refrigeration equipment selects one panel image from a plurality of panel images to display" matches the color of the furniture or appliance that is closest to the refrigeration equipment.

7. The control method for the refrigeration equipment panel according to claim 3, characterized in that, Following the statement "the panel controlling the refrigeration equipment selects one panel image from a plurality of panel images for display", the following is also included: Determine whether user feedback signals have been received; If not, the control panel of the cooling device maintains the displayed panel image; If so, the video acquisition device is rotated by a certain angle, the home decoration style of the environment where the refrigeration equipment is located is redefined, and the panel of the refrigeration equipment is controlled to select another panel image from multiple panel images for display.

8. The control method for the refrigeration equipment panel according to claim 1, characterized in that, The "obtaining user personal information" specifically refers to: Obtain the user's personal information pre-entered in the mobile terminal corresponding to the user; Alternatively, user personal information can be identified based on the user's facial image; The user's personal information includes the user's age and gender.

9. The control method for a refrigeration equipment panel according to claim 1, characterized in that, The refrigeration equipment information includes the refrigeration equipment model, the location of the refrigeration equipment, and information about the food ingredients that were placed inside the refrigeration equipment at a certain time.

10. A control system for a refrigeration equipment panel, characterized in that, include: A controller includes a memory and a processor, the memory storing a computer program executable on the processor, the processor executing the program to implement the steps of the control method for the refrigeration device panel according to any one of claims 1-9; A panel is used to display panel images.

11. A refrigeration device, characterized in that, The device includes a housing, a door mounted on the housing for opening or closing the housing, and a control system for a refrigeration equipment panel as claimed in claim 10, the panel being mounted on the door.

Images