Refrigerator display screen control method and apparatus, storage medium, and program product
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- XIAOMI TECH (WUHAN) CO LTD
- Filing Date
- 2024-12-27
- Publication Date
- 2026-06-30
AI Technical Summary
Refrigerator displays are prone to lighting up due to misjudgment, increasing power consumption, compromising user privacy, and affecting user experience and lifespan.
By detecting the home status of refrigerator users and the target user's posture information, the system controls the screen to turn on and off. This includes acquiring home status information, detecting the target user's relative position and facial orientation, acquiring multiple data points using a preset sampling frequency, using a neural network model to identify facial orientation, and combining this with an identity authentication interface to improve security.
It effectively reduces false alarms when the display screen lights up, lowers energy consumption, improves the safety and privacy of the refrigerator, and enhances the user experience.
Smart Images

Figure CN122308759A_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of automatic control, and in particular to methods, devices, storage media, and program products for controlling refrigerator displays. Background Technology
[0002] Currently, refrigerators have effectively improved the user experience by integrating displays and touchscreens, and have made significant progress in both displayed content and automation. For example, they can not only intuitively display basic information such as temperature, humidity, and time, but also clearly show the internal storage status of the refrigerator, and usually can automatically turn the screen on and off. However, this also makes refrigerator displays more prone to unnecessary power consumption and shortened display lifespan, and also poses corresponding risks to user privacy. Summary of the Invention
[0003] To overcome the problems existing in the related technologies, this disclosure provides a refrigerator display screen control method, device, storage medium and program product.
[0004] According to a first aspect of the present disclosure, a refrigerator display screen control method is provided, comprising: When the refrigerator display screen is off, the current home status information of the refrigerator user is obtained. The current home status information is either a first home status information or a second home status information. The first home status information is used to indicate that the user is at home, and the second home status information is used to indicate that the user is away from home. If the current home status information is determined to be the first home status information, and if a target user is determined to exist within the first preset distance range of the refrigerator, the first pose information of the target user is obtained; The refrigerator display screen is controlled to light up based on the first pose information.
[0005] Optionally, obtaining the current home status information of the refrigerator user includes: Get the current status of one or more preset associated devices; If it is determined that the current state of at least one of the preset associated devices is a home state, the first home state information is generated. If it is determined that the current status of one or more preset associated devices is "away from home", the second home status information is generated. Optionally, the one or more preset associated devices include one or more home appliances, which are connected to the refrigerator via a target application. The step of obtaining the current status of one or more preset associated devices includes: A target request instruction is sent to the target application, and the target application, in response to receiving the target request instruction, obtains the current status of each home appliance.
[0006] Optionally, determining that at least one of the preset associated devices is currently in a home state includes: For each household appliance, obtain the target attribute information of the current state of the household appliance; If the target attribute information is determined to be a home status attribute, then the current status of the home appliance is determined to be a home status. If the target attribute information is determined to be an "out-of-home" status attribute, then the current status of the home appliance is determined to be an "away-from-home" status.
[0007] Optionally, the one or more preset associated devices include a mobile terminal, and the current state includes a state of accessing the target wireless local area network and a state of not accessing the wireless local area network; determining that the current state of at least one of the one or more preset associated devices is a home state includes: If the current state of the mobile terminal is connected to the target wireless local area network, it is determined that the current state of the mobile terminal is at home.
[0008] Optionally, the refrigerator is connected to a target application, which receives user-set appliance control modes, including an away mode and a home mode, and obtains the user's current home status information, including: Obtain the appliance control mode set by the user in the target application; When the appliance control mode is home mode, the first home status information is generated; When the appliance control mode is set to "away mode", the second home status information is generated.
[0009] Optionally, determining that a target user exists within a first preset distance range of the refrigerator includes: If a target mobile terminal is determined to exist within a first preset distance range, then a target user is determined to exist within the first preset distance range.
[0010] Optionally, the first pose information includes the relative position information of the target user and the refrigerator and the user's facial orientation information, and obtaining the first pose information of the target user includes: According to the first preset sampling frequency, the relative position information between the target user and the refrigerator is obtained, so as to obtain multiple relative position information from multiple samplings; Acquire the user's facial image information according to the second preset sampling frequency; The facial orientation information of the target user is determined based on the facial image information.
[0011] Optionally, the facial orientation information includes facing the refrigerator and not facing the refrigerator, and controlling the refrigerator display screen to turn on based on the first pose information includes: If, based on the multiple relative position information, it is determined that the distance between the target user and the refrigerator is decreasing, and if the facial orientation information indicates that the user is facing the refrigerator, then the refrigerator display screen is controlled to turn on.
[0012] Optionally, controlling the refrigerator display screen to light up based on the first pose information includes: If, based on the multiple relative position information, it is determined that the distance between the target user and the refrigerator has decreased, and if it is determined that the face orientation information indicates that the user is not facing the refrigerator, then the refrigerator display screen is turned off.
[0013] Optionally, controlling the refrigerator display screen to light up based on the first pose information further includes: If the distance between the target user and the refrigerator increases or remains unchanged based on the multiple relative position information, the refrigerator display screen is turned off.
[0014] Optionally, the method further includes: If it is determined that there is no target user within the first preset distance range of the refrigerator, an identity authentication interface is displayed when the user's touch operation is detected. Obtain the user's authentication message through the authentication interface; If the identity verification is successful based on the identity verification message, the second pose information of the current user is obtained. If the current user is determined to be away from the refrigerator based on the second pose information, the refrigerator display screen is turned off.
[0015] According to a second aspect of the present disclosure, a refrigerator display screen control device is provided, comprising: The first acquisition module is configured to acquire the current home status information of the refrigerator user when the refrigerator display screen is in an off state. The current home status information is either first home status information or second home status information. The first home status information is used to indicate that the user is at home, and the second home status information is used to indicate that the user is away from home. The first determining module is configured to, when determining that the current home status information is the first home status information, if it is determined that there is a target user within the first preset distance range of the refrigerator, obtain the first pose information of the target user; The control module is configured to control the refrigerator display screen to light up based on the first pose information.
[0016] Optionally, the first acquisition module is configured as follows: Get the current status of one or more preset associated devices; If it is determined that the current state of at least one of the preset associated devices is a home state, the first home state information is generated. If it is determined that the current status of one or more preset associated devices is "away from home", the second home status information is generated. Optionally, the one or more preset associated devices include one or more home appliances, which are connected to the refrigerator via a target application. The first acquisition module is configured as follows: A target request instruction is sent to the target application, and the target application, in response to receiving the target request instruction, obtains the current status of each home appliance.
[0017] Optionally, the first acquisition module is configured as follows: For each household appliance, obtain the target attribute information of the current state of the household appliance; If the target attribute information is determined to be a home status attribute, then the current status of the home appliance is determined to be a home status. If the target attribute information is determined to be an "out-of-home" status attribute, then the current status of the home appliance is determined to be an "away-from-home" status.
[0018] Optionally, the one or more preset associated devices include a mobile terminal, and the current state includes a state of accessing the target wireless local area network and a state of not accessing the wireless local area network; the first acquisition module is configured to: If the current state of the mobile terminal is connected to the target wireless local area network, it is determined that the current state of the mobile terminal is at home.
[0019] Optionally, the refrigerator is connected to a target application, which receives user-defined appliance control modes, including an away mode and a home mode. The first acquisition module is configured to: Obtain the appliance control mode set by the user in the target application; When the appliance control mode is home mode, the first home status information is generated; When the appliance control mode is set to "away mode", the second home status information is generated.
[0020] Optionally, the first determining module is configured to: If a target mobile terminal is determined to exist within a first preset distance range, then a target user is determined to exist within the first preset distance range.
[0021] Optionally, the first pose information includes the relative position information of the target user and the refrigerator and the user's facial orientation information, and the first determining module is configured to: According to the first preset sampling frequency, the relative position information between the target user and the refrigerator is obtained, so as to obtain multiple relative position information from multiple samplings; Acquire the user's facial image information according to the second preset sampling frequency; The facial orientation information of the target user is determined based on the facial image information.
[0022] Optionally, the facial orientation information includes facing the refrigerator and not facing the refrigerator, and the control module is configured to: If, based on the multiple relative position information, it is determined that the distance between the target user and the refrigerator is decreasing, and if the facial orientation information indicates that the user is facing the refrigerator, then the refrigerator display screen is controlled to turn on.
[0023] Optionally, the control module is configured to: If, based on the multiple relative position information, it is determined that the distance between the target user and the refrigerator has decreased, and if it is determined that the face orientation information indicates that the user is not facing the refrigerator, then the refrigerator display screen is turned off.
[0024] Optionally, the control module is further configured to: If the distance between the target user and the refrigerator increases or remains unchanged based on the multiple relative position information, the refrigerator display screen is turned off.
[0025] Optionally, the device further includes: The second determining module is configured to display an identity authentication interface when it is determined that there is no target user within the first preset distance range of the refrigerator and the user's touch operation has been collected. The second acquisition module is configured to acquire the user's input authentication message through the authentication interface; The third determining module is configured to, when the identity authentication message determines that the authentication is successful, obtain the second pose information of the current user, and when the second pose information determines that the current user is away from the refrigerator, control the refrigerator display screen to turn off.
[0026] According to a third aspect of the present disclosure, a refrigerator display screen control device is provided, comprising: processor; Memory used to store processor-executable instructions; The processor is configured to implement the steps of the method described in the first aspect above.
[0027] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided that stores a computer program thereon, which, when executed by a processor, implements the steps of the method described in the first aspect above.
[0028] According to a fifth aspect of the present disclosure, a computer program product is provided, including a computer program that, when executed by a processor, implements the steps of the method described in the first aspect above.
[0029] The technical solutions provided by the embodiments of this disclosure may include the following beneficial effects: The system can detect whether a target user exists within a first preset distance range of the refrigerator when the user's current home status is determined to be the first home status, i.e., when the user is at home. Furthermore, if a target user exists within the first preset distance range of the refrigerator, the system can control the refrigerator display screen to light up based on the target user's first posture information. This not only effectively reduces the possibility of the display screen being triggered due to misjudgment, but also effectively improves the security and privacy of the refrigerator settings.
[0030] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description
[0031] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.
[0032] Figure 1 This is a flowchart illustrating a refrigerator display control method according to an exemplary embodiment; Figure 2 It is based on Figure 1 The illustrated embodiment shows a flowchart of a refrigerator display screen control method; Figure 3 It is based on Figure 1 The illustrated embodiment shows a flowchart of another refrigerator display control method; Figure 4 It is based on Figure 1 The illustrated embodiment shows a flowchart of another refrigerator display control method; Figure 5 This is a block diagram illustrating a refrigerator display control device according to an exemplary embodiment of the present disclosure; Figure 6 This is a block diagram illustrating a chip system according to an exemplary embodiment. Detailed Implementation
[0033] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.
[0034] It should be noted that all actions involving the acquisition of signals, information, or data in this disclosure are carried out in compliance with the relevant data protection laws and policies of the country where the location is situated, and with authorization from the owner of the relevant device.
[0035] Before detailing the specific embodiments of this disclosure, the application scenarios of this disclosure are first explained as follows. This disclosure can be applied to the control process of a refrigerator display screen. With the development of detection technology, infrared sensors, cameras, and millimeter-wave radar technologies enable refrigerators to accurately detect the presence and actions of people. Furthermore, refrigerators effectively improve the user's interactive experience by integrating a display screen and a touch screen. However, in actual applications, the refrigerator display screen often automatically lights up when there is obstruction or when a pet passes by the refrigerator. It also automatically lights up when strangers or visitors approach. This not only increases the power consumption of the refrigerator display screen but also hinders the extension of its lifespan. Moreover, it can easily leak the privacy of refrigerator users and lead to a poor user experience.
[0036] To address the aforementioned technical issues, this disclosure provides a refrigerator display screen control method, device, storage medium, and program product. This refrigerator display screen control method can detect whether a target user exists within a first preset distance range of the refrigerator when the user's current home state is determined to be the first home state, i.e., when the user is at home. This effectively reduces the energy consumption of the refrigerator display screen. Furthermore, when a target user exists within the first preset distance range of the refrigerator, the method can control the refrigerator display screen to light up based on the target user's first posture information. This not only effectively reduces the possibility of the display screen triggering light up due to misjudgment but also effectively improves the security and privacy of the refrigerator settings.
[0037] Figure 1 This is a flowchart illustrating a refrigerator display control method according to an exemplary embodiment; as shown below. Figure 1 As shown, the refrigerator display control method may include: Step 101: Obtain the current home status information of the refrigerator user when the refrigerator display screen is off.
[0038] The current home status information is either a first home status information or a second home status information; the first home status information is used to indicate that the user is at home, and the second home status information is used to indicate that the user is away from home.
[0039] In this step, one possible implementation is as follows: obtain the current status of one or more preset associated devices; if it is determined that the current status of at least one of the preset associated devices is at home, generate the first home status information; if it is determined that the current status of all one or more preset associated devices is away from home, generate the second home status information.
[0040] It should be noted that the preset associated device can be a home appliance, such as an air conditioner, light bulb, television, or air purifier; fitness equipment, such as a treadmill, exercise bike, or rowing machine; or a terminal device or wearable device, such as a tablet, mobile phone, watch, smart band, or earphones. The current status of the preset association can be "on," "running," the connection status of the terminal device to the preset wireless network, or the status of the current location displayed by the location function as belonging to the target location.
[0041] Another possible implementation is as follows: the refrigerator is connected to a target application, which is used to receive the appliance control mode set by the user, the appliance control mode including an away mode and a home mode, and to obtain the current home status information of the refrigerator user, including: obtaining the appliance control mode set by the user in the target application; generating the first home status information when the appliance control mode is the home mode; and generating the second home status information when the appliance control mode is the away mode.
[0042] For example, this target application is used to intelligently control multiple appliances pre-bound by the user. For instance, it can control the on / off state, mode selection, and temperature adjustment of a pre-bound air conditioner, as well as control pre-bound televisions and lights. When the appliance control mode is set to "Home Mode" on the target application, the pre-bound appliances can be controlled according to the control parameters for that mode. When the appliance control mode is set to "Away Mode" on the target application, the pre-bound appliances can be controlled according to the control parameters for that mode. For example, in "Home Mode," the air conditioner's control parameters include: On status: On, Time: January-April, Mode: Heating, Temperature: 26 degrees Celsius; May-September, Mode: Cooling, Temperature: 25 degrees Celsius. In "Home Mode," the air purifier's control parameters include: On status: On, Mode: Sterilization, Fan speed: Automatic. In "Home Mode," the indoor lights' control parameters include: Living room lights on. In the "Away from Home" mode, the control parameters for the air conditioner include: On status: Off. In the "Away from Home" mode, the control parameters for the air purifier include: On status: Off. In the "Away from Home" mode, the control parameters for the indoor lights include: Living room light off, bedroom light off, dining room light off, and bathroom light off.
[0043] Step 102: If the current home status information is determined to be the first home status information, and if a target user is determined to exist within the first preset distance range of the refrigerator, the first pose information of the target user is obtained.
[0044] In one implementation, if a target mobile terminal is determined to exist within a first preset distance range, then a target user can be determined to exist within the first preset distance range.
[0045] The target mobile terminal can be a pre-bound target user's mobile phone, watch, tablet, bracelet, etc.
[0046] It should be noted that the presence of a target mobile terminal within the first preset distance range can be determined by using Bluetooth, mobile signal detectors, or NFC technology.
[0047] In another implementation, an infrared sensor or camera can be used to determine whether a target user exists within the first preset distance range.
[0048] The target user can be a pre-set user. When determining whether the target user exists within the first preset distance range through the camera, the camera can capture images around the refrigerator and use these images to determine whether the target user exists within the first preset distance range.
[0049] Additionally, the first pose information can be the relative position information between the target user and the refrigerator, and the user's facial orientation information. The implementation method for obtaining the target user's first pose information in step 102 can be: obtaining the relative position information between the target user and the refrigerator at a first preset sampling frequency to obtain multiple relative position information from multiple samples; obtaining the user's facial image information at a second preset sampling frequency; and determining the target user's facial orientation information based on the facial image information. The first preset sampling frequency and the second preset sampling frequency can be the same or different.
[0050] Step 103: Control the refrigerator display screen to turn on according to the first pose information.
[0051] The first pose information may include the relative position information of the target user and the refrigerator and the user's facial orientation information; the facial orientation information includes facing the refrigerator and not facing the refrigerator.
[0052] It should be noted that one implementation method for obtaining this facial orientation information is to input the captured facial image into a preset facial orientation recognition model to obtain the facial orientation information output by the facial orientation recognition model. This facial orientation recognition model can be a pre-trained neural network model. The training process of the facial orientation recognition model can include acquiring multiple image sample data, including labeled data showing faces facing and not facing the refrigerator. Using these multiple image sample data as training data, a preset initial model is trained to obtain the facial orientation recognition model.
[0053] In some embodiments, if it is determined that the distance between the target user and the refrigerator has decreased based on the plurality of relative position information, and if it is determined that the face orientation information indicates that the user is facing the refrigerator, then the refrigerator display screen is controlled to turn on.
[0054] In other embodiments, if it is determined that the distance between the target user and the refrigerator has decreased based on the plurality of relative position information, and if it is determined that the face orientation information is not towards the refrigerator, then the refrigerator display screen is controlled to turn off.
[0055] In some other embodiments, if it is determined from the plurality of relative position information that the distance between the target user and the refrigerator increases or remains unchanged, the refrigerator display screen is turned off.
[0056] The above technical solution can detect whether a target user exists within a first preset distance range of the refrigerator when the user's current home state is determined to be the first home state, i.e., when the user is at home. This can effectively reduce the energy consumption of the refrigerator display screen. Furthermore, when a target user exists within the first preset distance range of the refrigerator, the refrigerator display screen can be controlled to light up based on the target user's first posture information. This not only effectively reduces the possibility of the display screen being triggered due to misjudgment, but also effectively improves the security and privacy of the refrigerator settings.
[0057] Figure 2 It is based on Figure 1 The illustrated embodiment shows a flowchart of a refrigerator display screen control method, as follows: Figure 2 As shown, Figure 1 The step 101 of obtaining the current home status information of the refrigerator user may include: Step 1011: Obtain the current status of one or more preset associated devices.
[0058] In one embodiment, the one or more preset associated devices include one or more home appliances, which are connected to the refrigerator via a target application.
[0059] This step can send a target request instruction to the target application, and the target application, in response to receiving the target request instruction, obtains the current status of each home appliance.
[0060] The target application is used to collect the current status of one or more home appliances and send the current status to the target server. After the refrigerator display screen sends a target request instruction to the target application, the target application responds to receiving the target request instruction by sending a current status acquisition request for each home appliance to the target server. After receiving the acquisition request, the target server sends the current status of the home appliance to the refrigerator display screen.
[0061] In another embodiment, the one or more preset associated devices include a mobile terminal, and the current state includes a state of accessing the target wireless local area network and a state of not accessing the wireless local area network; it can be obtained whether the mobile terminal is in the state of accessing the target wireless local area network.
[0062] It should be noted that the target wireless LAN can be the wireless LAN of the location where the refrigerator is located. For example, if the refrigerator is in the living room of user A's house, the target wireless LAN can be the LAN of user A's living room.
[0063] Step 1012: If it is determined that at least one of the preset associated devices is currently in a home state, the first home state information is generated.
[0064] In one possible implementation, for each household appliance, target attribute information of the current state of the household appliance can be obtained; if the target attribute information is determined to be a home state attribute, the current state of the household appliance is determined to be a home state; if the target attribute information is determined to be a non-home state attribute, the current state of the household appliance is determined to be a non-home state.
[0065] For example, when the household appliance is an air conditioner or an air purifier, if the current state is the operating state, meaning the target attribute information for the operating state is the "at home" state attribute, then the current state of the air conditioner or air purifier is determined to be the "at home" state. When the household appliance is a living room light, if the current state of the living room light is the "on" state, meaning the target attribute for the "on" state is the "at home" state attribute, then the current state of the living room light is determined to be the "at home" state. When the household appliance is a robotic vacuum cleaner, the robotic vacuum cleaner's states include sweeping, mopping, cleaning, charging, and off states. The target attribute information for the sweeping, mopping, and cleaning states can be the "at home" state attribute, while the target attribute information for the charging and off states can be the "not at home" state attribute. Therefore, if the current state of the robotic vacuum cleaner is determined to be sweeping, mopping, or cleaning, then the current state of the robotic vacuum cleaner is determined to be the "at home" state.
[0066] In another embodiment, the one or more preset associated devices include a mobile terminal, and the current state includes a state of accessing the target wireless local area network and a state of not accessing the wireless local area network; determining that the current state of at least one of the one or more preset associated devices belongs to the home state includes: if the current state of the mobile terminal is the state of accessing the target wireless local area network, determining that the current state of the mobile terminal belongs to the home state.
[0067] Specifically, if it is determined that the wireless local area network currently connected to by the mobile terminal is the target wireless local area network, then the current state of the mobile terminal is determined to be the state of accessing the target wireless local area network.
[0068] Step 1013: If it is determined that the current status of one or more preset associated devices is "away from home", the second home status information is generated. Steps 1011 to 1013 above can generate first home status information or second home status information based on the current status of one or more preset associated devices, and can provide reliable data basis for the refrigerator display screen to be on or off.
[0069] Optionally, Figure 3 It is based on Figure 1 The flowchart of another refrigerator display control method shown in the embodiment is as follows: Figure 3 As shown, Figure 1 The step 101 of obtaining the current home status information of the refrigerator user may further include: Step 1014: Obtain the appliance control mode set by the user in the target application.
[0070] The refrigerator is connected to a target application, which receives user-defined appliance control modes, including an away mode and a home mode.
[0071] Step 1015: If the appliance control mode is home mode, generate the first home status information.
[0072] Step 1016: If the appliance control mode is the away-from-home mode, generate the second home status information.
[0073] Steps 1014 to 1016 above can generate first home status information or second home status information based on the appliance control mode set by the user in the target application, and can provide reliable data basis for the refrigerator display screen to be on or off.
[0074] Figure 4 It is based on Figure 1 The flowchart of another refrigerator display control method shown in the embodiment is as follows: Figure 4 As shown, the refrigerator display control method may further include: Step 104: If it is determined that there is no target user within the first preset distance range of the refrigerator, the identity authentication interface is displayed when the user's touch operation is detected.
[0075] For example, if the target users of the refrigerator are family member A and family member B, and it is determined that family member A and family member B do not exist within the first preset distance range, but it is determined that the user's touch operation is collected, the identity authentication interface can be displayed.
[0076] Step 105: Obtain the identity authentication message entered by the user through the identity authentication interface.
[0077] The identity verification message is used to verify the user's identity and may include username, nickname, account, user password, PIN code, verification code, etc. It may also obtain the user's biometric information, such as fingerprint, iris, facial features, etc.
[0078] Step 106: If the identity verification is successful based on the identity authentication message, obtain the second pose information of the current user. If the current user is determined to be away from the refrigerator based on the second pose information, control the refrigerator display screen to turn off.
[0079] Specifically, if the authentication message is a user password, and the user's entered password matches the pre-set password, then authentication is successful. If the authentication message is the user's biometric information, and the user's first biometric information entered through the authentication interface matches the user's pre-set second biometric information, then authentication is successful.
[0080] Additionally, the second pose information can be the relative position information between the current user and the refrigerator, and the current user's facial orientation information; the facial orientation information includes facing the refrigerator and not facing the refrigerator. The process of obtaining this facial orientation information can involve inputting a captured facial image into a preset facial orientation recognition model to obtain the facial orientation information output by the model. This facial orientation recognition model can be a pre-trained neural network model. The training process of this model can include acquiring multiple image sample data, which includes labeled data indicating whether the face is facing or not facing the refrigerator. Using these multiple image sample data as training data, a preset initial model is trained to obtain the facial orientation recognition model.
[0081] It should be noted that when controlling the refrigerator display screen based on the second pose information, the following four implementation methods can be included: Method 1: If the distance between the current user and the refrigerator increases based on the multiple relative position information, the refrigerator display screen is turned off; Method 2: If the distance between the current user and the refrigerator decreases based on the multiple relative position information, and the facial orientation information indicates that the user is facing the refrigerator, the refrigerator display screen is turned on; Method 3: If the current user's facial orientation information indicates that the user is not facing the refrigerator, the refrigerator display screen is turned off; Method 4: If the distance between the current user and the refrigerator remains unchanged based on the multiple relative position information, the refrigerator display screen is turned off.
[0082] The above technical solution can obtain the user's authentication message through the authentication interface for users other than the pre-set target users. If the authentication is successful, the refrigerator display screen can be controlled according to the second pose information of the current user. This can effectively prevent the refrigerator display screen from automatically turning on for strangers, thereby effectively improving the privacy and security of the refrigerator display screen.
[0083] Figure 5This is a block diagram illustrating a refrigerator display control device according to an exemplary embodiment of this disclosure; as shown below. Figure 5 As shown, the refrigerator display screen control device may include: The first acquisition module 501 is configured to acquire the current home status information of the refrigerator user when the refrigerator display screen is in a screen-off state. The current home status information is either first home status information or second home status information. The first home status information is used to indicate that the user is at home, and the second home status information is used to indicate that the user is away from home. The first determining module 502 is configured to, when determining the current home status information as the first home status information, if it is determined that there is a target user within the first preset distance range of the refrigerator, obtain the first pose information of the target user. The control module 503 is configured to control the refrigerator display screen to light up based on the first pose information.
[0084] The above technical solution can detect whether a target user exists within a first preset distance range of the refrigerator when the user's current home state is determined to be the first home state, i.e., when the user is at home. This can effectively reduce the energy consumption of the refrigerator display screen. Furthermore, when a target user exists within the first preset distance range of the refrigerator, the refrigerator display screen can be controlled to light up based on the target user's first posture information. This not only effectively reduces the possibility of the display screen being triggered due to misjudgment, but also effectively improves the security and privacy of the refrigerator settings.
[0085] Optionally, the first acquisition module 501 is configured to: Get the current status of one or more preset associated devices; If it is determined that the current state of at least one of the preset associated devices is a home state, the first home state information is generated. If it is determined that the current status of one or more preset associated devices is "away from home", the second home status information is generated. Optionally, the one or more preset associated devices include one or more home appliances, which are connected to the refrigerator via a target application. The first acquisition module 501 is configured as follows: A target request instruction is sent to the target application, and the target application, in response to receiving the target request instruction, obtains the current status of each home appliance.
[0086] Optionally, the first acquisition module 501 is configured to: For each household appliance, obtain the target attribute information of the current state of the household appliance; If the target attribute information is determined to be a home status attribute, then the current status of the home appliance is determined to be a home status. If the target attribute information is determined to be an "out-of-home" status attribute, then the current status of the home appliance is determined to be an "away-from-home" status.
[0087] Optionally, the one or more preset associated devices include a mobile terminal, and the current state includes a state of accessing the target wireless local area network and a state of not accessing the wireless local area network; the first acquisition module is configured to: If the current state of the mobile terminal is connected to the target wireless local area network, it is determined that the current state of the mobile terminal is at home.
[0088] Optionally, the refrigerator is connected to a target application, which receives user-set appliance control modes, including an away mode and a home mode. The first acquisition module 501 is configured to: Obtain the appliance control mode set by the user in the target application; When the appliance control mode is home mode, the first home status information is generated; When the appliance control mode is set to "away mode", the second home status information is generated.
[0089] Optionally, the first determining module 502 is configured to: If a target mobile terminal is determined to exist within a first preset distance range, then a target user is determined to exist within the first preset distance range.
[0090] Optionally, the first pose information includes the relative position information of the target user and the refrigerator and the user's facial orientation information, and the first determining module 502 is configured to: According to the first preset sampling frequency, the relative position information between the target user and the refrigerator is obtained, so as to obtain multiple relative position information from multiple samplings; Acquire the user's facial image information according to the second preset sampling frequency; The facial orientation information of the target user is determined based on the facial image information.
[0091] Optionally, the facial orientation information includes facing the refrigerator and not facing the refrigerator, and the control module is configured to: If, based on the multiple relative position information, it is determined that the distance between the target user and the refrigerator is decreasing, and if the facial orientation information indicates that the user is facing the refrigerator, then the refrigerator display screen is controlled to turn on.
[0092] Optionally, the control module 503 is configured to: If, based on the multiple relative position information, it is determined that the distance between the target user and the refrigerator has decreased, and if it is determined that the face orientation information indicates that the user is not facing the refrigerator, then the refrigerator display screen is turned off.
[0093] Optionally, the control module 503 is further configured to: If the distance between the target user and the refrigerator increases or remains unchanged based on the multiple relative position information, the refrigerator display screen is turned off.
[0094] Optionally, the device further includes: The second determining module 504 is configured to display an identity authentication interface when it is determined that there is no target user within the first preset distance range of the refrigerator and the user's touch operation is collected. The second acquisition module 505 is configured to acquire the user-inputted authentication message through the authentication interface. The third determining module 506 is configured to, when the identity authentication is confirmed to be successful based on the identity authentication message, obtain the second pose information of the current user, and when the current user is determined to be away from the refrigerator based on the second pose information, control the refrigerator display screen to turn off.
[0095] The above technical solution can obtain the user's authentication message through the authentication interface for users other than the pre-set target users. If the authentication is successful, the refrigerator display screen can be controlled according to the second pose information of the current user. This can effectively prevent the refrigerator display screen from automatically turning on for strangers, thereby effectively improving the privacy and security of the refrigerator display screen.
[0096] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.
[0097] Another exemplary embodiment of this disclosure provides a refrigerator display control device, including: processor; Memory used to store processor-executable instructions; The processor is configured to implement the above. Figures 1 to 5 The steps of any of the methods described.
[0098] Another exemplary embodiment of this disclosure provides a computer-readable storage medium having a computer program stored thereon, characterized in that the computer program, when executed by a processor, implements the above... Figures 1 to 5 The steps of any of the methods described.
[0099] This disclosure also provides a computer-readable storage medium having computer program instructions stored thereon, which, when executed by a processor, implement the steps of the refrigerator display control method provided in this disclosure.
[0100] Some embodiments of this disclosure also provide a chip system, such as Figure 6 As shown, the chip system includes at least one processor 601 and at least one interface circuit 602. The processor 601 and the interface circuit 602 are interconnected via lines. For example, the interface circuit 602 can be used to receive signals from other devices (e.g., the memory of an electronic device). As another example, the interface circuit 602 can be used to send signals to other devices (e.g., the processor 601). Exemplarily, the interface circuit 602 can read instructions stored in memory and send those instructions to the processor 601. When the instructions are executed by the processor 601, the refrigerator display control device can perform the steps in the above embodiments. Of course, the chip system may also include other discrete components, and some embodiments of this disclosure do not specifically limit this.
[0101] In some embodiments of this disclosure, the interface circuit 602 can acquire data, program instructions, and / or information from the internal storage area of the chip system; it can also acquire data, program instructions, and / or information from outside the chip system.
[0102] Optionally, the chip system also includes a memory 603 for storing necessary computer programs and data.
[0103] Those skilled in the art will also understand that the various illustrative logical blocks and steps listed in the embodiments of this application can be implemented by electronic hardware, computer software, or a combination of both. Whether such functionality is implemented through hardware or software depends on the specific application and the overall system design requirements. Those skilled in the art can implement the described functionality using various methods for each specific application, but such implementation should not be construed as exceeding the scope of protection of the embodiments of this application.
[0104] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the appended claims.
[0105] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.
Claims
1. A method for controlling a refrigerator display screen, characterized in that, include: When the refrigerator display screen is off, the current home status information of the refrigerator user is obtained. The current home status information is either a first home status information or a second home status information. The first home status information is used to indicate that the user is at home, and the second home status information is used to indicate that the user is away from home. If the current home status information is determined to be the first home status information, and if a target user is determined to exist within the first preset distance range of the refrigerator, the first pose information of the target user is obtained; The refrigerator display screen is controlled to light up based on the first pose information.
2. The method according to claim 1, characterized in that, The process of obtaining the current home status information of the refrigerator user includes: Get the current status of one or more preset associated devices; If it is determined that the current state of at least one of the preset associated devices is a home state, the first home state information is generated. If it is determined that the current status of one or more preset associated devices is "away from home", the second home status information is generated.
3. The method according to claim 2, characterized in that, The one or more preset associated devices include one or more home appliances, which are connected to the refrigerator via a target application. The step of obtaining the current status of one or more preset associated devices includes: A target request instruction is sent to the target application, and the target application, in response to receiving the target request instruction, obtains the current status of each home appliance.
4. The method according to claim 3, characterized in that, Determining that at least one of the preset associated devices is currently in a home state includes: For each household appliance, obtain the target attribute information of the current state of the household appliance; If the target attribute information is determined to be a home status attribute, then the current status of the home appliance is determined to be a home status. If the target attribute information is determined to be an "out-of-home" status attribute, then the current status of the home appliance is determined to be an "away-from-home" status.
5. The method according to claim 2, characterized in that, The one or more preset associated devices include a mobile terminal, and the current state includes a state of accessing the target wireless local area network and a state of not accessing the wireless local area network; Determining that at least one of the preset associated devices is currently in a home state includes: If the current state of the mobile terminal is connected to the target wireless local area network, it is determined that the current state of the mobile terminal is at home.
6. The method according to claim 1, characterized in that, The refrigerator is connected to a target application, which receives user-set appliance control modes, including an away mode and a home mode, and obtains the user's current home status information, including: Obtain the appliance control mode set by the user in the target application; When the appliance control mode is home mode, the first home status information is generated; When the appliance control mode is set to "away mode", the second home status information is generated.
7. The method according to claim 1, characterized in that, Determine that a target user exists within a first preset distance range of the refrigerator, including: If a target mobile terminal is determined to exist within a first preset distance range, then a target user is determined to exist within the first preset distance range.
8. The method according to claim 1, characterized in that, The first pose information includes the relative position information of the target user and the refrigerator and the user's facial orientation information. Obtaining the first pose information of the target user includes: According to the first preset sampling frequency, the relative position information between the target user and the refrigerator is obtained, so as to obtain multiple relative position information from multiple samplings; Acquire the user's facial image information according to the second preset sampling frequency; The facial orientation information of the target user is determined based on the facial image information.
9. The method according to claim 8, characterized in that, The facial orientation information includes facing the refrigerator and not facing the refrigerator. Controlling the refrigerator display screen to light up based on the first pose information includes: If, based on the multiple relative position information, it is determined that the distance between the target user and the refrigerator is decreasing, and if the facial orientation information indicates that the user is facing the refrigerator, then the refrigerator display screen is controlled to turn on.
10. The method according to claim 9, characterized in that, The step of controlling the refrigerator display screen to turn on based on the first pose information includes: If, based on the multiple relative position information, it is determined that the distance between the target user and the refrigerator has decreased, and if it is determined that the face orientation information indicates that the user is not facing the refrigerator, then the refrigerator display screen is turned off.
11. The method according to claim 8, characterized in that, The step of controlling the refrigerator display screen to turn on based on the first pose information further includes: If the distance between the target user and the refrigerator increases or remains unchanged based on the multiple relative position information, the refrigerator display screen is turned off.
12. The method according to claim 1, characterized in that, The method further includes: If it is determined that there is no target user within the first preset distance range of the refrigerator, an identity authentication interface is displayed when the user's touch operation is detected. Obtain the user's authentication message through the authentication interface; If the identity verification is successful based on the identity verification message, the second pose information of the current user is obtained. If the current user is determined to be away from the refrigerator based on the second pose information, the refrigerator display screen is turned off.
13. A refrigerator display screen control device, characterized in that, include: The first acquisition module is configured to acquire the current home status information of the refrigerator user when the refrigerator display screen is in an off state. The current home status information is either first home status information or second home status information. The first home status information is used to indicate that the user is at home, and the second home status information is used to indicate that the user is away from home. The first determining module is configured to, when determining that the current home status information is the first home status information, if it is determined that there is a target user within the first preset distance range of the refrigerator, obtain the first pose information of the target user; The control module is configured to control the refrigerator display screen to light up based on the first pose information.
14. A refrigerator display screen control device, characterized in that, include: processor; Memory used to store processor-executable instructions; The processor is configured to implement the steps of the method according to any one of claims 1 to 12.
15. A computer-readable storage medium having a computer program stored thereon, characterized in that, When executed by a processor, the computer program implements the steps of the method described in any one of claims 1 to 12.
16. A computer program product, characterized in that, It includes a computer program that, when executed by a processor, implements the steps of the method according to any one of claims 1 to 12.