Display device and interface display method

Abstract

The application discloses a display device and an interface display method. An input food material search instruction is received, and the food material search instruction carries a search word. The search word is matched with food materials in a food material library. If there is a target food material matching the search word in the food material library, a search result interface containing a food material icon of the target food material is displayed. If there is no target food material matching the search word in the food material library, a search result interface containing a custom food material adding control is displayed. The custom food material adding control is used to trigger a jump to a custom food material adding interface, and the custom food material adding interface is used to receive a custom food material input by a user.

Description

[0001] The present application claims priority to Chinese Patent Application No. 202011216565.5, filed on November 4, 2020, Chinese Patent Application No. 202110560982.X, filed on May 19, 2021, and Chinese Patent Application No. 202110418427.3, filed on April 19, 2021, all of which are incorporated by reference in their entirety. TECHNICAL FIELD

[0002] The present application relates to the technical field of refrigerators, and in particular to a display device and an interface display method. BACKGROUND

[0003] Currently, a household member generally obtains food materials in a refrigerator by opening a refrigerator door and visually obtaining the food materials.

[0004] To improve user experience, a radio frequency identification (RFID) device or a camera can be configured for the refrigerator, so that a user can obtain the food materials without opening the refrigerator door, through a display on the refrigerator. SUMMARY

[0005] The display device and the interface display method provided by the present application solve the problem of complicated operation in the process of user-defined food material information.

[0006] In a first aspect, the present application provides a display device, comprising:

[0007] a display configured to display a user interface;

[0008] a controller connected to the display and configured to:

[0009] receive an input food material search instruction, the food material search instruction carrying a search term;

[0010] match the search term with food materials in a food material library;

[0011] if the food material library contains a target food material matching the search term, display a search result interface containing a food material icon of the target food material;

[0012] if the food material library does not contain a target food material matching the search term, display a search result interface containing a custom food material adding control, the custom food material adding control being configured to trigger a jump to a custom food material adding interface, the custom food material adding interface being configured to receive a user input custom food material.

[0013] In a second aspect, the present application provides an interface display method, comprising:

[0014] receiving an inputted food material search instruction, the food material search instruction carrying a search word;

[0015] matching the search word with food materials in a food material library;

[0016] if there is a target food material matching the search word in the food material library, displaying a search result interface containing a food material icon of the target food material on the display;

[0017] if there is no target food material matching the search word in the food material library, displaying a search result interface containing a custom food material adding control on the display, the custom food material adding control being used to trigger a jump to a custom food material adding interface, the custom food material adding interface being used to receive a user inputted custom food material. BRIEF DESCRIPTION OF DRAWINGS

[0018] In order to more clearly illustrate the technical solutions of the present application, the drawings needed in the embodiments will be briefly introduced as follows. Obviously, for those skilled in the art, other drawings can also be obtained without creative labor based on these drawings.

[0019] Figure 1 a An interactive scenario of a display device according to an exemplary embodiment of the present application;

[0020] Figure 1 b A perspective view of a refrigerator according to an exemplary embodiment of the present application;

[0021] Figure 1 c A schematic view of an appearance of a refrigerator according to an exemplary embodiment of the present application;

[0022] Figure 2 A schematic view of a hardware configuration of a refrigerator according to an exemplary embodiment of the present application;

[0023] Figure 3 A food material management interface according to an exemplary embodiment of the present application;

[0024] Figure 4 A food material library interface according to an exemplary embodiment of the present application;

[0025] Figure 5 Another food material library interface according to an exemplary embodiment of the present application;

[0026] Figure 6 Another food material library interface according to an exemplary embodiment of the present application;

[0027] Figure 7 A custom food material adding interface according to an exemplary embodiment of the present application;

[0028] Figure 8 A food material information confirmation interface according to an exemplary embodiment of the present application;

[0029] Figure 9 Another food material library interface according to an exemplary embodiment of the present application;

[0030] Figure 10 A search interface according to an exemplary embodiment of the present application;

[0031] Figure 11 A search result interface according to an exemplary embodiment of the present application;

[0032] Figure 12 Another search result interface according to an exemplary embodiment of the present application;

[0033] Figure 13 Another search result interface according to an exemplary embodiment of the present application;

[0034] Figure 14 A custom food material adding interface according to an exemplary embodiment of the present application;

[0035] Figure 15 A flow chart of an interface display method according to an exemplary embodiment of the present application;

[0036] Figure 16 A food material management interface according to an exemplary embodiment of the present application;

[0037] Figure 17 Another food material management interface according to an exemplary embodiment of the present application;

[0038] Figure 18 A flow chart of a food material icon display method according to an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0039] In order to enable persons skilled in the art to better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by persons skilled in the art without creative work should fall within the protection scope of the present application.

[0040] In the description of the present application, it needs to be understood that the terms "center", "upper", "lower", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer" and the like indicate the orientation or positional relationship based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the devices or elements referred to must have a particular orientation, be constructed and operated in a particular orientation, and therefore cannot be understood as a limitation of the present application.

[0041] The terms "first", "second" are only for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the technical features indicated. Therefore, the features defined with "first", "second" can explicitly or implicitly include one or more of the features. In the description of the present application, unless otherwise specified, the meaning of "a plurality of" is two or more.

[0042] In the description of the present application, it needs to be noted that, unless otherwise explicitly specified and limited, the terms "mounting", "connecting", "connecting" should be understood broadly, for example, it can be fixed connection, or detachable connection, or integral connection; it can be directly connected, or indirectly connected through intermediate medium, or the communication inside two elements. For those skilled in the art, the specific meaning of the above terms in the present application can be understood according to the specific circumstances.

[0043] At present, the way for family members to obtain food materials in the refrigerator is generally through opening the refrigerator door and obtaining visually with the naked eye.

[0044] In order to improve the user experience, a radio frequency identification (RFID) device or a built-in camera can be configured for the refrigerator, so that the user can obtain without opening the refrigerator door through a display on the refrigerator. The display can be touchable or voice controllable.

[0045] At present, the interconnection of smart home appliances is a hot research problem, and people hope to control home appliances before returning home, or control the refrigerator, air conditioner and the like in the living room.

[0046] The food material editing provided in the present application can be executed on a refrigerator with a display, or on other home appliances, handheld devices.

[0047] Figure 1 a The present application provides a display device operation scene according to an embodiment.

[0048] In some embodiments, the display device can be any home or office device with a display or a monitor, such as a mobile terminal, tablet computer, computer, laptop computer, television, refrigerator, electronic whiteboard, oven, washing machine, videophone, mirror, etc., which can serve as a carrier for displaying a UI interface to a user. All of the above devices are considered display devices under this application and are not limited to any specific type. Figure 1 a The TV 200A, refrigerator 200B, and oven 200C are shown.

[0049] In some embodiments, the display device 200 also communicates with the server 100. The display device 200 may be allowed to communicate via a local area network (LAN), wireless local area network (WLAN), and other networks. The server 100 may provide various content and interactive features to the display device 200. The server 100 may be a cluster or multiple clusters, and may include one or more types of servers.

[0050] In some embodiments, the display device can also synchronize and communicate with other display devices. The display device 200 can interact with other devices via a local area network (LAN) or a wireless local area network (WLAN). Interoperability can be achieved through devices within the same LAN; when one display device updates its data, other devices also update accordingly. Alternatively, through account management, when a display device logs in to other devices with the same account, it can communicate with other devices logged in under the same account.

[0051] In some embodiments, the display device may use a smart device such as a mobile phone or tablet, or a control device, to receive instructions, or may receive user control through touch or gestures.

[0052] In some embodiments, the display device 200 can also be controlled in ways other than controlling the device itself. For example, it can be controlled by receiving user voice commands directly through a module configured inside the display device 200 for acquiring voice commands, or it can be controlled by receiving user voice commands through a voice control device set outside the display device 200.

[0053] The following example, using a refrigerator, provides a illustrative illustration.

[0054] Figure 1 b This is a perspective view of a refrigerator according to an exemplary embodiment of the present application. The refrigerator provided in this embodiment of the invention has an approximate cuboid shape. The appearance of the refrigerator is defined by a storage compartment 101 providing limited storage space and a plurality of doors 200 disposed at the opening of the storage compartment 101. The storage compartment 101 is a box 100 with an opening, in Figure 1 bIn the illustrated example, the storage compartment 101 includes a lower freezer compartment 101A and an upper refrigeration compartment 101B, each having one or more separate storage spaces.

[0055] In some embodiments, the freezer compartment 101A is selectively covered by a drawer-type freezer compartment door 200A. The refrigeration compartment 101B is divided into left and right sides. The refrigeration compartment 101B is selectively opened or closed by a refrigeration compartment door 200B pivotably mounted on the refrigeration compartment 101B.

[0056] Figure 1 c As shown in the refrigerator appearance diagram according to the exemplary embodiments of the present application, the refrigerator 200 can include a display 210, a controller 220, a memory 250, and a plurality of user input interfaces. Figure 1 b As shown, a display is provided on the refrigeration compartment door 200B, which is embedded in the door body. In some embodiments, the screen plane of the display is flush with the outer surface of the door.

[0057] As shown in the refrigerator appearance diagram according to the exemplary embodiments of the present application, the refrigerator 200 can include a display 210, a controller 220, a memory 250, and a plurality of user input interfaces. Figure 1 b Figure 1 c As shown in the refrigerator appearance diagram according to the exemplary embodiments of the present application, the refrigerator 200 can include a display 210, a controller 220, a memory 250, and a plurality of user input interfaces.

[0058] Figure 2 As shown in the refrigerator hardware configuration diagram according to the exemplary embodiments of the present application, the refrigerator 200 can include a display 210, a controller 220, a memory 250, and a plurality of user input interfaces.

[0059] In some exemplary embodiments, the refrigerator 200 can further include at least one RFID detection module 230 and a detector 240. The display 210, the RFID detection module 230, the detector 240, and the memory 250 are coupled to the controller 220 through a communication interface. The display 210 is configured to receive image signals output by the controller 220, display video content and image, and display a menu control interface.

[0060] The controller 220 can include one or more processing units, such as a system on a chip (SoC), a central processing unit (CPU), a microcontroller (MCU), a memory controller, etc. Different processing units can be independent devices or integrated into one or more processors.

[0061] ​The memory 250 can include one or more memory units, for example, can include volatile memory such as dynamic random access memory (DRAM), static random access memory (SRAM), etc., and can also include non-volatile memory such as read-only memory (ROM), flash memory, etc. Different memory units can be independent devices, or can be integrated or packaged in one or more processors or communication interfaces to become part of the processor or communication interface.

[0062] The memory 250 stores program instructions and application programs such as a voice application. The controller 220 can call the program instructions or run the application programs in the memory 250 to make the refrigerator perform related methods, for example, the food material information editing method provided by the embodiments of the present application.

[0063] The detector 240 at least includes a sound collector such as a microphone, which can be used to receive the sound of the user. For example, a voice signal including a control instruction of the user to control the refrigerator 200.

[0064] The user input interface includes at least one of a microphone, a touchpad, a sensor, a key, and other input interfaces. For example, the user can realize the user instruction input function through voice, touch, gesture, pressing, etc. The input interface converts the received analog signal into a digital signal, and converts the digital signal into a corresponding instruction signal, and sends it to the refrigerator 200.

[0065] In some embodiments, the controller 220 can include a voice recognition module, which further includes a voice analysis unit and a voice instruction database, so that the refrigerator can independently complete the voice recognition of the voice data input by the user, and the process of matching the recognized voice content with the voice instructions in the voice instruction database.

[0066] The RFID detection module 230 can be arranged in each storage compartment, for emitting a wireless signal in the corresponding storage compartment and receiving the signal of the RFID tag in the storage compartment, to obtain the food material code of the RFID tag.

[0067] In some embodiments, the refrigerator further comprises a tag reading area arranged outside the storage compartment, i.e. an induction area for identifying the RFID tag, and an RFID detection module arranged at the tag reading area for detecting the RFID tag placed at the area. Optionally, the tag reading area can be arranged below the display, so that the user can place (or take away) the RFID tag at the tag reading area and operate the user interface displayed on the display at the same time.

[0068] In some embodiments, the refrigerator can further comprise an RFID processing module connected with each RFID detection module respectively, for controlling the RFID detection module to emit wireless signals and receive the signals of the RFID tag fed back by the RFID detection module.

[0069] In some embodiments, the RFID detection module can be specifically an antenna. The power of the antenna arranged in different storage compartments can be different. Moreover, the power of the antenna of each storage compartment can ensure that the antenna can identify the food materials included in the own compartment, so as to avoid that the power is too large to increase the misidentification rate, and the power is too small to identify all the food materials in the own compartment. In a specific implementation, the power of the antenna can be determined in advance according to the space size of each storage compartment, and the power of each antenna can be arranged in the refrigerator. The larger the space is, the larger the power is.

[0070] In order to realize the intelligent management of the food materials, the RFID tag is used to identify the food materials in the storage compartment.

[0071] In some embodiments, the virtual association between the RFID tag and the food material information is realized by establishing the corresponding relationship between the RFID tag and the food material information. The use flexibility of the RFID tag can be improved by modifying the corresponding relationship between the RFID tag and the food material information, so that the same RFID tag corresponds to different food material information in sequence. For example, the corresponding relationship between the identification information of the RFID tag and the food material information is established to realize the virtual association between the RFID tag and the food material. The identification information of the RFID tag can be the tag code of the RFID tag recognized by the RFID detection module 230, or can be a code segment in the tag code. In these embodiments, the controller 220 can determine the food material information corresponding to each RFID tag according to the identification information of each RFID tag and the pre-established corresponding relationship.

[0072] For example, the pre-established corresponding relationship between the identification information of the RFID tag and the food material information can be as shown in the following table:

[0073] RFID Foodstuff information Identification 1 Apple Identification 2 Cucumber Identification 3 Pork …… ……

[0074] After the correspondence between the RFID tags and the food information is established, the controller 220 acquires the tag code of the RFID tag by detecting the signal of the RFID tag, and determines the food information associated with each tag according to the tag code.

[0075] In some embodiments, the food information associated with each tag is associated with a storage compartment, and the storage position of the food can be determined according to the storage compartment associated with the food information, for example, the food information "apple" is associated with the "cold storage compartment", and it can be determined that the apple is stored in the cold storage compartment.

[0076] In some embodiments, the food management interface is displayed on the display 210, and the user manages the food in the refrigerator by operating the food management interface. For example, the corresponding food control / icon is drawn in the food management interface according to the food information associated with each RFID tag in the storage compartment, so that the food in the refrigerator is displayed in the form of icons, graphics, etc. In addition, function controls such as RFID tag identification control, food addition control, etc. can also be drawn in the food management interface for the user to operate to trigger the controller 220 to implement the corresponding functions.

[0077] In some embodiments, the food management interface can include a plurality of food display areas, and one food display area can correspond to one storage compartment. The food information associated with each storage compartment is displayed in the food display area corresponding to the storage compartment, that is, the food in the refrigerator is displayed in the food management interface. For example, the food information associated with the cold storage compartment is displayed in the food display area corresponding to the cold storage compartment. The food information displayed in the food management interface includes but is not limited to food icons, food names, and food freshness identifiers. The food icons can be generated according to the pictographic pictures of the food, and the food freshness identifiers are used to show any one or more of the put-in time of the food, the remaining time to expiration, and the expiration time of the food. It should be understood that the food name and the food freshness identifier can be part of the food icon, that is, included in the food icon.

[0078] Figure 3 A user interface according to an exemplary embodiment of the present application is shown, which is specifically an exemplary food management interface. Referring to Figure 3The food management interface includes a label editing control 301, a recommended recipe control 302, an add food control 306, and partitions corresponding to respective storage compartments, such as a partition 303 corresponding to a refrigeration compartment, a partition 304 corresponding to a variable-temperature compartment, and a partition 305 corresponding to a cold-temperature compartment. Each partition displays food icons of respective foods in the corresponding storage compartment, such as food 1, food 2, food 3, food 4, and food 5 in the partition 303, food icons 6-11 in the partition 304, and food icons 12 and 13 in the partition 305. In addition, each partition has a scroll bar that can be scrolled up or down, such as a scroll bar 3030 in the partition 303, a scroll bar 3040 in the partition 304, and a scroll bar 3050 in the partition 305. A user can operate the scroll bar to scroll the view displayed in the partition up or down to display food icons that are not all shown on the user interface.

[0079] Continuing to refer to Figure 3 Each food icon includes a food picture, a food name, and a freshness identifier of the food. Taking food 3

[3031] as an example, it includes a food picture 30311, a food name "food 1" (30312), and a freshness identifier 30313. Notably, in the food management interface 300, Figure 3 Because food 1 has expired, a stamp identifier with the word "expired" is displayed on the food picture as the freshness identifier of food 1, so that the user can quickly notice the expired food in the refrigerator.

[0080] In some embodiments, when the food has less than a preset number of days remaining before expiration, the specific number of days remaining is explicitly shown by the freshness identifier. For example, in the food management interface 300 shown in Figure 3 Because food 6

[3041] has less than a preset number of days remaining before expiration, the freshness identifier [304111] of food 4 includes a text prompt "2 days remaining", so that the user can quickly obtain the number of days remaining for the food that will expire soon.

[0081] In a specific implementation, the food management interface can be an interface of a food management related application run by the controller 220, and the user can trigger the display of the food management interface on the food management related application. When the food management related application receives a user operation that triggers the display of the food management interface, it reads a set of food information from the memory and displays corresponding food icons in the food management interface according to the food information in the set of food information. The set of food information is a set composed of food information corresponding to all RFID tags in the current storage compartment.

[0082] In some embodiments, the tag code of an RFID tag can include one or more code segments.

[0083] In some embodiments, the tag code of the RFID tag includes a plurality of code segments in accordance with a preset composition rule, and the controller obtains the unique identification of the tag, i.e., the tag identification, by intercepting the code segment corresponding to the tag identification according to the preset composition rule after obtaining the tag code. Taking one code segment in the tag code as the tag identification of the RFID tag can shorten the identification length and thus improve the efficiency of the identification comparison process.

[0084] In some embodiments, the RFID tag can be divided into a custom tag and a predefined tag, where the custom tag refers to a tag whose associated food material name can be customized by a user, and the predefined tag refers to a tag whose associated food material name cannot be customized by a user. The custom tag and the predefined tag can be distinguished according to the tag code.

[0085] In some embodiments, the tag code of the RFID tag includes at least two code segments, i.e., a first code segment and a second code segment. The first code segment is used to write a first code, which can be a predetermined code or a non-predetermined code. For the RFID tag whose first code is a predetermined code, the corresponding food material information can be customized by a user, i.e., it is a custom tag. For the RFID tag whose first code is a non-predetermined code, the corresponding preset food material information is pre-stored in a cloud server or a local food material library and cannot be customized by a user, i.e., it is a predefined tag. The second code segment is used to write a second code, which is the unique identification information of the RFID tag. It should be noted that the user-defined food material name means that the user can associate any food material name with the RFID tag according to the demand, and the user can also change the defined tag according to the change of the demand, so that the same tag is associated with different food material names before and after the change. The user cannot define the food material name means that the user cannot change the food material name associated with the RFID tag, and the food material name associated with the RFID tag is pre-defined and stored in the cloud server or the local food material library.

[0086] When a given RFID tag is given, whether the tag is a predefined tag or a custom tag can be determined according to the first code included in the tag code. If the first code is a predetermined code, the tag is a custom tag, and if the first code is not a predetermined code, the tag is a predefined tag. In some embodiments, the tag code of the RFID tag includes at least two code segments in accordance with a preset composition rule, and the controller obtains the first code and / or the second code by intercepting the first code segment and / or the second code segment according to the preset composition rule after obtaining the tag code, thereby saving the process of analyzing long code information and improving the processing efficiency.

[0087] In some embodiments, the predetermined encoding has uniqueness, such as 00; the non-predetermined encoding does not have uniqueness, and there can be multiple non-predetermined encodings, one non-predetermined encoding corresponding to one food material information.

[0088] For example, the tag encoding structure of an RFID tag is as follows:

[0089]

[0090]

[0091] For example, if the controller obtains the tag encoding of the RFID tag as "01123456789012345678901234", according to the preset composition rule, the first encoding is "01", and the second encoding is "123456789012345678901234".

[0092] It should be noted that according to different requirements, the tag encoding of the RFID tag can further include more code segments, such as a third code segment for writing the manufacturer identification of the RFID tag, and a fourth code segment for being used as a reserved bit of the tag encoding to improve the scalability of the RFID tag. In some other embodiments, the manufacturer identification of the RFID tag can also be included in the second code segment, which is not described herein.

[0093] For example, the correspondence between the first encoding (non-predetermined encoding) and the food material information can be as shown in the following table:

[0094] RFID first code Foodstuff name 01 Radish 02 Carrot 03 Lotus root …… ……

[0095] In some embodiments, when the food material management interface is displayed on the display, the user can input an instruction indicating food material information editing by operating the food material management interface, for example, the user clicks the food material information editing control provided by the food material management interface to indicate food material information editing; when the controller receives the instruction, it starts to detect the signal of the RFID tag placed on the tag reading area to obtain the identification information of the RFID tag, and displays an interface for editing the food material information associated with the RFID tag, that is, a food material editing interface, in which the food material information associated with the RFID tag is input.

[0096] In some embodiments, the identification information of the RFID tag obtained can also be displayed in the food material editing interface, so that the user can directly see the identification information of the RFID tag, and the user does not need to manually input the identification information, thereby improving the user experience.

[0097] In some embodiments, the food ingredient editing interface displays at least one food ingredient editing item. Each food ingredient editing item includes an item name and item content, where the item content is the part to be edited. Users can input the item content of each food ingredient editing item at the input location, and input the food ingredient information used to associate with the RFID tag. After input, the controller saves the input food ingredient information and the corresponding identification information, thereby completing and perfecting the correspondence table between the RFID tag's identification information and the food ingredient information.

[0098] In some embodiments, the interface for editing ingredient information can be called an ingredient editing interface. The ingredient editing items displayed on this interface may include ingredient name editing items, ingredient shelf-life editing items, ingredient quantity editing items, and so on. It should be understood that the item name for the ingredient name editing item can be "Label Name," and the item content is the ingredient name to be entered or updated. The item name for the ingredient shelf-life editing item can be "Shelf-Life," and the item content is the shelf-life to be entered or updated. The item name for the ingredient quantity editing item can be "Quantity," and the item content is the quantity to be selected or changed.

[0099] like Figure 3 As shown, users can click the RFID tag editing control on this interface to input instructions for editing ingredient information. In response to this instruction, the controller activates the RFID detection module to detect signals from the RFID tags in the tag reading area to obtain their identification information. After the controller obtains the RFID tag's identification information, the ingredient editing interface is displayed on the screen.

[0100] In some embodiments, when the controller receives a user's instruction to edit ingredient information, it displays a label scanning interface in response to the instruction. The interface includes a scanning prompt, which instructs the user to place the RFID tag to be edited on the label reading area. Simultaneously, the controller controls the RFID detection module to begin detecting the signal from the RFID tag on the label reading area to obtain its identification information. After the controller obtains the RFID tag's identification information, it displays the ingredient editing interface on the screen.

[0101] In some embodiments, users can also instruct on editing ingredient information by speaking a preset voice command. For example, the user might say, "Label edit." When the system receives the user's voice input and recognizes the content as "Label edit," it confirms that the preset voice command for triggering the editing of the ingredient information corresponding to the RFID tag has been received. At this point, the controller responds to the command, displays the tag scanning interface, and begins detecting RFID tags on the tag reading area.

[0102] In some embodiments, when the preset voice instruction is received, it is first determined whether an RFID tag on the tag reading area is detected. If no RFID tag on the tag reading area is detected, it indicates that the user has not placed the RFID tag to be edited on the tag reading area. At this time, the tag scanning interface including the scanning prompt is displayed to prompt the user to place the RFID tag to be edited on the tag reading area.

[0103] In some embodiments, the instruction for indicating the editing of the food material information is also referred to as an RFID tag editing instruction.

[0104] In some embodiments, the database includes a food material library. The food material library includes a large amount of food material information, such as preset food material information corresponding to each predefined tag and food material information associated with each custom tag. Each food material information is associated with a storage room. In addition, the preset food material information corresponding to each predefined tag is also associated with the tag code of the predefined tag, so that the corresponding preset food material information can be found in the food material library according to the tag code of the predefined tag. The food material information corresponding to each custom tag is also associated with the tag code of the custom tag, so that the associated food material information can be found in the food material library according to the tag code of the custom tag.

[0105] In some embodiments, the user can also define food material information that does not exist in the cloud server to expand the food material library.

[0106] In some embodiments, the preset food material information in the food material library can be classified and saved in the food material library. For example, the food material information of fruit food materials is saved in a fruit food material set, the food material information of vegetable food materials is saved in another vegetable food material set, and the food material information defined by the user is saved in a custom food material set. All food material information in the food material library constitutes a food material set. Various types of food material information are classified and displayed in the food material library. For example, operation controls corresponding to each food material category can be set in the food material library interface. When the user clicks the fruit control, the food material icons corresponding to each food material information in the fruit food material set are displayed. When the user clicks the vegetable control, the food material icons corresponding to each food material information in the vegetable food material set are displayed. When the user clicks the custom food material control, the food material icons corresponding to each food material information in the custom food material set are displayed.

[0107] In some embodiments, the food material library is intuitively displayed to the user by displaying the food material icons corresponding to part or all of the food material information in the food material library in the user interface, which facilitates the user to view.

[0108] Figure 4 A food material library interface is shown in some exemplary embodiments of the present application. As Figure 4As shown, the food material library interface includes a label switching bar 410 and a content area 420. The label switching bar 410 includes a plurality of label controls, namely, “all” 411, “fruit” 412, “vegetable” 413, “meat” 414, “drink” 415, “seafood” 416, “other” 417, and “custom food material” 418. The focus is on the “all” 411, i.e., the “all” 411 is in the selected state, and therefore the content area 420 displays the food material icons corresponding to “all”. It should be understood that when the label control “all” 411 is selected, the content area displays all the selectable food material icons in the food material library. These food material icons can be displayed in categories or not.

[0109] Figure 5 Another food material library interface shown in some example embodiments of the present application is the food material library interface displayed when the label control “fruit” is in the selected state. As shown in Figure 5 As shown, the label control “fruit” is in the selected state, and the content area displays a plurality of food material icons of fruits, namely, “apple”, “orange”, “banana”, “watermelon”, “mango”, “durian”, “honey peach”, “pineapple”, and so on.

[0110] Figure 6 Another food material library interface shown in some example embodiments of the present application is the food material library interface displayed when the label control “custom food material” is in the selected state. As shown in Figure 6 As shown, the label control “custom food material” is in the selected state, and the content area displays a plurality of custom food material icons, namely, “ Wahaha”, “salted duck egg”, “exploding liver”, and “chili sauce”. In addition, the food material library interface corresponding to the label control “custom food material” also displays a custom food material adding control “+ add custom food material”. The user can input a custom food material adding instruction by clicking the custom food material adding control, and the food material management application will display a custom food material adding interface in response to the input custom food material adding instruction. In the custom food material adding interface, the user can input the food material information of a new custom food material.

[0111] In Figure 4 to Figure 6 As shown in the food material library interface, a return control “<” is also displayed. The user can control to return to the food material management interface by operating the return control.

[0112] Figure 7 The custom food material adding interface shown in some example embodiments of the present application is a custom food material adding box displayed on the food material library interface when the label control “custom food material” is selected. As shown in Figure 7As shown, the custom food material adding box includes a plurality of definition items, such as a food material name definition item 701, a shelf life definition item 702, and a storage location definition item 703. Each definition item corresponds to at least one input position or operation position. The user can input corresponding information at the input position, such as inputting “duck neck” at the input position corresponding to the food material name, inputting “2” at the input position corresponding to the shelf life, and clicking the operation position in front of “refrigerator” from the three operation positions corresponding to the storage location to select “refrigerator”. After the input is completed, the user can click the “confirm” control 704 in the interface to submit the input information. The food material management application receives the operation of the user on the “confirm” control 704, and saves the food material information of the custom food material “duck neck” input by the user in the food material library. The user can click the “cancel” control 705 in the interface to cancel the adding operation.

[0113] In some embodiments, the user can select the food material icon in the food material library interface through a single-point or long-press operation.

[0114] In some embodiments, the food material management application displays a food material information confirmation box on the current food material library interface in response to the user's selection operation on the food material icon in the food material library interface. The food material information corresponding to the food material icon is displayed in the food material information confirmation box. On the one hand, the user can view the food material information corresponding to the food material icon through the food material information confirmation box. On the other hand, the user can modify the food material information corresponding to the food material icon in the food material information confirmation box.

[0115] Figure 8 In some example embodiments, a food material library interface is shown in the present application. Specifically, the user clicks the “apple” in the food material library interface. Figure 5 As shown, the interface displayed after the user clicks “apple” in the food material library interface. As shown, Figure 8 As shown, the food material information confirmation box 810 is displayed on the food material library interface. The food material information corresponding to the food material icon “apple”, the “confirm adding” control, and the “cancel adding” control are displayed in the food material information confirmation box 810. The user can delete one or more food material information displayed in the food material information confirmation box 810 and input new food material information to modify the food material information. When the user clicks the “confirm adding” control, the food material management application adds the food material information currently displayed in the food material information confirmation box 810 to the local food material information set and marks the storage state in response to the user operation, and simultaneously cancels the display of the food material information confirmation box 810. The food material information currently displayed in the food material information confirmation box 810 includes the initially displayed information and / or the information modified by the user. When the user clicks the “cancel adding” control, the food material management application cancels the display of the food material information confirmation box 810 in response to the user operation.

[0116] In other embodiments, the food management application, in response to a user's selection of a food icon in the food library interface, directly adds the food information corresponding to the selected food icon to the local food information collection and marks it as stored, without displaying it as such. Figure 8 The ingredient information confirmation box is shown in the image.

[0117] In conjunction with the above embodiments, in some other embodiments, the ingredient library interface further includes a search bar, which comprises a search term input box and a search control. Users can enter search terms, such as ingredient names, in the search term input box. After entering the search term, users can click the search control to input an ingredient search command carrying the search term. This ingredient search command instructs the ingredient management application to search the ingredient library for ingredients that match the entered search term and display the ingredient icons of the matched ingredients. This eliminates the need for users to browse through a large number of available ingredient icons to find the desired ingredient, saving user time and improving the user experience.

[0118] The food ingredient management application responds to input food ingredient search commands by matching the search terms with ingredients in the ingredient library. If a target ingredient matching the search terms exists in the library, a search results interface containing the target ingredient's icon is displayed. If no target ingredient matching the search terms exists in the library, a custom ingredient addition control pops up. This custom ingredient addition control triggers a jump to a custom ingredient addition interface, which receives custom ingredients input by the user.

[0119] Compared to traditional ingredient search methods, this ingredient management application integrates ingredient search and custom ingredient addition functions. If a target ingredient matching the search term exists in the ingredient library, the search results interface directly displays the ingredient icon containing the target ingredient. If no target ingredient matching the search term exists in the ingredient library, besides indicating that no corresponding ingredient is found, the user does not need to exit the ingredient search interface and then enter the custom ingredient addition interface. Instead, when no target ingredient matching the search term exists in the ingredient library, a custom ingredient addition control can be directly popped up on the interface, guiding the user to add the unsearched ingredient to the ingredient library.

[0120] Figure 9 This is another food ingredient database interface shown in some exemplary embodiments of this application. For example... Figure 9 As shown, in Figure 4On the basis of the illustrated food material library interface, a search bar 910 is displayed above the label switching bar in the food material library interface, including a search word input box 911 and a search control 912. In some implementations, the user activates the starting input position by clicking the search word input box, and the food material management application activates the starting input position in response to the user's click on the search word input box and displays an input method keyboard above the lower part of the food material library interface. In this way, the user can input search words based on the input method keyboard. After input is completed, the user inputs a food material search instruction carrying the input search words by clicking the search control. In other implementations, the user can input search words by speaking a voice password, such as the user saying "search apples". The food material management application receives the user's input voice password through a detector (microphone) and identifies the food material search instruction carrying the search words through semantic analysis.

[0121] It should be noted that the user can also input a food material search instruction by operating a corresponding control on another interface while displaying the other interface, or input a food material search instruction based on a voice control function by speaking a voice password while displaying the other interface. For example, in some embodiments, a food material search control is displayed in the food material management interface. When the user clicks the food material search control, the food material management application displays a search interface in response to the user's operation of the control, and the search interface includes at least a search bar, which includes a search word input box and a search control. The user can input a search word, such as a food material name, in the search word input box, and after inputting the search word, the user can input a food material search instruction carrying the search word by clicking the search control. The search interface can also include historical search words.

[0122] Figure 10 A search interface is shown in some exemplary embodiments of the present application. As shown, the search interface includes a search bar 110 and a content area 120. The search bar 110 includes a search word input box 111 and a search control 112, and the content area 120 displays a plurality of historical search words. Figure 10

[0123] ​In some implementations, after responding to an input ingredient search command containing search terms, the ingredient management application iterates through the ingredient information corresponding to each ingredient in the ingredient database. Using preset text matching rules, it matches the ingredient names in the iterated ingredient information with the search terms. These preset text matching rules include regular expression-based matching rules, semantic similarity-based text matching rules, etc., and are not limited in this application. For example, if an ingredient name includes a search term, then the ingredient name matches the search term. Similarly, if the semantic similarity between an ingredient name and a search term is greater than a preset threshold, then the ingredient name matches the search term. If at least one ingredient name matching the search term is found, the ingredient corresponding to that name is identified as the target ingredient; if no ingredient name matching the search term is found, it is determined that no target ingredient matching the search term exists in the ingredient database.

[0124] In some implementations, the local data of the ingredient management application includes search result variables. During the traversal and matching process, each time a target ingredient that matches the search term is encountered, the ingredient information corresponding to that target ingredient is added to the search result variables. After the matching is completed, the search result interface containing the ingredient icon of the target ingredient is displayed based on the ingredient information in the search result variables.

[0125] Figure 11 The search results interface shown in some exemplary embodiments of this application can specifically be used by a user in... Figure 9 The interface shown is the result of searching for "apple" in the ingredient database. Figure 11 As shown, the search results interface displays ingredient icons that match "apple," including "apple," "apple sauce," "apple juice," "apple candy," and "apple cider vinegar." It can be seen that the search function described in the foregoing embodiment can significantly narrow down the range of selectable ingredients, avoiding the need for users to manually browse icons and search for their desired items, saving user time and improving the user experience.

[0126] Figure 12 The search results interface shown in some exemplary embodiments of this application is specifically a search results interface displayed when no target ingredient matching the search term exists in the ingredient database. For example, Figure 12 This could be the interface displayed after a user searches for "tiramisu" in the ingredient database, even if "tiramisu" is not currently listed. For example... Figure 12 As shown, the search results interface displays a custom ingredient addition control "+ Add Custom Ingredient". When the user interacts with this control, the custom ingredient addition interface will be displayed, as shown below. Figure 7 As shown.

[0127] In some embodiments, in response to a user's interaction with the custom ingredient addition control displayed in the search interface, the food ingredient management application first returns to the food ingredient library interface when the custom category control is selected. Then, it displays the custom ingredient addition box on the food ingredient library interface when the custom category control is selected, and displays the user-entered search term in the input area corresponding to the ingredient name definition item in the custom ingredient addition box. Since the user-entered search term represents an ingredient that the user has not found in the food ingredient library, and thus also represents a custom ingredient that the user wants to add, displaying the search term in the input area corresponding to the ingredient name definition item saves the user the trouble of manually entering the ingredient name, thereby improving the user experience.

[0128] For example, when the user operates Figure 12 When adding custom ingredients using the "+ Add Custom Ingredient" control, it automatically returns to the following: Figure 6 The image shows the ingredient library interface when the custom category control is selected. A custom ingredient addition box is displayed above this interface, and "Tiramisu" is displayed in the input area corresponding to the ingredient name definition item within the custom ingredient addition box. Figure 13 As shown. This eliminates the need for users to manually type "tiramisu," saving user time and improving the user experience.

[0129] It's worth noting that when the desired ingredient doesn't exist in the ingredient library, a need arises to add a custom ingredient. As seen in the aforementioned example, when no matching ingredient exists in the library, a custom ingredient addition control in the search results interface allows users to trigger the display of the custom ingredient addition interface with a single click. This avoids the series of steps required to return to the ingredient library interface corresponding to the "Custom Ingredients" tab control, enabling quick access to the custom ingredient addition interface when no search results are available, thus rapidly fulfilling the user's need to add custom ingredients. Displaying the search term in the input area corresponding to the ingredient name definition item saves users the trouble of manually entering the ingredient name, thereby improving the user experience.

[0130] In a specific implementation, a search listener service (mSearchListener) is set in the interface containing the search bar to listen to the search words input by the user in the search word input box and the operation on the search control. For example, the search listener service is set in the food material library interface. In the case of no search result, the food material management application responds to the operation of the user on the custom food material adding control in the search result interface, and calls back the search words listened by the search listener service into the page parameter corresponding to the food material library interface through the callback function (addCustumFood). The callback function is also used to switch the state corresponding to the "custom food material" control in the food material library interface to the selected state, so as to display the food material library interface when the "custom food material" control is selected, and control the pop-up of the custom food material adding box, and fill the called back search words in the input area corresponding to the food material name definition item.

[0131] In some embodiments, when the food material library interface is displayed or the search result interface containing the food material icons of the target food material is displayed, the user can select the food material icon in the interface by single-point or long-press operation. When the user selects a certain food material icon, the food material icon is displayed in the selected state. The user can select multiple food material icons by multiple operations. The food material management application responds to the selection operation of the user on the food material icon, and updates the display state of the food material icon selected by the user to the selected state. If the selection operation is the first selection operation input by the user, a preview area is displayed at the position of the food material icon without blocking the food material icon in the current interface, and the food material icon selected by the user is displayed in the preview area. The food material management application responds to the operation indicating the completion of the selection, and saves the food material information corresponding to the food material icon selected by the user in the local food material information set.

[0132] For example, when the search result interface as shown in Figure 11 is displayed, the food material management application responds to the selection operation of the user on "apple", and updates the display state of the "apple" icon to the selected state, and displays the preview area 141 as shown in Figure 14 in the lower side of the search result interface, and displays the "apple" icon in the preview area. When the user continues to select "apple vinegar", the "apple" icon will be in the selected state, and the "apple vinegar" icon will also be displayed in the preview area 141. It can be seen that the preview area 141 also displays the "selected" control. After the user completes the selection, the user inputs the operation indicating the completion of the selection by clicking the "selected" control. The food material management application responds to the operation, saves the food material information corresponding to the food material icon selected by the user in the local food material information set, and marks it as the put-in state.

[0133] It can be seen from the above embodiments that the display device provided in the embodiments of the present application can be a refrigerator or other household appliances. An inputted food material search instruction carrying a search keyword can be received. The search keyword is matched with food materials in a food material library. If the target food material matching the search keyword exists in the food material library, a search result interface containing a food material icon of the target food material is displayed, so that the range of selectable food materials is greatly reduced, and the process of manually browsing icons and searching for the target by the user is avoided, thereby saving the time of the user and improving the use experience.

[0134] If the target food material matching the search keyword does not exist in the food material library, a search result interface containing a custom food material adding control is displayed, and the custom food material adding control is used to trigger a jump to a custom food material adding interface for receiving a custom food material inputted by the user. By setting the custom food material adding control in the search result interface, the user can trigger the display of the custom food material adding interface by one key, so that the function of quickly entering the custom food material adding interface when there is no search result is realized, the demand of the user for adding the custom food material is quickly met, and the user experience is improved.

[0135] The embodiments of the present application also provide an interface display method, as shown in Figure 15 The method can include the following steps.

[0136] S151, receiving an inputted food material search instruction carrying a search keyword.

[0137] In some embodiments, a food material management interface is displayed on the display, and the food material management interface includes a food material adding control. In response to an operation on the food material adding control, a food material library interface is displayed, and the food material library interface includes a search bar, and the search bar includes a search keyword input box and a search control. A food material search instruction carrying the search keyword is received by receiving an operation on the search control inputted by the user after inputting the search keyword in the search keyword input box.

[0138] S152, matching the search keyword with food materials in a food material library.

[0139] In some embodiments, food material information corresponding to each food material in the food material library is traversed, and a preset text matching rule is used to match the food material name in the traversed food material information with the search keyword. If at least one food material name matching the search keyword is traversed, the food material corresponding to the food material name is determined as the target food material. If no food material name matching the search keyword is traversed, it is determined that the target food material matching the search keyword does not exist in the food material library.

[0140] S153, if the target food material matching the search keyword exists in the food material library, a search result interface containing a food material icon of the target food material is displayed on the display.

[0141] In some embodiments, the interface display method provided in the present application further comprises: in response to a selection operation on the food material icon of the target food material, displaying a preview area at a position on the search result interface that does not block the food material icon, and displaying the food material icon selected by the user in the preview area; and in response to an operation indicating completion of selection input, saving the food material information corresponding to the food material icon selected by the user in the local food material information set.

[0142] S154, if the target food material matching the search term does not exist in the food material library, displaying a search result interface containing a custom food material adding control on the display, the custom food material adding control being used to trigger a jump to a custom food material adding interface, and the custom food material adding interface being used to receive a custom food material input by the user.

[0143] In some embodiments, in response to an operation on the custom food material adding control, the custom food material adding interface is displayed; the food material information of the custom food material input by the user in the custom food material adding interface is received; and in response to a confirmation operation input in the custom food material adding interface, the food material information of the custom food material is saved in the food material library.

[0144] In some embodiments, the food material library interface further comprises a label switching bar and a content area, the label switching bar comprises a plurality of label controls, and different ranges of food material icons are displayed in the content area when different label controls are selected; the label controls comprise a custom label control, and food material icons of custom food materials are displayed in the content area when the custom label control is selected; and in response to an operation on the custom food material adding control, the custom food material adding interface is displayed, which comprises returning to the food material library interface when the custom category control is selected, and displaying a custom food material adding frame on the food material library interface when the custom category control is selected, the custom food material adding frame being used to receive a custom food material input by the user.

[0145] In some embodiments, the custom food material adding frame at least comprises a food material name defining item, and the custom food material adding frame is displayed on the food material library interface when the custom category control is selected, which comprises displaying the search term in an input area corresponding to the food material name defining item.

[0146] As can be seen from the above embodiments, this application provides an interface display method, including: receiving an input ingredient search command carrying a search term; matching the search term with ingredients in an ingredient library; if a target ingredient matching the search term exists in the ingredient library, then displaying a search results interface containing an ingredient icon of the target ingredient, thereby greatly narrowing the range of selectable ingredients, avoiding the process of users manually browsing icons and searching for the target, saving user time and improving the user experience; if no target ingredient matching the search term exists in the ingredient library, then displaying a search results interface containing a custom ingredient addition control, which is used to trigger a jump to a custom ingredient addition interface, which is used to receive custom ingredients input by the user. By setting a custom ingredient addition control in the search results interface, users can trigger the display of the custom ingredient addition interface with one click, realizing the function of quickly entering the custom ingredient addition interface when there are no search results, quickly meeting the user's need to add custom ingredients, and improving the user experience.

[0147] Figure 16 The food ingredient management interface shown in some exemplary embodiments of this application is specifically the interface before scrolling the food ingredient icon corresponding to the target food ingredient information to the top of the section. For example... Figure 16 As shown, in this ingredient management interface, each section is preset to display 3 columns, meaning each row displays 3 ingredient icons. The scroll bar for each section is at the top, and the first 3 ingredient icons in each section are displayed in the first row at the top of each section. Ingredient 5 displayed in section 303 corresponds to a target ingredient and is displayed in the third row of section 303. Ingredient 8 displayed in section 304 corresponds to another target ingredient and is displayed in the second row of section 304.

[0148] Figure 17 The food ingredient management interface shown in some exemplary embodiments of this application specifically refers to... Figure 16 The interface after the ingredient icon corresponding to the target ingredient information scrolls to the top of the section. For example... Figure 17 As shown, compared to Figure 16 In the interface shown, the scroll bar in section 303 moves down two rows, and ingredient 5 scrolls up from the third row to the first row; the scroll bar in section 304 moves down one row, and ingredient 8 scrolls up from the second row to the first row.

[0149] See Figure 16 and Figure 17 As can be seen, based on the display device provided in the embodiments of this application, when the newly added target ingredient information appears in the ingredient information set, the ingredient icon corresponding to the target ingredient information can be automatically scrolled to the top of the partition without the user manually operating the scroll bar in the partition, thereby making it convenient for the user to view the newly added ingredients and improving the user experience.

[0150] In some embodiments, in order to display the food material icon corresponding to the newly added food material information at the top end of the food material display area, when it is detected that the food material information set changes, the food material information in the set can be arranged in descending order according to the food material put-in time contained in each food material information, so that the food material information with a later put-in time is arranged at the front in the food material information set. Then, according to the arrangement order of the food material information in the set, the food material icon corresponding to each food material information is displayed in the food material display area, so that the food material icons are arranged in descending order of the food material put-in time in the food material display area, that is, the food material icon with a later put-in time can be displayed at the front in the food material display area, thereby ensuring that the food material icon corresponding to the newly added food material information is displayed at the top end of the food material display area, facilitating user viewing and improving user experience.

[0151] In some embodiments, in order to display the food material in different storage rooms in the food material management interface, after reading the latest food material information set, the food material information in the set is divided into different sub-sets according to the storage room identifier in the food material information, so that the food material information containing the same storage room identifier is divided into the same sub-set. Then, the food material information in each sub-set is arranged in descending order according to the food material put-in time, so that the food material information with a later put-in time is arranged at the front in the sub-set. Then, according to the food material information and the arrangement order in each sub-set, the corresponding food material icon is displayed in the corresponding partition, so that the food material icons in each partition are arranged in descending order of the food material put-in time in each partition, that is, the food material icon with a later put-in time can be displayed at the front in the partition, thereby ensuring that the food material icon corresponding to the newly added food material information is displayed at the top end of the partition, facilitating user viewing and improving user experience.

[0152] The embodiments of the present application also provide a food material icon display method, as shown in Figure 18 The method can include:

[0153] S181, monitoring whether the information in the food material information set changes, the set including the food material information corresponding to the food material in the storage room, the food material information including the food material put-in time.

[0154] S182, when the information in the set changes, determining the target food material information newly added according to the food material put-in time.

[0155] In some possible implementation manners, according to the food material put-in time contained in each food material information in the set and the current time, the time difference corresponding to each food material information is determined; the food material information with a time difference less than a preset time difference is determined as the target food material information newly added.

[0156] In some embodiments, the newly added food material information is determined according to the time difference between the time when the food material information is contained in the newly added food material information and the current time.

[0157] S183, when displaying the corresponding food material icon of the target food material information in the food material display area according to the food material information in the changed set, displaying the corresponding food material icon of the target food material information at the top end of the food material display area.

[0158] In some embodiments, the food material display area comprises a sub-area corresponding to the storage compartment, and the food material information further comprises a storage compartment identifier; and displaying the corresponding food material icon of the target food material information at the top end of the sub-area according to the food material information in the changed set comprises: displaying the corresponding food material icon of the target food material information at the top end of the sub-area according to the storage compartment identifier in the food material information.

[0159] In some embodiments, displaying the corresponding food material icon of the target food material information at the top end of the sub-area according to the storage compartment identifier in the food material information comprises: dividing the food material information in the set into different sub-sets according to the storage compartment identifier; displaying the corresponding food material icon in the corresponding sub-area according to the food material information in each sub-set; and rolling the corresponding food material icon of the target food material information to the top end of the sub-area.

[0160] In some embodiments, rolling the corresponding food material icon of the target food material information to the top end of the sub-area comprises: determining the actual display row of the corresponding food material icon of the target food material information in the sub-area according to the index position of the target food material information in the sub-set and the preset display column number of the sub-area; determining the interval distance between the actual display row and the first row; and rolling the interval distance in the sub-area to roll the corresponding food material icon of the target food material information to the first row at the top end of the sub-area.

[0161] As can be seen from the above embodiments, based on the refrigerator and the food material icon display method provided in the embodiments of the present application, when the target food material information is newly added in the food material information set, the corresponding food material icon of the target food material information can be automatically rolled to the top end of the sub-area without manually operating the scroll bar in the sub-area, thereby facilitating the user to view the newly added food material and improving the user experience.

[0162] In specific implementation, the present application further provides a computer storage medium, wherein the computer storage medium can store a program, and the program can include some or all steps in the interface display method provided by the present application when executed. The storage medium can be a magnetic disc, an optical disc, a read-only memory (ROM) or a random access memory (RAM) and the like.

[0163] Those skilled in the art can clearly understand that the technology in the embodiments of the present application can be realized by means of software and necessary general hardware platforms. Based on such understanding, the technical solutions in the embodiments of the present application can be embodied in the form of a software product, and the computer software product can be stored in a storage medium, such as a ROM / RAM, a magnetic disc, an optical disc and the like, and includes a plurality of instructions to make a computer device (which can be a personal computer, a server or a network device and the like) execute the method described in the embodiments of the present application or some parts of the embodiments.

[0164] In the specification, the same or similar parts among various embodiments can be referred to each other. In particular, for the refrigerator embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the description in the method embodiments.

[0165] The above-described embodiments of the present application do not constitute a limitation on the protection scope of the present application.

Claims

1. A display device, characterized by comprising: The application comprises: a display for displaying a food material library interface and a food material management interface, the food material management interface comprising a food material display area for displaying food material icons of food material information in a food material information set, and the food material library interface comprising a search bar comprising a search term input box and a search control; a controller connected to the display and configured to: in response to a food material search instruction carrying a search term, match the search term with food material information in a food material library, the food material search instruction being generated by a user inputting a search term in the search term input box and triggering an operation of the search control; if there is a target food material matching the search term in the food material library, control the display to display a search result interface containing a food material icon of the target food material; if there is no target food material matching the search term in the food material library, control the display to display prompt information that there is no food material matching the search term and a food material library interface containing a custom food material adding control for triggering a jump to a custom food material adding interface for receiving a custom food material input by a user; in response to a selection operation of the custom food material adding control by a user, display the custom food material adding interface on the food material library interface and fill the search term in an input area corresponding to a food material name definition item in the custom food material adding interface; in response to a confirmation operation input by a user in the custom food material adding interface, save food material information of the target food material in the food material library; monitor whether food material information in the food material information set changes, the food material information comprising a food material put-in time and a current time; when a change in the food material information in the food material information set is monitored, determine target food material information newly added according to the food material put-in time and the current time; and display a food material icon corresponding to the target food material information at the top of the food material display area to update the food material display area.

2. The display device of claim 1, wherein, The controller performing the step of matching the search term with the food material information in the food material library is further configured to: traverse food material information of food materials in the food material library; match the search term with the food material information in the food material library according to a preset text matching rule.

3. The display device of claim 2, wherein, The controller is further configured to: traverse food material information of food materials in the food material library to obtain food material names of food material information in the food material library; match the search term with the food material names; if the food material names match the search term, determine that there is a target food material matching the search term in the food material library; if the food material names do not match the search term, determine that there is no target food material matching the search term in the food material library.

4. The display device of claim 3, wherein, The controller performing the step of matching the search term with the food material names is further configured to: if the food material names contain the search term, determine that the food material names match the search term; if the food material names do not contain the search term, determine that the food material names do not match the search term.

5. The display device of claim 3, wherein, The controller performing the step of matching the search term with the food material name is further configured to: calculate semantic similarity of the search term with the food material name; if the semantic similarity is greater than a preset threshold, determine that the food material name matches the search term; if the semantic similarity is less than or equal to the preset threshold, determine that the food material name does not match the search term.

6. The display device of claim 2, wherein, The controller is further configured to: add the food material information corresponding to the target food material to a search result variable during the traversing and matching process; after the matching ends, control the display to display a search result interface containing a food material icon of the target food material according to the food material information in the search result variable.

7. The display device of claim 1, wherein, The controller performing the step of controlling the display to display a search result interface containing a food material icon of the target food material is further configured to: in response to a selection operation on the food material icon, mark the food material information corresponding to the selected food material icon as a storage state and save it in a food material information set.

8. The display device of claim 1, wherein, The controller performing the step of controlling the display to display a search result interface containing a food material icon of the target food material is further configured to: in response to a selection operation on the food material icon, display the selected food material icon in a preview area, the preview area being a position on the search result interface that does not block the food material icon; in response to an input operation indicating completion of selection, save the food material information corresponding to the selected food material icon in the food material information set.

9. The display device of claim 1, wherein, The custom food material adding interface includes a custom food material adding box, and the controller performing the step of displaying the custom food material adding interface in response to a selection operation of the custom food material adding control by the user is further configured to: in response to a selection operation of the custom food material adding control by the user, display the custom food material adding box on a layer of the food material library interface containing the custom food material adding control, the custom food material adding box being used to receive custom food material information input by the user.

10. The display device of claim 9, wherein, The custom food material adding box includes a plurality of definition items, and the plurality of definition items are respectively a food material name definition item, a shelf life definition item, and a storage location definition item, and the controller performing the step of filling the search term in an input area corresponding to the food material name definition item in the custom food material adding interface is further configured to: obtain food material information of the target food material input by the user in the input area corresponding to the definition item; in response to a confirmation operation input by the user in the custom food material adding interface, save the food material information of the target food material in the food material library.

11. The display device of claim 1, wherein, The food material library interface further includes a label switching bar and a content area, the label switching bar includes a plurality of label controls and a custom label control, and the controller is further configured to: in response to a selection operation on the label control, display a food material icon of food material information corresponding to the label control in the content area; in response to a selection operation on the custom label control, display the custom food material adding control in the content area.

12. The display device of claim 1, wherein, The controller performing the step of determining the latest added target food material information according to the food material putting time and the current time is further configured to: According to the food material putting time and the current time, a time difference is calculated; Food material information with a time difference less than a preset time difference is determined as target food material information newly added.

13. The display device of claim 12, wherein, The controller performing the step of determining the target food material information newly added according to the food material putting time and the current time is further configured to: Compare the changed food material information set with the unchanged food material information set to obtain newly added food material information; Food material information with a time difference less than a preset time difference is determined as target food material information newly added.

14. The display device of claim 1, wherein, The food material display area includes multiple sub-areas corresponding to different storage compartments, and the food material information further includes a storage compartment identifier. The controller performing the step of displaying the food material icon corresponding to the target food material information at the top end of the food material display area is further configured to: Obtain the storage compartment identifier of the target food material information; According to the storage compartment identifier of the target food material information, display the food material icon corresponding to the target food material information at the top end of a target sub-area, which is a sub-area corresponding to the storage compartment identifier of the target food material information.

15. The display device of claim 14, wherein, The controller is further configured to: Divide the food material information in the food material information set into different sub-sets according to the storage compartment identifier, the sub-sets containing food material information with the same storage compartment identifier; Display the food material icons of the food material information in the sub-sets in the sub-area corresponding to the sub-set.

16. The display device of claim 15, wherein, The controller performing the step of displaying the food material icon corresponding to the target food material information at the top end of the food material display area is further configured to: According to the index position of the target food material information in the sub-set and the preset display column number of the sub-area, obtain the actual display row of the food material icon corresponding to the target food material information in the sub-area; Calculate the interval distance between the actual display row and the first row of the sub-area; Scroll the food material icon corresponding to the target food material information in the sub-area by the interval distance to scroll the food material icon corresponding to the target food material information to the top end of the sub-area.

17. The display device of claim 1, wherein, The food material icon includes a food material name, a food material picture, and a freshness identifier. The controller is further configured to: Obtain the putting time, the remaining time to expiration, and the expiration time of the target food material information; Generate a freshness identifier according to the putting time, the remaining time to expiration, and the expiration time.

18. The display device of claim 17, wherein, The controller is further configured to: When the remaining days to expiration of the food material is less than a preset number of days, update the freshness identifier so that the updated freshness identifier displays the remaining days to expiration of the target food material information.

19. An interface display method characterized by, Applied to a display device, the display device includes a display for displaying a food material library interface and a food material management interface, the food material management interface including a food material display area for displaying food material icons of food material information in a food material information set, and the food material library interface including a search bar including a search term input box and a search control. The method includes: In response to a search instruction for a search word, the search instruction being generated by a user inputting the search word in the search word input box and triggering the search control, the search word is matched with the food material information in the food material library; If the food material library contains a target food material matching the search word, the display is controlled to display a search result interface containing a food material icon of the target food material; If the food material library does not contain a target food material matching the search word, the display is controlled to display prompt information that there is no food material matching the search word and a food material library interface containing a custom food material adding control, the custom food material adding control being used to trigger a jump to a custom food material adding interface, the custom food material adding interface being used to receive a custom food material input by a user; In response to a selection operation of the custom food material adding control by the user, the custom food material adding interface is displayed on the food material library interface, and the search word is filled in an input area corresponding to a food material name definition item in the custom food material adding interface; In response to a confirmation operation input by the user in the custom food material adding interface, the food material information of the target food material is saved in the food material library; The food material information in the food material information set is monitored, the food material information including a food material putting time and a current time; When a change in the food material information in the food material information set is monitored, the latest added target food material information is determined according to the food material putting time and the current time; A food material icon corresponding to the target food material information is displayed at the top of the food material display area to update the food material display area.

Images