Display device and method for editing food ingredient information

By integrating the sound collector and controller in the refrigerator to analyze voice passwords and combining RFID tags, the food information accuracy problem caused by the user's non-standard voice input is solved, and more efficient food information editing is achieved and user experience is improved.

CN116235013BActive Publication Date: 2025-08-05HISENSE VISUAL TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202180066170.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2021-04-19
Filing Date
2021-08-23
Publication Date
2025-08-05
Estimated Expiration
2041-08-23

AI Technical Summary

Technical Problem

When users input food information through voice, the expression of existing refrigerators is not standardized, resulting in a decrease in information accuracy.

Method used

It provides a display device equipped with a sound collector and a controller, which can parse the user's voice password, determine the operation type and data, and display the corresponding input content in the ingredient editing interface, supporting the combination of voice recognition and RFID tags to realize the editing of ingredient information.

Benefits of technology

It improves the accuracy and user experience of food information input, reduces operation steps, especially through the combination of voice input and RFID tags, simplifies the editing process of food information.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116235013B_ABST
    Figure CN116235013B_ABST
Patent Text Reader

Abstract

This application discloses a display device and a method for editing food information, which allows users to edit food information through voice input. While displaying the food editing interface, a voice recognition interface is also displayed, allowing the device to quickly enter a voice detection state and promptly detect the user's voice input. By simply speaking the food information they wish to edit, the refrigerator automatically completes the process of inputting and saving the food information, saving user operations, making the editing process faster, and improving the user experience.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application claims priority to the Chinese patent application with application number 202011218085.2 filed on November 4, 2020, with invention name “Refrigerator and food information editing method”, priority to the Chinese patent application with application number 202110418594.8 filed on April 19, 2021, with invention name “Refrigerator and voice control method”, and priority to the Chinese patent application with application number 202110433466.0 filed on April 19, 2021, with invention name “Refrigerator and voice control method”. The entire contents of the above applications are incorporated into this application by reference. Technical Field

[0002] The present application relates to the field of display technology, and in particular to a display device and a method for editing food information. Background Art

[0003] Currently, the way for family members to obtain food in the refrigerator is generally by opening the refrigerator door and obtaining it with the naked eye.

[0004] To improve the user experience, refrigerators can be equipped with a radio frequency identification (RFID) device or a camera, allowing users to access the refrigerator's contents without opening the door. This display can be touch-sensitive or voice-controlled.

[0005] Some refrigerators support voice input for ingredient information. However, if the user's expression is not standard, the refrigerator will not accurately receive the information. Therefore, how to process the user's voice data when the user's expression is not standard is a pressing technical issue. Summary of the Invention

[0006] This application provides a display device and a food editing method to improve user experience.

[0007] In a first aspect, the present application provides a display device, comprising:

[0008] a display for presenting a user interface;

[0009] A voice collector, used to receive voice commands input by users;

[0010] The controller connected to the display screen and the sound collector is configured to:

[0011] receiving a user's instruction for editing ingredients, and presenting an ingredient editing interface on a display, wherein the ingredient editing interface displays input items corresponding to the ingredient expiration date;

[0012] Receiving a voice command input by a user through the sound collector;

[0013] Parsing the voice command to obtain a target operation type and first operation data for operating the shelf life of the food, wherein the first operation data includes a first operation value and a first time unit;

[0014] Determine second operation data corresponding to the first operation data, where the second operation data includes a second operand value and a second time unit, and the second time unit is a preset time unit;

[0015] According to the target operation type and the second operation data, the input content corresponding to the shelf life of the food is displayed in the food editing interface.

[0016] In a second aspect, the present application provides a display device, comprising:

[0017] a display, which presents the user interface to the user;

[0018] A voice collector, used to receive voice commands input by users;

[0019] The controller connected to the display screen and the sound collector is configured to:

[0020] receiving a user's instruction for editing ingredients, and presenting an ingredient editing interface on a display, wherein the ingredient editing interface displays input items corresponding to the ingredient expiration date;

[0021] Receive the voice command input by the user through the sound collector;

[0022] parsing the voice command to obtain an operation type and target operation data for operating the quantity of the ingredients, wherein the target operation data includes a target operation value and a target measurement unit;

[0023] determining, based on the operation type and the target operation data, a target display value measured in the target measurement unit, wherein, when the operation type represents an operation of inputting an ingredient quantity, the target display value is the target operation value; and when the operation type represents an operation of modifying a previously stored ingredient quantity, the target display value is determined based on the target operation value and the previously stored ingredient quantity when the target measurement unit matches a previously stored measurement unit category;

[0024] The target display value and the target measurement unit are used as input content corresponding to the ingredient quantity and displayed in the ingredient editing interface.

[0025] In a third aspect, the present application provides a voice control method, which is applied to a display device, wherein the display device includes a display, and the display presents a user interface; the method includes:

[0026] receiving a user's instruction for editing ingredients, and presenting an ingredient editing interface on a display, wherein the ingredient editing interface displays input items corresponding to the ingredient expiration date;

[0027] Receive voice commands input by the user;

[0028] Parsing the voice command to obtain a target operation type and first operation data for operating the shelf life of the food, wherein the first operation data includes a first operation value and a first time unit;

[0029] Determine second operation data corresponding to the first operation data, where the second operation data includes a second operand value and a second time unit, and the second time unit is a preset time unit;

[0030] According to the target operation type and the second operation data, the input content corresponding to the shelf life of the food is displayed in the food editing interface.

[0031] In a fourth aspect, the present application provides a method for editing food information, the method comprising:

[0032] When an RFID tag is detected on the tag reading area, a user interface including an ingredient editing interface and a voice recognition interface is displayed, and the input voice content is recognized. The ingredient editing interface is used to display the input ingredient information, and the voice recognition interface includes an input prompt and the recognized voice content;

[0033] According to the recognized voice content, the input ingredient information is displayed in the ingredient editing interface.

[0034] In a fifth aspect, the present application provides a method for editing food information, the method comprising:

[0035] In response to the input preset voice command, determining whether the currently displayed user interface is an ingredient editing interface, the ingredient editing interface being used to display the input ingredient information;

[0036] If the currently displayed user interface is not the ingredient editing interface, a tag scanning interface is displayed, wherein a scanning prompt is displayed in the tag scanning interface, and the scanning prompt is used to prompt the user to place the RFID tag to be edited on the tag reading area; when the RFID tag placed by the user on the tag reading area is detected, the ingredient editing interface is displayed according to the voice content included in the preset voice command;

[0037] If the currently displayed user interface is an ingredient editing interface, the ingredient editing interface is updated according to the voice content included in the preset voice instruction. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] In order to more clearly illustrate the technical solution of the present application, the following is a brief introduction to the drawings required for use in the embodiments. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0039] Figure 1a This is an interactive scenario of a display device according to an exemplary embodiment of the present application;

[0040] Figure 1b This is a perspective view of a refrigerator according to an exemplary embodiment of the present application;

[0041] Figure 1c This is a schematic diagram of the appearance of a refrigerator according to an exemplary embodiment of the present application;

[0042] Figure 2 This is a schematic diagram of refrigerator hardware configuration according to an exemplary embodiment of the present application;

[0043] Figure 3 A user interface according to an exemplary embodiment of the present application is shown;

[0044] Figure 4 Another user interface according to an exemplary embodiment of the present application is shown;

[0045] Figure 5 Another user interface according to an exemplary embodiment of the present application is shown;

[0046] Figure 6 Another user interface according to an exemplary embodiment of the present application is shown;

[0047] Figure 7 Another user interface according to an exemplary embodiment of the present application is shown;

[0048] Figure 8 Another user interface according to an exemplary embodiment of the present application is shown;

[0049] Figure 9 Another user interface according to an exemplary embodiment of the present application is shown;

[0050] Figure 10 Another user interface according to an exemplary embodiment of the present application is shown;

[0051] Figure 11 This is a flow chart of a method for editing food information according to an exemplary embodiment of the present application;

[0052] Figure 12 This is a flow chart of another method for editing food information according to an exemplary embodiment of the present application;

[0053] Figure 13 This is an ingredient editing interface shown in accordance with an exemplary embodiment of the present application;

[0054] Figure 14 This is another food editing interface shown in accordance with an exemplary embodiment of the present application;

[0055] Figure 15 This is another food editing interface shown in accordance with an exemplary embodiment of the present application;

[0056] Figure 16 This is another food editing interface shown in accordance with an exemplary embodiment of the present application;

[0057] Figure 17 This is another food editing interface shown in accordance with an exemplary embodiment of the present application;

[0058] Figure 18 This is another food editing interface shown in accordance with an exemplary embodiment of the present application;

[0059] Figure 19 This is another food editing interface shown in accordance with an exemplary embodiment of the present application;

[0060] Figure 20 This is another food editing interface shown in accordance with an exemplary embodiment of the present application;

[0061] Figure 21 This is another food editing interface shown in accordance with an exemplary embodiment of the present application;

[0062] Figure 22 This is a flow chart of a voice control method according to an exemplary embodiment of the present application;

[0063] Figure 23 The following is a flow chart of a voice control method according to an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0064] In order to enable those skilled in the art to better understand the technical solutions in this application, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of this application.

[0065] In the description of the present invention, it should be understood that the terms "center", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc., indicating the orientation or position relationship, are based on the orientation or position relationship shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention.

[0066] The terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the quantity of the technical features being referred to. Thus, a feature specified as "first" or "second" may explicitly or implicitly include one or more of such features. In the description of the present invention, unless otherwise specified, "plurality" means two or more.

[0067] In the description of the present invention, it should be noted that, unless otherwise expressly specified or limited, the terms "mounted," "connected," and "connected" should be understood broadly. For example, they may refer to fixed connections, detachable connections, or integral connections; they may refer to direct connections, indirect connections through an intermediary, or internal communication between two components. Those skilled in the art will understand the specific meanings of the above terms in the present invention based on the specific circumstances.

[0068] Currently, the way for family members to obtain food in the refrigerator is generally by opening the refrigerator door and obtaining it with the naked eye.

[0069] To improve the user experience, refrigerators can be equipped with a radio frequency identification (RFID) device or a camera, allowing users to access the refrigerator's contents without opening the door. This display can be touch-sensitive or voice-controlled.

[0070] At present, the intercommunication of smart home appliances is a hot research topic. People hope to control home appliances before returning home, or control refrigerators, air conditioners, etc. in the living room.

[0071] The description of food editing provided in this application can be performed on a refrigerator with a display, or on other home appliances or handheld devices.

[0072] Figure 1a Schematic diagram showing an operation scenario of a display device according to an embodiment is exemplarily shown in FIG.

[0073] In some embodiments, the display device can be any home or office device with a display screen or display, for example, when a mobile terminal, tablet computer, computer, laptop computer, TV, refrigerator, electronic whiteboard, oven, washing machine, videophone, mirror, etc. can become a carrier for displaying a UI interface for a user, the above devices are all display devices involved in this application, and are not limited to Figure 1a TV, refrigerator, oven shown.

[0074] In some embodiments, the display device 200 also communicates data with the server 100. The display device 200 may be connected to a local area network (LAN), a wireless local area network (WLAN), or other networks. The server 100 may provide various content and interactions to the display device 200. The server 100 may be a single cluster or multiple clusters, and may include one or more types of servers.

[0075] In some embodiments, the display device can also synchronize and communicate data with other display devices. The display device 200 can be allowed to interact with other devices via a local area network (LAN) or wireless local area network (WLAN). Intercommunication can be achieved through devices within the same local area network. When data on one display device is updated, other devices are also updated. Account management can also be used. When the display device and other devices are logged in through an account, data communication can be carried out with the devices logged in under the same account.

[0076] In some embodiments, the display device may receive instructions from a smart device or control device such as a mobile phone or tablet, or may receive user control through touch or gestures.

[0077] In some embodiments, the display device 200 can also be controlled in a manner other than the control device 100 and the smart device 300. For example, the user's voice command control can be directly received through a module for obtaining voice commands configured inside the display device 200, or the user's voice command control can be received through a voice control device set outside the display device 200.

[0078] The following is an illustrative explanation using a refrigerator as an example. Figure 1b This is a perspective view of a refrigerator according to an exemplary embodiment of the present application. The shape of the refrigerator provided by the embodiment of the present invention is approximately rectangular. The appearance of the refrigerator is defined by a storage chamber 101 providing limited storage space and a plurality of doors 200 provided at the opening of the storage chamber 101. The storage chamber 101 is a box body 100 with an opening. Figure 1b In the illustrated example, the storage chamber 101 includes a freezing chamber 101A located at the bottom and a refrigerating chamber 101B located at the top. The freezing chamber 101A and the refrigerating chamber 101B each have one or more independent storage spaces.

[0079] In some embodiments, the freezer compartment 101A can be selectively covered by a drawer-type freezer compartment door 200A. The refrigerator compartment 101B is divided into a left side and a right side. The refrigerator compartment 101B can be selectively opened or closed by a refrigerator compartment door 200B pivotally mounted on the refrigerator compartment 101B.

[0080] Figure 1c This is a schematic diagram of the appearance of a refrigerator according to an exemplary embodiment of the present application, as shown in FIG. Figure 1b As shown, a display screen is provided on the refrigerator door 200B, and the display screen is embedded in the door body. In some embodiments, the plane where the screen of the display screen is located is flush with the outer surface of the door.

[0081] like Figure 1b and Figure 1c As shown, the refrigerator provided in the embodiment of the present application has at least two storage compartments inside its box, such as a freezer compartment, a refrigerator compartment, a temperature-changing chamber and / or a fresh-keeping chamber, etc. Each storage compartment can have multiple independent storage spaces, such as drawer-type compartments.

[0082] Figure 2 This is a schematic diagram of refrigerator hardware configuration according to an exemplary embodiment of the present application. As an example, the refrigerator 200 may include a display screen 210, a controller 220, a memory 250 and several user input interfaces.

[0083] In some exemplary embodiments, refrigerator 200 may further include at least one RFID detection module 230 and a detector 240. Display screen 210, RFID detection module 230, detector 240, and memory 250 are coupled to controller 220 via a communication interface. Display 210 is configured to receive image signals output by controller 220, display video content and images, and display a menu interface, as well as a user interface for controlling refrigerator 200.

[0084] The controller 220 may include one or more processing units, such as a system on a chip (SoC), a central processing unit (CPU), a microcontroller (MCU), a storage controller, etc. The different processing units may be independent devices or integrated into one or more processors.

[0085] The memory 250 may include one or more storage units, such as volatile memory, such as dynamic random access memory (DRAM) and static random access memory (SRAM); and non-volatile memory (NVM), such as read-only memory (ROM) and flash memory. The different storage units may be independent devices or integrated or packaged into one or more processors or communication interfaces to become part of the processor or communication interface.

[0086] The detector 240 includes at least a sound collector, such as a microphone, which can be used to receive the user's voice, exemplarily including a voice signal of a user's control command to control the refrigerator 200 .

[0087] The user input interface includes at least one of a microphone, a touchpad, a sensor, a button, or other input interfaces. For example, a user can input user commands through voice, touch, gesture, pressing, or other actions. The input interface converts received analog signals into digital signals, and then converts the digital signals into corresponding command signals, which are then sent to the refrigerator 200.

[0088] In some embodiments, the controller 220 may include a voice recognition module, which further includes a voice parsing unit and a voice command database, so that the refrigerator can independently complete the voice recognition of the voice data input by the user, and the process of matching the recognized voice content with the voice commands in the voice command database.

[0089] In some exemplary embodiments, the RFID detection module 230 may be provided in each storage compartment, for transmitting wireless signals in the corresponding storage compartment and receiving signals from RFID tags in the storage compartment to obtain food information in the RFID tags.

[0090] In some embodiments, the refrigerator further includes a tag reading area disposed outside the storage compartment, i.e., a sensing area for identifying RFID tags. An RFID detection module is disposed at the tag reading area for detecting RFID tags placed in the area. Optionally, the tag reading area may be disposed below the display screen, so that a user can simultaneously place (or remove) an RFID tag in the tag reading area and operate a user interface displayed on the display screen.

[0091] In some embodiments, the refrigerator may further include an RFID processing module, which is connected to each RFID detection module respectively and is used to control the RFID detection module to transmit wireless signals and receive signals from RFID tags fed back by the RFID detection module.

[0092] In some embodiments, the RFID detection module can specifically be an antenna. The power of the antennas installed in different storage compartments can vary. Furthermore, the power of the antenna in each storage compartment should be sufficient to ensure that the antenna can identify the ingredients contained in that compartment. This avoids excessive power, which can increase the false recognition rate, and insufficient power, which can result in incomplete identification of ingredients in the compartment. In a specific implementation, the antenna power can be pre-determined based on the size of each storage compartment, and the power of each antenna can be set in the refrigerator. The larger the storage compartment, the greater the power.

[0093] In order to achieve intelligent management of food ingredients, RFID tags are used to identify food ingredients in the storage room.

[0094] In some embodiments, a virtual association between RFID tags and food information is achieved by establishing a correspondence between the RFID tags and the food information. The identification information of the RFID tags can be the tag code of the RFID tags identified by the RFID detection module 230, or a code segment in the tag code. In these embodiments, the controller 220 can determine the food information corresponding to each RFID tag based on the identification information of each RFID tag and the pre-established correspondence.

[0095] For example, the pre-established correspondence between the identification information of the RFID tag and the food information can be shown in the following table:

[0096] RFID food information

[0097] Logo 1 Apple

[0098] Logo 2 cucumber

[0099] Logo 3 pork

[0100] …………

[0101] After establishing the corresponding relationship between the RFID tag and the food information, the controller 220 obtains the tag code of the RFID tag by detecting the signal of the RFID tag, and can determine the food information associated with each tag according to the tag code.

[0102] In some embodiments, the food information associated with each tag is associated with a storage room, and the storage location of the food can be determined based on the storage room associated with the food information. For example, if the food information "apple" is associated with "refrigerator", it can be determined that the apple is stored in the refrigerator.

[0103] In some embodiments, a food management interface is displayed on display screen 210, and the user manages the food in the refrigerator by operating the food management interface. For example, corresponding food controls / icons are drawn in the food management interface based on the food information associated with each RFID tag in the storage chamber, so that all the food in the refrigerator can be displayed in the form of icons, graphics, etc. In addition, functional controls such as RFID tag identification controls and food addition controls can also be drawn in the food management interface for the user to operate to trigger controller 210 to implement corresponding functions.

[0104] Figure 3 This is a user interface shown in accordance with an exemplary embodiment of the present application, which is specifically an exemplary food management interface. Figure 3 The ingredient management interface includes an RFID tag editing control, a recommended recipe control, and ingredient display areas corresponding to each storage room, such as the ingredient display area 310 corresponding to the refrigerator. Each ingredient display area displays a corresponding ingredient icon and ingredient name, such as the ingredient icon "apple" 311 in the ingredient display area 310.

[0105] In some embodiments, the tag code of an RFID tag includes at least two code segments: a first code segment and a second code segment. The first code segment is used to write a first code, which can be a predetermined code or a non-predetermined code. For RFID tags whose first code is a predetermined code, the corresponding ingredient information can be customized by the user, i.e., a custom tag. For RFID tags whose first code is a non-predetermined code, the corresponding preset ingredient information is pre-stored in a cloud server or a local ingredient library and cannot be customized by the user, i.e., a predefined tag. The second code segment is used to write a second code, which is the unique identification information of the RFID tag. It should be noted that user-defined ingredient names mean that the user can associate any ingredient name with the RFID tag as needed. Furthermore, the user can also change the defined tag as needs change, so that the same tag is associated with different ingredient names. Non-user-defined ingredient names mean that the user cannot change the ingredient name associated with the RFID tag. The ingredient name associated with such RFID tags is pre-defined and stored in the cloud server or local ingredient library.

[0106] When an RFID tag is given, whether the tag is a predefined tag or a custom tag can be determined based on the first code included in the tag code. If the first code is a predetermined code, the tag is a custom tag; if the first code is not a predetermined code, the tag is a predefined tag. In some embodiments, the tag code of the RFID tag includes at least two code segments that conform to a preset composition rule. After obtaining the tag code, the controller intercepts the first code segment and / or the second code segment according to the preset composition rule to obtain the first code and / or the second code, thereby saving the process of parsing long coded information and improving processing efficiency.

[0107] In some embodiments, the predetermined code is unique, such as 00; the non-predetermined code is not unique, and there may be multiple non-predetermined codes, and one non-predetermined code corresponds to one type of food information.

[0108] For example, the tag coding structure of an RFID tag is as follows:

[0109] Code segment 1 Code segment 2 Code segment

[0110] Content first code (predetermined code or non-predetermined code) second code (identification information)

[0111] Length 2 hexadecimal digits 24 hexadecimal digits

[0112] For example, the controller obtains the tag code of the RFID tag as "01123456789012345678901234". According to the preset composition rule, the first code can be intercepted as "01" and the second code can be intercepted as "123456789012345678901234".

[0113] It should be noted that, depending on different needs, the tag code of an RFID tag may include additional code segments, such as a third code segment for writing the manufacturer's identification of the RFID tag, or a fourth code segment for use as a reserved bit in the tag code to improve the scalability of the RFID tag. In other embodiments, the manufacturer's identification of the RFID tag may also be included in the second code segment, which is not detailed here.

[0114] For example, the correspondence between the first code (non-predetermined code) and the food information may be shown in the following table:

[0115] RFID first code food name

[0116] 01 Radish

[0117] 02 Carrot

[0118] 03 Lotus Root

[0119] …………

[0120] In some embodiments, when the ingredient management interface is displayed on the display screen, the user can input instructions for editing ingredient information by operating the ingredient management interface. For example, the user clicks the ingredient information editing control provided by the ingredient management interface to instruct to edit the ingredient information; when the controller receives the instruction, it starts to detect the signal of the RFID tag placed on the tag reading area to obtain the identification information of the RFID tag, and displays an interface for editing the ingredient information associated with the RFID tag, that is, the ingredient editing interface, and inputs the ingredient information associated with the RFID tag in the ingredient editing interface.

[0121] In some embodiments, the identification information of the obtained RFID tag can also be displayed in the food editing interface, so that the user can intuitively see the identification information of the RFID tag without the need for the user to manually enter the identification information, thereby improving the user experience.

[0122] In some embodiments, the ingredient editing interface displays at least one ingredient editing item. Each ingredient editing item includes an item name and item content, where the item content is the portion to be edited. A user can enter the item content of each ingredient editing item in an input location to enter ingredient information for association with the RFID tag. Once the input is complete, the controller stores the input ingredient information in association with the identification information, thereby completing and improving the establishment of a correspondence table between the RFID tag identification information and the ingredient information.

[0123] In some embodiments, the interface for editing ingredient information may be referred to as an ingredient editing interface, and the ingredient editing items displayed thereon may include an ingredient name editing item, an ingredient expiration date editing item, an ingredient quantity editing item, etc. It should be understood that the item name of the ingredient name editing item may be "label name," and the item content is the ingredient name to be entered or updated; the item name of the ingredient expiration date editing item may be "expiration date," and the item content is the expiration date to be entered or updated; the item name of the ingredient quantity editing item may be "quantity," and the item content is the quantity to be selected or modified.

[0124] like Figure 3 As shown, the user can click the RFID tag editing control in this interface to enter an instruction to edit the ingredient information. In response to this instruction, the controller controls the RFID detection module to begin detecting the signal of the RFID tag in the tag reading area to obtain the RFID tag identification information. After the controller obtains the RFID tag identification information, the ingredient editing interface is displayed on the display screen.

[0125] In some embodiments, when the controller receives a user input command to edit ingredient information, it displays a tag scanning interface in response to the command, and displays a scanning prompt within the tag scanning interface. This prompt prompts the user to place the RFID tag to be edited on the tag reading area. Simultaneously, the controller controls the RFID detection module to begin detecting signals from RFID tags on the tag reading area to obtain identification information from the RFID tags. After the controller obtains the identification information from the RFID tags, the ingredient editing interface is presented on the display screen.

[0126] In some embodiments, the user can also speak a preset voice command to indicate the editing of ingredient information. For example, the user may say "Tag Edit." When the user's voice input is received and the content is recognized as "Tag Edit," the controller confirms receipt of the preset voice command for triggering the editing of the ingredient information corresponding to the RFID tag. In response to this command, the controller displays the tag scanning interface and begins detecting RFID tags in the tag reading area.

[0127] In some embodiments, when a preset voice command is received, it is first determined whether an RFID tag on the tag reading area is detected. If no RFID tag on the tag reading area is detected, it means that the user has not placed the RFID tag to be edited on the tag reading area. At this time, a tag scanning interface containing a scanning prompt is displayed to prompt the user to place the RFID tag to be edited on the tag reading area.

[0128] In some embodiments, the above-mentioned instruction for instructing to edit food information is also referred to as an RFID tag editing instruction.

[0129] Figure 4 The user interface shown in some embodiments of the present application is specifically an exemplary label scanning interface, such as Figure 4 As shown, the tag scanning interface displays a scanning prompt, which specifically reads "Please place the RFID tag in the scanning area below the screen." When an RFID tag placed by the user on the tag reading area is detected, the following is displayed: Figure 5 The ingredient editing interface shown.

[0130] See Figure 5The RFID tag's identification information, "20200005," is displayed on the ingredient editing interface. This eliminates the need for the user to manually enter this identification information, thus avoiding input errors and saving user effort. The ingredient editing interface also displays multiple ingredient editing items, including an ingredient name editing item 510 and an ingredient expiration date editing item 520. Each ingredient editing item has an input location for entering the corresponding item details. Furthermore, a "Cancel" control 530 and an "OK" control 540 are displayed.

[0131] In this way, each RFID tag is matched with the food information input by the user, realizing the virtual association between the RFID tag and the food information. The corresponding food information can be found according to the identification information of the RFID tag, and the correspondence between the RFID tag and the food information can be modified so that the same RFID tag can correspond to different food information in turn, thereby improving the flexibility of using RFID tags.

[0132] In some embodiments, users can edit the ingredient information corresponding to an RFID tag using voice commands. For example, a user can say, "Define a 2-pound beef tag." The controller will automatically update the corresponding ingredient editing item based on the recognized voice content, such as "beef" and "2 pounds," without requiring user input. This not only further reduces user operations and makes the editing process faster, but also increases the universality of the feature, allowing even elderly people or children who cannot type to complete the editing of ingredient information.

[0133] In some embodiments, when the controller detects an RFID tag placed by a user on the tag reading area, it displays a voice recognition interface while displaying the above-mentioned ingredient editing interface, and begins to receive and recognize the user's voice input, wherein the voice recognition interface can display input prompts and recognized voice content; based on the recognized voice content, the item content of the ingredient editing item in the interface is updated.

[0134] Figure 6 The user interface shown in some embodiments of the present application is specifically a user interface that displays the ingredient editing interface and the voice recognition interface at the same time, such as Figure 6 As shown, the view display area 610 where the voice recognition interface is located is displayed above the view display area 620 where the ingredient editing interface is located. The voice recognition interface displays an input prompt, specifically a text prompt such as "You can say, I want to define 2 kilograms of peaches." When receiving user input voice data and recognizing the voice content, the voice recognition interface can also display the recognized voice content.

[0135] In some embodiments, the controller receives voice data input by the user and sends the voice data to the server. The server recognizes the voice data, obtains the corresponding voice content, and generates a voice instruction based on the voice content. The voice instruction includes multiple fields, each field corresponding to an ingredient editing item, the field name being the item name, and the field value being the item content. The server returns the generated voice instruction to the refrigerator, which updates the item content of the corresponding ingredient editing item based on the field values of each field in the voice instruction.

[0136] An exemplary voice command format is as follows:

[0137] Field Name Field Value

[0138] cmd RFID-write

[0139] name beef

[0140] count 1000g

[0141] It can be seen from the above voice instructions that the voice instruction instructs the refrigerator to perform the RFID tag editing operation, wherein the field value "beef" corresponding to the field name "name" is used to update the item content of the ingredient name editing item, and the field value "1000g" corresponding to the field name "count" is used to update the ingredient quantity editing item.

[0142] In some embodiments, after the controller detects an RFID tag placed by a user on the tag reading area, it determines whether the RFID tag is a custom tag. If the RFID tag is a custom tag, a first editing interface is displayed. The first editing interface includes multiple ingredient editing items, wherein the item content display area (i.e., the input position area) corresponding to each ingredient editing item displays preset default characters, and the item content of each ingredient editing item is editable. In this way, the user can update the item content of each ingredient editing item by entering text or voice. If the RFID tag is not a custom tag, the preset ingredient information corresponding to the tag is obtained based on the first code in the tag code, and a second editing interface is displayed based on the obtained preset ingredient information. Unlike the first editing interface, in the second editing interface, the preset ingredient information, such as the preset ingredient name, is displayed in the item content display area corresponding to each ingredient editing item, and the item content of the ingredient name item is not editable, that is, the user cannot change the currently displayed ingredient name by entering text or voice.

[0143] In a specific implementation, the controller may obtain the corresponding preset ingredient information from the cloud server based on the first code. Alternatively, the controller may obtain the corresponding preset ingredient information from a locally pre-set ingredient library based on the first code. The locally pre-set ingredient library may be pre-downloaded by the controller from the cloud server.

[0144] In some embodiments, if the RFID tag placed by the user on the tag reading area is a custom tag, the local data is determined to determine whether the food information corresponding to the second code exists based on the second code in the tag code (i.e., the identification information of the RFID tag). If the food information corresponding to the second code exists in the local data, the food information is displayed as the item content of each food editing item in the first editing interface. In this way, on the one hand, the food information currently associated with the RFID tag can be displayed to the user, and on the other hand, if the user wants to modify the currently associated food information, the new food information can be input through text input or voice input. In addition, if the user only wants to modify part of the food information, they only need to re-enter the part of the food information that they do not want to modify, and there is no need to re-enter the other part of the food information that they do not want to modify. If the food information associated with the RFID tag does not exist in the local data, the preset default characters are used as the item content of each food editing item and displayed in the first editing interface.

[0145] Figure 7 This is a possible user interface shown in some embodiments of the present application, which is specifically an exemplary first editing interface, such as Figure 7 As shown, in this interface, the item content of each ingredient editing item is the default character "undefined".

[0146] Figure 8 This is a possible user interface shown in some embodiments of the present application, which is specifically an exemplary second editing interface, such as Figure 8 As shown in the figure, in this interface, the default text for the ingredient name edit item 810 is "apple", the default text for the expiration date edit item 820 is "1", and the default text for the ingredient quantity edit item 830 is "1". "Apple" and "1" are the default ingredient information corresponding to the currently detected label.

[0147] As mentioned above, the ingredient names associated with predefined tags are not editable, while the ingredient names associated with custom tags are editable. Based on this, when the refrigerator controller updates the ingredient edit items based on the voice command returned by the server, if the RFID tag is a custom tag, the contents of all ingredient edit items will be updated. If the RFID tag is not a custom tag, the contents of the ingredient edit items except the ingredient name will be updated.

[0148] It should be understood that the process of displaying or updating the item content of each ingredient editing item according to the voice content contained in the preset voice instruction can be referred to as follows. Figure 1a-Figure 8 The illustrated embodiments, for example, when the RFID tag is a custom tag, all ingredient editing items are updated; when the RFID tag is not a custom tag, ingredient editing items other than the ingredient name editing item are updated, etc., are not described in detail here.

[0149] As can be seen from the above embodiments, based on the refrigerator provided by the embodiments of the present application, users can edit the food information corresponding to the RFID tag through voice input. Specifically, when an RFID tag placed by the user on the tag reading area is detected, the voice recognition interface is displayed simultaneously with the food editing interface, automatically switching the voice application to the foreground, thereby quickly entering the voice detection state and promptly detecting the user's voice input. The user can automatically complete the information input process by speaking the food information they want to edit, saving user operations, making the editing process faster, and improving the user experience.

[0150] Figure 9 This is a user interface shown in accordance with an exemplary embodiment of the present application, which is specifically an exemplary food library interface. Figure 9 As shown, the interface includes operation controls 111-119 named "Recently Used", "All", "Fruits", "Vegetables", "Meat", "Drinks", "Aquatic Products", "Others" and "Custom". Figure 9 In the interface, since the "all" control 112 is selected, the food icon corresponding to each food information in the food collection is displayed. Figure 9 When the user clicks the "Customize" control 119, the user interface changes from Figure 9 Changes to Figure 10 ,exist Figure 10 In the interface shown, the ingredient icon corresponding to each ingredient information in the custom ingredient set is displayed.

[0151] like Figure 10As shown, in the ingredient library interface displaying the custom ingredient set, an operation control 121 for adding custom ingredient information is also displayed. The user can input an instruction for adding a custom ingredient by operating the operation control 121. In response to the instruction, the controller displays an ingredient definition interface, and the user can enter the newly defined ingredient information in the ingredient definition interface.

[0152] In some embodiments, Figure 9 and Figure 10 In the user interface shown, the user can select one or more food icons by a predetermined operation, such as by long pressing the icon to select the icon. The user can also cancel the selection of the icon by a predetermined operation, such as long pressing the icon in the selected state to cancel the selection of the icon.

[0153] The present application also provides a method for editing food information. Figure 1a-Figure 10 For the refrigerator shown, the execution subject of the method includes but is not limited to the controller of the refrigerator. Figure 11 This is a flow chart of a method for editing food information according to an exemplary embodiment of the present application, as shown in FIG. Figure 11 As shown, the method may include:

[0154] S010, when an RFID tag is detected on the tag reading area, a user interface including an ingredient editing interface and a voice recognition interface is displayed, and the input voice content is recognized. The ingredient editing interface is used to display the input ingredient information, and the voice recognition interface includes input prompts and recognized voice content.

[0155] In some embodiments, receiving input of RFID tag editing instructions, such as a user Figure 3 In the interface shown, an RFID tag editing instruction is input by clicking an RFID tag editing control; in response to the input RFID tag editing instruction, an RFID tag on a tag reading area is detected.

[0156] In other embodiments, a preset voice command is received to trigger editing of the food information corresponding to the RFID tag. For example, a user speaks a preset voice command, such as "tag edit," to input the preset voice command. In response to the preset voice command, the RFID tag on the tag reading area is detected.

[0157] In some embodiments, a preset voice command is received, and in response to the preset voice command, a tag scanning interface is displayed, wherein a scanning prompt is displayed in the tag scanning interface, and the scanning prompt is used to prompt the user to place the RFID tag to be edited in the tag reading area. At the same time, the RFID tag on the tag reading area is detected.

[0158] S011, displaying the input ingredient information in the ingredient editing interface according to the recognized voice content.

[0159] In some embodiments, when an RFID tag placed by a user on a tag reading area is detected, the food editing interface is displayed, including: obtaining a tag code obtained by detecting the RFID tag, the tag code including a code segment for indicating whether the RFID tag is a custom tag; judging whether the RFID tag is a custom tag according to the tag code; if the RFID tag is a custom tag, using a preset default character as the item content of each food editing item, and displaying it in the food editing interface. For example, in Figure 7 In the food editing interface shown, the item content of each food editing item is the default character "undefined". If the RFID tag is not a custom tag, the preset food information of the RFID tag is obtained according to the tag code, and the preset food information is used as the item content of each food editing item and displayed in the food editing interface. For example, Figure 8 In the ingredient editing interface shown, the default text for the ingredient name edit item is "apple," the default text for the expiration date edit item is "1," and the default text for the ingredient quantity edit item is "1." "Apple," "1," and so on, represent the preset ingredient information corresponding to the currently detected label.

[0160] In some embodiments, updating the item content of the ingredient editing item based on the recognized voice content includes: receiving voice data input by a user, and sending the voice data to a server so that the server recognizes the voice content; receiving a voice instruction returned by the server based on the recognized voice content, the voice instruction including multiple fields, one field corresponding to one ingredient editing item; and updating the item content of the ingredient editing item corresponding to the field using the field value of the field.

[0161] In some embodiments, the ingredient editing item includes an ingredient name editing item, and updating the item content of the ingredient editing item based on the recognized voice content includes: if the RFID tag is a custom tag, updating the item content of all ingredient editing items based on the voice content; if the RFID tag is not a custom tag, updating the item content of the ingredient editing item except the ingredient name editing item based on the voice content.

[0162] In some embodiments, if the RFID tag is not a custom tag, it also includes: determining whether the ingredient name contained in the voice content is the same as the preset ingredient name contained in the preset ingredient information; if the ingredient name contained in the voice content is different from the preset ingredient name contained in the preset ingredient information, then displaying an interface prompt, or playing a voice prompt, the interface prompt and the voice prompt are used to prompt the user that the RFID tag does not support editing the ingredient name. For example, if the preset ingredient name corresponding to the currently detected RFID tag is "apple", and the field value corresponding to the field name "name" in the voice instruction is "beef", since the two are different, a text prompt needs to be popped up or a voice prompt needs to be played. If the preset ingredient name corresponding to the currently detected RFID tag is "beef", since the field value corresponding to the field name "name" in the voice instruction is also "beef", there is no need to pop up a text prompt or play a voice prompt.

[0163] In some embodiments, the controller is also used to: receive a confirmation operation on a specified control on the ingredient editing interface; in response to the confirmation operation, generate ingredient information based on the updated item content of all ingredient editing items; and save the ingredient information and the label code of the RFID tag in the local data.

[0164] Figure 12 This is a flow chart of another method for editing food information according to an exemplary embodiment of the present application. Figure 12 As shown, the method may include:

[0165] S020, in response to the input preset voice command, determining whether the currently displayed user interface is an ingredient editing interface, the ingredient editing interface being used to display the input ingredient information;

[0166] S021: If the currently displayed user interface is not the ingredient editing interface, a tag scanning interface is displayed, wherein a scanning prompt is displayed in the tag scanning interface, and the scanning prompt is used to prompt the user to place the RFID tag to be edited in the tag reading area; when the RFID tag placed by the user in the tag reading area is detected, the ingredient editing interface is displayed according to the voice content included in the preset voice command;

[0167] S022: If the currently displayed user interface is an ingredient editing interface, update the ingredient editing interface according to the voice content included in the preset voice instruction.

[0168] In the above embodiment, the user can first place the RFID tag to be edited on the tag reading area. At this time, the controller detects the RFID tag and displays the ingredient editing interface. The user then speaks a preset voice command to enter a preset voice instruction. The preset voice instruction includes the ingredient information the user wants to edit, such as "I want to define 2 pounds of beef." In other embodiments, the user can speak a preset voice command before placing the RFID tag to be edited on the tag reading area to enter a preset voice instruction. The preset voice instruction is used to trigger the editing process and also includes the ingredient information the user wants to edit, such as "I want to define 2 pounds of beef."

[0169] As can be seen from the above embodiments, based on the food information editing method provided in the embodiments of the present application, users can edit the food information corresponding to the RFID tag through voice input. Specifically, when an RFID tag placed by the user on the tag reading area is detected, the voice recognition interface is displayed simultaneously with the food editing interface, automatically switching the voice application to the foreground, thereby quickly entering the voice detection state and timely detecting the user's voice input. The user can automatically complete the information input process by speaking the food information they want to edit, saving user operations, making the editing process faster, and improving the user experience.

[0170] Figure 13 This is an ingredient editing interface shown in accordance with an exemplary embodiment of the present application, such as Figure 13 As shown, on the ingredient editing interface, the identification information "20200005" of the RFID tag is displayed. In this way, the user does not need to manually enter the identification information, thereby avoiding input errors and saving user operations. A plurality of input items are also displayed, namely the ingredient name input item 410, the ingredient shelf life input item 420 and the ingredient quantity input item 430, wherein each ingredient input item corresponds to an input position for entering the corresponding content. In addition, a "Cancel" control 440 and an "OK" control 450 are also displayed. After the information input is completed, the user can click the "OK" control to indicate that the input ingredient information is saved, or click the "Cancel" control to indicate that the input is returned to the previous interface.

[0171] In some embodiments, the process of the controller displaying the ingredient editing interface may include: first, determining whether there is corresponding ingredient information in the ingredient information set based on the identification information of the label to be edited; if there is corresponding ingredient information in the ingredient information set, then displaying the input content corresponding to the input item in the ingredient editing interface based on the ingredient information; if there is no corresponding ingredient information in the ingredient information set, then displaying the item content corresponding to the editing item in the ingredient editing interface based on the preset fill information.

[0172] In one example, based on the identification information of the tag to be edited, it is determined whether the corresponding food information exists in the food information set, specifically: apple, 60 days, 1000g, and the food editing interface displayed is as follows: Figure 14 See Figure 14 In the ingredient editing interface, the input for "Tag Name" is "Apple," the input for "Shelf Life" is "60 Days," and the input for "Quantity" is "1000g." Through this ingredient editing interface, users can view the ingredient information previously associated with the tag to be edited and can also modify the displayed input to enter new ingredient information.

[0173] In another example, if it is determined that the corresponding food information does not exist in the food information set according to the identification information of the tag to be edited, the food editing interface displayed is as follows: Figure 15 See Figure 15 In the ingredient editing interface, the input fields for "Tag Name," "Expiration Date," and "Quantity" are all filled with the character "Undefined." This allows users to see that the target tag is brand new and enter the ingredient information to be associated with the tag by entering the content for each edit item.

[0174] It is worth noting that in Figure 13-15 In the food editing interface shown, the default input positions for "Shelf Life" and "Quantity" are displayed with measurement units. Figure 13 In the , the unit of measurement for shelf life is "days" and the unit of measurement for quantity is "g". Figure 14 In the , the unit of measurement for shelf life is displayed as "months" and the unit of measurement for quantity is displayed as "shares". Figure 15 In the , the unit of measurement for the shelf life is displayed as "days" and the unit of measurement for the quantity is displayed as "jin". When the ingredient editing interface is displayed, the user can set the unit of measurement for the shelf life and / or the quantity of the ingredient according to the needs. For example, when displaying Figure 13 In the ingredient management interface shown, users can click the drop-down control next to the measurement unit to control the display of measurement unit options.

[0175] For example, in the display Figure 13 When in the ingredient editing interface shown, the user can click the drop-down control next to the shelf life measurement unit to control the shelf life measurement unit option pop-up, such as Figure 16 After the unit of measurement option for the shelf life pops up, the user can click to select the unit of measurement to be set, such as Figure 16 In the example shown, after the user selects "month", the measurement unit option is collapsed, and the measurement unit displayed in the ingredient editing interface changes from "day" to "month".

[0176] For example, in the display Figure 13 When in the ingredient editing interface shown, the user can click the drop-down control next to the ingredient quantity measurement unit to control the pop-up of the ingredient quantity measurement unit option, such as Figure 17 When the unit of measurement option for the quantity of ingredients pops up, the user can click to select the unit of measurement to be set, such as Figure 17 In the example shown, after the user selects "portion", the measurement unit option is collapsed, and the measurement unit displayed in the ingredient editing interface changes from "g" to "portion".

[0177] In some embodiments, when the ingredient editing interface is displayed, the user can enter ingredient information using a voice command. The voice command can include one or more operational instructions, such as instructions for the ingredient name, the expiration date, and the quantity. For example, when the ingredient editing interface is displayed, if the user says, "Define a 2-pound beef label," the controller can parse the voice command to extract the instruction information for the ingredient name and the quantity. For another example, when the ingredient editing interface is displayed, if the user says, "Define an expiration date of 3 months," the controller can parse the voice command to extract the instruction information for the expiration date. The controller can then use the parsed instruction information to enter the content corresponding to the item and display it in the ingredient editing interface, eliminating the need for user input. This not only reduces user effort and speeds up the editing process, but also increases the universality of the feature, allowing even the elderly and children who cannot type to complete the editing of ingredient information.

[0178] In some embodiments, when the controller detects an RFID tag placed by a user on the tag reading area, it displays a voice recognition content area in the ingredient editing interface and begins receiving and recognizing the user's voice command. The voice recognition content area can display input prompts and recognized voice content. In some embodiments, the ingredient editing area and the voice recognition content area can be two different view display areas. These different view display areas can belong to the same layer or different layers.

[0179] Figure 18 This is a food editing interface including a voice recognition content area shown in some embodiments of this application. Figure 18 As shown, voice recognition content area 810 is displayed at the top of the ingredient editing interface and does not overlap with ingredient editing area 820. Voice recognition content area 810 displays an input prompt, specifically a text prompt such as "You can say, I want to define 2 jin of peaches." When a user's voice command is received and the voice content is recognized, the voice recognition content area can also display the recognized voice content.

[0180] In some embodiments, the controller receives a voice command input by a user and sends the voice command data to a server. The server parses the voice command data to obtain corresponding voice content and generates voice instruction information based on the voice content. The voice instruction information includes multiple fields, each field corresponding to an ingredient input item, the field name being the item name, and the field value being the operation type and / or operation data. The server returns the generated voice instruction information to the controller, which operates the corresponding input item based on the field values of each field in the voice instruction information and displays the content of the corresponding input item.

[0181] In some embodiments, the voice command information includes first command information, which is used to operate the shelf life of the food. The first command information includes at least first operation data, and the first operation data includes a first operation value and a first time unit. The first operation value carrying the first time unit is the original voice content directly parsed from the voice command. For example, if the voice command input by the user is "I want to define 2 pounds of beef with a shelf life of 3 months", then the first operation value carrying the first time unit is "3 months".

[0182] In some embodiments, after the controller parses the input voice command to obtain first instruction information for manipulating the shelf life of an ingredient, it determines second instruction information based on the first instruction information. The second instruction information includes a target operation type and second operation data. The second operation data includes a second operand value and a second time unit, where the second time unit is one of preset time units. Then, based on the target operation type and the second operation data, the input content corresponding to the shelf life of the ingredient is displayed on the ingredient editing interface.

[0183] When the controller generates the second instruction information based on the first instruction information, it first determines whether the first time unit is a preset time unit and whether the first operand value is an integer. If the first time unit is a preset time unit and the first operand value is an integer, then the operand value and its unit in the first instruction information do not need to be processed. Instead, the first time unit is determined to be the second time unit, and the first operand value is determined to be the second operand value. If the first time unit is not the preset time unit, or the first operand value is not an integer, then the operand value and its unit in the first instruction information need to be processed. Specifically, based on the conversion relationship between the first time unit and the preset time unit, the first operand value is converted into a second operand value in preset time units, and the second operand value must be an integer.

[0184] In some possible implementations, the preset time units include months and days. When the first time unit is years or months, the first operand value is converted into a second operand value in months or days; when the first time unit is weeks or days, the first operand value is converted into a second operand value in days. Specifically, if the first time unit is years and the first operand value is an integer, such as 3 years, no processing is performed on the first operand value; the first operand value carrying the first time unit is directly used as the second operand value. If the first time unit is years and the first operand value is not an integer, such as 2.5 years, the first operand value is converted into a second operand value in months, i.e., 2.5 × 12 months. If the first time unit is months and the first operand value is an integer, such as 3 months, no processing is performed on the first operand value; the first operand value carrying the first time unit is directly used as the second operand value. If the first time unit is months and the first operand value is not an integer, such as 2.5 months, the first operand value is converted into a second operand value in days, i.e., 2.5 × 30 days. If the first time unit is a week, since a week is not a preset time unit, regardless of whether the first operand value is an integer, the first operand value must be converted to a second operand value in days. For example, 3 weeks must be converted to 3 × 7 days. If the first time unit is a day and the first operand value is an integer, no processing is required. If the first time unit is a day and the first operand value is not an integer, the first operand value is rounded down to a second operand value still in days. For example, 2.5 days can be rounded down to 2 days, and 3.4 days can be rounded down to 3 days.

[0185] In addition, it is worth noting that when the user uses voice control to input food information, the input voice command can also include the operation type of operating the shelf life of the food, and the operation type can include extending operation, shortening operation and setting operation. It should be understood that if the input voice command contains the operation type supported by the refrigerator, the first instruction information obtained by parsing the voice command will naturally include the operation type. If the input voice command does not contain the operation type supported by the refrigerator, the first instruction information does not include the operation type. For example, when the food editing interface is displayed, if the user says "extend the shelf life by 3 months", the operation type contained in the voice command is the extension operation; if the user says "shorten the shelf life by 2 months", the operation type contained in the voice command is the shortening operation; if the user says "define the shelf life for 3 months", the operation type contained in the voice command is the setting operation.

[0186] Based on this, when the controller generates the second instruction information based on the first instruction information, if the first instruction information also includes an operation type, the operation type is determined as the target operation type. If the first instruction information does not include an operation type, the preset operation type is determined as the target operation type. As a possible implementation, the preset operation type can be a setup operation. That is, if the first instruction information does not include an operation type, the setup operation is determined as the target operation type.

[0187] When the controller determines the target operation type and the second operation data, it first determines the display data based on the target operation type and the second operation data. The display data consists of a display value and a second time unit. After obtaining the display value in the second time unit, the controller uses the display value in the second time unit as the input content corresponding to the shelf life of the ingredient in the ingredient editing interface. This way, if the time measurement unit displayed in the ingredient editing interface is inconsistent with the shelf life measurement unit in the user's voice command, not only can the shelf life operation of the ingredient be completed, but the refrigerator will also display the time measurement unit according to the user's voice command, improving the user experience.

[0188] Specifically, when the target operation type is a setting operation, the second operand value is determined as a display value.

[0189] When the target operation type is an extension operation, the previously stored shelf life value and the second operand value are converted into a first intermediate value and a second intermediate value respectively in intermediate time units; the first intermediate value and the second intermediate value are added to obtain an intermediate sum in intermediate time units; and the intermediate sum is converted into a display value in second time units. To save computational effort, the preset storage time unit can be used as an intermediate measurement unit, and the storage time unit is the unit of the previously stored shelf life value. For example, the storage time unit is seconds, the previously stored shelf life value is 200,000 (seconds), and the second operand value is 3 (days). According to the aforementioned method of determining the display value, in this example, the second operand value 3 (days) needs to be converted into 3×24×60×60 (seconds), and then added to the previously stored shelf life value 200,000 to obtain 261,200 (seconds). Finally, 261,200 (seconds) is converted into a display value in days and rounded down to 5 days.

[0190] Alternatively, based on the conversion relationship between the second time unit and the storage time unit, the previously stored shelf life value is converted into a value measured in the second time unit, which is then added to the second operation value to finally obtain a display value measured in the second time unit.

[0191] When the target operation type is a shortening operation, the previously stored shelf life value and the second operation value are converted into a first intermediate value and a second intermediate value respectively in intermediate time units; the first intermediate value is subtracted from the second intermediate value to obtain an intermediate difference in intermediate time units; the intermediate difference is converted into a display value in the second time unit. For example, the storage time unit is seconds, the previously stored shelf life value is 200,000 (seconds), and the second operation value is 3 (days). According to the above-mentioned method of determining the display value, when the storage time unit (seconds) is used as the intermediate time unit, the second operation value 3 (days) needs to be converted into 3×24×60×60 (seconds), and then subtracted from the previously stored shelf life value 200,000 to obtain 59,200 (seconds). Finally, 59,200 (seconds) is converted into a display value in days, and rounded down to obtain 0 days.

[0192] Alternatively, according to the conversion relationship between the second time unit and the storage time unit, the previously stored shelf life value is converted into a value measured in the second time unit, and then the second operation value is subtracted from it to finally obtain the display value measured in the second time unit.

[0193] For example, when the ingredient editing interface is displayed, in response to the user's voice command "I want to define 2 pounds of beef with a shelf life of 3 months", the content corresponding to the label name in the ingredient management interface will be displayed as "beef", the content corresponding to the ingredient shelf life will be displayed as "3 months", and the content corresponding to the ingredient quantity will be displayed as "2 pounds". Figure 19 shown.

[0194] After completing the input of each input item in the ingredient editing interface, the user can click the "Confirm" control on the ingredient editing interface to enter a confirmation operation. In response to receiving the confirmation operation entered by the user on the ingredient editing interface, the controller stores the received user-entered ingredient information in the ingredient information set in correspondence with the identification information of the tag to be edited.

[0195] In the above embodiment, when the target operation type is a shortening operation or an extending operation, the second operand value is converted into a second intermediate value measured in storage time units. On the one hand, this facilitates the calculation of the displayed value, and on the other hand, the intermediate sum or intermediate difference measured in storage time units can be directly used to update the previously stored shelf life value to complete the shortening or extending operation of the shelf life. If the target operation type is a setting operation, the second operand value (or the displayed value) is converted into a shelf life value measured in storage time units, and the shelf life value is stored in the food information.

[0196] In addition, the controller also responds to the confirmation operation, cancels the ingredient editing interface, displays the ingredient management interface, and updates the ingredient management interface according to the input ingredient information. For example, the updated ingredient management interface is newly added with an ingredient icon generated according to the input ingredient information.

[0197] It should be understood that compared to the ingredient management interface before the update, some updated ingredient management interfaces will display new ingredient icons, which are the ingredient icons corresponding to the newly added ingredients; in some updated ingredient management interfaces, since the shelf life of some ingredients has been extended or shortened, the freshness icons of some ingredient icons have been updated.

[0198] It can be seen from the above embodiments that the refrigerator provided based on the embodiments of the present application can obtain the target operation type and first operation data for operating the shelf life of ingredients by parsing the voice command when the user operates the shelf life of ingredients through voice commands. The first operation data includes a first operation value and a first time unit. Then, the second operation data corresponding to the first operation data is determined. The second operation data includes a second operation value and a second time unit. The second time unit is a preset time unit. Finally, according to the target operation type and the second operation data, the shelf life of ingredients is operated, and the input content corresponding to the shelf life of ingredients is displayed in the ingredient editing interface. Therefore, even if the time unit in the voice command does not match the preset time unit, the operation on the shelf life of ingredients can be completed, thereby improving the user experience.

[0199] In some embodiments, the controller receives a voice command input by a user and sends the voice command data to a server. The server parses the voice command data to obtain corresponding voice content and generates voice instruction information based on the voice content. The voice instruction information includes multiple fields, each field corresponding to an ingredient input item, the field name being the item name, and the field value being the operation type and / or operation data. The server returns the generated voice instruction information to the controller, which operates the corresponding input item based on the field values of each field in the voice instruction information and displays the content of the corresponding input item.

[0200] In some embodiments, the controller obtains instruction information for operating the quantity of ingredients by parsing the input voice command, and the instruction information includes the operation type and target operation data, and the target operation data includes the target operation value and the target measurement unit. The target operation value carrying the target measurement unit is the original voice content directly parsed from the voice command. For example, if the voice command input by the user is "I want to define 2 pounds of beef", the target operation value carrying the target measurement unit is "2 pounds". As a possible implementation method, the operation on the quantity of ingredients includes an input operation and a modification operation. The input operation is to store the target operation value indicated in the voice command when the quantity of ingredients has not been stored previously; the modification operation refers to the operation of increasing or decreasing the previously stored quantity of ingredients according to the target operation value indicated in the voice command when the quantity of ingredients has been stored previously.

[0201] It is worth noting that in some implementations, the controller parses the voice command input through a server, which parses the voice content from the voice command and returns the voice content to the refrigerator controller. The refrigerator controller then determines the instruction information for manipulating the ingredient quantity based on the voice content returned by the server. In other implementations, the controller parses the voice command input through a server, which parses the voice content from the voice command and determines the instruction information for manipulating the ingredient quantity based on the voice content, and returns the instruction information to the refrigerator controller. The voice content includes the target operation value with the target unit of measurement.

[0202] In the above implementation, after the server or refrigerator controller parses the target measurement unit and the target operation value from the voice command, it determines whether the target measurement unit is a preset measurement unit and whether the target operation value falls within the preset allowable operation range of the target measurement unit; if the target measurement unit is a preset measurement unit and the target operation value falls within the allowable operation range, the target operation data containing the target operation value and the target measurement unit is obtained. If the target measurement unit is not a preset measurement unit, or the target operation value does not fall within the allowable operation range, the process ends. Exemplarily, the preset measurement units can be divided into weight measurement units, singular measurement units and plural measurement units. Among them, weight measurement units can include kilograms, grams, and catties, unit measurement units can include handfuls, portions, pieces, strips, bottles, roots, pieces, grains, slices, strings, plates, cans, cups, cans, etc., and plural measurement units can include bags, packages, boxes, etc.

[0203] It should be noted that when the voice command input by the user contains operation type information, the server can parse the operation type information from it. If the voice command input by the user does not contain operation type information, the server cannot parse the operation type information from it. If the server cannot parse the operation type information from the voice command, or the parsed operation type is not an operation type supported by the refrigerator controller, the input operation is used as the target operation to determine the operation type representing the input operation.

[0204] After the controller obtains instruction information for operating the ingredient quantity by parsing the input voice command, it determines the target display value in the target measurement unit according to the operation type and target operation data in the instruction information, and displays the target display value and the target measurement unit as the input content corresponding to the ingredient quantity in the ingredient editing interface. The step of determining the target display value may specifically include:

[0205] When the operation type represents an input operation, the target operation value in the instruction information is determined as the target display value. For example, the voice command input by the user is "I want to define 2 pounds of beef". According to the voice command, it can be seen that the operation type is an input operation, the target operation value is 2, and the target measurement unit is pounds. In this example, the target display value is the target operation value, that is, 2. In this way, even if the quantity measurement unit displayed in the ingredient editing interface is inconsistent with the quantity measurement unit in the user's voice command, the input operation of the ingredient quantity can be completed. The user does not need to enter the voice command according to the displayed quantity measurement unit, but only needs to say the preset quantity measurement unit. When the quantity measurement unit said by the user is inconsistent with the current default display measurement unit, the refrigerator will display it according to the quantity measurement unit said by the user to improve the user experience.

[0206] When the operation type represents a modification operation, it is first determined whether the target unit of measurement matches the category of the previously stored unit of measurement. The previously stored unit of measurement is the unit of measurement for the previously stored ingredient quantity. If the target unit of measurement matches the category of the previously stored unit of measurement, if the operation type represents an increase operation, the sum of the previously stored ingredient quantity value and the target operation value is determined as the target display value; if the operation type represents a decrease operation, the difference between the previously stored ingredient quantity value and the target operation value is determined as the target display value. In this way, when a user modifies the previously stored ingredient quantity through voice control, the modification operation can be completed only if the quantity unit of measurement in the user's voice command matches the category of the previously stored unit of measurement, without the need for the quantity unit of measurement in the user's voice command to be completely consistent with the previously stored unit of measurement. When the quantity unit of measurement spoken by the user is inconsistent with the currently displayed default unit of measurement, the refrigerator will display the quantity unit spoken by the user to improve the user experience. On the contrary, if the target unit of measurement does not match the previously stored unit of measurement category, a predetermined prompt message will be displayed on the upper layer of the ingredient editing interface to remind the user that the shelf life of the ingredient cannot be operated according to the input voice command.

[0207] In some implementations, the controller determines whether the target measurement unit and the previously stored measurement unit are both weight units, singular measurement units, or plural measurement units; if the target measurement unit and the previously stored measurement unit are both weight units, singular measurement units, or plural measurement units, it is determined that the categories of the target measurement unit and the previously stored measurement unit match. In one example, the input voice command is "I want to define 5 bags of beef", that is, the target measurement unit is "bag", and the previously stored measurement unit is "jin", which is a weight measurement unit. In this example, since "bag" belongs to a plural measurement unit and "jin" belongs to a weight measurement unit, the categories of the two do not match. Therefore, it is necessary to display the following on the ingredient editing interface: Figure 20 The prompt message shown in the text is "The current operation cannot be completed due to mismatch of measurement units."

[0208] It is worth noting that in the case where the target measurement unit and the previously stored measurement unit are both weight units, the step of the controller determining the target display value may specifically include: judging whether the target measurement unit and the previously stored measurement unit are consistent; when the target measurement unit and the previously stored measurement unit are inconsistent, converting the previously stored quantity of ingredients into an intermediate value measured in the target measurement unit; finally, determining the target display value based on the target operation value and the intermediate value, that is, if the operation type represents an increase operation, then the sum of the intermediate value and the target operation value is determined as the target display value; if the operation type represents a decrease operation, then the difference between the intermediate value and the target operation value is determined as the target display value.

[0209] For example, when the ingredient editing interface is displayed, in response to the user's voice command "I want to define 2 pounds of beef with a shelf life of 3 months", the content corresponding to the label name in the ingredient management interface will be displayed as "beef", the content corresponding to the ingredient shelf life will be displayed as "3 months", and the content corresponding to the ingredient quantity will be displayed as "2 pounds". Figure 21 shown.

[0210] After completing the input of each item in the ingredient editing interface, the user can click the "Confirm" control on the ingredient editing interface to enter a confirmation operation. In response to receiving the confirmation operation, the controller stores the received user-entered ingredient information and the identification information of the tag to be edited in the ingredient information collection. Specifically, when the operation on the ingredient quantity is an input operation, the target display value with the target measurement unit is stored as an item in the ingredient information in the ingredient information collection. When the operation on the ingredient quantity is a modification operation, the target display value and target measurement unit are used to update the previously stored ingredient quantity value and measurement unit.

[0211] In addition, the controller also responds to the confirmation operation, cancels the ingredient editing interface, displays the ingredient management interface, and updates the ingredient management interface according to the input ingredient information. For example, the updated ingredient management interface is newly added with an ingredient icon generated according to the input ingredient information.

[0212] It can be seen from the above embodiments that, based on the refrigerator provided by the embodiments of the present application, when the ingredient editing interface is displayed, the user can enter or modify the quantity of ingredients by inputting a voice command. Among them, when inputting the quantity of ingredients through voice control, even if the quantity measurement unit displayed in the ingredient editing interface is inconsistent with the quantity measurement unit in the user's voice command, the input operation can be completed, and the user does not need to enter the voice command according to the displayed quantity measurement unit, and only needs to say the quantity measurement unit in the preset measurement unit. When modifying the quantity of previously stored ingredients through voice control, it is only necessary that the quantity measurement unit in the user's voice command matches the category of the previously stored measurement unit to complete the modification operation, without the need for the quantity measurement unit in the user's voice command to be completely consistent with the previously stored measurement unit. When the quantity measurement unit spoken by the user is inconsistent with the currently default displayed measurement unit, the refrigerator will display it according to the quantity measurement unit spoken by the user to improve the user experience.

[0213] The embodiment of the present application also provides a voice control method, the execution subject of which includes but is not limited to the refrigerator controller. For example, when the TV and the refrigerator are interconnected through the cloud, the TV can view and edit the ingredients in the refrigerator through the cloud server, such as opening a smart home related application. Editing ingredients on the TV can be done through a pre-installed voice assistant, or by controller buttons or touch. After the TV edits the ingredients, it is also synchronized to the refrigerator through the cloud.

[0214] Figure 22 This is a flow chart of a voice control method according to an exemplary embodiment of the present application, as shown in FIG. Figure 22 As shown, the method may include:

[0215] S101, when displaying the food editing interface, receiving a voice command input by the user.

[0216] S102: Obtain a target operation type and first operation data for operating the shelf life of the food by parsing the voice command, where the first operation data includes a first operation value and a first time unit.

[0217] S103: Determine second operation data corresponding to the first operation data, where the second operation data includes a second operand value and a second time unit, and the second time unit is a preset time unit.

[0218] In some embodiments, determining the second operation data corresponding to the first operation data includes: when the first time unit is consistent with the preset time unit and the first operand value is an integer, determining the first time unit as the second time unit and determining the first operand value as the second operand value; when the first time unit is inconsistent with the preset time unit, or the first operand value is not an integer, converting the first operand value into a second operand value measured in the preset time unit, and the second operand value is an integer.

[0219] In some embodiments, the preset time unit includes months and days; when the first time unit is inconsistent with the preset time unit, or the first operand value is not an integer, the first operand value is converted into a second operand value in the preset time unit, including: when the first time unit is year or month, the first operand value is converted into a second operand value in month or day; when the first time unit is week or day, the first operand value is converted into a second operand value in day.

[0220] In some embodiments, by parsing the voice command, a target operation type for operating the shelf life of the food is obtained, including: when the first instruction information also includes an operation type, determining the operation type as the target operation type; when the first instruction information does not include an operation type, determining the preset operation type as the target operation type.

[0221] S104: Displaying input content corresponding to the shelf life of the ingredient in the ingredient editing interface according to the target operation type and the second operation data.

[0222] In some embodiments, based on the target operation type and the second operation value carrying the second time unit, the input content corresponding to the shelf life of the ingredient is displayed in the ingredient editing interface, including: determining the display data based on the target operation type and the second operation data, the display data including the display value and the second time unit; using the display data as the input content corresponding to the shelf life of the ingredient, and displaying it in the ingredient editing interface.

[0223] In some embodiments, the target operation type includes an extension operation, a shortening operation, and a setting operation, and the display data is determined based on the target operation type and the second operation data, including: when the target operation type is a setting operation, the second operation value is determined as the display value; when the target operation type is an extension operation, the display value is determined based on the sum of the previously stored shelf life value and the second operation value; when the target operation type is a shortening operation, the display value is determined based on the difference between the previously stored shelf life value and the second operation value.

[0224] In some embodiments, when the target operation type is an extension operation, the display value is determined based on the sum of the previously stored shelf life value and the second operation value, including: converting the previously stored shelf life value and the second operation value into a first intermediate value and a second intermediate value measured in intermediate time units, respectively; adding the first intermediate value and the second intermediate value to obtain an intermediate sum measured in intermediate time units; and converting the intermediate sum into a display value measured in second time units.

[0225] When the target operation type is a shortening operation, the display value is determined based on the difference between the previously stored shelf life value and the second operation value, including: converting the previously stored shelf life value and the second operation value into a first intermediate value and a second intermediate value measured in intermediate time units respectively; subtracting the first intermediate value from the second intermediate value to obtain an intermediate difference measured in intermediate time units; and converting the intermediate difference into a display value measured in the second time unit.

[0226] In some embodiments, the intermediate time unit is consistent with the storage time unit. When the target operation type is a setting operation, the displayed value is converted into a shelf life value in storage time units, and the obtained shelf life value is saved in the food information; when the target operation type is a shortening operation, the intermediate difference is used to update the previously stored shelf life value; when the target operation type is an extending operation, the intermediate sum is used to update the previously stored shelf life value.

[0227] In some embodiments, the displayed value is converted into a shelf life value in a preset storage time unit; the converted shelf life value is saved in the food information.

[0228] It can be seen from the above embodiments that based on the voice control method provided in the embodiments of the present application, when the user operates the shelf life of food through voice commands, the target operation type and first operation data for operating the shelf life of food can be obtained by parsing the voice command, and the first operation data includes a first operation value and a first time unit. Then, the second operation data corresponding to the first operation data is determined, and the second operation data includes a second operation value and a second time unit, and the second time unit is a preset time unit. Finally, according to the target operation type and the second operation data, the shelf life of the food is operated, and the input content corresponding to the shelf life of the food is displayed in the food editing interface. Therefore, even if the time unit in the voice command does not match the preset time unit, the operation on the shelf life of the food can be completed, thereby improving the user experience.

[0229] Based on the refrigerator provided in the embodiment of the present application, the embodiment of the present application also provides a voice control method, such as Figure 23 As shown, the method may include:

[0230] S111, when displaying the food editing interface, receiving a voice command input by the user.

[0231] S112: Obtaining an operation type and target operation data for operating the quantity of the ingredients by parsing the voice command, wherein the target operation data includes a target operation value and a target measurement unit.

[0232] In some embodiments, when no operation type is parsed from the voice command, an operation type representing an operation of inputting the quantity of ingredients is determined.

[0233] In some embodiments, after parsing the target measurement unit and the target operation value from the voice command, it is determined whether the target measurement unit is a preset measurement unit and whether the target operation value falls within the preset allowable operation range of the target measurement unit; if the target measurement unit is a preset measurement unit and the target operation value falls within the allowable operation range, the target operation data including the target operation value and the target measurement unit is determined.

[0234] S113, determining a target display value measured in the target measurement unit based on the operation type and the target operation data, wherein, when the operation type represents an operation of inputting the quantity of ingredients, the target display value is the target operation value, and when the operation type represents an operation of modifying the quantity of previously stored ingredients, the target display value is determined based on the target operation value and the previously stored quantity of ingredients when the target measurement unit matches the measurement unit category previously stored.

[0235] In some embodiments, the following steps are followed to determine whether the category of the target measurement unit matches that of the previously stored measurement unit: determine whether the target measurement unit and the previously stored measurement unit are both weight units, singular measurement units, or plural measurement units; if the target measurement unit and the previously stored measurement unit are both weight units, singular measurement units, or plural measurement units, determine that the category of the target measurement unit matches that of the previously stored measurement unit.

[0236] In some embodiments, the operation of modifying the previously stored quantity of ingredients includes an increase operation and a decrease operation. The target display value is determined according to the following steps: when the operation type represents an increase operation, the target display value is determined as the sum of the previously stored quantity of ingredients and the target operation value; when the operation type represents a decrease operation, the target display value is determined as the difference between the previously stored quantity of ingredients and the target operation value.

[0237] In some embodiments, when the target measurement unit and the previously stored measurement unit are both weight units, the step of determining the target display value further includes: judging whether the target measurement unit and the previously stored measurement unit are consistent; when the target measurement unit and the previously stored measurement unit are inconsistent, converting the previously stored ingredient quantity into an intermediate value measured in the target measurement unit; and determining the target display value based on the target operation value and the intermediate value.

[0238] In some embodiments, when the operation type represents an operation of modifying the quantity of previously stored ingredients, if the target measurement unit does not match the previously stored measurement unit category, a predetermined prompt message is displayed to remind the user that the shelf life of the ingredients cannot be operated according to the input voice command.

[0239] S114: Use the target display value and the target measurement unit as input content corresponding to the ingredient quantity, and display them in the ingredient editing interface.

[0240] In some embodiments, the method provided by the embodiments of the present application further includes: using the target display value and target measurement unit to update the previously stored ingredient quantity value and measurement unit.

[0241] It can be seen from the above embodiments that, based on the voice control method provided by the embodiments of the present application, when the ingredient editing interface is displayed, the user can input or modify the quantity of ingredients by inputting a voice command. Among them, when inputting the quantity of ingredients through voice control, even if the quantity measurement unit displayed in the ingredient editing interface is inconsistent with the quantity measurement unit in the user's voice command, the input operation can be completed, and the user does not need to enter the voice command according to the displayed quantity measurement unit, but only needs to say the quantity measurement unit in the preset measurement unit. When modifying the quantity of previously stored ingredients through voice control, the modification operation can be completed only if the quantity measurement unit in the user's voice command matches the category of the previously stored measurement unit, without the need for the quantity measurement unit in the user's voice command to be completely consistent with the previously stored measurement unit. When the quantity measurement unit spoken by the user is inconsistent with the currently displayed default measurement unit, the refrigerator will display it according to the quantity measurement unit spoken by the user to improve the user experience.

[0242] In a specific implementation, the present invention further provides a computer storage medium, wherein the computer storage medium may store a program that, when executed, may include some or all of the steps of each embodiment of the method for editing food information provided by the present invention. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

[0243] Those skilled in the art will clearly understand that the techniques in the embodiments of the present invention can be implemented using software plus a necessary general-purpose hardware platform. Based on this understanding, the technical solutions in the embodiments of the present invention, or the portion that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium such as ROM / RAM, a magnetic disk, or an optical disk, and includes a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods described in various embodiments of the present invention or certain portions of the embodiments.

[0244] In this specification, the same or similar parts between the various embodiments can be referred to each other. In particular, for the refrigerator embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description in the method embodiment.

[0245] The above-described embodiments of the present invention do not limit the protection scope of the present invention.

Claims

1. A display device, characterized in that: include: A display for presenting a user interface; the user interface includes an ingredient editing interface; The ingredient editing interface displays input items corresponding to the ingredient quantity, and the input items include numerical values, measurement units and ingredient shelf life; A voice collector, used to receive voice commands input by users; The voice command is used to operate the quantity of ingredients, and the operation includes at least an input operation and a modification operation; according to the operation type and the target operation data, a target display value measured in a target measurement unit is determined; The controller connected to the display and the sound collector is configured to: When the food editing interface is displayed, receiving a voice command input by the user through the sound collector; Parsing the voice command to obtain ingredient parameters for operating the ingredients; The ingredient parameters include an operation type and target operation data for manipulating the ingredient quantity, wherein the target operation data includes a target operation value and a target measurement unit. The voice command is further configured to, when the operation type represents a modification operation, determine whether the target measurement unit matches a previously stored measurement unit category; and, if the target measurement unit matches the previously stored measurement unit category, determine whether the target measurement unit is consistent with the measurement unit category. Determining the input content of the ingredients according to the ingredient parameters; The food is provided with an RFID tag, the RFID tag is provided with a tag code, and the tag code includes at least two code segments; The input content corresponding to the ingredient is displayed on the ingredient editing interface.

2. The display device according to claim 1, wherein The controller is further configured to: Obtaining the food parameters; When the target operation data of the food in the voice command is inconsistent with the previously stored measurement unit record, determining whether the target measurement unit is a preset measurement unit, and determining whether the target operation value falls within the preset allowable operation range of the target measurement unit; detecting that the target measurement unit is a preset measurement unit and the target operation value falls within the allowable operation range, and determining whether the target measurement unit matches a previously stored measurement unit category; When the target measurement unit matches a previously stored measurement unit category, if the operation type represents an operation of inputting the quantity of ingredients, determining the target display value to be the target operation value; If the operation type represents an operation of modifying a previously stored quantity of ingredients, determining a target display value according to the target operation value and the previously stored quantity of ingredients; The target display value and the target measurement unit are used as input content corresponding to the ingredient quantity, and the input content is displayed in the ingredient editing interface.

3. The display device according to claim 2, wherein When the operation type represents an operation of modifying the quantity of previously stored ingredients, the controller is further configured to: Determining whether the target measurement unit is consistent with a previously stored measurement unit, wherein the measurement unit includes at least a weight unit, a singular measurement unit, and a plural measurement unit; If the target measurement unit is consistent with the previously stored measurement unit, it is determined that the categories of the target measurement unit and the previously stored measurement unit match.

4. The display device according to claim 3, wherein The operation of modifying the previously stored quantity of ingredients includes an increase operation and a decrease operation; the controller is further configured to determine the target display value according to the following steps: When the operation type represents the increase operation, adding the previously stored ingredient quantity value to the target operation value, and determining the result of the addition as the target display value; When the operation type represents the reduction operation, the previously stored ingredient quantity value is subtracted from the target operation value, and the subtraction result is determined as the target display value.

5. The display device according to claim 4, wherein: When the target measurement unit and the previously stored measurement unit are both weight units, the controller determines the target display value, and is further configured to: Determining whether the target measurement unit is consistent with a previously stored measurement unit; When the target measurement unit is inconsistent with the previously stored measurement unit, converting the previously stored quantity of the food into an intermediate value measured in the target measurement unit; The target display value is determined according to the target operation value and the intermediate value.

6. The display device according to claim 2, wherein: The controller is further configured to: When the operation type represents an operation of modifying the quantity of previously stored ingredients, if the target measurement unit does not match the previously stored measurement unit category, a predetermined prompt message is displayed above the ingredient editing interface to remind the user that the shelf life of the ingredient cannot be operated according to the input voice command.

7. The display device according to claim 1, wherein The controller is further configured to: Acquire the food parameter, where the food parameter includes a target operation type and first operation data for operating the shelf life of the food, where the first operation data includes a first operation value and a first time unit; Determine second operation data corresponding to the first operation data, where the second operation data includes a second operand value and a second time unit, and the second time unit is a preset time unit; According to the target operation type and the second operation data, the input content corresponding to the shelf life of the food is displayed in the food editing interface.

8. The display device according to claim 7, wherein: The controller performs the step of determining second operation data corresponding to the first operation data, and is further configured to: When the first time unit is consistent with a preset time unit and the first operand value is an integer, determining the first time unit as a second time unit, and determining the first operand value as a second operand value; When the first time unit is inconsistent with a preset time unit, or the first operand value is not an integer, the first operand value is converted into a second operand value measured in the preset time unit, and the second operand value is an integer.

9. The display device according to claim 8, wherein The preset time unit includes a month and a day; and the controller performs the step of converting the first operand value into a second operand value measured in the preset time unit when the first time unit is inconsistent with the preset time unit or the first operand value is not an integer, and is further configured to: When the first time unit is a year or a month, converting the first operand value into a second operand value with a month or a day as a unit of measurement; When the first time unit is a week or a day, the first operand value is converted into a second operand value with days as a measurement unit.

10. The display device according to claim 7, wherein: The controller performs the step of displaying the input content corresponding to the shelf life of the food in the food editing interface according to the target operation type and the second operation data, and is further configured to: determining display data according to the target operation type and the second operation data, the display data including a display value and the second time unit; The display data is displayed in the food editing interface as input content corresponding to the food shelf life.

11. The display device according to claim 10, wherein: The target operation type includes an extension operation, a shortening operation, and a setting operation. The controller performs the step of determining display data according to the target operation type and the second operation data, and is further configured to: When the target operation type is the setting operation, determining the second operand value as the display value; When the target operation type is the extension operation, adding the previously stored shelf life value to the second operation value, and determining the displayed value according to the result of the addition; When the target operation type is the shortening operation, the previously stored shelf life value is subtracted from the second operation value, and the displayed value is determined according to the subtraction result.

12. The display device according to claim 11, wherein The controller performs the step of adding a previously stored shelf life value and a second operation value when the target operation type is the extension operation, and determining the display value based on the addition result, and is further configured to: Converting the previously stored shelf life value and the second operand value into a first intermediate value and a second intermediate value using intermediate time units as measurement units, respectively; Adding the first intermediate value and the second intermediate value to obtain an intermediate sum using the intermediate time unit as a measurement unit; The intermediate sum is converted into a display value using the second time unit as a measurement unit.

13. The display device according to claim 12, wherein: The controller, when the target operation type is the shortening operation, performs the step of subtracting the previously stored shelf life value from the second operand value and determining the displayed value based on the subtraction result, and is further configured to: convert the previously stored shelf life value and the second operand value into a first intermediate value and a second intermediate value respectively, each of which is measured in an intermediate time unit; subtracting the first intermediate value from the second intermediate value to obtain an intermediate difference measured in the intermediate time unit; The intermediate difference is converted into a display value using the second time unit as a measurement unit.

14. The display device according to claim 13, wherein: The controller is further configured to: Converting the displayed value into a shelf life value using a preset storage time unit as a measurement unit; the storage time is consistent with the unit of the intermediate time; when the target operation type is the setting operation, converting the displayed value into a shelf life value using the storage time unit as a measurement unit, and saving the obtained shelf life value in the food information; When the target operation type is the shortening operation, using the intermediate difference to update the previously stored shelf life value; When the target operation type is the extension operation, the intermediate sum is used to update the previously stored shelf life value.

15. The display device according to claim 1, wherein The controller is further configured to: receiving an input RFID tag editing instruction and detecting an RFID tag on a tag reading area; When an RFID tag on the tag reading area is detected, a user interface including an ingredient editing interface and a voice recognition interface is displayed, and the input voice content is recognized, wherein the ingredient editing interface is used to display the input ingredient information, and the voice recognition interface includes an input prompt and the recognized voice content; According to the recognized voice content, the input ingredient information is displayed in the ingredient editing interface.

16. The display device according to claim 15, wherein: The ingredient editing interface includes at least one ingredient editing item, and the ingredient editing item includes item content to be updated; the controller performs the step of displaying the input ingredient information in the ingredient editing interface according to the recognized voice content, and is further configured to: The item content of the food editing item is updated according to the recognized voice content.

17. The display device according to claim 16, wherein: The controller is further configured to: Obtaining a tag code obtained by detecting the RFID tag, wherein the tag code includes a code segment for indicating whether the RFID tag is a custom tag; Determining whether the RFID tag is a custom tag according to the tag code; If the RFID tag is a custom tag, using preset default characters as item content of each ingredient editing item, and displaying the item content in the ingredient editing interface; If the RFID tag is not a custom tag, the preset food information of the RFID tag is obtained according to the tag code, and the preset food information is used as the item content of each food editing item, and the item content is displayed in the food editing interface.

18. The display device according to claim 15, wherein The controller is further configured to: In response to the input preset voice command, determining whether the currently displayed user interface is an ingredient editing interface, the ingredient editing interface being used to display the input ingredient information; If the currently displayed user interface is not the ingredient editing interface, a tag scanning interface is displayed, wherein the tag scanning interface includes a scanning prompt for prompting the user to place the RFID tag to be edited in the tag reading area; when an RFID tag placed in the tag reading area is detected, the ingredient editing interface is displayed according to the voice content included in the preset voice command; If the currently displayed user interface is an ingredient editing interface, the ingredient editing interface is updated according to the voice content included in the preset voice instruction.

19. A method for editing food information, characterized in that: Applied to a display device, the display device comprising at least a display and a sound collector, the display being used to present a user interface; the user interface comprising an ingredient editing interface; the ingredient editing interface displaying input items corresponding to ingredient quantities, the input items comprising numerical values, measurement units, and ingredient shelf life; The sound collector is used to receive a voice command input by a user, wherein the voice command is used to operate the quantity of ingredients, wherein the operation includes at least an input operation and a modification operation; and a target display value measured in a target measurement unit is determined according to the operation type and target operation data; The food information editing method includes: When the food editing interface is displayed, the voice command input by the user is received through the sound collector; parsing the voice command to obtain ingredient parameters for operating the ingredient; the ingredient parameters include an operation type and target operation data for operating the ingredient quantity, the target operation data including a target operation value and a target measurement unit; the voice command is further used to, when the operation type represents a modification operation, determine whether the target measurement unit matches a previously stored measurement unit category; and, if the target measurement unit matches the previously stored measurement unit category, determine whether the target measurement unit is consistent with the measurement unit category; Determining the input content of the food according to the food parameter; the food is provided with an RFID tag, the RFID tag is provided with a tag code, and the tag code includes at least two code segments; The input content corresponding to the ingredient is displayed on the ingredient editing interface.

Citation Information

Patent Citations

  • Information generation method and device

    CN105091499A

  • Automatic vending machine

    JP2005115610A