Article recording method, device, apparatus, storage medium, and program product

Abstract

This application relates to a method, apparatus, computer device, computer-readable storage medium, and computer program product for recording items. The method includes: in response to an image input event, acquiring an image of an item containing an ingested target item; displaying item elements corresponding to the ingested target item and corresponding item information; wherein the item elements include an image of the target item identified from the item image, and the item information includes calorie information and / or nutritional information of the target item. This method can improve the richness of the recorded item content.

Description

Technical Field

[0001] This application relates to the field of data processing technology, and in particular to a method, apparatus, computer equipment, computer-readable storage medium, and computer program product for recording articles. Background Technology

[0002] With increasing health awareness, people are paying more and more attention to healthy eating. Therefore, there is an urgent need for a method to record the items consumed.

[0003] In existing technologies, users can take pictures of ingested items and record the ingested items by recognizing the images taken by the user.

[0004] However, this method suffers from the problem of limited item recording content, which negatively impacts the user experience. Summary of the Invention

[0005] Therefore, it is necessary to provide a method, apparatus, computer device, computer-readable storage medium, and computer program product that can improve the richness of the recorded content and thus enhance the user experience, in order to address the aforementioned technical problems.

[0006] Firstly, this application provides a method for recording items, including:

[0007] In response to an image input event, acquire an image of the object containing the ingested target object;

[0008] Displays the item elements and corresponding item information for the target item;

[0009] The item element includes an image of the target item identified from the item image, and the item information includes the target item's calorie information and / or nutritional information.

[0010] In one embodiment, displaying the item elements and corresponding item information of the target item includes: performing recognition processing on the item image to segment the item elements containing the target item from the item image and obtaining the item information corresponding to the target item; and displaying the item elements and item information on the item recognition interface.

[0011] In one embodiment, the method further includes: after acquiring the object image, displaying the object image in the object recognition interface; playing an object recognition visual effect based on the object image, and displaying object elements and object information in the object recognition interface after the object recognition visual effect finishes playing.

[0012] In one embodiment, an item recognition visual effect is played based on an item image, and after the item recognition visual effect finishes playing, item elements and item information are displayed on the item recognition interface. This includes: playing an item segmentation visual effect for a target item in the item image; after the item segmentation visual effect finishes playing, playing a background switching visual effect; and after the background switching visual effect finishes playing, displaying item elements and item information in the form of streaming data based on the switched background.

[0013] In one embodiment, a background switching visual effect is played, and after the background switching visual effect finishes playing, the item elements and item information are displayed in the form of streaming data based on the switched background, including: playing a first background switching visual effect to switch the background of the item elements from the background of the item image to the first background, the color tone of the first background being determined based on the item elements; playing a second background switching visual effect to switch the background of the item elements from the first background to the second background, and displaying the item elements and item information in the form of streaming data based on the second background.

[0014] In one embodiment, the method further includes: displaying, in the item recording interface, the item elements and item information corresponding to at least one target item taken during the target recording period.

[0015] In one embodiment, the item recording interface includes a first item recording interface, which includes an item recording calendar. The item recording calendar includes multiple recording dates. The item recording interface displays the item elements and item information corresponding to at least one target item captured within a target recording period. This includes: displaying the selected target recording date in the item recording calendar with a target display effect; and displaying the item elements and item information corresponding to at least one target item captured within the target recording period corresponding to the target recording date in the first item recording interface.

[0016] In one embodiment, the item recording calendar includes calorie icons corresponding to a plurality of recording dates. The calorie icons are used to indicate the relationship between the total calories of the target item consumed and a preset calorie count during the target recording period corresponding to the recording date of the calorie icon.

[0017] In one embodiment, the first item recording interface further includes a preset calorie count and the total calorie count of the target item consumed within the target recording period corresponding to the target recording date; the method further includes: in response to a trigger operation on the preset calorie count, displaying a first editing control for editing the preset calorie count; in response to a preset operation on the first editing control, obtaining the edited preset calorie count, and adjusting the calorie icon based on the edited preset calorie count.

[0018] In one embodiment, the item recording interface includes a second item recording interface, which includes second time period indication information. The item recording interface displays item elements and item information corresponding to at least one target item ingested during the target recording time period, including: displaying item elements and item information corresponding to at least one target item ingested during the target recording time period corresponding to multiple recording dates indicated by the second time period indication information.

[0019] In one embodiment, the method further includes: displaying a first interface switching control, a second interface switching control, and an image input control; displaying a first item recording interface in response to a trigger operation on the first interface switching control; displaying a second item recording interface in response to a trigger operation on the second interface switching control; displaying an image input interface in response to a trigger operation on the image input control, and detecting an image input event based on the image input interface.

[0020] In one embodiment, the method further includes: in response to a triggering operation on an item element, displaying at least one of a second editing control for editing the item element, a download control for downloading the item element, and a share control for sharing the item element.

[0021] Secondly, this application also provides an article recording device, comprising:

[0022] The acquisition module is used to acquire an image of the object containing the ingested target object in response to an image input event;

[0023] The display module is used to display the item elements and corresponding item information of the target item;

[0024] The item element includes an image of the target item identified from the item image, and the item information includes the target item's calorie information and / or nutritional information.

[0025] Thirdly, this application also provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps of the method described in any of the embodiments of the first aspect above.

[0026] Fourthly, this application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the method described in any of the embodiments of the first aspect above.

[0027] Fifthly, this application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the method described in any of the embodiments of the first aspect above.

[0028] The aforementioned item recording method, apparatus, computer equipment, computer-readable storage medium, and computer program product, in response to an image input event, acquire an item image containing the ingested target item; display the item elements corresponding to the target item and the corresponding item information; wherein, the item elements include the image of the target item identified from the item image, and the item information includes the calorie information and / or nutritional information of the target item. The item recording method provided in this application not only displays the item information of the target item identified from the item image, and the item information may include the calorie information and / or nutritional information of the target item, but also displays the item elements corresponding to the target item identified from the item image, and the item elements include the image of the target item, effectively improving the richness of the item recording content, thereby enhancing the user experience. Attached Figure Description

[0029] To more clearly illustrate the technical solutions in the embodiments of this application or related technologies, the drawings used in the description of the embodiments of this application or related technologies will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0030] Figure 1 This is a diagram illustrating the application environment of an item recording method in one embodiment;

[0031] Figure 2 This is a flowchart illustrating an item recording method in one embodiment;

[0032] Figure 3 This is a schematic diagram of an item image in one embodiment;

[0033] Figure 4 This is a schematic diagram of an item element in one embodiment;

[0034] Figure 5 This is a schematic diagram of an item element in another embodiment;

[0035] Figure 6 This is a schematic diagram of item elements and item information in one embodiment;

[0036] Figure 7 This is a schematic diagram of item elements and item information in another embodiment;

[0037] Figure 8 This is a schematic diagram of item elements and item information in another embodiment;

[0038] Figure 9 This is a sequence diagram illustrating item elements and item information in one embodiment;

[0039] Figure 10 This is a flowchart illustrating a method for demonstrating the item elements and corresponding item information of a target item in one embodiment;

[0040] Figure 11 This is a schematic diagram of an item recognition interface in one embodiment;

[0041] Figure 12 This is a schematic diagram of an item recognition interface in another embodiment;

[0042] Figure 13 This is a schematic diagram of an item recognition interface in another embodiment;

[0043] Figure 14 This is a timing diagram illustrating a method for displaying item elements and item information in one embodiment;

[0044] Figure 15 This is a flowchart illustrating the method after obtaining an image of an item in one embodiment;

[0045] Figure 16 This is a schematic diagram of an item recognition interface in another embodiment;

[0046] Figure 17 This is a schematic diagram illustrating the process of displaying item elements and item information in one embodiment;

[0047] Figure 18 This is a timing diagram illustrating a method for displaying item elements and item information in one embodiment;

[0048] Figure 19 This is a flowchart illustrating a method for displaying item elements and item information in one embodiment;

[0049] Figure 20 This is a schematic diagram illustrating the process of playing a visual effect of item segmentation for a target item in an item image in one embodiment;

[0050] Figure 21 This is a schematic diagram illustrating the process of displaying item elements and item information in the form of streaming data in one embodiment.

[0051] Figure 22 This is a schematic diagram illustrating the process of displaying item elements and item information in the form of streaming data in one embodiment.

[0052] Figure 23 This is a timing diagram illustrating a method for displaying item elements and item information in one embodiment;

[0053] Figure 24 This is a flowchart illustrating a method for displaying item elements and item information in the form of streaming data in one embodiment.

[0054] Figure 25 This is a schematic diagram illustrating the process of switching the background of an item element from the background of the item image to a first background in one embodiment.

[0055] Figure 26 This is a schematic diagram illustrating the process of displaying item elements and item information in the form of streaming data based on a second background in one embodiment.

[0056] Figure 27 This is a schematic diagram illustrating the process of displaying item elements and item information in the form of streaming data based on a second background in one embodiment.

[0057] Figure 28 This is a timing diagram illustrating a method for displaying item elements and item information in one embodiment;

[0058] Figure 29 This is a schematic diagram of an item recording interface in one embodiment;

[0059] Figure 30 This is a schematic diagram of an item recording interface in one embodiment;

[0060] Figure 31 This is a timing diagram illustrating a method for displaying item elements and item information in one embodiment;

[0061] Figure 32 This is a flowchart illustrating a method for recording at least one target item and its corresponding item elements and information during a target recording period, as shown in one embodiment.

[0062] Figure 33 This is a schematic diagram illustrating the process of selecting a target record date in one embodiment;

[0063] Figure 34 This is a schematic diagram of the first item recording interface in one embodiment;

[0064] Figure 35 This is a schematic diagram of the first item recording interface in one embodiment;

[0065] Figure 36 This is a schematic diagram of the first item recording interface in one embodiment;

[0066] Figure 37 This is a schematic diagram of the first item recording interface in one embodiment;

[0067] Figure 38 This is a timing diagram illustrating a method for displaying item elements and item information in one embodiment;

[0068] Figure 39 This is a flowchart illustrating an item recording method in one embodiment;

[0069] Figure 40 This is a schematic diagram illustrating the process of creating the first editing control in one embodiment;

[0070] Figure 41 This is a schematic diagram illustrating the prompting process in one embodiment;

[0071] Figure 42 This is a timing diagram of a method for adjusting a heat icon in one embodiment;

[0072] Figure 43 This is a schematic diagram of the second item recording interface in one embodiment;

[0073] Figure 44 This is a schematic diagram of the second item recording interface in one embodiment;

[0074] Figure 45 This is a schematic diagram of the second item recording interface in one embodiment;

[0075] Figure 46 This is a timing diagram illustrating a method for displaying item elements and item information in one embodiment;

[0076] Figure 47 This is a flowchart illustrating an item recording method in one embodiment;

[0077] Figure 48 This is a schematic diagram of the first item recording interface in one embodiment;

[0078] Figure 49 This is a schematic diagram of the second item recording interface in one embodiment;

[0079] Figure 50 This is a schematic diagram illustrating the process of the first item recording interface in one embodiment;

[0080] Figure 51 This is a schematic diagram illustrating the process of the second item recording interface in one embodiment;

[0081] Figure 52 This is a schematic diagram illustrating the image input interface process in one embodiment;

[0082] Figure 53 This is a schematic diagram illustrating the image input interface process in one embodiment;

[0083] Figure 54 This is a timing diagram illustrating a method for a first item recording interface / a second item recording interface / an image input interface in one embodiment;

[0084] Figure 55 This is a schematic diagram illustrating the process of using the second editing control in one embodiment;

[0085] Figure 56This is a schematic diagram illustrating the process of downloading the control in one embodiment;

[0086] Figure 57 This is a schematic diagram illustrating the process of the sharing control in one embodiment;

[0087] Figure 58 This is a schematic diagram illustrating the process of a second editing control, a download control, and a share control in one embodiment;

[0088] Figure 59 This is a schematic diagram of the details interface of a target item in one embodiment;

[0089] Figure 60 This is a schematic diagram of the details interface of a target item in one embodiment;

[0090] Figure 61 This is a schematic diagram of the details interface of a target item in one embodiment;

[0091] Figure 62 This is a schematic diagram of sharing an image in one embodiment;

[0092] Figure 63 This is a schematic diagram of sharing an image in one embodiment;

[0093] Figure 64 This is a schematic diagram of sharing an image in one embodiment;

[0094] Figure 65 This is a structural block diagram of an item recording device in one embodiment;

[0095] Figure 66 This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation

[0096] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0097] Before describing the embodiments of this application, it should be noted that the term "in response to" as used herein refers to a state in which a corresponding event occurs or a condition is met. It will be understood that the timing of subsequent actions performed in response to an event or condition is not necessarily strongly correlated with the time when the event occurs or the condition is met. For example, in some cases, subsequent actions may be performed immediately upon the occurrence of the event or the fulfillment of the condition; while in other cases, subsequent actions may be performed some time after the occurrence of the event or the fulfillment of the condition. "Triggering operation" refers to an action performed by a user on a visual interface through clicking, dragging, swiping, or other interactive methods, which aims to initiate or activate a specific data display, analysis, or editing function. "First," "second," etc., can be used to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish between the first element and the second element. The terms "comprising" and "having," and any variations thereof, as used in this application, are intended to cover non-exclusive inclusion. The term "multiple" as used in this application refers to two or more. The term "and / or" as used in this application refers to one of the solutions, or any combination of multiple solutions.

[0098] With increasing health awareness, people are paying more and more attention to healthy eating. Therefore, there is an urgent need for a method to record the items consumed.

[0099] In existing technologies, users can take pictures of ingested items and record the ingested items by recognizing the images taken by the user.

[0100] However, after recognizing the images taken by the user, this method mostly only outputs information such as the name and calories of the ingested items, resulting in a relatively simple record of items and affecting the user experience.

[0101] In view of this, this application provides an item recording method that, in response to an image input event, acquires an item image containing the ingested target item; displays the item elements corresponding to the target item and the corresponding item information; wherein, the item elements include the image of the target item identified from the item image, and the item information includes the calorie information and / or nutritional information of the target item. The item recording method provided by this application not only displays the item information of the target item identified from the item image, and the item information may include the calorie information and / or nutritional information of the target item, but also displays the item elements corresponding to the target item identified from the item image, and the item elements include the image of the target item, effectively improving the richness of the item recording content and thus enhancing the user experience.

[0102] The item recording method provided in this application embodiment can be applied to, for example, Figure 1In the application environment shown, terminal 102 may have at least one target application with item recording function installed. Users can use the target application to record items. During the item recording process, terminal 102 may send the item image to server 104 for item recognition, or terminal 102 may perform item recognition on the item image.

[0103] Furthermore, this application does not limit the form of the target application; it can be a parent application running on the operating system, or a sub-application running within the parent application, such as a mini-program, or it can be a webpage.

[0104] Terminal 102 can communicate with server 104 via a communication network. A data storage system can store the data that server 104 needs to process. The data storage system can be integrated onto server 104, or it can be located in the cloud or on other network servers. Terminal 102 can be, but is not limited to, various personal computers, laptops, smartphones, tablets, and portable wearable devices, such as smartwatches, smart bracelets, and head-mounted devices. Server 104 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud computing services.

[0105] In one exemplary embodiment, such as Figure 2 As shown, an item recording method is provided, which can be applied to... Figure 1 Taking the terminal in the example, the explanation includes the following steps:

[0106] Step 201: In response to the image input event, acquire an image of the object containing the ingested target object.

[0107] Optionally, the image input event can be used to input an image of an item.

[0108] For example, if the item image is an image containing the target item taken by the terminal, the item image may be an image pre-taken by the terminal and stored in the album. When there is a need to record the item, the user can open the target application installed on the terminal and input the item image in the album into the target application through the operation of "open album - browse images - select item image". The operation of selecting the item image is the image input event.

[0109] If the item image is an image containing the target item captured by the terminal, the item image can also be an image captured in real time by the terminal. When a user has a need to record items, they can open the target application installed on the terminal and take a picture of the target item to use the captured image as the item image. The operation of taking a picture of the target item is the image input event.

[0110] If the item image is an image containing the target item downloaded from a network platform using the terminal, or an image containing an item that perfectly matches the target item obtained using the terminal's screenshot function, then the item image will be stored in the terminal's photo album. When a user needs to record an item, they can open the target application installed on the terminal and input the item image from the album into the target application by performing the operation of "open photo album - browse images - select item image". The operation of selecting the item image is the image input event.

[0111] Optionally, the target item can be an edible food product to be consumed by the user. For example, the target item can be a daily meal item, such as rice, noodles, stir-fried dishes, porridge, bread, etc.; the target item can also be a fresh food item, such as green vegetables, beef, eggs, apples, bananas, etc.; the target item can also be a processed food item, such as biscuits, yogurt, canned food, potato chips, etc.; the target item can also be a beverage item, such as purified water, juice, coffee, tea, etc.; the target item can also be a dietary supplement item, such as vitamin tablets, protein powder, fish oil capsules, etc.

[0112] In some exemplary embodiments, the terminal may acquire an image of an object containing the ingested target object in response to an image input event.

[0113] Specifically, after detecting an image input event, the terminal can retrieve the image of the selected item from the terminal's photo album, or it can directly retrieve the image of the item generated in real time by the terminal's camera.

[0114] In an optional embodiment of this application, in response to an image input event, an object image and its metadata information can also be obtained.

[0115] Optionally, the metadata information may include time information indicating when the image of the object was taken, and location information indicating the location where the image of the object was taken.

[0116] The time information can be used to summarize target items consumed within the same time period to generate summarized item information, which may include total calorie and / or total nutritional information of the target items consumed within the same time period. Time information can also be used to sort item elements and information based on time during the display of item elements and information. Location information can be used to generate item recommendation information. For example, the terminal can determine the user's geographical location based on location information to generate location-specific item recommendations.

[0117] Step 202: Display the item elements and corresponding item information of the target item.

[0118] Optionally, the item element may include an image of the target item identified from the item image.

[0119] The item image can be a user-provided image containing the target item. For example, the item image can be an image captured by the terminal, such as a photograph of the target item taken directly using the terminal's camera; the item image can also be an image downloaded from a network platform using the terminal, such as product images or display images of the target item downloaded from e-commerce platforms, food sharing platforms, or search engines; the item image can also be an image obtained using the terminal's screenshot function, containing an item that perfectly matches the target item, such as an image captured using the terminal's screenshot function from a product details page, food video, or recipe interface displayed on the terminal's screen containing an item that perfectly matches the target item.

[0120] The image of the target item can be used to indicate the target item. For example, the image of the target item can be a real image of the target item identified and extracted from an image of an item; or the image of the target item can be a preset image corresponding to the name of the target item obtained from a preset image library after identifying the name of the target item from the image of an item.

[0121] Furthermore, the item element can be an image of the target item identified from the item image. That is, after identifying and extracting the real image of the target item from the item image, the real image of the target item can be directly used as the item element. Alternatively, after obtaining a preset image corresponding to the name of the target item from a preset item image library, the preset image can be directly used as the item element. Item elements can also be generated based on the image of the target item identified from the item image. For example, after obtaining the image of the target item identified from the item image, a border style can be added to the image of the target item to generate the item element. In an optional approach, the item element can be a sticker.

[0122] Optionally, the item information may include the target item's calorie information and / or nutritional information.

[0123] Caloric information can be used to indicate the energy supply value of a target item, that is, the energy a user can obtain after consuming the target item. For example, caloric information can be the unit calories, total calories, and recommended caloric intake of the target item.

[0124] Nutritional information may include the nutritional components of the target product, the content of each nutrient, and the recommended intake. For example, nutritional components may include protein, carbohydrates, fat, dietary fiber, sugars, and sodium. Optionally, nutritional components may further include vitamins, calcium, iron, zinc, and other minerals.

[0125] In some exemplary embodiments, the terminal can display the item elements and corresponding item information corresponding to the ingested target item.

[0126] For example, the image of the item can be as follows: Figure 3 As shown, where, Figure 3 301 in the text refers to the target item. The item's elements can be like... Figure 4 As shown, Figure 4 The item elements shown are from Figure 3 The system identifies and extracts a real image of the target item. Furthermore, the item elements can also be... Figure 5 As shown, Figure 5 The item elements shown are from Figure 3 After identifying and extracting the real image of the target item, a border style is added to the image of the target item.

[0127] Furthermore, such as Figure 6 As shown, Figure 6 This displays the item elements and corresponding item information for the target item being ingested. Figure 6 In this context, the item information only includes the calorie information of the target item; for example... Figure 7 As shown, Figure 7 This displays the item elements and corresponding item information for the target item being ingested. Figure 7 In this context, item information only includes the nutritional information of the target item; for example... Figure 8 As shown, Figure 8 This displays the item elements and corresponding item information for the target item being ingested. Figure 8 In the text, the item information includes the nutritional information and calorie information of the target item.

[0128] The aforementioned item recording method, in response to an image input event, acquires an image of the target item containing the ingested item; displays the item elements corresponding to the target item and the corresponding item information; wherein, the item elements include the image of the target item identified from the item image, and the item information includes the calorie information and / or nutritional information of the target item. The item recording method provided in this application not only displays the item information of the target item identified from the item image, and the item information may include the calorie information and / or nutritional information of the target item, but also displays the item elements corresponding to the target item identified from the item image, and the item elements include the image of the target item, effectively improving the richness of the item recording content, thereby enhancing the user experience.

[0129] In one embodiment, taking the method of displaying the item elements and corresponding item information of the target item through interaction between server 104 and terminal 102 as an example, that is, in Figure 1 This explanation is based on the application environment shown; see [link / reference]. Figure 9 The sequence diagram shown illustrates the item elements and corresponding item information for the target item being ingested, including:

[0130] Step 901: The terminal responds to the image input event and acquires an image of the object containing the ingested target object;

[0131] Step 902: The terminal generates a request to display item elements and a request to display item information;

[0132] Step 903: The terminal sends an item element display request and an item information display request to the server;

[0133] Step 904: The server responds to the item element display request and the item information display request, and determines the item element display data and the item information display data;

[0134] Step 905: The server sends item element display data and item information display data to the terminal;

[0135] Step 906: The terminal displays the item elements and item information based on the item element display data and item information display data.

[0136] In one exemplary embodiment, such as Figure 10 As shown, the display shows the item elements and corresponding item information for the target item, including the following steps:

[0137] Step 1001: Perform recognition processing on the item image to segment the item elements containing the target item from the item image and obtain the item information corresponding to the target item.

[0138] In some exemplary embodiments, after acquiring an image of an item, the terminal can perform recognition processing on the image of the item to segment the item elements containing the target item from the image of the item.

[0139] Specifically, the terminal can use image segmentation algorithms to recognize and process the image of the object in order to segment the object elements containing the target object from the image of the object.

[0140] The image segmentation algorithm can be a subject extraction algorithm provided by the terminal's operating system, which can identify and segment target objects in an object image. In an optional approach, the image segmentation algorithm does not require network support; that is, it can be executed even when the terminal is not connected to the network to perform the step of identifying and segmenting object elements containing the target object from the object image.

[0141] Furthermore, while performing recognition processing on the object image to segment the object elements containing the target object from the object image, the terminal simultaneously acquires the object information corresponding to the target object.

[0142] Specifically, the terminal can use a multimodal large model to obtain the item information corresponding to the target item. For example, the multimodal large model can be deployed on a server. The terminal can send an item image to the server. After receiving the item image, the server can input the item image into the multimodal large model to obtain the item information corresponding to the target item output by the multimodal large model. The server then sends the item information back to the terminal.

[0143] In an optional embodiment of this application, in practical applications, there may be cases where the items contained in the item image are not edible target items, that is, not food. In this case, the multimodal large model can execute a degradation strategy. The degradation strategy refers to the multimodal large model recognizing the item image and outputting the object name and related text description of the item contained in the item image. The server sends the object name and related text description of the item to the terminal, and the terminal can display the object name and related text description of the item.

[0144] For example, if the object image contains a doll, the multimodal large model output could be "teddy bear doll" or "This teddy bear looks hungry, should we feed it some honey?"

[0145] Step 1002: Display the item elements and item information on the item recognition interface.

[0146] In some exemplary embodiments, after acquiring the item elements and item information, the terminal can display the item elements and item information on the item recognition interface.

[0147] For example, the item recognition interface can be as follows: Figure 11 As shown. Further, as... Figure 12 As shown, in addition to displaying item elements and item information, the item recognition interface can also display the item name of the target item and dietary suggestions related to the target item. Furthermore, the key fields in the dietary suggestions are displayed more prominently than other fields. For example, the key fields in the dietary suggestions can be displayed with bold or highlighted effects.

[0148] Furthermore, such as Figure 13 As shown, the item recognition interface may also include a control area, which includes a confirmation control, a cancellation control, and an item editing control.

[0149] The confirmation control can be used to confirm item elements and item information, and to store and record these elements and information. For example, after a user confirms that the item elements and item information are correct, they can trigger the confirmation control. In response to the triggering operation of the confirmation control, the terminal can save the item elements and item information to the terminal's database and display them in the item element list for the day.

[0150] The cancel control can be used to cancel the storage and recording of item elements and item information. For example, in practical applications, there may be situations where a user browses the item information of a target item but then decides not to purchase it. In this case, the user can trigger the cancel control, and the terminal, in response to the trigger operation, can choose not to perform the storage and recording operation of the item elements and item information. Alternatively, in response to the trigger operation of the cancel control, the terminal can display the item elements and item information with a preset display effect, such as a gradually fading display effect.

[0151] The item editing control allows users to edit item elements and information. For example, when a user needs to adjust item elements and / or item information, the item editing control can be triggered. In response to this trigger, the terminal can display an item editing interface, allowing the user to edit item elements and information. This includes actions such as cropping item elements and modifying item information. In an alternative approach, after cropping an item element, the terminal can obtain new item information based on the cropped element. Specifically, the terminal can send the cropped item element to the server, which then determines the new item information based on the cropped element and sends it to the terminal.

[0152] In this embodiment, the object image is processed for recognition to segment the object elements containing the target object from the object image and obtain the object information corresponding to the target object. The method of displaying the object elements and object information on the object recognition interface not only displays the object information of the target object identified from the object image, but also displays the object elements corresponding to the target object identified from the object image, which effectively improves the richness of the object record content and thus improves the user experience.

[0153] In one embodiment, taking the method of displaying item elements and item information through interaction between server 104 and terminal 102 as an example, that is, in Figure 1 This explanation is based on the application environment shown; see [link / reference]. Figure 14 The sequence diagram shown illustrates the methods for displaying item elements and item information, including:

[0154] Step 1401: The terminal performs recognition processing on the item image and generates an item information display request;

[0155] Step 1402: The terminal sends an item information display request to the server;

[0156] Step 1403: The server responds to the item information display request and determines the item information display data;

[0157] Step 1404: The server sends item information display data to the terminal;

[0158] Step 1405: The terminal displays the item information and the item elements containing the target item by segmenting from the item image based on the item information display data.

[0159] In one exemplary embodiment, such as Figure 15 As shown, after obtaining the item image, the following steps are also included:

[0160] Step 1501: After obtaining the object image, display the object image in the object recognition interface.

[0161] In some exemplary embodiments, after acquiring an object image, the terminal can display the object image in an object recognition interface. This object recognition interface can be as follows: Figure 16 As shown.

[0162] Step 1502: Play the item recognition visual effect based on the item image, and after the item recognition visual effect finishes playing, display the item elements and item information on the item recognition interface.

[0163] Optionally, the object recognition visual effect can consist of one or more visual effects. For example, the object recognition visual effect can be a dynamic effect of horizontal or vertical scan lines overlaid on the object image, a ripple effect that gradually spreads outward from the target object, a subject extraction effect that highlights the outline and delineates the edges of the target object, a circular or bar-shaped animation loading effect, a gradual focusing effect that changes the object image from blurry to clear, or any combination of the above effects.

[0164] For example, as mentioned above, the item elements are obtained by the terminal using an image segmentation algorithm, and the item information is obtained by the terminal using a multimodal large model. Since the speed of obtaining item elements is faster than the speed of obtaining item information, the user's perceived waiting time can be shortened by playing the item recognition visual effect. Therefore, the playback speed of the item recognition visual effect is related to the speed of obtaining item information. Specifically, the playback of the item recognition visual effect ends after the terminal obtains the item information.

[0165] In some exemplary embodiments, after the terminal displays an object image in the object recognition interface, it can play an object recognition visual effect based on the object image, and after the object recognition visual effect finishes playing, it can display object elements and object information in the object recognition interface.

[0166] like Figure 17 The diagram shown illustrates the process of displaying item elements and item information. After acquiring the item image, the image is displayed in the item recognition interface 17-1, as shown below. Figure 17-2 As shown, an item recognition visual effect is played based on the item image, and after the item recognition visual effect finishes playing, the item elements and item information are displayed in the item recognition interface 17-3.

[0167] In this embodiment, after acquiring an object image, the object image is displayed on the object recognition interface; an object recognition visual effect is played based on the object image, and after the object recognition visual effect finishes playing, the object elements and object information are displayed on the object recognition interface. By playing the object recognition visual effect, the perceived waiting time for the user to receive object information is shortened, thus improving the user experience.

[0168] In one embodiment, taking the method of displaying item elements and item information through interaction between server 104 and terminal 102 as an example, that is, in Figure 1 This explanation is based on the application environment shown; see [link / reference]. Figure 18 The sequence diagram shown illustrates the methods for displaying item elements and item information, including:

[0169] Step 1801: The terminal displays the image of the object in the object recognition interface and generates a request to play the object recognition visual effect.

[0170] Step 1802: The terminal sends a request to the server to play the visual effects of object recognition.

[0171] Step 1803: The server responds to the object recognition visual effect playback request and determines the object recognition visual effect playback data;

[0172] Step 1804: The server sends the visual effect playback data for item recognition to the terminal;

[0173] Step 1805: The terminal plays data based on the object recognition visual effect and plays the object recognition visual effect based on the object image;

[0174] Step 1806: After the visual effect of object recognition is played, the terminal generates an object element display request and an object information display request.

[0175] Step 1807: The terminal sends an item element display request and an item information display request to the server;

[0176] Step 1808: The server responds to the item element display request and the item information display request, and determines the item element display data and the item information display data;

[0177] Step 1809: The server sends item element display data and item information display data to the terminal;

[0178] Step 1810: The terminal displays the item elements and item information on the item recognition interface based on the item element display data and item information display data.

[0179] In one exemplary embodiment, such as Figure 19 As shown, an object recognition visual effect is played based on the object image, and after the object recognition visual effect finishes playing, the object elements and object information are displayed on the object recognition interface, including the following steps:

[0180] Step 1901: Play the item segmentation visual effect for the target item in the item image.

[0181] Optionally, the object segmentation visual effect can consist of one or more visual effects. For example, the object segmentation visual effect can be an automatic outline and highlighting effect of the target object, a dynamic segmentation line effect that gradually sweeps across the edge of the target object, a mask gradient effect that distinguishes the target object area from the background area, a three-dimensional highlighting effect that separates the main body of the target object from the background and floats up, a semi-transparent color block filling mark effect of the area where the target object is located, or any combination of the above effects.

[0182] In some exemplary embodiments, the terminal can play an item segmentation visual effect for a target item in an item image.

[0183] like Figure 20 The diagram shown illustrates the process of playing a visual effect of object segmentation for a target object in an object image. Figure 20-1 As shown, starting from the bottom edge of the target object, a white outline is gradually generated upwards along the contour, as follows. Figure 20-2 As shown, the stroke continues upwards until it surrounds the target object, completing the outline of the target object, as... Figure 20-3 As shown, the outline of the target item gradually thickens, distinguishing the target item from the background area, as... Figure 20-4 As shown, the outline of the target item becomes thicker, while a glowing light wave effect is displayed around the target item. In an alternative approach, as the outline of the target item becomes even thicker and more solid, the light wave effect gradually fades and disappears.

[0184] Step 1902: After the item segmentation visual effect finishes playing, play the background switching visual effect. After the background switching visual effect finishes playing, display the item elements and item information in the form of streaming data based on the switched background.

[0185] Optionally, the background transition visual effect can consist of one or more visual effects. For example, the background transition visual effect can be a gradual blurring of the original background, a gradient effect of the background changing from a realistic scene to a solid color or gradient background, an overlay transition effect of the original background fading out and the new background gradually appearing, or any combination of the above effects.

[0186] Streaming data can be presented dynamically and sequentially according to a preset display order, rather than all at once. For example, if item information includes the target item's calorie and nutritional information, and the item elements and information are displayed as streaming data, the item elements can be displayed first, followed by the calorie information, and finally the nutritional information.

[0187] In some exemplary embodiments, after the item segmentation visual effect finishes playing, the terminal can play a background switching visual effect, and after the background switching visual effect finishes playing, display item elements and item information in the form of streaming data based on the switched background.

[0188] like Figure 21 The diagram shown illustrates the process of displaying item elements and item information in the form of streaming data based on the changed background. Figure 21-1 As shown, the terminal can play background switching visual effects, such as... Figure 21-2As shown, after the background transition visual effect finishes playing, the terminal can first display item elements based on the changed background, such as... Figure 21-3 As shown, the item information will then be displayed.

[0189] In one optional embodiment of this application, after the background switching visual effect finishes playing, the terminal displays item elements, item names, item information, and dietary suggestions in the form of streaming data based on the switched background.

[0190] like Figure 22 The diagram shown illustrates the process of displaying item elements, item names, item information, and dietary suggestions in the form of streaming data, based on the changed background. Figure 22-1 As shown, the terminal can first display item elements based on the changed background, such as... Figure 22-2 As shown, the item names are then displayed, such as... Figure 22-3 As shown, the item information will then be displayed, such as... Figure 22-4 As shown, dietary recommendations are presented at the end.

[0191] In this embodiment, a method is used to play an item segmentation visual effect for the target item in the item image; after the item segmentation visual effect finishes playing, a background switching visual effect is played; and after the background switching visual effect finishes playing, the item elements and item information are displayed in the form of streaming data based on the switched background. By playing the item segmentation visual effect, the background switching visual effect, and displaying the item elements and item information in the form of streaming data, the user's perceived waiting time can be effectively shortened, thereby improving the user experience.

[0192] In one embodiment, taking the method of displaying item elements and item information through interaction between server 104 and terminal 102 as an example, that is, in Figure 1 This explanation is based on the application environment shown; see [link / reference]. Figure 23 The sequence diagram shown illustrates the methods for displaying item elements and item information, including:

[0193] Step 2301: The terminal generates a request to play the visual effect of item segmentation;

[0194] Step 2302: The terminal sends a request to the server to play the visual effect of item segmentation;

[0195] Step 2303: The server responds to the item segmentation visual effect playback request and determines the item segmentation visual effect playback data;

[0196] Step 2304: The server sends the visual effect playback data of item segmentation to the terminal;

[0197] Step 2305: The terminal plays the visual effect of item segmentation in the item image based on the item segmentation visual effect playback data.

[0198] Step 2306: After the item segmentation visual effect finishes playing, the terminal generates a background switching visual effect playback request.

[0199] Step 2307: The terminal sends a background switching visual effect playback request to the server;

[0200] Step 2308: The server responds to the background switching visual effect playback request and determines the background switching visual effect playback data;

[0201] Step 2309: The server sends background switching visual effect playback data to the terminal;

[0202] Step 2310: The terminal plays the background switching visual effect playback data according to the background switching visual effect;

[0203] Step 2311: After the playback of the background switching visual effect ends, the terminal generates an item element display request and an item information display request.

[0204] Step 2312: The terminal sends an item element display request and an item information display request to the server;

[0205] Step 2313: The server responds to the item element display request and item information display request, and determines the item element display data and item information display data;

[0206] Step 2314: The server sends item element display data and item information display data to the terminal;

[0207] Step 2315: The terminal displays the item elements and item information in the form of streaming data based on the item element display data and item information display data, according to the background after the switch.

[0208] In one exemplary embodiment, such as Figure 24 As shown, a background transition visual effect is played, and after the effect ends, the item elements and item information are displayed as streaming data based on the changed background. This includes the following steps:

[0209] Step 2401: Play the first background switching visual effect to change the background of the item element from the background of the item image to the first background.

[0210] Optionally, the first background transition visual effect can consist of one or more visual effects. For example, the first background transition visual effect can be a transition effect where the original background of the object image fades out, a coverage effect where the first background is gradually filled with a solid color or gradient color, or a combination of any of the above effects.

[0211] Optionally, the hue of the first background can be determined based on the item element. For example, the hue of the first background can be determined based on the main color of the item element. For instance, if the main color of the item element is white, the hue of the first background can be white; if the main color of the item element is light yellow, the hue of the first background can be warm yellow, beige, etc.; and if the main color of the item element is a contrasting color, such as green, the hue of the first background can be light pink, light purple, etc.

[0212] In some exemplary embodiments, the terminal may play a first background switching visual effect, switching the background of the item element from the background of the item image to the first background.

[0213] like Figure 25 The diagram shown illustrates the process of switching the background of an item element from the background of the item image to the first background. Figure 25-1 As shown, the background of the item element is the item image, such as... Figure 25-2 As shown, the background of the item element changes from the item image to a first background. In an optional manner, after the background of the item element changes from the item image to the first background, the item element is scaled to a preset size and displayed with a preset display effect, which can be a ripple display effect. Furthermore, the first background can also display the shadow of the item element, and the first background can also display a texture.

[0214] Step 2402: Play the second background switching visual effect, switch the background of the item element from the first background to the second background, and display the item element and item information in the form of streaming data based on the second background.

[0215] Optionally, the second background transition visual effect can consist of one or more visual effects. For example, the second background transition visual effect can be a fade-out transition effect of the first background, a gradual filling effect of the second background with a solid color or gradient color, or a combination of any of the above effects.

[0216] Optionally, the color tone of the second background can be preset. For example, white, black, pink, etc.

[0217] In some exemplary embodiments, the terminal can play a second background switching visual effect, switch the background of the item element from the first background to the second background, and display the item element and item information in the form of streaming data based on the second background.

[0218] like Figure 26 The diagram shown illustrates the process of displaying item elements and item information in the form of streaming data based on a second background. Figure 26-1 As shown, the background of the item element is the primary background, such as... Figure 26-2 As shown, the second background slides up from the bottom of the terminal, covering and displaying on the first background, as... Figure 26-3 As shown, the second background slides upwards, covering and displaying on the first background, with item elements displayed on the second background, as... Figure 26-4 As shown, the background of the item element changes from the first background to the second background, as follows: Figure 26-5 As shown, item elements and item information are displayed as streaming data based on a second background. In one optional approach, after the second background appears, the item elements are scaled back to a new preset size, where the preset size displayed on the second background is smaller than the preset size displayed on the first background. Furthermore, during the transition from the first background to the second background, the item elements can be displayed with preset effects, such as a halo emanating from the item element that gradually diffuses and disappears, or a sweeping light effect. Additionally, the second background can also display a texture.

[0219] In an optional embodiment of this application, such as Figure 27 The diagram shown illustrates the process of displaying item elements and item information in the form of streaming data based on a second background. Figure 27-1 As shown, the terminal can display a second background with a breathing effect, and within this second background, it displays item elements, prompts, and a control area. This control area includes a confirmation control, a cancellation control, and an item editing control. The prompts include a looping animation and prompt text, displayed with a looping sweeping effect, and this prompt text indicates that item information is being generated. Figure 27-2 As shown, the terminal can display a second background, and within this second background, display item elements, item names, prompts, and control areas. Furthermore, the display position of the item elements within the second background is shifted upwards. Figure 27-3 As shown, the terminal can display a second background, and within this second background, display item elements, item names, item information, prompts, and control areas. Furthermore, the display position of the item elements and item names within the second background is shifted upwards. Figure 27-4As shown, the terminal can display a second background, and within the second background, it displays item elements, item names, item information, dietary suggestions, and control areas. The display positions of the item elements, item names, and item information within the second background are moved upwards.

[0220] In this embodiment, a first background switching visual effect is played, changing the background of the item element from the background of the item image to the first background, the color tone of the first background being determined based on the item element; a second background switching visual effect is played, changing the background of the item element from the first background to the second background, and the item element and item information are displayed in the form of streaming data based on the second background. By playing the first and second background switching visual effects and displaying the item element and item information in the form of streaming data, the user's perceived waiting time can be effectively shortened, thereby improving the user experience.

[0221] In one embodiment, taking the method of displaying item elements and item information through interaction between server 104 and terminal 102 as an example, that is, in Figure 1 This explanation is based on the application environment shown; see [link / reference]. Figure 28 The sequence diagram shown illustrates the methods for displaying item elements and item information, including:

[0222] Step 2801: The terminal generates a request to play the first background switching visual effect;

[0223] Step 2802: The terminal sends a request to the server to play the first background switching visual effect;

[0224] Step 2803: The server responds to the first background switching visual effect playback request and determines the first background switching visual effect playback data;

[0225] Step 2804: The server sends the first background switching visual effect playback data to the terminal;

[0226] Step 2805: The terminal plays the first background switching visual effect playback data according to the first background switching visual effect;

[0227] Step 2806: After the background of the item element changes from the background of the item image to the first background, the terminal generates a request to play the second background switching visual effect.

[0228] Step 2807: The terminal sends a request to the server to play the second background switching visual effect;

[0229] Step 2808: The server responds to the second background switching visual effect playback request and determines the second background switching visual effect playback data;

[0230] Step 2809: The server sends the playback data for the second background switching visual effect to the terminal;

[0231] Step 2810: The terminal plays the second background switching visual effect according to the second background switching visual effect playback data;

[0232] Step 2811: After the background of the item element is switched from the first background to the second background, the terminal generates an item element display request and an item information display request.

[0233] Step 2812: The terminal sends an item element display request and an item information display request to the server;

[0234] Step 2813: The server responds to the item element display request and item information display request, and determines the item element display data and item information display data;

[0235] Step 2814: The server sends item element display data and item information display data to the terminal;

[0236] Step 2815: The terminal displays the item elements and item information in the form of streaming data based on the second background, according to the item element display data and item information display data.

[0237] In an exemplary embodiment, the method further includes: displaying, in the item recording interface, the item elements and item information corresponding to at least one target item ingested during the target recording period.

[0238] Optionally, the target recording period can be a time interval used to divide the intake of target items. For example, the target recording period can be a single day, in which case the item recording interface can display the item elements and information corresponding to at least one target item ingested on that day; the target recording period can also be a single week, in which case the item recording interface can display the item elements and information corresponding to at least one target item ingested within that week; the target recording period can also be a single month, in which case the item recording interface can display the item elements and information corresponding to at least one target item ingested within that month.

[0239] In some exemplary embodiments, the terminal can display the item elements and item information corresponding to at least one target item taken during the target recording period in the item recording interface.

[0240] The item record interface can be like Figure 29 As shown, where, Figure 29 This displays the item elements and item information corresponding to a target item captured during the target recording period. Furthermore, the item recording interface can also... Figure 30As shown, where, Figure 30 This shows the item elements and item information corresponding to various target items ingested during the target recording period.

[0241] In this embodiment, the method of displaying the item elements and item information corresponding to at least one target item taken in during the target recording period in the item recording interface can realize the recording of the taken items. Moreover, the item recording interface not only displays item information but also item elements, which effectively improves the richness of the item recording content and thus enhances the user experience.

[0242] In one embodiment, taking the method of displaying item elements and item information through interaction between server 104 and terminal 102 as an example, that is, in Figure 1 This explanation is based on the application environment shown; see [link / reference]. Figure 31 The sequence diagram shown illustrates the methods for displaying item elements and item information, including:

[0243] Step 3101: The terminal generates requests for displaying the item record interface, displaying item elements, and displaying item information;

[0244] Step 3102: The terminal sends a request to the server to display the item record interface, an item element, and an item information.

[0245] Step 3103: The server responds to the item record interface display request, item element display request, and item information display request, and determines the item record interface display data, item element display data, and item information display data;

[0246] Step 3104: The server sends the item record interface display data, item element display data, and item information display data to the terminal;

[0247] Step 3105: The terminal displays the item recording interface based on the item recording interface display data, item element display data, and item information display data. In the item recording interface, the item elements and item information corresponding to at least one target item captured during the target recording period are displayed.

[0248] In one exemplary embodiment, such as Figure 32 As shown, the item recording interface includes a first item recording interface, which includes an item recording calendar. The item recording calendar includes multiple recording dates. The item recording interface displays the item elements and item information corresponding to at least one target item captured within the target recording period, including the following steps:

[0249] Step 3201: Display the selected target record date in the item record calendar with a target display effect.

[0250] Optionally, the item recording calendar can include multiple consecutive date units, and the number of record dates displayed in the item recording calendar is also fixed. For example, the item recording calendar can display seven record dates for a consecutive week; or, for example, the item recording calendar can display record dates for a consecutive month. In an optional manner, the terminal can switch between multiple record dates displayed in the item recording calendar in response to a swipe operation on the item recording calendar.

[0251] The recording date can be a date unit used to identify different time points in an item's record calendar. For example, the recording date can include a specific date, such as January 5th, February 14th, March 19th, etc. The recording date can also include the specific date and the corresponding day of the week, such as Thursday, March 19th, Friday, January 1st, Tuesday, October 1st, etc.

[0252] For example, multiple record dates can be displayed with a default effect, while the target display effect has a higher intensity than the default display effect. For instance, the default display effect could be a normal text style with a regular font size, regular weight, and no background fill; the target display effect could be a prominent style with a larger font size, bolder font, and a highlighted background. Or, the default display effect could be light gray text with no border; the target display effect could be an enhanced style with theme color text, a circular highlighted background, and a bold outline border.

[0253] In some exemplary embodiments, the terminal can display the selected target record date in the item record calendar with a target display effect.

[0254] like Figure 33 The diagram illustrates the process of displaying the selected target record date. The terminal can display the first item record interface 33-1, and the item record calendar 3301 is displayed in the item record interface. The item record calendar displays multiple record dates, and all multiple record dates are displayed with the default display effect. In response to the user's trigger operation on the target record date among the multiple record dates, the terminal can display the first item record interface 33-2, and the target record date selected by the user as indicated by the trigger operation is displayed in the item record calendar 3301 in the first item record interface with the target display effect.

[0255] In an optional embodiment of this application, the item recording calendar may further include heat icons corresponding to a plurality of recording dates.

[0256] The calorie icon can be used to indicate the relationship between the total calories of the target item consumed and the preset calories during the target recording period corresponding to the recording date of the calorie icon.

[0257] Optionally, the preset calorie count is the recommended total calorie intake within the target recording period corresponding to the recording date shown on the calorie icon. For example, the preset calorie count can be pre-set based on recommended calorie values ​​for a general population, manually set by the user according to their own dietary plan, calculated using an algorithm model based on body data such as height, weight, and target weight input by the user, determined based on the user's health status, or based on information such as the user's age, gender, daily activity level, and dietary management goals, or determined based on any combination of the above information.

[0258] In some exemplary embodiments, the terminal may display a first item recording interface and an item recording calendar on the first item recording interface, and display multiple records as scheduled and heat icons corresponding to the multiple record dates in the item recording calendar on the item recording interface.

[0259] like Figure 34 The first item recording interface shown includes an item recording calendar that also includes calorie icons corresponding to multiple recording dates. Further, as... Figure 35 The first item recording interface shown in the diagram includes a calorie icon that can be a circular progress indicator. The filled and unfilled areas of this indicator can be used to indicate the relationship between the total calories of the target item consumed and the preset calorie intake during the recording period corresponding to each recording date. In an optional configuration, if no target item is consumed during the recording period corresponding to a recording date, the circular progress indicator is displayed as an empty ring.

[0260] Step 3202: In the first item record interface, display the item elements and item information corresponding to at least one target item taken during the target record time period corresponding to the target record date.

[0261] In some exemplary embodiments, the terminal may also display, on the first item recording interface, the item elements and item information corresponding to at least one target item taken during the target recording period corresponding to the target recording date.

[0262] For example, such as Figure 36 The first item recording interface shown displays the item elements and item information corresponding to a target item captured within the target recording time period corresponding to the target recording date.

[0263] For example, such as Figure 37The first item recording interface shown displays the item elements and item information corresponding to various target items captured during the target recording period corresponding to the target recording date.

[0264] Furthermore, users can browse the item elements and information corresponding to various target items captured within the target recording period corresponding to the target recording date by swiping up and down. In response to swiping to the bottom, the item elements and information currently displayed on the first item recording interface are switched to the item elements and information corresponding to various target items captured within the target recording period corresponding to the recording date after the target recording date through a damped sliding effect.

[0265] In one optional approach, the item elements and information corresponding to each target item within the target recording period can be arranged in reverse chronological order, with the most recently recorded item elements and information displayed first. Furthermore, if the number of target items ingested within the target recording period is less than a preset threshold, the item elements and information corresponding to each target item can be displayed in a staggered arrangement; if the number of target items ingested within the target recording period is greater than or equal to the preset threshold, the item elements and information corresponding to each target item are displayed in a neat and appropriate arrangement, which users can browse by swiping. Furthermore, if no target items are ingested within the target recording period, a prompt message is displayed on the first item recording interface, prompting the user to add the item elements and information corresponding to the target items.

[0266] In this embodiment, the item recording interface includes a first item recording interface, which includes an item recording calendar. The item recording calendar includes multiple recording dates, and the selected target recording date is displayed in the item recording calendar with a target display effect. In the first item recording interface, a method is used to display the item elements and item information corresponding to at least one target item captured within the target recording time period corresponding to the target recording date. By setting the recording calendar, it is convenient for users to switch the item elements and item information displayed in the item recording interface, thereby improving the user experience.

[0267] In one embodiment, taking the method of displaying item elements and item information through interaction between server 104 and terminal 102 as an example, that is, in Figure 1 This explanation is based on the application environment shown; see [link / reference]. Figure 38 The sequence diagram shown illustrates the methods for displaying item elements and item information, including:

[0268] Step 3801: The terminal generates a request to display the first item record interface;

[0269] Step 3802: The terminal sends a request to the server to display the first item record interface;

[0270] Step 3803: The server responds to the request to display the first item record interface and determines the data to be displayed on the first item record interface.

[0271] Step 3804: The server sends the data displayed on the first item record interface to the terminal;

[0272] Step 3805: The terminal displays the first item record interface based on the data displayed on the first item record interface, and displays the item record calendar in the first item record interface, and displays multiple record dates in the item record date;

[0273] Step 3806: The terminal responds to the trigger operation for the target record date, displays the selected target record date with the target display effect, and generates an item element display request and an item information display request;

[0274] Step 3807: The terminal sends an item element display request and an item information display request to the server;

[0275] Step 3808: The server responds to the item element display request and the item information display request, and determines the item element display data and the item information display data;

[0276] Step 3809: The server sends item element display data and item information display data to the terminal;

[0277] Step 3810: Based on the item element display data and item information display data, the terminal displays the item elements and item information corresponding to at least one target item captured within the target recording time period corresponding to the target recording date on the first item recording interface.

[0278] In one exemplary embodiment, such as Figure 39 As shown, the first item recording interface also includes the total calories of the target item consumed within the target recording period corresponding to the preset calorie and target recording date, and also includes the following steps:

[0279] Step 3901: In response to a trigger operation for a preset heat value, display a first editing control for editing the preset heat value.

[0280] For example, the first editing control may be a calorie input box that supports manual input of numbers, a scroll wheel control that supports sliding up and down or left and right to select calorie values, or a composite control composed of sub-controls for increasing calorie values ​​and sub-controls for decreasing calorie values.

[0281] In some exemplary embodiments, the terminal may display a first item recording interface, and display the total calories of the target item consumed within the target recording period corresponding to the preset calories and the target recording date in the first item recording interface.

[0282] Furthermore, in response to a trigger operation for a preset heat value, the terminal can display a first editing control for editing the preset heat value.

[0283] like Figure 40 The diagram shown illustrates the process of displaying the first editing control. The terminal can display a first item recording interface 4001, which displays the total calories of the target item consumed within the target recording period corresponding to the preset calorie and the target recording date. Further, in response to a trigger operation on the preset calorie, the terminal displays a first item recording interface 40-2, which displays a first editing control for editing the preset calorie.

[0284] Step 3902: In response to the preset operation on the first editing control, obtain the edited preset heat value, and adjust the heat value icon based on the edited preset heat value.

[0285] For example, when the first editing control is a heat input box, the preset operation can be that the user enters the target heat in the input box; when the first editing control is a scroll wheel adjustment control, the preset operation can be that the user selects the target heat by sliding the scroll wheel up and down or left and right; when the first editing control is a combo control, the preset operation can be that the user selects the target heat by clicking the sub-control used to increase the heat value or the sub-control used to decrease the heat value.

[0286] In some exemplary embodiments, after displaying the first editing control, the terminal can obtain the edited preset heat value in response to a preset operation on the first editing control.

[0287] Specifically, when the first editing control is a heat input box, the target heat entered by the user in the heat input box can be determined as the edited preset heat; when the first editing control is a scroll wheel adjustment control, the target heat selected by the user by sliding the scroll wheel up and down or left and right can be determined as the edited preset heat; when the first editing control is a combo control, the target heat selected by the user by clicking the sub-control used to increase the heat value or the sub-control used to decrease the heat value can be determined as the edited preset heat.

[0288] Furthermore, after acquiring the edited preset calorie count, the terminal can adjust the calorie icon based on the edited preset calorie count. Specifically, when the calorie icon is a ring indicator, the terminal can redetermine the relationship between the total calories of the target item ingested during the recording period corresponding to the recording date and the edited preset calorie count, and then adjust the size of the filled area of ​​the ring indicator based on the determination result.

[0289] In one alternative embodiment of this application, a prompt message is displayed in response to a preset operation for a preset heat value.

[0290] Optionally, the preset operation can be a single click operation for a preset heat value, a long press operation for a preset heat value, or a double click operation for a preset heat value, and the preset operation is different from the trigger operation used to display the first editing control.

[0291] The prompt message can be used to explain the principle behind determining the preset calorie intake. For example, if the preset calorie intake is 2000 kcal, the prompt message could be "Adults consume an average of about 2000 kcal per day."

[0292] In some exemplary embodiments, the terminal may display a first item recording interface and display a preset heat value on the first item recording interface. In response to a preset operation for the preset heat value, the terminal may display a prompt message.

[0293] like Figure 41 The diagram illustrates the process of displaying prompt information. The terminal can display a first item recording interface 41-1, and display the preset heat value in the first item recording interface 41-1. Further, in response to a preset operation for the preset heat value, the terminal displays a first item recording interface 41-2, and displays prompt information in the first item recording interface 41-2.

[0294] In this embodiment, in response to a trigger operation for a preset heat value, a first editing control for editing the preset heat value is displayed; in response to a preset operation for the first editing control, the method of obtaining the edited preset heat value and adjusting the heat value icon based on the edited preset heat value allows users to customize the preset heat value, thereby improving the user experience.

[0295] In one embodiment, taking the method of displaying item elements and item information through interaction between server 104 and terminal 102 as an example, that is, in Figure 1 This explanation is based on the application environment shown; see [link / reference]. Figure 42 The timing diagram of the method for adjusting the heat icon shown includes:

[0296] Step 4201: The terminal generates a request to display the first item record interface;

[0297] Step 4202: The terminal sends a request to the server to display the first item record interface;

[0298] Step 4203: The server responds to the request to display the first item record interface and determines the data to be displayed on the first item record interface.

[0299] Step 4204: The server sends the data displayed on the first item record interface to the terminal;

[0300] Step 4205: The terminal displays the first item recording interface based on the data displayed on the first item recording interface, and displays the preset calories in the first item recording interface;

[0301] Step 4206: The terminal responds to the trigger operation for the preset heat and displays the first editing control;

[0302] Step 4207: The terminal responds to the preset operation for the first editing control, obtains the edited preset heat, and adjusts the heat icon based on the edited preset heat.

[0303] In an exemplary embodiment, the item recording interface includes a second item recording interface, which includes second time period indication information. The item recording interface displays item elements and item information corresponding to at least one target item ingested during a target recording period, including: displaying item elements and item information corresponding to at least one target item ingested during a target recording period corresponding to multiple recording dates indicated by the second time period indication information.

[0304] Optionally, the multiple record dates indicated by the second time period indication information can be consecutive date units, and the number of record dates indicated by the second time period indication information is fixed. For example, the second time period indication information can indicate seven record dates for a consecutive week; or, for example, the second time period indication information can indicate record dates for a consecutive month. In an optional manner, the terminal can switch between the multiple record dates indicated by the second time period indication information in response to a swipe operation on the second time period indication information.

[0305] In some exemplary embodiments, the terminal may display a second item recording interface, and in the second item recording interface, display the item elements and item information corresponding to at least one target item ingested during the target recording period corresponding to the multiple recording dates indicated by the second time period indication information.

[0306] For example, such as Figure 43The second item recording interface shown displays the item elements and item information corresponding to a target item captured within the target recording time period corresponding to the second time period indication information and the multiple recording dates indicated by the second time period indication information.

[0307] For example, such as Figure 44 The second item recording interface shown displays the item elements and item information corresponding to various target items captured within the target recording time periods corresponding to the second time period indication information and the multiple recording dates indicated by the second time period indication information.

[0308] Furthermore, such as Figure 45 As shown, the second item recording interface includes a second time period indication information and multiple item display areas. Each item display area corresponds to multiple recording dates indicated by the second time period indication information, and each item display area displays the item elements and item information corresponding to the target item captured within the target recording time period corresponding to the corresponding recording date.

[0309] In one alternative approach, if no target item is consumed within the target recording period corresponding to one of the multiple recording dates indicated by the second time period indication information, the item display area corresponding to that recording date will not be displayed on the second item recording interface. If no target item is consumed within the target recording period corresponding to any of the multiple recording dates indicated by the second time period indication information, a prompt message can be displayed on the second item recording interface to prompt the user to add the item element and item information corresponding to the target item.

[0310] In this embodiment, the method of displaying the item elements and item information corresponding to at least one target item taken in during the target recording time period corresponding to the multiple recording dates indicated by the second time period indication information in the second item recording interface can realize the recording of the taken items. Moreover, the item recording interface not only displays the item information but also displays the item elements, which effectively improves the richness of the item recording content and thus improves the user experience.

[0311] In one embodiment, taking the method of displaying item elements and item information through interaction between server 104 and terminal 102 as an example, that is, in Figure 1 This explanation is based on the application environment shown; see [link / reference]. Figure 46 The sequence diagram shown illustrates the methods for displaying item elements and item information, including:

[0312] Step 4601: The terminal generates a request to display the second item record interface, a request to display item elements, and a request to display item information;

[0313] Step 4602: The terminal sends a request to display the second item record interface, a request to display item elements, and a request to display item information to the server;

[0314] Step 4603: The server responds to the second item record interface display request, item element display request, and item information display request, and determines the second item record interface display data, item element display data, and item information display data;

[0315] Step 4604: The server sends the second item record interface display data, item element display data, and item information display data to the terminal;

[0316] Step 4605: The terminal displays the second item recording interface based on the data displayed on the second item recording interface, the item element display data, and the item information display data. In the item recording interface, the terminal displays the item elements and item information corresponding to at least one target item taken in during the target recording period corresponding to the multiple recording dates indicated by the second time period indication information.

[0317] In one exemplary embodiment, such as Figure 47 As shown, it also includes the following steps:

[0318] Step 4701: Display the first interface switching control, the second interface switching control, and the image input control.

[0319] In some exemplary embodiments, the terminal may display a first interface switching control, a second interface switching control, and an image input control.

[0320] For example, such as Figure 48 The first item recording interface shown may include a control display area, which may display a first interface switching control, a second interface switching control, and an image input control.

[0321] For example, such as Figure 49 The second item recording interface shown may include a control display area, which may display a first interface switching control, a second interface switching control, and an image input control.

[0322] Step 4702: In response to the trigger operation of the first interface switching control, display the first item record interface.

[0323] In some exemplary embodiments, in response to a triggering operation on the first interface switching control, the terminal can jump from the currently displayed interface to the first item record interface.

[0324] For example, such as Figure 50The diagram illustrates the process of displaying the first item recording interface. The terminal can display a second item recording interface 50-1, and within the second item recording interface, display the second interface switching control with a preset display effect, and display the first interface switching control with a default display effect. The preset display effect can be a highlighted display effect. Furthermore, in response to a trigger operation on the first interface switching control, the terminal can display a first item recognition interface 50-2, and within the first item recognition interface, display the first interface switching control with a preset display effect, and display the second interface switching control with a default display effect.

[0325] Step 4703: In response to the trigger operation of the second interface switching control, display the second item record interface.

[0326] In some exemplary embodiments, in response to a triggering operation on the second interface switching control, the terminal can jump from the currently displayed interface to the second item record interface.

[0327] like Figure 51 The diagram illustrates the process of displaying the second item recording interface. The terminal can display the first item recording interface 51-1, and within the first item recording interface, display the first interface switching control with a preset display effect, and display the second interface switching control with a default display effect. Furthermore, in response to a trigger operation on the second interface switching control, the terminal can display the second item recognition interface 51-2, and within the second item recognition interface, display the second interface switching control with a preset display effect, and display the first interface switching control with a default display effect.

[0328] Step 4704: In response to a trigger operation on the image input control, display the image input interface and detect image input events based on the image input interface.

[0329] In some exemplary embodiments, the terminal may display an image input interface in response to a triggering operation on the image input control, and detect image input events based on the image input interface.

[0330] For example, such as Figure 52 The diagram illustrates the process of displaying the image input interface. The terminal can display a first object recognition interface 52-1, and within this interface, an image input control. Further, in response to a trigger operation on the image input control, the terminal can display an image input interface 52-2, which includes a viewfinder, a shooting control, and an album navigation control. Alternatively, in response to a zoom operation on the image input interface, the zoom level of the image within the viewfinder can be adjusted.

[0331] For example, such as Figure 53The diagram illustrates the process of displaying the image input interface. The terminal can display a second object recognition interface 53-1, and within this interface, an image input control is displayed. Furthermore, in response to a trigger operation on the image input control, the terminal can display an image input interface 53-2, which includes a viewfinder, a shooting control, and an album navigation control.

[0332] In this embodiment, a first interface switching control, a second interface switching control, and an image input control are displayed. In response to a trigger operation on the first interface switching control, a first item recording interface is displayed. In response to a trigger operation on the second interface switching control, a second item recording interface is displayed. In response to a trigger operation on the image input control, an image input interface is displayed. The method of detecting image input events based on the image input interface can realize the switching of multiple interfaces and improve the user experience.

[0333] In one embodiment, taking the method of displaying item elements and item information through interaction between server 104 and terminal 102 as an example, that is, in Figure 1 This explanation is based on the application environment shown; see [link / reference]. Figure 54 The timing diagram shown illustrates the methods for displaying the first item recording interface, the second item recording interface, and the image input interface, including:

[0334] Step 5401: The terminal displays the first interface switching control, the second interface switching control, and the image input control;

[0335] Step 5402: In response to the trigger operation of the first interface switching control / second interface switching control / image input control, the terminal generates a first item record interface display request / second item record interface display request / image input interface display request.

[0336] Step 5403: The terminal sends a request to display the first item record interface, a request to display the second item record interface, and a request to display the image input interface to the server;

[0337] Step 5404: The server responds to the request to display the first item record interface / the request to display the second item record interface / the request to display the image input interface, and determines the data to display the first item record interface / the data to display the second item record interface / the data to display the image input interface.

[0338] Step 5405: The server sends the data displayed on the first item record interface, the data displayed on the second item record interface, and the data displayed on the image input interface to the terminal;

[0339] Step 5406: The terminal displays the first item recording interface, the second item recording interface, and the image input interface based on the data displayed on the first item recording interface, the second item recording interface, and the image input interface.

[0340] In one exemplary embodiment, the method further includes: in response to a triggering operation on an item element, displaying at least one of a second editing control for editing the item element, a download control for downloading the item element, and a share control for sharing the item element.

[0341] In some exemplary embodiments, the terminal may display at least one of a second edit control, a download control, and a share control in response to a triggering operation on an item element.

[0342] For example, such as Figure 55 The diagram illustrates the process of displaying the second editing control. The terminal can display a first item recording interface 55-1, and display item elements within the first item recording interface 55-1. Further, in response to a trigger operation on an item element, the terminal can display the second editing control in the first item recording interface 55-2, where the trigger operation can be a long press operation. Further, in response to a trigger operation on the second editing control, the terminal can display an item element editing interface.

[0343] For example, such as Figure 56 The diagram illustrates the process of displaying the download control. The terminal can display a first item record interface 56-1, and display item elements within the first item record interface 56-1. Furthermore, in response to a trigger operation on an item element, the terminal can display a download control in the first item record interface 56-2. Further, in response to a trigger operation on the download control, the terminal can download the item element.

[0344] For example, such as Figure 57 The diagram illustrates the process of displaying the sharing control. The terminal can display a first item record interface 57-1, and display item elements within the first item record interface 57-1. Furthermore, in response to a trigger operation on an item element, the terminal can display a sharing control in the first item record interface 57-2. Further, in response to a trigger operation on the sharing control, the terminal can display an item element sharing interface.

[0345] For example, such as Figure 58 The diagram illustrates the process of displaying the second editing control, download control, and share control. The terminal can display the first item record interface 58-1, and display item elements in the first item record interface 58-1. Furthermore, in response to a trigger operation on an item element, the terminal can display the second editing control, download control, and share control in the first item record interface 58-2.

[0346] In an optional embodiment of this application, such as Figure 59 As shown, the details interface of the target item is displayed, showing the item elements, item name, item information, and dietary suggestions.

[0347] In an optional embodiment of this application, such as Figure 60 As shown, users can browse the item elements, item name, item information, and dietary suggestions of a target item by swiping. When the user is detected to have swiped to the bottom of the details screen, the recorded time and control area of ​​the target item are displayed. This control area may include confirmation controls, cancellation controls, and item editing controls.

[0348] Furthermore, in response to a trigger operation on the confirmation control, the first item record interface is displayed; in response to a trigger operation on the cancel control, the image input interface is displayed; and in response to a trigger operation on the item editing control, the editing interface is displayed.

[0349] Furthermore, such as Figure 61 As shown, the details page of the target item also includes sharing controls and function controls. In response to the trigger operation of the function controls, delete controls, download controls and edit controls are displayed.

[0350] In an optional embodiment of this application, in response to a trigger operation on any of the above-mentioned sharing controls, an item element sharing interface is displayed, and a sharing image generated based on item elements and item information is displayed in the item element sharing interface.

[0351] For example, the terminal can use a preset sharing template to generate a shareable image based on item elements and item information. For instance... Figure 62 , Figure 63 and Figure 64 As shown, Figure 62 , Figure 63 and Figure 64 The images shown are generated using different preset sharing models.

[0352] In this embodiment, in response to a trigger operation on an item element, a method is provided to display at least one of a second editing control for editing the item element, a download control for downloading the item element, and a share control for sharing the item element, so that users can edit, download, or share the item element according to their actual needs, thereby improving the user experience.

[0353] In one exemplary embodiment, another item recording method is provided, which includes the following steps:

[0354] 1. In response to a trigger operation for the target application, a first item recording interface is displayed. The first item recording interface displays an item recording calendar, preset calories, the total calories of the target items consumed during the target recording period corresponding to the target recording date, a first interface switching control, a second interface switching control, an image input control, and item elements and item information corresponding to at least one target item consumed during the target recording period corresponding to the target recording date. The item recording calendar displays multiple recording dates and calorie icons corresponding to the multiple recording dates, and the selected target recording date is displayed in the item recording calendar with a target display effect.

[0355] 2. In response to the trigger operation of the second interface switching control, the second item recording interface is displayed. The second item recording interface displays the item elements and item information corresponding to at least one target item taken during the target recording period corresponding to the second time period indication information, the first interface switching control, the second interface switching control, the image input control, the second time period indication information, and the target recording period corresponding to the second time period indication information.

[0356] 3. In response to a trigger operation on the image input control, display the image input interface, detect image input events based on the image input interface, and in response to the image input events, acquire the object image. After acquiring the object image, display the object image in the object recognition interface; play an object segmentation visual effect for the target object in the object image; after the object segmentation visual effect finishes playing, play a first background switching visual effect, changing the background of the object element from the background of the object image to the first background, the color tone of the first background being determined based on the object element; play a second background switching visual effect, changing the background of the object element from the first background to the second background, and display the object element and object information in the form of streaming data based on the second background;

[0357] 4. In response to a trigger operation on the preset heat value, display a first editing control for editing the preset heat value; in response to a preset operation on the first editing control, obtain the edited preset heat value, and adjust the heat value icon based on the edited preset heat value.

[0358] 5. In response to a triggered action on an item element, display at least one of a second editing control for editing the item element, a download control for downloading the item element, and a share control for sharing the item element.

[0359] It should be understood that although the steps in the flowcharts of the above embodiments are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the above embodiments may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages in other steps. It is understood that the steps in different embodiments can be freely combined as needed, and all non-contradictory solutions formed by such combinations are within the scope of protection of this application.

[0360] Based on the same inventive concept, this application also provides an article recording device for implementing the article recording method described above. The solution provided by this device is similar to the solution described in the above method; therefore, the specific limitations in one or more articles recording device embodiments provided below can be found in the limitations of the article recording method described above, and will not be repeated here.

[0361] In one exemplary embodiment, such as Figure 65 As shown, an item recording device is provided, including: an acquisition module 6501 and a display module 6502, wherein:

[0362] The acquisition module 6501 is used to acquire an image of an object containing the ingested target object in response to an image input event;

[0363] Display module 6502 is used to display the item elements and corresponding item information of the target item;

[0364] The item element includes an image of the target item identified from the item image, and the item information includes the target item's calorie information and / or nutritional information.

[0365] In one embodiment, the display module 6501 is specifically used to perform recognition processing on the object image to segment the object elements containing the target object from the object image and obtain the object information corresponding to the target object; and to display the object elements and object information on the object recognition interface.

[0366] In one embodiment, the display module 6501 is specifically used to display the object image in the object recognition interface after the object image is acquired; play the object recognition visual effect based on the object image; and display the object elements and object information in the object recognition interface after the object recognition visual effect finishes playing.

[0367] In one embodiment, the display module 6501 is specifically used to play an item segmentation visual effect for a target item in an item image; after the item segmentation visual effect finishes playing, a background switching visual effect is played; and after the background switching visual effect finishes playing, item elements and item information are displayed in the form of streaming data based on the switched background.

[0368] In one embodiment, the display module 6501 is specifically used to play a first background switching visual effect, which switches the background of the item element from the background of the item image to the first background, the color tone of the first background being determined based on the item element; and to play a second background switching visual effect, which switches the background of the item element from the first background to the second background, and displays the item element and item information in the form of streaming data based on the second background.

[0369] In one embodiment, the display module 6501 is specifically used to display, in the item recording interface, the item elements and item information corresponding to at least one target item captured during the target recording period.

[0370] In one embodiment, the item recording interface includes a first item recording interface, which includes an item recording calendar and a display module 6501, specifically used to display the selected target recording date in the item recording calendar with a target display effect; and in the first item recording interface, to display the item elements and item information corresponding to at least one target item captured within the target recording time period corresponding to the target recording date.

[0371] In one embodiment, the item recording calendar includes calorie icons corresponding to multiple recording dates. The calorie icons are used to indicate the relationship between the total calories of the target item consumed and the preset calories during the target recording period corresponding to the recording date of the calorie icon.

[0372] In one embodiment, the first item recording interface further includes a preset calorie count and the total calorie count of the target item consumed within the target recording period corresponding to the target recording date; the display module 6501 is specifically used to display a first editing control for editing the preset calorie count in response to a trigger operation on the preset calorie count; and to obtain the edited preset calorie count in response to a preset operation on the first editing control, and to adjust the calorie icon based on the edited preset calorie count.

[0373] In one embodiment, the item recording interface includes a second item recording interface, which includes second time period indication information. The display module 6501 is specifically used to display, in the second item recording interface, the item elements and item information corresponding to at least one target item taken within the target recording time period corresponding to the multiple recording dates indicated by the second time period indication information.

[0374] In one embodiment, the display module 6501 is specifically used to display a first interface switching control, a second interface switching control, and an image input control; in response to a trigger operation on the first interface switching control, it displays a first item recording interface; in response to a trigger operation on the second interface switching control, it displays a second item recording interface; in response to a trigger operation on the image input control, it displays an image input interface and detects image input events based on the image input interface.

[0375] In one embodiment, the display module 6501 is specifically configured to, in response to a trigger operation on an item element, display at least one of a second editing control for editing the item element, a download control for downloading the item element, and a share control for sharing the item element.

[0376] Each module in the aforementioned item recording device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device, or stored in the memory of a computer device as software, so that the processor can call and execute the operations corresponding to each module.

[0377] In one exemplary embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as follows: Figure 66As shown, the computer device includes a processor, memory, input / output interface, communication interface, display unit, and input device. The processor, memory, and input / output interface are connected via a system bus, and the communication interface, display unit, and input device are also connected to the system bus via the input / output interface. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The input / output interface is used for exchanging information between the processor and external devices. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, mobile cellular networks, Near Field Communication (NFC), or other technologies. When the computer program is executed by the processor, it implements a method for recording items. The display unit is used to form a visually visible image and can be a display screen, projection device, or virtual reality imaging device. The display screen can be an LCD screen or an e-ink screen. The input device of the computer device can be a touch layer covering the display screen, or buttons, a trackball, or a touchpad located on the computer device casing, or an external keyboard, touchpad, or mouse, etc. Those skilled in the art will understand that... Figure 66 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0378] In one exemplary embodiment, a computer device is provided, including a memory and a processor. The memory stores a computer program, and the processor, when executing the computer program, implements the steps of the method described in any of the above embodiments. In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, it implements the steps of the method described in any of the above embodiments. In one embodiment, a computer program product is provided, including a computer program, which, when executed by a processor, implements the steps of the method described in any of the above embodiments.

[0379] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of the relevant data must comply with relevant regulations.

[0380] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, artificial intelligence (AI) processors, etc., and are not limited to these.

[0381] The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as the combination of these technical features does not contradict each other, it should be considered within the scope of this application. The above embodiments only illustrate several implementation methods of this application, and their descriptions are relatively specific and detailed, but they should not be construed as limiting the scope of this application. It should be noted that for those skilled in the art, several modifications and improvements can be made without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. A method for recording items, characterized in that, The method includes: In response to an image input event, acquire an image of the object containing the ingested target object; Display the item elements and corresponding item information of the target item; The item element includes an image of the target item identified from the item image, and the item information includes the calorie information and / or nutritional information of the target item.

2. The method according to claim 1, characterized in that, The display of the item elements and corresponding item information corresponding to the target item includes: The image of the item is processed for recognition to segment the item elements containing the target item from the image of the item, and to obtain the item information corresponding to the target item; The item elements and item information are displayed on the item recognition interface.

3. The method according to claim 2, characterized in that, The method further includes: After acquiring the image of the item, the image of the item is displayed in the item recognition interface; Based on the image of the item, an item recognition visual effect is played, and after the item recognition visual effect finishes playing, the item elements and the item information are displayed on the item recognition interface.

4. The method according to claim 3, characterized in that, The process of playing an item recognition visual effect based on the item image, and displaying the item elements and item information on the item recognition interface after the item recognition visual effect finishes playing, includes: Play an item segmentation visual effect for the target item in the item image; After the item segmentation visual effect finishes playing, a background switching visual effect is played. After the background switching visual effect finishes playing, the item elements and item information are displayed in the form of streaming data based on the switched background.

5. The method according to claim 4, characterized in that, The playback background switching visual effect, and after the background switching visual effect ends, based on the switched background, displays the item elements and the item information in the form of streaming data, including: Play a first background switching visual effect to change the background of the item element from the background of the item image to the first background, the color tone of the first background being determined based on the item element; Play a second background switching visual effect to switch the background of the item element from the first background to the second background, and display the item element and the item information in the form of streaming data based on the second background.

6. The method according to any one of claims 1 to 5, characterized in that, The method further includes: The item recording interface displays the item elements and item information corresponding to at least one of the target items taken during the target recording period.

7. The method according to claim 6, characterized in that, The item recording interface includes a first item recording interface, which includes an item recording calendar. The item recording calendar includes multiple recording dates. The item recording interface displays the item elements and item information corresponding to at least one target item captured within the target recording period, including: The selected target record date is displayed in the item record calendar with a target display effect; The first item recording interface displays the item elements and item information corresponding to at least one of the target items consumed during the target recording period corresponding to the target recording date.

8. The method according to claim 7, characterized in that, The item recording calendar includes calorie icons corresponding to the plurality of recording dates. The calorie icons are used to indicate the relationship between the total calories of the target item consumed and the preset calories during the target recording period corresponding to the recording date of the calorie icon.

9. The method according to claim 8, characterized in that, The first item recording interface also includes the total calories of the target item consumed within the target recording period corresponding to the preset calorie and the target recording date; the method further includes: In response to a trigger operation on the preset heat value, a first editing control for editing the preset heat value is displayed; In response to a preset operation on the first editing control, the preset heat value is obtained after editing, and the heat value icon is adjusted based on the preset heat value.

10. The method according to claim 9, characterized in that, The item recording interface includes a second item recording interface, which includes second time period indication information. The item recording interface displays the item elements and item information corresponding to at least one of the target items captured during the target recording time period, including: In the second item recording interface, the item elements and item information corresponding to at least one of the target items consumed within the target recording time period corresponding to the multiple recording dates indicated by the second time period indication information are displayed.

11. The method according to claim 10, characterized in that, The method further includes: Display the first interface switching control, the second interface switching control, and the image input control; In response to a trigger operation on the switching control of the first interface, the first item record interface is displayed; In response to a trigger operation on the second interface switching control, the second item record interface is displayed; In response to a trigger operation on the image input control, an image input interface is displayed, and an image input event is detected based on the image input interface.

12. The method according to any one of claims 1 to 5, characterized in that, The method further includes: In response to a triggering operation on the item element, at least one of a second editing control for editing the item element, a download control for downloading the item element, and a share control for sharing the item element is displayed.

13. An item recording device, characterized in that, The device includes: The acquisition module is used to acquire an image of the object containing the ingested target object in response to an image input event; The display module is used to display the item elements and corresponding item information of the target item; The item element includes an image of the target item identified from the item image, and the item information includes the calorie information and / or nutritional information of the target item.

14. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 12.

15. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 12.

16. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 12.

Images