Article information recommendation method and device
By obtaining user biological detection images on the e-commerce platform to generate physical condition information and recommend matching items, it solves the problem that users find it difficult to choose suitable physical condition foods or health products, and achieves accurate recommendations and improvements in shopping experience.
Patent Information
- Application Number
- CN202510724812.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-05-30
- Publication Date
- 2025-08-29
AI Technical Summary
It is difficult for ordinary users to accurately choose food or health products that suit their physical fitness, which can easily lead to adverse physical effects.
By obtaining user's biological detection images in the purchasing link of the e-commerce platform, generating and displaying user's physical condition information, and recommending matching items based on physical condition information.
Accurately determine matching items that are suitable for users' physical fitness, reduce the risk of purchasing unsuitable for their physical fitness, and improve users' shopping experience.
Smart Images
Figure CN120563207A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the fields of e-commerce and medical care technology, and in particular to a method and device for recommending item information. Background Art
[0002] E-commerce malls offer a variety of foods and health supplements for users to choose from. Different foods and health supplements have different benefits. For ordinary users without specialized knowledge, it's often difficult to accurately choose foods or health supplements that suit their constitution. Users can easily blindly follow trends and purchase foods or health supplements that aren't suitable for them, potentially causing adverse health effects. Summary of the Invention
[0003] In view of this, embodiments of the present invention provide an item information recommendation method and device that can accurately determine matching items suitable for the user's physique, reducing the risk of the user purchasing food or health products that are not suitable for their own physique.
[0004] In a first aspect, an embodiment of the present invention provides an item information recommendation method, comprising:
[0005] In response to a biometric detection request triggered at a user terminal during a purchase link for an item, obtaining a biometric detection image of the user;
[0006] Generate and display user physical information based on biological detection images;
[0007] Determining at least one matching item from a plurality of candidate items associated with the item purchase link based on the user's physical condition information;
[0008] Display at least one matching item.
[0009] Optionally, the item purchase link includes a product homepage display; the product homepage is provided with a biometric detection trigger mark;
[0010] In response to a biometric detection request triggered at a user terminal during an item purchase process, obtaining a biometric detection image of the user includes:
[0011] In response to a biometric detection triggering mark being triggered by an operation during the display of the product homepage, an image acquisition interface is called to obtain a biometric detection image of the user.
[0012] Optionally, the item purchase link includes a display of an add-to-purchase settlement page; the add-to-purchase settlement page is provided with a biometric detection trigger mark;
[0013] In response to a biometric detection request triggered at a user terminal during an item purchase process, obtaining a biometric detection image of the user includes:
[0014] In response to a biometric detection triggering mark being triggered by an operation during the display of the add-to-purchase settlement page, an image acquisition interface is called to obtain a biometric detection image of the user.
[0015] Optionally, determining at least one matching item from a plurality of candidate items associated with the item purchase link based on the user's physical condition information includes:
[0016] Determine the target item and target store corresponding to the item purchase link;
[0017] Determine at least one matching item from multiple candidate items sold in the target store based on the user's physical condition information;
[0018] After displaying at least one matching item, the following also applies:
[0019] receiving a selection instruction for at least one matching item;
[0020] Determining at least one add-on item from at least one matching item according to the selection instruction;
[0021] Receive the add-to-cart action for each add-to-cart item;
[0022] Generate additional purchase information for each additional purchase item according to the additional purchase operation for each additional purchase item;
[0023] Generate an add-on purchase settlement page for the user at the target store based on the target item and the add-on purchase information of each add-on item.
[0024] Optionally, based on the biometric detection image, generate and display user physical information, including:
[0025] Perform background removal on the biological detection image to obtain a face-retained image;
[0026] Determining a tongue image of the user from the retained facial image;
[0027] resizing the tongue image to a preset size, and converting the resized tongue image into an HSV color space format;
[0028] extracting at least one biometric characteristic information of the user from the converted tongue image;
[0029] Generate and display user physical information based on at least one biometric feature information.
[0030] Optionally, determining at least one matching item from a plurality of candidate items associated with the item purchase link based on the user's physical condition information includes:
[0031] Determining at least one item feature information corresponding to each candidate item associated with the item purchase link;
[0032] For each candidate item, at least one feature of the candidate item and the user's physical condition information are input into a matching model; and based on the output of the matching model, a matching degree between the candidate item and the user is determined;
[0033] At least one matching item is determined from the plurality of candidate items according to the matching degrees corresponding to the candidate items.
[0034] Optionally, after generating and displaying the user's physical condition information based on the biometric detection image, the method further includes:
[0035] Determine the user's physical fitness test time;
[0036] Save the user's physical fitness records, which include: user's physical fitness information and physical fitness test time.
[0037] Optionally, it also includes:
[0038] Receive physical inquiry instructions for users;
[0039] Get at least one physical record of the user;
[0040] Determine the display information corresponding to the user's physical fitness information in each physical fitness record;
[0041] According to the physical fitness test time in each physical fitness record, the display information corresponding to each physical fitness record is arranged in sequence to generate and display the user's physical fitness change graph.
[0042] Optionally, after generating and displaying the user's physical condition information based on the biometric detection image, the method further includes:
[0043] Determining at least one user constitution corresponding to the user from a plurality of preset constitutions according to the user constitution information;
[0044] Determine and display physical analysis information corresponding to at least one user's physical condition.
[0045] In a second aspect, an embodiment of the present invention provides an item information recommendation device, comprising:
[0046] An image acquisition module, configured to acquire a biometric image of a user in response to a biometric detection request triggered at a user terminal during an item selection and purchase process;
[0047] A physical fitness determination module is used to generate and display user physical fitness information based on biological detection images;
[0048] An item determination module, configured to determine at least one matching item from a plurality of candidate items associated with the item purchase link based on the user's physical condition information;
[0049] The item display module is used to display at least one matching item.
[0050] In a third aspect, an embodiment of the present invention provides an electronic device, including:
[0051] one or more processors;
[0052] The storage device is used to store one or more programs. When the one or more programs are executed by one or more processors, the one or more processors implement the method of any of the above embodiments.
[0053] In a fourth aspect, an embodiment of the present invention provides a computer-readable medium having a computer program stored thereon, which implements the method of any of the above embodiments when the program is executed by a processor.
[0054] In a fifth aspect, an embodiment of the present invention provides a computer program product, including a computer program, which implements the method of any of the above embodiments when the computer program is executed by a processor.
[0055] One embodiment of the above invention has the following advantages or beneficial effects: User physical condition information is generated based on a user's biometric image. Based on the user's physical condition information, at least one matching item corresponding to the user is determined from a plurality of candidate items. This embodiment of the present invention can accurately determine matching items suitable for the user's physical condition based on the user's physical condition information, thereby reducing the risk of the user purchasing food or health products that are inappropriate for their physical condition.
[0056] After generating the user's physical condition information, at least one matching item is selected from the multiple candidate items associated with the item's purchase link. This facilitates users in understanding their physical condition and selecting suitable items during the shopping process. Furthermore, the fact that the candidate items are associated with the item's purchase link facilitates subsequent add-on purchases and checkout, further enhancing the user's shopping experience.
[0057] The further effects of the above-mentioned non-conventional optional manner will be described below in conjunction with specific embodiments. BRIEF DESCRIPTION OF THE DRAWINGS
[0058] The accompanying drawings are provided for a better understanding of the present invention and are not intended to limit the present invention.
[0059] Figure 1 This is a schematic diagram of a process of an item information recommendation method provided by an embodiment of the present invention;
[0060] Figure 2 is a schematic diagram of a physical fitness detection entrance provided by an embodiment of the present invention;
[0061] Figure 3 is a schematic diagram of a physical fitness detection entrance provided by another embodiment of the present invention;
[0062] Figure 4 is a schematic diagram of a process of an item information recommendation method provided by another embodiment of the present invention;
[0063] Figure 5 is a schematic diagram of a process of an item information recommendation method provided by another embodiment of the present invention;
[0064] Figure 6 is a flowchart of an item information recommendation method provided by yet another embodiment of the present invention;
[0065] Figure 7 This is a schematic diagram of a user uploading a biological detection image provided by an embodiment of the present invention;
[0066] Figure 8 is a schematic diagram of a tongue image detection result provided by an embodiment of the present invention;
[0067] Figure 9 is a schematic diagram of a constitution test result based on tongue image provided by an embodiment of the present invention;
[0068] Figure 10 is a schematic diagram of a tongue image-based return page provided by an embodiment of the present invention;
[0069] Figure 11 This is a schematic structural diagram of an item information recommendation device provided by an embodiment of the present invention;
[0070] Figure 12 It is a schematic diagram of the structure of a computer system of a terminal device or a server suitable for implementing an embodiment of the present invention. DETAILED DESCRIPTION
[0071] The following description of exemplary embodiments of the present invention is made in conjunction with the accompanying drawings, in which various details of the embodiments of the present invention are included to facilitate understanding. These details should be considered as merely exemplary. Therefore, it should be appreciated by those skilled in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present invention. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.
[0072] It should be noted that the acquisition, storage, use, and processing of data in the technical solutions of the embodiments of the present invention comply with the relevant provisions of national laws and regulations.
[0073] Figure 1 FIG. 1 is a schematic diagram of a process of an item information recommendation method provided by an embodiment of the present invention. Figure 1 As shown, the method includes:
[0074] Step 101: In response to a biometric detection request triggered at a user terminal during an item purchase process, a biometric detection image of the user is obtained.
[0075] The item purchase process is the process of a user selecting an item. The item purchase process may include: search page display, product information list display, product homepage display, add-to-cart checkout page display, checkout results display, etc.
[0076] Biometric images are images of a user's body parts, such as facial images, tongue images, and hand images. Biometric images can also be medical images of the user, such as ultrasound images and CT images. By detecting a user's biometric images, relevant information such as the user's physical condition and health status can be determined.
[0077] Step 102: Generate and display user physical information based on the biological detection image.
[0078] Image features can be extracted from the biometric detection image, and then the user's physical information can be determined based on the image features. Alternatively, at least one biometric feature of the user can be determined based on the biometric detection image, and then the user's physical information can be generated based on the at least one biometric feature.
[0079] Specifically, biometric information is characteristic information related to the user's physical condition extracted from a biometric detection image. For example, the biometric detection image is an image of the user's face. Biometric information may include facial color, pupil distance, lip color, facial texture, etc.
[0080] For example, a biometric detection image may be an image of the user's tongue. Biometric information may include tongue color, tongue coating color, tongue shape, coating quality, and saliva. Tongue color includes: pale white, pale, light red, red, dark red, crimson, light purple, bluish purple, and crimson purple. Tongue shape includes: fat or thin, punctures, ecchymoses, petechiae, tooth marks, cracks, and old or young. Coating color includes: white, light yellow, yellow, burnt yellow, gray-black, and burnt black. Coating quality includes: thin, thick, rotten, greasy, peeling, scanty, and absent. Saliva includes: slippery, moist, dry, and rough.
[0081] The user's physical information can be combined with at least one biometric feature information to generate the user's physical information. Alternatively, at least one biometric feature information can be input into a vector model and the user's physical information can be generated based on the output of the vector model.
[0082] In one embodiment of the present invention, multimodal data processing is used to generate user biometric information. Specifically, user information in different modalities is standardized. User information may include biometric images, age, region, gender, and medical history.
[0083] For numerical feature data, such as age, normalization is performed to obtain the corresponding biometric information. For text feature data, such as region and gender, they are converted into corresponding numerical values according to preset rules to obtain the corresponding biometric information.
[0084] For image-based feature data, such as facial and tongue images, unified image resizing and color correction are performed. The processed data is then mapped into a unified feature space. Using convolutional neural networks from deep learning, biometric information from facial and / or tongue images is automatically extracted. User feature information extracted from different modalities is concatenated along a certain dimension to generate a comprehensive physical fitness vector for the user.
[0085] Specifically, concatenate at different dimensions and calculate model performance metrics, such as precision and recall, for each concatenation dimension. Select the concatenation dimension that optimizes model performance. For example, multiple experiments have shown that concatenating at the kth dimension of each biometric feature yields the highest accuracy on the validation set. Therefore, the kth dimension can be considered the optimal concatenation dimension.
[0086] Alternatively, based on knowledge from relevant fields such as medicine, the facial or tongue biometrics most closely correlated with constitution can be determined. For example, Traditional Chinese Medicine theory considers facial color and tongue texture to be crucial for determining a Qi deficiency constitution. Therefore, facial color or tongue texture can be considered as candidate dimensions for splicing.
[0087]
[0088] Among them, X fusion is the comprehensive feature vector. F=[f1,f2,⋯,fn] is the facial color and texture feature vector. R=[r1,r2,⋯,rm] is the region encoding vector. A=[a1,a2,⋯,ak] is the age encoding vector. W F is the weight of facial color and texture features. R is the weight of regional characteristics. A is the age feature weight.
[0089] The comprehensive feature vector can be used directly as user constitution information. It can also be used as input into a vector model. A vector model is trained using sample data with labeled constitutions. The vector model analyzes and identifies the comprehensive feature vector, outputting the corresponding constitution category or constitution-related parameters, ultimately yielding the user's constitution information.
[0090] Step 103: Determine at least one matching item from a plurality of candidate items associated with the item purchase link based on the user's physical condition information.
[0091] Items associated with an item's purchase link can be items displayed on the page corresponding to the item's purchase link, or they can be associated items of items displayed in the item's purchase link. Associated items of a displayed item can be items that have the same, similar, or complementary functions as the displayed item. Associated items of a displayed item can also be items sold in the same e-commerce store as the displayed item.
[0092] From multiple candidate items, a candidate item whose degree of match with the user's physical condition information exceeds a preset threshold is determined as at least one matching item for the user. The degree of match between the candidate item and the user's physical condition information can be determined based on the candidate item's feature information and the user's physical condition information. The item feature vector may include: a quantitative value of the item's nutritional content, a quantitative value of the item's efficacy, and an item's applicable physical condition vector.
[0093] In one embodiment of the present invention, at least one matching item corresponding to the user is determined from a plurality of candidate items based on the user's physical condition information, including: determining at least one item feature information corresponding to each candidate item; for each candidate item, inputting the at least one item feature information of the candidate item and the user's physical condition information into a matching model; determining a matching degree between the candidate item and the user based on an output of the matching model; and determining at least one matching item corresponding to the user from the plurality of candidate items based on the matching degree corresponding to each candidate item.
[0094] In addition to the applicable physical vector of an item, other item characteristic information can also be extracted and quantified, including the nutritional content of the item and the efficacy of the item, all of which are converted into quantifiable item characteristic information through specific standards and methods.
[0095] For the nutritional content of items, such as the polysaccharide content in wolfberry and the vitamin C content in red dates, the nutritional content of the items can be directly used as the item feature information and normalized.
[0096] For the efficacy of items, evaluation standards and quantitative indicators are developed based on traditional Chinese medicine theory and clinical experience. For example, the efficacy of tonifying the kidney and improving essence is divided into three levels: weak, medium, and strong, with corresponding quantitative values of 1, 2, and 3 respectively.
[0097] For user physical information A and item physical vector B, the cosine similarity algorithm is used to calculate the similarity between them. The formula is as follows:
[0098]
[0099] Among them, sim (A, B) represents the matching degree between the item and the user in terms of applicable physical condition. A is the user's physical condition information, and B is the physical condition vector that the item is applicable to. i is the component of A in the i-th dimension, b i is the component of B in the i-th dimension.
[0100] Based on this, a neural network model is constructed. Its input layer receives feature vectors for each item and user's physical condition information. Item feature vectors may include quantitative values for the item's nutritional content, its efficacy, and its applicable physical condition vector. Several hidden layers transform and fuse the item feature vectors and user's physical condition information, ultimately producing an output layer that indicates the degree of compatibility between the item and the user. This degree of compatibility is mapped using a Sigmoid function, allowing its value to range from 0 to 1. The closer the degree of compatibility is to 1, the more closely the item and user are compatible. The item with the highest degree of compatibility is selected as a matching item and recommended to the user.
[0101] Step 104: Display at least one matching item.
[0102] In the solution of this embodiment of the present invention, user physical condition information is generated based on the user's biometric image. Finally, based on the user's physical condition information, at least one matching item for the user is determined from a plurality of candidate items. This solution of this embodiment of the present invention can accurately determine matching items suitable for the user's physical condition based on the user's physical condition information, reducing the risk of the user purchasing food or health products that are not suitable for their physical condition.
[0103] After generating the user's physical condition information, at least one matching item is selected from the multiple candidate items associated with the item's purchase link. This facilitates users to understand their physical condition information and select suitable items during the shopping process. Furthermore, the fact that the candidate items are associated with the item's purchase link facilitates subsequent add-on purchases and checkout, further enhancing the user's shopping experience.
[0104] In one embodiment of the present invention, the item selection and purchase link includes a product homepage display; the product homepage is provided with a biometric detection trigger mark; in response to a biometric detection request triggered at a user terminal in the item selection and purchase link, a user's biometric detection image is obtained, including: in response to the biometric detection trigger mark being triggered by an operation during the product homepage display process, calling up an image acquisition interface to obtain the user's biometric detection image.
[0105] Figure 2 FIG. 1 is a schematic diagram of a physical fitness detection entrance provided by an embodiment of the present invention. Figure 2 As shown, the product homepage displays "AI Tongue Diagnosis." "AI Tongue Diagnosis" is a biometric detection trigger set on the product homepage. When the user clicks "AI Tongue Diagnosis," the image acquisition interface is entered, where biometric detection images are captured. Based on the captured biometric detection images, the user's physical condition is then tested.
[0106] In one embodiment of the present invention, the item selection link includes the display of an add-to-purchase settlement page; the add-to-purchase settlement page is provided with a biometric detection trigger identifier; in response to a biometric detection request triggered at a user terminal in the item selection link, a biometric detection image of the user is obtained, including: in response to the biometric detection trigger identifier being triggered by an operation during the display of the add-to-purchase settlement page, calling up an image acquisition interface to obtain the biometric detection image of the user.
[0107] Figure 3 FIG. 1 is a schematic diagram of a physical fitness detection entrance provided by another embodiment of the present invention. Figure 3 As shown, the add-to-cart checkout page displays the message "This product is not suitable for all users. We recommend that you perform an AI setup test to select a product that best suits you." The "Agree" button below this display indicates the biometric detection trigger. Clicking "Agree" enters the image acquisition interface, where biometric detection images are collected. Based on the captured biometric images, the user's physical condition is then tested. Clicking "Reject" below the display allows normal checkout.
[0108] In one embodiment of the present invention, at least one matching item is determined from a plurality of alternative items associated with a purchase link of the item based on user physical information, including: determining a target item and a target store corresponding to the purchase link of the item; determining at least one matching item from a plurality of alternative items sold in the target store based on the user physical information; after displaying the at least one matching item, further comprising: receiving a selection instruction for the at least one matching item; determining at least one add-on item from the at least one matching item based on the selection instruction; receiving an add-on operation for each add-on item; generating add-on information for each add-on item based on the add-on operation for each add-on item; and generating an add-on settlement page for the user for the target store based on the target item and the add-on information for each add-on item.
[0109] The target item can be a user's browsing item, add-to-shopping item, or purchase item. The target store is the store that sells the target item. Add-to-shopping information may include price, quantity, and promotional information. The target item and the candidate items are sold by the same store. Recommending items from the same store facilitates centralized purchasing, further streamlining the purchasing process and enhancing the user's shopping experience.
[0110] Figure 4 FIG. 1 is a schematic diagram of a process of an item information recommendation method provided by another embodiment of the present invention. Figure 4 As shown, the method includes:
[0111] Step 401: In response to a biometric detection request triggered at a user terminal during an item purchase process, a biometric detection image of the user is obtained.
[0112] Step 402: Perform background removal processing on the biological detection image to obtain a face-retained image.
[0113] Step 403: Determine the user's tongue image from the retained facial image.
[0114] Step 404: Adjust the tongue image to a preset size, and convert the adjusted tongue image into an HSV color space format.
[0115] Step 405: Extract at least one biometric feature of the user from the converted tongue image.
[0116] Removing irrelevant background and retaining only the facial area can reduce background interference on the model. The tongue images are resized to a fixed size. This step ensures that all tongue images have the same input dimensions during subsequent model processing, facilitating unified calculations and feature extraction.
[0117] Convert the tongue image to the HSV (hue, saturation, value) color space. The HSV color space is more suitable for separating color and brightness information, which can better extract tongue color features. Extract feature information related to tongue color, tongue coating, etc. in the HSV color space. Feature information may include hue and saturation values for different regions. The extracted feature information is then normalized and adjusted to the range of [0, 1] or other appropriate intervals to make the feature values comparable and facilitate subsequent model learning and processing. This range-adjusted feature information is determined as the user's biometric information.
[0118] Step 406: Generate user physical information of the user based on at least one biometric feature information.
[0119] Step 407: Determine at least one matching item from a plurality of candidate items associated with the item purchase link based on the user's physical condition information.
[0120] From the plurality of candidate items, a candidate item whose degree of matching with the user's physical condition information exceeds a preset threshold is determined as at least one matching item for the user. The degree of matching between the candidate item and the user's physical condition information can be determined based on item feature information of the candidate item and the user's physical condition information.
[0121] Step 408: Display at least one matching item.
[0122] By utilizing the solution of the embodiment of the present invention, user physical information representing the user's physical constitution can be accurately generated through the user's tongue image, thereby recommending matching items that match the user's own physical constitution for the user to choose from, thereby improving the user's shopping experience.
[0123] In one embodiment of the present invention, after generating and displaying user physical fitness information based on at least one biometric feature, the system further includes determining the time of the user's physical fitness test and saving a physical fitness record for the user, the physical fitness record including the user's physical fitness information and the time of the physical fitness test. By saving the physical fitness record, detailed changes in the user's physical fitness over time can be recorded.
[0124] In one embodiment of the present invention, it also includes: receiving a physical fitness query instruction for the user; obtaining at least one physical fitness record of the user; determining the display information corresponding to the user's physical fitness information in each physical fitness record; and arranging the display information corresponding to each physical fitness record in sequence according to the physical fitness detection time in each physical fitness record to generate and display the user's physical fitness change chart.
[0125] The display information for each physical condition record can be arranged from the beginning to the end based on the physical condition test time. Alternatively, the display information for each physical condition record can be arranged from the end to the beginning based on the physical condition test time. The display information can be configured according to specific needs. Display information may include: physical condition test time, user physical condition, purchased items, diet, exercise and daily life, precautions, etc. Based on the displayed physical condition change chart, users can fully understand their physical condition and the effectiveness of purchased items.
[0126] Figure 5 FIG. 1 is a schematic diagram of a process of an item information recommendation method provided by another embodiment of the present invention. Figure 5 As shown, the method includes:
[0127] Step 501: In response to a biometric detection request triggered at a user terminal during an item purchase process, a biometric detection image of the user is acquired.
[0128] Step 502: Generate and display user physical information based on the biological detection image.
[0129] Step 303: Determine at least one matching item from a plurality of candidate items associated with the item purchase link based on the user's physical condition information.
[0130] At least one matching item is determined from a plurality of candidate items associated with the item purchase link according to the user's physical condition information.
[0131] Step 504: Determine at least one user constitution corresponding to the user from a plurality of preset constitutions according to the user constitution information.
[0132] Preset constitutions can be set based on medical knowledge or specific needs. Preset constitutions may include: balanced constitution, yang deficiency constitution, yin deficiency constitution, qi deficiency constitution, phlegm-damp constitution, damp-heat constitution, blood stasis constitution, special constitution, qi stagnation constitution, etc. A standard constitution vector is set for each preset constitution. The similarity between the user's constitution information and the standard constitution vector of each preset constitution is calculated. The preset constitution corresponding to the standard constitution vector with a similarity greater than a similarity threshold is used to determine the user's corresponding constitution.
[0133] Step 505: Determine the physical analysis information corresponding to at least one user's physical condition.
[0134] Physical analysis information can be set according to specific needs. Physical analysis information includes: diet, exercise, daily life, meridians and acupoints, etc.
[0135] Step 506: Display the physical analysis information and at least one matching item.
[0136] In the solution of this embodiment of the present invention, at least one user's physical constitution is determined from multiple preset physical constitutions based on the user's physical constitution information, and the physical constitution analysis information corresponding to the user's physical constitution and at least one matching item are displayed to the user. With an understanding of their physical constitution, the user can select the appropriate item from the at least one matching item, reducing the user's shopping blindness and shortening the time it takes to sift through a large number of items.
[0137] Figure 6 FIG. 1 is a flow chart of an item information recommendation method provided by another embodiment of the present invention. Figure 6As shown, the user enters the physical fitness assessment service. The user can take a biometric image or select a biometric image from the photo album. The system provides light and position correction for the biometric image. After the user completes image acquisition, the system collects the tongue image, performs denoising, contrast enhancement and other processing on the tongue image, extracts biometric information, and determines the user's physical fitness information. Based on the user's physical fitness information, at least one matching item corresponding to the user is determined from multiple candidate items. The above-mentioned item information recommendation method may include the following steps:
[0138] Step S1: Upload the user's biometric detection image. Figure 7 FIG. 1 is a schematic diagram of a user uploading a biological detection image provided by an embodiment of the present invention. Figure 7 As shown, the process of a user uploading a biological detection image includes the following steps S11 to S13.
[0139] Step S11: The user clicks the capture button to capture a biological detection image. The user can also click the left button to enter the system album and select a biological detection image from the system album.
[0140] Step S12: The system jumps to the image evaluation page. The system returns the image evaluation results. The image evaluation results indicate whether the biometric image representation meets the photo upload standards. Photo upload standards include: whether the tongue coating is successfully identified, whether the image ratio meets the requirements, and whether the image is blurry. If the biometric image evaluation passes, the system proceeds to the physical fitness evaluation page and executes step S2. If the biometric image evaluation fails, the system proceeds to the test failure page and executes step S13.
[0141] Step S13: The page displays the message "Recognition failed. The tongue coating area was not detected in the uploaded image. Please upload the image again." If the user clicks Cancel, the page returns to the previous photo capture page. If the user clicks Reupload, the upload image component pops up.
[0142] Step S2: The algorithm model determines various biometric information based on the biometric detection image. For example, the tongue image is determined from the biometric detection image to detect the user's tongue color, tongue shape, tongue coating color, coating texture, and saliva.
[0143] Figure 8 FIG. 1 is a schematic diagram of a tongue image detection result provided by an embodiment of the present invention. Figure 8 As shown in the figure, the tongue image test results include: the user's tongue color, tongue coating color, tongue shape, tongue coating quality and saliva, etc. The tongue image test results can provide users with valuable reference for their own physical condition.
[0144] Step S3: Perform a physical analysis based on the user's tongue color, tongue shape, tongue coating color, tongue coating quality, and body fluid to obtain a physical test result. Figure 9FIG is a schematic diagram of a constitution test result based on tongue image provided by an embodiment of the present invention. Figure 9 As shown, based on various tongue feature information, the user's physical condition detection results can be accurately obtained.
[0145] Step S4: Based on the user's physical condition information, the item library is used to recommend items related to their physical condition. Specifically, item feature information is extracted for each candidate item, including the item's applicable physical condition, nutritional content, and efficacy. For example, the nutritional content of goji berries includes polysaccharide content. The nutritional content of red dates includes vitamin C content, among others. The benefits of goji berries include tonifying the kidneys and improving essence. The benefits of red dates include tonifying the middle and replenishing qi, among others. These item features are quantified and then compared and matched against the user's physical condition information.
[0146] Figure 10 This is a schematic diagram of a tongue image-based return page provided by an embodiment of the present invention. Figure 10 As shown, the physical fitness test result page includes: physical fitness analysis information and at least one matching item. The relevant information on the physical fitness test result page allows users to understand their physical fitness and purchase items that are suitable for them.
[0147] Step S5: Record the user's physical condition each time. Through multiple physical condition records, track the user's tongue image and physical condition changes.
[0148] The solution in this embodiment of the present invention utilizes innovative multimodal data fusion. During model training, a comprehensive feature vector is generated based on the user's age, gender, region, medical history, and facial color and texture. This feature vector is then compared and analyzed with previously labeled physical sample data, enabling the model to quickly learn and accurately determine the physical type of a new user. Furthermore, in addition to providing users with recommended matching items based on the applicability and physical condition of the candidate items, the system also provides users with information such as their tongue image and physical constitution, and offers matching suggestions to support their decision-making.
[0149] Figure 11 FIG. 1 is a schematic diagram of a device for recommending item information provided by an embodiment of the present invention. Figure 11 As shown, the device includes:
[0150] An image acquisition module 1101 is configured to acquire a biometric image of a user in response to a biometric detection request triggered at a user terminal during an item selection and purchase process;
[0151] The physical condition determination module 1102 is used to generate and display the user's physical condition information based on the biological detection image;
[0152] The item determination module 1103 is configured to determine at least one matching item from a plurality of candidate items associated with the item purchase link based on the user's physical condition information;
[0153] The item display module 1104 is configured to display at least one matching item.
[0154] Optionally, the item purchase link includes a product homepage display; the product homepage is provided with a biometric detection trigger mark;
[0155] The image acquisition module 1101 is specifically used for:
[0156] In response to a biometric detection triggering mark being triggered by an operation during the display of the product homepage, an image acquisition interface is called to obtain a biometric detection image of the user.
[0157] Optionally, the item purchase link includes a display of an add-to-purchase settlement page; the add-to-purchase settlement page is provided with a biometric detection trigger mark;
[0158] The image acquisition module 1101 is specifically used for:
[0159] In response to a biometric detection triggering mark being triggered by an operation during the display of the add-to-purchase settlement page, an image acquisition interface is called to obtain a biometric detection image of the user.
[0160] Optionally, the item determination module 1103 is specifically configured to:
[0161] Determine the target item and target store corresponding to the item purchase link;
[0162] Determine at least one matching item from multiple candidate items sold in the target store based on the user's physical condition information;
[0163] Also included is: a settlement module for receiving a selection instruction for at least one matching item;
[0164] Determining at least one add-on item from at least one matching item according to the selection instruction;
[0165] Receive the add-to-cart action for each add-to-cart item;
[0166] Generate additional purchase information for each additional purchase item according to the additional purchase operation for each additional purchase item;
[0167] Generate an add-on purchase settlement page for the user at the target store based on the target item and the add-on purchase information of each add-on item.
[0168] Optionally, the physical condition determination module 1102 is specifically configured to:
[0169] Perform background removal on the biological detection image to obtain a face-retained image;
[0170] Determining a tongue image of the user from the retained facial image;
[0171] resizing the tongue image to a preset size, and converting the resized tongue image into an HSV color space format;
[0172] extracting at least one biometric characteristic information of the user from the converted tongue image;
[0173] Generate and display user physical information based on at least one biometric feature information.
[0174] Optionally, the item determination module 1103 is specifically configured to:
[0175] Determining at least one item feature information corresponding to each candidate item associated with the item purchase link;
[0176] For each candidate item, at least one feature of the candidate item and the user's physical condition information are input into a matching model; and based on the output of the matching model, a matching degree between the candidate item and the user is determined;
[0177] At least one matching item is determined from the plurality of candidate items according to the matching degrees corresponding to the candidate items.
[0178] Optionally, it further includes: a record saving module for determining the user's physical fitness test time;
[0179] Save the user's physical fitness records, which include: user's physical fitness information and physical fitness test time.
[0180] Optionally, the record keeping module is further configured to:
[0181] Receive physical inquiry instructions for users;
[0182] Get at least one physical record of the user;
[0183] Determine the display information corresponding to the user's physical fitness information in each physical fitness record;
[0184] According to the physical fitness test time in each physical fitness record, the display information corresponding to each physical fitness record is arranged in sequence to generate and display the user's physical fitness change graph.
[0185] Optionally, the system further includes: a physical constitution analysis module, configured to determine at least one physical constitution corresponding to the user from a plurality of preset physical constitutions according to the physical constitution information of the user;
[0186] Determine and display physical analysis information corresponding to at least one user's physical condition.
[0187] An embodiment of the present invention provides an electronic device, including:
[0188] one or more processors;
[0189] The storage device is used to store one or more programs. When the one or more programs are executed by one or more processors, the one or more processors implement the method of any of the above embodiments.
[0190] An embodiment of the present invention provides a computer program product, including a computer program. When the computer program is executed by a processor, the method of any of the above embodiments is implemented.
[0191] Reference below Figure 12 , which shows a schematic structural diagram of a computer system 1200 of a terminal device suitable for implementing an embodiment of the present invention. Figure 12 The terminal device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.
[0192] like Figure 12 As shown, computer system 1200 includes a central processing unit (CPU) 1201, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1202 or a program loaded from a storage unit 1208 into a random access memory (RAM) 1203. Various programs and data required for the operation of system 1200 are also stored in RAM 1203. CPU 1201, ROM 1202, and RAM 1203 are connected to each other via a bus 1204. An input / output (I / O) interface 1205 is also connected to bus 1204.
[0193] The following components are connected to the I / O interface 1205: an input section 1206 including a keyboard, mouse, and the like; an output section 1207 including devices such as a cathode ray tube (CRT), a liquid crystal display (LCD), and speakers; a storage section 1208 including a hard disk; and a communication section 1209 including a network interface card such as a LAN card or a modem. The communication section 1209 performs communication processing via a network such as the Internet. A drive 1210 is also connected to the I / O interface 1205 as needed. Removable media 1211, such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, is installed in the drive 1210 as needed, so that computer programs read from the removable media can be installed in the storage section 1208 as needed.
[0194] In particular, according to embodiments disclosed herein, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed herein include a computer program product comprising a computer program embodied on a computer-readable medium, the computer program containing program code for executing the methods illustrated in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication section 1209 and / or installed from removable media 1211. When executed by central processing unit (CPU) 1201, the computer program performs the aforementioned functions defined in the system of the present invention.
[0195] It should be noted that the computer-readable medium described in the present invention may be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. Computer-readable storage media may include, for example, but not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or components, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, an electrical connection having one or more conductors, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present invention, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such a propagated data signal may take a variety of forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. Program code embodied on a computer-readable medium may be transmitted using any suitable medium, including but not limited to wireless, wireline, optical fiber cable, RF, or any suitable combination thereof.
[0196] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present invention. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the above-mentioned module, program segment, or a part of code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0197] The modules described in the embodiments of the present invention may be implemented in software or hardware. The modules described may also be located within a processor. For example, they may be described as: an image acquisition module, a physical condition determination module, an item determination module, and an item display module. The names of these modules do not, in some cases, limit the modules themselves. For example, the image acquisition module may be described as "a module that acquires a user's biometric image in response to a biometric detection request triggered by a user terminal during the item purchase process."
[0198] As another aspect, the present invention further provides a computer-readable medium, which may be included in the device described in the above embodiments, or may exist independently without being incorporated into the device. The computer-readable medium carries one or more programs, and when the one or more programs are executed by the device, the device includes:
[0199] In response to a biometric detection request triggered at a user terminal during a purchase link for an item, obtaining a biometric detection image of the user;
[0200] Generate and display user physical information based on biological detection images;
[0201] Determining at least one matching item from a plurality of candidate items associated with the item purchase link based on the user's physical condition information;
[0202] Display at least one matching item.
[0203] According to the technical solution of the embodiments of the present invention, user physical condition information is generated based on the user's biometric image. Finally, based on the user's physical condition information, at least one matching item for the user is determined from a plurality of candidate items. This solution of the embodiments of the present invention can accurately determine matching items suitable for the user's physical condition based on the user's physical condition information, reducing the risk of the user purchasing food or health products that are not suitable for their physical condition.
[0204] After generating the user's physical condition information, at least one matching item is selected from the multiple candidate items associated with the item's purchase link. This facilitates users to understand their physical condition information and select suitable items during the shopping process. Furthermore, the fact that the candidate items are associated with the item's purchase link facilitates subsequent add-on purchases and checkout, further enhancing the user's shopping experience.
[0205] The above specific embodiments do not limit the scope of protection of the present invention. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions may occur depending on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention are intended to be included within the scope of protection of the present invention.
Claims
1. A method for recommending item information, characterized in that: include: In response to a biometric detection request triggered at a user terminal during a purchase link for an item, obtaining a biometric detection image of the user; Generate and display user physical information based on the biological detection image; Determining at least one matching item from a plurality of candidate items associated with the item purchase link according to the user's physical condition information; The at least one matching item is displayed.
2. The method according to claim 1, characterized in that The item purchase link includes a product homepage display; the product homepage is provided with a biometric detection trigger mark; The step of obtaining a biometric image of a user in response to a biometric detection request triggered at a user terminal during an item purchase process includes: In response to a biometric detection triggering mark being triggered during the display of the product homepage, an image acquisition interface is called to obtain a biometric detection image of the user.
3. The method according to claim 1, characterized in that The item selection link includes a purchase settlement page display; the purchase settlement page is provided with a biometric detection trigger mark; The step of obtaining a biometric image of a user in response to a biometric detection request triggered at a user terminal during an item purchase process includes: In response to a biometric detection triggering mark being triggered by an operation during the display of the add-to-purchase settlement page, an image acquisition interface is called to obtain a biometric detection image of the user.
4. The method according to claim 1, wherein The step of determining at least one matching item from a plurality of candidate items associated with the item purchase link based on the user's physical condition information includes: Determine the target item and target store corresponding to the purchase link of the item; Determining at least one matching item from a plurality of candidate items sold in the target store based on the user's physical condition information; After displaying the at least one matching item, the method further includes: receiving a selection instruction for the at least one matching item; determining at least one add-on item from the at least one matching item according to the selection instruction; receiving an add-on purchase operation for each of the add-on items; generating additional purchase information for each of the additional purchase items according to the additional purchase operation for each of the additional purchase items; Generate an additional purchase settlement page for the user at the target store based on the target item and the additional purchase information of each additional purchase item.
5. The method according to claim 1, characterized in that Generating and displaying user physical condition information based on the biological detection image includes: performing background removal processing on the biological detection image to obtain a face-retained image; determining a tongue image of the user from the retained facial image; Adjusting the tongue image to a preset size, and converting the adjusted tongue image into an HSV color space format; extracting at least one biometric feature of the user from the converted tongue image; User physical information is generated and displayed based on the at least one biometric feature information.
6. The method according to claim 1, characterized in that The step of determining at least one matching item from a plurality of candidate items associated with the item purchase link based on the user's physical condition information includes: Determining at least one item feature information corresponding to each candidate item associated with the item purchase link; For each candidate item, input at least one item feature information of the candidate item and the user's physical condition information into a matching model; and determine a matching degree between the candidate item and the user based on an output of the matching model; The at least one matching item is determined from the plurality of candidate items according to the matching degrees corresponding to the candidate items.
7. The method according to claim 1, characterized in that After generating and displaying the user's physical condition information based on the biological detection image, the method further includes: Determine the user's physical fitness test time; The user's physical fitness record is saved, where the physical fitness record includes: the user's physical fitness information and the physical fitness detection time.
8. The method according to claim 7, characterized in that Also includes: receiving a physical condition inquiry instruction for the user; Obtain at least one physical record of the user; Determining display information corresponding to the user's physical fitness information in each of the physical fitness records; According to the physical fitness detection time in each physical fitness record, the display information corresponding to each physical fitness record is arranged in sequence to generate and display the physical fitness change graph of the user.
9. The method according to claim 1, characterized in that After generating and displaying the user's physical condition information based on the biological detection image, the method further includes: Determining at least one user physical condition corresponding to the user from a plurality of preset physical conditions according to the user physical condition information; Determine and display physical analysis information corresponding to the at least one user's physical condition.
10. An item information recommendation device, characterized in that: include: An image acquisition module, configured to acquire a biometric image of a user in response to a biometric detection request triggered at a user terminal during an item selection and purchase process; a physical condition determination module, configured to generate and display user physical condition information based on the biological detection image; an item determination module, configured to determine at least one matching item from a plurality of candidate items associated with the item purchase link based on the user's physical condition information; The item display module is used to display the at least one matching item.
11. An electronic device, characterized in that: include: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 9.
12. A computer-readable medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 9 is implemented.
13. A computer program product comprising a computer program, which, when executed by a processor, implements the method according to any one of claims 1 to 9.