Recommendation information-based interaction method and apparatus, device, medium, and product

Abstract

The present application relates to the field of human-computer interaction, and discloses a recommendation information-based interaction method and apparatus, a device, a medium, and a product. The method comprises: displaying a recommendation medium and a virtual interaction control of a first recommended product; in response to a trigger operation for the virtual interaction control, displaying a camera acquisition preview interface, the camera acquisition preview interface comprising prompt information for guiding acquisition of a target object image; and in response to the target object image meeting an acquisition condition, displaying an associated effect of a physical attribute corresponding to a target recommended product and a target part, the target recommended product being the first recommended product or a second recommended product belonging to the same type as the first recommended product. The associated effect is a virtual product effect of the target recommended product. By displaying the virtual product effect of the target recommended product in the form of AR on the target part, the fusion of the virtual product effect and a real scenario is ensured, and by recommending the same product or similar types of products, personalized recommendation is achieved.

Description

Interactive methods, devices, equipment, media, and products based on recommendation information

[0001] Priority information

[0002] This application claims priority to Chinese Patent Application No. 202411187678.5, filed on August 27, 2024, entitled "Interactive Method, Apparatus, Device, Medium and Product Based on Recommendation Information", the entire contents of which are incorporated herein by reference. Technical Field

[0003] This application relates to the field of human-computer interaction, and in particular to an interactive method, apparatus, device, medium, and product based on recommendation information. Background Technology

[0004] To enhance the promotional effectiveness of recommended products, advertisers can employ various methods and utilize different platforms to promote them. For example, advertisers can promote recommended products through short videos on social media platforms.

[0005] In related technologies, taking jewelry as an example of recommended products, when users browse short videos, the jewelry is often presented in the form of static images or dynamic videos. Users can understand the effect of trying on the jewelry through the displayed static images or dynamic videos, and make further understanding or purchase decisions by estimating or referring to the effect of others trying it on. For example, users can choose to click on the interactive controls in the short video to enter the corresponding jewelry details page.

[0006] However, the display effect of recommended products in related technologies is limited, and the interaction methods between users and recommended products are relatively simple, resulting in a low click-through rate for recommended products. Summary of the Invention

[0007] This application provides an interactive method, apparatus, device, medium, and product based on recommendation information, the technical solution of which is as follows.

[0008] According to one aspect of this application, an interaction method based on recommendation information is provided, the method comprising:

[0009] Displays the recommendation medium and virtual interactive controls for the top-recommended product;

[0010] In response to a trigger operation on the virtual interactive control, a camera acquisition preview interface is displayed, which includes prompts to guide the acquisition of images of the target object.

[0011] In response to the target object image meeting the acquisition conditions, the association effect between the physical attributes of the target recommended product and the target part is displayed on the virtual trial interface. The target part is the position in the target object image that is related to the position of the first recommended product.

[0012] The target recommended product is either the first recommended product or a second recommended product of the same type as the first recommended product.

[0013] According to one aspect of this application, an interactive device based on recommendation information is provided, the device comprising:

[0014] The display module is used to display the recommendation medium and virtual interactive controls for the first recommended product;

[0015] The display module is used to display a camera acquisition preview interface in response to a trigger operation on the virtual interactive control. The camera acquisition preview interface includes prompt information to guide the acquisition of images of the target object.

[0016] The display module is used to display the correlation effect between the physical attributes of the target recommended product and the target part on the virtual trial interface in response to the target object image meeting the acquisition conditions. The target part is the position in the target object image that is related to the position of the first recommended product.

[0017] The target recommended product is either the first recommended product or a second recommended product of the same type as the first recommended product.

[0018] According to another aspect of this application, a computer device is provided, comprising: a processor and a memory, wherein the memory stores at least one computer program, the at least one computer program being loaded and executed by the processor to implement the interactive method based on recommendation information as described above.

[0019] According to another aspect of this application, a computer storage medium is provided, wherein at least one computer program is stored in the computer-readable storage medium, and the at least one computer program is loaded and executed by a processor to implement the interactive method based on recommendation information as described above.

[0020] According to another aspect of this application, a computer program product is provided, comprising a computer program stored in a computer-readable storage medium; the computer program is read from and executed by a processor of a computer device from the computer-readable storage medium, causing the computer device to perform the recommendation-based interactive method as described above.

[0021] The beneficial effects of the technical solutions provided in this application include at least the following:

[0022] Taking recommended short videos as an example, in related technologies, users learn about the try-on effect of recommended products through static images or dynamic videos while browsing short videos. In this embodiment, by displaying a first recommended product and virtual interactive controls on the short video playback interface, users can trigger the virtual interactive controls to enter the camera acquisition preview interface. On the camera acquisition preview interface, users can interact according to the prompts. When the target object image meets the acquisition conditions, the association effect between the physical attributes of the target recommended product and the target part in the target object image is displayed on the virtual trial interface. The association effect is the virtual product effect of the target recommended product. For example, AR interaction can be performed according to the prompts, and the wearing or use effect of the target recommended product can be previewed through AR. By displaying the virtual product effect of the target recommended product in AR form on the target part, the integration of the virtual product effect of the target recommended product with the real scene is ensured.

[0023] Furthermore, by triggering virtual interactive controls, products that are the same as or of the same type as the promoted product (the first recommended product) are recommended to users, thus realizing personalized recommendation services. This recommendation method not only improves the accuracy of recommendations but also increases the frequency of user interaction with advertisements, thereby increasing the click-through rate of advertisements. Attached Figure Description

[0024] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0025] Figure 1 is an architecture diagram of a computer system provided in an exemplary embodiment of this application;

[0026] Figure 2 is a schematic diagram of an interactive method based on recommendation information provided in an exemplary embodiment of this application;

[0027] Figure 3 is a flowchart of an exemplary embodiment of the interactive method based on recommendation information provided in this application;

[0028] Figure 4 is a schematic diagram of an interactive method based on recommendation information provided in an exemplary embodiment of this application;

[0029] Figure 5 is a schematic diagram of an interactive method based on recommendation information provided in an exemplary embodiment of this application;

[0030] Figure 6 is a flowchart of an exemplary embodiment of the interactive method based on recommendation information provided in this application;

[0031] Figure 7 is a flowchart of an exemplary embodiment of the interactive method based on recommendation information provided in this application;

[0032] Figure 8 is a schematic diagram of an interactive method based on recommendation information provided in an exemplary embodiment of this application;

[0033] Figure 9 is a schematic diagram of an interactive method based on recommendation information provided in an exemplary embodiment of this application;

[0034] Figure 10 is a schematic diagram of an interactive method based on recommendation information provided in an exemplary embodiment of this application;

[0035] Figure 11 is a schematic diagram of an interactive method based on recommendation information provided in an exemplary embodiment of this application;

[0036] Figure 12 is a timing diagram of an interactive method based on recommendation information provided in an exemplary embodiment of this application;

[0037] Figure 13 is a structural block diagram of an interactive device based on recommendation information provided in an exemplary embodiment of this application;

[0038] Figure 14 is a schematic diagram of the structure of a computer device provided in an exemplary embodiment of this application. Detailed Implementation

[0039] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0040] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0041] The terminology used in this application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. The singular forms “a,” “the,” and “the” used in this application and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used herein refers to and includes any and all possible combinations of one or more of the associated listed items.

[0042] It should be understood that although the terms first, second, etc., may be used in this disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, a first parameter may also be referred to as a second parameter without departing from the scope of this disclosure, and similarly, a second parameter may also be referred to as a first parameter. Depending on the context, the word "if" as used herein may be interpreted as "when," "when," or "in response to determination."

[0043] It should be noted that this application may display prompt interfaces, pop-ups, or output voice prompts before and during the collection of user-related data (e.g., operational data involved in this application). These prompt interfaces, pop-ups, or voice prompts are used to inform the user that their relevant data is being collected. This ensures that the application only begins the steps for collecting user-related data after receiving confirmation from the user regarding the prompt interface or pop-up; otherwise (i.e., without receiving confirmation from the user), the steps for collecting user-related data end, meaning no user-related data is collected. In other words, all user data collected in this application is collected with the user's consent and authorization, and the collection, use, and processing of related user data must comply with the relevant laws, regulations, and standards of the relevant regions.

[0044] Before introducing the technical solutions of this application, some terms involved in this application will be explained. The following related explanations are optional solutions and can be arbitrarily combined with the technical solutions of the embodiments of this application, all of which fall within the protection scope of the embodiments of this application. The embodiments of this application include at least some of the following contents.

[0045] A feed refers to a data format that continuously updates and presents social content to users. Feeds include at least two display formats: timeline-based and random. Timeline-based display shows social content to users in the order it was updated. Random display calculates the weight of content based on certain factors to determine the order in which it is shown. For example, an algorithm might calculate the weight of social content published by a subscription account, and then use that weight to determine the order in which it is recommended to users. Feeds also use different presentation formats to display social content, such as list, waterfall, and card formats. A feed can also be considered as an aggregation of at least one resource provided by at least one content source subscribed to by a user's account.

[0046] Artificial Intelligence (AI) is the theory, methods, technology, and application systems that use digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, perceive the environment, acquire knowledge, and use that knowledge to achieve optimal results. In other words, AI is a comprehensive technology within computer science that attempts to understand the essence of intelligence and produce new intelligent machines that can react in a way similar to human intelligence. AI studies the design principles and implementation methods of various intelligent machines, enabling them to possess perception, reasoning, and decision-making capabilities.

[0047] Augmented Reality (AR) is a technology that combines virtual information with the real world, creating an enhanced reality experience by overlaying virtual information onto the real world. AR uses cameras, sensors, and other devices to capture images and sounds of the real world and combines this information with computer-generated virtual content to enhance the user's sensory experience.

[0048] Figure 1 shows a structural block diagram of a computer system provided in an exemplary embodiment of this application. The computer system 100 includes: a first terminal 120, a server 140, and a second terminal 160.

[0049] The first terminal 120 has a social interaction platform installed and running that supports an information flow interface. A first user account is logged into the social interaction platform, and this account can browse or post content on the platform's information flow interface. The first user account can also interact with its subscribed accounts through the information flow interface displayed on the social interaction platform. For example, if the social interaction platform is the Moments feature of a social media app, the first user account can like and comment on social content posted by its friends; if the first social interaction platform is a Q&A community, the first user account can like, comment on, share, report, and ignore content posted by users it follows.

[0050] The second terminal 160 has a social interaction platform installed and running, which supports a news feed interface. A second user account is logged into the social interaction platform, and this account can browse or post content on the news feed interface. The second user account can also interact with its subscribed accounts through the news feed interface displayed on the social interaction platform.

[0051] In one embodiment, the first user account and the second user account have a one-way subscription relationship. If the second user account publishes social content on the social interaction platform, the first user account can view the content on the information feed interface. However, if the first user account publishes social content on the social interaction platform, the second user account cannot view the content on the information feed interface.

[0052] In another embodiment, the first user account and the second user account have a two-way subscription relationship. If the second user account publishes social content on the social interaction platform, the first user account can view the content on the information feed interface.

[0053] The first terminal 120 and the second terminal 160 are connected to the server 140 via a wireless network or a wired network.

[0054] Server 140 includes at least one of a single server, multiple servers, a cloud computing platform, and a virtualization center. For example, server 140 includes a processor 144 and a memory 142. Memory 142 further includes a receiving module 1421, a control module 1422, and a sending module 1423. The receiving module 1421 is used to receive requests sent by the social interaction platform, such as a request to like target social content. The control module 1422 is used to control the rendering of the information flow interface. The sending module 1423 is used to send responses to the social interaction platform, such as sending feedback on whether the like was successful. Server 140 is used to provide backend services to support the social interaction platform. Optionally, server 140 undertakes the main computational work for the functions supported by the social interaction platform, while the first terminal 120 and the second terminal 160 undertake the secondary computational work for the functions supported by the social interaction platform; or, server 140 undertakes the secondary computational work for the functions supported by the social interaction platform, while the first terminal 120 and the second terminal 160 undertake the main computational work for the functions supported by the social interaction platform; or, server 140, first terminal 120, and second terminal 160 undertake the computational work for the functions supported by the social interaction platform in a collaborative manner.

[0055] Optionally, the first terminal 120 and the second terminal 160 may be of the same or different device types, including at least one of the following: smartphones, smartwatches, in-vehicle terminals, wearable devices, smart TVs, tablets, e-book readers, MP3 players, MP4 players, laptops, and desktop computers. The following embodiments use smartphones as an example.

[0056] Those skilled in the art will understand that the number of terminals described above can be more or less. For example, there may be only one terminal, or there may be dozens or hundreds of terminals, or even more. This application does not limit the number of terminals or the type of device.

[0057] For example, Figure 2 shows a schematic diagram of an interactive method based on recommendation information provided in an exemplary embodiment of this application.

[0058] In related technologies, taking jewelry as an example of recommended products, when users browse short videos, jewelry is mostly displayed in the form of static images or dynamic videos. Users understand the effect of trying on the jewelry through the displayed static images or dynamic videos, and make further understanding or purchase decisions by estimating or referring to the effect of others trying it on. For example, users can choose to click on the interactive controls in the short video to enter the corresponding jewelry details page. However, the display effect of recommended products in related technologies is limited, and the interaction methods between users and recommended products are relatively simple, resulting in a low click-through rate for recommended products.

[0059] To address the aforementioned issues, this application provides an interactive method based on recommendation information. An information flow advertisement corresponding to a first recommended product is displayed on an information flow interface (e.g., a short video playback interface). Optionally, the short video playback interface also includes a virtual interactive control. After the user clicks the virtual interactive control, the terminal device acquires an image of the user's target object through a camera, such as an image of the user's hand. The device then analyzes the user's hand image based on an AI algorithm, such as analyzing the size and shape of the hand image, to obtain a recommendation list for the hand image. The recommendation list includes at least one recommended product of the same type as the first recommended product. A virtual trial interface displays the effect of the target recommended product superimposed on the user's hand. The user can move their hand to view the trial effect from different angles.

[0060] For example, a social interaction platform is installed and runs on the terminal device. For instance, a short video is used as the recommendation medium for the first recommended product. This social interaction platform has a short video playback interface 10, which includes social content published by at least one content publishing account arranged chronologically. A content publishing account refers to an account that publishes social content on the social interaction platform. As shown in Figure 2(a), the content publishing account is an advertising account. For example, the content publishing account is "XXX Jewelry," and the social content published by this account is advertising content.

[0061] Optionally, the short video playback interface 10 displays a recommended short video of the first recommended product 20 and a virtual interactive control 30. The first recommended product 20 can be jewelry, such as a ring, bracelet, or necklace. Alternatively, the first recommended product 20 can also be a beauty product, such as lipstick, eyeshadow, or eyebrow pencil. The virtual interactive control 30 refers to an interactive element in the short video playback interface 10 used to trigger AR try-on. Optionally, the virtual interactive control 30 is typically presented as an icon, button, text, or other form.

[0062] In some embodiments, in response to a triggering operation on the virtual interactive control 30, a camera capture preview interface 40 is displayed. Optionally, the camera capture preview interface 40 displays prompting information to guide the capture of a target object image, for example, a guide overlay 50. For example, as shown in Figure 2(b), after the user clicks the virtual interactive control 30, the camera capture preview interface 40 and the corresponding guide overlay 50 are displayed. The guide overlay 50 guides the user to capture a target object image. The target object image is an image of a body part of the user; optionally, the target object image is an image of a body part used for trying on makeup or wearing jewelry. For example, the target object image is an image of the user's hand, neck, or lips. Optionally, the user, following the guidance of the guide overlay 50, controls the alignment of the target object image with the guide overlay 50 within the camera capture preview interface 40.

[0063] As shown in Figure 2(c), in response to the target object image meeting the acquisition conditions, that is, in response to the overlap between the target object image and the guidance overlay 50 meeting the first threshold, the association effect between the physical attributes corresponding to the target recommended product 71 and the target part in the target object image is displayed. The association effect is the virtual product effect of the target recommended product 71, and the target recommended product 71 is displayed in AR form overlaid on the virtual trial interface 60 of the target part. Here, the overlap refers to the degree of overlap (or overlap ratio) between the target object image and the guidance overlay in the spatial area. The overlap can be used to measure the consistency between the target part and the guidance overlay. If the overlap reaches or exceeds the preset first threshold, the target recommended product 71 is displayed in AR form overlaid on the target part.

[0064] Optionally, the target recommended product 71 is the first recommended product 20, or the target recommended product 71 is a second recommended product of the same type as the first recommended product 20. "Same type" means the recommended products belong to the same category or product class. For example, if the first recommended product is a ring, the target recommended product is also a ring. Optionally, the target recommended product 71 is a recommended product obtained based on AI algorithms analyzing the user's target object image.

[0065] In some embodiments, in response to the overlap between the target object image and the guiding mask layer 50 satisfying a first threshold, the target object image is analyzed based on an AI algorithm to obtain a recommendation list 70. For example, as shown in Figure 2(c), the recommendation list 70 includes at least one candidate recommended product.

[0066] Optionally, at least one candidate recommended product in the recommendation list 70 is sorted from high to low according to its fit with the target object image, and the candidate recommended product ranked first is determined as the target recommended product 71 and displayed in AR form overlaid on the target area.

[0067] Optionally, a recommendation list 70 is obtained by analyzing the reference standards corresponding to the target object image based on AI algorithms. Different target object images correspond to different reference standards. For example, when the target object image is a hand image, the reference standards corresponding to the hand image include, but are not limited to, at least one of the shape, size, and color of the hand image; when the target object image is a neck image, the reference standards corresponding to the neck image include, but are not limited to, at least one of the color and smoothness of the neck image.

[0068] In some embodiments, in response to a selection operation of any candidate recommended product in the recommendation list 70, the selected candidate recommended product is overlaid and displayed on the target area in AR format. Optionally, the user browses the recommendation list 70 and selects candidate recommended products from the recommendation list 70 according to their preferences.

[0069] In some embodiments, in response to an interactive operation on the target recommended product 71, the association effect between the physical attributes of the target recommended product 71 and the target body part is updated. Optionally, in response to a rotation operation on the target recommended product 71, the angle of the target recommended product 71 is rotated, and the rotated target recommended product 71 is displayed on the target body part; or, in response to a zoom-in operation on the target recommended product 71, the size of the target recommended product 71 is enlarged, and the enlarged target recommended product 71 is displayed on the target body part; or, in response to a zoom-out operation on the target recommended product 71, the size of the target recommended product 71 is reduced, and the reduced target recommended product 71 is displayed on the target body part; or, in response to a move operation on the target recommended product 71, the position of the target recommended product 71 is moved, and the moved target recommended product 71 is displayed on the target body part. Users can view the wearing effect of the target recommended product 71 in different states through rotation, zoom-in, zoom-out, and move operations on the target recommended product 71.

[0070] In some embodiments, the user can move the target area, and in response to the movement operation on the target area, the target recommended product 71 can be displayed in AR form overlaid on the target area at different angles. Optionally, in response to the switching operation on the virtual background, the target recommended product 71 can be displayed in AR form overlaid on the target area in different scenarios. By switching the virtual background, the wearing effect of the user in different daily scenarios can be simulated.

[0071] In some embodiments, as shown in Figure 2(c), the virtual trial interface 60 includes a split-screen control 80, which triggers the split-screen display of the virtual trial interface 60. The virtual trial interface 60 displays the correlation effect between the physical attributes of the target recommended product 71 and the target body part. In response to the trigger operation of the split-screen control 80, the virtual trial interface 60 and the short video playback interface 10 are controlled to be displayed in a split-screen format on the comparison interface 90. Users can view the difference between the advertising effect and the actual wearing effect through the comparison interface 90.

[0072] Figure 3 is a flowchart of an exemplary embodiment of the interactive method based on recommendation information provided in this application. This method can be executed by a terminal device, by a server, or by both a terminal device and a server simultaneously. The method includes at least the following steps:

[0073] Step 210: Display the recommendation medium and virtual interactive controls for the first recommended product.

[0074] Here, "recommendation medium" refers to the method used to display the first recommended product. Recommendation mediums can take many different forms, and optionally include, but are not limited to, at least one of the following: recommended short videos, recommended text content, recommended websites, recommended public accounts, recommended mini-programs, and recommended mobile applications.

[0075] For example, the recommendation medium is a recommendation mini-program. Optionally, a social interaction platform is installed and running on the terminal device, and the recommendation mini-program is installed within the social interaction platform. After entering the recommendation mini-program, the main page displays a virtual interactive control corresponding to the first recommended product, and players can interact with the first recommended product by triggering the virtual interactive control.

[0076] For example, the recommendation medium is recommended text content. Optionally, a target application is installed and running on the terminal device, and the target application supports the display of recommended text content. Optionally, the text content includes promotional keywords, which are interactive text content; that is, the promotional keywords can be virtual interactive controls, and players can interact with the first recommended product by triggering the promotional keywords (virtual interactive controls).

[0077] For example, the recommendation medium is a short video recommendation. Optionally, a social interaction platform is installed and runs on the terminal device, and this social interaction platform is designed with a short video playback interface, which is part of the information flow interface. Optionally, the short video playback interface displays a virtual interactive control corresponding to the first recommended product, and players can interact with the first recommended product by triggering the virtual interactive control. This application does not limit this aspect.

[0078] It should be noted that the embodiments in this application are mainly described using recommended short videos as the recommended medium. However, this does not constitute a limitation on the recommended medium.

[0079] In some embodiments, the recommendation medium is recommended short videos, which are displayed on a short video playback interface, which is part of the information feed interface. The information feed interface refers to an interface that continuously updates and presents content to the user, including social content sent by at least one content publishing account. The information feed includes at least a timeline-based display format and a random display format. Optionally, the information feed interface includes social content sent by at least one content publishing account arranged chronologically; or, the information feed interface includes social content sent by at least one content publishing account displayed randomly.

[0080] In some embodiments, a content publishing account refers to an account that publishes social content on a social interaction platform. Social content refers to the content published by the content publishing account. If the content publishing account is a user account, the social content may be the user account's daily updates, video reposts, etc.

[0081] Optionally, the content publishing account is an advertising account, and the social content published by the advertising account is an in-feed ad corresponding to the first recommended product. Optionally, the in-feed ad is displayed in the form of a short video or an image on the short video playback interface.

[0082] In some embodiments, the short video playback interface displays a recommended short video of a first recommended product and virtual interactive controls. The first recommended product can be a jewelry product, such as a ring, bracelet, or necklace. Alternatively, the first recommended product can be a beauty product, such as lipstick, eyeshadow, or eyebrow pencil. The virtual interactive controls refer to interface elements in the short video playback interface used to trigger AR interaction. Optionally, virtual interactive controls are typically presented as icons, buttons, text, or other forms.

[0083] In some embodiments, the content publishing account is an advertising account, and the first recommended product is the promotional content corresponding to the advertising account. Optionally, the short video playback interface also displays promotional text corresponding to the first recommended product. Optionally, the short video playback interface also includes a component for expressing an opinion on the first recommended product. This component includes, but is not limited to, at least one of a like button, a comment button, a favorite button, and a share button.

[0084] For example, as shown in Figure 4, a social interaction platform is installed and runs on the terminal device. This platform displays a short video playback interface 200, which includes social content published by at least one content publishing account 202. For example, content publishing account 202 is an advertising account "XXX Jewelry". The social content published by content publishing account 202 is promotional content; for example, the promotional content published by content publishing account 202 is a recommended short video of the first recommended product 201. The first recommended product 201 is a jewelry product, such as a ring. A comment component 203 is also displayed around content publishing account 202, allowing users to comment on the recommended short video of the first recommended product 201. Optionally, a virtual interactive control 204 is also displayed on the short video playback interface, which is displayed as "AR Try-On".

[0085] Step 220: In response to a trigger action on the virtual interactive control, display the camera capture preview interface.

[0086] Among them, the triggering operation for the virtual interactive control includes at least one of the direct triggering operation and the indirect triggering operation.

[0087] Optionally, direct triggering operations for virtual interactive controls include, but are not limited to: single-click operation, double-click operation, voice operation, long-press operation, swipe operation, touch operation, button operation, gesture operation, and free combination of at least two of the above operations.

[0088] Optionally, indirect triggering of virtual interactive controls can be implemented through a status component. In some embodiments, the short video playback interface further includes a status component for recommended short videos of the first recommended product. The status component includes, but is not limited to, at least one of a like button, a comment button, a favorite button, and a share button.

[0089] Optionally, in response to a positive expression action on the expression component, the conditions for an indirect triggering action on the virtual interactive control are determined. A positive expression action refers to an action by which a user actively interacts with or expresses a positive attitude towards a recommended short video through the expression component. Optionally, a positive expression action can be a like, favorite, share, or comment action on the recommended short video. After a user performs a positive expression action, the conditions for an indirect triggering action on the virtual interactive control are determined to be met. The user's positive feedback on the recommended short video of the first recommended product affects the state of the virtual interactive control. For example, when a user likes the like button in the expression component, this like action represents the user's positive feedback on the recommended short video of the first recommended product. In response to this positive expression action, the terminal device triggers the virtual interactive control on the short video playback interface, automatically opening or displaying the virtual interactive control.

[0090] In some embodiments, in response to a triggering operation on a virtual interactive control, a camera capture preview interface is displayed, which includes prompts to guide the capture of an image of the target object. Optionally, when the virtual interactive control is directly or indirectly triggered, the terminal device's display interface jumps from the short video playback interface to the camera capture preview interface.

[0091] The camera capture preview interface refers to the live view captured by the user through the camera on their terminal device. This interface allows users to view the images captured by the camera in real time. The prompts / information displayed on the camera capture preview interface are guiding information or visual aids that instruct the user on how to capture images of the target object using the camera. Optionally, the target object image includes images of body parts and non-body parts.

[0092] In some embodiments, the target object image is a body part image (or a target fitting part image). The first recommended product is a product applied to the target part, which is a body part. Optionally, the first recommended product is a jewelry or cosmetic product that modifies the user's body part. On the camera capture preview interface, the camera is moved according to the interactive method indicated by the prompts, so that the camera can acquire the image corresponding to the body part. For example, if the first recommended product is a ring, the pre-captured target object image is a hand image; if the first recommended product is a necklace, the pre-captured target object image is a neck image; if the first recommended product is lipstick, the pre-captured target object image is a lip image.

[0093] In some embodiments, the target object image is a non-body part image (or target spatial location image). The first recommended product is a product applied to the target part, where the target part is the target spatial location. Optionally, the first recommended product is a decorative product or a practical product. On the camera acquisition preview interface, the camera is moved according to the interactive method indicated by the prompt information, enabling the camera to acquire the image corresponding to the target spatial location. The target spatial location is a location related to the application position of the first recommended product. For example, if the first recommended product is a television, the pre-acquired target object image (target spatial location image) is the image corresponding to the area where the television is placed, such as the image of the TV cabinet location; or, if the first recommended product is a decorative item, the pre-acquired target object image (target spatial location image) is the image corresponding to the area where the decorative item is placed, such as the image of the blank wall where the decorative item is hung; or, if the first recommended product is a lamp, the pre-acquired target object image (target spatial location image) is the image corresponding to the area requiring illumination, such as the image of the bookshelf where the lamp needs to be placed.

[0094] In some embodiments, the prompt information refers to guiding information or visual aids displayed to the user on the camera capture preview interface. Optionally, the prompt information is a guidance mask. The guidance mask can be a layer with a certain shape and / or color overlaid on the camera capture preview interface. For example, the guidance mask is a layer overlaid on the camera capture preview interface with a preset transparency, or a layer overlaid on the camera capture preview interface with a preset color (e.g., white, black), or a layer overlaid on the camera capture preview interface with a preset shape (e.g., a hand shape). The guidance mask is used to guide the user to capture an image of the target object.

[0095] Optionally, when the target object image is a body part image, the prompt message is a first type of guiding mask. The shape of the first type of guiding mask is related to the shape of the pre-captured target object image. For example, if the first piece of jewelry is a ring and the pre-captured target object image is a hand image, the guiding mask is displayed as a layer shaped like a palm. Or, for example, if the first piece of jewelry is a necklace and the pre-captured target object image is a neck image, the guiding mask is displayed as a layer shaped like a neck. This application does not limit this.

[0096] Optionally, when the target object image is not a body part image, the prompt message is a second type of guiding mask. The shape of the second type of guiding mask is related to the location of the area where the pre-captured target object image is placed. For example, if the first recommended product is a television set, and the pre-captured target object image is the image corresponding to the location where the television set is placed, the guiding mask can be displayed as a layer shaped like a TV cabinet; or, for example, if the first recommended product is a lamp, and the pre-captured target object image is the image corresponding to the location of the area that needs lighting, the guiding mask can be displayed as a layer shaped like a desk. This application does not limit this.

[0097] In some embodiments, the camera capture preview interface includes a capture frame, within which a guide overlay is displayed. The capture frame is located in the target area of ​​the camera capture preview interface. The capture frame is displayed as a rectangular, circular, or other shaped border. The target area is the display area of ​​the capture frame, which can be a preset area or a dynamically changing area; for example, the target area may be the middle two-thirds of the terminal screen. In some embodiments, the display size of the capture frame can be dynamically changing. Optionally, the display size of the capture frame changes with the distance between the target object and the camera. For example, the greater the distance between the target object and the camera, the smaller the display size of the capture frame; the smaller the distance between the target object and the camera, the larger the display size of the capture frame.

[0098] In some embodiments, the camera acquisition preview interface also includes acquisition prompts, which are prompts used to guide the target object image to the guide overlay position. Optionally, the acquisition prompts may include, but are not limited to, at least one of text prompts, arrow prompts, image prompts, and voice prompts. Optionally, the acquisition prompts may be located around the periphery of the acquisition frame, such as above the acquisition frame. Optionally, the display information of the acquisition prompts may be dynamically changing.

[0099] In one possible implementation, the acquisition prompts are voice prompts, which can change according to the positional shift between the target image and the camera. For example, if the target image is a hand, the initial voice prompt would be "Please place your hand within the capture frame in the center of the screen." If the user's hand is not aligned with the guide overlay, the voice prompt would be "Your hand is slightly off-center; please move to the left."

[0100] For example, as shown in Figure 5, in response to a trigger operation on a virtual interactive control, such as a click operation on the virtual interactive control, a camera capture preview interface 300 is displayed. The camera capture preview interface 300 displays a capture frame 301, which is located in a preset area of ​​the camera capture preview interface 300. A guide layer 302 is located within the capture frame 301, and the shape of the guide layer 302 is related to the shape of the target object image 303 to be captured. For example, if the first recommended product is a ring, the target object image 303 to be captured is an image of the user's hand, and the shape of the guide layer 302 is a palm shape. Optionally, the guide layer 302 is used to guide the user to capture the target object image 303. Above the capture frame 301, a capture prompt message 304 is also displayed. This capture prompt message 304 is a text prompt message, such as "Please aim the lens at the palm."

[0101] Step 230: In response to the target object image meeting the acquisition conditions, display the correlation effect between the physical attributes of the target recommended product and the target part on the virtual trial interface.

[0102] Among them, the acquisition conditions refer to the conditions that the camera of the terminal device must meet when acquiring images of the target object.

[0103] In some embodiments, after the target object image identified in the camera preview screen meets the acquisition conditions, the user enters or jumps from the camera acquisition preview interface to the virtual trial interface. The virtual trial interface displays the correlation effect between the physical attributes of the target recommended product and the target body part. The virtual trial interface refers to the interface that displays the correlation effect between the physical attributes of the target recommended product and the target body part. The target recommended product is either the first recommended product or a second recommended product of the same type as the first recommended product. "Same type" means that the recommended products belong to the same category or class. For example, if the first recommended product is a ring, the target recommended product is also a ring. Or, if the first recommended product is a bracelet, the target recommended product is also a bracelet.

[0104] The association effect refers to the visual or application effect produced when the physical attributes of the target recommended product are combined with the target part. Optionally, the association effect applied to the target part is a virtual product effect, that is, a virtual product effect in which the target recommended product is displayed in AR form on the target part.

[0105] Displaying recommended products in AR format on target areas refers to using AR technology to integrate virtual recommended products into a real-world scene (i.e., an image of the target object captured by a camera), allowing the recommended product to blend naturally with the target area in the image. Specifically, the terminal device or server can use 3D rendering technology to render the 3D model of the recommended product onto the target area in the image. During 3D rendering, the terminal device or server considers the lighting consistency of the real scene and the occlusion relationship between the recommended product and the target area, resulting in a more realistic rendering.

[0106] The target location is a position within the target object image that relates to the application of the first recommended product. Specifically, it can be a body part or a target spatial location. For instance, when the target object image is a body part image, and the first recommended product is a body accessory or cosmetic product, the target location is the position where the first recommended product is worn or the application position of the cosmetic product within the body part image. For example, when the body part image is a hand image, the target location could be the finger used to wear a ring; when the body part image is a face image, the target location could be the lip area where lipstick is applied.

[0107] When the target object image is not a body part image, the first recommended product is a decorative or practical product. Correspondingly, the target part in the non-body part image represents the location for placing or installing the first recommended product. For example, when the target object image is a TV cabinet image or a corner image of a living room, the target part is the location for placing the TV in the TV cabinet image or the corner image of the living room. The corner image of the living room includes the TV cabinet image, and may also include partial images of a table or fish tank adjacent to the TV cabinet.

[0108] In some embodiments, the target object image is a body part image (or target try-on part image), and the first recommended product is a product applied to the body part. Optionally, the first recommended product is an accessory or cosmetic product that modifies the user's body part. The target recommended product is the first recommended product or a second recommended product of the same type as the first recommended product; that is, the target recommended product is an accessory or cosmetic product that modifies the user's body part. The physical attribute corresponding to the target recommended product is the modifying effect of the accessory or cosmetic product. For example, if the target recommended product is lipstick, the physical attribute of the lipstick is the cosmetic modifying effect applied to the user's lips; or, for example, if the target recommended product is a ring, the physical attribute of the lipstick is the accessory modifying effect applied to the user's fingers. Optionally, the association effect between the physical attribute corresponding to the target recommended product and the target body part is displayed, that is, the virtual product effect of the target recommended product superimposed on the user's body part in AR form is displayed.

[0109] In some embodiments, the target object image is a non-body part image (or an image corresponding to the target location), and the first recommended product is a product applied to the target spatial location. Optionally, the first recommended product is a decorative product or a practical product. The target recommended product is either the first recommended product or a second recommended product of the same type as the first recommended product; that is, the target recommended product is a decorative product or a practical product. The physical attributes corresponding to the target recommended product are the actual physical characteristics of the decorative or practical product, such as size and material. For example, if the target recommended product is a television, the physical attributes corresponding to the television include the size (length, width, and height); another example is a sofa, and the physical attributes corresponding to the sofa include the material of the sofa (e.g., leather sofa, velvet sofa). Optionally, the association effect between the physical attributes corresponding to the target recommended product and the target part is displayed, that is, the virtual product effect of the target recommended product placed and displayed in AR form at the target spatial location is displayed.

[0110] It should be noted that the above acquisition conditions assume that environmental conditions are met, such as lighting conditions, background interference, and image resolution.

[0111] In related technologies, users can learn about the try-on effect of recommended products through static images or dynamic videos while browsing short videos. In this embodiment, when the recommendation medium is a short video, a first recommended product and a virtual interactive control are displayed on the short video playback interface. Users can trigger the virtual interactive control to enter the camera capture preview interface and interact according to the prompts. When the target object image meets the capture conditions, the physical attributes of the target recommended product and the correlation effect with the target part in the target object image are displayed. For example, according to the prompts, users can enter AR interaction mode and preview the virtual product effect of the target recommended product through AR. By displaying the virtual product effect of the target recommended product in AR form on the target part (overlaying when the target part is a body part, and placing when the target part is a target spatial location), the integration of the virtual product effect of the target recommended product with the real scene is ensured. Furthermore, by triggering the virtual interactive control, the same product or product of the same type as the promoted product (first recommended product) is recommended to the user, realizing personalized recommendation service. This recommendation method not only improves the accuracy of the recommendation but also increases the frequency of user interaction with the information flow advertisement, thereby increasing the click-through rate of the information flow advertisement.

[0112] The overlap between the target object image and the guiding mask layer meets the acquisition conditions.

[0113] In some embodiments, the prompt information is a guiding mask, which guides the acquisition of the target object image. In response to the target object image meeting the acquisition conditions, the association effect between the physical attributes of the target recommended product and the target part is displayed. Optionally, the acquisition conditions include overlap; when the overlap between the target object image and the guiding mask meets the acquisition conditions, the association effect between the physical attributes of the target recommended product and the target part is displayed.

[0114] Figure 6 is a flowchart of an interactive method based on recommendation information provided in an exemplary embodiment of this application. Step 230 above can be replaced by step 231.

[0115] Step 231: In response to the overlap between the target object image and the guiding mask layer meeting the first threshold, display the correlation effect between the physical attributes of the target recommended product and the target part.

[0116] The overlap degree refers to the degree of overlap between the target image and the guidance mask, specifically the degree of overlap in spatial regions. The overlap degree measures the matching degree between the target area and the guidance mask. If the overlap degree reaches or exceeds a preset first threshold, the association effect between the physical attributes of the recommended product and the target area is displayed.

[0117] Optionally, the association effect refers to the visual or application effect produced when the physical attributes of the target recommended product are combined with the target part. Optionally, the association effect applied to the target part is a virtual product effect, that is, a virtual product effect in which the target recommended product is displayed in AR form on the target part.

[0118] For example, the target recommended product is a jewelry product, such as a ring. When the overlap between the target object image and the guiding overlay needs to meet a first threshold, that is, meet the minimum overlap requirement, the virtual product effect of the ring is overlaid on the user's body part, such as the finger, in AR form.

[0119] For example, the target recommended product is a practical product, such as a sofa. When the overlap between the target object image and the guiding overlay needs to meet a first threshold, that is, meet the minimum overlap requirement, the virtual product effect of the ring is placed and displayed in AR form at the target spatial location, such as the living room area.

[0120] In some embodiments, the overlap between the target object image and the guide overlay needs to meet a first threshold, which is expressed as a percentage of overlap and indicates the minimum overlap requirement. For example, the first threshold is set to 80%. When the overlap between the target object image and the guide overlay reaches or exceeds 80%, it can be considered that the target object image has been correctly placed at the designated position (the position of the guide overlay) on the camera acquisition preview interface. That is, the target object image and the guide overlay have been correctly aligned. At this time, the association effect between the physical attributes of the target recommended product and the target part is displayed, that is, the virtual product effect of the target recommended product is displayed on the target part in AR form.

[0121] In some embodiments, overlap is used to indicate the degree of overlap between the area of ​​the target object image on the camera acquisition preview interface and the area occupied by the guide mask.

[0122] In some embodiments, the overlapping areas of the target object image and the guide mask are displayed using a first display style, and the non-overlapping areas of the target object image and the guide mask are displayed using a second display style. Optionally, the first display style differs from the second display style, and the visual salience of the first display style is higher than that of the second display style. Display styles include, but are not limited to, at least one of display brightness, display transparency, display color, display effects, and display lines.

[0123] Optionally, the visual salience of the first display style is higher than that of the second display style, which can be manifested in the following aspects:

[0124] • Display style is reflected in display brightness: the display brightness of overlapping areas differs from that of non-overlapping areas; for example, the display brightness of overlapping areas is higher than that of non-overlapping areas. Optionally, by increasing the brightness or contrast of the overlapping areas of the target object image and the guide layer, the overlapping areas can be made more prominent in the camera acquisition preview interface, thus significantly distinguishing between overlapping and non-overlapping areas.

[0125] • Display style is manifested in the display transparency: the display transparency of overlapping areas differs from that of non-overlapping areas; for example, the display transparency of overlapping areas is higher than that of non-overlapping areas. Optionally, by setting the display transparency of overlapping areas of the target object image and the guide layer to be higher than that of non-overlapping areas—for example, setting the transparency of overlapping areas to 100% (completely transparent) and setting the transparency of non-overlapping areas to 0% (completely opaque)—this method can significantly distinguish between overlapping and non-overlapping areas.

[0126] • Display style is manifested in display color: the display color of overlapping areas differs from that of non-overlapping areas; for example, the display color of overlapping areas is brighter than that of non-overlapping areas. Optionally, by setting the display color of overlapping areas of the target object image and the guide layer to be brighter than that of non-overlapping areas—for example, displaying overlapping areas in a vibrant color and non-overlapping areas in a muted color—overlapping areas can be clearly distinguished from non-overlapping areas.

[0127] • Display style manifests as display effects: the display effects of overlapping areas differ from those of non-overlapping areas. For example, the display effects of overlapping areas are richer than those of non-overlapping areas. Optionally, by setting the display effects of overlapping areas of the target object image and the guide layer to be richer than those of non-overlapping areas, for example, overlapping areas are displayed with floating effects, while non-overlapping areas are displayed statically, this method can significantly distinguish between overlapping and non-overlapping areas.

[0128] The display style is manifested in the display lines: the displayed lines in overlapping areas differ from those in non-overlapping areas; for example, the displayed lines in overlapping areas are thicker than those in non-overlapping areas. Optionally, by setting the displayed lines in overlapping areas of the target object image and the guide layer to be thicker than those in non-overlapping areas—for example, displaying the edge lines of overlapping areas as thick lines and the edge lines of non-overlapping areas as thin lines—this method can clearly distinguish overlapping and non-overlapping areas.

[0129] It should be noted that the above are merely illustrative examples and do not constitute a limitation on the display style of overlapping and non-overlapping areas. Optionally, the display style can be any one of the above, or a free combination of at least two display styles, and this application does not limit this.

[0130] In some embodiments, the overlap degree is used to indicate the degree of overlap between the area of ​​the target object image on the camera capture preview interface and the area occupied by the guide mask. The terminal device first captures an image of the user's target object, such as an image of the user's hand, using the camera. Second, it identifies and locates edge feature points of the target object image based on edge detection. By extracting the edge feature points of the target object image, it aligns these edge feature points with the edge feature points in the guide mask to determine the relative positions of the target object image and the guide mask. Then, it calculates the area of ​​the target object image using the edge feature points, overlaps the area of ​​the target object image with the area of ​​the guide mask, and calculates the overlap area. The overlap degree is obtained based on the overlap area. For example, the ratio of the overlap area to the total image area is calculated to obtain the overlap degree between the target object image and the guide mask, where the total image area is the union of the areas of the target object image and the guide mask, and the overlap area can be understood as the intersection of the areas of the target object image and the guide mask.

[0131] Optionally, the overlap can be expressed as a percentage or other measure (e.g., a decimal). For example, the overlap between the target object image and the guide mask is greater than or equal to 0% and less than or equal to 100%. Here, an overlap of 0% means that the target object image and the guide mask have no overlap, and an overlap of 100% means that the target object image and the guide mask completely overlap.

[0132] Optionally, in some embodiments, the number of pixels in the target object image can be calculated using edge feature points of the target object image. The pixels in the target object image are then overlapped with the pixels in the guiding mask layer, and the number of overlapping pixels is calculated. The degree of overlap between the target object image and the guiding mask layer is obtained based on the number of overlapping pixels. For example, the ratio of the number of overlapping pixels to the total number of pixels in the image is calculated to obtain the degree of overlap between the target object image and the guiding mask layer. Here, the total number of pixels in the image is the union of the number of pixels in the target object image and the number of pixels in the guiding mask layer, and the number of overlapping pixels can be understood as the intersection of the number of pixels in the target object image and the number of pixels in the guiding mask layer.

[0133] In some embodiments, when the overlap between the target object image and the guide mask reaches a first threshold, it indicates that the target object image has been correctly placed at the specified position (the position of the guide mask) of the camera acquisition preview interface. That is, the target object image and the guide mask have been aligned. At this time, the virtual trial interface is entered from the camera acquisition preview interface, and the virtual product effect of the target recommended product is displayed on the target part in AR form.

[0134] In this embodiment, in the camera acquisition preview interface, the overlap between the target object image and the guide mask is judged to determine whether the target object image is in the correct position. Once the overlap meets the condition, that is, the overlap reaches the first threshold, the virtual product effect of the target recommended product is displayed superimposed on the target part. This instant feedback mechanism allows users to feel the immediacy and effectiveness of the operation. At the same time, the precise positioning reduces the need for users to adjust the position, improving the smoothness and naturalness of the try-on experience.

[0135] The recommendation list is generated based on AI analysis of the target object image.

[0136] In some embodiments, in response to the overlap between the target object image and the guiding mask layer satisfying a first threshold, the target object image is analyzed based on an AI algorithm to obtain a recommendation list. Optionally, target recommended products are obtained from the recommendation list.

[0137] Figure 7 is a flowchart of an interactive method based on recommendation information provided in an exemplary embodiment of this application. Step 231 above can be replaced by steps 231a and 231b.

[0138] Step 231a: In response to the overlap between the target object image and the guiding mask satisfying the first threshold, the target object image is analyzed based on the AI ​​algorithm to obtain a recommendation list, which includes at least one candidate recommended product.

[0139] The recommendation list includes a set of candidate recommended products obtained by analyzing the target object image based on an AI algorithm. The AI ​​algorithm can be a neural network model, the input of which is the target object image, and the output is a set of candidate recommended products. The neural network model includes, but is not limited to, convolutional neural networks, deep network models, and large language models.

[0140] In some embodiments, the recommendation list may have different layouts. The layout of a recommendation list generally refers to optimizing its format to make it clearer, easier to read, and more aesthetically pleasing. A recommendation list is a collection of multiple candidate recommended products. Optionally, the layout of the recommendation list may include at least one of the following: grid layout, list layout, card layout, sliding tabs, waterfall layout, and carousel layout.

[0141] For example, the recommendation list can be laid out as follows: A grid layout, arranging multiple candidate products in a grid, with each candidate product's icon or name occupying a fixed-size square; users can scroll or paginate to view more candidate products. A list layout, presenting multiple candidate products in a vertical list, with each candidate product arranged sequentially; users can scroll through all candidate products. A card layout, displaying each candidate product as a card, including an icon, name, and brief description; users can click or touch the card to select the corresponding candidate product. A sliding tab layout, placing sliding tabs at the top or bottom of the virtual trial interface; each sliding tab representing a different type or category of candidate products; users can switch between different categories of candidate products by sliding or clicking the sliding tabs. A waterfall layout, a dynamic grid layout where the thumbnail size of each candidate product may vary, making the overall recommendation list look more dynamic and natural. A carousel layout, displaying candidate products in a loop; users can swipe left and right to browse different candidate products.

[0142] In some embodiments, the recommendation list is a set of candidate recommended products obtained by the server after analyzing the target object image based on a neural network model. First, the terminal device's camera acquires an image of the user's target object and sends it to the server. The server processes the target object image, extracting key image features. Second, the server queries the product library of the first recommended product, which includes all products owned by the brand to which the first recommended product belongs. The server finds products in the product library that belong to the same type as the first recommended product. Then, based on a matching algorithm, the server adapts the extracted key image features to the products in the product library, and selects a set of candidate recommended products from the product library based on the adaptation results. The adaptation degree of the selected candidate recommended products to the target object image meets a preset adaptation standard. Finally, the server sends the selected candidate recommended products to the terminal device. The terminal device receives the candidate recommended products and generates a recommendation list. The candidate recommended products in the recommendation list are recommended products that match (or are adapted to) the target object image.

[0143] In some embodiments, the server analyzes the target object image based on a neural network model to obtain candidate recommended products for the target object image. Optionally, a recommendation model (a neural network model) is pre-trained, which can generate a corresponding recommendation list based on the target object image. Optionally, an image dataset (i.e., the dataset corresponding to the target object image) is acquired, and the image dataset is used as training samples to train the recommendation model. The training samples are obtained based on user feedback, and training the recommendation model based on these training samples yields a recommendation model with recommendation capabilities. The method for acquiring training samples is as follows: first, the target object image captured by the camera is acquired; if the target object image meets the acquisition conditions, a recommendation list is randomly displayed; in response to a positive feedback operation on a preset recommended product in the recommendation list, the binding relationship between the preset recommended product and the target object image is obtained. The positive feedback operation includes at least one of the following: selection operation, try-on operation, and sharing operation of the preset recommended product. The target object image and the preset recommended product are used as training samples to train the recommendation model.

[0144] Optionally, training samples are obtained based on the user feedback-driven approach described above. These training samples are then used to train the recommendation model. The labels for the training samples are obtained based on the binding relationship between preset recommended products and target object images; that is, the preset recommended products selected by the user are used as the label data for the training samples. Optionally, the input to the recommendation model is a feature vector. Preset operations are used to transform the image into image features. Image detection and image feature extraction techniques are used to extract detailed features from the images of each training sample as image features. Then, the image features and their corresponding labels are input into the recommendation model. The model is trained based on different image features and their corresponding labels (preset recommended products), allowing it to learn the mapping relationship between images and preset recommended products. The recommendation model predicts the input data to obtain the training results for the image features. The training results (recommended products) are compared with the true results (the preset recommended products corresponding to the training samples) to calculate the loss, which indicates the error between the training results and the true results. Optionally, a backpropagation algorithm is used to adjust the parameters of the recommendation model, making the output of the recommendation model closer to the labels corresponding to the training samples. Optionally, the recommendation model is optimized using a loss function. Based on this, a trained recommendation model is obtained, which can learn the mapping relationship between images and preset recommended products.

[0145] It should be noted that the training of the recommendation model provided in this embodiment is only illustrative and does not constitute a limitation on the training method of the recommendation model.

[0146] Step 231b: Determine the target recommended product based on the recommendation list, and display the correlation effect between the physical attributes of the target recommended product and the target part on the virtual trial interface.

[0147] In some embodiments, for each candidate recommended product in the recommendation list, the server determines its fit with the target object image, obtains the fit calculation result of each candidate recommended product with the target object image, and then determines the target recommended product from the recommendation list based on the fit calculation result. Optionally, the fit calculation result can be represented as a fit score, and the candidate recommended product with the highest fit score can be ranked at the top of the recommendation list.

[0148] Optionally, the reference criteria for the fit between different target object images and candidate recommended products may differ. For example, when the target object image is a hand image, the reference criteria for the hand image include, but are not limited to, at least one of the hand's shape, size, and color. For example, when the target object image is a neck image, the reference criteria for the neck image include, but are not limited to, at least one of the neck's color and smoothness. For example, when the target object image is a lip image, the reference criteria for the lip image include, but are not limited to, at least one of the lip's color and shape.

[0149] In some embodiments, the terminal device displays at least one candidate recommended product from the recommendation list, sorted from highest to lowest according to its fit with the target object image. Optionally, the top n candidate recommended products sorted from highest to lowest are determined as the target recommended product, where n is a positive integer. For example, the candidate recommended product ranked first is determined as the target recommended product. Optionally, the association effect between the physical attributes corresponding to the target recommended product and the target body part is displayed. The association effect is the virtual product effect of the target recommended product, that is, the virtual product effect of the target recommended product is displayed in AR form on the target body part (including body parts and target spatial location).

[0150] In some embodiments, a recommendation list is obtained by analyzing the target object image based on an AI algorithm. Based on the fit between at least one candidate recommended product in the recommendation list and the target object image, the candidate recommended product whose fit with the target object image reaches a second threshold is determined as the target recommended product. That is, the candidate recommended product in the recommendation list whose fit with the target object image reaches a second threshold is determined as the target recommended product. By default, the virtual product effect of the target recommended product is displayed in AR form on the target part (including body parts and target spatial location).

[0151] For example, in response to the overlap between the target object image and the guide mask meeting the acquisition conditions (reaching the first threshold), indicating that the target object image and the guide mask are aligned, the virtual trial interface is entered from the camera acquisition preview interface. As shown in Figure 8, the virtual product effect of the target recommended product 402a is displayed in AR form on the target part of the virtual trial interface 400. Optionally, after meeting the acquisition conditions, the target object image 401 is analyzed based on AI. For example, if the target object image 401 is a hand image, a recommendation list 402 is obtained for the target object image 401. The recommendation list 402 includes at least one candidate recommended product. For example, the recommendation list 402 includes candidate recommended product 402a, candidate recommended product 402b, etc. The candidate recommended products in the recommendation list 402 are sorted from high to low according to their fit with the target object image 401. The candidate recommended product 402a ranked first is determined as the target recommended product, and the virtual product effect of the target recommended product is displayed in AR form on the user's hand by default.

[0152] In this embodiment, candidate recommended products are automatically sorted according to their compatibility with the target object image. Personalized recommendations based on user characteristics are achieved, ensuring that the recommended products displayed meet the user's needs. Users can quickly and intuitively preview the product styles or designs that best suit them, thereby improving the accuracy of the recommendations.

[0153] In some embodiments, in response to a selection operation on a candidate recommended product in the recommendation list, the selected candidate recommended product is determined as the target recommended product, and the association effect between the physical attributes of the selected candidate recommended product (i.e., the target recommended product) and the target body part is displayed on the virtual trial interface. Optionally, the recommendation list includes at least one candidate recommended product, which is sorted from high to low according to its fit with the target object image. By default, the top n candidate recommended products are determined as the target recommended products and displayed on the target body part in AR format. For example, the first candidate recommended product is determined as the target recommended product by default. The target recommended product displayed by default may not be a product that the user is interested in. In this case, the user can also select other candidate recommended products in the recommendation list according to their personal preferences.

[0154] For example, referring to Figure 9, as shown in Figure 9(a), a recommendation list 402 corresponding to the target object image 401 is displayed on the virtual trial interface 400. The recommendation list 402 includes at least one candidate recommended product, for example, candidate recommended product 402a, candidate recommended product 402b, etc. The candidate recommended products in the recommendation list 402 are sorted from high to low according to their fit with the target object image 401, and the candidate recommended product 402a, which is ranked first, is determined as the target recommended product by default. Optionally, the user can also select other candidate recommended products in the recommendation list 402 according to their personal preferences. As shown in Figure 9(b), in response to the user's selection operation of candidate recommended product 402b in the recommendation list 402, the virtual product effect of the selected candidate recommended product 402b is displayed on the user's hand in AR form.

[0155] In this embodiment, users can also select other candidate recommended products from the recommendation list according to their personal preferences, and display the virtual product effect of the selected candidate recommended products in AR form on the target part. This instant feedback mechanism allows users to quickly see the virtual try-on effect of the selected products, thereby enhancing the convenience of interaction.

[0156] In summary, the method provided in this application allows the server to analyze a target object image using an AI algorithm and generate a recommendation list. The candidate recommended products in this list better meet the user's actual needs, and this personalized recommendation improves the relevance and accuracy between the candidate recommended products and the target object image. By setting a fit threshold to determine the target recommended product, the system can filter out the product that best matches the target object image from the recommendation list. This filtering mechanism reduces the difficulty for users to choose from numerous products and improves selection efficiency.

[0157] In some embodiments, the associated effect is the virtual product effect of the target recommended product. After the virtual product effect of the target recommended product is displayed on the target area in AR form, the user can interact with the target recommended product and change the virtual product effect of the target recommended product through interactive operations.

[0158] In response to interactive actions targeting the recommended product, update the association effect between the physical attributes of the recommended product and the target part, that is, display the association effect between the physical attributes of the recommended product and the target part under different display methods on the target part.

[0159] Interactive operations refer to actions performed on the virtual trial interface to interact with the target recommended product. Optionally, interactive operations include, but are not limited to, at least one of rotation, zoom in, zoom out, and movement operations. Display method refers to the way the virtual product effect of the target recommended product is presented under different interactive operations.

[0160] Among them, the association effect refers to the virtual product effect of the target recommended product.

[0161] Optionally, when the target recommended product is an accessory or beauty product that modifies a user's body part, the target body part is the user's body part, and the physical attribute corresponding to the target recommended product is the modification effect of the accessory or beauty product.

[0162] Optionally, when the target recommended product is a decorative product or a practical product, the target part is the target spatial location, and the physical attribute corresponding to the target recommended product is the actual physical characteristics of the decorative product or the practical product.

[0163] In this embodiment of the application, by allowing users to interactively preview the virtual effects of the target recommended product under different display methods on the target area, the effect of the target recommended product can be felt more intuitively, thereby increasing the fun and user satisfaction.

[0164] The virtual product effect of the target recommended product is displayed in multiple dimensions.

[0165] For the first interactive operation (rotation operation):

[0166] In some embodiments, in response to a first interactive operation on a target recommended product, the angle of the target recommended product is rotated, and the correlation effect between the physical attributes of the rotated target recommended product and the target part is displayed on the target part. The first interactive operation is a rotation operation. Optionally, the rotation operation includes at least one of an upward rotation operation, a downward rotation operation, a leftward rotation operation, a rightward rotation operation, and a custom rotation operation. For example, a custom rotation operation is a rotation operation with a sliding trajectory set to an arc.

[0167] Optionally, in response to a rotation operation targeting the recommended product, the angle of the recommended product is rotated. After the display angle of the recommended product changes, the user can view the recommended product from different angles. After the user performs the rotation operation, the virtual product effect of the rotated recommended product is updated and displayed on the target area. By rotating the angle of the recommended product, users can view the recommended product from different perspectives and obtain a more comprehensive visual experience.

[0168] For the second interactive operation (zoom in):

[0169] In some embodiments, in response to a second interactive operation on a target recommended product, the size of the target recommended product is enlarged, and the association effect between the enlarged physical attributes of the target recommended product and the target area is displayed on the target area. The second interactive operation is a zoom-in operation. Optionally, the zoom-in operation includes a partial zoom-in operation or a global zoom-in operation.

[0170] Optionally, in response to a zoom-in operation on the target recommended product, the size of the target recommended product is enlarged. After the size of the target recommended product changes, the enlarged virtual product effect is displayed on the target area, allowing the user to see more detailed product details. For example, when a user double-clicks the target recommended product on the virtual try-on screen, the virtual product effect of the target recommended product is enlarged; in response to the user double-clicking the target recommended product again, the virtual product effect of the target recommended product is restored.

[0171] For example, the target recommended product is a practical product, such as a sofa. After the data collection conditions are met, the sofa is displayed at a preset size in the center of the living room floor. Optionally, in response to a zoom-in operation on the sofa, a magnified virtual product image of the sofa is displayed in the center of the living room floor.

[0172] For the third interactive operation (zoom out operation):

[0173] In some embodiments, in response to a third interactive operation on the target recommended product, the size of the target recommended product is reduced, and the association effect between the reduced physical attributes of the target recommended product and the target area is displayed on the target area. The third interactive operation is a reduction operation.

[0174] Optionally, in response to a zoom-out operation targeting the recommended product, the size of the recommended product is reduced. After the size of the recommended product changes, the reduced virtual product effect is displayed on the target area. For example, a user can reduce the display size of the virtual product effect of the recommended product on the virtual try-on screen using a two-finger zoom-out operation.

[0175] For the fourth interactive action (movement action):

[0176] In some embodiments, in response to a fourth interactive operation targeting a recommended product, the position of the recommended product is moved, and the physical attributes of the moved recommended product and their association with the target location are displayed on the target location. The fourth interactive operation is a movement operation. Optionally, the movement operation includes at least one of an up movement, a down movement, a left movement, a right movement, or a custom movement operation. For example, a custom movement operation is one where the sliding trajectory is an arc. The direction of movement of the recommended product is related to the movement operation. For example, in response to an up movement operation, the virtual product effect of the recommended product on the target location is moved upwards.

[0177] Optionally, in response to a movement operation targeting the recommended product, the position of the recommended product is moved. The position of the virtual product effect of the recommended product on the target body part will change, and the user can view the try-on effect of the virtual product effect of the recommended product at different positions on the target body part.

[0178] For example, the target recommended product is a ring. By default, the virtual product effect of the ring is worn on the middle finger. Users can move the ring from the middle finger to the index finger to view the virtual product effect of the ring on the index finger.

[0179] For example, the target recommended product is a sofa. The sofa is displayed by default in the center area of ​​the living room floor. Optionally, in response to a movement operation on the sofa, a virtual product effect is displayed as if the sofa has moved from the center area A of the object's floor to another area B.

[0180] In this embodiment, through multi-dimensional interactive operations (rotation, zoom in, zoom out, and movement) to interact with the target recommended product, users can more freely explore and experience the virtual product effects of the target recommended product from different angles, sizes, and positions.

[0181] Other interactive operations

[0182] 1) Changes in movement of the target area

[0183] In some embodiments, in response to changes in movement at a target body part, the physical attributes of the recommended product corresponding to the target body part are displayed to show the correlation between the changes in movement at the target body part and the body part.

[0184] In some embodiments, once the data acquisition conditions are met, the current interface transitions from a camera-captured preview interface to a virtual trial interface, where the target recommended product is automatically attached to the target area. Here, "automatic attachment" means that the virtual product effect of the target recommended product can be automatically recognized and attached to the target area.

[0185] Optionally, when the target recommended product is an accessory or beauty product that modifies a user's body part, the target body part is the user's body part, and the corresponding physical attribute of the target recommended product is the modifying effect of the accessory or beauty product. Optionally, when the target recommended product is a decorative product or a practical product, the target body part is the target spatial location, and the corresponding physical attribute of the target recommended product is the actual physical characteristics of the decorative product or practical product.

[0186] Optionally, in response to changes in the user's target body part's movement, the display shows the physical attributes of the recommended product and their correlation with the target body part's movement. In other words, the virtual product effect of the recommended product changes synchronously with the user's movements. The virtual product effect follows the position and posture of the target body part in real time and updates its position and angle on the screen accordingly to maintain consistency with the user's actions.

[0187] For example, the target recommended product is a jewelry product, such as a ring. After the collection conditions are met, the ring will automatically be attached to the user's finger. Optionally, in response to an upward movement of the finger, the virtual product effect of the ring moves upward with the finger; in response to a downward movement of the finger, the virtual product effect of the ring moves downward with the finger; in response to a leftward movement of the finger, the virtual product effect of the ring moves left with the finger; in response to a rightward movement of the finger, the virtual product effect of the ring moves right with the finger; in response to free movement of the finger in three-dimensional space, the virtual product effect of the ring moves freely with the finger in three-dimensional space; in response to a bending movement of the finger, the virtual product effect of the ring is displayed to follow the bending of the finger.

[0188] For example, the target recommended product is a jewelry product, such as a bracelet. After the collection conditions are met, the bracelet will automatically be attached to the user's wrist. Optionally, in response to wrist movement, the virtual product effect of the bracelet moves with the wrist; in response to wrist rotation, the virtual product effect of the bracelet rotates with the wrist; in response to wrist shaking, the virtual product effect of the bracelet shakes with the wrist.

[0189] For example, the target recommended product is a beauty product, such as lipstick. After the collection conditions are met, the lipstick will automatically be applied to the user's lips. Optionally, in response to lip movement, the virtual product effect of the lipstick follows the movement of the lips; in response to the user's speaking actions, the virtual product effect of the lipstick changes with the movement of the lips; in response to changes in the user's facial expressions, the virtual product effect of the lipstick changes with the magnitude of the change in the lips.

[0190] In this embodiment, the recommended product automatically attaches to the target area and responds to changes in the user's movements, ensuring that the virtual product effect changes synchronously with the target area. This design provides a smooth and interactive try-on experience, allowing users to view the virtual product effect more realistically.

[0191] 2) Switching AR display scenes

[0192] In some embodiments, in response to a switching operation of the virtual background of the virtual trial interface, the association effect between the physical attributes of the target recommended product and the target part is displayed in the switched virtual background.

[0193] In one possible implementation, a background switching control is displayed on the virtual trial interface. In response to a touch operation on the background switching control, a switching operation is performed on the virtual background. The switched virtual background displays the virtual product effect of the recommended product in AR form, showing a virtual try-on effect on the target body part. Here, the virtual background is used to simulate real-life scenarios; different virtual backgrounds simulate different real-life scenarios. The virtual background is displayed on the virtual trial interface as the background for displaying the association effect between the physical attributes of the recommended product and the target body part. The background switching control refers to the interface element in the virtual trial interface used to trigger the switching of the virtual background. Optionally, the background switching control is typically presented as an icon, button, text, or other form.

[0194] Optionally, in response to a touch operation on the background switching control, a virtual background selection list pops up on the virtual trial interface. The user can select any virtual background from the list, and the selected virtual background displays the virtual product effect of the target recommended product in AR form, showing the trial effect on the target area.

[0195] For example, the virtual background selection list includes, but is not limited to, at least one of the following: sports virtual background, work virtual background, entertainment virtual background, home virtual background, leisure virtual background, and travel virtual background. Users can switch the virtual background display of the target recommended product by selecting different virtual backgrounds, simulating the display effect of the target recommended product in different real-life scenarios.

[0196] In one possible implementation, in response to a click on the virtual background, the virtual background is randomly switched. The virtual product effect of the recommended product is then overlaid on the target area in AR format within the randomly switched scene, creating a virtual try-on effect. The virtual background is used to simulate different real-life scenarios.

[0197] Optionally, the randomly switchable virtual background includes, but is not limited to, at least one of the following: sports virtual background, work virtual background, entertainment virtual background, home virtual background, leisure virtual background, and travel virtual background. For example, in response to a click operation on the virtual background, the virtual background is randomly switched from a home virtual background to a work virtual background, and the virtual product effect of the target recommended product is displayed in AR overlay on the target area to create a try-on effect.

[0198] In this embodiment, users can switch the virtual background to simulate the product effect of the recommended product in different scenarios and display it in AR form on the target part for trial wearing. This method of switching the virtual background provides users with the ability to evaluate the suitability of the recommended product in different life scenarios, allowing users to preview the virtual product effect in different life scenarios, such as daily leisure, sports, formal occasions, etc., to adapt to different user needs and thus provide more personalized services.

[0199] 3) Comparison of split-screen display effects

[0200] In some embodiments, a split-screen control is displayed, and in response to a trigger operation on the split-screen control, the virtual trial interface and the display interface are controlled to be displayed in a split-screen manner.

[0201] The virtual trial interface displays the physical attributes of the recommended product and their association with the target area; in other words, it displays the virtual product effect of the recommended product in AR format on the target area. The display interface showcases the first recommended product. For example, the display interface could be a short video playback interface. Split-screen controls can be displayed on the virtual trial interface; these are interface elements used to trigger split-screen display of the virtual background interface. Optionally, split-screen controls are typically presented as icons, buttons, text, or other forms.

[0202] Optionally, in response to a trigger operation on the split-screen control, the terminal device's screen display is divided into two areas: one area is used to display the virtual trial interface, and the other area is used to display the presentation interface. This screen display is also referred to as the comparison interface. For example, the upper area of ​​the comparison interface is used to display the virtual trial interface, and the lower area is used to display the presentation interface.

[0203] Optionally, in response to a trigger operation on the split-screen control, the virtual trial interface and the short video playback interface are controlled to be displayed on the comparison interface according to their respective split-screen ratios. The split-screen ratio indicates the proportion of area occupied by the virtual trial interface and the display interface on the comparison interface. For example, in response to a trigger operation on the split-screen control, the virtual trial interface and the display interface are controlled to be split into two screens. For instance, the split-screen ratio is 1:1, meaning the virtual trial interface and the display interface each occupy half (50%) of the comparison interface. Another example is a split-screen ratio of 3:2, meaning the virtual trial interface and the display interface occupy 60% and 40% of the comparison interface, respectively. This application does not limit the specific value of the split-screen ratio.

[0204] For example, referring to Figure 10, as shown in Figure 10(a), a virtual trial interface 500 is displayed. A split-screen control 501 is displayed on the virtual trial interface 500. For example, the split-screen control 501 is set to "View Comparison Effect". In response to a trigger operation on the split-screen control 501, as shown in Figure 10(b), the interface is controlled to display in split-screen mode. A display interface, such as a short video playback interface, is displayed in the upper area 601 of the comparison interface 600, while the virtual trial interface is displayed in the lower area 602 of the comparison interface 600. Optionally, the split-screen proportions of the short video playback interface and the virtual trial interface on the comparison interface 600 are different; for example, the proportion of the short video playback interface is 40%, and the proportion of the virtual trial interface is 60%.

[0205] In this embodiment, by splitting the virtual trial interface and the short video playback interface, users can watch demonstrations of recommended products while virtually trying them on, better evaluate the actual effects of the recommended products, and obtain more information while trying on virtual products, thus assisting in purchasing decisions.

[0206] 4) Interact with friends

[0207] In some embodiments, a sharing control is displayed, which is used to trigger the first account to share the virtual trial interface with the second account; in response to the second account's joining operation, the interaction screen between the first account and the second account is displayed on the virtual trial interface.

[0208] The sharing control refers to the UI element used to trigger the first account to share the virtual trial interface with the second account. Optionally, the sharing control is usually presented as an icon, button, text, or other form. Optionally, the first account can be the user's currently used account, and the second account is an account that is a friend of the first account.

[0209] Optionally, in response to a sharing operation on the virtual trial interface, the second account can receive a sharing request from the first account; in response to the second account receiving the sharing request from the first account, it is displayed that the second account has joined the virtual trial interface.

[0210] Optionally, in response to the joining of a second account, an interactive screen is displayed showing that the users of the first and second accounts can interact within the virtual trial interface. For example, the users of the first and second accounts can simulate a handshake within the virtual trial interface.

[0211] In this embodiment of the application, by providing interactive options or automated interactive scenarios, users can interact with others during the virtual try-on process, share and compare the try-on effects, thereby enhancing the user experience.

[0212] 5) Compare with other brands

[0213] In some embodiments, the target recommended product is a recommended product of the first brand, and a recommended product of the second brand is displayed in a preset area of ​​the virtual trial interface. In response to the selection operation of the recommended product of the second brand, the details interface of the recommended product of the second brand is displayed.

[0214] The virtual trial interface displays the correlation between the physical attributes of the recommended product and the target body part.

[0215] In some embodiments, the virtual trial interface displays the association effect between the physical attributes of the target recommended product and the target body part; that is, the virtual product effect of the target recommended product is displayed in AR form on the target body part. The target recommended product belongs to a first brand, and a recommended product from a second brand can be displayed in a preset area of ​​the virtual trial interface. The first brand and the second brand belong to different product brands. Optionally, by selecting a recommended product from the second brand, the user is redirected to the details interface of the second brand's recommended product. The details interface includes, but is not limited to, at least one of the following: details, price, and interactive controls of the second brand's recommended product. Optionally, the virtual trial interface displays the details and price of the target recommended product belonging to the first brand, allowing the user to compare the target recommended product from the first brand with the recommended product from the second brand.

[0216] This application provides a comparison between brands. Users can see recommended products from different brands in the virtual trial interface. By comparing the recommended products from different brands, users can make a more comprehensive purchase decision.

[0217] Interactive operations on the short video playback interface

[0218] In some embodiments, the short video playback interface displays a recommended short video of the first recommended product. The recommended short video includes content of a model trying on the first recommended product. Users can decide whether to interact with the virtual try-on by evaluating the model's appearance.

[0219] • In response to the first color change operation for the first recommended product, the virtual product effect of the first recommended product after the color change is displayed on the model's image in the recommended short video, as well as the corresponding promotional content of the first recommended product after the color change.

[0220] The first switching operation is used to switch the color of the first recommended product. The first switching operation can be a selection operation for the first recommended product of different colors.

[0221] In some embodiments, the recommended short video includes content showing a model trying on the first recommended product, and the recommended short video displays the first recommended product in different colors. Optionally, the promotional content corresponding to the first recommended product in different colors is different. The promotional content includes promotional slogans corresponding to the first recommended product and the video content of the recommended short video.

[0222] For example, the first recommended product is a beauty product, such as lipstick. Lipsticks include different shades. Users can switch between different lipstick colors to display different lipstick colors in the recommended short videos, showing the beauty product effects of the lipstick on the model's image and displaying different promotional content for each lipstick color.

[0223] • In response to the second switching operation for the model of the first recommended product, the recommended short video will display the product effect of the first recommended product after the model switch on the model's image, as well as the corresponding promotional content of the first recommended product after the model switch.

[0224] The first switching operation is used to switch the model of the first recommended product. The first switching operation can be a selection operation for different models of the first recommended product.

[0225] In some embodiments, the recommended short video includes content featuring a model trying out the first recommended product, and the recommended short video displays different models of the first recommended product. Optionally, the promotional content corresponding to different models of the first recommended product is different. The promotional content includes promotional slogans for the first recommended product and the video content of the recommended short video.

[0226] For example, the first recommended product is a jewelry product, such as a ring. The ring includes different sizes and styles. Users can switch between different ring sizes to see the effect of wearing the ring on the model's image in the recommended short video, as well as see different promotional content for different ring sizes.

[0227] For example, referring to Figure 11, as shown in Figure 11(a), a recommended short video of the first recommended product is displayed on the short video interface 700. The recommended short video includes content of a model 701 trying on the first recommended product. Optionally, the first recommended product is a beauty product, such as lipstick. The recommended short video includes content of the model 701 trying on different lipstick colors. Different colors of lipstick are displayed in the recommended short video. In response to a click operation on the first color of lipstick 702, the beauty product effect of the first color of lipstick 702 is displayed on the model 701. At the same time, the promotional slogan 702a corresponding to the first color of lipstick 702 is displayed on the short video playback interface, such as "The plump lip effect instantly transforms you into a Japanese magazine style." In response to a switching operation on different colors of lipstick, the beauty product effect of the switched color lipstick is displayed on the model 701 in the recommended short video. As shown in Figure 11(b), in response to a click on the second color lipstick 703, the beauty product effect of the second color lipstick 703 is displayed on the model image 701, and at the same time, the promotional slogan 703a corresponding to the second color lipstick 703 is displayed on the short video playback interface, such as "Thick application gives a light European and American style".

[0228] In this embodiment, in response to switching operations for different colors or models of the first recommended product, the virtual product effects of the first recommended product in different colors or models are displayed on the model's image in the recommended short video. Users can more intuitively see the makeup effects of different colors and models, and decide whether to virtually try on the product based on the model's wearing effect. By obtaining more product details and promotional content through the recommended short video, users can enhance their interaction and purchase intention.

[0229] Conversion processing is performed based on the virtual trial interface.

[0230] In some embodiments, after the conversion conditions are met, a conversion process is performed based on the virtual trial interface. The conversion process includes at least one of jumping to the purchase interface of the target recommended product, jumping to the introduction interface of the target recommended product, and jumping to the interactive interface of the target recommended product.

[0231] Optionally, the conversion condition is the condition that triggers the virtual trial interface to enter a third-party interface. The third-party interface includes at least one of the following: the purchase interface of the target recommended product, the introduction interface of the target recommended product, and the interactive interface of the target recommended product. Optionally, the conversion condition is a time-based condition. That is, the conversion condition is that the virtual product effect of the target recommended product is displayed in AR form on the target area for a preset duration.

[0232] In some embodiments, the purchase interface for the target recommended product can be used at least for purchasing the target recommended product. The introduction interface for the target recommended product includes, but is not limited to, an advertising promotion page, which the current user can share with other users. The interactive interface for the target recommended product allows interaction with other users; optionally, the interaction on the interactive interface includes, but is not limited to, displaying at least one of the following: popularity information, voting information, comment information, and topic discussion information for the target recommended product. Optionally, the purchase interface, introduction interface, interactive interface, and virtual trial interface for the target recommended product can be provided by the same application (or applet, webpage) installed / accessed on the terminal, or they can be provided by different applications (or applets, webpages) installed / accessed on the terminal. This application does not limit this.

[0233] In this embodiment, after the virtual product effect of the target recommended product is displayed in AR format on the target area for a preset duration, the user can directly jump to the purchase interface, introduction interface, or interactive interface of the target recommended product through the virtual trial interface. This reduces the steps of searching for product information and completing the purchase, making the shopping experience smoother and more efficient. Performing conversion processing based on the virtual trial interface can improve the conversion rate of advertised products.

[0234] In one possible implementation, a conversion entry point (or landing page access point) is displayed around the target recommended product. In response to a trigger action on the conversion entry point, the user is redirected to the recommended landing page corresponding to the target recommended product, which contains detailed information about the target recommended product.

[0235] The conversion entry point (landing page access point) is the access point for the target recommended product. Optionally, a conversion entry point can be added around the target recommended product. The conversion entry point can be a visual control, including at least one of a button, link, or other navigation element. This application does not limit the presentation format of the landing page access point.

[0236] Optionally, in response to a user's trigger action on the conversion entry point, the user is redirected to the recommended landing page corresponding to the target recommended product. The recommended landing page is a details page showcasing the target recommended product, displaying detailed content related to the product, including but not limited to videos, images, animations, applications, or other display elements related to the product. Optionally, the recommended landing page can be a page from another third-party application (e.g., a page in a shopping application, or a page on the website of the merchant to which the product belongs). This application does not limit the specific content of the recommended landing page.

[0237] In some embodiments, by triggering a conversion entry point, users can directly enter the purchase interface of the target recommended product from the virtual trial interface and purchase the target recommended product on the purchase interface without having to leave the virtual trial interface and click again, thereby shortening the purchase link and helping to improve the conversion rate.

[0238] The aforementioned triggering operations for conversion entry points include, but are not limited to: input operations, voice operations, click operations, long press operations, swipe operations, touch operations, button operations, gesture operations, and free combinations of at least two of the above operations.

[0239] In this embodiment, the recommended landing page is displayed via a user-triggered conversion entry point. That is, the landing page is only shown to the user when they express interest in the recommended product. Since the landing page typically requires a user to leave the original interface, automatically displaying it could interrupt the user's browsing process. Therefore, recognizing the user's interaction with the conversion entry point to initially determine their intent improves the user experience. Furthermore, the client only loads and displays detailed landing page content when the user actually triggers the conversion entry point, reducing unnecessary resource consumption and improving program response speed.

[0240] Figure 12 is a timing diagram of an interactive method based on recommendation information provided in an exemplary embodiment of this application. The method is illustrated by an example where the terminal device and server shown in Figure 1 jointly execute the method. The server includes a target application server (the social platform where the recommended short videos are located) and a recommendation product server.

[0241] Referring to Figure 12, this timing diagram includes the following steps:

[0242] Step 1: Send an advertising request.

[0243] Optionally, the terminal device sends an advertising request to the target application server. The target application is the social media platform where the recommended short video is located. The recommended short video is an in-feed advertisement used to recommend the primary recommended product, and the target application server sends the in-feed advertisement request to the terminal device.

[0244] Step 2: Forward the ad request.

[0245] Optionally, the target application server forwards the advertising request to the recommending product server.

[0246] Step 3: Process advertising requests.

[0247] Optionally, it is recommended that the product server handle advertising requests.

[0248] Step 4: Return to the advertisement content.

[0249] Optionally, the product recommendation server returns the ad content of the feed ad to the target application server based on the ad request of the recommendation information.

[0250] Step 5: Display the advertisement content.

[0251] Optionally, the terminal device displays the advertising content of the in-feed advertisement on the short video playback interface.

[0252] Step 6: Trigger the interactive controls to enter the AR try-on mode.

[0253] Optionally, the short video playback interface displays virtual interactive controls, which can be activated by the user's actions in response to the user's interaction with the virtual interactive controls, allowing the user to try on the device in AR mode.

[0254] Step 7: Send trigger data.

[0255] The terminal device sends trigger data to the target application server based on the user's trigger operation.

[0256] Step 8: Forward the trigger data.

[0257] Optionally, the target application server may trigger data forwarding to the recommended product server.

[0258] Step 9: Process the trigger data.

[0259] Step 10: Return to the recommendation list.

[0260] Optionally, the recommendation product server analyzes the triggered data using AI algorithms to obtain a recommendation list, which includes a set of candidate recommended products. The recommendation product server then returns the recommendation list to the target application server.

[0261] Step 11: Display the recommendation list.

[0262] Optionally, the target application server returns the recommendation list to the terminal device, which then displays the list on the virtual trial interface. By default, the top-ranked recommended product in the list is selected as the target recommended product, and its virtual product effect is overlaid on the target area using AR (Augmented Reality).

[0263] Step 12: Enter AR try-on and interact.

[0264] Optionally, the recommendation list includes at least one candidate recommended product, and users can also select other candidate recommended products in the recommendation list according to their personal preferences, and display the selected candidate recommended products in AR form overlaid on the target area.

[0265] Optionally, users can interact with the recommended product, such as rotating, zooming in, zooming out, and moving it. Alternatively, users can also perform other interactive actions, such as moving the target area or changing the virtual background.

[0266] Step 13: Send trial wear data.

[0267] Optionally, in response to the user's selection, the terminal device sends trial data to the target application server.

[0268] Step 14: Forward the trial wear data.

[0269] Optionally, the target application server forwards the try-on data to the recommended product server.

[0270] Step 15: Process and optimize trial data.

[0271] Optionally, the product server can process the try-on data and optimize the try-on effect of the recommended products based on the reference standard of the user's target object image.

[0272] Step 16: Return to the trial fitting results.

[0273] Step 17: Show the effect of trying it on.

[0274] Step 18: Share the trial effect.

[0275] Optionally, a sharing control can be displayed on the virtual trial interface, allowing users to share the virtual trial interface with other users.

[0276] In one application scenario, interactive methods based on recommendation information can be applied to the field of jewelry try-on. Optionally, the target recommended product is a jewelry product, and the target object image is a body part image, also known as a target try-on part image, where the target part is a body part. This will be illustrated using short recommended videos as the recommendation medium.

[0277] Step 1: On the short video playback interface, a recommended short video and virtual interactive controls for the first accessory are displayed.

[0278] For example, a social interaction platform is installed and runs on the terminal device. For instance, a short video recommendation medium for the first piece of jewelry will be used as an example. This social interaction platform is designed with a short video playback interface, which includes social content posted by at least one content-publishing account arranged chronologically. Optionally, the content-publishing account is an advertising account. The social content posted by the content-publishing account is advertising content.

[0279] Optionally, the short video playback interface displays recommended short videos and virtual interactive controls for the first piece of jewelry. For example, the first piece of jewelry could be a ring, bracelet, or necklace.

[0280] Step 2: In response to the triggered operation of the virtual interactive control, display the camera capture preview interface.

[0281] Optionally, the triggering operation for the virtual interactive control includes direct triggering operations and indirect triggering operations. Indirect triggering operations for the virtual interactive control can be implemented through a stateful component. Optionally, in response to a positive stateful operation for the stateful component, the conditions for satisfying the indirect triggering operation for the virtual interactive control are determined.

[0282] In some embodiments, in response to a triggering operation on a virtual interactive control, a camera capture preview interface is displayed. This preview interface includes prompts to guide the capture of an image of the target fitting area. The target fitting area image is an image of the user's body part. The prompts refer to guiding information or visual aids displayed to the user on the camera capture preview interface. These prompts instruct the user on how to capture the image of the target fitting area using the camera on the camera capture preview interface.

[0283] In some embodiments, the prompt message is a guide mask. The guide mask can be a layer with preset transparency overlaid on the camera preview interface. The guide mask guides the user to capture an image of the target fitting area. The shape of the guide mask is related to the shape of the target fitting area image to be captured.

[0284] For example, if the first accessory is a ring, the pre-captured image of the target area for trying it on is a hand image, and the guiding mask is displayed as a layer shaped like a palm. As another example, if the first accessory is a necklace, the pre-captured image of the target area for trying it on is a neck image, and the guiding mask is displayed as a layer shaped like a neck.

[0285] In some embodiments, the camera capture preview interface includes a capture frame, within which a guide overlay is displayed. The capture frame is located in the target area of ​​the camera capture preview interface. The capture frame is displayed as a rectangular, circular, or other shaped border. The target area is the display area of ​​the capture frame, which can be a preset area or a dynamically changing area. Optionally, the display size of the capture frame changes according to the distance between the target fitting area image and the camera.

[0286] In some embodiments, the camera preview interface further includes acquisition prompts, which guide the image of the target fitting area to the guide layer position. Optionally, the acquisition prompts may include, but are not limited to, at least one of text prompts, arrow prompts, and voice prompts.

[0287] Step 3: In response to the image of the target fitting area meeting the acquisition conditions, display the correlation effect between the physical properties of the target jewelry and the body part.

[0288] The acquisition conditions refer to the standard conditions that the camera of the terminal device must meet when acquiring images of the target fitting area. The target accessory is either the first accessory or a second accessory of the same type as the first accessory. The associated effect refers to the visual or application effect produced when the physical attributes of the target accessory are combined with the body part. The physical attribute is the accessory's decorative effect. Optionally, the associated effect acting on the body part is a virtual product effect.

[0289] In response to the target fitting area image meeting the acquisition conditions, or in response to the overlap between the target fitting area image and the guide layer meeting the first threshold, the association effect between the physical attributes of the target jewelry and the body part is displayed. The association effect is the virtual product effect of the target jewelry. In the virtual trial interface, the target jewelry is superimposed on the target part in AR form.

[0290] The overlap refers to the degree of overlap between the image of the target fitting area and the guiding overlay. Overlap is used to measure the consistency between the body part and the guiding overlay. If the overlap reaches or exceeds a preset first threshold, the target accessory is displayed as an AR overlay on the body part.

[0291] In some embodiments, in response to the overlap between the target fitting area image and the guiding overlay meeting a first threshold, the target fitting area image is analyzed using an AI algorithm to obtain a recommendation list. The recommendation list includes at least one candidate accessory. Optionally, the at least one candidate accessory in the recommendation list is sorted from high to low according to its fit with the target fitting area image, and the candidate accessory ranked first is determined as the target accessory, which is then overlaid on the body part in AR format. Optionally, the recommendation list is obtained based on reference standards for analyzing the target fitting area image using an AI algorithm, and different target fitting area images correspond to different reference standards. For example, when the target fitting area image is a hand image, the reference standards corresponding to the hand image include, but are not limited to, at least one of the shape, size, and color of the hand image; when the target fitting area is a neck image, the reference standards corresponding to the neck image include, but are not limited to, at least one of the color and smoothness of the neck image.

[0292] In some embodiments, in response to a selection of any candidate accessory from the recommended list, the selected accessory is overlaid on the body in AR format. Optionally, users can browse the recommended list and select candidate accessories according to their preferences.

[0293] In some embodiments, in response to an interactive action on a target accessory, the physical properties of the target accessory and the associated effects on body parts are updated.

[0294] For example, in response to a movement operation targeting a target accessory, the position of the target accessory is moved on a body part, and the association effect between the physical attributes of the moved target accessory and the body part is displayed. For instance, if the target accessory is a ring, and by default the virtual product effect of the ring is worn on the middle finger, the user can move the ring from the middle finger to the index finger through a movement operation to view the virtual product effect of the ring being worn on the index finger.

[0295] In some embodiments, in response to changes in movement on a body part, the physical properties of the target accessory are displayed, showing the correlation between the physical properties of the target accessory and the movement on the body part. Once the data collection conditions are met, the current interface transitions from a camera-captured preview interface to a virtual trial interface, where the recommended product is automatically attached to the body part.

[0296] For example, the target accessory is a bracelet. After the collection conditions are met, the bracelet will automatically attach to the user's wrist. Optionally, in response to wrist movement, the virtual product effect of the bracelet moves with the wrist; in response to wrist rotation, the virtual product effect of the bracelet rotates with the wrist; in response to wrist shaking, the virtual product effect of the bracelet shakes with the wrist.

[0297] In some embodiments, a split-screen control is displayed to trigger the virtual trial interface to enter split-screen display. The virtual trial interface is an interface that displays the accessory decoration effect corresponding to the target accessory and the association effect with the body part. In response to the trigger operation of the split-screen control, the virtual trial interface and the short video playback interface are controlled to be displayed in a split-screen form on the comparison interface.

[0298] In this embodiment, when the recommendation medium is a short video, a first accessory and a virtual interactive control are displayed on the short video playback interface. Users can trigger the virtual interactive control to enter the camera capture preview interface and interact according to the prompts. Once the image of the target fitting area meets the capture conditions, the physical attributes of the target accessory and their association with the body part are displayed. For example, AR interaction can be performed according to the prompts, allowing users to preview the virtual product effect of the target accessory. By overlaying the virtual product effect of the target accessory onto the body part in AR form, the integration of the virtual product effect of the target accessory with the real scene is ensured. By triggering the virtual interactive control, products identical to or of the same type as the promoted product (the first accessory) are recommended to the user, achieving personalized recommendation services. This recommendation method not only improves the accuracy of recommendations but also increases the frequency of user interaction with the information flow advertisement, thereby increasing the click-through rate of the information flow advertisement.

[0299] In one application scenario, interactive methods based on recommendation information can be applied to the field of furniture trials. Optionally, the target recommended product is a furniture product, the target object image is a target spatial location image, and the target part is the target spatial location. This will be illustrated using a short recommended video as the recommendation medium.

[0300] Step 1: On the short video playback interface, the recommended short video and virtual interactive controls for the first piece of furniture are displayed.

[0301] For example, a social interaction platform is installed and runs on the terminal device. For instance, a short video recommendation medium for a furniture store can be used as an example. This social interaction platform has a short video playback interface that includes social content posted by at least one content-publishing account, arranged chronologically. Optionally, the content-publishing account is an advertising account. The social content posted by the content-publishing account is advertising content.

[0302] Optionally, the short video playback interface displays recommended short videos and virtual interactive controls for the first piece of furniture. For example, the first piece of furniture could be a television, sofa, or lamp.

[0303] Step 2: In response to the triggered operation of the virtual interactive control, display the camera capture preview interface.

[0304] Optionally, the triggering operation for the virtual interactive control includes direct triggering operations and indirect triggering operations. Indirect triggering operations for the virtual interactive control can be implemented through a stateful component. Optionally, in response to a positive stateful operation for the stateful component, the conditions for satisfying the indirect triggering operation for the virtual interactive control are determined.

[0305] In some embodiments, in response to a triggering operation on a virtual interactive control, a camera acquisition preview interface is displayed. This preview interface includes prompts to guide the acquisition of an image of the target spatial location. The target spatial location image is an image corresponding to a location related to the functional position of the first piece of furniture. The prompts refer to guiding information or visual aids displayed to the user on the camera acquisition preview interface. These prompts instruct the user on how to acquire the target spatial location image using the camera on the camera acquisition preview interface.

[0306] In some embodiments, the prompt message is a guide mask. The guide mask can be a layer with preset transparency overlaid on the camera capture preview interface. The guide mask is used to guide the user in capturing an image of the target spatial location. The shape of the guide mask is related to the location of the area where the target spatial location image to be captured will be placed.

[0307] For example, if the first piece of furniture is a television, the pre-captured target spatial location image is the image corresponding to the area where the television will be placed, and the guide mask can be displayed as a layer shaped like a TV cabinet. As another example, if the first piece of furniture is a lamp, the pre-captured target spatial location image is the image corresponding to the area that needs illumination, and the guide mask can be displayed as a layer shaped like a desk.

[0308] In some embodiments, the camera capture preview interface includes a capture frame, within which a guide overlay is displayed. The capture frame is located in the target area of ​​the camera capture preview interface. The capture frame is displayed as a rectangular, circular, or other shaped border. The target area is the display area of ​​the capture frame, which can be a preset area or a dynamically changing area. Optionally, the display size of the capture frame changes according to the distance between the target spatial position image and the camera.

[0309] In some embodiments, the camera acquisition preview interface also includes acquisition prompts, which are prompts used to guide the target spatial location image to the guide overlay position. Optionally, the acquisition prompts may include, but are not limited to, at least one of text prompts, arrow prompts, and voice prompts.

[0310] Step 3: In response to the target spatial location image meeting the acquisition conditions, display the correlation effect between the physical attributes of the target furniture and the target spatial location.

[0311] The acquisition conditions refer to the standard conditions that the camera of the terminal device must meet when acquiring images of the target spatial location. The target furniture is either the first piece of furniture or a second piece of furniture of the same type as the first piece of furniture. The association effect refers to the visual or application effect produced when the physical attributes of the target furniture are combined with the target spatial location. The physical attributes are the actual physical characteristics of the target furniture, such as size and material. Optionally, the association effect acting on the target spatial location is a virtual product effect.

[0312] In response to the target spatial location image meeting the acquisition conditions, or in response to the overlap between the target spatial location image and the guiding mask meeting the first threshold, the association effect between the physical attributes of the target furniture and the target spatial location is displayed. The association effect is the virtual product effect of the target furniture, that is, the target furniture is placed and displayed in AR form at the target spatial location in the virtual trial interface.

[0313] The overlap ratio refers to the degree of overlap between the target spatial location image and the guide overlay. The overlap ratio measures the consistency between the target spatial location and the guide overlay. If the overlap ratio reaches or exceeds a preset first threshold, the target furniture is displayed in AR mode at the target spatial location.

[0314] In some embodiments, in response to the overlap between the target spatial location image and the guiding overlay meeting a first threshold, the target spatial location image is analyzed based on an AI algorithm to obtain a recommendation list. The recommendation list includes at least one candidate furniture. Optionally, the at least one candidate furniture in the recommendation list is sorted from high to low according to its fit with the target spatial location image, the candidate furniture ranked first is determined as the target furniture, and the target furniture is placed and displayed in AR format at the target spatial location.

[0315] In some embodiments, in response to a selection operation of any candidate furniture in the recommendation list, the selected candidate furniture is displayed in AR format at the target space location. Optionally, users can browse the recommendation list and select candidate furniture according to their preferences.

[0316] In some embodiments, in response to an interactive operation on the target furniture, the association between the physical properties of the target furniture and the target spatial location is updated.

[0317] For example, in response to a movement operation on the target furniture, the position of the target furniture is moved, and the association effect between the physical attributes of the target furniture and its target spatial position after the position is moved is displayed. For example, the target furniture is a sofa, which is displayed by default in the center area of ​​the living room floor. Optionally, in response to a movement operation on the sofa, a virtual product effect is displayed showing the sofa moving from its center area A on the object's floor to another area B.

[0318] For example, in response to a zoom-in operation on the target furniture, the size of the target furniture is enlarged, and the association effect between the enlarged physical attributes of the target furniture and the target spatial location is displayed at the target spatial location. For example, if the target furniture is a sofa, the preset size of the sofa is displayed. Optionally, in response to a zoom-in operation on the sofa, a virtual product effect is displayed showing the sofa's size enlarged from the preset size to the changed size.

[0319] In some embodiments, a split-screen control is displayed to trigger the virtual trial interface to enter split-screen display. The virtual trial interface is an interface that displays the correlation effect between the physical attributes of the target furniture and the target spatial location. In response to the trigger operation of the split-screen control, the virtual trial interface and the short video playback interface are controlled to be displayed in a split-screen format on the comparison interface.

[0320] In this embodiment, when the recommendation medium is a short video, by displaying the first piece of furniture and virtual interactive controls on the short video playback interface, the user can trigger the virtual interactive controls to enter the camera capture preview interface. On the camera capture preview interface, the user can interact according to the prompts. When the target spatial location image meets the capture conditions, the association effect between the physical attributes of the target furniture and the target spatial location is displayed. For example, AR interaction can be performed according to the prompts, and the virtual product effect of the target furniture can be previewed via AR. By placing the virtual product effect of the target furniture in AR form at the target spatial location, the integration of the virtual product effect of the target furniture with the real scene is ensured. By triggering the virtual interactive controls, products that are the same as or of the same type as the promoted product (the first piece of furniture) are recommended to the user, realizing a personalized recommendation service. This recommendation method not only improves the accuracy of the recommendation but also increases the frequency of user interaction with the information flow advertisement, thereby increasing the click-through rate of the information flow advertisement.

[0321] Beneficial effects of this plan

[0322] 1) Through AR virtual try-on or AR virtual trial, users can intuitively experience the try-on or trial effect of recommended products, enhancing their confidence in making decisions.

[0323] 2) Analyze the user's target image using AI algorithms to obtain at least one candidate recommended product, and improve user satisfaction by providing personalized product recommendations.

[0324] 3) Simultaneously combine AR and AI technologies to provide an interactive advertising experience, increasing user engagement and advertising effectiveness.

[0325] Figure 13 shows a structural block diagram of an interactive device based on recommendation information according to an embodiment of this application. This device has the functionality to implement the above-described example of an interactive method based on recommendation information. This functionality can be implemented in hardware or by hardware executing corresponding software. The device can be the server described above, or it can be located within a server. As shown in Figure 13, the device 1300 may include a display module 1310.

[0326] Display module 1310 is used to display the recommendation medium and virtual interactive controls of the first recommended product;

[0327] Display module 1310 is used to display a camera acquisition preview interface in response to a trigger operation on the virtual interactive control. The camera acquisition preview interface includes prompt information to guide the acquisition of images of the target object.

[0328] Display module 1310 is used to display the correlation effect between the physical attributes of the target recommended product and the target part on the virtual trial interface in response to the target object image meeting the acquisition conditions. The target part is the position in the target object image that is related to the position of the first recommended product.

[0329] The target recommended product is either the first recommended product or a second recommended product of the same type as the first recommended product.

[0330] In some embodiments, the display module 1310 further includes a display submodule.

[0331] In an optional example, the prompt information is a guidance overlay used to guide the acquisition of a target object image; the display submodule is used to display the correlation effect between the physical attributes of the target recommended product and the target part on the virtual trial interface in response to the overlap between the target object image and the guidance overlay satisfying a first threshold.

[0332] In some embodiments, the display submodule further includes an analysis unit and a display unit.

[0333] In an optional example, the analysis unit is configured to analyze the target object image based on an artificial intelligence (AI) algorithm in response to the overlap between the target object image and the guiding mask satisfying the first threshold, and obtain a recommendation list, the recommendation list including at least one candidate recommended product;

[0334] The display unit is used to determine the target recommended product based on the recommendation list and display the correlation effect between the physical attributes of the target recommended product and the target part on the virtual trial interface.

[0335] In an optional example, a display unit is used to sort and display the at least one candidate recommended products in descending order of their fit with the target object image;

[0336] The display unit is used to determine the top n candidate recommended products sorted from high to low as the target recommended product, and to display the correlation effect between the physical attributes of the target recommended product and the target part on the virtual trial interface, where n is a positive integer.

[0337] In an optional example, the display unit is configured to determine, from the recommendation list, the candidate recommended product whose adaptation to the target object image reaches a second threshold as the target recommended product based on the adaptation degree between the at least one candidate recommended product and the target object image, and display the association effect between the physical attributes corresponding to the target recommended product and the target part on the virtual trial interface.

[0338] In an optional example, a display unit is configured to, in response to a selection operation on a candidate recommended product in the recommendation list, determine that the candidate recommended product selected by the selection operation is the target recommended product, and display on the virtual trial interface the association effect between the physical attributes of the target selected candidate recommended product and the target part.

[0339] In an optional example, a submodule is displayed to update the association effect between the physical attributes of the target recommended product and the target part in response to an interactive operation on the target recommended product.

[0340] In an optional example, the display unit is configured to, in response to a first interactive operation on the target recommended product, rotate the target recommended product by an angle, and display on the target portion the correlation effect between the rotated physical attributes of the target recommended product and the target portion; or,

[0341] The display unit is configured to, in response to a second interactive operation on the target recommended product, enlarge the size of the target recommended product and display, on the target area, the enlarged physical attributes of the target recommended product and the correlation effect between the enlarged product and the target area; or...

[0342] The display unit is configured to, in response to a third interactive operation on the target recommended product, reduce the size of the target recommended product and display, on the target area, the correlation effect between the reduced physical attributes of the target recommended product and the target area; or...

[0343] The display unit is configured to respond to a fourth interactive operation on the target recommended product by moving the position of the target recommended product and displaying the association effect between the physical attributes of the moved target recommended product and the target part on the target part.

[0344] In an optional example, a submodule is displayed to show the correlation effect between the physical attributes of the target recommended product and the target part in response to a change in action on the target part.

[0345] In an optional example, a display submodule is provided to respond to a switching operation of the virtual background of the virtual trial interface, displaying the correlation effect between the physical attributes of the target recommended product and the target part in the switched virtual background, wherein different virtual backgrounds are used to simulate different real-life scenarios.

[0346] In an optional example, the target recommended product belongs to the recommended products of the first brand, and the display submodule is used to display the recommended products of the second brand in a preset area of ​​the virtual trial interface;

[0347] The display submodule is used to respond to the selection operation of the recommended product of the second brand and jump to the details interface of the recommended product of the second brand.

[0348] In an optional example, a submodule is displayed for displaying a split-screen control, which triggers the split-screen display of the virtual trial interface;

[0349] The display submodule is used to respond to the trigger operation of the split-screen control and control the virtual trial interface and the display interface to be displayed in a split-screen format. The display interface is used to display the first recommended product.

[0350] In an optional example, a submodule is displayed to show a sharing control that triggers a first account to share the virtual trial interface to a second account;

[0351] The display submodule is used to display the interaction screen between the first account and the second account in response to the joining operation of the second account.

[0352] In an optional example, the recommendation medium is a short video recommendation, which includes content of a model trying out the first recommended product. A display submodule is used to display, in response to a first color switching operation for the first recommended product, the virtual product effect of the first recommended product after the color switch is applied to the model, and the promotional content corresponding to the first recommended product after the color switch is displayed in the short video recommendation.

[0353] In an optional example, a display submodule is configured to, in response to a second switching operation for the model of the first recommended product, display in the recommended short video the product effect of the first recommended product after the model switching on the image of the model, and display the promotional content corresponding to the first recommended product after the model switching.

[0354] In some embodiments, the apparatus 1300 further includes an execution module.

[0355] In an optional example, the execution module is configured to perform conversion processing based on the virtual trial interface, the conversion processing including at least one of redirecting to the purchase interface of the target recommended product, redirecting to the introduction interface of the target recommended product, and redirecting to the interactive interface of the target recommended product.

[0356] In an optional example, a conversion entry is displayed around the target recommended product, and a display submodule is used to display a recommended landing page corresponding to the target recommended product in response to a trigger operation for the conversion entry. The recommended landing page displays detailed information about the target recommended product.

[0357] It should be noted that the specific limitations of the embodiments of the one or more interactive devices based on recommendation information provided above can be found in the limitations of the interactive methods based on recommendation information above, and will not be repeated here. Each module of the above-mentioned device can be implemented entirely or partially by software, hardware, or a combination thereof. Each module can be embedded in the processor of the computer device in hardware form or independent of the processor of the computer device, or it can be stored in the memory of the computer device in software form, so that the processor can call and execute the corresponding operations of each module.

[0358] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0359] This application also provides a computer device, which includes a processor and a memory. The memory stores at least one computer program, which is loaded and executed by the processor to implement the interactive method based on recommendation information provided in the above-described method embodiments.

[0360] Figure 14 shows a structural block diagram of a computer device 1800 provided in an exemplary embodiment of this application. The computer device 1800 may be a portable mobile terminal, such as a smartphone, tablet computer, MP3 player (Moving Picture Experts Group Audio Layer III), or MP4 player (Moving Picture Experts Group Audio Layer IV). The computer device 1800 may also be referred to as a user device, portable terminal, or other names. Typically, the computer device 1800 includes a processor 1801 and a memory 1802.

[0361] Processor 1801 may include one or more processing cores, such as a quad-core processor, an octa-core processor, etc. Processor 1801 may be implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field Programmable Gate Array), and PLA (Programmable Logic Array). Processor 1801 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, processor 1801 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, processor 1801 may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.

[0362] Memory 1802 may include one or more computer-readable storage media, which may be tangible and non-transitory. Memory 1802 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in memory 1802 is used to store at least one instruction, which is executed by processor 1801 to implement the recommendation-based interactive method provided in the embodiments of this application.

[0363] In some embodiments, the computer device 1800 may also optionally include a peripheral device interface 1803 and at least one peripheral device. The processor 1801, memory 1802, and peripheral device interface 1803 can be connected via a bus or signal line. Each peripheral device can be connected to the peripheral device interface 1803 via a bus, signal line, or circuit board. Specifically, the peripheral device includes at least one of the following: a radio frequency circuit 1804, a touch display screen 1805, a camera assembly 1806, an audio circuit 1807, and a power supply 1808.

[0364] Peripheral device interface 1803 can be used to connect at least one I / O (Input / Output) related peripheral device to processor 1801 and memory 1802. In some embodiments, processor 1801, memory 1802 and peripheral device interface 1803 are integrated on the same chip or circuit board; in some other embodiments, any one or two of processor 1801, memory 1802 and peripheral device interface 1803 can be implemented on separate chips or circuit boards, which is not limited in this embodiment.

[0365] The radio frequency (RF) circuit 1804 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The RF circuit 1804 communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 1804 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals back into electrical signals. Optionally, the RF circuit 1804 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The RF circuit 1804 can communicate with other terminals through at least one wireless communication protocol. This wireless communication protocol includes, but is not limited to: the World Wide Web, metropolitan area networks, intranets, various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and / or Wi-Fi (Wireless Fidelity) networks. In some embodiments, the RF circuit 1804 may also include circuitry related to NFC (Near Field Communication), which is not limited in this application.

[0366] The touch display screen 1805 is used to display a UI (User Interface). This UI may include graphics, text, icons, videos, and any combination thereof. The touch display screen 1805 also has the ability to collect touch signals on or above its surface. These touch signals can be input as control signals to the processor 1801 for processing. The touch display screen 1805 is used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there may be one touch display screen 1805, located on the front panel of the computer device 1800; in other embodiments, there may be at least two touch display screens, respectively located on different surfaces of the computer device 1800 or in a folded design; in some embodiments, the touch display screen 1805 may be a flexible display screen, located on a curved or folded surface of the computer device 1800. Furthermore, the touch display screen 1805 may be configured as a non-rectangular, irregular shape, i.e., a non-rectangular screen. The touch display screen 1805 may be made of materials such as LCD (Liquid Crystal Display) or OLED (Organic Light-Emitting Diode).

[0367] The camera assembly 1806 is used to acquire images or videos. Optionally, the camera assembly 1806 includes a front-facing camera and a rear-facing camera. Typically, the front-facing camera is used for video calls or selfies, and the rear-facing camera is used for taking photos or videos. In some embodiments, there are at least two rear-facing cameras, which are any one of a main camera, a depth-sensing camera, and a wide-angle camera, to achieve background blurring by fusion of the main camera and the depth-sensing camera, and panoramic shooting and VR shooting by fusion of the main camera and the wide-angle camera. In some embodiments, the camera assembly 1806 may also include a flash. The flash can be a single-color temperature flash or a dual-color temperature flash. A dual-color temperature flash is a combination of a warm-light flash and a cool-light flash, which can be used for light compensation at different color temperatures.

[0368] Audio circuitry 1807 provides an audio interface between the user and computer device 1800. Audio circuitry 1807 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, converting the sound waves into electrical signals that are input to processor 1801 for processing, or input to radio frequency circuitry 1804 for voice communication. For stereo sound acquisition or noise reduction purposes, multiple microphones may be used, each located at a different location within computer device 1800. The microphone may also be an array microphone or an omnidirectional microphone. The speaker is used to convert electrical signals from processor 1801 or radio frequency circuitry 1804 into sound waves. The speaker may be a conventional diaphragm speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can convert electrical signals not only into audible sound waves but also into inaudible sound waves for purposes such as distance measurement. In some embodiments, audio circuitry 1807 may also include a headphone jack.

[0369] Power supply 1808 is used to supply power to the various components in computer device 1800. Power supply 1808 can be AC ​​power, DC power, a disposable battery, or a rechargeable battery. When power supply 1808 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery that is charged via a wired line, and a wireless rechargeable battery is a battery that is charged via a wireless coil. The rechargeable battery can also be used to support fast charging technology.

[0370] In some embodiments, the computer device 1800 further includes one or more sensors 1809. The one or more sensors 1809 include, but are not limited to, an accelerometer 1810, a gyroscope 1811, a pressure sensor 1812, an optical sensor 1813, and a proximity sensor 1814.

[0371] Accelerometer 1810 can detect the magnitude of acceleration on the three coordinate axes of a coordinate system established by computer device 1800. For example, accelerometer 1810 can be used to detect the components of gravitational acceleration on the three coordinate axes. Processor 1801 can control touch screen 1805 to display the user interface in landscape or portrait view based on the gravitational acceleration signal collected by accelerometer 1810. Accelerometer 1810 can also be used for games or to collect user motion data. Gyroscope 1811 can detect the orientation and rotation angle of computer device 1800. Gyroscope 1811 can work in conjunction with accelerometer 1810 to collect 3D movements of the user on computer device 1800. Based on the data collected by gyroscope 1811, processor 1801 can perform the following functions: motion sensing (e.g., changing the UI based on the user's tilt), image stabilization during shooting, game control, and inertial navigation.

[0372] The pressure sensor 1812 can be disposed on the side bezel of the computer device 1800 and / or on the underside of the touchscreen display 1805. When the pressure sensor 1812 is disposed on the side bezel of the computer device 1800, it can detect the user's grip signal on the computer device 1800 and perform left / right hand recognition or quick operation based on the grip signal. When the pressure sensor 1812 is disposed on the underside of the touchscreen display 1805, it can control operable controls on the UI interface based on the user's pressure operation on the touchscreen display 1805. Operable controls include at least one of button controls, scroll bar controls, icon controls, and menu controls.

[0373] An optical sensor 1813 is used to collect ambient light intensity. In one embodiment, the processor 1801 can control the display brightness of the touch screen 1805 based on the ambient light intensity collected by the optical sensor 1813. Specifically, when the ambient light intensity is high, the display brightness of the touch screen 1805 is increased; when the ambient light intensity is low, the display brightness of the touch screen 1805 is decreased. In another embodiment, the processor 1801 can also dynamically adjust the shooting parameters of the camera assembly 1806 based on the ambient light intensity collected by the optical sensor 1813.

[0374] The proximity sensor 1814, also known as a distance sensor, is typically located on the front of the computer device 1800. The proximity sensor 1814 is used to detect the distance between the user and the front of the computer device 1800. In one embodiment, when the proximity sensor 1814 detects that the distance between the user and the front of the computer device 1800 is gradually decreasing, the processor 1801 controls the touch display screen 1805 to switch from a screen-on state to a screen-off state; when the proximity sensor 1814 detects that the distance between the user and the front of the computer device 1800 is gradually increasing, the processor 1801 controls the touch display screen 1805 to switch from a screen-off state to a screen-on state.

[0375] Those skilled in the art will understand that the above structure does not constitute a limitation on the computer device 1800, and may include more or fewer components than shown, or combine certain components, or employ different component arrangements.

[0376] This application also provides a computer-readable storage medium storing at least one computer program, which is loaded and executed by a processor to implement the interactive method based on recommendation information provided in the above-described method embodiments.

[0377] This application also provides a computer program product, which includes at least one computer program stored in a computer-readable storage medium; the at least one computer program is read from and executed by a processor of a computer device from the computer-readable storage medium, causing the computer device to perform the interactive method based on recommendation information provided in the above-described method embodiments.

[0378] It should be understood that "multiple" as used herein refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. Furthermore, the step numbers described herein are merely illustrative of one possible execution order. In some other embodiments, the steps may not be executed in numerical order, such as two steps with different numbers being executed simultaneously, or two steps with different numbers being executed in the reverse order of the illustration. This application does not limit this.

[0379] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware or by a program instructing related hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.

[0380] The above description is merely an optional embodiment of this application and is not intended to limit this application. Any modifications, equivalent switching, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

An interactive method based on recommendation information, characterized in that, The method includes: Displays the recommendation medium and virtual interactive controls for the top-recommended product; In response to a trigger operation on the virtual interactive control, a camera acquisition preview interface is displayed, which includes prompts to guide the acquisition of images of the target object. In response to the target object image meeting the acquisition conditions, the correlation effect between the physical attributes of the target recommended product and the target part is displayed on the virtual trial interface, wherein the target part is the position in the target object image that is related to the position of the first recommended product. The target recommended product is either the first recommended product or a second recommended product of the same type as the first recommended product. The method according to claim 1, characterized in that, The prompt message is a guidance mask, which is used to guide the acquisition of the target object image; The step of displaying the correlation effect between the physical attributes of the target recommended product and the target body part on the virtual trial interface in response to the target object image meeting the acquisition conditions includes: In response to the overlap between the target object image and the guiding mask layer satisfying a first threshold, the association effect between the physical attributes of the target recommended product and the target part is displayed on the virtual trial interface. The method according to claim 2, characterized in that, The step of displaying the correlation effect between the physical attributes of the target recommended product and the target part on the virtual trial interface in response to the overlap between the target object image and the guiding mask layer satisfying a first threshold includes: In response to the overlap between the target object image and the guiding mask satisfying the first threshold, the target object image is analyzed based on an artificial intelligence (AI) algorithm to obtain a recommendation list, which includes at least one candidate recommended product. Based on the recommendation list, the target recommended product is determined, and the correlation effect between the physical attributes of the target recommended product and the target part is displayed on the virtual trial interface. The method according to claim 3, characterized in that, The step of determining the target recommended product based on the recommendation list and displaying the correlation effect between the physical attributes of the target recommended product and the target body part on the virtual trial interface includes: The at least one candidate recommended product is sorted and displayed in descending order of its fit with the target object image; The top n candidate recommended products, sorted from highest to lowest, are determined as the target recommended products. The correlation effect between the physical attributes of the target recommended products and the target body part is displayed on the virtual trial interface, where n is a positive integer. The method according to claim 3, characterized in that, The step of determining the target recommended product based on the recommendation list and displaying the correlation effect between the physical attributes of the target recommended product and the target body part on the virtual trial interface includes: Based on the fit between the at least one candidate recommended product and the target object image, a candidate recommended product whose fit with the target object image reaches a second threshold is determined from the recommendation list as the target recommended product, and the correlation effect between the physical attributes of the target recommended product and the target part is displayed on the virtual trial interface. The method according to claim 3, characterized in that, The step of determining the target recommended product based on the recommendation list and displaying the correlation effect between the physical attributes of the target recommended product and the target body part on the virtual trial interface includes: In response to the selection operation of candidate recommended products in the recommended list, the selected candidate recommended product is determined to be the target recommended product, and the correlation effect between the physical attributes of the target recommended product and the target part is displayed on the virtual trial interface. The method according to any one of claims 1 to 5, characterized in that, The method further includes: In response to an interactive operation on the target recommended product, update the association effect between the physical attributes of the target recommended product and the target part. The method according to claim 7, characterized in that, The step of updating the association between the physical attributes of the target recommended product and the target body part in response to an interactive operation on the target recommended product includes: In response to a first interactive operation on the target recommended product, the angle of the target recommended product is rotated, and the correlation effect between the rotated physical attributes of the target recommended product and the target part is displayed on the target part; or, In response to a second interactive operation on the target recommended product, the size of the target recommended product is enlarged, and the correlation effect between the enlarged physical attributes of the target recommended product and the target area is displayed on the target area; or, In response to a third interactive operation on the target recommended product, the size of the target recommended product is reduced, and the correlation effect between the reduced physical attributes of the target recommended product and the target area is displayed on the target area; or, In response to a fourth interactive operation on the target recommended product, the position of the target recommended product is moved, and the association effect between the physical attributes of the moved target recommended product and the target part is displayed on the target part. The method according to any one of claims 1 to 8, characterized in that, The method further includes: In response to changes in movement at the target location, the physical attributes of the recommended product are displayed to show the correlation between the changes in movement at the target location and the target location. The method according to any one of claims 1 to 9, characterized in that, The method further includes: In response to the switching operation of the virtual background of the virtual trial interface, the correlation effect between the physical attributes of the target recommended product and the target part is displayed in the switched virtual background. Different virtual backgrounds are used to simulate different real-life scenarios. The method according to any one of claims 1 to 10, characterized in that, The target recommended product is a recommended product of the first brand, and the method further includes: The second brand's recommended products are displayed in a preset area of ​​the virtual trial interface; In response to the selection of recommended products for the second brand, the user is redirected to the details page of the recommended products for the second brand. The method according to any one of claims 1 to 11, characterized in that, The method further includes: A split-screen control is displayed, which is used to trigger the split-screen display of the virtual trial interface; In response to a trigger operation on the split-screen control, the virtual trial interface and the display interface are controlled to be displayed in a split-screen format, wherein the display interface is used to display the first recommended product. The method according to any one of claims 1 to 12, characterized in that, The method further includes: Display a sharing control, which is used to trigger the first account to share the virtual trial interface with the second account; In response to the joining operation of the second account, the interaction screen between the first account and the second account is displayed on the virtual trial interface. The method according to any one of claims 1 to 12, characterized in that, The recommendation medium is a short video recommendation, which includes content featuring models trying out the first recommended product. The method further includes: In response to a first color-switching operation for the first recommended product, the recommended short video displays the virtual product effect of the first recommended product after the color switch, applied to the model's image, and also displays the promotional content corresponding to the first recommended product after the color switch. The method according to claim 14, characterized in that, The method further includes: In response to a second switching operation for the model of the first recommended product, the recommended short video displays the effect of the product of the first recommended product after the model switch on the image of the model, as well as the promotional content corresponding to the first recommended product after the model switch. The method according to any one of claims 1 to 15, characterized in that, The method further includes: The conversion process is performed based on the virtual trial interface, and the conversion process includes at least one of jumping to the purchase interface of the target recommended product, jumping to the introduction interface of the target recommended product, and jumping to the interactive interface of the target recommended product. The method according to any one of claims 1 to 15, characterized in that, The method further includes displaying a conversion entry point around the target recommended product, and displaying the conversion entry point around the target product: In response to a trigger operation targeting the conversion entry point, a recommended landing page corresponding to the target recommended product is displayed, and the recommended landing page displays detailed information related to the target recommended product. An interactive device based on recommendation information, characterized in that, The device includes: The display module is used to display the recommendation medium and virtual interactive controls for the first recommended product; The display module is used to display a camera acquisition preview interface in response to a trigger operation on the virtual interactive control. The camera acquisition preview interface includes prompt information to guide the acquisition of images of the target object. The display module is used to display the correlation effect between the physical attributes of the target recommended product and the target part on the virtual trial interface in response to the target object image meeting the acquisition conditions. The target part is the position in the target object image that is related to the position of the first recommended product. The target recommended product is either the first recommended product or a second recommended product of the same type as the first recommended product. A computer device, characterized in that, The computer device includes a processor and a memory, the memory storing at least one computer program, the at least one computer program being loaded and executed by the processor to implement the interactive method based on recommendation information as described in any one of claims 1 to 17. A computer storage medium, characterized in that, The computer-readable storage medium stores at least one computer program, which is loaded and executed by a processor to implement the interactive method based on recommendation information as described in any one of claims 1 to 17. A computer program product, characterized in that, The computer program product includes a computer program stored in a computer-readable storage medium; the computer program is read from and executed by a processor of a computer device, causing the computer device to perform an interactive method based on recommendation information as described in any one of claims 1 to 17.

Images