AI contact lens virtual try-on method and system

Abstract

The application provides an AI beauty lens virtual fitting method and system. After a user logs in a program or application and completes authorization, the system obtains user facial information, analyzes image quality and eye area quality, and selectively supplements eye information collection. After processing the image, the system displays, analyzes facial and pupil characteristics, and recommends a beauty lens pattern. The user can select or edit the beauty lens color, graphic shape, and confirm that the system fits the beauty lens pattern to the eye to display the fitting result. The user can upload their own edited design for other users to select or edit, and at the same time, obtain virtual points according to the interaction for internal use of the application. The system cooperates with various modules to realize the whole process of beauty lens virtual fitting, adapt to the personalized needs of users, and assist users in decision-making.

Description

Technical Field

[0001] This invention relates to the field of AI-powered virtual try-on technology for colored contact lenses, specifically to an AI-powered virtual try-on method and system for colored contact lenses. Background Technology

[0002] In online contact lens shopping scenarios, consumers cannot visually preview the wearing effect and can only judge whether it is suitable through product images and text descriptions and feedback from others trying it on. This method lacks intuitiveness and specificity, making it difficult for consumers to make decisions and easily leading to unsatisfactory wearing effects after purchase. This increases the cost of shopping for consumers and reduces the overall experience of online contact lens shopping. Furthermore, traditional online contact lens recommendations rely heavily on manual screening, failing to accurately recommend products based on individual characteristics such as facial contours, eye shape, and pupil color, further reducing the accuracy of recommendations and failing to meet consumers' personalized needs. In addition, existing online contact lens shopping lacks interactivity; consumers cannot participate in the personalized design and sharing of contact lens designs, making it difficult to increase user engagement.

[0003] Existing virtual try-on technologies have significant limitations. Most technologies do not rigorously assess the quality of the captured facial images, especially the clarity and integrity of the eye area. Poor image quality can easily lead to deviations in the fitting effect of the contact lenses, failing to realistically reproduce the wearing state. Some technologies lack mechanisms for supplementing eye information collection; when the eye area is blurry or obscured, qualified eye information cannot be obtained, affecting the try-on effect. Furthermore, existing technologies lack flexible contact lens pattern editing functions, preventing consumers from adjusting the color and shape of the contact lenses according to their preferences, hindering personalized try-ons. The absence of design sharing and incentive mechanisms fails to motivate consumer participation, resulting in a lack of interactivity and limiting the platform's contact lens pattern resources, making it difficult to balance individual consumer needs with platform activity. Summary of the Invention

[0004] To address the aforementioned technical shortcomings, the purpose of this invention is to provide an AI-powered virtual try-on method and system for colored contact lenses, enabling a complete virtual try-on process.

[0005] To achieve the above objectives, the present invention adopts the following technical solution:

[0006] An AI-powered virtual try-on method for colored contact lenses includes the following steps:

[0007] S1. After the user logs into the corresponding mini-program or application and completes the relevant authorization operation, the system obtains the user's facial information;

[0008] S2. The system performs quality analysis on the acquired facial information images or photos from the specified album, focusing on determining the quality of the eye area in the image. Based on the quality analysis results, it selectively supplements the collection of user eye information.

[0009] S3. The system processes the facial information image and displays it on the monitor;

[0010] S4. Based on the processed facial information image, the system analyzes the user's facial features and pupil color, and recommends suitable contact lens patterns;

[0011] S5. Users can select a target pattern from the recommended contact lens patterns, or edit the color, shape, and text of the contact lens pattern.

[0012] S6. After the user confirms the selection or editing, the system will fit the target contact lens pattern to the eye area of ​​the user's facial image and display the virtual try-on result.

[0013] Preferably, users can upload their own edited contact lens design to the system, which will then make the design available for other users to view, select, or further edit. Users can earn virtual points based on the number of times their design is selected and edited, and these virtual points can be used within the application.

[0014] Preferably, in step S1, the user authorizes the system to obtain the right to use the mobile phone camera, the right to access the photo album, and the right to use the microphone. After the authorization is completed, the system saves the authorization record. The user does not need to re-authorize when logging in later. The authorization operation needs to be completed again when the user revoks the authorization. The user takes a real-time picture of his / her face through the mobile phone camera or selects a specified face image from the mobile phone photo album and uploads it to the system. After receiving the face image, the system performs a preliminary screening of the image, removes images that cannot identify facial features, and retains images with recognizable facial information.

[0015] Preferably, in step S2, the system detects the clarity, illumination uniformity, and facial posture of the facial image, focusing on identifying the integrity of the eye area and the pupil recognition. When the eye area is blurry, obscured, or the pupil cannot be clearly identified, it is determined that the quality of the eye area is substandard, and the system issues a prompt and guides the user to collect additional eye information.

[0016] Preferably, in step S2, when the quality of the eye area is substandard, the system guides the user to take a close-up picture of the eye using the mobile phone camera, or to select a clear close-up picture of the eye from the album and upload it. After the supplementary collection is completed, the system judges the quality of the eye area again until eye information with satisfactory quality is obtained.

[0017] Preferably, in step S4, the system extracts the user's facial contour, eye shape features and pupil color information, establishes the matching relationship between facial features and contact lens patterns, filters out contact lens patterns that match the user's eye shape and pupil color according to the matching relationship, and presents them to the user after sorting them by the degree of matching.

[0018] Preferably, in step S5, the user can select a target color from the color library provided by the system to replace the original contact lens color, and can scale, rotate, and delete the graphic shapes on the contact lens. The user can also draw new graphic shapes and add them to the contact lens design. The edited contact lens effect is displayed in real time during the editing process.

[0019] Preferably, in step S7, the system sets the points acquisition rules. Each time a user's edited design is selected by another user, the user can obtain a preset number of virtual points. Each time the design is edited by another user, the user can obtain an additional preset number of virtual points. The points are accumulated to the user's account in real time. The user can use the virtual points to redeem related rights within the application. The virtual points cannot be withdrawn and have a preset expiration date.

[0020] An AI-powered virtual contact lens try-on system includes a user login module, an authorization module, a facial information acquisition module, an image quality analysis module, an image processing module, a contact lens recommendation module, an editing module, a fitting and display module, a scheme upload and scoring module, and a control system module. The user login module allows users to log in to a mini-program or application. The authorization module acquires and saves the user's relevant authorization information. The facial information acquisition module acquires the user's facial information and supplements it with eye information. The image quality analysis module analyzes the quality of the facial image and the eye area. The image processing module processes the facial image and displays it on a monitor. The contact lens recommendation module analyzes facial and pupil features and recommends contact lens designs. The editing module allows users to edit the color and shape of the contact lens designs. The fitting and display module fits the contact lens designs to the eyes and displays the try-on results. The scheme upload and scoring module allows users to upload design schemes and acquire and manage virtual points. The control system module is connected to each module and controls the modules to collaboratively complete the entire virtual try-on process.

[0021] Preferably, the facial information acquisition module includes a real-time shooting unit, a photo album selection unit, and a supplementary acquisition unit; the real-time shooting unit is used to control the mobile phone camera to capture facial images; the photo album selection unit is used to read facial images from the mobile phone's photo album; and the supplementary acquisition unit is used to guide the user to supplement and acquire eye information.

[0022] The scheme upload and points module includes a scheme storage unit, a points calculation unit, and a points management unit. The scheme storage unit is used to store the design schemes uploaded by users, the points calculation unit is used to calculate points based on the selection and editing status of the design schemes, and the points management unit is used to manage the accumulation, use, and validity period of user account points.

[0023] Compared with the prior art, the beneficial effects of the present invention are as follows:

[0024] The user login module works in conjunction with the authorization module to enable users to quickly log in to the mini-program or application, and at the same time complete the authorization operations for the camera, photo album, and microphone. The authorization records can be saved, eliminating the need for users to re-authorize, which not only improves the convenience of use, but also standardizes the authorization process and ensures the security of user information.

[0025] The facial information acquisition module includes a real-time shooting unit, an album selection unit, and a supplementary acquisition unit. It can flexibly acquire the user's facial information through real-time shooting or album selection. At the same time, when the quality of the eye area is not up to standard, it guides the user to supplement the acquisition of eye information to ensure that qualified facial and eye information is obtained, laying the foundation for subsequent contact lens fitting.

[0026] The image quality analysis module focuses on judging image clarity, illumination uniformity, eye area integrity, and pupil recognition. It can effectively screen out qualified images and remove images that cannot identify facial or eye features, thus avoiding the fitting deviation of colored contact lenses due to poor image quality.

[0027] The contact lens recommendation module extracts the user's facial contours, eye shape, and pupil features to establish a matching relationship between features and contact lens patterns. It then recommends contact lenses in order of matching degree, achieving accurate matching of contact lens patterns, reducing the user's screening cost, and helping the user quickly find suitable contact lenses.

[0028] The editing module allows users to adjust the color and shape of the contact lenses, and performs operations such as color replacement, image scaling, rotation, and drawing. The effect is displayed in real time during the editing process, meeting users' personalized design needs and improving the flexibility and personalization of trying on contact lenses.

[0029] The fitting display module can accurately fit the colored contact lens pattern selected or edited by the user to the eye area of ​​the facial image, restoring the real wearing state, allowing users to intuitively preview the wearing effect, assisting users to make a quick purchase decision, and reducing the difficulty of decision-making.

[0030] The design upload and points module allows users to upload their own edited contact lens designs, which can then be viewed, selected, or edited by other users. Virtual points are calculated based on the number of times a design is selected and edited, which not only motivates users to participate in design and sharing but also enriches the platform's contact lens image resources and enhances user engagement.

[0031] The control system module coordinates the collaborative work of all functional modules to ensure smooth operation of the entire process, including user login, authorization, image acquisition, quality analysis, recommendation editing, fitting display, scheme uploading, and score statistics, thereby improving the overall stability and usability of the system. Attached Figure Description

[0032] Figure 1 This is a flowchart of the method of the present invention;

[0033] Figure 2 This is a structural block diagram of the system of the present invention;

[0034] Figure 3 This is a virtual try-on effect image of AI-powered colored contact lenses. Detailed Implementation

[0035] The invention will now be further described with reference to the accompanying drawings.

[0036] like Figure 1 , Figure 3 As shown, an AI-powered virtual try-on method for colored contact lenses includes the following steps:

[0037] S1. The user logs in to the corresponding mini-program or application and completes the relevant authorization operations:

[0038] The user authorizes the system to obtain the right to use the phone's camera, album, and microphone. After the authorization is completed, the system saves the authorization record. The user does not need to re-authorize when logging in later. The authorization operation needs to be completed again when the user revoks the authorization.

[0039] The system obtains the user's facial information:

[0040] Users can capture their own facial images in real time using their mobile phone camera, or select a specific facial image from their mobile phone album and upload it to the system. After receiving the facial images, the system will perform a preliminary screening, removing images that cannot identify facial features and retaining images with recognizable facial information.

[0041] S2. The system performs quality analysis on facial information images from the acquired or specified albums, focusing on determining the quality of the eye area in the image:

[0042] The system detects the clarity, lighting uniformity, and facial posture of facial images, with a focus on identifying the integrity of the eye area and the pupil's recognizability. When the eye area is blurry, obscured, or the pupil cannot be clearly identified, it is determined that the quality of the eye area is substandard, and the system issues a prompt and guides the user to collect additional eye information.

[0043] Based on the quality analysis results, selectively supplement the collection of user eye information:

[0044] When the quality of the eye area is not up to standard, the system guides the user to take a close-up picture of the eye with the mobile phone camera, or select a clear close-up picture of the eye from the album and upload it. After the supplementary collection is completed, the system will judge the quality of the eye area again until the eye information that meets the quality standard is obtained.

[0045] S3. The system processes the facial information image and displays it on the monitor;

[0046] S4. Based on the processed facial information image, the system analyzes the user's facial features and pupil color, and recommends suitable contact lens patterns:

[0047] The system extracts information about the user's facial contours, eye shape features, and natural pupil color, establishes a matching relationship between facial features and contact lens patterns, filters out contact lens patterns that match the user's eye shape and pupil color based on the matching relationship, and presents them to the user in order of matching degree.

[0048] S5. Users can select a target pattern from the recommended contact lens designs, or edit the color, shape, and graphics of the contact lens design:

[0049] Users can select a target color from the color library provided by the system to replace the original contact lens color. They can also scale, rotate, and delete the graphic shapes on the contact lenses, and draw new graphic shapes to add to the contact lens design. The effect of the edited contact lenses is displayed in real time during the editing process.

[0050] S6. After the user confirms the selection or editing, the system will fit the target contact lens pattern to the eye area of ​​the user's facial image and display the virtual try-on result.

[0051] Users can upload their edited contact lens designs to the system, which then makes these designs available for other users to view, select, or further edit. Users can earn virtual points based on the number of times their designs are selected and edited; these virtual points are used within the application.

[0052] The system sets rules for earning points. Each time a user's edited design is selected by another user, the user earns a preset number of virtual points. Each time the design is edited by another user, the user earns an additional preset number of virtual points. Points are accumulated in real time to the user's account. Users can use virtual points to redeem related benefits within the application. Virtual points cannot be withdrawn and have a preset expiration date.

[0053] like Figure 2As shown, an AI-powered virtual contact lens try-on system includes a user login module, an authorization module, a facial information acquisition module, an image quality analysis module, an image processing module, a contact lens recommendation module, an editing module, a fitting and display module, a scheme upload and scoring module, and a control system module. The user login module allows users to log in to a mini-program or application. The authorization module acquires and saves the user's relevant authorization information. The facial information acquisition module acquires the user's facial information and supplements it with eye information. The image quality analysis module analyzes the quality of the facial image and the eye area. The image processing module processes the facial image and displays it on a monitor. The contact lens recommendation module analyzes facial and pupil features and recommends contact lens designs. The editing module allows users to edit the color and shape of the contact lens designs. The fitting and display module fits the contact lens designs to the eyes and displays the try-on results. The scheme upload and scoring module allows users to upload design schemes and acquire and manage virtual points. The control system module is connected to each module and controls the modules to collaboratively complete the entire virtual try-on process.

[0054] Furthermore, the facial information acquisition module includes a real-time shooting unit, an album selection unit, and a supplementary acquisition unit; the real-time shooting unit is used to control the mobile phone camera to capture facial images; the album selection unit is used to read facial images from the mobile phone's album; and the supplementary acquisition unit is used to guide the user to supplement and acquire eye information.

[0055] The design upload and points module includes a design storage unit, a points calculation unit, and a points management unit. The design storage unit stores user-uploaded design designs, the points calculation unit calculates points based on the selection and editing status of the design designs, and the points management unit manages the accumulation, use, and validity period of user account points.

[0056] Example 1

[0057] This example applies to a scenario where a user is using the AI-powered virtual try-on function for colored contact lenses for the first time. The specific process is as follows:

[0058] Users open the corresponding application and log in to their account through the user login module. After logging in, the authorization module displays an authorization prompt, guiding the user to authorize the system to use the phone's camera, photo album, and microphone. After the user completes all authorizations, the authorization module saves the authorization record for direct use during subsequent logins.

[0059] Users control their phone's camera to capture real-time facial images via the facial information acquisition module's real-time shooting unit. After receiving the images, the system performs initial screening, retaining only those with identifiable facial features. The image quality analysis module then analyzes the facial image, checking image sharpness, lighting uniformity, and facial posture, with a focus on determining the integrity of the eye area and pupil clarity. If the eye area is slightly blurred or the pupil clarity is insufficient due to the shooting angle, the system determines that the eye area quality is substandard, issues a prompt, and guides the user to collect additional eye information.

[0060] The user uses the supplementary acquisition unit to control the phone's camera to capture close-up images of the eyes. After the supplementary acquisition is completed, the image quality analysis module performs another quality assessment to confirm that the eye area meets the quality standards. The image processing module integrates the processed facial information image and the close-up eye image, removes redundant image information, adjusts the image display ratio, and then clearly displays the processed facial image on the phone's screen.

[0061] The contact lens recommendation module extracts information about the user's facial contours, eye shape, and natural pupil color to establish a matching relationship between facial features and contact lens designs. It then filters out contact lens designs that match the user's eye shape and pupil color, presenting them to the user in descending order of compatibility. Users browse the recommended designs, select a favorite, and use the editing module to choose a target color from the system's color library to replace the original contact lens color. No adjustments are made to the shape or text of the design. The edited effect is displayed in real-time on the monitor.

[0062] After the user confirms the edits, the fitting and display module accurately fits the edited target contact lens pattern to the eye area of ​​the facial image, adjusting the pattern size and angle to ensure a natural fit. The complete virtual try-on result is then displayed on the monitor, allowing the user to view the effect from multiple angles to make a selection. After the try-on is complete, the user uploads their edited contact lens design to the system via the scheme upload and points module. The system saves the design in the scheme storage unit and makes it available for other users to view, select, or edit. Users wait for other users to interact to earn virtual points, which can be used to redeem benefits within the application.

[0063] Example 2

[0064] This embodiment is applied to scenarios where users are not using the product for the first time and need to perform complex editing of the contact lens pattern and obtain virtual points. The specific process is as follows:

[0065] When a user opens the corresponding application and logs in to their account through the user login module, since the user has already authorized the account, the authorization module directly calls the saved authorization record, eliminating the need for the user to authorize the account again.

[0066] Users select a clear facial image from their phone's photo album using the album selection unit of the facial information acquisition module and upload it to the system. After initial screening, the system confirms that the image can identify facial features. The image quality analysis module performs quality analysis on the facial image and finds that the image clarity, lighting uniformity, and facial posture all meet the requirements. The eye area is complete, and the pupils are highly recognizable, so the quality of the eye area is deemed satisfactory, and no additional eye information needs to be collected.

[0067] The image processing module processes the facial image, adjusting its brightness and contrast, removing impurities, and then displays the processed image on the phone's screen. The contact lens recommendation module extracts the user's facial contours, eye shape features, and natural pupil color information, filters suitable contact lens designs, and presents them in order of suitability. If the user cannot find a design they completely like after browsing, they can select a basic contact lens design to enter the editing interface.

[0068] Users can perform complex edits on the contact lens design through the editing module, select two colors from the color library to create a gradient, replace the original contact lens color, scale and rotate the graphic shapes on the contact lens, and draw new simple graphic shapes to add to the contact lens design. The editing effect is displayed in real time on the monitor during the editing process, and the user can complete the editing operation after making multiple adjustments.

[0069] Once the user confirms the editing is complete, the fitting and display module fits the edited contact lens pattern to the eye area of ​​the facial image, displaying a virtual try-on result. After the user reviews and confirms satisfaction, they upload the design scheme to the system via the scheme upload and points module. After the system makes the design scheme available, multiple other users view and select it. Some users further edit the scheme. The points calculation unit of the scheme upload and points module calculates virtual points according to preset rules based on the number of times the design scheme has been selected and edited. The points management unit accumulates the points in real time to the user's account. The user can use these points to redeem related benefits within the application. The points have a preset validity period set according to system rules.

Claims

1. An AI-powered virtual try-on method for colored contact lenses, characterized in that, Includes the following steps: S1. After the user logs into the corresponding mini-program or application and completes the relevant authorization operation, the system obtains the user's facial information; S2. The system performs quality analysis on the acquired facial information images or photos from the specified album, focusing on determining the quality of the eye area in the image. Based on the quality analysis results, it selectively supplements the collection of user eye information. S3. The system processes the facial information image and displays it on the monitor; S4. Based on the processed facial information image, the system analyzes the user's facial features and pupil color, and recommends suitable contact lens patterns; S5. Users can select a target pattern from the recommended contact lens patterns, or edit the color, shape, and text of the contact lens pattern. S6. After the user confirms the selection or editing, the system will fit the target contact lens pattern to the eye area of ​​the user's facial image and display the virtual try-on result.

2. The AI-powered virtual try-on method for colored contact lenses as described in claim 1, characterized in that, Users can upload their own edited contact lens designs to the system, which will then make the designs available for other users to view, select, or further edit. Users can earn virtual points based on the number of times their designs are selected and edited, and these virtual points can be used within the application.

3. The AI-powered virtual try-on method for colored contact lenses as described in claim 1, characterized in that, In step S1, the user authorizes the system to obtain the right to use the mobile phone camera, access the photo album, and use the microphone. After the authorization is completed, the system saves the authorization record. The user does not need to re-authorize when logging in later. The authorization operation needs to be completed again when the user revoks the authorization. The user takes a real-time picture of his / her face through the mobile phone camera or selects a specified face image from the mobile phone album and uploads it to the system. After receiving the face image, the system performs a preliminary screening of the image, removing images with unrecognizable facial features and retaining images with recognizable facial information.

4. The AI-powered virtual try-on method for colored contact lenses as described in claim 1, characterized in that, In step S2, the system detects the clarity, illumination uniformity, and facial posture of the facial image, focusing on identifying the integrity of the eye area and the pupil recognition. When the eye area is blurry, obscured, or the pupil cannot be clearly identified, it is determined that the quality of the eye area is substandard, and the system issues a prompt and guides the user to collect additional eye information.

5. The AI-powered virtual try-on method for colored contact lenses as described in claim 1, characterized in that, In step S2, when the quality of the eye area is not up to standard, the system guides the user to take a close-up picture of the eye using the mobile phone camera, or select a clear close-up picture of the eye from the album and upload it. After the supplementary collection is completed, the system will judge the quality of the eye area again until the eye information that meets the quality standard is obtained.

6. The AI-powered virtual try-on method for colored contact lenses as described in claim 1, characterized in that, In step S4, the system extracts the user's facial contour, eye shape features, and natural pupil color information, establishes the adaptation relationship between facial features and contact lens patterns, filters out contact lens patterns that match the user's eye shape and pupil color based on the adaptation relationship, and presents them to the user after sorting them by the degree of adaptation.

7. The AI-powered virtual try-on method for colored contact lenses as described in claim 1, characterized in that, In step S5, the user can select a target color from the color library provided by the system to replace the original contact lens color. The user can also scale, rotate, and delete the graphic shapes on the contact lens, or draw new graphic shapes to add to the contact lens design. The edited contact lens effect is displayed in real time during the editing process.

8. The AI-powered virtual try-on method for colored contact lenses as described in claim 1, characterized in that, In step S7, the system sets the rules for earning points. Each time a user's edited design is selected by another user, the user can earn a preset number of virtual points. Each time a user edits a design, the user can earn an additional preset number of virtual points. Points are accumulated in real time to the user's account. Users can use virtual points to redeem related benefits within the application. Virtual points cannot be withdrawn and have a preset expiration date.

9. An AI-powered virtual try-on system for colored contact lenses, used to perform the method described in any one of claims 1 to 8, characterized in that, The system includes a user login module, an authorization module, a facial information acquisition module, an image quality analysis module, an image processing module, a colored contact lens recommendation module, an editing module, a fitting and display module, a scheme upload and scoring module, and a control system module. The user login module allows users to log in to the mini-program or application. The authorization module acquires and saves the user's relevant authorization information. The facial information acquisition module acquires the user's facial information and supplements it with eye information. The image quality analysis module analyzes the quality of facial images and the quality of the eye area. The image processing module processes facial images and displays them on the monitor. The colored contact lens recommendation module analyzes facial and pupil features and recommends colored contact lens designs. The editing module allows users to edit the color and shape of the colored contact lens designs. The fitting and display module fits the colored contact lens designs to the eyes and displays the trial results. The scheme upload and scoring module allows users to upload design schemes and acquire and manage virtual points. The control system module connects to each module and controls the modules to collaboratively complete the entire virtual trial process.

10. The AI-powered virtual try-on system for colored contact lenses as described in claim 9, characterized in that, The facial information acquisition module includes a real-time shooting unit, a photo album selection unit, and a supplementary acquisition unit; the real-time shooting unit is used to control the mobile phone camera to capture facial images; the photo album selection unit is used to read facial images from the mobile phone's photo album; and the supplementary acquisition unit is used to guide the user to supplement and acquire eye information. The scheme upload and points module includes a scheme storage unit, a points calculation unit, and a points management unit; the scheme storage unit is used to store the design schemes uploaded by users, and the points calculation unit is used to calculate points based on whether the design schemes are selected or edited; The points management unit is used to manage the accumulation, use, and validity period of user account points.

Images