Contact lens fitting method and system based on multi-modal data and remote diagnosis and treatment

Abstract

The invention provides a contact lens fitting method and system based on multi-modal data and remote diagnosis and treatment, and the method comprises the steps: carrying out the eye examination of a user based on remote diagnosis and treatment, and obtaining an examination result; based on a preset eye disease database, according to the examination result, determining an eye disease result; the examination result and the eye disease result are pushed to an online doctor for rechecking; determining a contact lens fitting scheme based on the multi-modal data of the examination result and the eye disease result after the online doctor rechecks; and carrying out corresponding contact lens fitting assistance on the user based on the contact lens fitting scheme. According to the method, the user is helped to perform more accurate and personalized contact lens fitting, the condition of improper fitting is avoided, in addition, the eye disease database is introduced to assist experts in performing eye disease results, and the contact lens fitting efficiency is improved.

Description

Technical Field

[0001] The present invention relates to the field of remote interaction technology, and in particular to a contact lens fitting method and system based on multimodal data and remote diagnosis and treatment. Background Art

[0002] Contact lens fitting is a highly personalized process involving multiple factors, including refraction, corneal curvature, and intraocular pressure, and requires precise assessment by a professional physician. However, most contact lens fitting currently relies on traditional offline clinics and outpatient clinics. Limited by physician experience, the accuracy and degree of personalization of fitting are limited, and inappropriate fitting often occurs, causing discomfort to the wearer and even affecting eye health.

[0003] In addition, when professional doctors conduct accurate assessments, they rely entirely on their own analysis, which may reduce the efficiency of contact lens fitting.

[0004] Therefore, a solution is urgently needed. Summary of the Invention

[0005] One of the purposes of the present invention is to provide a contact lens fitting method based on multimodal data and remote diagnosis and treatment. Based on remote diagnosis and treatment, the user's eyes are examined to obtain the examination results. Based on the preset eye disease database, the eye disease results are determined according to the examination results. The examination results and the eye disease results need to be reviewed by the online doctor before being used to determine the contact lens fitting plan. Finally, based on the determined contact lens fitting plan, the user is assisted in corresponding contact lens fitting to help the user to perform more accurate and personalized contact lens fitting and avoid inappropriate fitting. In addition, the eye disease database is introduced to assist experts in correcting the shortcomings of eye disease results and improve the efficiency of contact lens fitting.

[0006] The contact lens fitting method based on multimodal data and remote diagnosis and treatment provided by an embodiment of the present invention includes:

[0007] Based on remote diagnosis and treatment, the user's eyes are examined and the examination results are obtained;

[0008] Based on the preset eye disease database and the examination results, the eye disease results are determined;

[0009] Push the examination results and eye disease results to the online doctor for review;

[0010] Determine contact lens fitting plans based on examination results reviewed by online doctors and multimodal data on eye disease outcomes;

[0011] Based on the contact lens fitting plan, users are provided with corresponding contact lens fitting assistance.

[0012] Optionally, the remote diagnosis and treatment-based eye examination of the user and obtaining the examination results may include:

[0013] Based on remote diagnosis and treatment, users can be examined for eye health and pathology, including at least: conjunctivitis, keratitis, dry eyes, corneal curvature, and tear film stability;

[0014] as well as,

[0015] Based on remote diagnosis and treatment, users are given standard eye examinations, which include at least: corneal diameter, pupil diameter, and refractive power.

[0016] Optionally, determining the eye disease result based on a preset eye disease database and the examination result includes:

[0017] Matching the examination results with multiple eye disease data in the eye disease database respectively and in sequence;

[0018] When the match is confirmed, the eye disease information represented by the matched eye disease data is used as the eye disease result.

[0019] Optionally, determining a contact lens fitting plan based on the examination results reviewed by the online doctor and the multimodal data of the eye disease results includes:

[0020] Based on the pre-trained contact lens fitting plan determination model, the contact lens fitting plan is determined according to the examination results and eye disease results reviewed by the online doctor.

[0021] Optionally, providing corresponding contact lens fitting assistance to the user based on the contact lens fitting plan includes:

[0022] Analyze the fitting parameters of contact lens fitting plans;

[0023] Assist users to customize contact lens styles that meet fitting parameters.

[0024] Optionally, the method of assisting the user in customizing the style of contact lenses that meet fitting parameters includes:

[0025] Generate a style window constraint sequence based on the user's contact lens style requirements;

[0026] Based on the style window constraint sequence, the user is shown multiple movements of the style window on the contact lens style layout; wherein, after the i-th movement, the style window on the contact lens style layout complies with the i-th style window constraint in the style window constraint sequence; after each movement of the style window, when the user inputs a continue movement instruction, the next movement is performed;

[0027] In the process of demonstrating to the user that the style window is moved multiple times on the contact lens style layout, when the user actively drags the style window after the j-th movement, the style window after the j-th movement is divided into four equal-sized partitions in four directions;

[0028] The partition in the opposite direction of the pre-processed direction of the user's most recent active drag is used as the target partition; wherein the pre-processed direction is the larger of the vertical component and the horizontal component of the active drag direction;

[0029] When more than a threshold number of contact lens styles are newly entered into the target partition and the duration of each entry exceeds a threshold, an expansion style constraint is determined based on the original contact lens styles in the target partition and the newly entered contact lens styles;

[0030] Match multiple extended contact lens styles based on extended style constraints;

[0031] The expanded contact lens styles are used to replace the peripheral contact lens styles on the contact lens style layout that are located in the direction of the user's most recent active drag in the style window after the jth movement after the user's active drag, and the user is guided to continue actively dragging in the direction of the most recent active drag.

[0032] Optionally, generating a style window constraint sequence based on the user's contact lens style requirements includes:

[0033] Determine the maximum number of stages based on the demand for contact lens styles;

[0034] Generate multiple style window constraints based on contact lens style requirements;

[0035] Divide each style window constraint into a sequence to be spliced with a limit number of stages;

[0036] Each sequence to be spliced is spliced to obtain a style window constraint sequence; wherein, each style window constraint in each sequence to be spliced makes the conformity of the contact lens style in the style window to the contact lens style requirements increase in sequence; the maximum conformity of the former in each pair of sequences to be spliced in the style window constraint sequence does not exceed that of the latter, and the maximum conformity is the maximum value of the conformity of the style window constraints in the sequence to be spliced that makes the contact lens style in the style window conform to the contact lens style requirements.

[0037] The contact lens fitting system based on multimodal data and remote diagnosis and treatment provided by an embodiment of the present invention includes:

[0038] An examination module is used to perform eye examinations on users based on remote diagnosis and treatment and obtain examination results;

[0039] A first determination module is used to determine the eye disease result based on the preset eye disease database and the examination result;

[0040] Review module, used to push examination results and eye disease results to online doctors for review;

[0041] The second determination module is used to determine a contact lens fitting plan based on the examination results reviewed by the online doctor and the multimodal data of the eye disease results;

[0042] The auxiliary module is used to provide users with corresponding contact lens fitting assistance based on the contact lens fitting plan.

[0043] Optionally, the examination module performs an eye examination on the user based on remote diagnosis and treatment, and obtains the examination results, including:

[0044] Based on remote diagnosis and treatment, users can be examined for eye health and pathology, including at least: conjunctivitis, keratitis, dry eyes, corneal curvature, and tear film stability;

[0045] as well as,

[0046] Based on remote diagnosis and treatment, users are given standard eye examinations, which include at least: corneal diameter, pupil diameter, and refractive power.

[0047] Optionally, the first determining module determines the eye disease result based on a preset eye disease database and the examination result, including:

[0048] Matching the examination results with multiple eye disease data in the eye disease database respectively and in sequence;

[0049] When the match is confirmed, the eye disease information represented by the matched eye disease data is used as the eye disease result.

[0050] Optionally, the second determination module determines a contact lens fitting plan based on the examination results reviewed by the online doctor and the multimodal data of the eye disease results, including:

[0051] Based on the pre-trained contact lens fitting plan determination model, the contact lens fitting plan is determined according to the examination results and eye disease results reviewed by the online doctor.

[0052] Optionally, the auxiliary module provides corresponding contact lens fitting assistance to the user based on the contact lens fitting plan, including:

[0053] Analyze the fitting parameters of contact lens fitting plans;

[0054] Assist users to customize contact lens styles that meet fitting parameters.

[0055] Optionally, the method of assisting the user in customizing the style of contact lenses that meet fitting parameters includes:

[0056] Generate a style window constraint sequence based on the user's contact lens style requirements;

[0057] Based on the style window constraint sequence, the user is shown multiple movements of the style window on the contact lens style layout; wherein, after the i-th movement, the style window on the contact lens style layout complies with the i-th style window constraint in the style window constraint sequence; after each movement of the style window, when the user inputs a continue movement instruction, the next movement is performed;

[0058] In the process of demonstrating to the user that the style window is moved multiple times on the contact lens style layout, when the user actively drags the style window after the j-th movement, the style window after the j-th movement is divided into four equal-sized partitions in four directions;

[0059] The partition in the opposite direction of the pre-processed direction of the user's most recent active drag is used as the target partition; wherein the pre-processed direction is the larger of the vertical component and the horizontal component of the active drag direction;

[0060] When more than a threshold number of contact lens styles are newly entered into the target partition and the duration of each entry exceeds a threshold, an expansion style constraint is determined based on the original contact lens styles in the target partition and the newly entered contact lens styles;

[0061] Match multiple extended contact lens styles based on extended style constraints;

[0062] The expanded contact lens styles are used to replace the peripheral contact lens styles on the contact lens style layout that are located in the direction of the user's most recent active drag in the style window after the jth movement after the user's active drag, and the user is guided to continue actively dragging in the direction of the most recent active drag.

[0063] Optionally, generating a style window constraint sequence based on the user's contact lens style requirements includes:

[0064] Determine the maximum number of stages based on the demand for contact lens styles;

[0065] Generate multiple style window constraints based on contact lens style requirements;

[0066] Divide each style window constraint into a sequence to be spliced with a limit number of stages;

[0067] Each sequence to be spliced is spliced to obtain a style window constraint sequence; wherein, each style window constraint in each sequence to be spliced makes the conformity of the contact lens style in the style window to the contact lens style requirements increase in sequence; the maximum conformity of the former in each pair of sequences to be spliced in the style window constraint sequence does not exceed that of the latter, and the maximum conformity is the maximum value of the conformity of the style window constraints in the sequence to be spliced that makes the contact lens style in the style window conform to the contact lens style requirements.

[0068] Other features and advantages of the present invention will be described in the following description, and in part will become apparent from the description, or will be understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures particularly pointed out in the written description and the accompanying drawings.

[0069] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0070] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0071] Figure 1 is a schematic diagram of a contact lens fitting method based on multimodal data and remote diagnosis and treatment in an embodiment of the present invention;

[0072] Figure 2 Schematic diagram of a contact lens fitting system based on multimodal data and remote diagnosis and treatment in an embodiment of the present invention. DETAILED DESCRIPTION

[0073] The preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0074] The embodiment of the present invention provides a contact lens fitting method based on multimodal data and remote diagnosis and treatment, such as Figure 1 Shown, including:

[0075] S1. Based on remote diagnosis and treatment, perform eye examination on the user and obtain the examination results;

[0076] S2. determining the eye disease result based on the preset eye disease database and the examination results;

[0077] S3. Push the examination results and eye disease results to the online doctor for review;

[0078] S4. Determine the contact lens fitting plan based on the examination results reviewed by the online doctor and the multimodal data of eye disease results;

[0079] S5. Provide corresponding contact lens fitting assistance to the user based on the contact lens fitting plan;

[0080] The remote diagnosis and treatment-based eye examination of the user and obtaining the examination results include:

[0081] Based on remote diagnosis and treatment, users can be examined for eye health and pathology, including at least: conjunctivitis, keratitis, dry eyes, corneal curvature, and tear film stability;

[0082] as well as,

[0083] Based on remote diagnosis and treatment, users are given standard eye examinations, which include at least: corneal diameter, pupil diameter, and refractive power.

[0084] Users can go to offline clinics and outpatient clinics, and then connect with professional doctors remotely. Under the guidance of professional doctors, they use eye examination instruments to conduct eye examinations, obtain examination results, and realize remote diagnosis and treatment. There is a large amount of eye disease data in the eye disease database, based on which the eye disease results can be determined according to the examination results. The examination results and eye disease results need to be reviewed by the online doctor before being used to determine the contact lens fitting plan. The multimodal data based on the examination results and eye disease results after the online doctor’s review are the examination results and multiple types of data in the eye disease results after the online doctor’s review. Finally, based on the determined contact lens fitting plan, the user is assisted in the corresponding contact lens fitting. Eye examinations include eye health, pathology examinations, and standard optometry examinations.

[0085] This application is based on remote diagnosis and treatment, and performs eye examinations on users to obtain examination results. Based on the preset eye disease database, the eye disease results are determined according to the examination results. The examination results and eye disease results need to be reviewed by the online doctor before being used to determine the contact lens fitting plan. Finally, based on the determined contact lens fitting plan, the user is provided with corresponding contact lens fitting assistance to help the user to perform more accurate and personalized contact lens fitting and avoid inappropriate fitting. In addition, the eye disease database is introduced to assist experts in correcting the shortcomings of eye disease results and improve the efficiency of contact lens fitting.

[0086] In one embodiment, determining the eye disease result based on the examination results based on a preset eye disease database includes:

[0087] Matching the examination results with multiple eye disease data in the eye disease database respectively and in sequence;

[0088] When the match is confirmed, the eye disease information represented by the matched eye disease data is used as the eye disease result.

[0089] When using the eye disease database, the examination results are matched with the eye disease data therein. When matched, the eye disease data will represent the eye disease information and the eye disease results from last night will be matched; the eye disease information includes the type of eye disease, etc.

[0090] In one embodiment, determining a contact lens fitting plan based on the examination results reviewed by the online doctor and the multimodal data of the eye disease results includes:

[0091] Based on the pre-trained contact lens fitting plan determination model, the contact lens fitting plan is determined according to the examination results and eye disease results reviewed by the online doctor.

[0092] The contact lens fitting plan determination model is an artificial intelligence model that uses a large number of examination results and eye disease results marked with contact lens fitting plans as training samples for machine learning training until convergence. It can automatically determine the contact lens fitting plan based on the examination results and eye disease results reviewed by online doctors.

[0093] In particular, in the traditional contact lens fitting process, after determining the fitting parameters, users usually need to flip through a thick style album to select their favorite contact lens style. However, this method is very cumbersome and inefficient. The album contains a large number of styles, with different colors, patterns, and lens types. Users are often confused by the large number of choices and find it difficult to quickly find the right style. For example, a user may spend a lot of time flipping through the album, but still cannot determine whether a certain contact lens is suitable for their eye shape and daily needs, such as whether it is suitable for long-term wear or whether it meets their style preferences. This selection process is not only time-consuming, but may also lead to decision-making difficulties due to the inability to intuitively experience the wearing effect, affecting the user's overall experience. Therefore, the traditional selection method is particularly inefficient and inconvenient, and there is an urgent need to find a more convenient and intelligent alternative.

[0094] Therefore, in one embodiment, providing corresponding contact lens fitting assistance to the user based on the contact lens fitting plan includes:

[0095] Analyze the fitting parameters of contact lens fitting plan; fitting parameters include at least: eyeball diameter, refractive power, etc.;

[0096] Assist users to customize contact lens styles that meet fitting parameters.

[0097] It helps users customize contact lens styles that meet fitting parameters, improves the convenience of users choosing contact lens styles, avoids wasting too much time, and is more intelligent.

[0098] Specifically, the method of assisting the user in customizing the style of contact lenses that meet the fitting parameters includes:

[0099] Generate a style window constraint sequence based on the user's contact lens style requirements;

[0100] Based on the style window constraint sequence, the user is shown multiple movements of the style window on the contact lens style layout; wherein, after the i-th movement, the style window on the contact lens style layout complies with the i-th style window constraint in the style window constraint sequence; after each movement of the style window, when the user inputs a continue movement instruction, the next movement is performed;

[0101] In the process of demonstrating to the user that the style window is moved multiple times on the contact lens style layout, when the user actively drags the style window after the j-th movement, the style window after the j-th movement is divided into four equal-sized partitions in four directions;

[0102] The partition in the opposite direction of the pre-processed direction of the user's most recent active drag is used as the target partition; wherein the pre-processed direction is the larger of the vertical component and the horizontal component of the active drag direction;

[0103] When more than a threshold number of contact lens styles are newly entered into the target partition and the duration of each entry exceeds a threshold, an expansion style constraint is determined based on the original contact lens styles in the target partition and the newly entered contact lens styles;

[0104] Match multiple extended contact lens styles based on extended style constraints;

[0105] The expanded contact lens styles are used to replace the peripheral contact lens styles on the contact lens style layout that are located in the direction of the user's most recent active drag in the style window after the jth movement after the user's active drag, and the user is guided to continue actively dragging in the direction of the most recent active drag.

[0106] The contact lens style layout is a virtual plan containing a large number of contact lens styles, in which the closer the contact lens styles are, the closer they are arranged; the style window is a window for viewing multiple contact lens styles locally on the contact lens style layout. When the style window moves, the user can only view the contact lens styles contained in the style window; the style window constraint sequence is used to constrain the movement process of the style window. Specifically, the style window after the i-th movement meets the i-th style window constraint in the style window constraint sequence on the contact lens style layout. When the user inputs the continue movement instruction (indicating that there is no contact lens style that the user likes in the current style window), the next movement is performed.

[0107] Equally sized partitions refer to the semicircular areas within the style window, drawn with the top, bottom, left, and right sides of the style window as their diameters. When demonstrating multiple movements of the style window on the contact lens style layout, the user may actively drag the moved style window, indicating a particular interest in the contact lens styles within the current style window. Since similar contact lens styles within the contact lens style layout are arranged closer together, the user, aware of this, will explore other contact lens styles that are similar to the one they are interested in. Therefore, the partition in the direction opposite to the pre-processed direction of the user's most recent active drag represents the area of contact lens style interest reflected by the user's active drag.

[0108] The number threshold can be 10, and the duration threshold can be 15 seconds. After the style window is actively dragged, new contact lens styles will enter the target partition. When the number of newly entered contact lens styles in the target partition exceeds the number threshold and the duration of each entry exceeds the duration threshold, it further indicates that the target partition is the contact lens style area of interest reflected by the user's active drag. Based on the original contact lens styles and the newly entered contact lens styles in the target partition, an extended style constraint is determined, and multiple extended contact lens styles are matched based on it. The extended style constraint can be other contact lens styles that are similar in style to the original contact lens styles and the newly entered contact lens styles, or a combination of the original contact lens styles and the newly entered contact lens styles. The peripheral contact lens styles are the contact lens styles in the outer circle of the style window in the direction of the user's most recent active drag after the jth movement after the user's active drag. After replacing them with extended contact lens styles, if the user continues to actively drag in the direction of the most recent active drag, the extended contact lens styles will immediately enter the target partition. The user may immediately have a liking for the extended contact lens styles and make a quick selection. When the user actively drags to search, he or she may not be able to find the contact lens style he or she wants. The embodiment of the present invention actively determines and expands the contact lens styles to improve the selection efficiency.

[0109] The embodiment of the present invention generates a style window constraint sequence according to the user's contact lens style needs, and through multiple moving demonstrations of style windows, can help users gradually find their favorite styles; when the user actively drags the style window and shows interest in a certain style, the system can intelligently identify the user's area of interest, i.e., the target partition, and determine whether to further expand the style recommendation by analyzing the direction of the user's dragging and the contact lens styles newly entering the target partition. Based on the expanded style constraints, similar or related contact lens styles are recommended, thereby avoiding repeated screening and dragging, improving the accuracy and suitability of the timing of expanded style recommendations, significantly improving the efficiency and accuracy of user selection, and avoiding the waste of time in blind screening.

[0110] In one embodiment, generating a style window constraint sequence based on the user's contact lens style requirements includes:

[0111] Determine the maximum number of stages based on the demand for contact lens styles;

[0112] Generate multiple style window constraints based on contact lens style requirements;

[0113] Divide each style window constraint into a sequence to be spliced with a limit number of stages;

[0114] Each sequence to be spliced is spliced to obtain a style window constraint sequence; wherein, each style window constraint in each sequence to be spliced makes the conformity of the contact lens style in the style window to the contact lens style requirements increase in sequence; the maximum conformity of the former in each pair of sequences to be spliced in the style window constraint sequence does not exceed that of the latter, and the maximum conformity is the maximum value of the conformity of the style window constraints in the sequence to be spliced that makes the contact lens style in the style window conform to the contact lens style requirements.

[0115] The number of stage limits is positively correlated with the complexity of the contact lens style requirements. The more complex the contact lens style requirements are, the more stages of continuous style recommendation are required; each style window constraint makes the contact lens styles in the style window meet the contact lens style requirements at different levels; setting each style window constraint in each sequence to be spliced makes the contact lens styles in the style window meet the contact lens style requirements at increasing levels, and the maximum degree of conformity of the former in each sequence to be spliced in the style window constraint sequence does not exceed the latter, and the maximum degree of conformity is the maximum value of the degrees of conformity of the contact lens styles in the style window in the sequence to be spliced that make the contact lens styles in the style window meet the contact lens style requirements, so that each sequence to be spliced can be a recommendation stage that gradually meets the user's contact lens style requirements, and multiple recommendation stages will eventually become more and more consistent, and contact lens styles are recommended to users step by step through the movement of the style window.

[0116] The embodiments of the present invention can effectively enhance the user experience through a phased, incremental recommendation approach. The degree of conformity in each recommendation phase gradually increases, allowing users to gradually find the contact lens style that best meets their needs among multiple recommendations, avoiding information overload and difficulty in selection. This progressive recommendation model can dynamically adjust the number of recommendation stages based on the complexity of the needs, ensuring that users with complex needs receive more accurate recommendations. In addition, by ensuring the incremental increase in the degree of conformity in each phase and the reasonable connection between the degrees of conformity in the previous and subsequent phases, the system not only improves the accuracy of recommendations, but also enhances the user's trust and satisfaction, ultimately achieving the goal of gradual optimization and accurate recommendations.

[0117] An embodiment of the present invention provides a contact lens fitting system based on multimodal data and remote diagnosis and treatment, including:

[0118] Examination module 1, used to perform eye examination on the user based on remote diagnosis and treatment and obtain examination results;

[0119] A first determination module 2 is configured to determine an eye disease result based on a preset eye disease database and the examination result;

[0120] Review module 3, used to push the examination results and eye disease results to the online doctor for review;

[0121] A second determination module 4 is configured to determine a contact lens fitting plan based on the examination results reviewed by the online doctor and the multimodal data of the eye disease results;

[0122] The auxiliary module 5 is used to provide corresponding contact lens fitting assistance to the user based on the contact lens fitting plan.

[0123] The inspection module performs an eye inspection on the user based on remote diagnosis and treatment, and obtains the inspection results, including:

[0124] Based on remote diagnosis and treatment, users can be examined for eye health and pathology, including at least: conjunctivitis, keratitis, dry eyes, corneal curvature, and tear film stability;

[0125] as well as,

[0126] Based on remote diagnosis and treatment, users are given standard eye examinations, which include at least: corneal diameter, pupil diameter, and refractive power.

[0127] The first determination module determines the eye disease result based on the preset eye disease database and the examination result, including:

[0128] Matching the examination results with multiple eye disease data in the eye disease database respectively and in sequence;

[0129] When the match is confirmed, the eye disease information represented by the matched eye disease data is used as the eye disease result.

[0130] The second determination module determines a contact lens fitting plan based on the examination results reviewed by the online doctor and the multimodal data of the eye disease results, including:

[0131] Based on the pre-trained contact lens fitting plan determination model, the contact lens fitting plan is determined according to the examination results and eye disease results reviewed by the online doctor.

[0132] The auxiliary module provides corresponding contact lens fitting assistance to the user based on the contact lens fitting plan, including:

[0133] Analyze the fitting parameters of contact lens fitting plans;

[0134] Assist users to customize contact lens styles that meet fitting parameters.

[0135] The method of assisting a user in customizing a contact lens style that meets fitting parameters includes:

[0136] Generate a style window constraint sequence based on the user's contact lens style requirements;

[0137] Based on the style window constraint sequence, the user is shown multiple movements of the style window on the contact lens style layout; wherein, after the i-th movement, the style window on the contact lens style layout complies with the i-th style window constraint in the style window constraint sequence; after each movement of the style window, when the user inputs a continue movement instruction, the next movement is performed;

[0138] In the process of demonstrating to the user that the style window is moved multiple times on the contact lens style layout, when the user actively drags the style window after the j-th movement, the style window after the j-th movement is divided into four equal-sized partitions in four directions;

[0139] The partition in the opposite direction of the pre-processed direction of the user's most recent active drag is used as the target partition; wherein the pre-processed direction is the larger of the vertical component and the horizontal component of the active drag direction;

[0140] When more than a threshold number of contact lens styles are newly entered into the target partition and the duration of each entry exceeds a threshold, an expansion style constraint is determined based on the original contact lens styles in the target partition and the newly entered contact lens styles;

[0141] Match multiple extended contact lens styles based on extended style constraints;

[0142] The expanded contact lens styles are used to replace the peripheral contact lens styles on the contact lens style layout that are located in the direction of the user's most recent active drag in the style window after the jth movement after the user's active drag, and the user is guided to continue actively dragging in the direction of the most recent active drag.

[0143] The step of generating a style window constraint sequence based on the user's contact lens style requirements includes:

[0144] Determine the maximum number of stages based on the demand for contact lens styles;

[0145] Generate multiple style window constraints based on contact lens style requirements;

[0146] Divide each style window constraint into a sequence to be spliced with a limit number of stages;

[0147] Each sequence to be spliced is spliced to obtain a style window constraint sequence; wherein, each style window constraint in each sequence to be spliced makes the conformity of the contact lens style in the style window to the contact lens style requirements increase in sequence; the maximum conformity of the former in each pair of sequences to be spliced in the style window constraint sequence does not exceed that of the latter, and the maximum conformity is the maximum value of the conformity of the style window constraints in the sequence to be spliced that makes the contact lens style in the style window conform to the contact lens style requirements.

[0148] Obviously, those skilled in the art may make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if such changes and modifications fall within the scope of the claims and their equivalents, the present invention is intended to include such changes and modifications.

Claims

1. A contact lens fitting method based on multimodal data and remote diagnosis and treatment, characterized in that: include: Based on remote diagnosis and treatment, the user's eyes are examined and the examination results are obtained; Based on the preset eye disease database and the examination results, the eye disease results are determined; Push the examination results and eye disease results to the online doctor for review; Determine contact lens fitting plans based on examination results reviewed by online doctors and multimodal data on eye disease outcomes; Based on the contact lens fitting plan, users are provided with corresponding contact lens fitting assistance.

2. The contact lens fitting method based on multimodal data and remote diagnosis and treatment according to claim 1, characterized in that: The remote diagnosis and treatment-based eye examination of the user and obtaining the examination results include: Based on remote diagnosis and treatment, users can be examined for eye health and pathology, including at least: conjunctivitis, keratitis, dry eyes, corneal curvature, and tear film stability; as well as, Based on remote diagnosis and treatment, users are given standard eye examinations, which include at least: corneal diameter, pupil diameter, and refractive power.

3. The contact lens fitting method based on multimodal data and remote diagnosis and treatment according to claim 1, characterized in that: The method of determining the eye disease result based on the preset eye disease database and the examination result includes: Matching the examination results with multiple eye disease data in the eye disease database respectively and in sequence; When the match is confirmed, the eye disease information represented by the matched eye disease data is used as the eye disease result.

4. The contact lens fitting method based on multimodal data and remote diagnosis and treatment according to claim 1, characterized in that: The contact lens fitting plan is determined based on the examination results reviewed by the online doctor and the multimodal data of the eye disease results, including: Based on the pre-trained contact lens fitting plan determination model, the contact lens fitting plan is determined according to the examination results and eye disease results reviewed by the online doctor.

5. The contact lens fitting method based on multimodal data and remote diagnosis and treatment according to claim 1, characterized in that: The contact lens fitting assistance provided to the user based on the contact lens fitting plan includes: Analyze the fitting parameters of contact lens fitting plans; Assist users to customize contact lens styles that meet fitting parameters.

6. The contact lens fitting method based on multimodal data and remote diagnosis and treatment according to claim 5, characterized in that: The method of assisting a user in customizing a contact lens style that meets fitting parameters includes: Generate a style window constraint sequence based on the user's contact lens style requirements; Based on the style window constraint sequence, the user is shown multiple movements of the style window on the contact lens style layout; wherein, after the i-th movement, the style window on the contact lens style layout complies with the i-th style window constraint in the style window constraint sequence; after each movement of the style window, when the user inputs a continue movement instruction, the next movement is performed; In the process of demonstrating to the user that the style window is moved multiple times on the contact lens style layout, when the user actively drags the style window after the j-th movement, the style window after the j-th movement is divided into four equal-sized partitions in four directions; The partition in the opposite direction of the pre-processed direction of the user's most recent active drag is used as the target partition; wherein the pre-processed direction is the larger of the vertical component and the horizontal component of the active drag direction; When more than a threshold number of contact lens styles are newly entered into the target partition and the duration of each entry exceeds a threshold, an expansion style constraint is determined based on the original contact lens styles in the target partition and the newly entered contact lens styles; Match multiple extended contact lens styles based on extended style constraints; The expanded contact lens styles are used to replace the peripheral contact lens styles on the contact lens style layout that are located in the direction of the user's most recent active drag in the style window after the jth movement after the user's active drag, and the user is guided to continue actively dragging in the direction of the most recent active drag.

7. The contact lens fitting method based on multimodal data and remote diagnosis and treatment according to claim 6, characterized in that: The step of generating a style window constraint sequence based on the user's contact lens style requirements includes: Determine the maximum number of stages based on the demand for contact lens styles; Generate multiple style window constraints based on contact lens style requirements; Divide each style window constraint into a sequence to be spliced with a limit number of stages; Each sequence to be spliced is spliced to obtain a style window constraint sequence; wherein, each style window constraint in each sequence to be spliced makes the conformity of the contact lens style in the style window to the contact lens style requirements increase in sequence; the maximum conformity of the former in each pair of sequences to be spliced in the style window constraint sequence does not exceed that of the latter, and the maximum conformity is the maximum value of the conformity of the style window constraints in the sequence to be spliced that makes the contact lens style in the style window conform to the contact lens style requirements.

8. A contact lens fitting system based on multimodal data and remote diagnosis and treatment, characterized by: include: An examination module is used to perform eye examinations on users based on remote diagnosis and treatment and obtain examination results; A first determination module is used to determine the eye disease result based on the preset eye disease database and the examination result; Review module, used to push examination results and eye disease results to online doctors for review; The second determination module is used to determine a contact lens fitting plan based on the examination results reviewed by the online doctor and the multimodal data of the eye disease results; The auxiliary module is used to provide users with corresponding contact lens fitting assistance based on the contact lens fitting plan.

9. The contact lens fitting system based on multimodal data and remote diagnosis and treatment according to claim 8, characterized in that: The inspection module performs an eye inspection on the user based on remote diagnosis and treatment, and obtains the inspection results, including: Based on remote diagnosis and treatment, users can be examined for eye health and pathology, including at least: conjunctivitis, keratitis, dry eyes, corneal curvature, and tear film stability; as well as, Based on remote diagnosis and treatment, users are given standard eye examinations, which include at least: corneal diameter, pupil diameter, and refractive power.

10. The contact lens fitting system based on multimodal data and remote diagnosis and treatment according to claim 8, characterized in that: The first determination module determines the eye disease result based on the preset eye disease database and the examination result, including: Matching the examination results with multiple eye disease data in the eye disease database respectively and in sequence; When the match is confirmed, the eye disease information represented by the matched eye disease data is used as the eye disease result.

Images