Method, device and equipment for measuring optometry data

Abstract

The invention is suitable for the technical field of electrical digital data processing, and provides an optometry data measurement method, device and equipment, and the method comprises the steps: obtaining a user image of a user to be subjected to optometry; based on the user image and a preset reference object, generating a prefabricated frame which is equal to the preset reference object in proportion at a preset position of the user image; re-acquiring the user image of the user to be subjected to optometry until the preset reference object in the re-acquired user image coincides with the prefabricated frame, and sending a prompt word for prompting the head movement of the user to be subjected to optometry; acquiring head movement video data of the user to be subjected to optometry moving according to the cue word; and based on the head motion video data, obtaining a left eye pupil distance and a right eye pupil distance of the user. The optometry efficiency can be improved while the accuracy of the optometry data is improved.

Description

Technical Field

[0001] This application belongs to the technical field of electronic digital data processing, and particularly relates to a method, device, and equipment for measuring optometry data. Background Art

[0002] Although the optometry process of modern optometry equipment is complex, time-consuming, and requires an optometrist to debug the equipment, there are significant differences in the experience of different optometrists, which easily leads to subjective errors. Currently, there is always a difference between the measurement results of optometry equipment and the actual degree of the human eye. This is due to the measurement principle and is directly related to the equipment itself, and cannot be completely eliminated by replacing the equipment. Especially in some cases, such as when the equipment is not calibrated, the equipment parts are worn, or the equipment parts are aged, it will directly affect the accuracy of the measurement results.

[0003] The existing method usually determines the final optometry data through manual optometry after using machine optometry, which makes the optometry process more cumbersome. At the same time, it requires the optometrist to have sufficient optometry experience, which results in low efficiency of the optometry process. Summary of the Invention

[0004] The embodiments of this application provide a method, device, and equipment for measuring optometry data, which can improve the accuracy of optometry data and the optometry efficiency at the same time.

[0005] This application is implemented through the following technical solutions: In a first aspect, the embodiments of this application provide a method for measuring optometry data, including: Obtain a user image of the user to be optometrized.

[0006] Based on the user image and a preset reference object, generate a prefabricated frame at a preset position in the user image that is proportional to the preset reference object.

[0007] Re-obtain the user image of the user to be optometrized until the preset reference object in the re-obtained user image coincides with the prefabricated frame, and then send a prompt word to prompt the head movement of the user to be optometrized.

[0008] Obtain head movement video data of the user to be optometrized according to the prompt word.

[0009] Based on the head movement video data, obtain the left eye pupillary distance and the right eye pupillary distance of the user.

[0010] In combination with the first aspect, in some possible implementation manners, the preset position of the user image is the position where the forehead of the user to be optometrized is located in the user image.

[0011] In combination with the first aspect, in some possible implementation manners, obtaining the left eye pupillary distance and the right eye pupillary distance of the user based on the head movement video data includes: Based on the head movement video data, obtain the midpoint of the nose bridge.

[0012] Based on the midpoint of the nose bridge and a preset reference object, obtain the left eye pupil distance and the right eye pupil distance of the user.

[0013] Combined with the first aspect, in some possible implementation manners, based on the head movement video data, obtaining the midpoint of the nose bridge includes: Based on the head movement video data, obtain the front-facing image of the user.

[0014] Scan the front-facing image through a face tracking algorithm to obtain the midpoint of the nose bridge.

[0015] Combined with the first aspect, in some possible implementation manners, based on the head movement video data, obtaining the front-facing image of the user includes: Based on the user's head movement video data, obtain multiple frame images.

[0016] Use a face tracking algorithm to detect the face region in each frame image.

[0017] Perform key point detection and 3D reconstruction on the face region in each frame image to obtain the face pose estimation result corresponding to each frame image.

[0018] Determine the frame image closest to the front-facing camera among the multiple frame images according to each face pose estimation result as the front-facing image.

[0019] Combined with the first aspect, in some possible implementation manners, based on the midpoint of the nose bridge and a preset reference object, obtaining the left eye pupil distance and the right eye pupil distance of the user includes: Obtain the actual size of the preset reference object.

[0020] Based on the actual size of the preset reference object and the image size of the preset reference object in the front-facing image, obtain the image scale.

[0021] Based on the midpoint of the nose bridge, obtain the nose bridge center line.

[0022] Measure the distance from the midpoint of the left eye pupil in the front-facing image to the nose bridge center line to obtain the first distance.

[0023] Measure the distance from the midpoint of the right eye pupil in the front-facing image to the nose bridge center line to obtain the second distance.

[0024] Based on the image scale and the first distance, obtain the left eye pupil distance.

[0025] Based on the image scale and the second distance, obtain the right eye pupil distance.

[0026] In combination with the first aspect, in some possible implementation manners, obtaining an image scale based on the true size of a preset reference object and the image size of the preset reference object in a front-facing image includes: Obtain the true length of the preset reference object and the image length of the preset reference object in the front-facing image.

[0027] Calculate the ratio of the true length to the image length to obtain the image scale.

[0028] In combination with the first aspect, in some possible implementation manners, the optometry data measurement method further includes: Obtain the diopter measured by a diopter measurement device, denoted as the first diopter, obtain the age and occupation of the user to be optometrized, and a plurality of cluster centers; wherein, the cluster centers are sets of age and occupation; Calculate the distances from the age and occupation of the user to be optometrized to the plurality of cluster centers, and determine the cluster center corresponding to the age and occupation of the user to be optometrized; Obtain a diopter adjustment amount according to the cluster center corresponding to the age and occupation of the user to be optometrized; Calculate the sum of the first diopter and the diopter adjustment amount to obtain the final diopter on the prescription form.

[0029] In a second aspect, an embodiment of the present application provides an optometry data measurement device, including: A first acquisition module, configured to acquire a user image of a user to be optometrized.

[0030] A first processing module, configured to generate a prefabricated frame equal in proportion to the preset reference object at a preset position of the user image based on the user image and the preset reference object.

[0031] A first prompt module, configured to re-acquire the user image of the user to be optometrized until the preset reference object in the re-acquired user image coincides with the prefabricated frame, and then send a prompt word for prompting the head movement of the user to be optometrized.

[0032] A second acquisition module, configured to acquire head movement video data of the user to be optometrized moving according to the prompt word.

[0033] A result output module, configured to obtain the left eye pupillary distance and the right eye pupillary distance of the user based on the head movement video data.

[0034] In a third aspect, an embodiment of the present application provides a terminal device, including: a processor and a memory, where the memory is used to store a computer program, and the processor implements the optometry data measurement method according to any one of the first aspect when executing the computer program.

[0035] It can be understood that the beneficial effects of the above second aspect and third aspect can refer to the relevant descriptions in the above first aspect, and will not be elaborated here.

[0036] The beneficial effects of the embodiments of the present application compared with the prior art are as follows: The present application generates a prefabricated frame based on the user's image and a preset reference object, then sends a prompt word according to the relative relationship between the preset reference object and the prefabricated frame to prompt the user to perform corresponding movements and obtains the head movement video data, and finally obtains the left eye interpupillary distance and the right eye interpupillary distance based on the head movement video data. Abandoning the traditional method of measuring the interpupillary distance of the left and right eyes by machines, a scale is constructed using a preset reference object, and the size of the preset reference object is converted into the interpupillary distance of the left and right eyes. In this way, the obtained interpupillary distance of the left and right eyes is more accurate, the error of the optometry instrument can be avoided, and the result is relatively accurate.

[0037] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit this specification. Brief Description of the Drawings

[0038] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for use in the embodiments or the description of the prior art. Obviously, the following drawings are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0039] Figure 1 is a schematic flowchart of an optometry data measurement method provided by an embodiment of the present application; Figure 2 is a schematic structural diagram of an optometry data measurement device provided by an embodiment of the present application; Figure 3 is a schematic structural diagram of a terminal device provided by an embodiment of the present application. Detailed Description of the Embodiments

[0040] In the following description, specific details such as specific system structures and technologies are presented for the purpose of illustration rather than limitation, so as to thoroughly understand the embodiments of the present application. However, those skilled in the art should clearly understand that the present application can also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid unnecessary details from interfering with the description of the present application.

[0041] It should be understood that when used in the specification of the present application and the appended claims, the term "comprising" indicates the presence of the described features, wholes, steps, operations, elements, and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components, and / or their combinations.

[0042] It should also be understood that the term "and / or" as used in the specification and appended claims of this application refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0043] As used in the specification and appended claims of this application, the term "if" may be construed as "when", "once", "in response to determining", or "in response to detecting" depending on the context. Similarly, the phrases "if determined" or "if [the described condition or event] is detected" may be construed as meaning "once determined", "in response to determining", "once [the described condition or event] is detected", or "in response to detecting [the described condition or event]" depending on the context.

[0044] In addition, in the description of the specification and appended claims of this application, the terms "first", "second", "third", etc. are only used for distinguishing descriptions and cannot be construed as indicating or implying relative importance.

[0045] Reference to "one embodiment" or "some embodiments" etc. described in the specification of this application means that a specific feature, structure, or characteristic described in connection with that embodiment is included in one or more embodiments of this application. Thus, statements such as "in one embodiment", "in some embodiments", "in other some embodiments", "in still other embodiments", etc. that appear in different places in this specification do not necessarily all refer to the same embodiment, but mean "one or more but not all of the embodiments", unless otherwise specifically emphasized in other ways. The terms "comprising", "including", "having", and their variants all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0046] An embodiment of this application provides an optometry data measurement method. Figure 1 It is a schematic flowchart of the optometry data measurement method provided by an embodiment of this application. Referring to Figure 1 , the detailed description of this optometry data measurement method is as follows: Step 101, obtain a user image of the user to be optometrized.

[0047] Step 102, based on the user image and a preset reference object, generate a prefabricated frame at a preset position of the user image that is proportional to the preset reference object.

[0048] In some specific embodiments, the preset position of the user image is the position where the forehead of the user to be optometrized is located in the user image.

[0049] In some specific embodiments, the shape of the preset reference object can be various shapes. Considering convenience and the ease of acquisition, in specific embodiments, the preset reference object can be a bank card or an identity card.

[0050] In some specific embodiments, the preset reference object may be the glasses currently used by the user to be optometry. The user needs to input the number on the temple of the glasses into the computer, and the computer can obtain the size data of the currently used glasses according to this number. The glasses of the user to be optometry are easier to obtain than other preset reference objects.

[0051] Step 103: Re-obtain the user image of the user to be optometry until the preset reference object in the re-obtained user image coincides with the prefabricated frame, and then send a prompt word to prompt the head movement of the user to be optometry.

[0052] Specifically, the prompt words may include: turning the head left and right, raising the head, and lowering the head, etc.

[0053] In some specific embodiments, if the preset reference object in the re-obtained user image does not coincide with the prefabricated frame, then re-obtain the user image of the new user to be optometry.

[0054] Step 104: Obtain the head movement video data of the user to be optometry moving according to the prompt words.

[0055] In some specific embodiments, the head movement video data may be a head movement video, and this video can be recorded starting from after the prompt word appears and stopped when the user completes the actions of the prompt word (the stop moment of the video recording can be controlled by detecting the similarity of consecutive frame images. For example, when the similarity is greater than the preset value, stop recording).

[0056] Step 105: Obtain the left eye pupillary distance and right eye pupillary distance of the user based on the head movement video data.

[0057] In some specific embodiments, step 105 may include: Based on the head movement video data, obtain the midpoint of the nose bridge.

[0058] Based on the midpoint of the nose bridge and the preset reference object, obtain the left eye pupillary distance and right eye pupillary distance of the user.

[0059] In some specific embodiments, based on the head movement video data, obtaining the midpoint of the nose bridge may include: Based on the head movement video data, obtain the front-facing image of the user.

[0060] Scan the front-facing image through a facial tracking algorithm to obtain the midpoint of the nose bridge.

[0061] In some specific embodiments, based on the head movement video data, obtaining the front-facing image of the user may include: Based on the user's head movement video data, obtain multiple frame images.

[0062] The facial region in each frame image is detected using a facial tracking algorithm.

[0063] Key point detection and 3D reconstruction are performed on the facial region in each frame image to obtain the facial pose estimation result corresponding to each frame image.

[0064] Based on each facial pose estimation result, the frame image closest to facing the camera among multiple frame images is determined as the frontal image.

[0065] Exemplarily, the use of the facial tracking algorithm, key point detection, and 3D reconstruction technology is to identify the frontal image. These technologies are relatively mature in the prior art and can accurately identify the frontal image, facilitating subsequent processing based on the frontal image to obtain the midpoint of the nasal bridge, and facilitating the calculation of the left eye interpupillary distance and the right eye interpupillary distance.

[0066] Specifically, the facial pose estimation result specifically includes parameters such as pitch angle, yaw angle, and roll angle. To more easily obtain the frontal image, reduce the computational load of the system, and at the same time take into account the accuracy of the left and right eye interpupillary distances, when the pitch angle, yaw angle, and roll angle are all within a certain threshold, the image can be considered as the frontal image.

[0067] In some specific embodiments, based on the midpoint of the nasal bridge and a preset reference object, obtaining the left eye interpupillary distance and the right eye interpupillary distance of the user may include: Obtain the actual size of the preset reference object.

[0068] Based on the actual size of the preset reference object and the image size of the preset reference object in the frontal image, obtain the image scale.

[0069] Based on the midpoint of the nasal bridge, obtain the nasal bridge midline.

[0070] Measure the distance from the midpoint of the left eye pupil in the frontal image to the nasal bridge midline to obtain the first distance.

[0071] Measure the distance from the midpoint of the right eye pupil in the frontal image to the nasal bridge midline to obtain the second distance.

[0072] Based on the image scale and the first distance, obtain the left eye interpupillary distance.

[0073] Based on the image scale and the second distance, obtain the right eye interpupillary distance.

[0074] In some specific embodiments, based on the actual size of the preset reference object and the image size of the preset reference object in the frontal image, obtaining the image scale may include: Obtain the actual length of the preset reference object and the image length of the preset reference object in the frontal image.

[0075] Calculate the ratio of the actual length to the image length to obtain the image scale.

[0076] Specifically, for example, the actual length of the preset reference object is 54 mm, and the image length of the preset reference object in the front-facing image is 5.4 mm. Then the image scale is 10:1 (54:5.4). Therefore, according to the above example, the left interpupillary distance is equal to the product of the image scale and the first distance, and the right interpupillary distance is equal to the product of the image scale and the second distance.

[0077] In some specific embodiments, the optometry data of the user further includes the diopter of the user. The diopter can be directly measured by the device, and the diopter measured by the device is the most suitable, but it is not the final diopter on the user's glasses prescription. After obtaining the diopter measured by the device according to the device, the optometrist will also appropriately adjust the diopter measured by the device based on his own glasses-fitting experience according to the user's work or study environment, so as to obtain the final diopter on the glasses prescription.

[0078] Therefore, in some specific embodiments, the optometry data measurement method may further include: Obtain the diopter measured by the diopter measurement device, denoted as the first diopter, obtain the age and occupation of the user to be optometrized, and a plurality of cluster centers. Among them, the cluster center is a set of age and occupation.

[0079] Calculate the distances from the age and occupation of the user to be optometrized to the plurality of cluster centers, and determine the cluster center corresponding to the age and occupation of the user to be optometrized.

[0080] Obtain the diopter adjustment amount according to the cluster center corresponding to the age and occupation of the user to be optometrized.

[0081] Calculate the sum of the first diopter and the diopter adjustment amount to obtain the final diopter on the glasses prescription.

[0082] Specifically, take the smallest of the multiple calculated distances as the cluster center corresponding to the age and occupation of the user to be optometrized. The above cluster center can be {24, clerk}, where 24 represents 24 years old and clerk represents the occupation of clerk. There are many other situations for the cluster center, which will not be elaborated here. In addition, each cluster center corresponds to a diopter adjustment amount. For example, in the above example, the diopter adjustment amount corresponding to this cluster center is 0.

[0083] Exemplarily, in existing research, it is found that the two factors of age and occupation will affect the diopter adjustment amount, specifically as follows: 1. Childhood and Adolescence: Myopia is relatively common among school-age children. Studies have shown that the peak of myopia occurs at a relatively young age, such as before the age of 30 - 39, and reaches its highest point in the 20s. For example, in a study, the myopia rate was 18.2% in the 20 - 29 age group, while it reached 18.7% in the 30 - 39 age group.

[0084] 2. Early Adulthood: As age increases, the myopia rate gradually decreases. Starting from the age of 30, the proportion of myopia gradually decreases and reaches the lowest point (about 11.8%) at the age of 60 - 69. In another study, it was found that the age group of 30 - 39 is a key period for the transition from myopia to hyperopia. Except for anisometropia, this transition occurs in the age group of 50 - 59.

[0085] 3. Old Age: In old age, that is, over the age of 70, a second peak of myopia appears. This may be related to the changes in the eye structure of the elderly. For example, among the elderly population aged 70 - 85, the myopia rate has rebounded again, reaching about 15.8%.

[0086] 4. High - risk Occupations: Certain occupations have a higher risk of myopia for their practitioners due to the need for long - term close work. Specifically include: students, military personnel, technicians, agricultural and fishery workers, service personnel, technical staff, professionals, and the unemployed, etc. Especially the student group has a relatively high incidence of myopia (OR = 3.49; 95% CI 2.76–4.42), while jobs with a supervisory nature such as senior executives, senior officials, and managers have a relatively low incidence.

[0087] 5. Impact of Near - work Exposure: For adults, near - work exposure in the occupation can increase the probability of myopia by 21%. For example, the occupational characteristics of clinical microscope operators, law students, or medical students may lead to a higher incidence of myopia.

[0088] In summary, different age groups and occupational types have different impacts on the occurrence of myopia in individuals. This information helps to develop targeted eye health prevention strategies, especially to implement effective intervention measures in the workplace environment. Therefore, correspondingly, different diopter adjustment amounts will be set specifically according to the different ages and occupations of users based on the results of the first diopter.

[0089] Specifically, after the user to be refracted obtains the final diopter on the prescription form, the age and occupation data of the user will be added to the database for generating new multiple cluster centers. This is conducive to the adaptive adjustment of the data and avoids the database data losing its reference value over time.

[0090] In some specific embodiments, in addition to the diopter, left eye pupillary distance, and right eye pupillary distance mentioned above, the optometry device also obtains the astigmatism degree of the user to be optometrized. When the astigmatism degree is less than 25 degrees, the measured astigmatism degree is directly discarded and the astigmatism data on the prescription form is modified to 0.

[0091] When the astigmatism degree is greater than or equal to 25 degrees and less than 50 degrees, first determine the type of astigmatism. If it is with-the-rule astigmatism, the measured astigmatism degree is discarded (modified to 0 in the same way as above), or the degree of with-the-rule astigmatism is converted into spherical power and filled in the prescription form; the measured astigmatism degrees of against-the-rule astigmatism and oblique-axis astigmatism are directly filled in the prescription form.

[0092] When the astigmatism degree is greater than or equal to 50 degrees and less than 200 degrees, obtain the corrected visual acuity of the user to be optometrized. If the visual acuity can reach 1.0, the astigmatism degree is discarded. If the visual acuity cannot reach 1.0, 1 / 2 cylinder is converted into spherical power and filled in the prescription form.

[0093] In some specific embodiments, in order to ensure the clarity of the vision of the optometry user and ensure that there is no obvious size difference between the left and right eyes when the user looks at the same object, the visual acuities of both eyes are adjusted to be the same on the final prescription form. For example, if the left eye visual acuity is 0.8 and the right eye visual acuity is 1.0, then both eyes of the user are corrected to 0.8.

[0094] The above optometry data measurement method generates a prefabricated frame based on the user image and a preset reference object, then sends a prompt word according to the relative relationship between the preset reference object and the prefabricated frame to prompt the user to perform corresponding movements and obtains the head movement video data. Finally, the left eye pupillary distance and the right eye pupillary distance are obtained based on the head movement video data. It abandons the traditional method of measuring the left and right eye pupillary distances by machines, uses the preset reference object to construct a scale, and converts the size of the preset reference object into the pupillary distances of the left and right eyes. In this way, the obtained left and right eye pupillary distances are more accurate, can avoid the errors of the optometry instrument, and the results are relatively accurate.

[0095] In some specific embodiments, the following experiment was conducted to verify the accuracy of the present solution: A number of tested persons were randomly selected, and the pupillary distances were calculated using the method of the present solution and the traditional manual measurement method respectively. Among them, the method of the present solution was used multiple times to obtain the calculation results. The experimental results are shown in Table 1 below: Table 1

[0096] In the above experiment, the manual measurement result is the test result of a professional optometrist, which can be considered the most accurate result under ideal conditions. Through the above experiment, it can be found that the precision error of the calculation result of the present solution is within 1 mm, the error is small enough, and the precision is very high.

[0097] It should be understood that the sequence numbers of the steps in the above embodiments do not indicate the order of execution, and the execution order of each process should be determined according to its function and internal logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.

[0098] Corresponding to the optometry data measurement method described in the above embodiments, Figure 2 The structural block diagram of the optometry data measurement device provided by the embodiments of the present application is shown. For the convenience of description, only the parts related to the embodiments of the present application are shown.

[0099] See Figure 2 , the optometry data measurement device in the embodiments of the present application may include: The first acquisition module 201 is used to acquire the user image of the user to be optometrized.

[0100] The first processing module 202 is used to generate a prefabricated frame proportional to the preset reference object at a preset position of the user image based on the user image and the preset reference object.

[0101] The first prompt module 203 is used to re-acquire the user image of the user to be optometrized until the preset reference object in the re-acquired user image coincides with the prefabricated frame, and then send a prompt word to prompt the head movement of the user to be optometrized.

[0102] The second acquisition module 204 is used to acquire the head movement video data of the user to be optometrized moving according to the prompt word.

[0103] The result output module 205 is used to obtain the left eye pupillary distance and the right eye pupillary distance of the user based on the head movement video data.

[0104] Exemplarily, the preset position of the user image is the position where the forehead of the user to be optometrized is located in the user image.

[0105] Exemplarily, the result output module 205 is further used for: Obtaining the midpoint of the nose bridge based on the head movement video data.

[0106] Obtaining the left eye pupillary distance and the right eye pupillary distance of the user based on the midpoint of the nose bridge and the preset reference object.

[0107] Exemplarily, the result output module 205 is further used for: Obtaining the frontal image of the user based on the head movement video data of the user.

[0108] Scanning the frontal image through a face tracking algorithm to obtain the midpoint of the nose bridge.

[0109] Exemplarily, the result output module 205 is further used for: Obtaining a plurality of frame images based on the head movement video data of the user.

[0110] Use a face tracking algorithm to detect the face region in each frame image.

[0111] Perform key point detection and 3D reconstruction on the face region in each frame image to obtain the face pose estimation result corresponding to each frame image.

[0112] Determine the frame image closest to facing the camera among multiple frame images according to each face pose estimation result as the frontal image.

[0113] Exemplarily, the result output module 205 is further configured to: Obtain the actual size of a preset reference object.

[0114] Based on the actual size of the preset reference object and the image size of the preset reference object in the frontal image, obtain the image scale.

[0115] Based on the midpoint of the nose bridge, obtain the midline of the nose bridge.

[0116] Measure the distance from the midpoint of the left eye pupil to the midline of the nose bridge in the frontal image to obtain a first distance.

[0117] Measure the distance from the midpoint of the right eye pupil to the midline of the nose bridge in the frontal image to obtain a second distance.

[0118] Based on the image scale and the first distance, obtain the left eye interpupillary distance.

[0119] Based on the image scale and the second distance, obtain the right eye interpupillary distance.

[0120] Exemplarily, the result output module 205 is further configured to: Obtain the actual length of a preset reference object and the image length of the preset reference object in the frontal image.

[0121] Calculate the ratio of the actual length to the image length to obtain the image scale.

[0122] It should be noted that for the information interaction, execution process, etc. between the above-mentioned devices / units, since they are based on the same concept as the method embodiment of the present application, for their specific functions and the technical effects brought, please refer to the method embodiment part specifically, and details are not described here again.

[0123] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the above-mentioned division of each functional unit and module is used as an example. In actual applications, the above functions can be allocated to different functional units and modules according to needs, that is, the internal structure of the device is divided into different functional units or modules to complete all or part of the functions described above. Each functional unit and module in the embodiment can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit. In addition, the specific names of each functional unit and module are only for the convenience of mutual distinction and do not limit the protection scope of this application. The specific working process of the units and modules in the above system can refer to the corresponding process in the foregoing method embodiment and will not be elaborated here.

[0124] The embodiment of this application also provides a terminal device. Refer to Figure 3 , the terminal device 300 may include: at least one processor 310 and a memory 320. The memory 320 is used to store a computer program 321. The processor 310 is used to call and run the computer program 321 stored in the memory 320 to implement the steps in any of the foregoing method embodiments, such as Figure 1 the steps 101 to 105 in the illustrated embodiment. Alternatively, when the processor 310 executes the computer program, it implements the functions of each module / unit in each device embodiment above, such as Figure 2 the functions of each module shown.

[0125] Exemplarily, the computer program 321 can be divided into one or more modules / units. One or more modules / units are stored in the memory 320 and executed by the processor 310 to complete this application. The one or more modules / units can be a series of computer program segments capable of performing specific functions, and these program segments are used to describe the execution process of the computer program in the terminal device 300.

[0126] Those skilled in the art can understand that Figure 3 this is only an example of the terminal device and does not constitute a limitation on the terminal device. It may include more or fewer components than shown in the figure, or combine some components, or different components, such as input / output devices, network access devices, buses, etc.

[0127] The processor 310 may be a Central Processing Unit (CPU), or may also be other general-purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field-Programmable Gate Arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0128] The memory 320 may be an internal storage unit of the terminal device or an external storage device of the terminal device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) card, a Flash Card, etc. The memory 320 is used to store the computer program and other programs and data required by the terminal device. The memory 320 may also be used to temporarily store data that has been output or is to be output.

[0129] The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, the buses in the drawings of this application are not limited to only one bus or one type of bus.

[0130] The optometry data measurement method provided in the embodiments of this application can be applied to terminal devices such as computers, wearable devices, vehicle-mounted devices, tablet computers, laptop computers, etc. The embodiments of this application do not impose any restrictions on the specific types of terminal devices.

[0131] The embodiments of this application also provide a computer-readable storage medium. The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the various embodiments of the above optometry data measurement method can be implemented.

[0132] An embodiment of the present application provides a computer program product. When the computer program product runs on a mobile terminal, it enables the mobile terminal to execute the steps in each of the above-described embodiments of the optometry data measurement method when executed.

[0133] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the above-described embodiment methods of the present application can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by a processor, the steps of each of the above-described method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in the form of source code, object code, executable file, or some intermediate form, etc. The computer-readable medium can at least include: any entity or device that can carry the computer program code to the photographing device / terminal device, recording medium, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electrical carrier signal, telecommunication signal, and software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk, or an optical disc, etc.

[0134] In the above embodiments, the descriptions of each embodiment have their own emphases. For the parts not detailed or recorded in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0135] Those of ordinary skill in the art can realize that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. A professional technician can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present application.

[0136] In the embodiments provided by the present application, it should be understood that the disclosed device / network device and method can be implemented in other ways. For example, the device / network device embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there can be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed couplings or direct couplings or communication connections to each other can be through some interfaces. The indirect couplings or communication connections of the devices or units can be in an electrical, mechanical, or other form.

[0137] The unit described as a separation component may or may not be physically separated, and the component displayed as a unit may or may not be a physical unit, that is, it may be located in one place or distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0138] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements on some of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. An optometry data measurement method, characterized in that, Including: Obtain a user image of the user to be refracted; Based on the user image and a preset reference object, generate a prefabricated frame at a preset position of the user image that is proportional to the preset reference object; Re-obtain the user image of the user to be refracted until the preset reference object in the re-obtained user image coincides with the prefabricated frame, and then send a prompt word to prompt the head movement of the user to be refracted; Obtain the head movement video data of the user to be refracted performing movement according to the prompt word; Based on the head movement video data, obtain the left eye pupillary distance and the right eye pupillary distance of the user.

2. The optometry data measurement method according to claim 1, wherein The preset position of the user image is the position where the forehead of the user to be refracted is located in the user image.

3. The optometry data measurement method according to claim 1, characterized in that, Based on the head movement video data, obtaining the left eye pupillary distance and the right eye pupillary distance of the user includes: Based on the head movement video data, obtain the midpoint of the nose bridge; Based on the midpoint of the nose bridge and the preset reference object, obtain the left eye pupillary distance and the right eye pupillary distance of the user.

4. The optometry data measurement method according to claim 3, wherein Based on the head movement video data, obtaining the midpoint of the nose bridge includes: Based on the head movement video data, obtain the frontal image of the user; Scan the frontal image through a face tracking algorithm to obtain the midpoint of the nose bridge.

5. The optometry data measurement method according to claim 4, wherein, Based on the head movement video data, obtaining the frontal image of the user includes: Based on the user head movement video data, obtain a plurality of frame images; Use a face tracking algorithm to detect the facial area in each frame image; Perform key point detection and 3D reconstruction on the facial area in each frame image to obtain the facial pose estimation result corresponding to each frame image; Determine the frame image closest to the front of the camera among the plurality of frame images according to each facial pose estimation result as the frontal image.

6. The optometry data measurement method according to claim 4, characterized in that, Based on the midpoint of the nose bridge and the preset reference object, obtaining the left eye pupillary distance and the right eye pupillary distance of the user includes: Obtain the real size of the preset reference object; Based on the real size of the preset reference object and the image size of the preset reference object in the frontal image, obtain the image scale; Based on the midpoint of the nose bridge, obtain the midline of the nose bridge; Measure the distance from the midpoint of the left eye pupil in the frontal image to the midline of the nose bridge to obtain a first distance; Measure the distance from the midpoint of the right eye pupil in the frontal image to the midline of the nose bridge to obtain a second distance; Based on the image scale and the first distance, obtain the left eye pupillary distance; Based on the image scale and the second distance, obtain the right eye pupillary distance.

7. The optometry data measurement method according to claim 6, wherein, Based on the real size of the preset reference object and the image size of the preset reference object in the frontal image, obtaining the image scale includes: Obtain the real length of the preset reference object and the image length of the preset reference object in the frontal image; Calculate the ratio of the real length and the image length to obtain the image scale.

8. The optometry data measurement method according to claim 1, characterized in that The refraction data measurement method further includes: Obtain the measured refractive power measured by a refractive power measurement device, denoted as the first refractive power, obtain the age and occupation of the user to be refracted, and a plurality of cluster centers; where the cluster center is a set of age and occupation; Calculate the distances from the age and occupation of the user to be optometry-tested to multiple cluster centers, and determine the cluster centers corresponding to the age and occupation of the user to be optometry-tested; Obtain the diopter adjustment amount according to the cluster centers corresponding to the age and occupation of the user to be optometry-tested; Calculate the sum of the first diopter and the diopter adjustment amount to obtain the final diopter on the prescription form.

9. An optometry data measurement device, characterized in that, It includes: A first acquisition module, configured to acquire a user image of the user to be optometry-tested; A first processing module, configured to generate a prefabricated frame proportional to the preset reference object at a preset position of the user image based on the user image and the preset reference object; A first prompt module, configured to re-acquire the user image of the user to be optometry-tested until the preset reference object in the re-acquired user image coincides with the prefabricated frame, and then send a prompt word for prompting the head movement of the user to be optometry-tested; A second acquisition module, configured to acquire head movement video data of the user to be optometry-tested moving according to the prompt word; A result output module, configured to obtain the left eye pupillary distance and the right eye pupillary distance of the user based on the head movement video data.

10. A terminal device, comprising: A processor and a memory, wherein the memory stores a computer program that can run on the processor, and is characterized in that when the processor executes the computer program, it implements the optometry data measurement method according to any one of claims 1 to 7.

Images