Pupil positioning method, pupil positioning device and storage medium

Abstract

The embodiment of the invention provides a pupil positioning method, a pupil positioning device and a storage medium. The pupil positioning method comprises the following steps: determining the position of a reference datum and a sighting mark arrangement range; controlling the sighting marks to be within the sighting mark arrangement range; acquiring a first position of the pupil relative to the reference benchmark and a second position of the head relative to the reference benchmark in a state that the user watches the sighting mark; and calculating the offset position of the pupil relative to the head according to the first position and the second position. According to the pupil positioning method, the position ranges of the pupils relative to the head in the far vision state and the near vision state can be obtained, personalized customization of the spectacle lenses of the user can be achieved according to the position ranges, and the requirements of the user are better met.

Description

Technical Field

[0001] The present invention relates to the field of visual technology, and in particular to a pupil positioning method, a pupil positioning device and a storage medium. Background Art

[0002] When people observe distant objects and nearby objects, the position of the pupil relative to the head is different, so that they can observe the objects more clearly.

[0003] In the process of customizing glasses for users, in order to facilitate users to observe distant objects and near objects more clearly, it is necessary to determine the area on the lens corresponding to the user's pupil when observing distant objects, and to determine the area on the lens corresponding to the user's pupil when observing near objects, so that the lenses can provide users with more suitable refraction when observing distant objects and near objects, thereby improving the user experience.

[0004] Therefore, it is necessary to obtain the position of the user's pupil when observing distant objects and near objects, so as to provide a reference for prescribing lenses. Summary of the invention

[0005] In order to solve the above technical problems, the present application provides a pupil positioning method, a pupil positioning device and a storage medium, which aim to obtain the offset position of the pupil relative to the head in the far vision state and the near vision state respectively.

[0006] To achieve the above-mentioned purpose, the technical solution of the embodiment of the present application is implemented as follows: The embodiment of the present invention provides a pupil positioning method for determining the position of the user's pupil relative to the head in the far vision state and the near vision state, respectively, including:

[0007] Determine the position of the reference datum and the range of sight mark arrangement;

[0008] Controlling the sight mark to be within the sight mark arrangement range;

[0009] Acquire a first position of the pupil relative to the reference datum and a second position of the head relative to the reference datum when the user is gazing at the sight mark;

[0010] The offset position of the pupil relative to the head is calculated based on the first position and the second position.

[0011] In some embodiments, the sight mark arrangement range is a far sight arrangement range, and determining the sight mark arrangement range specifically includes:

[0012] Obtaining the telescopic distance of the sight mark, the pupil level of the user, and the upper limit angle of the user's line of sight in the telescopic state, and calculating the first active height of the sight mark;

[0013] Acquire the far vision horizontal boundary of the user's line of sight in the far vision state;

[0014] According to the sight mark distance and the sight mark horizontal boundary, two sight mark width endpoints are calculated;

[0015] The telescopic arrangement range is determined according to the telescopic width endpoint and the first active height.

[0016] In some embodiments, the sight mark arrangement range is a near sight arrangement range, and determining the sight mark arrangement range specifically includes:

[0017] Obtaining the near-sighted distance of the sight mark, the pupil level of the user, and the lower limit angle of the user's line of sight in the near-sighted state, and calculating the second active height of the sight mark;

[0018] Acquire a near vision horizontal boundary of a user's line of sight in the near vision state;

[0019] According to the sight mark near distance and the near horizontal boundary, two near width endpoints of the sight mark are calculated;

[0020] The near viewing arrangement range is determined according to the near viewing width endpoint and the second active height.

[0021] In some embodiments, before acquiring the first position of the pupil relative to the reference datum and the second position of the head relative to the reference datum when the user is gazing at the sight mark, the pupil locating method further includes:

[0022] Obtaining the positions of two width end points of the sight mark arrangement range along the left and right directions of the user and the width distance therebetween;

[0023] Determining the number of detection positions of the sight mark within the sight mark arrangement range;

[0024] Calculating the position of the detection position according to the position of the width endpoint, the width distance and the number of the detection positions;

[0025] The sight mark is controlled to be located at the detection position, and the user is prompted to look at the sight mark located at each detection position.

[0026] In some embodiments, the plurality of detection positions are spaced apart along the left-right direction of the user, and the two width endpoints correspond to one of the detection positions at both ends along the left-right direction of the user, respectively.

[0027] In some embodiments, controlling the sight mark to be located at the detection position specifically includes:

[0028] The sight mark is controlled to appear at each of the detection positions one by one from one side to the other side along the left and right direction of the user.

[0029] In some embodiments, controlling the sight mark to appear successively at each of the detection positions from one side to the other side along the left-right direction of the user specifically includes:

[0030] The display module is controlled to display the sight mark at each detection position in sequence from one width end point to another width end point along the left and right direction of the user, and the sight mark is displayed only at one detection position at the same time.

[0031] In some embodiments, the obtaining of a first position of a pupil relative to the reference datum and a second position of a head relative to the reference datum when the user is gazing at the sight mark specifically includes:

[0032] After prompting the user to look at the sight mark, controlling the image acquisition module to photograph the user to acquire a reference image including the user's pupil and head;

[0033] The reference image is processed to calculate the first position and the second position.

[0034] The present invention also provides a pupil positioning device, comprising:

[0035] A determination module, used to determine the position of the reference datum and the range of sight mark arrangement;

[0036] A control module, used for controlling the sight mark to be within the sight mark arrangement range;

[0037] An acquisition module, used for acquiring a first position of the pupil relative to the reference datum and a second position of the head relative to the reference datum when the user is gazing at the sight mark;

[0038] A calculation module is used to calculate the offset position of the pupil relative to the head according to the first position and the second position.

[0039] In some embodiments, the pupil locating device further comprises a display module, wherein a display area of ​​the display module is used to face the front of the user, the display area is used to form at least a part of the sight mark arrangement range and display the sight mark, and the control module is further used to control the display module to display the sight mark.

[0040] In some embodiments, the pupil positioning device further includes a driving module, which is connected to the display module to drive the display module to move in a three-dimensional space.

[0041] In some embodiments, the pupil locating device further comprises a prompting module, and the prompting module is used to prompt the user to look at the sight mark.

[0042] In some embodiments, the pupil locating device further includes an image acquisition module, wherein the image acquisition area of ​​the image acquisition module is used to face the front of the user, the image acquisition module is used to acquire a reference image including the pupil and head of the user, and the control module is further used to control the image acquisition module to photograph the user.

[0043] In some embodiments, the image acquisition module is a binocular camera, and the image acquisition area is a lens of the binocular camera.

[0044] An embodiment of the present invention further provides a storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the pupil positioning method described in any one of the aforementioned embodiments are implemented.

[0045] The pupil positioning method provided in the embodiment of the present invention can measure the offset position of the pupil relative to the head in the far vision state, and can also measure the offset position of the pupil relative to the head in the near vision state, and then obtain the position range of the pupil relative to the head in the far vision state and the near vision state, respectively, which is conducive to realizing personalized customization of the user's eyeglasses according to the position range, and better meeting the needs of the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] Figure 1 A schematic diagram of a flow chart of a pupil positioning method according to an embodiment of the present invention;

[0047] Figure 2 is a schematic diagram of a pupil in a farsighted state according to an embodiment of the present invention;

[0048] Figure 3 for Figure 2 Schematic diagram of the distance horizontal boundary of the middle pupil;

[0049] Figure 4 is a schematic diagram of a pupil in a near vision state according to an embodiment of the present invention;

[0050] Figure 5 for Figure 4 Schematic diagram of the near horizontal boundary of the middle pupil;

[0051] Figure 6 A schematic diagram of a detection position within a telescopic arrangement range according to an embodiment of the present invention;

[0052] Figure 7 A schematic diagram of a detection position within a near-viewing arrangement range according to an embodiment of the present invention;

[0053] Figure 8 is a schematic diagram of a head coordinate system and a world coordinate system according to an embodiment of the present invention;

[0054] Fig. 9is a schematic diagram of a pupil positioning device in one embodiment of the present invention;

[0055] Fig.10 FIG. 1 is a schematic diagram of the relative positions of a pupil locating device and a user according to an embodiment of the present invention.

[0056] Description of Reference Numerals

[0057] 100, ground; 110, world coordinate system; 200, sight mark; 300, head; 310, pupil; 320, head coordinate system; 400, sight mark layout range; 410, far vision layout range; 411, far vision horizontal boundary; 420, near vision layout range; 421, near vision horizontal boundary; 430, horizontal projection line; 500, detection position; 510, width endpoint; 511, far vision width endpoint; 512, near vision width endpoint; 600, reference datum; 700, pupil positioning device; 710, control module; 720, display module; 730, drive module; 740, prompt module; 750, image acquisition module; 751, image acquisition area; 760, determination module; 770, acquisition module; 780, calculation module; 800, user. DETAILED DESCRIPTION

[0058] The following embodiments of the technical solution of the present application are described in detail in conjunction with the accompanying drawings. The following embodiments are only used to more clearly illustrate the technical solution of the present application, and are therefore only used as examples, and cannot be used to limit the scope of protection of the present application.

[0059] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by technicians in the technical field to which this application belongs; the terms used herein are only for the purpose of describing specific embodiments and are not intended to limit this application; the terms "including" and "having" in the specification and claims of this application and the above-mentioned figure descriptions and any variations thereof are intended to cover non-exclusive inclusions.

[0060] In the description of the embodiments of the present application, the technical terms "first", "second", "third", etc. are only used to distinguish different objects, and cannot be understood as indicating or implying relative importance or implicitly indicating the number, specific order or primary and secondary relationship of the indicated technical features. In the description of the embodiments of the present application, the meaning of "multiple" is more than two, unless otherwise clearly and specifically defined.

[0061] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0062] In the description of the embodiments of the present application, the term "and / or" is only a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0063] In the description of the embodiments of the present application, the orientation or position relationship indicated by the technical term "vertical direction" is based on the attached Figure 2 , Attachment Figure 4 or Figure 8 The directions or positional relationships indicated by the arrows W shown in the figure, wherein "above" refers to the side to which W1 points, and "below" refers to the side to which W2 points; the directions or positional relationships indicated by the technical term "left-right direction" are based on the attached Figure 3 , Attachment Figure 5 or Figure 8 The direction or position relationship indicated by the arrow T shown in the figure; the direction or position relationship indicated by the technical term "front-rear direction" is based on the attached Figure 2 , Attachment Figure 3 , Attachment Figure 4 , Attachment Figure 5 or attached Figure 8 The directions or positional relationships of the arrows U shown, where "rear" refers to the side to which U1 points, and "front" refers to the side to which U2 points. This is only for the convenience of describing the embodiments of the present application and simplifying the description, and does not indicate or imply that the device or element referred to must have a specific direction, be constructed, operated or used in a specific direction, and therefore cannot be understood as limiting the embodiments of the present application.

[0064] In the description of the embodiments of the present application, unless otherwise clearly specified and limited, technical terms such as "installed", "connected", "connected", "fixed" and the like should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, and it can be the internal connection of two elements or the interaction relationship between two elements. For those of ordinary skill in the art, the specific meanings of the above terms in the embodiments of the present application can be understood according to the specific circumstances.

[0065] In the description of the embodiments of the present application, unless otherwise clearly specified and limited, the technical term "contact" should be understood in a broad sense, and may be direct contact or contact through an intermediate medium layer. It may be contact with essentially no interaction force between the two contacting parties, or it may be contact with interaction force between the two contacting parties.

[0066] The following is a detailed description of the embodiments of the present invention.

[0067] See also Figure 1 The embodiment of the present invention provides a pupil 310 positioning method for determining the position of the pupil 310 of the user 800 relative to the head 300 in the far vision state and the near vision state, respectively. The pupil 310 positioning method includes the following steps in sequence:

[0068] S10. Determine the position of the reference datum and the range of sight mark arrangement.

[0069] The reference datum 600 refers to a reference object in the world coordinate system 110 . The world coordinate system 110 refers to a coordinate system established with the ground or a fixed object placed on the ground as a reference. The reference datum 600 is a reference object fixed in the world coordinate system 110 .

[0070] The optotype arrangement range 400 is a spatial range for arranging the optotype 200 so that the optotype 200 can be gazed at by the user 800 .

[0071] S20, controlling the sight mark to be within the sight mark arrangement range, so that the user 800 can focus on the sight mark 200.

[0072] It should be noted that the form of the visual mark 200 is not limited, and it can be a physical form or an image form.

[0073] S30. Acquire a first position of the pupil relative to a reference datum and a second position of the head relative to the reference datum when the user 800 is gazing at the sight mark.

[0074] The optotype 200 is located within the optotype arrangement range 400 , and when the user 800 is gazing at the optotype 200 , the pupil is in one of a far vision state and a near vision state.

[0075] The far vision state refers to the position state of the pupil when the user 800 observes an object at a far distance.

[0076] The near vision state refers to the position state of the pupil when the user 800 observes an object at a relatively close distance.

[0077] The first position refers to the coordinates of the center point of the pupil 310 relative to the reference datum 600 in the world coordinate system 110 .

[0078] The second position refers to the rotation angle of the head coordinate system 320 relative to the world coordinate system 110 and the coordinates of the origin of the head coordinate system 320 relative to the reference datum 600 in the world coordinate system 110 .

[0079] The attitude angle of the head 300 includes a roll angle, a pitch angle, and a yaw angle. Figure 8 The roll angle is the rotation angle of the head coordinate system 320 relative to the z-axis of the world coordinate system 110, the pitch angle is the rotation angle of the head coordinate system 320 relative to the x-axis of the world coordinate system 110, and the yaw angle is the rotation angle of the head coordinate system 320 relative to the y-axis of the world coordinate system 110.

[0080] S40: Calculate the offset position of the pupil relative to the head according to the first position and the second position.

[0081] The offset position of the pupil 310 relative to the head 300 refers to the relative coordinates of the center point of the pupil 310 relative to the head coordinate system 320 when the user 800 is gazing at the sight mark 200. Figure 8 The head coordinate system 320 is a coordinate system established with any position of the head 300 as the origin, and includes mutually orthogonal x'-axis, y'-axis and z'-axis. It is understandable that the head coordinate system 320 can move and deflect with the head 300 relative to the world coordinate system 110, that is, the x'-axis, y'-axis and z'-axis can move and deflect relative to the x-axis, y-axis and z-axis of the world coordinate system 110, respectively.

[0082] The pupil positioning method provided by the embodiment of the present invention can measure the offset position of the pupil 310 relative to the head 300 in the far vision state, and can also measure the offset position of the pupil 310 relative to the head 300 in the near vision state, thereby obtaining the position range of the pupil 310 relative to the head in the far vision state and the near vision state, respectively, which is conducive to realizing personalized customization of the eyeglasses of the user 800 according to the position range, so as to better meet the needs of the user 800.

[0083] In some embodiments, the sight mark arrangement range 400 is the far sight arrangement range 410, and determining the sight mark arrangement range 400 specifically includes:

[0084] S111 , obtaining the telescopic distance of the sight mark, the pupil level of the user 800 , and the upper limit angle of the sight line of the user 800 in the telescopic state, and calculating the first active height of the sight mark 200 .

[0085] The sight mark distance refers to the distance between the preset sight mark 200 within the sight mark arrangement range 410 and the center point of the pupil 310 in the front-to-back direction. Figure 2 , the far distance of the sight mark is Y.

[0086] The pupil eye level refers to the distance in the vertical direction between the center point of the pupil 310 and the ground 100 when the line of sight of the pupil 310 of the user 800 is parallel to the straight line in the front-back direction.

[0087] The upper limit angle refers to the angle between the line of sight and the straight line in the front and back directions when looking far away. Figure 2 , the upper limit angle is angle X.

[0088] The first moving height refers to the vertical distance between the sight mark 200 and the ground 100 when the sight mark 200 moves within the telescopic arrangement range 410. Figure 2 , the first activity height is V.

[0089] S112 . Obtain the far vision horizontal boundary 411 of the sight line of the user 800 in the far vision state.

[0090] The telescopic horizontal boundary 411 refers to the limit position that can be seen along the left and right directions in the telescopic state.

[0091] It can be understood that there are two far vision horizontal boundaries 411 , one is located on one side of the user 800 along the left-right direction, and the other is located on the other side of the user 800 along the left-right direction.

[0092] S113 , according to the far vision distance of the sight mark and the far vision horizontal boundary 411 , two far vision width endpoints 511 of the sight mark 200 are calculated.

[0093] On the far vision horizontal boundary 411 , the point that is at a distance from the center point of the pupil 310 in the front-to-back direction equal to the far vision distance of the sight mark is the far vision width endpoint 511 .

[0094] S114 , determining the distance vision arrangement range 410 according to the distance vision width endpoint 511 and the first active height.

[0095] The telescopic arrangement range 410 determined by the two telescopic width endpoints 511 and the first active height is an area under the world coordinate system 110 .

[0096] Through the above steps, the arrangement area of ​​the sight mark 200 is determined to meet the far vision state of the pupil 310, so as to facilitate the subsequent measurement of the position of the pupil 310 in the far vision state.

[0097] It is understandable that the upper limit angle of the sight line of the user 800 in the far vision state varies according to different users 800 , and therefore, the upper limit angle may be predefined based on experience, or the upper limit angle may be directly measured.

[0098] The upper limit angle selected based on experience ranges from 0° to 30°, and its specific value may be 0°, 5°, 10°, 15°, 20°, 25°, 30°, etc.

[0099] The specific method of calculating the first active height of the sight mark 200 according to the pupil horizontal height, the sight mark distance and the upper limit angle is not limited. Exemplarily, the calculation formula is as follows:

[0100] V=Z+Y*tan(X)

[0101] In some embodiments, see Figure 3 , obtaining the far-sighted horizontal boundary 411 of the sight line of the user 800 in the far-sighted state includes:

[0102] The maximum far viewing angles of the pupil 310 in the left and right directions are determined.

[0103] A horizontal projection line 430 of the horizontal sight line of the pupil 310 along the front-back direction on a projection plane perpendicular to the vertical direction is determined.

[0104] With the center point passing through the pupil 310 in the vertical direction as the rotation axis, the horizontal projection line 430 is rotated in the left and right directions by the maximum far vision viewing angle to obtain the far vision horizontal boundary 411.

[0105] The maximum far viewing angles of the pupil 310 in the left and right directions may be the same or different.

[0106] The maximum far-sighted viewing angle may directly select an empirical value based on general experience in the art, or may be directly measured on the user 800 during the measurement process to improve the customization accuracy.

[0107] See also Figure 3 , the maximum far-sighted viewing angle is the angle S in the figure.

[0108] The maximum far-sighted viewing angle is not less than 60°, and the specific value may be 60°, 65°, 70°, 75°, etc.

[0109] In some embodiments, the sight mark arrangement range 400 is the near sight arrangement range 420, and the step S10 of determining the sight mark arrangement range 400 specifically includes:

[0110] S121, obtaining the near viewing distance of the sight mark, the pupil level height of the user 800, and the lower limit angle of the sight line of the user 800 in the near viewing state, and calculating the second active height of the sight mark 200.

[0111] The near sight distance refers to the distance between the preset sight mark 200 in the near sight arrangement range 410 and the center point of the pupil 310 in the front-to-back direction. Figure 4 , the near distance of the sight mark is Y'.

[0112] The lower limit angle refers to the angle between the line of sight and the straight line in the front and back directions when looking at near objects. Figure 2 , the lower limit angle is angle X'.

[0113] The second moving height refers to the vertical distance between the sight mark 200 and the ground 100 when the sight mark 200 moves within the near sight arrangement range 410. Figure 2 , the second activity height is V'.

[0114] S122 . Obtain the near vision horizontal boundary 421 of the sight line of the user 800 in the near vision state.

[0115] The near vision horizontal boundary 421 refers to the extreme positions that can be seen along the left and right directions in the near vision state.

[0116] It can be understood that there are two near horizontal boundaries 421, namely Figure 4 Among S1' and S2', one is located on one side of the user 800 along the left-right direction, and the other is located on the other side of the user 800 along the left-right direction.

[0117] S123 , calculating two near vision width endpoints 512 of the sight mark 200 according to the sight mark near vision distance and the near vision horizontal boundary 421 .

[0118] On the near vision horizontal boundary 421 , the point that is at a distance from the center point of the pupil 310 in the front-to-back direction equal to the near vision distance of the sight mark is the near vision width endpoint 512 .

[0119] S124 , determining the near view arrangement range 420 according to the near view width endpoint 512 and the second active height.

[0120] The near arrangement range 420 determined by the two near width endpoints 512 and the first active height is an area under the world coordinate system 110 .

[0121] Through the above steps, the arrangement area of ​​the sight mark 200 is determined to meet the near vision state of the pupil 310, so as to facilitate the subsequent measurement of the position of the pupil 310 in the near vision state.

[0122] It is understandable that the lower limit angle X' of the line of sight of the user 800 in the near vision state may vary according to different users 800, and therefore, the lower limit angle may be predefined based on experience, or the lower limit angle may be directly measured.

[0123] The range of the lower limit angle X' selected based on experience is 40° to 60°, and its specific value can be 40°, 45°, 50°, 55°, 60°, etc.

[0124] The specific method of calculating the second active height of the sight mark 200 according to the pupil horizontal sight height, the sight mark near distance and the lower limit angle is not limited. Exemplarily, the calculation formula is as follows:

[0125] V' = ZY' * tan(X');

[0126] In some embodiments, see Figure 3 , obtaining the near horizontal boundary 421 of the sight line of the user 800 in the near state includes:

[0127] The maximum near viewing angles of the pupil 310 in the left and right directions are determined.

[0128] A horizontal projection line 430 of the horizontal sight line of the pupil 310 along the front-back direction on a projection plane perpendicular to the vertical direction is determined.

[0129] With the center point passing through the pupil 310 in the vertical direction as the rotation axis, the horizontal projection line 430 is rotated in the left and right directions by the maximum near visual angle to obtain the near horizontal boundary 421 .

[0130] The maximum near viewing angles of the pupil 310 in the left and right directions may be the same or different.

[0131] The maximum near viewing angle may directly select an empirical value based on general experience in the art, or the user 800 may be directly measured during the measurement process to improve the customization accuracy.

[0132] See also Figure 5 , the maximum near viewing angle is the angle S' in the figure.

[0133] The maximum near viewing angle is not less than 60°, and the specific value may be 60°, 65°, 70°, 75°, etc.

[0134] In some embodiments, see Figure 6 and Figure 7 Before obtaining the first position of the pupil 310 relative to the reference datum 600 and the second position of the head 300 relative to the reference datum 600 when the user 800 is gazing at the sight mark 200, the pupil positioning method further includes:

[0135] The positions of the two width end points 510 of the sight mark arrangement range 400 along the left and right directions of the user 800 and the width distance therebetween are acquired.

[0136] The width distance between the two width endpoints 510 refers to the distance between the two width endpoints 510 along the left-right direction in the world coordinate system 110 .

[0137] The number of detection positions 500 of the sight mark 200 within the sight mark arrangement range 400 is determined.

[0138] The position of the detection position 500 is calculated based on the position of the width endpoint 510 , the width distance, and the number of the detection positions 500 .

[0139] The sight mark 200 is controlled to be located at the detection position 500 , and the user 800 is prompted to look at the sight mark 200 located at each detection position 500 .

[0140] When the user 800 is looking at the sight mark 200 located at the detection position 500, the pupil 310 is in the far-sighted state and the near-sighted state. Thus, by controlling the specific position of the sight mark 200, the pupil 310 of the user 800 is placed in the far-sighted state and the near-sighted state, thereby facilitating the acquisition of the position of the pupil 310 in the two states.

[0141] It can be understood that in the embodiment where the sight mark arrangement range is the far sight arrangement range, refer to Figure 6 , the width endpoint 510 is the telescopic width endpoint 511 .

[0142] It can be understood that in the embodiment where the sight mark arrangement range is the near sight arrangement range, refer to Figure 7 , width endpoint 510 is near width endpoint 512 .

[0143] The number of the detection positions 500 may be one or more, for example, 1, 2, 3, 4, 5, 6, etc. When the width distance is constant, the more the number of detection positions 500 is, the more positions the sight mark 200 can appear, and the measured position of the pupil 310 relative to the head 300 in the far vision state and the near vision state is more accurate.

[0144] It is understandable that due to the structural limitations of the human eye, in some embodiments, the near sight distance is equal to the far sight distance, and the width distance between the two far sight width endpoints 511 is greater than the width distance between the two near sight width endpoints 512 .

[0145] In some embodiments, see Figure 6 and Figure 7 , a plurality of detection positions 500 are arranged at intervals along the left-right direction of the user 800 , and two width endpoints 510 correspond to a detection position 500 at both ends along the left-right direction of the user 800 .

[0146] This is helpful in obtaining the maximum offset position of the pupil 310 relative to the head 300 along the left-right direction, and further helpful in obtaining the position of the pupil 310 when it is looking at the sight mark 200 at the extreme position along the left-right direction in the far vision state and the near vision state, thereby helping to more accurately obtain the activity range of the pupil 310 in the far vision state and the near vision state, respectively.

[0147] The spacing distance between two adjacent detection positions 500 along the left-right direction may be a fixed value or a variable value.

[0148] In some embodiments, controlling the sight mark 200 to be located at the detection position 500 specifically includes: controlling the sight mark 200 to appear in each detection position 500 from one side to the other side along the left-right direction of the user 800 .

[0149] From one side to the other side along the left-right direction of the user 800 may be from the left side to the right side along the left-right direction of the user 800 , or may be from the right side to the left side along the left-right direction of the user 800 .

[0150] This helps to make the pupil 310 of the user 800 move unidirectionally in the left-right direction, making it easier for the user 800 to focus on the single sight mark 200 more quickly, improving the efficiency of locating the pupil 310 and improving the comfort of the user 800 during the measurement process.

[0151] The successive appearance at each detection position 500 may mean that after the sight mark 200 appears at a detection position 500, the sight mark 200 at the detection position 500 does not disappear, another sight mark 200 appears at another detection position 500, and so on. The sight mark 200 at the previous detection position 500 will not disappear after the sight mark 200 at the next detection position 500 appears, that is, a plurality of sight marks 200 can appear simultaneously in the sight mark arrangement range 400; or it may mean that after the sight mark 200 appears at a detection position 500, the sight mark 200 at the detection position 500 will disappear before or at the same time as another sight mark 200 appears at another detection position 500, that is, only one sight mark 200 can appear simultaneously in the sight mark arrangement range 400.

[0152] In some embodiments, controlling the sight mark 200 to appear successively at each detection position 500 along the left-right direction of the user 800 from one side to the other side specifically includes:

[0153] The display module is controlled to display the sight mark 200 in each detection position 500 in sequence from one width end point 510 to another width end point 510 along the left and right direction of the user 800 , and the sight mark 200 is displayed only in one detection position 500 at the same time.

[0154] The display module 720 is a module for displaying the optotype 200 , that is, the optotype 200 is a specific image displayed on the display module 720 .

[0155] It is understandable that if the sight mark 200 is displayed at only one detection position 500 at the same time, it means that the sight mark 200 at the previous detection position 500 disappears before the sight mark 200 is displayed at the next detection position 500 in sequence.

[0156] This is conducive to simplifying the method of forming the sight mark 200 and facilitating the formation of the sight mark 200 at a low cost; at the same time, only one sight mark 200 is displayed at a time, which avoids interference of other sight marks on the user 800's gaze, reduces the risk of incorrect measurement results due to incorrect position observation by the user 800, and improves measurement accuracy.

[0157] The display area of ​​the display module 720 can cover all detection positions 500 in the sight mark arrangement range 400, and display the sight mark 200 at each detection position 500 in turn; or it can only cover part of the detection positions 500 in the sight mark arrangement range 400, and after displaying the sight mark 200 at the covered part of the detection positions 500, move the display module so that the display area can cover the other parts of the detection positions 500.

[0158] In some embodiments, obtaining a first position of the pupil 310 relative to the reference datum 600 and a second position of the head 300 relative to the reference datum 600 when the user 800 is gazing at the sight mark 200 specifically includes:

[0159] S31 . After prompting the user 800 to look at the sight mark 200 , control the image acquisition module 750 to photograph the user 800 to obtain a reference image including the pupil 310 and the head 300 of the user 800 .

[0160] The image acquisition module 750 includes an image acquisition area 751 , which is used to face the front of the user 800 to acquire a reference image including the pupil 310 and the head 300 of the user 800 .

[0161] The image acquisition module 750 can be a binocular camera or a monocular camera. The image acquisition area 751 is the lens of the camera.

[0162] S32: Process the reference image and calculate the first position and the second position.

[0163] In this way, calculating the first position and the second position by collecting images is beneficial to improving the speed of collecting data. At the same time, the collection process is non-contact with the user 800, which is beneficial to improving the user 800 experience.

[0164] The first position and the second position are calculated by using the reference image. The coordinates of the reference point in the reference image need to be normalized to transform the coordinates of the reference point from a point in the image coordinate system in the reference image to a point in the world coordinate system 110 .

[0165] The reference point refers to the coordinate position of the center point of the pupil 310 and the coordinate position of the origin of the head coordinate system 320 in the image coordinate system after the reference image is acquired.

[0166] First, the distortion of the image acquisition area 751 of the image acquisition module 750 is removed. This embodiment simplifies the process and focuses on basic transformation.

[0167] The image point coordinates (u, v) of the reference point are obtained, the unit of the point coordinates is pixel, and the internal parameter matrix K of the image acquisition module 750. The internal parameter matrix K is a 3×3 matrix in the following form:

[0168]

[0169] f x and f y is the focal length (in pixels) in the x and y directions; s is the distortion coefficient, which can be 0; C x and C y are the coordinates of the center of the image.

[0170] According to the inverse matrix K of the internal parameter matrix K -1 , convert the image point coordinates (u, v) to normalized image coordinates (x, y, 1).

[0171] Specifically, we first define the image coordinates (u, v) as a two-dimensional vector and construct a homogeneous coordinate vector [u, v, 1]. Then, we use the inverse matrix K of the intrinsic parameter matrix K -1 Multiply the image coordinate (u, v) by the homogeneous coordinate vector [u, v, 1]. The mathematical expression is as follows:

[0172]

[0173] In this way, the coordinate position of each reference point in the two-dimensional image coordinate system is converted into the coordinate position in the three-dimensional normalized image coordinate system, which is beneficial to reduce the measurement error caused by image distortion and is also beneficial to obtain the relative reference benchmark of the pupil.

[0174] The conversion of the coordinates of the reference point from the normalized image coordinate system to the world coordinate system 110 requires the attitude angle and position of the image acquisition module 750, which are represented by a rotation matrix P and a translation vector Q respectively. The rotation matrix P and the translation vector Q are obtained when the image acquisition module 750 is calibrated.

[0175] The normalized image coordinates (x, y, 1) and their corresponding world coordinates are (X w , Y w , Z w ), the relationship between the two is expressed by the following formula:

[0176]

[0177] In this way, the conversion of each reference point from the two-dimensional image coordinate system to the three-dimensional world coordinate system 110 is realized, thereby obtaining the coordinates of the first position and the coordinates of the second position in the world coordinate system 110, so that the coordinates of the first position and the second position can be subsequently calculated in the same coordinate system, and the measurement error caused by the attitude angle and position of the image acquisition module 750 itself is reduced.

[0178] The present application also provides a pupil positioning device 700 for positioning the pupil. Fig. 9 The pupil positioning device 700 includes a determination module 760 , a control module 710 , an acquisition module 770 and a calculation module 780 .

[0179] The determination module 760 is used to determine the position of the reference datum 600 and the sight mark arrangement range 400 .

[0180] The control module 710 is used to control the sight mark 200 to be within the sight mark arrangement range 400 .

[0181] The acquisition module 770 is used to acquire a first position of the pupil 310 relative to the reference datum 600 and a second position of the head 300 relative to the reference datum 600 when the user 800 is gazing at the sight mark 200 .

[0182] The calculation module 780 is used to calculate the offset position of the pupil 310 relative to the head 300 according to the first position and the second position.

[0183] The pupil positioning device 700 provided in the embodiment of the present application can implement the pupil positioning method in the aforementioned embodiment, and is conducive to obtaining the offset position of the pupil 310 relative to the head 300 in the far vision state and the near vision state, so as to be used in the field of making eyeglass lenses, and is conducive to realizing the personalized customization of eyeglass lenses. In some embodiments, the pupil positioning device 700 also includes a display module 720, and the display area of ​​the display module 720 is used to face the front of the user 800, and the display area is used to form at least part of the sight mark arrangement range 400 and display the sight mark 200, and the control module 710 is also used to control the display module 720 to display the sight mark 200 in different positions.

[0184] The display module 720 can display multiple optotypes 200 at the same time, or can display only one optotype 200 at the same time, which is controlled by the control module 710 .

[0185] The specific type of the display module 720 is not limited, and the display module 720 is exemplarily a display. In this way, it is convenient to flexibly adjust the specific pattern form and size of the sight mark 200, and it is also convenient to adjust the specific position of the detection position 500 according to the situation of different users 800, thereby improving the flexibility of the pupil positioning device 700.

[0186] In one embodiment, the display module 720 is a display with a resolution of 1920*1080 and a screen size of 21 inches, so that the display area of ​​the display can cover all detection positions 500 in the sight mark arrangement range 400. The width of the sight mark 200 is 1 / 10 of the width of the display, and the interval between two adjacent detection positions 500 in the left-right direction is 5 cm.

[0187] For further information, see Fig.10 The pupil positioning device 700 further includes a driving module 730, which is connected to the display module 720 to drive the display module 720 to move in a three-dimensional space.

[0188] The driving module 730 can adjust the height of the display module 720 according to the height of the user 800, and can also flexibly adjust the distance between the display module 720 and the user 800 in the front-to-back direction, thereby improving the use flexibility of the pupil locating device 700.

[0189] The specific form of the driving module 730 is not limited. Exemplarily, the driving module 730 includes a cart and a lifting platform. The lifting platform is arranged on the cart. The lifting platform is provided with a mounting seat that can be lifted and lowered in a vertical direction. The display module 720 is arranged on the mounting seat.

[0190] In some embodiments, see Fig.10 The pupil locating device 700 also includes a prompting module 740, which is used to prompt the user 800 to look at the sight mark 200, so that the user 800 can look at the sight mark 200 in time before the image acquisition module 750 obtains the reference image, thereby facilitating the image acquisition module 750 to capture the reference image of the user 800 looking at the sight mark 200.

[0191] The prompt module 740 can remind the user 800 in the form of sound, light, screen, etc.

[0192] In some embodiments, the prompt module 740 is a dual-channel speaker, and the control module 710 is further used to control the dual-channel speaker to broadcast the prompt sound so that the user 800 can look at the corresponding detection position.

[0193] In some embodiments, see Fig.10 The pupil locating device 700 further includes an image acquisition module 750 , an image acquisition area 751 of the image acquisition module 750 is used to face the front of the user 800 , and the image acquisition module 750 is used to acquire a reference image including the pupil 310 and the head 300 of the user 800 .

[0194] The reference image includes an image of the pupil 310 and an image of the head 300 when the user 800 looks at each sight mark 200 .

[0195] Therefore, the reference image is helpful to unify the posture angle of the head 300, and then obtain the offset position of the pupil 310 under the same posture angle of the head 300.

[0196] In some embodiments, the image acquisition module 750 is a binocular camera, and the image acquisition area 751 is a lens of the binocular camera.

[0197] In this way, the binocular camera can be used to perform the distance measurement function, which is helpful for calculating the positions of the pupil and the head along the front-to-back direction, and then the calculation module 780 calculates the respective deflection angles of the two.

[0198] In some embodiments, a 6.3-megapixel CMOS (Complementary Metal Oxide Semiconductor) binocular camera is used, and the focal length of the lens is 35 mm. In order to better capture the reference image including the pupil 310 and the head 300 of the user 800, the binocular camera is arranged above the display module 720, and the user 800 can stand at a distance of 0.5 m from the lens. It should be noted that the binocular camera can be calibrated before working, and the captured images for calibration are unified on the y-axis in the world coordinate system 110, and then the x-axis coordinates of the two lenses in the world coordinate system 110 are calculated in real time. The x-axis coordinate difference of the two lenses is the parallax, and the parallax can be further converted into depth information, that is, the ranging function of the binocular camera is realized.

[0199] An embodiment of the present invention further provides a storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the pupil positioning method in any one of the aforementioned embodiments are implemented.

[0200] The storage medium may be a computer-readable storage medium, for example, a memory storing a computer program, such as a ROM, PROM, EPROM, EEPROM, Flash Memory, magnetic surface storage, optical disk or CD-ROM.

[0201] It is understood that the memory may be a volatile memory or a non-volatile memory, and may also include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory (FRAM), a flash memory, a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM); the magnetic surface memory may be a disk memory or a tape memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), synchronous static random access memory (SSRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM, SyncLink Dynamic Random Access Memory), and direct RAM bus random access memory (DRRAM, Direct Rambus Random Access Memory).The memories described in the embodiments of the present invention are intended to include, but are not limited to, these and any other suitable types of memories.

[0202] It is understandable that when the user 800 wears the glasses, the glasses deflect and move with the head. Therefore, the position of the lens relative to the head 300 is measured in the world coordinate system 110, and the position of the pupil 310 relative to the lens can be obtained according to the position of the pupil 310 relative to the head 300. In this way, along the front-back direction, the projection of the position of the pupil 310 on the lens in the far vision state and the near vision state is obtained, and the lens parameters such as the diopter of the projection position are optimized, which is conducive to meeting the use requirements of different users 800 for the lens.

[0203] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them; although the present application is described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions loaded in the above embodiments, or replace some or all of the technical features therein by equivalents; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application, and they should all be included in the scope of the claims and specification of the present application. In particular, as long as there is no structural conflict, the various technical features mentioned in the various embodiments can be combined in any way. The present application is not limited to the specific embodiments disclosed herein, but includes all technical solutions that fall within the scope of the claims.

Claims

1. A pupil positioning method for determining the position of a user's pupil relative to the head in a far-sighted state and a near-sighted state, characterized in that: include: Determine the position of the reference datum and the range of sight mark arrangement; Controlling the sight mark to be within the sight mark arrangement range; Acquire a first position of the pupil relative to the reference datum and a second position of the head relative to the reference datum when the user is gazing at the sight mark; The offset position of the pupil relative to the head is calculated based on the first position and the second position.

2. The pupil positioning method according to claim 1, characterized in that: The sight mark arrangement range is the distance sight arrangement range, and determining the sight mark arrangement range specifically includes: Obtaining the telescopic distance of the sight mark, the pupil level of the user, and the upper limit angle of the user's line of sight in the telescopic state, and calculating the first active height of the sight mark; Acquire the far vision horizontal boundary of the user's line of sight in the far vision state; According to the sight mark distance and the sight mark horizontal boundary, two sight mark width endpoints are calculated; The telescopic arrangement range is determined according to the telescopic width endpoint and the first active height.

3. The pupil positioning method according to claim 1, characterized in that: The sight mark arrangement range is the near sight arrangement range, and determining the sight mark arrangement range specifically includes: Obtaining the near-sighted distance of the sight mark, the pupil level of the user, and the lower limit angle of the user's line of sight in the near-sighted state, and calculating the second active height of the sight mark; Acquire a near vision horizontal boundary of a user's line of sight in the near vision state; According to the sight mark near distance and the near horizontal boundary, two near width endpoints of the sight mark are calculated; The near viewing arrangement range is determined according to the near viewing width endpoint and the second active height.

4. The pupil positioning method according to claim 1, characterized in that: Before obtaining the first position of the pupil relative to the reference datum and the second position of the head relative to the reference datum when the user is gazing at the sight mark, the pupil locating method further includes: Obtaining the positions of two width end points of the sight mark arrangement range along the left and right directions of the user and the width distance therebetween; Determining the number of detection positions of the sight mark within the sight mark arrangement range; Calculating the position of the detection position according to the position of the width endpoint, the width distance and the number of the detection positions; The sight mark is controlled to be located at the detection position, and the user is prompted to look at the sight mark located at each detection position.

5. The pupil positioning method according to claim 4, characterized in that: The plurality of detection positions are arranged at intervals along the left-right direction of the user, and the two width end points correspond to one of the detection positions at both ends along the left-right direction of the user respectively.

6. The pupil positioning method according to claim 5, characterized in that: The controlling the sight mark to be located at the detection position specifically includes: The sight mark is controlled to move from one side to the other side along the left and right direction of the user, so that each of the detection positions appears one by one.

7. The pupil positioning method according to claim 6, characterized in that: The controlling the sight mark to appear successively at each of the detection positions from one side to the other side along the left-right direction of the user specifically includes: The display module is controlled to display the sight mark at each detection position in sequence from one width end point to another width end point along the left and right direction of the user, and the sight mark is displayed only at one detection position at the same time.

8. The pupil positioning method according to claim 1, characterized in that: The obtaining of a first position of the pupil relative to the reference datum and a second position of the head relative to the reference datum when the user is gazing at the sight mark specifically includes: After prompting the user to look at the sight mark, controlling the image acquisition module to photograph the user to acquire a reference image including the user's pupil and head; The reference image is processed to calculate the first position and the second position.

9. A pupil locating device, characterized in that: include: A determination module, used to determine the position of the reference datum and the range of sight mark arrangement; A control module, used for controlling the sight mark to be within the sight mark arrangement range; An acquisition module, used for acquiring a first position of the pupil relative to the reference datum and a second position of the head relative to the reference datum when the user is gazing at the sight mark; A calculation module is used to calculate the offset position of the pupil relative to the head according to the first position and the second position.

10. The pupil positioning device according to claim 9, characterized in that: The pupil positioning device also includes a display module, a display area of ​​the display module is used to face the front of the user, the display area is used to form at least part of the sight mark arrangement range and display the sight mark, and the control module is also used to control the display module to display the sight mark.

11. The pupil positioning device according to claim 10, characterized in that: The pupil positioning device further comprises a driving module, which is drivingly connected to the display module to drive the display module to move in a three-dimensional space.

12. The pupil positioning device according to claim 9, characterized in that: The pupil locating device further comprises a prompting module, and the prompting module is used to prompt the user to look at the sight mark.

13. The pupil positioning device according to claim 9, characterized in that: The pupil locating device further comprises an image acquisition module, the image acquisition area of ​​the image acquisition module is used to face the front of the user, the image acquisition module is used to acquire a reference image including the pupil and head of the user, and the control module is further used to control the image acquisition module to photograph the user.

14. The pupil positioning device according to claim 13, characterized in that: The image acquisition module is a binocular camera, and the image acquisition area is a lens of the binocular camera.

15. A storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the pupil positioning method according to any one of claims 1 to 8 are implemented.

Images