Correction method, electronic device and non-transient computer readable storage medium

Abstract

A correction method is disclosed. The correction method is suitable for the electronic device. The electronic device comprises a head-mounted display device. The correction method comprises the following steps: when a user gazes at a first correction gaze point, obtaining first eye information of a first eye of the user; and calculating at least one of second eye information of the first eye of the user and third eye information of the second eye of the user by mirroring the first eye information. The time of the correction process is shortened, and the accuracy of the correction process is improved.

Description

Technical Field

[0001] The present disclosure relates to a calibration method, an electronic device, and a non-transitory computer-readable storage medium, and in particular to a calibration method, an electronic device, and a non-transitory computer-readable storage medium for an eye tracking function. Background Art

[0002] In VR and AR application scenarios, the user's eye movements are tracked through sensing devices or photographic circuits, and relevant information such as the user's eye vision and eye appearance is reflected in the virtual world, so that the user can interact with others in the virtual world of the virtual reality (VR) or augmented reality (AR) environment.

[0003] In order to reflect the user's eye movement information in the virtual world of the VR / AR environment, a calibration process will be performed so that the user's eye movement information can be more accurately mapped in the virtual world. However, the calibration process may be time-consuming, and the user's eyes may feel uncomfortable after watching VR content for a long time, thereby reducing the accuracy of the collection and accumulation conditions and affecting the accuracy of the overall calibration. Summary of the invention

[0004] One embodiment of the present disclosure discloses a calibration method. The calibration method is applicable to an electronic device. The electronic device includes a head-mounted display device. The calibration method includes: when a user gazes at a first calibration gaze point, obtaining first eye information of a first eye of the user; and calculating at least one of second eye information of the first eye of the user and third eye information of the second eye of the user by mirroring the first eye information.

[0005] In some embodiments, it is characterized in that a first symmetry axis is located on a connecting line of a first center point of the first eye and a second center point of the second eye, and the second eye information of the first eye is mirror-symmetric to the first eye information about the first symmetry axis.

[0006] In some embodiments, it is characterized in that, when the first eye information is obtained when the first eye gazes at the first correction gaze point, and a first correction gaze direction corresponding to the first correction gaze point is upward, the second eye information corresponds to the first eye gaze at a second correction gaze point, and a second correction gaze direction corresponding to the second correction gaze point is downward, wherein the first correction gaze point and the second correction gaze point are mirror-symmetrical about the first symmetry axis; wherein when the first eye information is obtained when the first eye gazes at the first correction gaze point, and the first correction gaze direction is downward, the second eye information corresponds to the first eye gaze at the second correction gaze point, and the second correction gaze direction is upward, wherein the first correction gaze point and the second correction gaze point are mirror-symmetrical about the first symmetry axis.

[0007] In some embodiments, it is characterized in that the first eye information is captured by a camera circuit located on a vertical line, wherein the vertical line is perpendicular to the first symmetry axis and a second symmetry axis, wherein the second symmetry axis is located between the first eye and the second eye, and the second symmetry axis is perpendicular to the first symmetry axis.

[0008] In some embodiments, it is characterized in that a first symmetry axis is located on a connecting line between a first center point of the first eye and a second center point of the second eye, a second symmetry axis is located between the first eye and the second eye, and the second symmetry axis is perpendicular to the first symmetry axis, and the third eye information of the second eye is mirror-symmetric to the first eye information about the second symmetry axis.

[0009] In some embodiments, it is characterized in that, when the first eye information is obtained when the first eye gazes at the first correction gaze point, and a first correction gaze direction corresponding to the first correction gaze point is toward a first outer side of the first eye, the third eye information corresponds to the second eye gaze at a second correction gaze point, and a second correction gaze direction corresponding to the second correction gaze point is toward a second outer side of the second eye, wherein the first correction gaze point and the second correction gaze point are mirror-symmetric about the second symmetry axis; wherein when the first eye information is obtained when the first eye gazes at the first correction gaze point, and the first correction gaze direction is toward a first inner side of the first eye, the third eye information corresponds to the second eye gaze at the second correction gaze point, and the second correction gaze direction is toward a second inner side of the second eye, wherein the first correction gaze point and the second correction gaze point are mirror-symmetric about the second symmetry axis.

[0010] In some embodiments, the method further comprises: calculating a fourth eye information of the second eye by mirroring at least one of the second eye information and the third eye information.

[0011] Another embodiment of the present disclosure discloses an electronic device. The electronic device includes a camera circuit and a processing circuit. The camera circuit is used to capture first eye information of a first eye of a user when the user gazes at a first calibrated gaze point. The processing circuit is coupled to the camera circuit. The processing circuit is used to calculate at least one of second eye information of the first eye of the user and third eye information of the second eye of the user by mirroring the first eye information.

[0012] In some embodiments, it is characterized in that a first symmetry axis is located along a connecting line between a first center point of the first eye and a second center point of the second eye, and the second eye information of the first eye is mirror-symmetric to the first eye information about the first symmetry axis.

[0013] Another embodiment of the present disclosure discloses a non-transitory computer-readable storage medium storing at least one instruction program executed by a processing unit to run a calibration method. The calibration method includes: when the user gazes at a first calibration gaze point, obtaining first eye information of the user's first eye by a camera circuit; and calculating at least one of second eye information of the user's first eye and third eye information of the user's second eye by a processing circuit through mirroring the first eye information.

[0014] It should be noted that the above description and the following detailed description are illustrative of the present case in the form of embodiments, and are used to assist in the explanation and understanding of the invention content claimed in the present case. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to make the above and other objects, features and embodiments of the present disclosure more clearly understood, the accompanying drawings are described as follows:

[0016] Figure 1 is a schematic diagram of an electronic device according to some embodiments of the present disclosure;

[0017] Figure 2 is a flow chart of a correction method according to some embodiments of the present disclosure;

[0018] Figure 3 is a schematic diagram of an operation of an electronic device according to some embodiments of the present disclosure;

[0019] Figure 4 is a schematic diagram of a user's face according to some embodiments of the present disclosure;

[0020] Figure 5A According to some embodiments of the present disclosure, Figure 2 A schematic diagram of the operation of one of the steps in FIG.

[0021] Figure 5B According to some embodiments of the present disclosure, Figure 2 A schematic diagram of the operation of one of the steps in FIG.

[0022] Fig. 6A According to some embodiments of the present disclosure, Figure 2 A schematic diagram of the operation of one of the steps in FIG.

[0023] Figure 6B According to some embodiments of the present disclosure, Figure 2 A schematic diagram of the operation of one of the steps in ; and

[0024] Figure 7 is a schematic diagram showing the location of a camera circuit according to some embodiments of the present disclosure.

[0025] Explanation of symbols:

[0026] 100: Electronic devices

[0027] 110: Processing circuit

[0028] 120: Storage device

[0029] 130: Camera circuit

[0030] 150: Display circuit

[0031] 200: Calibration method

[0032] S210, S230: Step X, Y: Coordinate Axis

[0033] CP1,CP2,CP3,CP4,CP5,CP6,CP7,CP8,CP9: Correction gaze point

[0034] VD1,VD2,VD3,VD4,VD5,VD6,VD7,VD8,VD9: Correct gaze direction

[0035] E: Eyes

[0036] 400:Example

[0037] E1: Eye (right eye)

[0038] E2: Eye (left eye)

[0039] SA1, SA2: Axis of symmetry

[0040] MD:Point

[0041] C1, C2: center point

[0042] CL: Connecting cable

[0043] U: User

[0044] PA: Vertical Line DETAILED DESCRIPTION

[0045] The following disclosure provides many different embodiments or examples for implementing different features of the present disclosure. The elements and configurations in the specific examples are used to simplify the present disclosure in the following discussion. Any examples discussed are used for illustrative purposes only and do not limit the scope and significance of the present disclosure or its examples in any way. Where appropriate, the same reference numerals are used between the drawings and in the corresponding text descriptions to represent the same or similar elements.

[0046] It should be understood that in the description herein and throughout the appended claims, when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element. In contrast, when an element is referred to as being "directly connected" or "directly coupled" to another element, there are no intervening elements. In addition, "electrically connected" or "connected" may further refer to a step or interaction between two or more elements.

[0047] It should be understood that, in the description herein and throughout the appended claims, although the terms "first", "second", etc. may be used to describe various elements, these elements should not be limited to these terms being used only to distinguish one element from another. For example, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element without departing from the scope of the embodiments.

[0048] It should be understood that in the description herein and throughout the appended claims, the words indicating directions, such as "above", "below", "left", "right", "front", and "rear" used in the description of the following embodiments are directions related to the accompanying drawings. Therefore, these words indicating directions are only used for illustrative purposes and do not limit the present disclosure.

[0049] See also Figure 1 . Figure 1 is a schematic diagram of an electronic device 100 according to some embodiments of the present disclosure. The electronic device 100 can perform eye tracking to detect the gaze direction of the user. Specifically, in some embodiments, the electronic device 100 can be applied to virtual reality (VR) / mixed reality (MR) / augmented reality. For example, the electronic device 100 can be implemented by an independent head-mounted device (HMD) or VIVE HMD (a virtual reality head-mounted display). Specifically, the independent HMD or VIVE HMD can process position data such as position and rotation, graphics processing, or other data calculations.

[0050] like Figure 1As shown, the electronic device 100 includes a processing circuit 110, a storage device 120, a camera circuit 130, and a display circuit 150. The storage device 120 stores one or more programs and is configured to be executed by the processing circuit 110 to perform the calibration method.

[0051] The processing circuit 110 is electrically connected to the camera circuit 130. In some embodiments, the processing circuit 110 can be implemented by, for example, one or more processing circuits, such as a central processing circuit and / or a microprocessor circuit, but the implementation of the present case is not limited thereto. In some embodiments, the storage device 120 includes one or more storage modules, each storage module includes or multiple storage modules together include a computer-readable storage medium. The computer-readable storage medium may include a read-only memory (ROM), a flash memory, a floppy disk, a hard disk, an optical disk, a flash disk, a USB flash disk, a magnetic tape, a database accessible from a network, and / or any storage medium with the same function that can be thought of by a technician in the field of the present disclosure.

[0052] Structurally, the storage device 120 is electrically connected to the processing circuit 110. The camera circuit 130 can capture one or more images of the user's eyes so that the processing circuit 110 can analyze the one or more images to perform eye tracking. In some embodiments, the camera circuit 130 can be implemented by an infrared camera circuit element or any other camera circuit with image capture function. It should be noted that Figure 1 The embodiments shown in the figure are merely illustrative, and the implementation of the present invention is not limited thereto. The display circuit 150 is electrically connected to the processing circuit 110 , so that the video and / or audio content displayed by the display circuit 150 is controlled by the processing circuit 110 .

[0053] See also Figure 2 In order to better understand the present invention, the following will be referred to Figure 2 The illustrated embodiment is used to illustrate detailed operation steps of the electronic device 100 . Figure 2 is a flow chart of a calibration method 200 according to some embodiments of the present disclosure. It should be noted that the calibration method 200 can be applied to Figure 1 The electronic device 100 shown in FIG. 1 is an electronic device with the same or similar structure as the electronic device 100 shown in FIG. 1 . Figure 1 As an example, the calibration method 200 according to some embodiments of the present invention is described. However, the embodiments of the present invention are not limited to the application Figure 1 The embodiment shown. Figure 2 The calibration method 200 shown includes steps S210 to S230 .

[0054] In step S210 , when the user gazes at the first calibrated gaze point, the camera circuit 130 obtains first eye information of the user's first eye.

[0055] See also Figure 3 . Figure 3 is a schematic diagram of the operation of an electronic device 100 according to some embodiments of the present disclosure.

[0056] like Figure 3 As shown, in some embodiments, in step S210, the processing circuit 110 may control the display circuit 150 to display the corrected gaze points CP1 to CP9 in a continuous multi-frame manner. The corrected gaze points CP1 to CP9 correspond to one of the corrected gaze directions VD1 to VD9 respectively.

[0057] For example, in Figure 3 In the first frame shown, the display circuit 150 displays the corrected gaze point CP1, which corresponds to the corrected gaze direction VD1. In the next frame, the display circuit 150 displays the corrected gaze point CP2, which corresponds to another corrected gaze direction VD3, and so on.

[0058] Accordingly, the processing circuit 110 may control the camera circuit 130 to sequentially capture eye information of the eyes in multiple frames.

[0059] Assume that the corrected gaze point CP1 is located at the origin of the coordinate system. The corrected gaze point CP2 is located at the coordinate (0, 1), the corrected gaze point CP3 is located at the coordinate (√0.5, √0.5), the corrected gaze point CP4 is located at the coordinate (1, 0), the corrected gaze point CP5 is located at the coordinate (√0.5, -√0.5), the corrected gaze point CP6 is located at the coordinate (0, -1), the corrected gaze point CP7 is located at the coordinate (-√0.5, -√0.5), the corrected gaze point CP8 is located at the coordinate (-1, 0), the corrected gaze point CP7 is located at the coordinate (-√0.5, -√0.5), and CP9 is located at the coordinate (-√0.5, √0.5). The coordinates of the corrected gaze points CP1 to CP9 are only for illustrative purposes, and the embodiments of the present invention are not limited thereto.

[0060] for Figure 3 As shown in the eye E, when the eye E gazes at the correction gaze point CP4, for the eye E, the correction gaze direction VD4 corresponding to the correction gaze point CP4 is rightward. When the eye E gazes at the correction gaze point CP8, for the eye E, the correction gaze direction VD8 corresponding to the correction gaze point CP8 is leftward. When the eye E gazes at the correction gaze point CP2, for the eye E, the correction gaze direction VD2 corresponding to the correction gaze point CP2 is upward. When the eye E gazes at the correction gaze point CP6, for the eye E, the correction gaze direction VD6 corresponding to the correction gaze point CP6 is downward.

[0061] When the eye E gazes at the correction gaze point CP3, the correction gaze direction VD3 corresponding to the correction gaze point CP3 is the upper right for the eye E. When the eye E gazes at the correction gaze point CP5, the correction gaze direction VD5 corresponding to the correction gaze point CP5 is the lower right for the eye E. When the eye E gazes at the correction gaze point CP9, the correction gaze direction VD9 corresponding to the correction gaze point CP9 is the upper left for the eye E. When the eye E gazes at the correction gaze point CP7, the correction gaze direction VD7 corresponding to the correction gaze point CP7 is the lower left for the eye E.

[0062] Figure 3 The eye E shown may represent Figure 4 The left eye E2 or the right eye E1 is shown.

[0063] If the eye E is Figure 4 , the left side is the outer side of the left eye E2 of the user U, and the right side is the inner side of the left eye E2 of the user U. On the other hand, if the eye E is as shown in FIG. Figure 4 As shown in FIG. 1 , the right eye E1 of the user U is shown as the inner side of the right eye E1 of the user U to the left, and the outer side of the right eye E1 of the user U to the right.

[0064] It should be noted that the correction gaze points CP1 to CP9 are only for illustration purposes, and the embodiments of the present invention are not limited thereto.

[0065] During the calibration process, if all calibration gaze points CP1 to CP9 are displayed and eye information corresponding to all left eyes and right eyes is obtained, the calibration process may take a long time.

[0066] In an embodiment of the present invention, the symmetry of the eye is utilized to reduce the correction time.

[0067] Please refer again Figure 2 In step S230, the first eye information is mirrored as Figure 1 The illustrated processing circuit 110 calculates at least one of second eye information of a first eye of a user and third eye information of a second eye of the user.

[0068] See also Figure 4 . Figure 4 FIG. 1 is a schematic diagram of a face of a user U according to some embodiments of the present disclosure. Figure 4 As shown, the symmetry axis SA1 is located on a connection line CL of the face of the user U. The connection line CL connects a center point C1 of the eye E1 and a center point C2 of the eye E2.

[0069] Another symmetry axis SA2 is located between the eye E1 and the eye E2. The symmetry axis SA2 is perpendicular to the symmetry axis SA1. The symmetry axis SA1 and the symmetry axis SA2 intersect at the point MD.

[0070] Please also see Figure 5A and Figure 5B .

[0071] Assume that in step S210, Figure 5A As shown, eye E1 and eye E2 are fixed on Figure 3 The corrected gaze point CP8 is shown. Figure 1 The processing circuit 110 shown obtains eye information of the eye E2 corresponding to the corrected gaze point CP8 and the corrected gaze direction VD8, wherein the corrected gaze point CP8 and the corrected gaze direction VD8 correspond to the eye E2 gazing at the outside of the face of the user U. At the same time, Figure 1 The illustrated processing circuit 110 obtains eye information of the eye E1 corresponding to a corrected gaze point CP8 and a corrected gaze direction VD8 , wherein the corrected gaze point CP8 and the corrected gaze direction VD8 correspond to the eye E1 gazing at the inside of the user U's face.

[0072] Next, in step S230, Figure 1 The processing circuit 110 shown mirrors the eye information of the eye E2 corresponding to the corrected gaze point CP8 according to the symmetry axis SA2, so as to calculate the eye information of the eye E corresponding to the corrected gaze point CP4 based on the eye information of the eye E2 corresponding to the corrected gaze point CP8.

[0073] like Figure 3 As shown, the correction gaze point CP8 and the correction gaze point CP4 are symmetrical to each other with respect to the symmetry axis SA2. Since when the eye E1 gazes at the correction gaze point CP4, the eye E1 gazes at the outside of the face of the user U, and when the eye E2 gazes at the correction gaze point CP8, the eye E1 gazes at the outside of the face of the user U, the eye information of the eye E1 gazed at the correction gaze point CP4 is similar to the eye information of the eye E2 gazed at the correction gaze point CP8.

[0074] Therefore, the processing circuit 110 can perform symmetry processing on the eye information of the eye E2 gazing at (corresponding to) the corrected gaze point CP8 according to the symmetry axis SA2 to calculate the eye information of the eye E1 gazing at (corresponding to) the corrected gaze point CP4. In this way, the eye information of the eye E1 gazing at (corresponding to) the corrected gaze point CP4 can be obtained without displaying the corrected gaze point CP8.

[0075] Similarly, in step S230, Figure 1The processing circuit 110 shown symmetrically processes the eye information of the eye E1 corresponding to the corrected gaze point CP8 according to the symmetry axis SA2, so as to calculate the eye information of the eye E2 corresponding to the corrected gaze point CP4 according to the eye information of the eye E1 corresponding to the corrected gaze point CP8.

[0076] Since when the eye E1 gazes at the correction gaze point CP8, the eye E1 gazes at the inside of the face of the user U. And when the eye E2 gazes at the correction gaze point CP4, the eye E1 gazes at the inside of the face of the user U. The eye information of the eye E2 gazed at the correction gaze point CP4 is similar to the eye information of the eye E1 gazed at the correction gaze point CP8.

[0077] Therefore, the processing circuit 110 can symmetrize the eye information of the eye E1 corresponding to the corrected gaze point CP8 according to the symmetry axis SA2, so as to calculate the eye information of the eye E2 corresponding to the corrected gaze point CP4 based on the eye information of the eye E1 corresponding to the corrected gaze point CP8 without displaying the corrected gaze point CP4.

[0078] In this way, the processing circuit 110 can obtain the following information without displaying the calibrated gaze point CP4. Figure 5B The eye E2 shown gazes the eye information of the gaze point CP4, and the time of the correction operation is reduced.

[0079] It should be noted that the remaining eye information of one of the eyes (the first eye) corresponding to one of the correction gaze points (the first correction gaze point) can be obtained based on the eye information of the other eye (the second eye) corresponding to the other correction gaze point (the second correction gaze point), and one of the correction gaze points (the first correction gaze point) and the other correction gaze point (the second correction gaze point) are symmetrical about the symmetry axis SA2. This is because the correction gaze direction of one of the eyes (the first eye) gazing at one of the correction gaze points (the first correction gaze point) and the correction gaze direction of the other eye (the second eye) gazing at the other correction gaze point (the second correction gaze point) are mirror-symmetric about the symmetry axis SA2.

[0080] For example, the eye information of the gaze correction point CP3 of the eye E2 is calculated based on the eye information of the gaze correction point CP9 of the eye E1. The eye information of the gaze correction point CP6 of the eye E2 is calculated based on the eye information of the gaze correction point CP8 of the eye E1.

[0081] See also Fig. 6A and Figure 6B . Fig. 6A and Figure 6B According to some embodiments of the present disclosure, Figure 2 Schematic diagram of the operation of step S230 in .

[0082] Assume that in step S210, Fig. 6A As shown, eye E1 and eye E2 gaze as Figure 3 The corrected gaze point CP2 is shown in FIG. Figure 1 The processing circuit 110 shown obtains eye information of the eye E1 corresponding to the corrected gaze point CP2 and the corrected gaze direction VD2, wherein the corrected gaze point CP2 and the corrected gaze direction VD2 correspond to the eye E1 gazing above the face of the user U. At the same time, Figure 1 The processing circuit 110 shown obtains eye information of the eye E2 corresponding to the corrected gaze point CP2 and the corrected gaze direction VD2, wherein the corrected gaze point CP2 and the corrected gaze direction VD2 correspond to the eye E2 gazing at the upper part of the user U's face.

[0083] Next, in step S230, Figure 1 The processing circuit 110 shown symmetrizes and calculates the eye information of the eye E1 corresponding to the corrected gaze point CP2 according to the symmetry axis SA1 , so as to calculate the eye information of the eye E1 corresponding to the corrected gaze point CP6 .

[0084] like Figure 3 As shown, the correction gaze point CP2 and the correction gaze point CP6 are symmetrical with respect to the symmetry axis SA1. When the eye E1 gazes at the correction gaze point CP2, the eye E1 gazes above the face of the user U. When the eye E1 gazes at the correction gaze point CP6, the eye E1 gazes below the face of the user U. Therefore, the eye information of the eye E1 gazing at the correction gaze point CP6 and the eye information of the eye E1 gazing at the correction gaze point CP2 are symmetrical about the symmetry axis SA1.

[0085] Therefore, the processing circuit 110 can symmetrically process the eye information of the eye E1 corresponding to the corrected gaze point CP2 and the corrected gaze direction VD2 through the symmetry axis SA1, and calculate the eye information of the eye E1 corresponding to the corrected gaze point CP6 and the corrected gaze direction VD6 based on the eye information corresponding to the corrected gaze point CP2 and the corrected gaze direction VD2 without displaying the corrected gaze point CP2.

[0086] Similarly, in step S230, if Figure 1 The processing circuit 110 shown performs symmetry processing on the eye information of the eye E2 corresponding to the corrected gaze point CP2 according to the symmetry axis SA1 to calculate the eye information of the eye E2 corresponding to the corrected gaze point CP6.

[0087] When the eye E2 gazes at the correction gaze point CP2, the eye E2 gazes above the face of the user U, and when the eye E1 gazes at the correction gaze point CP6, the eye E1 gazes below the face of the user U. The eye information of the eye E2 gazed at the correction gaze point CP6 and the eye information of the eye E2 gazed at the correction gaze point CP2 are mirror-symmetric to each other with respect to the symmetry axis SA1.

[0088] Therefore, the processing circuit 110 can symmetrically process the eye information of the corrected gaze point CP2 and the corrected gaze direction VD2 corresponding to the eye E2 according to the symmetry axis SA1 based on the eye information of the eye E2 corresponding to the corrected gaze point CP2 and the corrected gaze direction VD2, so as to calculate the eye information of the eye E2 corresponding to the corrected gaze point CP6 and the corrected gaze direction VD6 without displaying the corrected gaze point CP2.

[0089] In this way, the processing circuit 110 can obtain Figure 6B The eye information of the eye E1 and the eye E2 shown is gazed at the correction gaze point CP6, and there is no need to display the correction gaze point CP6, which reduces the time of the correction process.

[0090] It should be noted that the eye information of one of the eyes (the first eye) corresponding to one of the correction gaze points (the first correction gaze point) can be obtained based on the eye information of the same one of the eyes (the first eye) corresponding to the other correction gaze point (the second correction gaze point). Since the correction gaze direction of one of the eyes (the first eye) gazing at one of the correction gaze points (the first correction gaze point) and the correction gaze direction of the same one of the eyes (the first eye) gazing at the other correction gaze point (the second correction gaze point) are symmetrical to each other about the symmetry axis SA1, the other correction gaze point (the first correction gaze point) and the one of the correction gaze points (the second correction gaze point) are mirror-symmetrical to each other with respect to the symmetry axis SA1.

[0091] For example, eye information of eye E1 gaze correction gaze point CP9 is calculated based on eye information of eye E1 gaze correction gaze point CP8, and eye information of eye E2 gaze correction gaze point CP9 is calculated based on eye information of eye E2 gaze correction gaze point CP8, and so on.

[0092] Eye information includes the shape of the eyeball, the coordinates of the white of the eye and the eyeball, the relative relationship between the light spot reflected by the eye and the light source, etc.

[0093] See also Figure 7 . Figure 7 FIG. 1 is a schematic diagram showing the location of a camera circuit 130 according to some embodiments of the present disclosure. Figure 7As shown, the camera circuit 130 is located at the extension of the vertical line PA. The vertical line PA is perpendicular to the symmetry axis SA1 and the symmetry axis SA2, and the symmetry axis SA1 and the symmetry axis SA2 intersect the vertical line PA at the point MD.

[0094] When the camera circuit 130 is located on the extension of the vertical line PA, the eye E1 and the eye E2 are mirror-symmetrical to each other with respect to the camera circuit 130. The upward portion of the eye E1 is located above the symmetry axis SA1, and the downward portion of the eye E1 is located below the symmetry axis SA1, and with respect to the camera circuit 130, the upward portion of the eye E1 and the downward portion of the eye E1 are mirror-symmetrical.

[0095] For the eye information including the shape and the eye information including the corresponding coordinates of the white of the eye and the eyeball, the camera circuit 130 must be placed on the vertical line PA to obtain the eye information according to the symmetry axis SA1.

[0096] For the eye information of the reflected light spots formed by the light source on the eye, the camera circuit 130 must be placed on the vertical line PA, and the distribution of the hardware of the light source must be symmetrical relative to the camera circuit 130, so that the eye information can be calculated based on the symmetry axis SA1 and the symmetry axis SA2.

[0097] Please refer again Figure 3 . In some embodiments, the eye information may be calculated together based on the symmetry axis SA1 and the symmetry axis SA2. For example, in one embodiment, after the camera circuit 130 obtains the eye information corresponding to the corrected gaze point CP9, the processing circuit 110 obtains the eye information corresponding to the corrected gaze point CP7 based on the corrected gaze point CP9 and the symmetry axis SA1. Next, the processing circuit 110 obtains the eye information corresponding to the corrected gaze point CP3 based on the corrected gaze point CP9 and the symmetry axis SA2, and the processing circuit 110 obtains the eye information corresponding to the corrected gaze point CP5 based on the corrected gaze point CP5 and the symmetry axis SA2.

[0098] In another embodiment, after the camera circuit 130 obtains the eye information corresponding to the corrected gaze point CP9, the processing circuit 110 obtains the eye information corresponding to the corrected gaze point CP3 according to the corrected gaze point CP9 and the axis of symmetry SA2. Then, the processing circuit 110 obtains the eye information corresponding to the corrected gaze point CP7 according to the corrected gaze point CP9 and the axis of symmetry SA1, and the processing circuit 110 obtains the eye information corresponding to the corrected gaze point CP5 according to the corrected gaze point CP5 and the axis of symmetry SA1.

[0099] By calculating the eye information based on the symmetry axis SA1 and the symmetry axis SA2 at the same time, the time of the correction process can be reduced.

[0100] In some embodiments, the camera circuit 130 may be a close-up camera capable of capturing images at a close distance. In some embodiments, the electronic device 100 further includes at least one mirror to reflect and transmit the image of the eye to a farther place, so that the camera circuit 130 can capture the image of the eye.

[0101] In summary, the present disclosure provides a calibration method, an electronic device, and a non-transitory computer-readable medium, which can reduce the time of the calibration process and improve the accuracy of the calibration process by calculating eye information based on the symmetry of the eye and the corresponding symmetry axis.

[0102] It should be noted that, in order to better understand the implementation of the present invention, the above implementation is simplified. It should be noted that, in some embodiments, the calibration method 200 can be implemented as a computer program. When the computer program is executed, the computer, electronic device or Figure 1 The processing circuit 110 in the embodiment of the present invention is used to execute the calibration method 200. The computer program can be stored in a non-transitory computer readable storage medium, such as a ROM (read-only memory), a flash memory, a disk drive, a hard disk, an optical disk, a flash drive, a USB flash drive, a magnetic tape, a database accessible from a network, or any storage medium having the following features: The functions are the same as those that can be imagined by a person skilled in the art to which the present disclosure belongs.

[0103] It should be noted that, unless otherwise specified, there is no specific order in the steps of the calibration method 200. In addition, the steps may be performed simultaneously, or their execution may at least partially overlap.

[0104] In addition, according to various embodiments of the present disclosure, steps in the correction method 200 may be appropriately added, replaced and / or deleted.

[0105] Although specific embodiments of the present disclosure have been disclosed with respect to the above-mentioned embodiments, these embodiments are not intended to limit the present disclosure. Various substitutions and improvements can be performed in the present disclosure by a person of ordinary skill in the relevant art without departing from the principles and spirit of the present disclosure. Therefore, the protection scope of the present disclosure is determined by the appended claims.

Claims

1. A calibration method, applicable to an electronic device, characterized in that: The electronic device includes a head mounted display device, and the calibration method includes: When a user gazes at a first calibrated gaze point, obtaining first eye information of a first eye of the user; and By mirroring the first eye information, at least one of a second eye information of the first eye of the user and a third eye information of a second eye of the user is calculated.

2. The calibration method according to claim 1, characterized in that: A first symmetry axis is located on a connecting line between a first center point of the first eye and a second center point of the second eye, and the second eye information of the first eye is mirror-symmetrical to the first eye information about the first symmetry axis.

3. The calibration method according to claim 2, characterized in that: wherein when the first eye information is obtained when the first eye gazes at the first calibrated gaze point, and a first calibrated gaze direction corresponding to the first calibrated gaze point is upward, the second eye information corresponds to the first eye gaze at a second calibrated gaze point, and a second calibrated gaze direction corresponding to the second calibrated gaze point is downward, wherein the first calibrated gaze point and the second calibrated gaze point are mirror-symmetrical about the first symmetry axis; When the first eye information is obtained when the first eye gazes at the first correction gaze point, and the first correction gaze direction is downward, the second eye information corresponds to the first eye gaze at the second correction gaze point, and the second correction gaze direction is upward, wherein the first correction gaze point and the second correction gaze point are mirror-symmetrical about the first symmetry axis.

4. The calibration method according to claim 2, characterized in that: The first eye information is captured by a camera circuit located on a vertical line, wherein the vertical line is perpendicular to the first symmetry axis and a second symmetry axis, wherein the second symmetry axis is located between the first eye and the second eye, and the second symmetry axis is perpendicular to the first symmetry axis.

5. The calibration method according to claim 1, wherein: A first symmetry axis is located on a connecting line between a first center point of the first eye and a second center point of the second eye, a second symmetry axis is located between the first eye and the second eye, and the second symmetry axis is perpendicular to the first symmetry axis, and the third eye information of the second eye is mirror-symmetric to the first eye information about the second symmetry axis.

6. The calibration method according to claim 5, characterized in that: wherein when the first eye information is obtained when the first eye gazes at the first calibrated gaze point, and a first calibrated gaze direction corresponding to the first calibrated gaze point is toward a first outer side of the first eye, the third eye information corresponds to the second eye gaze at a second calibrated gaze point, and a second calibrated gaze direction corresponding to the second calibrated gaze point is toward a second outer side of the second eye, wherein the first calibrated gaze point and the second calibrated gaze point are mirror-symmetrical about the second symmetry axis; Wherein, when the first eye information is obtained when the first eye gazes at the first correction gaze point, and the first correction gaze direction is toward a first inner side of the first eye, the third eye information corresponds to the second eye gaze at the second correction gaze point, and the second correction gaze direction is toward a second inner side of the second eye, wherein the first correction gaze point and the second correction gaze point are mirror-symmetric to the second symmetry axis.

7. The calibration method according to claim 1, characterized in that: Also includes: A fourth eye information of the second eye is calculated by mirroring at least one of the second eye information and the third eye information.

8. An electronic device, characterized in that: Include: a camera circuit for capturing first eye information of a first eye of a user when the user gazes at a first calibrated gaze point; and A processing circuit is coupled to the camera circuit, wherein the processing circuit is used to calculate at least one of a second eye information of the first eye of the user and a third eye information of the second eye of the user by mirroring the first eye information.

9. The electronic device as claimed in claim 8, characterized in that: A first symmetry axis is located along a connecting line between a first center point of the first eye and a second center point of the second eye, and the second eye information of the first eye is mirror-symmetrical to the first eye information about the first symmetry axis.

10. A non-transitory computer-readable storage medium, characterized in that: The device stores at least one instruction program to be executed by a processing unit to run a calibration method, the calibration method comprising: When a user gazes at a first calibrated gaze point, obtaining first eye information of a first eye of the user by a camera circuit; and A processing circuit calculates at least one of second eye information of the first eye of the user and third eye information of a second eye of the user by mirroring the first eye information.

Images