Method and device for identifying attention position of eyeball and head-mounted display equipment

By integrating infrared transmitting and receiving units on the substrate layer of the image display, the problems of space occupancy and weight increase in the prior art are solved, and a high degree of integrated eye focus position recognition is achieved.

CN119065490APending Publication Date: 2024-12-03BEIJING XIHONGXIAN TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310982121.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-08-04
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

The method of obtaining eyeball attention position in the prior art requires the installation of an infrared camera outside the image display, which takes up a large space and increases the weight of the equipment, which violates the principle of lightweight design.

Method used

The infrared emitting unit and the infrared receiving unit are integrated on the substrate layer of the image display to determine the eye focus position by controlling the intensity parameters of the infrared light, avoiding the need for additional arrangement of infrared cameras.

Benefits of technology

It realizes the acquisition of eyeball attention position in the image display, while avoiding space occupation and weight increase, and improving the integration and space utilization of the device.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119065490A_ABST
    Figure CN119065490A_ABST
Patent Text Reader

Abstract

The invention provides an eyeball attention position identification method and device and head-mounted display equipment, and relates to the technical field of eyeball tracking, and the method comprises the steps: controlling a plurality of infrared emission units to sequentially emit infrared light towards eyeballs, and obtaining the intensity parameters of the infrared light reflected by the eyeballs to a plurality of infrared receiving units; determining an eyeball attention position according to the intensity parameter of the infrared light; wherein the infrared transmitting unit and the infrared receiving unit are both arranged on a substrate layer in the image display, and the part, except the infrared transmitting unit and the infrared receiving unit, of the substrate layer is filled with pixel points; according to the method, the attention position of the eyeball can be effectively obtained, and meanwhile, the defects of additional arrangement of an infrared camera and the like in the prior art are avoided.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of eye tracking technology, and in particular to a method and device for identifying an eye focus position and a head-mounted display device. Background Art

[0002] Obtaining the eye's focus position in the image display is a prerequisite for operations such as gaze point rendering.

[0003] In the prior art, the method for obtaining the eye focus position is mainly to arrange multiple infrared cameras outside the image display to shoot / capture the relative position of the eye, and calculate the eye focus position through an algorithm.

[0004] However, the above method, on the one hand, occupies a large installation space, and on the other hand, the infrared camera and the like increase the overall weight of the equipment, which does not conform to the principle of lightweight design.

[0005] Therefore, it is urgent to provide a new method for identifying the eye focus position. Summary of the invention

[0006] In view of the shortcomings of the prior art, the present invention provides a method for identifying the eye focus position, an identification device and a head-mounted display device, which solves the technical problem in the prior art of additionally deploying infrared cameras to obtain the eye focus position, which occupies installation space and increases the overall weight of the equipment.

[0007] To achieve the above objectives, the present invention is implemented through the following technical solutions:

[0008] One aspect of the present invention provides a method for identifying an eye focus position, the method comprising the following contents:

[0009] S1, controlling multiple infrared emitting units to sequentially emit infrared light toward the eyeball;

[0010] S2, obtaining the intensity parameter of the infrared light reflected by the eyeball to the infrared receiving unit; the infrared receiving unit is multiple;

[0011] S3, determining the eye focus position according to the intensity parameter of the infrared light;

[0012] The infrared emitting unit and the infrared receiving unit are both arranged on a substrate layer in the image display, and the portion of the substrate layer other than the infrared emitting unit and the infrared receiving unit is filled with pixel points.

[0013] Furthermore, it also includes:

[0014] S4. Determine the picture resolution of the image display based on the eye focus position and the gaze point rendering algorithm.

[0015] Furthermore, the pixel point is pixel point A or pixel point B; a notch is provided on pixel point B, and the infrared emitting unit is arranged in a notch or in a space surrounded by multiple notches; the infrared receiving unit is arranged in a notch or in a space surrounded by multiple notches.

[0016] Further, the pixel point is pixel point A, pixel point B or pixel point C;

[0017] A notch is provided on the pixel point B, and the infrared emitting unit is arranged in one notch or in a space formed by a plurality of notches;

[0018] The pixel point C includes a light emitting device driving circuit arranged on the substrate layer and a light emitting device arranged on the light emitting device driving circuit;

[0019] The infrared receiving unit comprises an infrared photosensitive circuit arranged on a substrate layer; the infrared photosensitive circuit is arranged below the whole formed by at least one light emitting device.

[0020] A second aspect of the present invention further provides a device for identifying an eyeball focus position, comprising:

[0021] An infrared control module, used to control multiple infrared emitting units to sequentially emit infrared light toward the eyeball;

[0022] An infrared receiving module, used to obtain the intensity parameters of the infrared light reflected by the eyeball to the infrared receiving unit; there are multiple infrared receiving units;

[0023] An eyeball focus position determination module, used to determine the eyeball focus position according to the intensity parameter of the infrared light;

[0024] The infrared emitting unit and the infrared receiving unit are both arranged on a substrate layer in the image display, and the portion of the substrate layer other than the infrared emitting unit and the infrared receiving unit is filled with pixel points.

[0025] Furthermore, it also includes: an execution module, which is used to determine the picture resolution of the image display based on the eye focus position and the gaze point rendering algorithm.

[0026] Furthermore, the pixel point is pixel point A or pixel point B; a notch is provided on pixel point B, and the infrared emitting unit is arranged in a notch or in a space surrounded by multiple notches; the infrared receiving unit is arranged in a notch or in a space surrounded by multiple notches.

[0027] Further, the pixel point is pixel point A, pixel point B or pixel point C;

[0028] A notch is provided on the pixel point B, and the infrared emitting unit is arranged in one notch or in a space formed by a plurality of notches;

[0029] The pixel point C includes a light emitting device driving circuit arranged on the substrate layer and a light emitting device arranged on the light emitting device driving circuit;

[0030] The infrared receiving unit comprises an infrared photosensitive circuit arranged on a substrate layer; the infrared photosensitive circuit is arranged below the whole formed by at least one light emitting device.

[0031] According to a third aspect of the present invention, there is also provided a head mounted display device capable of identifying an eye focus position, comprising an optical system and also comprising the above-mentioned device for identifying an eye focus position.

[0032] The method, device and head mounted display device for identifying the eyeball focus position provided by the present invention have the following beneficial effects compared with the prior art:

[0033] When obtaining the eyeball's focus position in the image display, it can be done with the help of an infrared emitting unit and an infrared receiving unit arranged on the image display, without the need to arrange an infrared camera outside the image display.

[0034] When acquiring the eye's focus position, the space occupied outside the image display is zero, and the overall weight of the corresponding equipment is not increased; this avoids the defect in the prior art that the eye's focus position in the image display needs to be acquired by additionally deploying infrared cameras, which occupies the equipment installation space and increases the overall weight of the equipment. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0036] Figure 1 is a flow chart of a method for identifying an eyeball focus position in an embodiment;

[0037] Figure 2 Schematic diagram of the relative position relationship between the infrared transmitting unit and the infrared receiving unit in the embodiment;

[0038] Figure 3 A schematic diagram of the arrangement relationship between the infrared emitting unit, the infrared receiving unit and the substrate layer in the embodiment;

[0039] Figure 4 A top view showing the arrangement relationship between pixel point A, pixel point B and functional units in the embodiment;

[0040] Figure 5 Schematic diagram of the relative position relationship between the pixel point C and the infrared photosensitive circuit in the embodiment;

[0041] Figure 6 Schematic diagram of the light path between the image display, the optical system, and the eyeball in the embodiment. DETAILED DESCRIPTION

[0042] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention are clearly and completely described. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0043] Example 1

[0044] In order to solve the defects of occupying a large installation space when deploying infrared cameras etc. to capture the eye position in the prior art, the main idea of ​​this application is:

[0045] First, refer to Figure 1 This embodiment provides a method for identifying an eye focus position, the method comprising the following contents:

[0046] S1. Control multiple infrared emitting units to emit infrared light toward the eyeball in sequence; that is, the infrared emitting unit emits infrared light toward the eyeball. The purpose of multiple infrared emitting units emitting infrared light in sequence is to make only one infrared light source work at the same time, thereby avoiding the defect of multiple light sources interfering with each other.

[0047] S2. Acquire the intensity parameters of the infrared light reflected by the eyeball to the infrared receiving unit; there are multiple infrared receiving units; that is, the infrared light reflected by the eyeball irradiates the infrared receiving units at different distribution positions, and the infrared receiving units acquire the infrared light intensity parameters.

[0048] S3. Determine the eye focus position according to the intensity parameters of the infrared light; that is, confirm the eye focus position according to the intensity parameters of all acquired infrared lights (for example, confirm the eye focus position according to the pupil cornea reflection method).

[0049] In this embodiment, the infrared emitting unit and the infrared receiving unit are both arranged on the substrate layer in the image display, and the portion of the substrate layer other than the infrared emitting unit and the infrared receiving unit is filled with pixels; that is, the infrared emitting unit, the infrared receiving unit and the pixel points are arranged in sequence on the substrate layer in the image display; the infrared emitting unit is used to emit infrared light, and the infrared receiving unit is used to obtain the intensity parameters of the portion on which the infrared light reflected by the eyeball shines.

[0050] By arranging an infrared transmitting unit and an infrared receiving unit on the image display, the position where the eyeball is focused can be effectively identified, and the image display can work normally at the same time.

[0051] The integration of the equipment is improved, and the defects existing when the identification of the eye's focus position requires the deployment of additional separate equipment are avoided.

[0052] In some embodiments, the above method further includes:

[0053] The picture resolution of the image display is determined based on the eye focus position and the gaze point rendering algorithm.

[0054] It is convenient to improve the viewing experience at the position where the human eye is focused.

[0055] In this embodiment, when the device is prepared, the infrared transmitting unit and the infrared receiving unit are prepared together with the image display; wherein, there is no less than one infrared transmitting unit, and the number of infrared receiving units is no less than the minimum number for obtaining eye recognition positions, and the relative number and layout relationship of the infrared transmitting units and the infrared receiving units satisfy that the infrared light intensity parameters obtained during single-point transmission and multiple-point reception can be used to identify the eye's focus position.

[0056] In one implementation, reference Figure 2 As shown in (a), the black dots in the central area of ​​the figure are infrared emitting units 8, and the spots on the periphery are infrared receiving units 9. In the figure, four adjacent infrared receiving units 9 arranged in a matrix form a receiving group (the infrared receiving units 9 in the same receiving group do not touch each other), and multiple receiving groups are distributed on the periphery of the infrared emitting unit 8; wherein, the arrangement form of the infrared receiving units 9 can also be other forms to meet the purpose of obtaining infrared light intensity parameters from multiple angles, for example, the receiving group is cancelled, and each infrared receiving unit 9 is arranged separately.

[0057] By arranging the single infrared emitting unit 8 at the center of the image display and arranging a plurality of receiving groups around the infrared emitting unit 8, the recognition of the eye's focus position at various angles can be ensured.

[0058] In one implementation, in order to improve the accuracy of eye focus position recognition, there are multiple infrared emitting units 8 in the image display, and the multiple infrared emitting units 8 and the multiple infrared receiving units 9 are arranged in a matrix, and a plurality of infrared receiving units 9 are arranged around each infrared emitting unit 8;

[0059] refer to Figure 2 As shown in (b), the black dots in the figure are infrared emitting units 8 and the spots are infrared receiving units 9. Eight infrared receiving units 9 are arranged around each infrared emitting unit 8. The corresponding eight infrared receiving units 9 surround one infrared emitting unit 8 to form a transceiver group. Figure 2 As shown in (b), the transceiver groups are arranged in a matrix, and may also be in other forms, as long as they can meet the purpose of multiple emission points and multiple reception points (to avoid the situation where some infrared emission units 8 are damaged or unable to work, to ensure the stable identification of the eye's focus position, and multiple point reflections are emitted sequentially, not simultaneously).

[0060] In some embodiments, the layout relationship between the substrate layer and the infrared receiving unit or the infrared emitting unit in the image display is as follows: Figure 3 ;

[0061] refer to Figure 3 As shown in (a), the CMOS photosensitive circuit 3 in the infrared receiving unit (the whole composed of the CMOS photosensitive circuit 3 and the microlens structure 4) and the LED device circuit 2 of the pixel point in the image display are prepared on the substrate layer 1 together, and the CMOS photosensitive circuit 3 can receive the infrared light transmitted through the packaging protection layer 6 and the microlens structure 4; in the figure, three LED device circuits 2 and three visible light emitting devices 5 constitute a pixel point;

[0062] refer to Figure 3 As shown in (b), the driving circuit (i.e., the LED device circuit 2 below the infrared light-emitting layer 7) corresponding to the infrared emitting unit (an integral body formed by the infrared light-emitting layer 7 and the LED device circuit 2 located therebelow, and the LED device circuit 2 located below the infrared light-emitting layer 7 drives the corresponding infrared light-emitting layer 7 to operate) is prepared together with the LED device circuits 2 corresponding to other visible light-emitting devices 5 and controlled separately; the non-visible infrared light generated by the infrared emitting unit passes through the packaging protective layer 6 and is emitted; through the above arrangement, the infrared emitting unit and the infrared receiving unit can be integrated in the image display.

[0063] based on Figure 2 In some embodiments, there are multiple situations in which the arrangement relationship between the pixel points and the infrared emitting unit or the infrared receiving unit in the top view direction includes: Figure 4 The situations shown in a to d.

[0064] Among them, reference Figure 4 In (a), the functional unit (the functional unit is an infrared emitting unit or an infrared receiving unit) is arranged between two adjacent pixel points (it can also be arranged on one side of a pixel point, in which case the functional unit is at the edge of the substrate layer 1), and the two adjacent functional units in two rows or columns are staggered (to avoid forming a continuous non-display area to reduce the impact on the picture displayed by the image display); this situation can reduce the difficulty of preparing the image display.

[0065] refer to Figure 4bd, at this time, the relationship between the functional unit and the gap exists in the following situations; among them, for the convenience of distinction, the pixel point on the substrate layer 1 in the image display is set as pixel point A or pixel point B, wherein a gap is provided on pixel point B, and the functional unit is arranged in a space surrounded by one or more gaps, and all pixel points B are arranged in the same direction (that is, the arrangement of sub-pixels in pixel points A and B is consistent, so as to facilitate the display control in the later stage);

[0066] 1) The functional unit is set in a space surrounded by a gap (the functional unit may or may not touch the edge of the gap, depending on the requirements), refer to Figure 4 In (b), the size of a sub-pixel in pixel B in the figure is smaller than the size of a sub-pixel in pixel A (i.e., a sub-pixel in pixel B is partially missing compared to other sub-pixels, and when pixel B is not provided with a gap, its size is the same as that of pixel A); at this time, the size requirement for the functional unit is relatively high, and the preparation difficulty is relatively large; and in some embodiments, a sub-pixel in pixel B can be directly completely missing, and the functional unit is set in the missing area. At this time, the size requirement for the functional unit is slightly lower than the requirement when it is partially missing.

[0067] 2) The functional unit is located in the space surrounded by two gaps, refer to Figure 4 In (c), the size relationship between pixel A and pixel B in the figure is the same as described above; at this time, the two pixel points B are arranged in the same direction, and one of the two gaps is set at the lower left corner of the corresponding pixel point B, and the other is set at the upper left corner of the corresponding pixel point B, that is, the position of the gap on the pixel point B is set according to needs, and the arrangement direction of the pixel point B is fixed (the arrangement relationship between sub-pixels is fixed to facilitate screen display); in this case, the size requirement for the functional unit can be reduced; and when the size of the functional unit remains unchanged, the impact on the single pixel point B can be reduced.

[0068] 3) The functional unit is located in the space surrounded by four gaps, refer to Figure 4 In (d), the pixel points B corresponding to the four gaps are arranged in the same direction, and the four gaps are respectively located at the corners of the corresponding pixel point B, and the four corners are adjacent; that is, the position of the gap on the pixel point B is set according to needs; at this time, the size requirement for the functional unit can be further reduced; and when the size of the functional unit remains unchanged, the impact on the pixel point B can be further reduced.

[0069] Among them, Figure 4In the case where bd corresponds to, the sizes of all sub-pixels in pixel A are consistent, while the size of one sub-pixel in pixel B is different from the size of the sub-pixel in pixel A; in some embodiments, two, three or all sub-pixels in pixel B are equal to the size of the sub-pixel in pixel A (when there are multiple sub-pixels, the sizes of the corresponding multiple sub-pixels may be consistent or inconsistent, that is, adaptively adjusted according to the shape of the functional unit), and the missing part of pixel B compared to pixel A is made a gap; in some embodiments, the sizes of the sub-pixels in pixel A may be partially different, and when pixel B is not set with a gap, it is the same as or different from pixel A, and can be set as needed.

[0070] In some embodiments, the relationship between the infrared emitting unit and the pixel point is still referred to Figure 2 (b) and Figure 4 The arrangement is carried out in the manner shown, and the infrared receiving unit is improved.

[0071] The improvement lies in: making the infrared receiving unit include an infrared photosensitive circuit 10 (a CMOS photosensitive circuit is selected in this embodiment), and making the pixel point on the substrate layer 1 be pixel point A, pixel point B or pixel point C, and the relationship between pixel point A and pixel point B refers to the aforementioned embodiment; and pixel point C includes a light-emitting device driving circuit arranged on the substrate layer (such as a whole composed of three LED device circuits 2) and a light-emitting device arranged on the light-emitting device driving circuit (such as a whole composed of three visible light light-emitting devices 5, that is, the number of visible light light-emitting devices 5 is the same as the number of LED device circuits 2); the structure of pixel point C is basically the same as the aforementioned pixel point A, the only difference is that the size or layout method of the pixel point C corresponding to all LED device circuits 2 as a whole is different from that of pixel point A, but the functions of the two are completely consistent.

[0072] In one implementation, the infrared receiving unit corresponds to a pixel point C; that is, the infrared photosensitive circuit 10 and the light-emitting device driving circuit in the corresponding pixel point C are arranged on the substrate layer 1, and the infrared photosensitive circuit 10 and the light-emitting device driving circuit are integrally provided with a corresponding light-emitting device (compared to Figure 2 (a), the microlens structure 4 is omitted, and the infrared light passes through the light-emitting device on the infrared photosensitive circuit 10 and shines on the infrared photosensitive circuit); the whole composed of pixel points A, pixel points B and pixel points C jointly displays the picture.

[0073] Through the above, the infrared photosensitive circuit 10 is arranged below the light emitting device. Figure 2 (a) The micro-lens structure 4 is eliminated, which can effectively reduce the impact on the display content of the image display.

[0074] In the above implementation, one infrared receiving unit corresponds to one pixel point C; wherein, when the pixel point C is composed of multiple sub-pixel points, the corresponding light-emitting device and the light-emitting device driving circuit are divided into multiple parts, for example, the light-emitting device is composed of three visible light light-emitting devices 5, and the light-emitting device driving circuit is composed of three LED device circuits 2 corresponding to the three visible light light-emitting devices 5 respectively.

[0075] At this time, the infrared photosensitive circuit 10 occupies a partial area of ​​the LED device circuit 2 corresponding to one or more sub-pixels in the same pixel point C; that is, the occupied space of the LED device circuit 2 corresponding to one or more sub-pixels is compressed for the layout of the infrared photosensitive circuit 10, which does not affect the normal operation of each LED device circuit 2; wherein, the size of the light-emitting device in the pixel point C is the same as the size of the light-emitting device in the pixel point A (a whole composed of three visible light-emitting devices 5).

[0076] In another implementation method, one infrared receiving unit corresponds to multiple pixel points C (for example, two, three or four, etc.). In this case, the size requirement for the infrared photosensitive circuit 10 can be reduced or the space occupied by the infrared photosensitive circuit 10 for the light-emitting device driving circuit corresponding to a single pixel point C can be reduced, thereby reducing the difficulty of manufacturing the equipment.

[0077] For example, the infrared photosensitive circuit 10 may be arranged below the adjacent ends of two pixel points C as a whole (eg Figure 5 , Figure 5 In order to facilitate the distinction between the light-emitting device driving circuit and the infrared photosensitive circuit 10, all LED device circuits in the light-emitting device driving circuit are displayed as a whole). At this time, the infrared photosensitive circuit 10 is arranged below the adjacent ends of two adjacent sub-pixels in the two pixel points C (or two adjacent sub-pixels), so that when the size of the infrared photosensitive circuit 10 remains unchanged, the impact on the space used by the light-emitting device driving circuit corresponding to the two pixel points C can be reduced.

[0078] In another implementation, the infrared photosensitive circuit 10 can be arranged in a matrix manner with four adjacent pixels C at the adjacent ends forming the bottom of the whole, which can further reduce the impact on the pixel driving circuit.

[0079] In the above arrangement, the space occupied by the infrared photosensitive circuit 10 is provided by compressing one or more sub-pixel points corresponding to the LED device circuit 2.

[0080] That is, through the above method, the influence of the infrared receiving unit on the image display can be effectively reduced (the light-emitting device covered on the infrared receiving unit can display normally, avoiding the layout of the microlens structure and the influence on the layout of the visible light-emitting device), which is convenient for improving the imaging quality. At the same time, compared with the aforementioned embodiment, the manufacturing difficulty of the equipment can be reduced; secondly, only the infrared emitting unit needs to be specially arranged.

[0081] Among them, the arrangement of the relative number and position relationship of the infrared transmitting units and the infrared receiving units refers to the above, and will not be repeated here.

[0082] Through the above, the eyeball focus position recognition can be effectively realized, while avoiding the defects of separately deploying infrared cameras for eyeball position recognition, thereby reducing the overall space occupied by the equipment;

[0083] By integrating an infrared transmitting unit and an infrared receiving unit on the image display, the eye's focus position can be effectively identified when displaying a normal picture, making the device highly integrated and reducing the total amount of space required for device installation.

[0084] Example 2

[0085] This embodiment provides a device for identifying an eyeball focus position, including:

[0086] An infrared control module, used to control multiple infrared emitting units to sequentially emit infrared light toward the eyeball;

[0087] An infrared receiving module, used to obtain the intensity parameters of the infrared light reflected by the eyeball to the infrared receiving unit; there are multiple infrared receiving units;

[0088] An eyeball focus position determination module, used to determine the eyeball focus position according to the intensity parameter of the infrared light;

[0089] The infrared emitting unit and the infrared receiving unit are both arranged on a substrate layer in the image display, and the portion of the substrate layer other than the infrared emitting unit and the infrared receiving unit is filled with pixel points.

[0090] It also includes: an execution module, which is used to determine the picture resolution of the image display based on the eye focus position and the gaze point rendering algorithm.

[0091] It is understandable that the device for identifying the eye focus position provided in the embodiment of the present invention corresponds to the above-mentioned method for identifying the eye focus position, and the explanations, examples, beneficial effects and other parts of the relevant contents can refer to the corresponding contents in the method for identifying the eye focus position, and will not be repeated here.

[0092] Example 3

[0093] This embodiment provides a head-mounted display device capable of identifying the eye focus position, including an optical system and the above-mentioned device for identifying the eye focus position.

[0094] The optical system is used to irradiate the infrared light emitted by the infrared emitting unit to the eyeball, and irradiate the infrared light reflected by the eyeball to the infrared receiving unit, and form the picture of the image display in front of the eyeball.

[0095] refer to Figure 6 In this embodiment, the optical path composed of the eyeball, the image display, the optical system (composed of the optical machine module and the prism in the figure), the infrared transmitting unit and the infrared receiving unit is as follows Figure 6 The image seen by the eyeball at this time is the virtual image surface of the image display (in front of the eyeball) magnified by the prism. At this time, the infrared light generated by the infrared emitting unit is transmitted to the eyeball after passing through the optical system, and the infrared light reflected by the eyeball is irradiated on the image display after passing through the optical system and on the infrared receiving unit. According to the intensity parameters of the infrared light obtained by all infrared receiving units, the position of the eyeball's attention can be identified.

[0096] Among them, the image viewed by the eyeball is the virtual image surface of the image display after being magnified by the prism. Correspondingly, the eyeball's focus position is also located on the virtual image surface of the image display. The virtual image surface of the image display is equivalent to the existence of an infrared emitting unit (virtual image) and an infrared receiving unit (virtual image).

[0097] That is, the virtual optical path between the eyeball, the infrared emitting unit (virtual image) and the infrared receiving unit (virtual image) is: after the infrared light emitted by the infrared emitting unit (virtual image) enters the eyeball, the infrared light reflected by the eyeball is received by the infrared receiving unit (virtual image).

[0098] At this time, the actual optical path (infrared emitting unit-optical system-eyeball-optical system-infrared receiving unit) is equivalent to the virtual optical path (infrared emitting unit (virtual image)-eyeball-infrared receiving unit (virtual image)); that is, the infrared emitting unit and the infrared receiving unit are equivalent to being arranged at a certain distance in front of the eyeball (the distance is determined according to parameters such as the magnification factor). Compared with placing infrared cameras and the like diagonally above the human eye or image display, the device provided in the present application helps to improve the accuracy of identifying the eye's focus position.

[0099] The head-mounted display device may be an AR / VR device, etc., which can effectively identify the eye focus position through the aforementioned eye focus position recognition device and optical system, thereby facilitating operations such as local image quality enhancement.

[0100] In summary, the method, device and head mounted display device for identifying the eye focus position provided by the present application have the following beneficial effects:

[0101] When acquiring the eyeball focus position, it can be done with the help of the infrared transmitting unit and the infrared receiving unit arranged on the image display, without the need to separately arrange an infrared camera outside the image display, that is, the space occupied outside the image display is zero, and the overall weight of the device will not be increased;

[0102] The defect of additionally deploying infrared cameras for obtaining the eye focus position is avoided, which helps to improve the space utilization rate of the corresponding equipment; the power consumption of the equipment can be reduced by saving infrared cameras, etc.;

[0103] By accurately locating the eye's focus point, the local image quality can be enhanced or weakened in a targeted manner, thereby improving system operating efficiency and user satisfaction when using the device;

[0104] The infrared light emitted by the infrared transmitting unit is equivalent to being in front of the human eye, which can more accurately obtain the position where the eye is focusing.

[0105] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0106] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for identifying an eyeball's focus position, characterized in that: The method includes the following: S1, controlling multiple infrared emitting units to sequentially emit infrared light toward the eyeball; S2, obtaining the intensity parameter of the infrared light reflected by the eyeball to the infrared receiving unit; the infrared receiving unit is multiple; S3, determining the eye focus position according to the intensity parameter of the infrared light; The infrared emitting unit and the infrared receiving unit are both arranged on a substrate layer in the image display, and the portion of the substrate layer other than the infrared emitting unit and the infrared receiving unit is filled with pixel points.

2. The identification method according to claim 1, characterized in that: Also includes: S4. Determine the picture resolution of the image display based on the eye focus position and the gaze point rendering algorithm.

3. The identification method according to claim 1, characterized in that: The pixel point is pixel point A or pixel point B; a notch is provided on pixel point B, the infrared emitting unit is arranged in a notch or in a space surrounded by a plurality of notches; the infrared receiving unit is arranged in a notch or in a space surrounded by a plurality of notches.

4. The identification method according to claim 1, characterized in that: The pixel point is pixel point A, pixel point B or pixel point C; A notch is provided on the pixel point B, and the infrared emitting unit is arranged in one notch or in a space formed by a plurality of notches; The pixel point C includes a light emitting device driving circuit arranged on the substrate layer and a light emitting device arranged on the light emitting device driving circuit.

5. The identification method according to claim 4, characterized in that: The infrared receiving unit comprises an infrared photosensitive circuit arranged on a substrate layer; the infrared photosensitive circuit is arranged below at least one light-emitting device.

6. A device for identifying eye focus position, characterized in that: include: An infrared control module, used to control multiple infrared emitting units to sequentially emit infrared light toward the eyeball; An infrared receiving module, used to obtain the intensity parameters of the infrared light reflected by the eyeball to the infrared receiving unit; there are multiple infrared receiving units; An eyeball focus position determination module, used to determine the eyeball focus position according to the intensity parameter of the infrared light; The infrared emitting unit and the infrared receiving unit are both arranged on a substrate layer in the image display, and the portion of the substrate layer other than the infrared emitting unit and the infrared receiving unit is filled with pixel points.

7. The identification device according to claim 6, characterized in that Also includes: An execution module is used to determine the picture resolution of the image display based on the eye focus position and the gaze point rendering algorithm.

8. The identification device according to claim 6, characterized in that: The pixel point is pixel point A or pixel point B; a notch is provided on pixel point B, the infrared emitting unit is arranged in a notch or in a space surrounded by a plurality of notches; the infrared receiving unit is arranged in a notch or in a space surrounded by a plurality of notches.

9. The identification device according to claim 6, characterized in that: The pixel point is pixel point A, pixel point B or pixel point C; A notch is provided on the pixel point B, and the infrared emitting unit is arranged in one notch or in a space formed by a plurality of notches; The pixel point C includes a light emitting device driving circuit arranged on the substrate layer and a light emitting device arranged on the light emitting device driving circuit.

10. The identification device according to claim 9, characterized in that: The infrared receiving unit comprises an infrared photosensitive circuit arranged on a substrate layer; the infrared photosensitive circuit is arranged below at least one light-emitting device.

11. A head mounted display device capable of identifying eye focus positions, comprising an optical system, characterized in that: It also includes a device for identifying the eye focus position as described in any one of claims 6 to 10.