Display apparatus and near-eye display device

Abstract

The invention relates to a display apparatus and a near-to-eye display device. The device comprises a processing control chip used for sending a control instruction; the display area is used for displaying virtual reality / augmented reality content; the invisible light emitter is installed on the peripheral side of the display area and used for emitting invisible light according to the control instruction; an eye movement tracking pixel collector mounted on the outer peripheral side of the display area and configured to receive reflected non-visible reflected light and acquire an eye image of an operation body; the processing control chip is also used for analyzing the received invisible reflected light and the received eye image, and determining an adjustment behavior and a target position of the display area corresponding to the adjustment behavior; the display area is further used for displaying virtual reality / augmented reality content at the target position according to the adjustment behavior. The size of the near-to-eye display device is reduced, and the portability of the near-to-eye display device is improved.

Description

Technical Field

[0001] The present invention relates to the field of near-eye display technology, and in particular to a display device and a near-eye display apparatus. Background Art

[0002] Eye tracking technology refers to the process of measuring and recording eye movements to determine a person's gaze point (i.e. where a person is looking), gaze direction, or the movement or position of the eye relative to the head. With the development of science and technology, eye tracking technology is closely integrated with current augmented reality (AR) / virtual reality (VR) applications, and usually uses non-contact optical methods to measure the position of the eye or the gaze angle.

[0003] Traditional eye tracking technology in AR / VR devices usually uses infrared light to illuminate the eyes and calculate the direction of the pupil by reflecting light. However, due to the presence of optical devices such as thermal mirrors and lenses, the device is large in size. In addition, users need to interact with the display screen through a handheld controller, which greatly limits the user's freedom of movement, resulting in a low degree of natural interaction and a poor user experience. Therefore, it is necessary to provide a display device and a near-eye display device. Summary of the invention

[0004] In view of the above-mentioned shortcomings of the prior art, an object of the present invention is to provide a display device and a near-eye display apparatus, which improve the problem that the display device in the prior art is not very portable.

[0005] To achieve the above-mentioned purpose and other related purposes, the present invention provides a display device, comprising: a processing control chip for sending control instructions; a display area for displaying virtual reality / augmented reality content; a non-visible light emitter installed on the outer side of the display area, for emitting non-visible light according to the control instructions; an eye tracking pixel collector installed on the outer side of the display area, for receiving reflected non-visible reflected light and obtaining an eye image of an operating body; the processing control chip is also used to analyze the received non-visible reflected light and the eye image to determine an adjustment behavior and a target position of the display area corresponding to the adjustment behavior; the display area is also used to display the virtual reality / augmented reality content at the target position according to the adjustment behavior.

[0006] In one embodiment of the present invention, there are a plurality of the non-visible light emitters and a plurality of the eye-tracking pixel collectors, respectively, and the plurality of the non-visible light emitters and the plurality of the eye-tracking pixel collectors are alternately arranged around the periphery of the display area.

[0007] In one embodiment of the present invention, there are a plurality of the non-visible light emitters and a plurality of the eye-tracking pixel collectors, respectively, and the plurality of the non-visible light emitters and the plurality of the eye-tracking pixel collectors are alternately arranged around the periphery of the display area.

[0008] In one embodiment of the present invention, the eye tracking pixel collector is a CIS chip.

[0009] In one embodiment of the present invention, a plurality of the CIS chips are packaged on the periphery of the display area.

[0010] In one embodiment of the present invention, the display area is a silicon-based Micro-OLED chip.

[0011] In one embodiment of the present invention, the display area includes at least a driving control layer and a Micro-OLED pixel display layer, wherein: the driving control layer is used to receive the adjustment behavior and the target position, and convert the adjustment behavior and the target position to generate a driving voltage for driving the Micro-OLED pixel display layer; the Micro-OLED pixel display layer is arranged on the driving control layer, and is used to update the display information of the virtual reality / augmented reality content at the target position under the action of the driving voltage.

[0012] In one embodiment of the present invention, the processing and control chip includes: a behavior analysis unit, used to extract and analyze the motion features of the plurality of eye images to determine the corresponding adjustment behavior; a pupil positioning unit, used to analyze the angle between the corneal reflected light and the pupil reflected light of the non-visible reflected light based on the pupil-corneal reflection vector method, determine the gaze position of the pupil in the display area based on the angle, and use it as the target position of the display area.

[0013] In one embodiment of the present invention, the display device further includes a power supply unit, which is electrically connected to the display area, the processing control chip, the non-visible light emitter and the eye tracking pixel collector respectively.

[0014] In an embodiment of the present invention, the power supply unit is a power chip.

[0015] In one embodiment of the present invention, the non-visible light is infrared light or near-infrared light.

[0016] In one embodiment of the present invention, a near-eye display device is further provided, the device comprising: a bracket; a display device as described in any one of the above items, wherein the display device is arranged on the bracket and is used to track eye postures for near-eye display.

[0017] In one embodiment of the present invention, the bracket includes: a frame; a printed circuit board installed on the frame; wherein the printed circuit board at least integrates a display area and a processing control chip that are electrically connected to each other, and non-visible light emitters and eye tracking pixel collectors are arranged at intervals on the periphery of the display area.

[0018] As described above, a display device and a near-eye display device of the present invention have the following beneficial effects: the processing control chip sends instructions to control the non-visible light emitter to emit non-visible light to the eye, the eye tracking pixel collector captures the light and image reflected by the eye, and transmits the data to the processing control chip for analysis, thereby determining the target position of the operator in the display area and the corresponding adjustment behavior. The display area dynamically displays virtual reality or augmented reality content at the target position of gaze according to the adjustment behavior generated by the processing control chip. The present invention realizes precise control of non-visible light and real-time processing of eye movement data through the integrated design of the chip, thereby ensuring that the eye tracking has good response speed and accuracy. In addition, this chip integration method greatly reduces the space occupancy rate of the device, realizes the lightweight design of the device, optimizes the user's wearing experience, and significantly improves the user's immersion and convenience of use. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 It is a schematic diagram of the structure of a traditional display device;

[0020] Figure 2 Shown is a side view of a display device provided by an embodiment of the present invention;

[0021] Figure 3 Shown is a front view of a display device provided by an embodiment of the present invention;

[0022] Figure 4 Shown is a structural block diagram of the display device of the present invention;

[0023] Figure 5 Shown are diagrams showing different pupil positions in the eye.

[0024] Component number description:

[0025] 100. Processing control chip; 200. Display area; 300. Non-visible light emitter; 400. Eye tracking pixel collector; 500. Power supply unit; 600. Eyes. DETAILED DESCRIPTION

[0026] The following describes the embodiments of the present invention by specific examples, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present invention. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict.

[0027] It should be noted that the illustrations provided in the following embodiments are only schematic illustrations of the basic concept of the present invention, and thus the drawings only show components related to the present invention rather than being drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component may be changed arbitrarily, and the component layout may also be more complicated.

[0028] In the following description, numerous details are discussed to provide a more thorough explanation of the embodiments of the present invention. However, it is obvious to those skilled in the art that the embodiments of the present invention can be implemented without these specific details. In other embodiments, well-known structures and devices are shown in the form of block diagrams rather than in detail to avoid making the embodiments of the present invention difficult to understand.

[0029] In order to better understand and illustrate the method provided in the embodiments of the present application, some technical terms involved in the embodiments of the present application are first explained and illustrated below.

[0030] The design principle of eye tracking is to use an infrared transmitter to emit a beam of infrared light to illuminate the eyes. The infrared light reflected from the cornea and retina is collected by the camera. Due to the physiological structure and physical properties of the eyeball, under the premise that the relative position of the light source and the head remains unchanged, the light spot formed by the corneal reflection will not move, and the direction of the light reflected on the retina indicates the direction of the pupil (the light source enters from the pupil, and the retinal reflected light is emitted from the pupil). Finally, the direction of the eye movement can be calculated based on the angle between the cornea and the pupil reflected light. When the subject is staring at a fixed target, no matter how the head moves, the positional relationship between the pupil center and the corneal reflection will not change. Even if the subject is moving, the eye tracker can reflect that she is looking at the same position. Therefore, when the light source and the head position are relatively stable, the light reflected from the cornea and retina is collected, and their relative position relationship is analyzed, the data of the pupil direction can be obtained. This is the principle of the pupil-corneal reflection eye tracker.

[0031] In one known type of optical eye tracking technology, light (typically light in the infrared region) is reflected from the eye and sensed by a camera. The information sensed by the camera is then analyzed to extract the gaze direction or position of the pupil from the changes in the reflection. Video-based eye trackers sometimes use corneal reflections or pupil centers as features to track over time. A camera-based eye tracking system may include a rear-mounted camera attached to a bracket and pointed (directly or indirectly) at the user's eyes as a means of detecting the position of the user's eyes. The digital data generated by the camera is sent via wired or wireless means to an external device such as a computer (or alternatively, to a computer resource located on itself) for processing and analysis. Computer software in such a system runs an eye tracking algorithm known to those of ordinary skill in the art to detect the position of one or both of the user's eyes.

[0032] like Figure 1 As shown, eye tracking includes one or two small display areas with lenses and semi-transparent mirrors (i.e., "hot mirrors") embedded in various form factors, such as helmets, glasses (also called data glasses), or goggles. Hot mirrors provide one possible design approach for eye tracking and allow cameras or other eye tracking sensors (such as eye tracking cameras) to obtain a good view of the eye being tracked. Some hot mirrors reflect infrared ("IR") radiation and are transparent to visible light. The hot mirror in some eye tracking applications is tilted in front of the eye and allows the IR camera or other eye tracking sensor to obtain a reflected image of the eye while having a transparent view on the display. Figure 1 The display shows a traditional display device, where an infrared transmitter emits infrared light to the user's eyeball, and the light reflected from the eyeball is transmitted to the eye tracking camera through a lens and a thermal mirror, and the corresponding content is displayed on the display after being analyzed by the controller. This optical eye tracking method is widely used for gaze tracking. Such a tracker may require a relatively high-resolution camera that uses image processing and pattern recognition devices to capture at a high frame rate to track reflected light or known eye structures (e.g., iris or pupil).

[0033] Based on the above, traditional display devices monitor eye movements by reflecting and capturing light through optical components such as lenses and thermal mirrors. However, these components greatly increase the weight of the entire VR / AR glasses, making the entire device bulky and not conducive to long-term wear by users. In addition, traditional devices usually require users to hold controllers to assist in operation and target selection, but this interaction method is not natural enough. When using it, users need to switch back and forth between line of sight and hand operation, and cannot achieve natural line of sight control, resulting in poor immersion for users.

[0034] See also Figure 2Based on the above problems, the present invention provides a display device, in which the processing control chip 100 sends instructions to control the non-visible light emitter 300 to emit non-visible light to the eye 600, and the eye tracking pixel collector 400 captures the light and image reflected by the eye, and transmits the data to the processing control chip 100 for analysis, so as to determine the target position of the operator in the display area 200 and the corresponding adjustment behavior. The display area 200 dynamically displays the content of virtual reality or augmented reality at the target position of gaze according to the adjustment behavior generated by the processing control chip 100. The key components of the present invention are all implemented in the form of chips. Through the integrated design of this chip, the physical connection between the components is reduced, and the precise control of non-visible light and the real-time processing of eye movement data are realized, thereby ensuring that the eye tracking has good response speed and accuracy. In addition, this chip integration method greatly reduces the space occupancy rate of the device, realizes the lightweight design of the device, optimizes the user's wearing experience, and significantly improves the user's immersion and convenience of use. Furthermore, this method of the present invention can determine the target position and adjustment behavior through eye tracking, so as to realize clicking the target at the target position on the display screen and present it according to the adjustment behavior, thereby eliminating manual remote control operation actions, and thus has milestone significance for the product.

[0035] See also Figure 2 and Figure 3 The display device includes: a processing control chip 100, a display area 200, a non-visible light emitter 300, and an eye tracking pixel collector 400. The processing control chip 100 is used to send control instructions; the display area 200 is used to display virtual reality / augmented reality content; the non-visible light emitter 300 is installed on the outer peripheral side of the display area 200, and is used to emit non-visible light according to the control instructions; the eye tracking pixel collector 400 is installed on the outer peripheral side of the display area 200, and is used to receive the reflected non-visible reflected light and obtain the eye image of the operating body; the processing control chip 100 is also used to analyze the received non-visible reflected light and the eye image, determine the adjustment behavior and the target position of the display area 200 corresponding to the adjustment behavior; the display area 200 is also used to display the virtual reality / augmented reality content at the target position according to the adjustment behavior.

[0036] See also Figure 4, the processing control chip 100 serves as the control center of the entire display device, and is responsible for sending control instructions to the non-visible light emitter 300, and receiving eye movement data such as non-visible reflected light and eye images reflected by the operator's eyes 600 sent by the eye tracking pixel collector 400. After analyzing and processing these eye movement data, the gaze position of the operator and the specific adjustment behavior can be determined. The processing control chip 100 can also determine its target position in the display area 200 according to the gaze position based on the data fed back by the display area 200. Thereby, the display area 200 can dynamically adjust the display content according to the corresponding adjustment behavior according to the change of the operator's line of sight. Specifically, after the operator wears the near-eye display device provided with the display device, the processing control chip 100 will send control instructions to the non-visible light emitter 300 at a preset time interval, so that the non-visible light emitter 300 emits non-visible light to the operator's eyes 600. When the eye tracking pixel collector 400 receives the non-visible reflected light and the eye image reflected from the eye, it sends them to the processing control chip 100. The processing control chip 100 analyzes and processes these eye movement data, determines the gaze direction of the eye 600 based on the non-visible reflected light, and determines the specific eye movement based on the eye image, so as to determine the adjustment behavior. Exemplarily, when the operator gazes at a certain position of the display area 200, the processing control chip 100 can command the display area 200 to enlarge or focus the content of the position according to the gaze position. Furthermore, in order to reduce the volume of the near-eye display device and improve the wearing comfort of the user, in one embodiment of the present invention, the processing control chip 100 is a CPU chip.

[0037] See also Figure 2 and Figure 3 , the non-visible light emitter 300 is arranged on the outer peripheral side of the display area 200, and is used to emit non-visible light to the eyes 600 of the operating body under the action of the control command. When the non-visible light irradiates the eyes 600 of the operating body, a part of the light is reflected on the cornea to form a stable corneal reflection light spot, and the other part of the light passes through the pupil into the eye, and is emitted from the pupil after being reflected on the retina. These two kinds of non-visible reflected light will be captured by the eye tracking pixel collector 400 and transmitted to the processing and control chip 100. Based on the relative position changes of the corneal reflection light spot and the pupil reflection light, the processing and control chip 100 uses the pupil-corneal reflection vector method to calculate the real-time gaze point position and gaze direction of the eye 600, so as to accurately track the line of sight of the operating body. Furthermore, since the human eye cannot perceive the existence of infrared light and near-infrared light, it will not interfere with the user's visual experience. Therefore, in one embodiment of the present invention, the non-visible light is infrared light or near-infrared light. Further, if Figure 5As shown in FIG. 1 , it shows schematic diagrams of different positions of the pupil in the eye, namely, the pupil is on the right side above the eye, in the middle above the glasses, on the left side above the eye, and the pupil is on the right side below the eye, in the middle below the eye, and on the left side below the eye. It can be seen that the user's gaze point can be accurately determined by the change in the position of the pupil.

[0038] Please continue to see Figure 2 and Figure 3 The eye tracking pixel collector 400 receives the invisible reflected light reflected by the pupil and cornea, and can also capture the image of the eye and its surroundings, and extract the eye image from it through the image processing algorithm. The received invisible emitted light and eye image are sent to the processing control chip 100, so that it can determine the specific target position of the display area 200 and the corresponding adjustment behavior based on these eye movement data.

[0039] Please continue to see Figure 2 and Figure 3 , after the processing control chip 100 determines the gaze point and adjusts the behavior, the display area 200 will display the display content at the target position of the display area 200 according to this information, and provide users with a smoother interactive experience through this eye tracking method. In one embodiment of the present invention, the display area 200 is a silicon-based Micro-OLED chip. The display area 200 adopts a silicon-based CMOS technology driver chip, and makes a Micro-OLED pixel display layer on the upper surface of the silicon-based CMOS technology driver chip, so that the bottom CMOS drives the upper Micro-OLED pixel. This design not only improves the resolution of the pixel, but also greatly improves the brightness uniformity and brightness, making the visual effect clearer and brighter. Specifically, the silicon-based Micro-OLED chip realizes the combination of pixels and silicon-based CMOS chips, has high resolution and clarity, and can present a clear visual picture. The display area 200 receives the video signal (MIPI / RGB / LVDS and other formats) transmitted by the processing control chip 100, and is driven by the silicon-based Micro-OLED and displayed in the Micro-OLED pixel area.

[0040] See also Figure 2 and Figure 4In order to improve the comprehensiveness of data collection and take into account the actual needs of space and weight of AR / VR glasses, the present invention removes traditional lenses and thermal mirrors, thereby greatly reducing the space occupied by the entire device. Specifically, in one embodiment of the present invention, there are multiple non-visible light emitters 300 and multiple eye tracking pixel collectors 400, respectively, and multiple non-visible light emitters 300 and multiple eye tracking pixel collectors 400 are alternately arranged around the periphery of the display area 200. Multiple non-visible light emitters 300 are evenly arranged around the outside of the display area 200, so that non-visible light can be emitted toward the eyes of the operating body from different angles, which facilitates the all-round reflection of non-visible light from the cornea and pupil. Multiple eye tracking pixel collectors 400 are alternately installed between the non-visible light emitters 300 and are evenly distributed around the periphery of the display area 200. This method can ensure that the eye tracking pixel collector 400 can receive the non-visible reflected light reflected by the eye 600 of the operator from different angles, so that the subtle movement and position change of the eye 600 can be captured more accurately, effectively improving the problem of blind spots that are prone to occur in single-angle monitoring. This method of alternating multiple non-visible light emitters 300 and multiple eye tracking pixel collectors 400 can collect data from multiple perspectives, ensure the stability and reliability of the data, and provide more and more accurate data to analyze the position of the eye 600 rotation. It can be understood that the arrangement order between the eye tracking pixel collector 400 and the non-visible light emitter 300 is not limited, and can be "eye tracking pixel collector 400-non-visible light emitter 300-eye tracking pixel collector 400", or "eye tracking pixel collector 400-non-visible light emitter 300-non-visible light emitter 300-eye tracking pixel collector 400", etc. The specific combination method is not limited and can be adaptively selected based on actual application needs.

[0041] See also Figure 4 In one embodiment of the present invention, the eye tracking pixel collector 400 is a CIS chip. The high-precision CIS chip can collect infrared light information and direction and face information in multiple viewing angles and directions, so that more data can be obtained to facilitate the processing and analysis of the control chip 100. In addition, unlike traditional image collectors, the present invention uses a CIS chip as a pixel image collector. Since the CIS chip has a strong photosensitivity, it not only greatly improves the clarity and accuracy of pixel collection, but also reduces the installation space on the main bracket. By adopting the chip, the lightweight degree of AR / VR glasses can be effectively improved to improve the comfort of users wearing them.

[0042] See also Figure 3 and Figure 4In one embodiment of the present invention, a plurality of the CIS chips are packaged on the periphery of the display area 200. A plurality of CIS chips are evenly packaged on the outer side of the display area 200 to form a ring array surrounding the display area 200. Since the CIS chip is small in size, directly packaging it on the outer edge of the display area 200 does not affect the overall size of the device, thereby enabling a lightweight design of the entire device. In addition, the design of multiple CIS chips working in collaboration also ensures data redundancy. Even if a CIS chip fails, other CIS chips can still work normally to ensure stable operation of the system.

[0043] See also Figure 2 and Figure 4 In one embodiment of the present invention, the display area 200 at least includes a driving control layer and a Micro-OLED pixel display layer, wherein: the driving control layer is used to receive the adjustment behavior and the target position, and convert the adjustment behavior and the target position to generate a driving voltage for driving the Micro-OLED pixel display layer; the Micro-OLED pixel display layer is arranged on the driving control layer, and is used to update the display information of the virtual reality / augmented reality content at the target position under the action of the driving voltage. The display area 200 adopts a silicon-based Micro-OLED chip, including a driving control layer and a Micro-OLED pixel display layer located thereon. Specifically, after receiving the adjustment behavior and the corresponding target position sent by the processing control chip 100, the driving control layer will perform data conversion on the received information, and generate a driving voltage signal suitable for driving the Micro-OLED pixel display layer through data format conversion. The Micro-OLED pixel display layer is composed of a large number of micro OLED pixels, which can emit light independently under the drive of voltage. When the voltage signal provided by the driving control layer is applied to the pixel, the OLED material emits visible light. Thus, the driving voltage signal controls the brightness and color of each pixel to form a complete image or video content.

[0044] See also Figure 4In one embodiment of the present invention, the processing control chip 100 includes: a behavior analysis unit, which is used to extract and analyze the motion features of the plurality of eye images to determine the corresponding adjustment behavior; and a pupil positioning unit, which is used to analyze the angle between the corneal reflection light of the non-visible reflection light and the pupil reflection light according to the pupil-corneal reflection vector method, determine the gaze position of the pupil in the display area 200 based on the angle, and use it as the target position of the display area 200. The behavior analysis unit receives a plurality of eye images within a preset time length sent by each eye tracking pixel collector 400, and extracts eye features in the eye images through a pre-trained eye movement recognition model to determine the user's interactive action. The identified interactive action is analyzed, and if the interactive action is a preset action category, the corresponding adjustment behavior can be determined according to the interactive action. Exemplarily, the interactive action is a preset number of blinks (such as 5 times) within a preset time length (such as 2 seconds), and the adjustment behavior is to amplify the information of the corresponding position. It is understandable that the eye movement recognition model that recognizes interactive actions through eye images can be any applicable model (such as YOLO, MobileNet, LSTM, etc.), which is not limited here. After the pupil positioning unit receives the corneal reflected light and pupil emitted light sent by the eye tracking pixel collector 400, it determines the gaze angle at this time by calculating the angle between the corneal reflected light and the pupil reflected light. According to the preset mapping rules, after mapping the gaze angle to the coordinate system of the display area 200, the specific gaze position (i.e., the target position) of the operating body in the display area 200 can be determined. The eye movement operation control content presentation can be realized according to the target position and the adjustment behavior. Exemplarily, the target position is A, and the adjustment behavior is to amplify the information, then the final effect is to amplify the content at A in the display area 200.

[0045] See also Figure 4 In one embodiment of the present invention, the display device further includes a power supply unit 500, and the power supply unit 500 is electrically connected to the display area 200, the processing control chip, the non-visible light emitter 300, and the eye tracking pixel collector 400, respectively. The power supply unit 500 serves as the power supply center of the entire device and is electrically connected to other components to ensure the normal operation of the device by providing different power supply voltages to different components. In one embodiment of the present invention, the power supply unit 500 is a power chip. By setting the power supply unit 500 as a power chip, the space occupancy rate can be greatly reduced, thereby effectively reducing the overall size of the device and improving the lightweight and portability of the device.

[0046] See also Figure 2 and Figure 3, the processing process of the display device in the present invention is as follows: the non-visible light emitter 300 is used to emit infrared light to the eyes 600 of the operator, and the infrared light emitted by the non-visible light emitter 300 is irradiated on the human cornea and reflected on the cornea to form a corneal reflection spot. According to the change in the relative position of the corneal reflection spot and the pupil, the pupil-corneal reflection method is used to calculate the position and gaze direction of the real-time gaze point of the human eye to track the eye sight of the monitored person. By adding multiple groups of non-visible light emitters 300 and fixing them in special positions, it is convenient to emit infrared light at multiple angles and reflect infrared light from the cornea and pupil without dead angles. Unlike the traditional design, non-visible light emitters 300 are installed in different positions around the display area 200 to ensure that infrared rays are emitted at different positions to the human eye, and infrared rays are reflected from different viewing angles. When a person wears AR / VR glasses, the display area 200 is located directly in front of the eye 600. The pupil of the human eye usually rotates continuously and searches for display target graphics at different positions on the display area 200. Under the action of the processing and control chip 100, the non-visible light emitter 300 emits non-visible light to the eye, and the eye tracking pixel collector 400 obtains the eye image and non-visible reflected light, etc., and transmits these data to the processing and control chip 100. The processing and control chip 100 receives and analyzes these data, and gives a display target graphic on the display area 200 where the eye 600 is locked. The display area 200 can receive the processing and control chip signal and confirm the position where the human eye pupil is looking at, so the display area 200 can identify the content that the person wants to see and open the video signal content.

[0047] In one embodiment of the present invention, a near-eye display device is also provided, comprising a bracket (not shown in the figure) and any of the display devices described above, the display device being mounted on the bracket and used to track eye postures for near-eye display. The near-eye display device includes but is not limited to VR glasses and AR glasses.

[0048] See also Figure 2 and Figure 4In one embodiment of the present invention, the bracket includes: a frame; a printed circuit board mounted on the frame; wherein the printed circuit board at least integrates a display area 200 and a processing control chip 100 electrically connected to each other, and the outer periphery of the display area 200 is provided with a non-visible light emitter 300 and an eye tracking pixel collector 400. The frame is similar to a glasses structure or a head-mounted device, and is used to provide mechanical support for the display device. The printed circuit board (PCB) is mounted on the frame to provide an electrical connection path for each component of the display device. Specifically, the display area 200 is integrated on the printed circuit board and is located in front of the entire frame to present the corresponding VR / AR content. The eye tracking pixel collector 400 is encapsulated on the outer periphery of the display area 200, and the non-visible light emitter 300 is mounted on the frame and is alternately arranged with the eye tracking pixel collector 400 according to a preset order. The processing control chip 100 is integrated on the printed circuit board and is located beside the display area 200. It is used to process various data and generate processing results so that the display area 200 displays corresponding content according to the processing results.

[0049] In summary, the present invention discloses a display device and a near-eye display device, wherein the processing control chip sends instructions to control the non-visible light emitter to emit non-visible light to the eye, and the eye tracking pixel collector captures the light and image reflected by the eye, and transmits the data to the processing control chip for analysis, thereby determining the target position of the operator in the display area and the corresponding adjustment behavior. The display area dynamically displays the content of virtual reality or augmented reality at the target position of the gaze according to the adjustment behavior generated by the processing control chip. All key components of the present invention are implemented in the form of chips. The integrated design of this chip reduces the physical connection between the modules, realizes the precise control of non-visible light and the real-time processing of eye movement data, thereby ensuring that the eye tracking has good response speed and accuracy. In addition, this chip integration method greatly reduces the space occupancy rate of the device, realizes the lightweight design of the device, optimizes the user's wearing experience, and significantly improves the user's immersion and convenience of use. Furthermore, this method of the present invention can determine the target position and adjustment behavior through eye tracking, so as to realize the selection of the target at the target position on the display screen, and make it present according to the adjustment behavior, thereby eliminating the manual remote control operation action, and therefore has a milestone significance for VR glasses or AR glasses. Therefore, the present invention effectively overcomes various shortcomings in the prior art and has high industrial utilization value.

[0050] The above embodiments are merely illustrative of the principles and effects of the present invention, and are not intended to limit the present invention. Anyone familiar with the art may modify or alter the above embodiments without departing from the spirit and scope of the present invention. Therefore, all equivalent modifications or alterations made by a person of ordinary skill in the art without departing from the spirit and technical concept disclosed by the present invention shall still be covered by the claims of the present invention.

Claims

1. A display device, characterized in that: The device comprises: Processing control chip, used to send control instructions; Display area, used to display virtual reality / augmented reality content; a non-visible light emitter, mounted on the outer periphery of the display area, and configured to emit non-visible light according to the control instruction; An eye tracking pixel collector, mounted on the outer periphery of the display area, for receiving the reflected invisible reflected light and acquiring an eye image of the operating body; The processing control chip is further used to analyze the received non-visible reflected light and the eye image to determine an adjustment behavior and a target position of the display area corresponding to the adjustment behavior; The display area is also used to display virtual reality / augmented reality content at the target location according to the adjustment behavior.

2. The display device according to claim 1, characterized in that There are a plurality of the non-visible light emitters and a plurality of the eye-tracking pixel collectors, respectively, and the plurality of the non-visible light emitters and the plurality of the eye-tracking pixel collectors are alternately arranged around the periphery of the display area.

3. The display device according to claim 2, characterized in that The eye tracking pixel collector is a CIS chip.

4. The display device according to claim 3, characterized in that A plurality of CIS chips are packaged on the periphery of the display area.

5. The display device according to claim 1, characterized in that The display area is a silicon-based Micro-OLED chip.

6. The display device according to claim 5, characterized in that The display area at least includes a driving control layer and a Micro-OLED pixel display layer, wherein: The driving control layer is used to receive the adjustment behavior and the target position, and convert the adjustment behavior and the target position to generate a driving voltage for driving the Micro-OLED pixel display layer; The Micro-OLED pixel display layer is arranged on the driving control layer, and is used to update the display information of the virtual reality / augmented reality content at the target position under the action of the driving voltage.

7. The display device according to claim 1, characterized in that The processing control chip comprises: A behavior analysis unit, used to extract and analyze the action features of the plurality of eye images to determine corresponding adjustment behaviors; The pupil positioning unit is used to analyze the angle between the corneal reflected light and the pupil reflected light of the non-visible reflected light according to the pupil-corneal reflection vector method, determine the gaze position of the pupil in the display area based on the angle, and use it as the target position of the display area.

8. The display device according to claim 1, characterized in that The display device also includes a power supply unit, which is electrically connected to the display area, the processing control chip, the non-visible light emitter and the eye tracking pixel collector respectively.

9. The display device according to claim 8, characterized in that The power supply unit is a power chip.

10. The display device according to claim 1, characterized in that The non-visible light is infrared light or near infrared light.

11. A near-eye display device, characterized in that: The device comprises: Bracket; The display device according to any one of claims 1 to 10, wherein the display device is arranged on the bracket and is used to track eye posture for near-eye display.

12. The near-eye display device according to claim 11, characterized in that: The support comprises: Frame; A printed circuit board is mounted on the frame; wherein the printed circuit board at least integrates a display area and a processing control chip that are electrically connected to each other, and non-visible light emitters and eye tracking pixel collectors are arranged at intervals on the periphery of the display area.

Images