Display apparatus adjusting display mode using line-of-sight direction and operating method thereof

By identifying the direction of the face and the direction of the gaze, and using the VOR compensation mode and the field of view range to adjust the three-dimensional rendering mode, the problems of image jitter and visual disparity caused by head rotation in 3D display technology are solved, thereby improving the viewing experience.

CN114610141BActive Publication Date: 2025-10-17ACER INC
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202011402868.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-12-04
Publication Date
2025-10-17
Estimated Expiration
2040-12-04

AI Technical Summary

Technical Problem

Existing 3D display technology causes abnormal jitter in the 3D image when the viewer turns their head, and there is a discrepancy between the left and right eye images and the human eye's perception of actual objects, causing dizziness and discomfort in the user.

Method used

By identifying the face and gaze directions of people in the viewing area, the processing circuit determines whether to enable the vestibular-oculomotor reflex (VOR) compensation mode, and dynamically adjusts the 3D rendering mode according to the field of view, enabling 3D rendering or 2D rendering respectively.

Benefits of technology

Improved the jitter problem caused by abnormal switching of 3D display modes due to inaccurate eye detection when the viewer moves their head and eyes, improving the user's viewing experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114610141B_ABST
    Figure CN114610141B_ABST
Patent Text Reader

Abstract

A display device and an operating method thereof are provided. The display device includes a three-dimensional display module, a camera, and a processing circuit. The processing circuit is coupled to the three-dimensional display module and the camera. The camera is configured to capture a viewing field of the three-dimensional display module to generate a photo. The processing circuit is configured to output an image stream to the three-dimensional display module to display a picture. The processing circuit identifies the photo to learn a face direction and a gaze direction of a person in the viewing field. The processing circuit determines whether to enable a vestibulo-ocular reflex (VOR) compensation mode for the image stream according to the face direction and the gaze direction.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to a display technology, and more particularly, to a display device adjusting a display mode using a line-of-sight direction and an operating method thereof. BACKGROUND

[0002] In a conventional 3D display technology, a display image does not dynamically zoom in or out in response to a change in a viewer's viewpoint, unlike an actual experience of an object. Therefore, in the 3D display technology, an object is dynamically zoomed in or out in response to a person's face approaching or moving away from a screen, and a person's eyes can see different angle images of the same object while the head is rotated at a fixed gaze position, so that an interactive feeling closer to an actual object can be achieved.

[0003] Using a vestibulo-ocular reflex (VOR) mechanism of a person's eyes, a lens provides a hand-shake prevention function when a mobile phone is used for photographing, so that the image is not shaken to some extent when the mobile phone is used for photographing. The vestibulo-ocular reflex of a person's eyes is one of the fastest and most active reflexes in the human body. After the inner ear detects head movement, the vestibulo-ocular reflex controls the eyeball to produce compensatory movement to match the movement of the head (but the eyeball movement is opposite to the direction of the head). Therefore, no matter how much the head is rotated, the subconscious continuous eye posture adjustment can keep the person's eyes in a stable gaze state.

[0004] However, in the existing 3D display technology, when the viewer's head is rotated, the 3D image will be abnormally shaken, and there is a gap between the left and right eye images and the actual object. At present, the 3D image is generated by detecting the image by parallel and front and back movement of the face landmark of the 2D face, without supporting the up, down, left and right rotation of the head, and without detecting the actual gaze position of the eyeball. Therefore, there is a misalignment between the left and right eye images and the actual feeling, causing the user to feel dizzy and uncomfortable, and the user experience is greatly reduced.

[0005] It should be noted that the content of the "BACKGROUND" section is used to help understand the present application. Part or all of the content disclosed in the "BACKGROUND" section may not be prior art known to those skilled in the art. The content disclosed in the "BACKGROUND" section does not mean that the content is known to those skilled in the art before the present application. SUMMARY

[0006] The present application provides a display device and an operating method thereof, which can determine a display operation according to a face direction and a line-of-sight direction.

[0007] Embodiments of the present disclosure provide a display device. The display device includes a three-dimensional display module, a camera, and a processing circuit. The camera is configured to capture a viewing field of the three-dimensional display module to generate a photograph. The processing circuit is coupled to the three-dimensional display module and the camera. The processing circuit is configured to output a stream of images to the three-dimensional display module to display a picture. The processing circuit can identify the photograph to obtain a face direction and a gaze direction of a person in the viewing field. The processing circuit can determine whether to enable a vestibulo-ocular reflex (VOR) compensation mode for the stream of images based on the face direction and the gaze direction.

[0008] Another embodiment of the present disclosure provides an operation method of a display device. The operation method includes capturing, by a camera of the display device, a viewing field of a three-dimensional display module of the display device to generate a photograph, outputting, by a processing circuit of the display device, a stream of images to the three-dimensional display module to display a picture, identifying, by the processing circuit, the photograph to obtain a face direction and a gaze direction of a person in the viewing field, and determining, by the processing circuit, whether to enable a vestibulo-ocular reflex (VOR) compensation mode for the stream of images based on the face direction and the gaze direction.

[0009] Yet another embodiment of the present disclosure provides a display device. The display device includes a three-dimensional display module, a camera, and a processing circuit. The camera is configured to capture a viewing field of the three-dimensional display module to generate a photograph. The processing circuit is coupled to the three-dimensional display module and the camera. The processing circuit is configured to output a stream of images to the three-dimensional display module to display a picture. The processing circuit can identify the photograph to obtain a face direction and a gaze direction of a person in the viewing field. The processing circuit can determine a field of view of the person based on the face direction and the gaze direction. The processing circuit can enable a three-dimensional (3D) rendering mode for a picture covered by the field of view, and the processing circuit can enable a two-dimensional (2D) rendering mode for a picture not covered by the field of view.

[0010] Still another embodiment of the present disclosure provides an operation method of a display device. The operation method includes capturing, by a camera of the display device, a viewing field of a three-dimensional display module of the display device to generate a photograph, outputting, by a processing circuit of the display device, a stream of images to the three-dimensional display module to display a picture, identifying, by the processing circuit, the photograph to obtain a face direction and a gaze direction of a person in the viewing field, determining, by the processing circuit, a field of view of the person based on the face direction and the gaze direction, enabling, by the processing circuit, a three-dimensional (3D) rendering mode for a picture covered by the field of view, and enabling, by the processing circuit, a two-dimensional (2D) rendering mode for a picture not covered by the field of view.

[0011] Based on the above, embodiments of the present application recognize the face direction and the line of sight direction of the viewer in the viewing field from the photo. In some embodiments, the processing circuit can determine whether to enable a vestibulo-ocular reflex (VOR) compensation mode for the image stream according to the face direction and the line of sight direction. In other embodiments, the processing circuit can determine the field of view of the viewer according to the face direction and the line of sight direction, and then enable a three-dimensional rendering mode for the pictures covered by the field of view and a two-dimensional rendering mode for the pictures not covered by the field of view. BRIEF DESCRIPTION OF DRAWINGS

[0012] Figure 1 is a schematic diagram of a display device according to an embodiment of the present application;

[0013] Figure 2 is a flowchart of an operation method of a display device according to an embodiment of the present application;

[0014] Figure 3 is a schematic diagram of an eye image according to an embodiment of the present application;

[0015] Figure 4 is a schematic diagram of an eye image according to another embodiment of the present application;

[0016] Figure 5 is a flowchart of an operation method of a display device according to another embodiment of the present application;

[0017] Figure 6 is a top view schematic diagram of a field of view of a person according to an embodiment of the present application;

[0018] Figure 7 is a side view schematic diagram of a field of view of a person according to an embodiment of the present application;

[0019] Figure 8 is a flowchart of an operation method of a display device according to yet another embodiment of the present application.

[0020] REFERENCE SIGNS

[0021] 10: display device

[0022] 20: person

[0023] 100: three-dimensional display module

[0024] 110: viewing field

[0025] 112: picture

[0026] 200: camera

[0027] 210: photo

[0028] 212: eye image

[0029] 213: corneal diameter

[0030] 214: corneal left distance

[0031] 215: corneal right distance

[0032] 216: eye vertical length

[0033] 217: eyelid vertical length

[0034] 240: field of view range

[0035] 300: processing circuitry

[0036] 310: image stream

[0037] S210-S240, S310-S360, S410-S460: steps DETAILED DESCRIPTION

[0038] Reference will now be made in detail to the exemplary embodiments of the present application, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers will be used in the different drawings and the description to refer to the same or like parts.

[0039] The term "coupled" or "connected" used in the detailed description of the specification (including the claims) can refer to either a direct or indirect connection. For example, if a first device is coupled (or connected) to a second device, it can be directly connected to the second device or it can be indirectly connected to the second device through one or more other devices or some connection means. The terms "first", "second", and the like used in the detailed description of the specification (including the claims) are used to name components, or to distinguish different embodiments or aspects of the application, and are not used to limit the number of components or the order of components. In addition, wherever possible, like components / elements / steps in the drawings and embodiments are denoted by like reference numerals. Components / elements / steps denoted by like reference numerals in different embodiments or using like terms can be referred to each other for relevant description.

[0040] Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. Components denoted by the same reference numerals in the description cited below are considered to be the same or similar components. These embodiments are only some of the embodiments of the present application and do not disclose all the embodiments of the present application. Rather, these embodiments are only examples of the devices and systems in the claims of the present application.

[0041] Figure 1is a schematic diagram of a display device 10 according to an embodiment of the present application. Figure 1 The display device 10 shown includes a three-dimensional display module 100, a camera 200, and a processing circuit 300. The processing circuit 300 is coupled to the three-dimensional display module 100 and the camera 200. The processing circuit 300 can output an image stream 310 to the three-dimensional display module 100 for displaying a picture. A person 20 in a viewing field 110 can view the picture displayed by the three-dimensional display module 100. Depending on different design requirements, the three-dimensional display module 100 and / or the processing circuit 300 can be implemented in hardware, firmware, software (i.e., a program), or a combination of more than one of the foregoing.

[0042] Figure 2 is a flowchart of a method for operating a display device according to an embodiment of the present application. Please refer to Figure 1 and Figure 2 In step S210, the camera 200 can take a photograph 210 of the viewing field 110 of the three-dimensional display module 100.

[0043] In step S220, the processing circuit 300 of the display device 10 outputs an image stream 310 to the three-dimensional display module 100 for displaying a picture. Depending on design requirements, in some embodiments, the image stream 310 can be a three-dimensionally rendered object frame or a two-dimensionally displayed object frame. For example, the image stream 310 can be a display frame that supports a vestibulo-ocular reflex (VOR) compensation mode. It should be noted that there is no sequence restriction between step S210 and step S220. In some implementation scenarios, step S210 and step S220 can be performed simultaneously. In other implementation scenarios, step S220 can be performed earlier (or later) than step S210.

[0044] In step S230, the processing circuit 300 can recognize the photograph 210 to obtain the face direction and the gaze direction of the person 20 in the viewing field 110. The face direction can include yaw, pitch, or roll direction rotation. In some embodiments, the processing circuit 300 can determine the direction of the user's head rotation (face direction) by using feature points calculated by a face landmark technique. For example, the processing circuit 300 can calculate the nose midline, the average eye midline, and the ellipse formed by the chin and the forehead, and detect the change in the shape of the ellipse to determine the case of head rotation.

[0045] In some embodiments, the processing circuit 300 can further calculate the gaze direction (eye direction) based on the feature points of the face landmark information. The face direction and the gaze direction can be the same direction or different directions.

[0046] In step S240, the processing circuit 300 can determine whether to enable the VOR compensation mode for the image stream 310 according to the face direction and the gaze direction. The VOR compensation mode can perform the existing VOR compensation operation or other VOR compensation operation according to design requirements. For example, in some embodiments, the VOR compensation mode is enabled when the face direction and the gaze direction are different.

[0047] Figure 3 FIG. 4 is a schematic diagram illustrating the identification of the eye image 212 in the photo 210 according to an embodiment of the present application. Please refer to FIG. 1 and FIG. 4. Figure 1 、 Figure 2 and Figure 3 In some embodiments, the processing circuit 300 can obtain the eye image 212 of the person 20 in the photo 210. The processing circuit 300 can identify the eye image 212 in the photo 210 to obtain the corneal diameter 213, the left corneal distance 214, and the right corneal distance 215. The processing circuit 300 can use at least the corneal diameter 213, the left corneal distance 214, and the right corneal distance 215 to obtain the gaze direction of the person 20 in step S230. For example, the gaze direction can be determined (obtained) by comparing the size of the left corneal distance 214 and the right corneal distance 215. In some embodiments, when the left corneal distance 214 is smaller than the right corneal distance 215, the processing circuit 300 can determine that the gaze direction is right rotation. That is, the face direction of the person 20 is toward the camera 200 (the three-dimensional display module 100), but the gaze direction (eye direction) is right rotation. Conversely, when the left corneal distance 214 is greater than the right corneal distance 215, the processing circuit 300 can determine that the gaze direction is left rotation.

[0048] In other embodiments, the processing circuit 300 can calculate the ratio of the corneal diameter 213 to the left corneal distance 214 and the right corneal distance 215, respectively, and can determine the gaze direction by comparing the size of the calculated ratios. For example, in some embodiments, when the ratio of the corneal diameter 213 to the left corneal distance 214 is greater than the ratio of the corneal diameter 213 to the right corneal distance 215, the processing circuit 300 determines that the gaze direction is rotated to the right. When the ratio of the corneal diameter 213 to the left corneal distance 214 is less than the ratio of the corneal diameter 213 to the right corneal distance 215, the processing circuit 300 determines that the gaze direction is rotated to the left. When the ratio of the corneal diameter 213 to the left corneal distance 214 is equal to the ratio of the corneal diameter 213 to the right corneal distance 215, the processing circuit 300 determines that the gaze direction is straight to the camera 200 (the three-dimensional display module 100).

[0049] Figure 4 is a schematic diagram showing an eye image 212 according to another embodiment of the present application. Please refer to Figure 1 、 Figure 2 and Figure 4 In some embodiments, the processing circuit 300 can obtain the eye image 212 of the person 20 in the photograph 210, and identify the eye image 212 to obtain the eye length 216 and the eyelid length 217. In some embodiments, the eyelid length 217 can be the distance from the edge of the eyelid to the eyebrow. The processing circuit 300 can use at least the eye length 216 and the eyelid length 217 to determine the gaze direction of the person 20. For example, the processing circuit 300 can determine the gaze direction by the change in the size of the values of the eye length 216 and the eyelid length 217. In some embodiments, if the eye length 216 becomes larger and the eyelid length 217 becomes smaller at the same time, the processing circuit 300 can determine that the gaze direction is rotated upward. Conversely, if the eye length 216 becomes smaller and the eyelid length 217 becomes larger at the same time, the processing circuit 300 can determine that the gaze direction is rotated downward.

[0050] Figure 5 is a flowchart showing a method for operating a display device according to another embodiment of the present application. Figure 5 The steps S310-S330 shown can refer to the related descriptions of the steps S210-S230 shown in Figure 2 , and thus will not be described again. Please refer to Figure 1 and Figure 5 After the face direction and the gaze direction are determined, the processing circuit 300 can further determine the field of view range (for example, the angle of view) according to the face direction and the gaze direction in step S340. Figure 6 and Figure 7Specifically, in some embodiments, based on the face direction and the empirical rules of head and line of sight rotation in ergonomics, the maximum range of eyeball rotation is approximately ±30 degrees. Generally speaking, considering the visual comfort of the human eye, if the eyes still cannot see after turning 15 degrees, the head will naturally follow suit. Figure 6 and Figure 7 The field of view 240 shown can be determined by the maximum range of the sight rotation within plus or minus 15 degrees.

[0051] The processing circuit 300 may be Figure 5 In step S350, 3D rendering mode is enabled for the image covered by the field of view 240, and in step S360, 2D rendering mode is enabled for the image not covered by the field of view 240. It should be noted that there is no order restriction for steps S350 and S360. In some implementation scenarios, steps S350 and S360 may be performed simultaneously. In other implementation scenarios, step S360 may be performed before (or after) step S210.

[0052] Figure 6 FIG. 1 is a top view schematic diagram of a person's field of view according to an embodiment of the present invention. Figure 6 In the top view shown on the left, the field of view 240 covers a portion of the image 112 displayed by the three-dimensional display module 100 of the display device 10 . Figure 6 The right side shows a front view of the screen 112 displayed by the display device 10. Figure 6 In the illustrated example, the field of view 240 covers a portion of the left side of the image 112. Therefore, the processing circuit 300 may process the image ( Figure 6 The three-dimensional rendering mode is enabled in the area marked as “3D” in the picture 112 shown, and the picture (not covered by the field of view 240) is rendered in step S360. Figure 6 The area marked as "2D" in the image 112 shown in the figure enables the two-dimensional rendering mode. Figure 6 The application examples shown are illustrative examples of three-dimensional rendering, but the implementation examples of the present invention are not limited thereto. For example, in some embodiments, Figure 6 The area marked as "3D" in the image 112 can be considered as the area where the vestibulo-ocular reflex (VOR) compensation mode is enabled. Figure 6 The area labeled “2D” in the illustrated screen 112 may be considered an area where the vestibulo-oculomotor reflex (VOR) compensation mode is turned off.

[0053] Figure 7 FIG. 1 is a side view schematic diagram of a person's field of view according to an embodiment of the present invention. Figure 7 In the side view shown on the left, the field of view 240 covers a portion of the image 112 displayed by the three-dimensional display module 100 of the display device 10 . Figure 7 The right side shows a front view of the screen 112 displayed by the display device 10. Figure 7 In the illustrated example, the field of view 240 covers a portion of the upper side of the image 112. Therefore, the processing circuit 300 may process the image ( Figure 7 The three-dimensional rendering mode is enabled for the area marked as “3D” in the picture 112 shown, and the picture not covered by the field of view 240 ( Figure 7 The area marked as "2D" in the image 112 shown in the figure enables the two-dimensional rendering mode. Figure 7 The application examples shown are illustrative examples of three-dimensional rendering, but the implementation examples of the present invention are not limited thereto. For example, in some embodiments, Figure 7 The area marked as "3D" in the image 112 can be considered as the area where the vestibulo-ocular reflex (VOR) compensation mode is enabled. Figure 8 The area labeled "2D" in the image 112 can be considered to be the area where the vestibulo-ocular reflex (VOR) compensation mode is disabled. The area covered by the field of view 240 can be determined by rotating the field of view 240 of the person 20 in the vertical direction or the left-right direction, and the present invention is not limited thereto.

[0054] Figure 6 is a flow chart illustrating a method for operating a display device according to another embodiment of the present invention. In step S410, the processing circuit 300 may output the image stream 310 to the 3D display module 100 to display the image 112 (3D display mode). In step S420, the processing circuit 300 may determine whether to enable the vestibulo-ocular reflex (VOR) compensation mode for the image stream 310 based on the facial orientation and gaze direction. When the processing circuit 300 determines that the vestibulo-ocular reflex (VOR) compensation mode is disabled (the determination result of step S420 is "off"), the processing circuit 300 may proceed to step S430. In step S430, the 3D display module 100 maintains the content display in the normal 3D rendering mode.

[0055] When the processing circuit 300 determines to enable the VOR compensation mode (the determination result of step S420 is "enable"), the processing circuit 300 can proceed to step S440. In step S440, the processing circuit 300 can further determine whether to enable the dynamic adjustment display according to the field of view range 240. The dynamic adjustment display can be analogized with the related description of Figure 7 and Figure 6 . When the processing circuit 300 determines to disable the dynamic adjustment display (the determination result of step S440 is "disable"), the processing circuit 300 can proceed to step S450. In step S450, the three-dimensional display module 100 can proceed to the general VOR compensation mode and use the three-dimensional rendering mode in the full screen of the picture 112. That is, the three-dimensional display module 100 can perform the VOR compensation mode operation to the whole of the picture 112.

[0056] When the processing circuit 300 determines to enable the dynamic adjustment display (the determination result of step S440 is "enable"), the processing circuit 300 can proceed to step S460. In step S460, the processing circuit 300 can dynamically adjust the VOR mode and the three-dimensional rendering mode according to the field of view range 240. For example, the processing circuit 300 can enable the VOR mode and the three-dimensional rendering mode to the area of the picture 112 (or the area of the picture 112 marked as "3D") covered by the field of view range 240, and enable the two-dimensional rendering mode and disable the VOR mode to the area of the picture 112 (or the area of the picture 112 marked as "2D") not covered by the field of view range 240. Figure 7 Figure 6 Figure 7 ​

[0057] ​​​​In hardware form, the blocks of the three-dimensional display module 100 and / or the processing circuit 300 can be implemented as logic circuitry within an integrated circuit (IC). The functionality of the three-dimensional display module 100 and / or the processing circuit 300 can be implemented by software executed by a processor, by hardware, or by a combination of software and hardware. For example, the functionality of the three-dimensional display module 100 and / or the processing circuit 300 can be implemented by one or more controllers, microcontrollers, microprocessors, application-specific integrated circuits (ASICs), digital signal processors (DSPs), field programmable gate arrays (FPGAs), and / or other processing components, in various combinations.

[0058] In software and / or firmware form, the functions of the three-dimensional display module 100 and / or the processing circuit 300 can be implemented as programming codes. For example, the three-dimensional display module 100 and / or the processing circuit 300 can be implemented using general programming languages such as C, C++, or assembly language, or other suitable programming languages. The programming codes can be recorded / stored in a recording medium. In some embodiments, the recording medium includes a Read Only Memory (ROM), a Random Access Memory (RAM), and / or a storage device. The storage device includes a hard disk drive (HDD), a Solid-state drive (SSD), or other storage devices. In other embodiments, the recording medium can include a "non-transitory computer readable medium". For example, a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used to implement the non-transitory computer readable medium. A computer, a Central Processing Unit (CPU), a controller, a microcontroller, or a microprocessor can read and execute the programming codes from the recording medium, thereby implementing the functions of the three-dimensional display module 100 and / or the processing circuit 300. Moreover, the programming codes can be provided to the computer (or CPU) via any transmission medium (a communication network, a broadcast wave, or the like). The communication network includes the Internet, a wired communication network, a wireless communication network, or other communication media.

[0059] In summary, the display device and the operation method thereof according to the embodiments can recognize a face direction and a line of sight direction of a person in a viewing field by recognizing a photo, determine whether to enable a vestibulo-ocular reflex (VOR) compensation mode in some embodiments, and further determine a moving field range according to the face direction and the line of sight direction to dynamically adjust a three-dimensional rendering mode display. In the existing detection system based on face landmarks, the vestibulo-ocular reflex (VOR) auxiliary judgment mechanism is added to improve the jitter problem of abnormal switching of the three-dimensional display mode due to inaccurate eye detection when the viewer's head and eyes rotate.

[0060] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, and are not intended to limit the present application; although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that the technical solutions recorded in the above embodiments can be modified, or some or all of the technical features can be replaced by equivalents; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A display device, characterized in that: The display device comprises: 3D display module; a camera configured to capture a viewing area of ​​the three-dimensional display module to generate a photograph; and A processing circuit is coupled to the 3D display module and the camera, and is configured to output an image stream to the 3D display module for display, wherein the processing circuit identifies the photo to determine the face direction and gaze direction of a person in the viewing field, and determines whether to enable a vestibulo-ocular reflex compensation mode for the image stream based on the face direction and the gaze direction. The processing circuit acquires an eye image of the person in the photo, identifies the eye image to obtain corneal diameter length, corneal left distance, and corneal right distance, and uses at least the corneal diameter length, the corneal left distance, and the corneal right distance to determine the gaze direction of the person.

2. A display device, characterized in that: The display device comprises: 3D display module; a camera configured to capture a viewing area of ​​the three-dimensional display module to generate a photograph; and A processing circuit is coupled to the 3D display module and the camera, and is configured to output an image stream to the 3D display module for display, wherein the processing circuit identifies the photo to determine the face direction and gaze direction of a person in the viewing field, the processing circuit determines whether to enable a vestibulo-ocular reflex compensation mode for the image stream based on the face direction and the gaze direction, the processing circuit obtains an eye image of the person in the photo, identifies the eye image to obtain a longitudinal length of the eye and a longitudinal length of the eyelid, and the processing circuit uses at least the longitudinal length of the eye and the longitudinal length of the eyelid to determine the gaze direction of the person.

3. The display device according to claim 2, wherein The longitudinal length of the eyelid is the distance from the edge of the eyelid to the eyebrow.

4. A method for operating a display device, characterized in that: The operation method includes: photographing a viewing area of ​​the three-dimensional display module of the display device by a camera of the display device to generate a photo; The processing circuit of the display device outputs an image stream to the three-dimensional display module for displaying a picture; The processing circuit identifies the photo to obtain the face direction and the sight direction of the person in the viewing area; The processing circuit determines whether to enable a vestibulo-ocular reflex compensation mode for the image stream based on the face direction and the gaze direction; Acquiring, by the processing circuit, an eye image of the person in the photograph; The processing circuit identifies the eye image to obtain the corneal length, the left corneal distance and the right corneal distance; and The processing circuit uses at least the corneal diameter length, the corneal left distance, and the corneal right distance to obtain the person's line of sight direction.

5. A method for operating a display device, characterized in that: The operation method includes: photographing a viewing area of ​​the three-dimensional display module of the display device by a camera of the display device to generate a photo; The processing circuit of the display device outputs an image stream to the three-dimensional display module for displaying a picture; The processing circuit identifies the photo to obtain the face direction and the sight direction of the person in the viewing area; The processing circuit determines whether to enable a vestibulo-ocular reflex compensation mode for the image stream based on the face direction and the gaze direction; Acquiring, by the processing circuit, an eye image of the person in the photograph; Recognizing the eye image by the processing circuit to obtain the eye length and the eyelid length; and The processing circuit uses at least the longitudinal length of the eye and the longitudinal length of the eyelid to obtain the sight direction of the person.

6. A display device, characterized in that: The display device comprises: 3D display module; a camera configured to capture a viewing area of ​​the three-dimensional display module to generate a photograph; and A processing circuit is coupled to the three-dimensional display module and the camera, and is configured to output an image stream to the three-dimensional display module for displaying a picture, wherein the processing circuit identifies the photo to obtain the face direction and the gaze direction of a person in the viewing field, the processing circuit determines the person's field of view based on the face direction and the gaze direction, the processing circuit enables a three-dimensional rendering mode for the picture covered by the field of view, and the processing circuit enables a two-dimensional rendering mode for the picture not covered by the field of view, the processing circuit obtains an eye image of the person in the photo, the processing circuit identifies the eye image to obtain the corneal diameter length, the left corneal distance, and the right corneal distance, and the processing circuit uses at least the corneal diameter length, the left corneal distance, and the right corneal distance to obtain the person's gaze direction.

7. A display device, characterized in that: The display device comprises: 3D display module; a camera configured to capture a viewing area of ​​the three-dimensional display module to generate a photograph; and A processing circuit, coupled to the three-dimensional display module and the camera, is configured to output an image stream to the three-dimensional display module for displaying a picture, wherein the processing circuit identifies the photo to obtain the face direction and the gaze direction of the person in the viewing field, the processing circuit determines the person's field of view based on the face direction and the gaze direction, the processing circuit enables a three-dimensional rendering mode for the picture covered by the field of view, and enables a two-dimensional rendering mode for the picture not covered by the field of view, the processing circuit obtains an eye image of the person in the photo, the processing circuit identifies the eye image to obtain the vertical length of the eye and the vertical length of the eyelid, and the processing circuit uses at least the vertical length of the eye and the vertical length of the eyelid to obtain the gaze direction of the person.

8. The display device according to claim 7, wherein: The longitudinal length of the eyelid is the distance from the edge of the eyelid to the eyebrow.

9. A method for operating a display device, characterized in that: The operation method includes: photographing a viewing area of ​​the three-dimensional display module of the display device by a camera of the display device to generate a photo; Outputting an image stream from a processing circuit of a display device to the three-dimensional display module for displaying a picture; The processing circuit identifies the photo to obtain the face direction and the sight direction of the person in the viewing area; The processing circuit determines the visual field of the person based on the face direction and the sight direction; The processing circuit enables a three-dimensional rendering mode for the image covered by the field of view; The processing circuit enables a two-dimensional rendering mode for the image not covered by the field of view; Acquiring, by the processing circuit, an eye image of the person in the photograph; The processing circuit identifies the eye image to obtain the corneal length, the left corneal distance, and the right corneal distance; and The processing circuit uses at least the corneal diameter length, the corneal left distance, and the corneal right distance to obtain the person's line of sight direction.

10. A method for operating a display device, characterized in that: The operation method includes: photographing a viewing area of ​​the three-dimensional display module of the display device by a camera of the display device to generate a photo; Outputting an image stream from a processing circuit of a display device to the three-dimensional display module for displaying a picture; The processing circuit identifies the photo to obtain the face direction and the sight direction of the person in the viewing area; The processing circuit determines the visual field of the person based on the face direction and the sight direction; The processing circuit enables a three-dimensional rendering mode for the image covered by the field of view; The processing circuit enables a two-dimensional rendering mode for the image not covered by the field of view; Acquiring, by the processing circuit, an eye image of the person in the photograph; Recognizing the eye image by the processing circuit to obtain the eye length and the eyelid length; and The processing circuit uses at least the longitudinal length of the eye and the longitudinal length of the eyelid to obtain the sight direction of the person.

Citation Information

Patent Citations

  • Systems and methods using virtual reality or augmented reality environments for the measurement and / or improvement of human vestibulo-ocular performance

    US20160262608A1

  • Image manipulation based on tracked eye movement

    US8564533B2