Head-mounted visual distortion correction device

Abstract

The invention discloses a head-mounted visual distortion correction device which comprises a left display screen, a right display screen, a head-mounted holder, an image acquisition unit and an image processing unit, the left display screen and the right display screen are used for displaying images to the left eye and the right eye respectively, the image acquisition unit is used for shooting the front visual field range of a wearer to obtain an original image, and the image processing unit is used for processing the original image. And the image processing unit is used for respectively carrying out reverse distortion processing which is opposite to and equal to the visual distortion of the left eye and the right eye on the original image to obtain a left eye correction image and a right eye correction image, and respectively outputting the left eye correction image and the right eye correction image to the left display screen and the right display screen for displaying. According to the head-mounted visual distortion correction device provided by the embodiment of the invention, the image in the visual field of the patient is distorted in the opposite direction before being presented to the patient in an image processing manner, so that the image seen by the patient is a normal and undistorted image, and the aim of correcting visual distortion is fulfilled.

Description

Technical Field

[0001] The present invention generally relates to an intelligent display device, and in particular to a head-mounted display device capable of intelligently correcting visual distortion. Background Art

[0002] In a normal human eye, the retina is tightly attached to the inner surface of the choroid and is very flat. When looking at an object, the image of the object can be accurately and evenly projected on the retina, so that a clear image consistent with the actual shape of the object can be seen. The macula of the human eye is located in the center of the retina. The macula concentrates a large number of visual function cells and is the most sensitive area for vision. The cone cells responsible for vision and color vision are distributed in this area. They can recognize most optical signals such as shape, size, color, depth, distance, etc., and are an important part that determines visual function. There is a depression in the center of the macula, called the fovea.

[0003] Certain diseases can cause lesions in the macular area of ​​the retina, which manifests as retinal deformation. For example, macular degeneration and diabetic retinopathy caused by diabetes may cause edema, new blood vessels, and bleeding scars in the macular area of ​​the retina. Most of the lesions are centered on the fovea and are located within a radius of 1PD (optical disc diameter). The deformed area of ​​the retina will cause the image of the object to not be projected on the original position of the retina when the human eye looks at the object, but to a peripheral position that is offset from the original position. In this way, the patient's subjective feeling is that the object seen is distorted (hereinafter referred to as "visual distortion"). For patients, retinal deformation and visual distortion bring varying degrees of pain and pressure to their physical, psychological, economic and other aspects, reducing the patient's quality of life.

[0004] At present, the main treatments for macular degeneration in the medical field include: antioxidant therapy, anti-VEGF therapy, laser therapy, transpupillary thermotherapy (TTT), photodynamic therapy (PDT) and surgical treatment, etc.; the treatments for diabetic retinopathy include: blood sugar control, laser photocoagulation therapy, cryotherapy and vitrectomy, etc. However, on the one hand, whether these treatments are effective depends on the actual physical condition of the patient, and the treatment effect is not certain. On the other hand, these treatments cannot actually correct the visual distortion that the patient sees at the moment. Summary of the invention

[0005] An object of the present invention is to provide a head-mounted visual distortion correction device, which at least partially overcomes the problems in the prior art.

[0006] According to one aspect of the present invention, there is provided a head-mounted visual distortion correction device, comprising:

[0007] A left display screen is arranged toward the left eye of the wearer and is used to display images to the left eye;

[0008] A right display screen, arranged toward the right eye of the wearer, for displaying images to the right eye;

[0009] A head-mounted holder, suitable for being worn on the head of a wearer, wherein the left display screen and the right display screen are mounted on the head-mounted holder;

[0010] An image acquisition unit, mounted on the head-mounted holder, for photographing the front visual field of the wearer to obtain an original image; and

[0011] an image processing unit, wherein the image processing unit receives the original image, performs reverse distortion processing on the original image in the opposite and equal amounts to the visual distortion of the left eye and the right eye of the wearer, obtains a left eye corrected image and a right eye corrected image, and outputs the left eye corrected image and the right eye corrected image to the left display screen and the right display screen for display, respectively.

[0012] Wherein, the reverse twisting process comprises:

[0013] Determining a left eye gaze area of ​​the left eye on the left display screen according to a left eye gaze point of the wearer's left eye on the left display screen;

[0014] Determining a right eye gaze area of ​​the right eye on the right display screen according to a right eye gaze point of the wearer's right eye on the right display screen; and

[0015] The portions of the original image located within the left eye gaze area and the right eye gaze area are subjected to reverse distortion in an amount opposite to and equal to the visual distortion of the left eye and the right eye of the wearer.

[0016] Advantageously, the head-mounted visual distortion correction device is configured to display gaze point guide marks at predetermined positions on the left display screen and the right display screen.

[0017] Advantageously, the predetermined position is the center of the left display screen and the center of the right display screen.

[0018] Advantageously, the image processing unit is configured to: set the predetermined position of the left display screen as the left eye gaze point, set the predetermined position of the right display screen as the right eye gaze point, and add gaze point guide marks at positions of the left eye corrected image and the right eye corrected image corresponding to the predetermined position of the left display screen and the predetermined position of the right display screen.

[0019] Advantageously, the gaze point guiding mark is in the shape of a cross, a dot or a circle.

[0020] Advantageously, the gaze point guiding mark has a specific color or a flashing display effect.

[0021] Advantageously, the head-mounted visual distortion correction device may further include an eye tracking device, which is disposed on the head-mounted retaining frame and connected to the left display screen, the right display screen, the image processing unit and the image acquisition unit, for detecting the left eye gaze point and the right eye gaze point; and the image processing unit is configured to: obtain information about the left eye gaze point and the right eye gaze point detected by the eye tracking device, and perform the reverse distortion processing based on the information.

[0022] Advantageously, the eye tracking device comprises two eye tracking units, respectively used for detecting the left eye gaze point and the right eye gaze point.

[0023] Advantageously, the image acquisition unit comprises a single camera, and the single camera is positioned on the head-mounted holder such that when the head-mounted holder is worn on the head, the single camera is located directly in front of the head.

[0024] Advantageously, the image acquisition unit comprises two cameras, which are positioned on the head-mounted holder so that when the head-mounted holder is worn on the head, the two cameras respectively shoot along the sight lines of the left eye and the right eye.

[0025] Advantageously, the head mounted holder is shaped and sized to substantially conform to the area surrounding the eyes to prevent ambient light from entering the eyes.

[0026] Advantageously, the head-mounted holder is constructed to have a light blocking structure between the left display screen and the right display screen for preventing light from the left display screen from entering the right eye, and preventing light from the right display screen from entering the left eye.

[0027] The head-mounted visual distortion correction device according to an embodiment of the present invention distorts the image in the patient's field of view in the opposite direction before presenting it to the patient through image processing, so that the image seen by the patient is a normal, undistorted image, thereby achieving the purpose of visual distortion correction. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Other features, objects and advantages of the present invention will become more apparent from the detailed description of non-limiting embodiments made with reference to the following drawings:

[0029] Figure 1 Illustration of distorted vision caused by lesions in the macula of the retina;

[0030] Figure 2 A schematic diagram of an example of a head-mounted visual distortion correction device according to Embodiment 1 of the present invention;

[0031] Figure 3 The following schematically shows the gaze point guide mark and the gaze area corresponding thereto displayed on the display screen;

[0032] Figure 4 An example of an original image obtained according to the first embodiment and a gaze point and a corresponding gaze area determined on the original image is schematically shown;

[0033] Figure 5 The visual distortion and the corresponding reverse distortion are schematically shown;

[0034] Figure 6 Schematically showing a left-eye corrected image and a right-eye corrected image obtained through reverse warping according to the first embodiment of the present invention;

[0035] Figure 7 is a schematic stereoscopic diagram of an example of a head-mounted visual distortion correction device according to Embodiment 2 of the present invention;

[0036] Figure 8 for Figure 7 A bottom view of the head-mounted visual distortion correction device shown;

[0037] Fig. 9 is a schematic stereoscopic diagram of an example of a head-mounted visual distortion correction device according to Embodiment 3 of the present invention;

[0038] Fig.10 for Fig. 9 A rear view of the head-mounted visual distortion correction device shown;

[0039] Fig.11 An example of an original image obtained according to Embodiment 3 and a gaze point and a corresponding gaze area determined on the original image is schematically shown;

[0040] Fig.12 Schematically showing a left-eye corrected image and a right-eye corrected image obtained through reverse warping according to Embodiment 3 of the present invention;

[0041] Fig.13 A head-mounted visual distortion correction device according to a variant of the third embodiment of the present invention is schematically shown. DETAILED DESCRIPTION

[0042] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the relevant invention, rather than to limit the invention. For ease of description, only the parts related to the invention are shown in the accompanying drawings.

[0043] For ease of understanding, first refer to Figure 1Briefly introduce the visual distortion caused by retinal macular lesions.

[0044] Patients with macular degeneration often use Figure 1 The Amsler scale shown in the figure on the left is used to measure the patient's visual deformation. The Amsler scale includes a grid of multiple horizontal and vertical lines arranged in a regular pattern. Normal testers see the Amsler scale as clear, undistorted horizontal and vertical lines, while patients with retinal deformation may see the horizontal and vertical lines of the Amsler scale as distorted in various ways, such as wavy bends, such as Figure 1 As shown in the figure on the right.

[0045] The Amsler scale can be used to assist in diagnosing whether a patient has visual distortion and the specific conditions of visual distortion. One way is that when the Amsler scale is used to test a patient, the patient can tell the approximate location, direction, and degree of visual distortion. Another way is that the patient is no longer required to state the location, direction, and degree of visual distortion, but is still provided with the Amsler scale, and the patient draws a line that does not appear to be distorted on his own. In the latter method, the greater the degree of visual distortion of the patient, the greater the actual degree of distortion of the line that he redraws that does not appear to be distorted, and the redrawn line can provide detailed information on the location and direction of visual distortion.

[0046] In addition, the inventor of the present invention has also proposed a new method for detecting the patient's visual distortion (specifically described in other patent applications filed on the same day as the present application), namely: based on the correspondence between the concave-convex deformation on the retinal macula and the distortion direction and degree of visual distortion, the macula area morphology is detected through fundus imaging, thereby determining the patient's visual distortion. This detection method does not rely on the Amsler scale, and the detected visual distortion can also be expressed in the form of the Amsler scale, similar to Figure 1 As shown in the graphic on the right.

[0047] Based on the detected visual distortion, the present invention proposes a technical idea that is completely different from the pathological treatment in the medical field. This technical idea no longer considers the administration of medication or any invasive or non-invasive treatment to the patient, but focuses entirely on the specific state of the patient's visual distortion. Through image processing, the image in the patient's field of view is distorted in the opposite direction before being presented to the patient, so that the image seen by the patient is a normal, non-distorted image, thereby achieving the purpose of correcting visual distortion.

[0048] Moreover, the inventors of the present invention have discovered that when patients have distorted vision due to macular degeneration or diabetic retinopathy, the retinas of the two eyes of the patient often undergo different deformations, and part or all of the image of the same object cannot fall on the corresponding points of the retinas of the two eyes, resulting in the patient's two eyes The distortion state, distortion area, and distortion direction are often different. If the image seen in front of the patient's eyes is corrected according to the distortion of the vision of one eye so that the eye sees a normal vision state, then because the other eye is also looking at the same image at the same time, it is very likely that the other eye does not see a normal vision state, so that the visual center cannot fuse the signals from the two eyes, and the purpose of correcting the distortion of vision cannot be achieved. In view of the above findings and considerations, the inventors have made the inventions disclosed in this application.

[0049] The head-mounted visual distortion correction device according to an embodiment of the present invention will be described below with reference to other drawings.

[0050] Figure 2 FIG. 1 is a schematic diagram of an example of a head-mounted visual distortion correction device according to Embodiment 1 of the present invention. Figure 2 As shown, a head-mounted visual distortion correction device 10A according to the first embodiment of the present invention includes a display screen 11, a head-mounted holder 12, an image acquisition unit 13 and an image processing unit 14.

[0051] The display screen 11 includes a left display screen 11-1 and a right display screen 11-2, wherein the left display screen 11-1 is arranged toward the left eye of the wearer for displaying images to the left eye; the right display screen 11-2 is arranged toward the right eye of the wearer for displaying images to the right eye. In actual implementation, the size and shape of the left display screen 11-1 and the right display screen 11-2 are preferably the same.

[0052] The head-mounted holder 12 is configured to be suitable for being worn on the head of a wearer, and the left display screen 11 - 1 and the right display screen 11 - 2 are mounted on the head-mounted holder.

[0053] The image acquisition unit 13 may include, for example, a camera mounted on the head-mounted holder 12, and used to capture the wearer's front field of view to obtain an original image. Figure 2 In the example shown, the image acquisition unit 13 includes a single camera, which is positioned on the head-mounted holder 12 such that when the head-mounted holder 12 is worn on the head, the single camera is located directly in front of the head.

[0054] According to an embodiment of the present invention, the image processing unit 14 receives the original image captured by the image acquisition unit 13, and performs reverse distortion processing on the original image in the opposite and equal amounts to the visual distortion of the left eye and right eye of the wearer, respectively, to obtain a left eye corrected image and a right eye corrected image. Figure 2As shown, the image processing unit 14 may include a processor (e.g., a chip) 14a and a memory 14b. The memory 14b may store instructions executable by the processor 14a and may be used to store data such as images during image processing. The processor 14a completes reverse distortion and other processing when executing the instructions stored in the memory 14b. Figure 2 In the example shown, the image processing unit 14 may be arranged / integrated in the head-mounted holder 12. In other cases, the image processing unit 14 may also be formed as a separate component, and be connected to the display screen 11 and the image acquisition unit 13 in a wired or wireless manner.

[0055] The left eye corrected image and the right eye corrected image processed by the image processing unit 14 are output to the left display screen 11-1 and the right display screen 11-2 for display, respectively, so that the left and right eyes of the wearer see "undistorted" images, respectively.

[0056] The reverse distortion processing performed by the image processing unit 14 on the image includes:

[0057] Determining a left eye fixation area of ​​the left eye on the left display screen according to a left eye fixation point of the wearer's left eye on the left display screen;

[0058] Determining a right eye gaze area of ​​the right eye on the right display screen according to a right eye gaze point of the wearer's right eye on the right display screen; and

[0059] The portions of the original image located within the left eye gaze area and the right eye gaze area are reversely distorted in the opposite direction and by the same amount as the visual distortion of the left eye and the right eye of the wearer.

[0060] It should be understood that the above-mentioned determination of the left eye gaze area and the determination of the right eye gaze area are not in a particular order, and the two can be performed in reverse order or simultaneously.

[0061] According to this embodiment, Figure 3 As shown, the head-mounted visual distortion correction device 10A is configured to display a gaze point guide identifier ID at a predetermined position (eg, a center position) on the left display screen 11 - 1 and the right display screen 11 - 2 . Figure 3 A cross-shaped gaze point guide mark ID is shown, but the present invention is not limited in this respect, and the gaze point guide mark ID may have other suitable shapes, such as a dot or circle shape. In addition, in order to better guide the gaze point of the eyes, the gaze point guide mark ID may have a specific color or a flashing display effect.

[0062] Advantageously, in some cases, the image processing unit 14 may be configured to: set a predetermined position of the left display screen 11-1 as the left eye gaze point, set a predetermined position of the right display screen 11-2 as the right eye gaze point, and add a gaze point guide mark at the positions of the left eye correction image and the right eye correction image corresponding to the predetermined position of the left display screen 11-1 and the predetermined position of the right display screen 11-2. In other cases, the display screen 11 of the head-mounted visual distortion correction device 10A may be configured to provide a gaze point guide mark ID at a predetermined position of the display screen independently of the displayed image content, for example, by means of an indicator light or the like set at the center of the display screen.

[0063] According to this embodiment, the image processing unit 14 is configured to determine the gaze area a according to the gaze point guide identifier ID and the fixed gaze point in the above reverse warping process, such as Figure 3 shown. Figure 3 The square focus area a shown in FIG. 1 is only exemplary, and the focus area a may be set to have other shapes, such as a circle.

[0064] although Figure 3 Only one display screen and the corresponding gaze point guide identifier ID and gaze area a are shown, but it should be understood that according to this embodiment, gaze point guide identifier IDs should be provided on the left display screen 11-1 and the right display screen 11-2, respectively, which correspond to the left eye gaze point and the right eye gaze point, respectively, and the left eye gaze area and the right eye gaze area are determined according to the left eye gaze point and the right eye gaze point, respectively.

[0065] For ease of understanding, Figure 4 The original left eye image IM11 and right eye image IM12 obtained according to the first embodiment are schematically shown, as well as the left eye gaze point z1, the right eye gaze point z2 and the corresponding left eye gaze area a1, the right eye gaze area a2 marked on the original images IM11 and IM12. Figure 2 In the example shown, the image acquisition unit 13 of the head-mounted visual distortion correction device 10A includes a single camera; in this case, the original left-eye image IM11 and the right-eye image IM12 may be the same image. However, it should be understood that the present invention is not limited in this respect. Figure 4 In the example shown, the gaze point guide identifier id is intended to be displayed at the center of the left display screen 11-1 and the right display screen 11-2; accordingly, the left eye gaze point z1 and the right eye gaze point z2 are located at the center of the corresponding display screens, and gaze areas a1 and a2 are determined around the gaze points z1 and z2. The positional relationship between the left eye gaze point z1, the right eye gaze point z2 and the corresponding left eye gaze area a1, the right eye gaze area a2 and the original left eye image IM11 and the right eye image IM12 is shown in FIG. Figure 4 At this time, Figure 4As shown, the images located in the gaze areas a1 and a2 (represented by grid patterns in the figure) are not distorted.

[0066] According to the embodiment of the present invention, the image processing unit 14 performs reverse distortion on the parts of the original left eye image IM11 and the right eye image IM12 located within the left eye gaze area a1 and the right eye gaze area a2 in the opposite direction and equal to the visual distortion of the wearer's left eye and right eye.

[0067] For ease of understanding, Figure 5 The diagram schematically shows the visual distortion and the corresponding reverse distortion. Specifically, Figure 5 The figure on the left is intended to exemplarily represent one eye of the patient (wearer) looking at Figure 4 The grid pattern shown is a pattern seen when viewing the patient's image (hereinafter referred to as the "visual distortion pattern" for convenience), which reflects the patient's visual distortion condition. Figure 5 The graphic on the right is intended to exemplify Figure 4 The grid pattern shown is Figure 5 The visual distortion graph on the left is a graph obtained by the reverse distortion of the visual distortion and the same amount of reverse distortion (hereinafter referred to as the "reverse distortion graph" for convenience). Figure 5 For the convenience of observation and comparison, simple pincushion distortion and barrel distortion are used to intuitively demonstrate the effect of "reverse distortion", while the real visual distortion of the human eye usually presents a complex distortion (see Figure 1 However, it should be understood that this does not affect the implementation of the reverse distortion processing of the image by the visual distortion correction device according to the embodiment of the present invention and the effect it brings.

[0068] Figure 6 The left eye corrected image IM21 and the right eye corrected image IM22 obtained by reverse distortion processing according to this embodiment are schematically shown. The visual distortion of the left eye and the right eye is most likely different; Figure 6 As shown, the portions of the left eye image IM11 and the right eye image IM12 located within the left eye gaze area a1 and the right eye gaze area a2 are reversely distorted in the opposite direction and by the same amount as the visual distortion of the left eye and the right eye, thereby obtaining different corrected images. Figure 6 The graphics in the left eye gaze area a1 and the right eye gaze area a2 are respectively shown as grid graphics with opposite distortions, however, this is only to schematically indicate that the left and right eye corrected images are processed separately and are most likely different, and is not intended to indicate any other correlation between the two corrected images.

[0069] The left eye correction image and the right eye correction image provided and displayed by the head-mounted visual distortion correction device according to the embodiment of the present invention are intended to be "non-distorted" images for the left eye and right eye of the patient (wearer), respectively. In this way, the left and right images seen by the wearer of the head-mounted visual distortion correction device are both in a normal state, so that the visual center can fuse the signals from the two eyes, thereby achieving the purpose of visual distortion correction.

[0070] Advantageously, the head mounted holder 12 is shaped and sized to substantially conform to the area surrounding the wearer's eyes to prevent external light from entering the eyes. Figure 2 The head-mounted holder 12 may include a blocking portion 12a, which, together with other parts of the head-mounted holder 12, blocks the outside of the display screen 11 and extends to be close to the face of the person, preferably, extends to be substantially in contact with the area around the eyes to prevent light from entering the eyes. In other cases, the blocking portion 12a may be configured to be switchable between a light-transmitting state and an opaque state, thereby providing the wearer with more flexible use options. For example, the blocking portion 12a may be at least partially composed of an electrically-controlled color-changing lens based on liquid crystal electric control technology.

[0071] Figure 7 and Figure 8 1 and 2 are schematic three-dimensional diagrams and bottom views of a head-mounted visual distortion correction device 10B according to Embodiment 2 of the present invention. The head-mounted visual distortion correction device 10B according to Embodiment 2 has substantially the same structure and function as the head-mounted visual distortion correction device 10A according to Embodiment 1. The same structures of the two are not described here, and the differences between the two are described below.

[0072] like Figure 7 As shown, the image acquisition unit 13 of the head-mounted visual distortion correction device 10B includes two cameras 13-1 and 13-2. The two cameras 13-1 and 13-2 are positioned on the head-mounted holder 12 so that when the head-mounted holder 12 is worn on the wearer's head, the cameras 13-1 and 13-2 respectively shoot along the line of sight of the left eye and the line of sight of the right eye. Correspondingly, the images shot by the cameras 13-1 and 13-2 are respectively used as the original image for the left eye and the original image for the right eye. The visual distortion display based on the two cameras arranged in this way can advantageously provide the wearer with a more realistic stereoscopic visual experience.

[0073] like Figure 7 and Figure 8As shown, the head-mounted retaining frame 12 of the head-mounted visual distortion correction device 10B also includes a light blocking structure 12b, which is arranged between the left display screen 11-1 and the right display screen 11-2, and is used to prevent the light of the left display screen 11-1 from entering the right eye and prevent the light of the right display screen 11-2 from entering the left eye.

[0074] exist Figure 7 In the example shown, the light blocking structure 12b is a structure obtained by deforming the nose pad part of the head-mounted holder 12, the lower part of which still serves as a nose pad and can be supported on the bridge of the wearer's nose, and the upper part of which extends upward to between the two eyes relative to the ordinary nose pad, thereby achieving light blocking on both sides. In order to improve wearing comfort and achieve better light blocking effect, preferably, at least a part of the light blocking structure 12b is formed of a flexible material (such as sponge or silicone).

[0075] Although not shown, as an alternative or supplement to the second embodiment, the display screen 11 of the head-mounted visual distortion correction device according to other embodiments of the present invention can be constructed to have the function of directional light projection, so that the light projected from the left display screen 11-1 can only enter the left eye, and the light projected from the right display screen 11-2 can only enter the right eye. The present invention intends to cover similar structures and technologies that are conducive to preventing interference between left and right eye vision.

[0076] Fig. 9 and Fig.10 1 is a schematic three-dimensional diagram and a rear view of an example of a head-mounted visual distortion correction device 10C according to Embodiment 3 of the present invention. Fig. 9 and Figure 7 As shown, the head-mounted visual distortion correction device 10C according to the third embodiment has substantially the same structure and function as the head-mounted visual distortion correction device 10B according to the second embodiment. The same structure of the two will not be described here, and the main differences between the two will be introduced below.

[0077] like Fig.10 As shown, according to this embodiment, the head-mounted visual distortion correction device 10C further includes an eye tracking device 16. The eye tracking device 16 can be arranged on the head-mounted holder 12 and connected to the left display screen 11-1, the right display screen 11-2, the image acquisition unit 13 and the image processing unit 14. Fig.10 In the example shown, the eye tracking device 16 includes a left eye eye tracking unit 16-1 and a right eye eye tracking unit 16-2, which are respectively used to detect the left eye gaze point of the wearer's left eye on the left display screen 11-1 and the right eye gaze point of the wearer's right eye on the right display screen 11-2.

[0078] like Fig.10As shown, the eye tracking device 16 / eye tracking unit 16-1, 16-2 includes a camera 16a, and in some cases preferably also includes a light source 16b. The light source 16b can be an infrared light source or a visible light source; accordingly, the camera 16a is a camera that works in the corresponding spectral range.

[0079] According to this embodiment, the image processing unit 14 is configured to obtain information about the left eye gaze point and the right eye gaze point detected by the eye tracking device 16, and perform reverse distortion processing based on the information. The directional distortion processing here is similar to the reference Figure 5 and Figure 6 The reverse distortion processing performed by the head-mounted visual distortion correction device 10A according to the first embodiment is the same as that described above and will not be described in detail here.

[0080] Fig.11 The original left eye image IM11' and right eye image IM12' obtained according to the third embodiment are schematically shown, as well as the left eye gaze point z1', right eye gaze point z2' and the corresponding left eye gaze area a1', right eye gaze area a2' marked on the original images IM11' and IM12'. According to this embodiment, the left eye gaze point z1' and the right eye gaze point z2' are determined by the image processing unit 14 according to the information from the eye tracking device 19, rather than according to the gaze point guide identifier id on the display screen 11. Fig.11 As shown, the positions of the left eye gaze point z1' and the right eye gaze point z2' on the left eye display screen 11-1 and the right eye display screen 11-2 may be different, so that their corresponding positions in the original images IM11' and IM12' are also different. The image processing unit 14 determines the left eye gaze area a1' and the right eye gaze area a2' according to the left eye gaze point z1' and the right eye gaze point z2'. Fig.11 The shapes and sizes of the left eye gaze area a1' and the right eye gaze area a2' are only exemplary; in other examples, they may have the same Fig.11 Different shapes and sizes are shown, such as having a circular shape and / or having a larger or smaller size. The present invention is not limited in this regard.

[0081] Fig.12 The left eye corrected image IM21' and the right eye corrected image IM22' obtained by reverse warping according to the third embodiment of the present invention are schematically shown. Figure 6 The diagram is similar to Fig.12 In the figure, the graphics in the left eye gaze area a1' and the right eye gaze area a2' are respectively shown as grid graphics with opposite distortions, and this is only to schematically indicate that the left and right eye corrected images are processed separately and are most likely different, and is not intended to indicate any other correlation between the two corrected images.

[0082] The head-mounted visual distortion correction device 10C according to the third embodiment of the present invention determines the left and right gaze points of the wearer based on eye tracking, rather than guiding and assuming that the wearer's gaze point is consistent with the position of the preset gaze point guide mark. This is conducive to more accurately determining the gaze point and gaze area, thereby more accurately achieving visual distortion correction.

[0083] Fig.13 A head-mounted visual distortion correction device 10C' according to a variant of the third embodiment of the present invention is schematically shown. The head-mounted visual distortion correction device 10C' according to the variant has substantially the same structure and function as the head-mounted visual distortion correction device 10C according to the third embodiment, and the only difference is that the eye tracking device 16 of the head-mounted visual distortion correction device 10C' includes only one eye tracking unit for tracking the eye movement of the left eye or the right eye. Since the movements of the left eye and the right eye of a person are usually coordinated with each other, especially when observing objects at a distance, in this case, the eye movement of a single eye can represent the eye movement of both eyes, so it is assumed that the positions of the gaze points of the left eye and the right eye on the left display screen and the right display screen are corresponding, that is, if the coordinate system is constructed in the same way on the left and right display screens (for example, the lower left corner of the display screen is the origin, the lower edge of the display screen is the x-axis, and the left edge of the display screen is the y-axis), the coordinates of the gaze point of the left eye on the left display screen and the coordinates of the gaze point of the right eye on the right display screen are considered to be the same. The head-mounted visual distortion correction device 10C' according to this variant of the present invention is proposed based on this consideration, which is conducive to reducing the cost of the device, so that the head-mounted visual distortion correction device can be used by more patients.

[0084] Although not shown, in other variations of the third embodiment, the eye tracking device 16 may also be disposed, for example, at a position corresponding to the middle of the left eye and the right eye, and used to detect eye movements of both eyes simultaneously. This is also feasible when the camera used in the eye tracking device 16 has a sufficiently large shooting range and shooting accuracy. This variation is also conducive to reducing the cost of the device.

[0085] The above description is only a preferred embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the inventive concept. For example, the above features are replaced with (but not limited to) technical features with similar functions disclosed in the present application.

Claims

1. A head-mounted visual distortion correction device, comprising: A left display screen is arranged toward the left eye of the wearer and is used to display images to the left eye; A right display screen, arranged toward the right eye of the wearer, for displaying images to the right eye; A head-mounted holder, suitable for being worn on the head of a wearer, wherein the left display screen and the right display screen are mounted on the head-mounted holder; An image acquisition unit, mounted on the head-mounted holder, for photographing the front visual field of the wearer to obtain an original image; and an image processing unit, wherein the image processing unit receives the original image, performs reverse distortion processing on the original image in the opposite and equal amounts to the visual distortion of the left eye and the right eye of the wearer, obtains a left eye corrected image and a right eye corrected image, and outputs the left eye corrected image and the right eye corrected image to the left display screen and the right display screen for display, respectively. Wherein, the reverse twisting process comprises: Determining a left eye gaze area of ​​the left eye on the left display screen according to a left eye gaze point of the wearer's left eye on the left display screen; Determining a right eye gaze area of ​​the right eye on the right display screen according to a right eye gaze point of the wearer's right eye on the right display screen; and The portions of the original image located within the left eye gaze area and the right eye gaze area are subjected to reverse distortion in an amount opposite to and equal to the visual distortion of the left eye and the right eye of the wearer.

2. The head-mounted visual distortion correction device according to claim 1, wherein: The head-mounted visual distortion correction device is configured to display gaze point guidance marks at predetermined positions on the left display screen and the right display screen.

3. The head-mounted visual distortion correction device according to claim 2, wherein: The predetermined position is the center of the left display screen and the center of the right display screen.

4. The head-mounted visual distortion correction device according to claim 2 or 3, wherein: The image processing unit is configured to: set the predetermined position of the left display screen as the left eye gaze point, set the predetermined position of the right display screen as the right eye gaze point, and add gaze point guide marks at positions of the left eye corrected image and the right eye corrected image corresponding to the predetermined position of the left display screen and the predetermined position of the right display screen.

5. The head-mounted visual distortion correction device according to claim 2, wherein: The gaze point guiding mark is in the shape of a cross, a dot or a circle.

6. The head-mounted visual distortion correction device according to claim 2 or 5, wherein: The gaze point guiding mark has a specific color or a flashing display effect.

7. The head-mounted visual distortion correction device according to claim 1, further comprising an eye tracking device, wherein the eye tracking device is disposed on the head-mounted holder and connected to the left display screen, the right display screen, the image processing unit and the image acquisition unit, and is used to detect the left eye gaze point and the right eye gaze point; and The image processing unit is configured to obtain information about the left eye gaze point and the right eye gaze point detected by the eye tracking device, and perform the reverse distortion processing based on the information.

8. The head-mounted visual distortion correction device according to claim 7, wherein: The eye tracking device includes two eye tracking units, which are respectively used to detect the left eye gaze point and the right eye gaze point.

9. The head-mounted visual distortion correction device according to claim 1, wherein: The image acquisition unit includes a single camera, and the single camera is positioned on the head-mounted holder so that when the head-mounted holder is worn on the head, the single camera is located directly in front of the head.

10. The head-mounted visual distortion correction device according to claim 1, wherein: The image acquisition unit includes two cameras, which are positioned on the head-mounted holder so that when the head-mounted holder is worn on the head, the two cameras respectively shoot along the sight lines of the left eye and the right eye.

11. The head-mounted visual distortion correction device according to claim 1, wherein: The head mounted holder is shaped and sized to substantially conform to the area surrounding the eyes to prevent external light from entering the eyes.

12. The head-mounted visual distortion correction device according to claim 1 or 11, wherein: The head-mounted holder is configured to have a light blocking structure between the left display screen and the right display screen for preventing light from the left display screen from entering the right eye and preventing light from the right display screen from entering the left eye.

Images