A multifunctional bionic near-eye imaging and display system

Abstract

The application discloses a multifunctional bionic near-eye imaging and display system, and relates to the display field.The system comprises at least two outer side super lenses, an image receiving unit corresponding to each outer side super lens, a spectacle lens, a transparent display screen, at least two inner side super lenses, and a controller.The system further comprises an image receiving unit integrated between each outer side super lens and the spectacle lens.The inner side super lenses are used for shaping micro display sub-region light and guiding display content into human eyes.The controller is used for receiving light information images sent by the image receiving unit and controlling the image receiving unit and the transparent display screen to work according to a first instruction.The application uses a plurality of super lenses with different parameters on the outer side of the spectacle lens to collect information of objects at different distances, controls corresponding display regions of the transparent display screen to work according to instructions of a wearer, and projects display content into eyeballs of the wearer through the inner side super lenses in front of the display regions, so that self-defined viewing experience is realized.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of photoelectric display, in particular to a multifunctional bionic near-eye imaging and display system. BACKGROUND

[0002] In the prior art, near-eye display is generally combined with single image collection and single image display, which has the disadvantage that when the viewing depth is switched, zoom collection is required in image collection, and corresponding image display or focusing operation is required, resulting in display delay and poor response speed due to single-mode image collection and image display. SUMMARY

[0003] In view of the shortcomings of the prior art, the technical problem to be solved by the present application is to provide a multifunctional bionic near-eye imaging and display system, which is equipped with multiple outer hyperlenses outside the glasses lenses and collects images at different distances, and displays on the transparent display screen through interactive judgment, and projects to the retina of the wearer through the inner hyperlens. The present application can obtain scene information of different distances and different display effects according to the needs of the wearer, thereby realizing a multifunctional bionic near-eye imaging and display system. The present application effectively improves the image collection and the response speed of the inner hyperlens by using multiple outer hyperlenses, display sub-regions and inner hyperlenses, and reduces the delay; at the same time, through the interaction, it can quickly switch between images at different distances, and improve the observation of far and near scenes in the actual combat process.

[0004] To achieve the above-mentioned purpose, in the first aspect of the present application, a multifunctional bionic near-eye imaging and display system is provided, which includes at least two outer hyperlenses, an image receiving unit corresponding to each outer hyperlens, a glasses lens, a transparent display screen, and at least two inner hyperlenses from far to near from the wearer's eyes; the system further comprises a controller.

[0005] An image receiving unit is integrated between each outer hyperlens and the glasses lens; each outer hyperlens is used to collect light rays at different distances to form images with different distances; the image receiving unit is used to receive the light ray information image collected by the corresponding outer hyperlens and transmit it to the controller;

[0006] The transparent display screen includes a micro display sub-region corresponding to each inner hyperlens, the inner hyperlens is used to shape the light rays emitted by the micro display sub-region and guide the display content into the human eye; the number of inner hyperlenses corresponds to the number of outer hyperlenses;

[0007] The controller comprises a data processing module and an interaction module; the interaction module is used for receiving a first instruction issued by the wearer, the first instruction being used for determining whether the image receiving unit and the transparent display screen are in a working state of collection and display and / or determining a matching relationship between the image receiving unit and the transparent display screen; the controller is used for receiving light information images sent by the image receiving unit and controlling the image receiving unit and the transparent display screen according to the first instruction.

[0008] In an embodiment, the types of the outer hyper-lenses include: single-focal-length hyper- short-focus type, single-focal-length short-focus type, single-focal-length medium-focus type, single-focal-length long-focus type, single-focal-length super-long-focus type, multi-focal-length hyper-short-focus type, multi-focal-length short-focus type, multi-focal-length medium-focus type, and multi-focal-length long-focus type; the number and type of the outer hyper-lenses are designed according to actual requirements; the number of focal lengths of the multi-focal-length hyper-lenses is also designed according to actual requirements.

[0009] In an embodiment, the image receiving unit performs data transmission with the controller through a transparent electrode; the image receiving unit comprises a CMOS and / or a CCD.

[0010] In an embodiment, the interaction mode of the interaction module includes: voice instruction, gesture recognition, eye tracking, eye movement tracking, and / or body interaction.

[0011] In an embodiment, the micro display sub-regions are dynamically reconfigured and adjusted according to user requirements and current environment; the inner hyper-lenses and the outer hyper-lenses correspond to each other; the inner hyper-lenses and the outer hyper-lenses cooperate to project information processed by the control system in a clear form into the field of view of the wearer.

[0012] In an embodiment, in the operation process of the system, each micro display sub-region displays the light information images of different distances, and only one light information image is transmitted to the human eye at the same time; the information displayed by the micro display sub-regions is updated in real time and is displayed optimally according to the first instruction of the wearer and the system algorithm.

[0013] In an embodiment, the inner hyper-lenses are distributed in different positions, and the focal points of each inner hyper-lens tend to gather on the retina of the eyeball; the inner hyper-lenses are classified according to focal points and include: single-focal-length type and multi-focal-length type; when the inner hyper-lenses are of the single-focal-length type, the corresponding outer hyper-lenses are also of the single-focal-length type; when the inner hyper-lenses are of the multi-focal-length type, the corresponding outer hyper-lenses are also of the multi-focal-length type, and the number of focal lengths is consistent, but the size of the focal lengths is inconsistent; the largest focal length of the inner hyper-lenses should be focused on the retina of the wearer's eyeball.

[0014] In an embodiment, the frame of the spectacle lens is made of light-weight and durable material; the outer hyperlens and the inner hyperlens are made of high-purity optical material.

[0015] In an embodiment, the system further comprises a storage module for storing historical data and wearer configuration information, and a positioning module for realizing positioning and auxiliary navigation functions.

[0016] In an embodiment, the system is a head-mounted near-eye display device or a spectacle-mounted near-eye display device.

[0017] The present application has the following advantages: (1) The present application can obtain scene information of different distances and different display effects according to the needs of the wearer, and thus realize a multi-functional bionic near-eye imaging and display system. The present application effectively improves the image acquisition and the response speed of the inner hyperlens, and reduces the delay. At the same time, through the interaction, the present application can quickly switch between images of different distances, and improve the observation of far and near scenes in the actual combat process. (2) Compared with the existing near-eye display, the present application only needs to equip the outer side of the spectacle lens with a plurality of outer hyperlenses for collecting information from a distance. Then the information is transmitted to the control system of the glasses through a graphic recording device. The inner side of the spectacle lens is equipped with a transparent display screen, which is divided into multiple regions, each region having an inner hyperlens. When a certain region works, it cooperates with the corresponding outer hyperlens to transmit the collected information to the human eye. The hyperlens responsible for collecting light information has multiple parameters, so that the present system can obtain scene information of different distances and different display effects according to the needs of the wearer, and thus realize a multi-functional bionic near-eye imaging and display system. BRIEF DESCRIPTION OF DRAWINGS

[0018] Figure 1 is a light path schematic diagram of a multi-functional bionic near-eye imaging and display system in an embodiment of the present application;

[0019] Figure 2 is a front view of the outer side of the spectacle lens of a multi-functional bionic near-eye imaging and display system in an embodiment of the present application;

[0020] Figure 3 is a front view of the inner side of the spectacle lens of a multi-functional bionic near-eye imaging and display system in an embodiment of the present application;

[0021] Figure 4is a near view schematic diagram of a multifunctional bionic near-eye imaging and display system in an embodiment of the present application;

[0022] Figure 5 is a near view optical path diagram of a multifunctional bionic near-eye imaging and display system in an embodiment of the present application;

[0023] Figure 6 is a middle view schematic diagram of a multifunctional bionic near-eye imaging and display system in an embodiment of the present application;

[0024] Figure 7 is a middle view optical path diagram of a multifunctional bionic near-eye imaging and display system in an embodiment of the present application;

[0025] Figure 8 is a far view schematic diagram of a multifunctional bionic near-eye imaging and display system in an embodiment of the present application;

[0026] Figure 9 is a far view optical path diagram of a multifunctional bionic near-eye imaging and display system in an embodiment of the present application. DETAILED DESCRIPTION

[0027] Embodiments of the present patent are described below in detail, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals represent the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the drawings are exemplary, only for explaining the present patent, and should not be understood as limiting the present patent.

[0028] To make the purpose, technical solutions and advantages of the present application more clear, the present application will be further described in detail below through specific embodiments and related drawings. Here, the reference is an idealized embodiment schematic diagram of the present application, and the embodiments of the present application should not be considered as limited to the specific shape of the area shown in the figure, but include the resulting shape, such as manufacturing deviation. In the present embodiment, the cross section of the superlens and the image receiving unit is represented as a circle, and the transparent display screen is represented as a rectangle. The representation in the figure is schematic, but this should not be considered as limiting the scope of the present application. In the present embodiment, the size of the superlens and the image receiving unit pattern has a certain range, and in actual production, the size of the superlens and the image receiving unit pattern can be designed according to actual needs. The numerical values of the parameters such as the ratio between the superlens, the image receiving unit and the transparent display screen in the embodiment are only schematic values, but this should not be considered as limiting the scope of the present application.

[0029] As Figures 1-9As shown, the first embodiment of the present application provides a multifunctional bionic near-eye imaging and display system, which is away from the wearer's eyes from far to near and comprises at least two outer hyperlenses 102, an image receiving unit 103 corresponding to each of the outer hyperlenses 102, a spectacle lens 101, a transparent display screen 106, at least two inner hyperlenses 105, and a controller 104. Figure 2 , Figure 3 are respectively a front view and a rear view of the system of the present application.

[0030] An image receiving unit 103 is integrated between each of the outer hyperlenses 102 and the spectacle lens 101; as Figure 2 shown, the image receiving unit 103 is connected to the control system by a transparent electrode; each of the outer hyperlenses 102 is used to collect light rays of different distances to form images of different distances; the image receiving unit 103 is used to receive the light ray information images collected by the corresponding outer hyperlens 102 and transmit them to the controller 104.

[0031] The transparent display screen 106 comprises micro display sub-regions corresponding to each of the inner hyperlenses 105, the inner hyperlenses 105 are used to shape the light rays emitted by the micro display sub-regions and guide the display content into the human eye; the number of the inner hyperlenses 105 corresponds to the number of the outer hyperlenses 102; as Figure 3 shown, the transparent display screen 106 is connected to the control system by a transparent electrode.

[0032] The controller 104 comprises a data processing module and an interaction module; the interaction module is used to receive a first instruction issued by the wearer, the first instruction is used to determine whether the image receiving unit 103 and the transparent display screen 106 are in the working state of collection and display and / or determine the matching relationship between the image receiving unit 103 and the transparent display screen 106; the controller 104 is used to receive the light ray information images sent by the image receiving unit 103 and control the image receiving unit 103 and the transparent display screen 106 to work according to the first instruction.

[0033] As Figure 1 shown, the image receiving unit 103 collects images of different distances through the outer hyperlens 102.

[0034] As Figures 2-3As shown, the glasses lens 101 is integrated with 9 outside superlenses 102 on the outside, which can adopt different types of superlenses for collecting scenes at different distances. Correspondingly, the transparent display screen 106 is also divided into 9 micro display sub-regions, and the glasses lens 101 is integrated with 9 inside superlenses 105 matched with the outside superlenses 102. In actual application, the number of outside superlenses 102, micro display sub-regions, and inside superlenses 105 can be designed according to actual needs.

[0035] Typically, the types of outside superlenses 102 include: single-focal ultra-short focus type, single-focal short focus type, single-focal medium focus type, single-focal long focus type, single-focal ultra-long focus type, multi-focal ultra-short focus type, multi-focal short focus type, multi-focal medium focus type, multi-focal long focus type; the number and type of outside superlenses 102 are designed according to actual needs; wherein the number of multi-focal superlens focal lengths is also designed according to actual needs.

[0036] Optionally, the image receiving unit 103 transmits data to the controller 104 through a transparent electrode; the image receiving unit 103 includes CMOS and / or CCD.

[0037] Optionally, the control system includes a data receiving module, a data processing unit, a graphical recording device, and an interactive module:

[0038] The data receiving module is responsible for receiving the information collected by the outside superlenses 102 of the glasses lens 101 transmitted by the image receiving unit 103, ensuring the accuracy and integrity of the data;

[0039] The data processing unit is used to process the received information and perform corresponding operations according to the user's instructions. This unit has powerful computing power and intelligent algorithms, can analyze and process a large amount of data in real time, and can process and respond according to the user's needs;

[0040] The graphical recording device is used to display the processed information in real time on the inside transparent display screen 106 of the glasses, can convert the processed data into visual graphics or text, and transmit it to the transparent display screen 106 of the glasses, so that the user can intuitively view and understand the information related to the environment outside the glasses; the user can obtain information related to the environment outside the glasses through the display screen inside the glasses;

[0041] The interactive module is used for interaction with the user, receives instructions and adjusts the functions of the glasses. The interaction methods include voice instructions, gesture recognition, eye tracking, eye movement tracking, and body interaction to meet the different needs and habits of users. This module also has a personalized customization function, which can be customized and optimized according to the user's preferences and habits, improving user experience and operation convenience.

[0042] In actual interaction, the wearer issues a first instruction (for example, by eye tracking), the corresponding image receiving unit receives the corresponding scene, and displays it to the retina of the human eye. Figures 4-9 The viewing diagrams of the close-up, the medium shot and the long shot are respectively shown.

[0043] Typically, the interaction mode of the interaction module includes voice instruction, gesture recognition, eye tracking, eye movement tracking and / or body interaction. Preferably, by eye tracking, the long shot and the close-up image can be directly switched.

[0044] In the embodiment, the micro display sub-regions are dynamically reconfigured and adjusted according to the user's needs and the current environment, the inner side hyperlens 105 corresponds to the outer side hyperlens 102 one by one, and the inner side hyperlens 105 cooperates with the outer side hyperlens 102 to project the information processed by the control system to the wearer's field of view in a clear form.

[0045] In the embodiment, during the operation of the system, each micro display sub-region displays the light information image of different distances, and only one light information image is transmitted to the human eye at the same time, so as to reduce unnecessary power consumption and unnecessary visual confusion; the information displayed by the micro display sub-region is updated in real time, and is displayed optimally according to the first instruction of the wearer and the system algorithm; the wearer can interact with the system through the control system, adjust the display content, switch the function module and perform other operations.

[0046] In the embodiment, the inner side hyperlens 105 is distributed in different positions, and the focal points of each inner side hyperlens 105 tend to gather on the retina of the eyeball 107, so as to prevent the wearer from having visual distortion and discomfort (myopic or hyperopic can be adaptively adjusted); the inner side hyperlens 105 is classified according to the focal point, including single focal length type and multi-focal length type; when the inner side hyperlens 105 is single focal length type, the corresponding outer side hyperlens 102 is also single focal length type; when the inner side hyperlens 105 is multi-focal length type, the corresponding outer side hyperlens 102 is also multi-focal length type, and the number of focal lengths is consistent, but the size of the focal length is inconsistent, and the maximum focal length of the inner side hyperlens 105 should be focused on the retina of the eyeball 107 of the wearer.

[0047] In the embodiment, the frame of the glasses lens 101 is made of lightweight and durable material to ensure comfort and durability; the outer side hyperlens 102 and the inner side hyperlens 105 are made of high-purity optical material, which has low dispersion rate and high transmittance, so as to ensure clear imaging effect.

[0048] In the embodiment, the system further comprises a storage module for storing historical data and wearer configuration information, and a positioning module for implementing positioning and assisted navigation functions.

[0049] In the embodiment, the system is a head-mounted near-eye display device or a glasses-mounted near-eye display device.

[0050] The preferred embodiments of the present application are described in detail above. It should be understood that those of ordinary skill in the art can make modifications and variations without departing from the concept of the present application. Therefore, any technical solutions obtained by logical analysis, reasoning or limited experiments based on the concept of the present application and the prior art in the technical field should be within the scope of protection of the present application as defined by the claims.

Claims

1. A multi-functional bionic near-eye imaging and display system, characterized in that, The system from far to near of the wearer's eyes comprises: at least two outer hyperlenses, an image receiving unit corresponding to each of the outer hyperlenses, a spectacle lens, a transparent display screen, at least two inner hyperlenses, and a controller; Each of the outer hyperlenses is integrated with the image receiving unit between the outer hyperlenses and the spectacle lens; each of the outer hyperlenses is used to collect light rays of different distances to form images of different distances; and the image receiving unit is used to receive the light ray information images collected by the corresponding outer hyperlenses and transmit the light ray information images to the controller; The transparent display screen comprises micro display sub-regions corresponding to each of the inner hyperlenses; the inner hyperlenses are used to shape the light rays emitted by the micro display sub-regions and guide the display content into the human eyes; and the number of the inner hyperlenses corresponds to the number of the outer hyperlenses; The controller comprises a data processing module and an interaction module; the interaction module is used to receive a first instruction issued by the wearer, the first instruction is used to determine whether the image receiving unit and the transparent display screen are in the working state of collection and display and / or determine the matching relationship between the image receiving unit and the transparent display screen; and the controller is used to receive the light ray information images transmitted by the image receiving unit and control the working of the image receiving unit and the transparent display screen according to the first instruction; The image receiving unit transmits data to the controller through a transparent electrode; and the image receiving unit comprises a CMOS and / or a CCD; During the operation of the system, each of the micro display sub-regions displays the light ray information images of different distances, and only one of the light ray information images is transmitted to the human eyes at the same time; the information displayed by the micro display sub-regions is updated in real time and is displayed optimally according to the first instruction of the wearer and the system algorithm; The inner hyperlenses are distributed in different positions, and the focal points of each of the inner hyperlenses tend to be gathered on the retina of the eyeball; the inner hyperlenses are classified according to the focal points and comprise single focal length type and multi-focal length type; when the inner hyperlenses are of the single focal length type, the corresponding outer hyperlenses are also of the single focal length type; when the inner hyperlenses are of the multi-focal length type, the corresponding outer hyperlenses are also of the multi-focal length type, and the number of focal lengths is consistent, but the sizes of the focal lengths are inconsistent; and the largest focal length of the inner hyperlenses should be focused on the retina of the wearer's eyeball.

2. The multi-functional biomimetic near-eye imaging and display system of claim 1, wherein, The types of the outer hyperlenses comprise: single focal length hyper-short focus type, single focal length short focus type, single focal length medium focus type, single focal length long focus type, single focal length hyper-long focus type, multi-focal length hyper-short focus type, multi-focal length short focus type, multi-focal length medium focus type, and multi-focal length long focus type; the number and type of the outer hyperlenses are designed according to actual needs; and the number of focal lengths of the multi-focal length hyperlens is also designed according to actual needs.

3. The multi-functional biomimetic near-eye imaging and display system of claim 1, wherein, The interaction modes of the interaction module comprise: voice instruction, gesture recognition, eyeball tracking, eye movement tracking, and / or body interaction.

4. The multi-functional biomimetic near-eye imaging and display system of claim 1, wherein, The micro display sub-area is dynamically reconfigured and adjusted according to the requirements of the user and the current environment, the inner side super lens corresponds to the outer side super lens, and the inner side super lens and the outer side super lens cooperate to project the information processed by the control system into the field of view of the wearer in a clear form.

5. The multi-functional biomimetic near-eye imaging and display system of claim 1, wherein, The frame of the glasses lens is made of light and durable material; the outer side super lens and the inner side super lens are made of high-purity optical material.

6. The multi-functional biomimetic near-eye imaging and display system of claim 4, wherein, The system further comprises a storage module for storing historical data and wearer configuration information, and a positioning module for realizing positioning and auxiliary navigation functions.

7. The multi-functional biomimetic near-to-eye imaging and display system of any of claims 1-6, wherein, The system is installed in a head-mounted near-eye display device or a glasses-mounted near-eye display device.

Images