Multi-modal analysis system and multifunctional portable eye detection device

Abstract

The utility model provides a multi-modal analysis system and a multifunctional portable eye detection device. The multi-modal analysis system comprises a user eye interface, an imaging assembly, a light propagation assembly and a light source assembly. The light propagation assembly comprises an eye objective lens, a selectively arranged anterior segment lens and a selectively arranged fourth reflector; the light source assembly comprises a first light source, a second light source and a third light source, the imaging assembly comprises a first image collection device and a second image collection device; the fourth reflector comprises a first configuration located on the main optical axis and a second configuration moved out of the main optical axis, and in the first configuration, the second image collecting device is connected to the main optical axis through the fourth reflector and is coupled with the second light source to receive crystal reflected light, responding to the second stimulation light, of the eyes of the user; in the second configuration, the first image collection device is coupled with the first light source and the third light source. The multi-modal analysis system solves the problem that a multi-modal analysis system in the prior art has few detection functions.

Description

Technical Field

[0001] The utility model relates to the technical field of detection equipment, and in particular to a multimodal analysis system and a multifunctional portable eye detection device. Background Art

[0002] As the only organ in the body that can directly observe arteries and veins without passing through the skin and connective tissue, the eye is very important for monitoring systemic physiological indicators, metabolic diseases, cardiovascular diseases, nervous system diseases, aging evaluation, etc. Therefore, the development of an analysis system that can reflect multi-system indicators of the whole body through the eye and has integrated multimodal detection means is of great significance for early screening of multi-system diseases, aging indicators, and quantitative evaluation of health levels. Currently, a multimodal analysis system is usually used to extract the characteristics of the human eye to detect physiological indicators. However, due to the small number of detection modules in the current multimodal analysis system, only a single or fewer detection functions can be realized, the functions are not comprehensive enough, the coverage is not wide enough, and it cannot truly reflect the cell morphology, hemodynamics and blood vessel diameter of the fundus.

[0003] In other words, the multimodal analysis system in the prior art has the problem of having few detection functions. Utility Model Content

[0004] The main purpose of the utility model is to provide a multimodal analysis system and a multifunctional portable eye detection device to solve the problem that the multimodal analysis system in the prior art has few detection functions.

[0005] In order to achieve the above-mentioned purpose, according to one aspect of the utility model, a multimodal analysis system is provided, comprising: a user eye interface, an imaging component arranged on one side of the user eye interface, a light propagation component and a light source component located between the user eye interface and the imaging component; the light propagation component comprises: an eyepiece objective lens arranged from the user eye interface toward the main optical axis direction of the imaging component, a selectively arranged anterior segment mirror and a selectively arranged fourth reflector; the light source component comprises: a first light source located between the anterior segment mirror and the imaging component, a second light source arranged offset from the main optical axis and a third light source arranged on the periphery of the eyepiece objective lens, the second light source propagating a second stimulation light through the user eye interface in a direction at an angle to the main optical axis, the second stimulation light being diffuse light; the imaging component comprises a light source arranged away from the user eye interface and away from the fourth reflector A first image collecting device on one side of the user's eye interface and a second image collecting device arranged in the reflection path of a fourth reflector; the fourth reflector includes a first configuration located on the main optical axis and a second configuration moved out of the main optical axis, wherein, in the first configuration, the second image collecting device is connected to the main optical axis via the fourth reflector and is coupled with the second light source to receive the crystal reflected light of the user's eye in response to the second stimulation light; in the second configuration, the first image collecting device is coupled with the first light source and the third light source to respectively receive the first eye signal of the user's eye in response to the first light source or the second eye signal of the user's eye in response to the third light source; the third light source is configured to emit near-infrared light, the first light source is configured to emit light of different wavelengths to generate multi-spectral fundus stimulation light through the eyepiece objective, and when the first light source is turned on, the anterior segment lens is not arranged on the main optical axis.

[0006] Furthermore, the light propagation component also includes a first beam splitter arranged on a side of the fourth reflector close to the user eye interface and a first display located in a reflection path of the first beam splitter, the first display being used to display a first fixation cursor in response to the first light source in a second configuration or to selectively display a moving second fixation cursor or light stimulation of different wavelengths in response to the third light source, and the second eye signal includes an eye tracking signal corresponding to the second fixation cursor or a pupil reflection signal corresponding to light stimulation of different wavelengths.

[0007] Furthermore, the light propagation component also includes a hollow reflector arranged on the main optical axis, and the light of different wavelengths emitted by the first light source is reflected by the hollow reflector to the eyepiece objective lens.

[0008] Further, the first light source includes a plurality of LEDs emitting 460nm-900nm light.

[0009] Furthermore, the light propagation component also includes: a focusing reflector selectively arranged between the user eye interface and the eyepiece objective lens, and the multimodal analysis system also includes a blood glucose measurement component arranged in the reflection path of the focusing reflector, and the blood glucose measurement component includes a fourth light source and a spectrometer for collecting scattered light of the eye blood vessels in response to the stimulation of the fourth light source and generating a spectral signal.

[0010] Furthermore, the blood glucose measurement component includes a fourth beam splitter, the spectrometer is located in the transmission path of the fourth beam splitter, the light emitted by the fourth light source is reflected by the fourth beam splitter and then transmitted to the user eye interface through the focusing reflector, and the blood glucose measurement component also includes a first scanning device arranged between the fourth beam splitter and the fourth light source, the first scanning device includes a first scanning galvanometer and a second scanning galvanometer which can rotate in two directions perpendicular to each other.

[0011] Furthermore, the light propagation component also includes: a first reflector selectively arranged between the eyepiece objective and the anterior segment mirror, the multimodal analysis system also includes an optical laser scanning component arranged in the reflection path of the first reflector, the optical laser scanning component includes a fifth light source, a fourth image collecting device and a wavefront sensor.

[0012] Furthermore, the multimodal analysis system also includes a refractive adjustment system, which is located between the first reflector and the optical laser scanning assembly.

[0013] Furthermore, the optical laser scanning assembly also includes a second beam splitter and a third beam splitter, the third beam splitter is located in the transmission path of the second beam splitter, the fifth light source is located in the reflection path of the second beam splitter, the fourth image collection device is located in the transmission path of the third beam splitter, and the wavefront sensor is located in the reflection path of the third beam splitter.

[0014] Furthermore, the optical laser scanning assembly also includes a second scanning device located between the refractive adjustment system and the second beam splitter, the second scanning device includes a deformable mirror, a vertical scanning device and a horizontal scanning device, and the deformable mirror is located between the vertical scanning device and the horizontal scanning device.

[0015] According to another aspect of the utility model, a multifunctional portable eye detection device is also provided, including the above-mentioned multimodal analysis system, the light propagation component of the multimodal analysis system also includes: a focusing reflector selectively arranged between the user eye interface and the eyepiece objective lens, and a first reflector selectively arranged between the eyepiece objective lens and the anterior segment lens, the multifunctional portable eye detection device also includes: a blood glucose measurement component arranged in the reflection path of the focusing reflector and an optical laser scanning component arranged in the reflection path of the first reflector, the blood glucose measurement component includes a fourth light source and a spectrometer for collecting scattered light of eye blood vessels in response to stimulation of the fourth light source and generating a spectral signal, the optical laser scanning component includes a fifth light source, a fourth image collection device and a wavefront sensor; the multifunctional portable eye detection device also includes a processor coupled to the first image collection device, the second image collection device, the spectrometer, the fourth image collection device and the wavefront sensor.

[0016] Furthermore, the multifunctional portable eye detection device also includes a VR / AR display unit connected to the processor, and the user eye interface is integrated in the VR / AR display unit.

[0017] By applying the technical solution of the utility model, the multimodal analysis system comprises: a user eye interface, an imaging component arranged at one side of the user eye interface, a light propagation component and a light source component located between the user eye interface and the imaging component; the light propagation component comprises: an eye-receiving objective lens arranged from the user eye interface toward the main optical axis direction of the imaging component, a selectively arranged anterior segment mirror and a selectively arranged fourth reflector; the light source component comprises: a first light source located between the anterior segment mirror and the imaging component, a second light source arranged deviating from the main optical axis and a third light source arranged at the periphery of the eye-receiving objective lens, the second light source propagating a second stimulation light through the user eye interface in a direction forming an angle with the main optical axis, the second stimulation light being diffuse light; the imaging component comprises a A first image collecting device and a second image collecting device arranged in a reflection path of a fourth reflector; the fourth reflector includes a first configuration located on the main optical axis and a second configuration moved out of the main optical axis, wherein, in the first configuration, the second image collecting device is connected to the main optical axis via the fourth reflector and coupled to the second light source to receive the crystal reflected light of the user's eye in response to the second stimulation light; in the second configuration, the first image collecting device is coupled to the first light source and the third light source to respectively receive a first eye signal of the user's eye in response to the first light source or a second eye signal of the user's eye in response to the third light source; the third light source is configured to emit near-infrared light, and the first light source is configured to emit light of different wavelengths to generate multi-spectral fundus stimulation light through the eyepiece objective lens, and when the first light source is turned on, the anterior segment lens is not set on the main optical axis.

[0018] By selectively setting the anterior segment mirror and the selectively set fourth reflector, and by reasonably and selectively moving or removing the anterior segment mirror and the fourth reflector from the optical axis, different detection optical paths can be accessed to achieve different detection functions, so that the multimodal analysis system of the present application can realize the detection functions of diffuse light imaging system, eye tracking system, pupil reflection system, multispectral imaging system and blood oxygen content measurement system, increase the detection range, ensure the comprehensiveness of human eye detection, and at the same time ensure detection efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The drawings constituting part of the present application are used to provide a further understanding of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation on the present invention. In the drawings:

[0020] Figure 1 A structural schematic diagram of a multimodal analysis system according to an optional embodiment of the utility model is shown.

[0021] The above drawings include the following reference numerals:

[0022] S12, first light source; FB, optical fiber; L13, first transfer lens; HM, hollow reflector; L14, anterior segment lens; L15, eyepiece lens; S11, second light source; L11, fifth transfer lens; SL, slit; L12, sixth transfer lens; G1, ground glass; S13, third light source; FM1, focusing reflector; M1, first reflector; F1, focusing lens; BS2, first beam splitter; 23, display; L21, first imaging lens; 21, first image collection device; M21, fourth reflector; M22, fifth reflector; F2, Galileo zoom system; L22, second imaging lens; 22, second image collection device; M4, seventh reflector; 30, blood glucose measurement component; S3, fourth light source; L31, eighth transfer lens; SC31 , the first scanning galvanometer; SC32, the second scanning galvanometer; L32, the ninth transfer lens; M3, the sixth reflector; BS3, the fourth beam splitter; L33, the third imaging objective lens; LP, filter; SP1, spectrometer; 50, refractive adjustment system; 40, optical laser scanning assembly; M41, the second reflector; M42, the third reflector; SC41, the vertical scanning device; SC42, the horizontal scanning device; DM, deformable mirror; BS41, the second beam splitter; BS42, the third beam splitter; L41, the second transfer lens; S4, the fifth light source; L42, the third transfer lens; L43, the fourth transfer lens; L44, the fourth imaging objective lens; PH, pinhole; PMT, photomultiplier tube; A1, aperture; SHWS, wavefront sensor; 60, processor; 70, human eye. DETAILED DESCRIPTION

[0023] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The present utility model will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0024] It should be noted that, unless otherwise specified, all technical and scientific terms used in this application have the same meanings as commonly understood by ordinary technicians in the technical field to which this application belongs.

[0025] In the present invention, unless otherwise specified, the directional words used, such as "up, down, top, bottom", usually refer to the directions shown in the drawings, or to the components themselves in the vertical, perpendicular or gravity directions; similarly, for ease of understanding and description, "inside and outside" refer to the inside and outside relative to the outline of each component itself, but the above-mentioned directional words are not used to limit the present invention.

[0026] In order to solve the problem of insufficient detection functions in the multimodal analysis system in the prior art, the utility model provides a multimodal analysis system and a multifunctional portable eye detection device.

[0027] like Figure 1 As shown, the multimodal analysis system includes a user eye interface, an imaging component disposed on one side of the user eye interface, a light propagation component and a light source component located between the user eye interface and the imaging component;

[0028] The light transmission component includes: an eyepiece lens L15 arranged from the user eye interface toward the main optical axis direction of the imaging component, an optionally arranged anterior segment lens L14, and an optionally arranged fourth reflector M21;

[0029] The light source assembly includes: a first light source S12 located between the anterior segment lens L14 and the imaging assembly, a second light source S11 disposed away from the main optical axis, and a third light source S13 disposed on the outer peripheral side of the eyepiece objective lens L15, the second light source S11 propagates the second stimulation light through the user eye interface along a direction forming an angle with the main optical axis, and the second stimulation light is diffuse light;

[0030] The imaging assembly includes a first image collecting device 21 disposed on a side of the fourth reflector M21 away from the user eye interface and a second image collecting device 22 disposed in a reflection path of the fourth reflector M21;

[0031] The fourth reflector M21 includes a first configuration located on the main optical axis and a second configuration moved out of the main optical axis, wherein in the first configuration, the second image collecting device 22 is connected to the main optical axis via the fourth reflector M21 and coupled to the second light source S11 to receive the crystal reflected light of the user's eye in response to the second stimulation light; in the second configuration, the first image collecting device 21 is coupled to the first light source S12 and the third light source S13 to respectively receive the first eye signal of the user's eye in response to the first light source S12 or the second eye signal of the user's eye in response to the third light source S13;

[0032] The third light source S13 is configured to emit near-infrared light, and the first light source S12 is configured to emit light of different wavelengths to generate multi-spectral fundus stimulation light through the eyepiece objective lens L15. When the first light source S12 is turned on, the anterior segment lens L14 is not set on the main optical axis.

[0033] By selectively setting the anterior segment mirror L14 and the selectively setting the fourth reflector M21, and by reasonably choosing to set or not set the anterior segment mirror L14 and the fourth reflector M21, different detection optical paths can be connected to realize different detection functions, so that the multimodal analysis system of the present application can realize the detection functions of diffuse light imaging system, eye tracking system, pupil reflection system, multispectral imaging system and blood oxygen content measurement system, increase the detection range, ensure the comprehensiveness of human eye detection, and at the same time ensure the detection efficiency.

[0034] Specifically, when the fourth reflector M21 is set on the main optical axis and the anterior segment mirror L14 is set on the main optical axis, the second light source S11, the eyepiece objective lens L15, the anterior segment mirror L14 and the second image collecting device 22 form a diffuse light imaging system; when the anterior segment mirror L14 is set on the main optical axis and the fourth reflector M21 is not set on the main optical axis, the third light source S13, the eyepiece objective lens L15, the anterior segment mirror L14 and the first image collecting device 21 form an eye tracking system and a pupil reflection system; when the anterior segment mirror L14 is not set on the main optical axis and the fourth reflector M21 is not set on the main optical axis, the first light source S12, the eyepiece objective lens L15 and the first image collecting device 21 form a multi-spectral imaging system and a blood oxygen content measurement system.

[0035] In the present application, the selective arrangement includes one of moving the optical element into the optical axis and removing the optical element from the optical axis.

[0036] like Figure 1 As shown, the light source assembly also includes a fifth transfer lens L11, a slit SL, a sixth transfer lens L12 and a frosted glass G1 which are sequentially arranged on the light exit side of the second light source S11. The second light source S11, the fifth transfer lens L11, the slit SL, the sixth transfer lens L12 and the frosted glass G1 are coaxially arranged. The optical path direction from the second light source S11 to the human eye 70 is arranged at an acute angle to the main optical axis direction, specifically at 45°. The above-mentioned user eye interface is arranged in front of the human eye 70.

[0037] Specifically, the light propagation component also includes a first beam splitter BS2 disposed on the side of the fourth reflector M21 close to the user eye interface and a first display 23 located on the reflection path of the first beam splitter BS2. The first display is used to display a first fixation cursor in response to the first light source S12 in the second configuration or to selectively display a moving second fixation cursor or light stimulation of different wavelengths in response to the third light source S13. The second eye signal includes an eye tracking signal corresponding to the second fixation cursor or a pupil reflection signal corresponding to light stimulation of different wavelengths. The light propagation component also includes a focusing mirror F1 disposed on the light incident side of the first beam splitter BS2 and a first imaging objective lens L21 disposed between the first image collecting device 21 and the fourth reflector M21. The light propagation component also includes a fifth reflector M22, a Galilean zoom system F2, a second imaging objective lens L22, which are located between the fourth reflector M21 and the second image collecting device 22 and are sequentially disposed on the reflection path of the fourth reflector M21.

[0038] Specifically, when the fourth reflector M21 and the anterior segment mirror L14 are both set on the main optical axis, the anterior segment mirror L14 and the eyepiece objective lens L15 are both on the main optical axis, the second light source S11 emits visible light, and the emitted visible light is collected by the fifth transfer lens L11, the slit SL, the sixth transfer lens L12 and the frosted glass G1 in turn to form a circular uniform diffuse light, and then enters the human eye 70 through the user eye interface, and the reflected light of the human eye 70 passes through the eyepiece objective lens L15 and the anterior segment mirror L14 to the imaging component. Since the fourth reflector M21 is set in the direction of the main optical axis, the emitted light passes through the focusing mirror F1 and the first beam splitter BS2 in turn, and is reflected by the fourth reflector M21, and is further reflected by the fifth reflector M22 and transmitted to the Galileo magnification system F2. The Galileo magnification system F2 can achieve 10 times and 40 times magnification, and then reaches the second image collection device 22 through the second imaging objective lens L22, and is finally transmitted to the processor. It should be noted here that when the fourth reflector M21 is set in the direction of the main optical axis, the fourth reflector M21 intercepts the imaging light path of the first image collecting device 21, so only the second image collecting device 22 plays an imaging role; when the fourth reflector M21 is not set in the direction of the main optical axis, the first image collecting device 21 forms an image, and the second image collecting device 22 does not form an image.

[0039] Specifically, the Galilean zoom system F2 includes at least a combination of a positive lens and a negative lens to achieve 10 times and 40 times magnification.

[0040] like Figure 1As shown, the light propagation component also includes a hollow reflector HM arranged on the main optical axis, and the hollow reflector HM is arranged obliquely to the main optical axis. The light of different wavelengths emitted by the first light source S12 is reflected to the eyepiece objective lens L15 through the hollow reflector HM. An optical fiber FB and a first transfer lens L13 are also arranged in sequence between the first light source S12 and the hollow reflector HM. When the anterior segment mirror L14 is not arranged in the direction of the main optical axis, that is, the anterior segment mirror L14 is removed and the fourth reflector M21 is not arranged in the direction of the main optical axis, the first light source S12, the eyepiece objective lens L15 and the imaging component form a multi-spectral imaging system and a blood oxygen content measurement system.

[0041] Specifically, the multi-spectral imaging system includes a first light source S12, an optical fiber FB, a first transfer lens L13, a hollow reflector HM and an eyepiece lens L15, as well as a focusing lens F1, a first imaging lens L21, a first image collecting device 21, a first beam splitter BS2 and a display 23, wherein the display 23 is used to display a fixation cursor or an image. In the multi-spectral imaging system, the first light source S12 is used to sequentially emit light of different wavelengths, and the first light source S12 includes a plurality of LEDs emitting 460nm-900nm light, each of which is connected to an optical fiber branch, which is evenly distributed at the annular light outlet after being beam-combined by the optical fiber branches, so that the light emitted by each LED lamp is emitted as a fixed annular light beam, which reaches the hollow reflector HM after passing through the first transfer lens L13, is received and reflected by the peripheral area of ​​the hollow reflector HM, and reaches the human eye 70 after passing through the eyepiece lens L15. The light reflected by the human eye 70 reaches the imaging assembly after passing through the eyepiece lens L15 and the hollow area of ​​the hollow reflector HM, and then is imaged on the first image collecting device 21 after passing through the focusing lens F1 and the first imaging lens L21, and finally transmitted to the processor. The processor may be a computer.

[0042] Specifically, the blood oxygen content measurement system includes a first light source S12, an optical fiber FB, a first transmission lens L13, a hollow reflector HM and an eyepiece lens L15, as well as a focusing lens F1, a first imaging lens L21, a first image collection device 21, a first spectroscope BS2 and a display 23, wherein the display 23 is used to display a fixation cursor or an image. In the blood oxygen content measurement system, the first light source S12 is used to emit light of at least two wavelengths. The first light source S12 is composed of a plurality of LED lamps, and can emit light of 570nm and 600nm. After passing through the first transmission lens L13, the light reaches the peripheral area of ​​the hollow reflector HM, is reflected by the hollow reflector HM, and then reaches the human eye 70 through the eyepiece lens L15. The light reflected by the human eye 70 reaches the imaging component through the eyepiece lens L15 and the hollow area of ​​the hollow reflector HM, is imaged on the first image collection device 21 after passing through the focusing lens F1 and the first imaging lens L21, and is finally transmitted to the computer.

[0043] It should be noted here that the multi-spectral imaging system and the blood oxygen content measurement system use the same devices and the same optical path. The difference is that the first light source S12 in the multi-spectral imaging system is used to emit light of different wavelengths in sequence, and the first light source S12 in the blood oxygen content measurement system is used for 570nm and 600nm light. Due to the different wavelengths of the detection light, different detection functions can be achieved.

[0044] like Figure 1 As shown, the third light source S13 is multiple, and multiple third light sources S13 are spaced around the periphery of the eyepiece objective lens L15. In a specific embodiment of the present application, the third light source S13 is a near-infrared LED lamp and is two, and the two near-infrared LED lamps are spaced on the upper side and the lower side of the eyepiece objective lens L15. When the front segment mirror L14 is arranged on the main optical axis and the fourth reflecting mirror M21 is not arranged on the main optical axis, the third light source S13, the eyepiece objective lens L15, the front segment mirror L14 and the imaging assembly form an eye tracking system and a pupil reflection system. Optionally, different third light sources S13 can be arranged on the periphery of the eyepiece objective lens L15 with different diameters.

[0045] Specifically, the eye tracking system includes a third light source S13, an eyepiece objective lens L15, an anterior segment lens L14, a focusing lens F1, a first imaging objective lens L21, a first image collecting device 21, a first beam splitter BS2, and a display 23. The display 23 is used to realize a moving fixation cursor. In the eye tracking system, the third light source S13 is used to illuminate the human eye 70 with near-infrared light, and the specific wavelength of the light is 850nm. The imaging light reflected by the human eye 70 passes through the eyepiece objective lens L15 and the anterior segment lens L14 to realize imaging of the surface of the human eye 70. Then, the tracking of the corneal light reflection point and the pupil center is realized through the first imaging objective lens L21 and the first image collecting device 21. Finally, the image is transmitted to a computer to produce corresponding eye movement data.

[0046] Specifically, the pupil reflection system includes a third light source S13, an eyepiece lens L15, an anterior segment lens L14, a focusing lens F1, a first imaging lens L21, a first image collecting device 21, a first beam splitter BS2, and a display 23. The display 23 is used to achieve stimulation of different wavelengths. In the pupil reflection system, the third light source S13 is used to illuminate the human eye 70 with near-infrared light, and the specific wavelength of the light is 850nm. The imaging light reflected by the human eye 70 passes through the eyepiece lens L15 and the anterior segment lens L14 to achieve imaging of the surface of the human eye 70. Then, the first imaging lens L21 and the first image collecting device 21 are used to realize recording including pupil images, and finally the images are transmitted to a computer to produce corresponding pupil reaction data.

[0047] It should be noted here that the eye tracking system and the pupil reflection system use the same devices and the same optical path. The specific difference is that the display 23 in the eye tracking system is used to display a moving fixation cursor or different images, and the display 23 in the pupil reflection system is used to provide light stimulation of different wavelengths.

[0048] like Figure 1 As shown, the light transmission component also includes a focusing reflector FM1 selectively arranged between the user eye interface and the eyepiece objective lens L15, and the multimodal analysis system also includes a blood glucose measurement component 30 arranged on the reflection path of the focusing reflector FM1, and the blood glucose measurement component 30 includes a fourth light source S3 and a spectrometer SP1 for collecting scattered light stimulated by the eye blood vessels in response to the fourth light source S3 and generating a spectral signal. When the focusing reflector FM1 is arranged between the user eye interface and the eyepiece objective lens L15, the blood glucose measurement component 30 and the focusing reflector FM1 form a blood glucose measurement system.

[0049] Specifically, the blood glucose measurement component 30 includes a fourth beam splitter BS3, a spectrometer SP1 is located in the transmission path of the fourth beam splitter BS3, and a third imaging objective lens L33 and a filter LP are arranged in sequence between the fourth beam splitter BS3 and the spectrometer SP1, and the spectrometer SP1 is a Raman spectrometer. The light emitted by the fourth light source S3 is reflected by the fourth beam splitter BS3 and then transmitted to the user eye interface through the focusing reflector FM1. The blood glucose measurement component 30 also includes a first scanning device arranged between the fourth beam splitter BS3 and the fourth light source S3, and the first scanning device includes a first scanning galvanometer SC31 and a second scanning galvanometer SC32 that can rotate in two directions perpendicular to each other. An eighth transfer lens L31 is also arranged between the fourth light source S3 and the first scanning device, and a ninth transfer lens L32 and a sixth reflector M3 are also arranged in sequence between the first scanning device and the fourth beam splitter BS3. The fourth beam splitter BS3 is located on the side of the third imaging objective lens L33 away from the filter LP and on the reflection path of the sixth reflector M3. The blood glucose analysis system further includes a seventh reflector M4 , which is located between the focusing reflector FM1 and the blood glucose measurement component 30 to achieve a turning of the optical path between the focusing reflector FM1 and the blood glucose measurement component 30 .

[0050] When the focusing reflector FM1 is set between the user eye interface and the eyepiece objective lens L15, the blood glucose measurement system works. Specifically, the 785nm light emitted by the fourth light source S3 is collected by the eighth transfer lens L31 and then scanned in the horizontal direction and the vertical direction respectively by the first scanning galvanometer SC31 and the second scanning galvanometer SC32 of the first scanning device, and then reflected by the ninth transfer lens L32, the sixth reflector M3, and the fourth beam splitter BS3, and then further reflected by the seventh reflector M4, and then reflected to the human eye 70 by the focusing reflector FM1. The scattered light of the blood vessels of the human eye 70 is collected by the focusing reflector FM1 and reaches the blood glucose measurement component 30 through the seventh reflector M4, and then transmits the fourth beam splitter BS3, and then sequentially passes through the third imaging objective lens L33, the filter LP and the spectrometer SP1 to measure blood glucose. Among them, the function of the filter LP is to only allow light with a wavelength greater than the third light source S13 to pass. The spectral information collected by the spectrometer SP1 is transmitted to the computer for blood glucose content analysis.

[0051] like Figure 1 As shown, the light propagation component also includes a first reflector M1 selectively arranged between the eyepiece objective lens L15 and the anterior segment lens L14, and the multimodal analysis system also includes an optical laser scanning component 40 arranged in the reflection path of the first reflector M1, and the optical laser scanning component 40 includes a fifth light source S4, a fourth image collection device and a wavefront sensor SHWS. The wavefront sensor SHWS is a Shack-Hartmann wavefront sensor.

[0052] The optical laser scanning assembly 40 also includes a second beam splitter BS41 and a third beam splitter BS42. The third beam splitter BS42 is located on the transmission path of the second beam splitter BS41, and the fifth light source S4 is located on the reflection path of the second beam splitter BS41. It can also be understood that the second beam splitter BS41 is located on the light emitting side of the fifth light source S4, the fourth image collecting device is located on the transmission path of the third beam splitter BS42, and the wavefront sensor SHWS is located on the reflection path of the third beam splitter BS42.

[0053] Specifically, the multimodal analysis system further includes a diopter adjustment system 50, which is located between the first reflector M1 and the optical laser scanning assembly 40. The diopter adjustment system 50 includes two biconvex lenses and four reflectors, and the two biconvex lenses are arranged on both sides of the reflection module formed by the four reflectors.

[0054] Specifically, the optical laser scanning assembly 40 also includes a second scanning device located between the diopter adjustment system 50 and the second beam splitter BS41, the second scanning device includes a deformable mirror DM, a vertical scanning device SC41 and a horizontal scanning device SC42, and the deformable mirror DM is located between the vertical scanning device SC41 and the horizontal scanning device SC42. Of course, the optical laser scanning assembly 40 also includes a second transfer lens L41 located on the light exit side of the fifth light source S4, a second reflector M41 between the vertical scanning device SC42 and the diopter adjustment system 50, and a third transfer lens L42, a third reflector M42, an aperture A1, a fourth transfer lens L43 and a wavefront sensor SHWS arranged in sequence on the reflection path of the third beam splitter BS42. It also includes a fourth imaging objective lens L44, a pinhole PH, a photomultiplier tube PMT and the above-mentioned fourth image collection device arranged in sequence on the transmission path of the third beam splitter BS42, and the third beam splitter BS42 is located on the transmission path of the second beam splitter BS41 and on the side of the second beam splitter BS41 away from the vertical scanning device SC41.

[0055] When the first reflector M1 is arranged on the main optical axis, the fifth light source S4 is used to emit light of 785 nm. The emitted light passes through the second transfer lens L41 and then is reflected by the second beam splitter BS41 to reach the vertical scanning device SC41. Then, the light passes through the deformable mirror DM, the horizontal scanning device SC42, the second reflector M41, and then the refractive adjustment system 50 to the first reflector M1. After being reflected by the first reflector M1, it is focused by the eyepiece lens L15 and reaches the human eye 70. The light returned by the human eye 70 is reflected by the eyepiece lens L15 and the first reflector M1 and then enters the refractive adjustment system 50. Then, it reaches the optical laser scanning component 40, and then passes through the second scanning device and transmits the second beam splitter BS41. Then, after being reflected by the third beam splitter BS42, it passes through the third transfer lens L42, the third reflector M42, the aperture A1, and the fourth transfer lens L43 in sequence to reach the wavefront sensor SHWS for wavefront sensing. The reflected light of the fundus after correction by the deformable mirror DM is finally collected by the fourth image collection device and transmitted to the computer. The aperture A1 and the pinhole PH are used to filter out stray light in the system. The correction wavefront can be corrected by the deformable mirror DM after the wavefront is detected by the wavefront sensor SHWS, or by the deformable mirror DM after the image is collected by the detector and processed by a computer without the wavefront sensor SHWS.

[0056] The optical laser scanning assembly 40 is an adaptive optical laser scanning imaging system. Adaptive optics is a technology for improving the performance of optical systems. It uses deformable mirrors to correct the optical wavefront distortion caused by atmospheric jitter to improve the quality of imaging. The confocal laser scanning ophthalmoscope technology is to emit a laser beam from a scanning device, pass through a series of optical elements in the optical path, such as reflectors, scanning devices, etc., and irradiate the patient's retina. The scanning device forms a scanning point diagram with a specific geometric shape on the eye tissue by controlling the scanning speed and direction of the laser beam. These point diagrams can generate a two-dimensional image of the retina, a three-dimensional structural image and other related measurement parameters after analysis and processing. Since light can pass through tissue mainly by relying on its inherent wavelength, different wavelengths of light can be used when obtaining fundus imaging of the anatomical structure and pathological characteristics of different levels of the retina. Long-wavelength light, such as infrared light, can penetrate deeper layers and enhance the imaging of deep retina and choroid. Conversely, if short-wavelength light, such as blue light, is used, the structure of the superficial retina, such as the retinal nerve fiber layer and retinal blood vessels, can be observed.

[0057] It should be noted that the above-mentioned beam splitter can be a dichroic mirror or a beam splitter prism, which can be set according to actual conditions. The above-mentioned display 23 is one of one or more liquid crystal display screens, organic light emitting diode OLED displays, and micro LED displays. The display 23 can be in a fixed position or can be moved in the horizontal direction or vertical direction. The above-mentioned first image collection device 21 and the second image collection device 22 can be PMT, CCD or CMOS detectors.

[0058] In addition, the multimodal analysis system further includes a processor 60, which is specifically a computer. Specifically, the first image collection device 21, the second image collection device 22, the deformable mirror DM, the wavefront sensor SHWS, the fourth image collection device, and the spectrometer SP1 are all connected to the processor 60, and the processor 60 can be connected to the VR / AR display unit, and the user eye interface is integrated on the VR / AR display unit.

[0059] In summary, the multimodal analysis system of the present application realizes the high integration of seven detection modules, namely, diffuse light imaging system, eye tracking system, pupil reflex system, blood glucose measurement system, multispectral imaging system, blood oxygen content measurement system and optical laser scanning imaging system, which effectively reduces the size of the equipment, improves the detection efficiency of the system, and realizes the imaging of single photoreceptor cells in the fundus at the micron level through optical laser scanning imaging.

[0060] The present application also provides a multifunctional portable eye detection device, including the above-mentioned multimodal analysis system, the light propagation component of the multimodal analysis system also includes: a focusing reflector FM1 selectively arranged between the user eye interface and the eyepiece objective lens L15, and a first reflector M1 selectively arranged between the eyepiece objective lens L15 and the anterior segment lens L14, the multifunctional portable eye detection device also includes: a blood glucose measurement component 30 arranged in the reflection path of the focusing reflector FM1 and an optical laser scanning component 40 arranged in the reflection path of the first reflector M1, the blood glucose measurement component 30 includes a fourth light source S3 and a spectrometer SP1 for collecting scattered light of the eye blood vessels in response to the stimulation of the fourth light source S3 and generating a spectral signal, the optical laser scanning component 40 includes a fifth light source S4, a fourth image collection device and a wavefront sensor SHWS; the multifunctional portable eye detection device also includes a processor coupled to the first image collection device 21, the second image collection device 22, the spectrometer SP1, the fourth image collection device and the wavefront sensor SHWS.

[0061] Specifically, the multifunctional portable eye detection device also includes a VR / AR display unit connected to the processor, and the user eye interface is integrated on the VR / AR display unit.

[0062] The principle of the multimodal analysis system of the present application is described below in conjunction with practical applications.

[0063] First, diffuse light imaging is performed through the diffuse light imaging system. At this time, the fourth reflector M21 is in the direction of the main optical axis, and the focusing reflector FM1 is not on the main optical axis. The second light source S11 emits visible light, and the fifth transfer lens L11, the slit SL, the sixth transfer lens L12 and the frosted glass G1 arranged in sequence on its light output side are used to realize diffuse light illumination for the human eye 70. The reflected light of the human eye 70 reaches the imaging component after passing through the eyepiece objective lens L15 and the anterior segment lens L14. After passing through the focusing lens F1, the first beam splitter BS2, the fourth reflector M21 and the fifth reflector M22, the Galilean magnification system F2, and the second imaging objective lens L22, it reaches the second image collection device 22, and finally transmits the image information to the processor 60.

[0064] After that, eye tracking is performed through the eye tracking system. At this time, the first reflector M1, the focusing reflector FM1, and the fourth reflector M21 are not in the direction of the main optical axis. The display 23 displays a moving fixed cursor. The third light source S13 emits 850nm light, which is reflected by the cornea of ​​the human eye 70 and then passes through the eye-receiving objective lens L15 and the anterior segment lens L14 to enter the imaging component. After passing through the focusing lens F1, the first beam splitter BS2, and the first imaging objective lens L21, it reaches the first image collection device 21. The data obtained by the first image collection device 21 is processed by the processor 60 to identify the pupil and the cornea, and then the corneal reflection point data is used as the base point of the relative position of the eye camera and the eyeball. The gaze point in the screen space is calculated according to the coordinates of the pupil center position, and the relevant indicators of eye movement are given by the computer. The relevant indicators may include one or more of latency, rate, amplitude, position, duration and peak acceleration.

[0065] After that, pupil reflex is performed through the pupil reflex system, and the display 23 displays the flash stimulation. The 850nm light emitted by the third light source S13 is reflected by the cornea of ​​the human eye 70, passes through the eyepiece lens L15, the anterior segment lens L14, and reaches the imaging component. After passing through the focusing lens F1, the first beam splitter BS2, and the first imaging lens L21, it reaches the first image collection device 21. The data obtained by the first image collection device 21 is processed by the processor 60, so as to detect the position and size of the pupil, and record the change trend of the pupil size during the stimulation process.

[0066] Afterwards, the blood sugar content is detected by the blood sugar measurement system, and at this time, the focusing reflector FM1 is in the direction of the main optical axis. The fourth light source S3 emits 750nm light, which reaches the first scanning device after passing through the eighth transfer lens L31, and is reflected by the sixth reflector M3 to the fourth beam splitter BS3 after passing through the ninth transfer lens L32, and is incident on the focusing reflector FM1 after passing through the seventh reflector M4, and is focused on the conjunctival blood vessels of the human eye 70 through the focusing reflector FM1. The reflected light of the human eye 70 is collected by the focusing reflector FM1, and reaches the spectrometer SP1 after passing through the seventh reflector M4, the fourth beam splitter BS3, the third imaging objective lens L33 and the filter LP. The ratio of the spectral line peak corresponding to blood sugar and the spectral peak corresponding to hemoglobin in the Raman scattered light is compared and analyzed by a computer, and then the blood sugar value is determined based on the relationship between the ratio of the two spectral peaks and blood sugar obtained in advance.

[0067] Afterwards, multispectral fundus imaging is performed through the multispectral imaging system, and the first reflector M1, the focusing reflector FM1, the anterior segment mirror L14, and the fourth reflector M21 are removed at this time. A static fixation cursor is provided through the display 23. The first light source S12 emits light of different wavelengths in sequence, which reaches the eyepiece objective lens L15 after passing through the optical fiber FB, the first transfer lens L13, and the hollow reflector HM, and evenly illuminates the fundus through the eyepiece objective lens L15. The reflected light of the fundus reaches the imaging assembly after passing through the eyepiece objective lens L15 and the hollow reflector HM. After passing through the focusing lens F1, the first beam splitter BS2, and the first imaging objective lens L21, it reaches the first image collection device 21, and finally transmits the image information to the computer.

[0068] Afterwards, the blood oxygen content is measured by the blood oxygen content measurement system, and a static fixation cursor is provided by the display 23. The first light source S12 emits light of 570nm and 600nm wavelengths in turn, which reaches the eyepiece objective L15 after passing through the optical fiber FB, the first transfer lens L13 and the hollow reflector HM, and evenly illuminates the fundus through the eyepiece objective L15. The reflected light of the fundus passes through the eyepiece objective L15, the hollow reflector HM, and then reaches the imaging component. After passing through the focusing lens F1, the first beam splitter BS2 and the first imaging objective L21, it reaches the first image collection device 21, and the collected retinal dual-wavelength image is input into the computer for processing by the blood oxygen calculation system to calculate the blood oxygen saturation.

[0069] Finally, adaptive optical laser scanning imaging is performed through the optical laser scanning imaging system, and at this time, the first reflector M1 is in the direction of the main optical axis. The fifth light source S4 emits light with a wavelength of 785nm, which reaches the diopter adjustment system 50 through the second transfer lens L41, the second beam splitter BS41, the vertical scanning device SC41, the deformable mirror DM, the horizontal scanning device SC42 and the first reflector M1, and reaches the human eye 70 after passing through the first reflector M1 and the eyepiece lens L15. The reflected light returns to the optical laser scanning assembly 40 after passing through the eyepiece lens L15, the first reflector M1 and the diopter adjustment system 50. After passing through the second reflector M41, the horizontal scanning device SC42, the deformable mirror DM, the vertical scanning device SC41, the second beam splitter BS41, the third beam splitter BS42, the third transfer lens L42, the third reflector M42, the aperture A1, and the fourth transfer lens L43, it reaches the wavefront sensor SHWS, and the wavefront is sensed and transmitted to the computer, and then the deformable mirror DM is driven to change its surface shape to achieve wavefront aberration correction. Repeat the previous step, and the reflected light reaches the photomultiplier tube PMT after passing through the eyepiece objective lens L15, the first reflector M1, the refractive adjustment system 50, the second reflector M41, the horizontal scanning device SC42, the deformable mirror DM, the vertical scanning device SC41, the second beam splitter BS41, the third beam splitter BS42, the fourth imaging objective lens L44 and the pinhole PH, and finally transmits the image information to the computer.

[0070] All the above data are processed by the processor 60 and then transmitted to the wearable device, which can be a VR / AR display unit, specifically VR / AR glasses, which can be observed by the tester or patient in the form of augmented reality or virtual reality, thereby realizing visualization of the test results.

[0071] Obviously, the above described embodiments are only some embodiments of the utility model, not all embodiments. Based on the embodiments of the utility model, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the utility model.

[0072] It should be noted that the terms used herein are only for describing specific embodiments and are not intended to limit the exemplary embodiments according to the present application. As used herein, unless the context clearly indicates otherwise, the singular form is also intended to include the plural form. In addition, it should be understood that when the terms "comprise" and / or "include" are used in this specification, it indicates the presence of features, steps, operations, devices, components and / or combinations thereof.

[0073] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein.

[0074] The above description is only the preferred embodiment of the utility model, and is not intended to limit the utility model. For those skilled in the art, the utility model can have various modifications and changes. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the utility model shall be included in the protection scope of the utility model.

Claims

1. A multimodal analysis system, characterized in that: include: A user eye interface, an imaging component disposed on one side of the user eye interface, a light propagation component and a light source component located between the user eye interface and the imaging component; The light propagation component comprises: an eyepiece objective lens (L15) arranged from the user eye interface toward the main optical axis direction of the imaging component, a selectively arranged anterior segment lens (L14) and a selectively arranged fourth reflector (M21); The light source assembly comprises: a first light source (S12) located between the anterior segment lens (L14) and the imaging assembly, a second light source (S11) arranged offset from the main optical axis, and a third light source (S13) arranged at the periphery of the eyepiece objective lens (L15), wherein the second light source (S11) transmits second stimulation light through the user eye interface in a direction forming an angle with the main optical axis, and the second stimulation light is diffuse light; The imaging assembly comprises a first image collecting device (21) arranged on a side of the fourth reflector (M21) away from the user eye interface and a second image collecting device (22) arranged on a reflection path of the fourth reflector (M21); The fourth reflector (M21) includes a first configuration located on the main optical axis and a second configuration moved out of the main optical axis, wherein in the first configuration, the second image collecting device (22) is connected to the main optical axis via the fourth reflector (M21) and coupled with the second light source (S11) to receive the crystal reflected light of the user's eye in response to the second stimulus light; in the second configuration, the first image collecting device (21) is coupled with the first light source (S12) and the third light source (S13) to respectively receive the first eye signal of the user's eye in response to the first light source (S12) or the second eye signal of the user's eye in response to the third light source (S13); The third light source (S13) is configured to emit near-infrared light, the first light source (S12) is configured to emit light of different wavelengths to generate multi-spectral fundus stimulation light through the eyepiece objective (L15), and when the first light source (S12) is turned on, the anterior segment lens (L14) is not arranged on the main optical axis.

2. The multimodal analysis system according to claim 1, characterized in that: The light propagation component also includes a first beam splitter (BS2) arranged on the side of the fourth reflector (M21) close to the user eye interface and a first display (23) located in the reflection path of the first beam splitter (BS2), the first display being used to display a first fixation cursor in response to the first light source (S12) under the second configuration or to selectively display a moving second fixation cursor or light stimulation of different wavelengths in response to the third light source (S13), and the second eye signal including an eye tracking signal corresponding to the second fixation cursor or a pupil reflection signal corresponding to the light stimulation of different wavelengths.

3. The multimodal analysis system according to claim 1, characterized in that: The light propagation component also includes a hollow reflector (HM) arranged on the main optical axis, and the light of different wavelengths emitted by the first light source (S12) is reflected by the hollow reflector (HM) to the eyepiece objective lens (L15).

4. The multimodal analysis system according to claim 1, characterized in that: The first light source (S12) includes a plurality of LEDs emitting light in the range of 460nm to 900nm.

5. The multimodal analysis system according to claim 1, characterized in that: The light transmission component also includes: a focusing reflector (FM1) selectively arranged between the user eye interface and the eyepiece objective lens (L15); the multimodal analysis system also includes a blood glucose measurement component (30) arranged in the reflection path of the focusing reflector (FM1); the blood glucose measurement component (30) includes a fourth light source (S3) and a spectrometer (SP1) for collecting scattered light generated by eye blood vessels in response to stimulation by the fourth light source (S3) and generating a spectral signal.

6. The multimodal analysis system according to claim 5, characterized in that: The blood glucose measurement component (30) comprises a fourth beam splitter (BS3), the spectrometer (SP1) is located in the transmission path of the fourth beam splitter (BS3), the light emitted by the fourth light source (S3) is reflected by the fourth beam splitter (BS3) and then transmitted to the user eye interface via the focusing reflector (FM1), and the blood glucose measurement component (30) further comprises a first scanning device arranged between the fourth beam splitter (BS3) and the fourth light source (S3), the first scanning device comprising a first scanning galvanometer and a second scanning galvanometer which are rotatable in two directions perpendicular to each other.

7. The multimodal analysis system according to claim 2, characterized in that: The light propagation component also includes: a first reflector (M1) selectively arranged between the eyepiece objective lens (L15) and the anterior segment lens (L14); the multimodal analysis system also includes an optical laser scanning component (40) arranged in a reflection path of the first reflector (M1); the optical laser scanning component (40) includes a fifth light source (S4), a fourth image collecting device and a wavefront sensor (SHWS).

8. The multimodal analysis system according to claim 7, characterized in that: The multimodal analysis system further comprises a refractive adjustment system (50), wherein the refractive adjustment system (50) is located between the first reflector (M1) and the optical laser scanning assembly (40).

9. The multimodal analysis system according to claim 8, characterized in that: The optical laser scanning assembly (40) further comprises a second beam splitter (BS41) and a third beam splitter (BS42); the third beam splitter (BS42) is located in the transmission path of the second beam splitter (BS41); the fifth light source (S4) is located in the reflection path of the second beam splitter (BS41); the fourth image collecting device is located in the transmission path of the third beam splitter (BS42); and the wavefront sensor (SHWS) is located in the reflection path of the third beam splitter (BS42).

10. The multimodal analysis system according to claim 9, characterized in that: The optical laser scanning assembly (40) also includes a second scanning device located between the refractive adjustment system (50) and the second beam splitter (BS41), the second scanning device including a deformable mirror (DM), a vertical scanning device (SC41) and a horizontal scanning device (SC42), the deformable mirror (DM) being located between the vertical scanning device (SC41) and the horizontal scanning device (SC42).

11. A multifunctional portable eye detection device, characterized in that: A multimodal analysis system comprising any one of claims 1 to 4, wherein the light propagation component of the multimodal analysis system further comprises: a focusing reflector (FM1) selectively arranged between a user eye interface and an eyepiece objective lens (L15), a first reflector (M1) selectively arranged between the eyepiece objective lens (L15) and the anterior segment lens (L14), and the multifunctional portable eye detection device further comprises: a blood sugar measuring component (30) arranged in the reflection path of the focusing reflector (FM1) and an optical laser scanning component (40) arranged in the reflection path of the first reflector (M1), The blood sugar measurement component (30) comprises a fourth light source (S3) and a spectrometer (SP1) for collecting scattered light of eye blood vessels in response to stimulation by the fourth light source (S3) and generating a spectral signal, and the optical laser scanning component (40) comprises a fifth light source (S4), a fourth image collection device and a wavefront sensor (SHWS); The multifunctional portable eye detection device also includes a processor coupled to the first image collection device (21), the second image collection device (22), the spectrometer (SP1), the fourth image collection device and the wavefront sensor (SHWS).

12. The multifunctional portable eye detection device according to claim 11, characterized in that: The multifunctional portable eye detection device also includes a VR / AR display unit connected to the processor, and the user eye interface is integrated in the VR / AR display unit.

Images