Artificial-eye automatic adjustment method and artificial-eye optical system

Abstract

An artificial-eye automatic adjustment method and an artificial-eye optical system. The method comprises: acquiring an image to be tested and image information to be tested that corresponds to the image to be tested, wherein the image to be tested is an image obtained by means of an artificial-eye optical system collecting a display interface to be tested of a pair of smart glasses, and comprises a target object, and the image information to be tested comprises image event information and spectral information; inputting into a trained first model the image to be tested, so as to determine a motion sequence parameter; inputting into a trained second model the image to be tested and the image information to be tested, so as to determine a focusing parameter; and on the basis of the motion sequence parameter and the focusing parameter, performing automatic adjustment on the artificial-eye optical system.

Description

Artificial eye automatic adjustment method and artificial eye optical system

[0001] Related applications

[0002] The present application claims priority from Chinese Patent Application No. 202410472068.3, filed on April 18, 2024, and entitled "Artificial eye automatic adjustment method and artificial eye system" and Chinese Patent Application No. 202410468610.8, filed on April 18, 2024, and entitled "Artificial eye optical system", the contents of which are incorporated herein by reference in their entirety. TECHNICAL FIELD

[0003] The present application relates to the technical field of bionic eye, and in particular to an artificial eye automatic adjustment method and an artificial eye optical system. BACKGROUND

[0004] With the development of extended reality (XR) glasses technology, higher requirements are put forward for the reliability of the spatial display quality of the XR glasses; comprehensive and efficient detection of the display quality of the XR glasses is crucial for improving the reliability of the XR glasses and improving the user experience.

[0005] In related technologies, during the manufacturing process of the XR glasses, a display detection camera is usually used to monitor the display quality of the XR glasses to ensure the reliability of the display quality thereof; however, in actual applications, the display detection camera is simply placed behind the XR glasses, and after focusing is achieved through manual adjustment of the focal length, the detection work of the display quality of the XR glasses can be carried out; it can be seen that in the related technologies, due to the long time and low efficiency of manual focusing during the detection process, the efficient detection of the display quality of the XR glasses cannot be ensured.

[0006] At present, there is no effective solution to the problem of low detection efficiency of the display detection camera caused by the need for manual adjustment of the focal length in related technologies. SUMMARY

[0007] Therefore, it is necessary to provide an artificial eye automatic adjustment method and an artificial eye optical system to solve the above technical problems.

[0008] In a first aspect, the present application provides an artificial eye automatic adjustment method, the method comprising: acquiring a to-be-tested image and to-be-tested image information corresponding to the to-be-tested image; the to-be-tested image is an image obtained by collecting a to-be-tested display interface of smart glasses through an artificial eye optical system, and the to-be-tested image comprises a target object; the to-be-tested image information comprises image event information and spectral information; inputting the to-be-tested image into a trained first model to determine a motion sequence parameter corresponding to the artificial eye optical system gazing at the target object; inputting the to-be-tested image and the to-be-tested image information into a trained second model to determine a focusing parameter corresponding to the artificial eye optical system gazing at the target object; and automatically adjusting the artificial eye optical system according to the motion sequence parameter and the focusing parameter.

[0009] In a second aspect, the present application further provides an artificial eye optical system, the system comprising a visual processing component, two artificial eye camera components, and a servo control component corresponding to each of the artificial eye camera components; the artificial eye camera components are electrically connected to the visual processing component, and are configured to collect a to-be-tested image and to-be-tested image information corresponding to the to-be-tested image, and transmit the to-be-tested image and the to-be-tested image information to the visual processing component; the to-be-tested image is an image obtained by collecting a to-be-tested display interface of smart glasses, and the to-be-tested image comprises a target object; the to-be-tested image information comprises image event information and spectral information; the visual processing component is electrically connected to the servo control component, and is configured to execute the artificial eye automatic adjustment method described in any one of the embodiments of the first aspect, and transmit a motion sequence parameter corresponding to the artificial eye optical system gazing at the target object to the servo control component, and transmit a focusing parameter corresponding to the artificial eye optical system gazing at the target object to the artificial eye camera component; the artificial eye camera component is arranged on the corresponding servo control component, and the servo control component is configured to control a motion trajectory of the artificial eye camera component according to the motion sequence parameter; and the artificial eye camera component is further configured to perform automatic focusing processing according to the focusing parameter.

[0010] The details of one or more embodiments of the application are set forth in the accompanying drawings and the description below. Other features, objects, and advantages of the application will be apparent from the description, drawings, and claims. BRIEF DESCRIPTION OF DRAWINGS

[0011] To better describe and illustrate embodiments and / or examples of the inventions disclosed herein, reference can be made to one or more drawings. Additional details or examples used to describe the drawings should not be considered limiting to the scope of any of the disclosed inventions, the presently described embodiments and / or examples, and the best mode presently contemplated of these inventions.

[0012] FIG. 1 is a flowchart of an artificial eye automatic adjustment method in one embodiment.

[0013] FIG. 2 is a structural schematic diagram of an artificial eye optical system in an embodiment.

[0014] FIG. 3 is a block schematic diagram of an artificial eye optical system in an embodiment.

[0015] FIG. 4 is a structural schematic diagram of an artificial eye optical system in an embodiment.

[0016] FIG. 5 is a structural schematic diagram of an artificial eye optical system in a first specific embodiment.

[0017] FIG. 6 is a light path schematic diagram of an artificial eye optical system in the first specific embodiment.

[0018] FIGS. 7A-7B are MTF curve diagrams and field curvature distortion curve diagrams of the artificial eye optical system in the first specific embodiment at diopter 4D.

[0019] FIGS. 8A-8B are MTF curve diagrams and field curvature distortion curve diagrams of the artificial eye optical system in the first specific embodiment at diopter 3D.

[0020] FIGS. 9A-9B are MTF curve diagrams and field curvature distortion curve diagrams of the artificial eye optical system in the first specific embodiment at diopter 2D.

[0021] FIGS. 10A-10B are MTF curve diagrams and field curvature distortion curve diagrams of the artificial eye optical system in the first specific embodiment at diopter 1D.

[0022] FIGS. 11A-11B are MTF curve diagrams and field curvature distortion curve diagrams of the artificial eye optical system in the first specific embodiment at diopter 0D.

[0023] FIG. 12 is a structural schematic diagram of an artificial eye optical system in a second specific embodiment.

[0024] FIG. 13 is a light path schematic diagram of an artificial eye optical system in the second specific embodiment.

[0025] FIGS. 14A-14B are MTF curve diagrams and field curvature distortion curve diagrams of the artificial eye optical system in the second specific embodiment at diopter 6D.

[0026] FIGS. 15A-15B are MTF curve diagrams and field curvature distortion curve diagrams of the artificial eye optical system in the second specific embodiment at diopter 5D.

[0027] FIGS. 16A-16B are MTF curve diagrams and field curvature distortion curve diagrams of the artificial eye optical system in the second specific embodiment at diopter 3D.

[0028] FIGS. 17A-17B are MTF curve diagrams and field curvature distortion curve diagrams of the artificial eye optical system in the second specific embodiment at diopter 1D.

[0029] Figures 18A-18B are MTF curves and field curvature distortion curves of the artificial eye optical system at diopter 0D in a second embodiment.

[0030] Figure 19 is a schematic diagram of the structure of an artificial eye optical system in an embodiment.

[0031] Legend: 100, visual processing component; 200, artificial eye camera component; 300, servo control component; 1, optical acquisition component; 10, corneal mirror group; 20, aperture stop; 30, conventional mirror group; 31, first mirror group; 32, second mirror group; 33, third mirror group; 34, focusing mirror group; 35, light splitting mirror group; 11, first lens; 311, second lens; 312, third lens; 313, fourth lens; 321, fifth lens; 322, sixth lens; 323, seventh lens; 331, eighth lens; 341, liquid lens; 351, light splitting prism; 60, field stop; 2, signal sensing component; 40, image event perception sensor; 401, protective glass; 50, spectrometer; 70, fiber coupling-in interface; 80, optical fiber; 90, converging mirror group; 3, housing; 410, vertical rotation structure; 420, horizontal rotation structure; 510, interpupillary distance adjustment structure; 520, height adjustment structure; 530, view point adjustment structure; 600, analog head shape support component. DETAILED DESCRIPTION

[0032] In order to make the purposes, technical solutions and advantages of the present application clearer, the present application is further described in detail below in combination with the drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and do not limit the present application.

[0033] Unless otherwise defined, technical terms and scientific terms used in the present application shall have the same meaning as those commonly understood by a person of ordinary skill in the art to which the present application belongs. The terms "one", "a", "an", "the", "these", and similar terms in the present application do not mean "only one" or "exactly one", but "one or more" or "at least one". The terms "include", "contain", "have", and any variant thereof in the present application are intended to cover the non-exclusive inclusion; for example, a process, method, system, product or device containing a series of steps or modules (units) is not limited to the listed steps or modules (units), but can include steps or modules (units) not listed, or can include other steps or modules (units) inherent to the process, method, product or device. The terms "connect", "connect", "couple" and the like in the present application are not limited to physical or mechanical connection, but can include electrical connection, whether direct or indirect. The term "multiple" in the present application means two or more. The term "and / or" describes the association between the associated objects, which means that there can be three relationships, for example, "A and / or B" can mean that A exists alone, A and B exist together, and B exists alone. Generally, the character " / " represents the relationship between the front and rear associated objects as "or". The terms "first", "second", "third" and the like in the present application are only used to distinguish similar objects, and do not represent a specific order for the objects.

[0034] In one embodiment, as shown in FIG. 1, FIG. 1 is a flowchart of an artificial eye automatic adjustment method in one embodiment; the artificial eye automatic adjustment method comprises steps P1, P2, P3 and P4.

[0035] Step P1, obtaining a to-be-tested image and to-be-tested image information corresponding to the to-be-tested image.

[0036] The to-be-tested image is an image obtained by collecting a to-be-tested display interface of smart glasses through an artificial eye optical system, and includes a target object; the to-be-tested image information includes image event information and spectral information.

[0037] The intelligent glasses can be, but are not limited to, virtual reality glasses, augmented reality glasses, and mixed reality glasses, and are not specifically limited herein. The image information to be measured includes image event information and spectrum information. The image event information includes image data and event information. The image data refers to original data obtained by collecting the image to be measured, such as pixel value, resolution, and color information of the image to be measured. The event information refers to information related to changes in the scene of the image to be measured, for example, the light intensity of a pixel is detected by an event sensor, and when the light intensity of the pixel changes, corresponding event information is generated to record the coordinates, timestamp, and change polarity of the pixel corresponding to the changed pixel. The spectrum information at least includes brightness information, chrominance information, and illumination information, and is used to represent color feature information of the image to be measured. The target object can be any fixation area or fixation point in the image to be measured, and is not specifically limited herein.

[0038] In step P2, the image to be measured is input into the trained first model to determine the motion sequence parameters of the artificial eye optical system for fixing the target object.

[0039] The first model can be, but is not limited to, a convolutional neural network model based on a convolutional neural network structure or a recurrent neural network model based on a recurrent neural network structure, and is not specifically limited herein. The motion sequence parameters at least include a rotation angle, a rotation speed, and a rotation acceleration. The rotation angle refers to a horizontal rotation angle and a vertical rotation angle required for the artificial eye optical system to fix the target object in a three-dimensional space. The rotation speed refers to a horizontal rotation speed and a vertical rotation speed required for the artificial eye optical system to fix the target object in a three-dimensional space. The rotation acceleration refers to a horizontal rotation acceleration required for the artificial eye optical system to fix the target object in a three-dimensional space and a vertical rotation acceleration required for the artificial eye optical system to fix the target object in a three-dimensional space. Optionally, the motion sequence parameters further include a horizontal displacement parameter and a vertical displacement parameter. The horizontal displacement parameter includes a left-right displacement parameter and a front-back displacement parameter. The left-right displacement parameter is used to control the artificial eye optical system to simulate different pupil distances of the human eye. The front-back displacement parameter is used to adjust the relative distance between the artificial eye optical system and the intelligent glasses. The vertical displacement parameter is used to adjust the relative height between the artificial eye optical system and the intelligent glasses.

[0040] An example is based on the real eye movement trajectory data set, the prior parameters of human eye are determined; wherein, the prior parameters of human eye include human eye rotation prior parameters and human eye gaze prior parameters; the human eye rotation prior parameters at least include gaze rotation angle, gaze rotation acceleration and gaze rotation speed; the human eye gaze prior parameters at least include gaze probability parameters, gaze time parameters, gaze angle parameters and gaze direction parameters. Further, based on the artificial eye optical system, the display interface of the intelligent glasses is collected to obtain a large number of sample images; wherein, the sample images include preset objects; the preset objects are any gaze area or gaze point in the sample image; based on the sample image, the sample image feature information corresponding to the sample image is determined; based on the prior parameters of human eye and the sample image feature information, the first data set corresponding to the first model is constructed; based on the first data set, the first model is trained to establish the mapping relationship between the sample image feature information and the prior parameters of human eye and the motion sequence parameters; based on this, the to-be-tested image is input into the trained first model, and the motion sequence parameters corresponding to the artificial eye optical system gaze target object are obtained.

[0041] Step P3, the to-be-tested image and the to-be-tested image information are input into the trained second model to determine the focusing parameter corresponding to the artificial eye optical system gaze target object.

[0042] Wherein, the second model can be but is not limited to a convolutional neural network model constructed based on a convolutional neural network structure, or a recurrent neural network model constructed based on a recurrent neural network structure, which is not limited here. The focusing parameter is an electric control parameter, which is used to realize the automatic focusing of the artificial eye optical system.

[0043] An example is based on the sample image and the sample image information corresponding to the sample image, the second data set corresponding to the second model is constructed, wherein the sample image includes preset objects; based on the second data set, the second model is trained to establish the mapping relationship between the sample image information and the focusing parameter corresponding to the artificial eye optical system gaze preset object; based on this, the to-be-tested image and the to-be-tested image information are input into the trained second model, and the focusing parameter corresponding to the artificial eye optical system gaze target object is obtained.

[0044] Step P4, according to the motion sequence parameters and the focusing parameter, the artificial eye optical system is automatically adjusted.

[0045] Specifically, according to the motion sequence parameters, the motion trajectory of the artificial eye optical system is controlled to enable the artificial eye optical system to simulate human eye movement to gaze at the target object; according to the focusing parameter, the artificial eye optical system is automatically focused to enable the artificial eye optical system to simulate human eye automatic focusing.

[0046] In this embodiment, based on the trained first model and the second model, the motion sequence parameters and the focusing parameters required for the artificial eye optical system to fixate on the target object can be accurately and efficiently determined according to the to-be-tested image and the to-be-tested image information corresponding to the to-be-tested image, and then the motion sequence parameters and the focusing parameters can be used to accurately control the artificial eye optical system to simulate the human eye movement and automatic focusing. Therefore, the display quality of the intelligent glasses can be accurately and efficiently detected, and the efficiency of the artificial eye optical system detection is effectively improved.

[0047] In one embodiment, the step P2 of inputting the to-be-tested image into the trained first model to determine the motion sequence parameters of the artificial eye optical system to fixate on the target object includes a step P21 and a step P22.

[0048] The step P21 is to perform feature extraction on the to-be-tested image to obtain image feature information corresponding to the to-be-tested image.

[0049] The image feature information includes salient region feature information and text feature information. The salient region feature information refers to the feature information contained in the region with the most salience and importance in the to-be-tested image. The salient region refers to the region attracting the attention of the human eye in the to-be-tested image. The text feature information refers to the feature information possessed by the text content contained in the to-be-tested image.

[0050] It should be noted that the feature extraction on the to-be-tested image can be achieved by using any method capable of extracting image feature information from the to-be-tested image, which is not limited here.

[0051] The step P22 is to input the image feature information into the trained first model to determine the motion sequence parameters of the artificial eye optical system to fixate on the target object.

[0052] In one embodiment, the first model includes a feature fusion mapping model and a motion sequence parameter regression mapping model.

[0053] Further, the step P22 of inputting the image feature information into the trained first model to determine the motion sequence parameters of the artificial eye optical system to fixate on the target object includes a step P221 and a step P222.

[0054] The step P221 is to input the image feature information into the trained feature fusion mapping model to determine the motion feature parameters of the artificial eye optical system to fixate on the target object.

[0055] The motion characteristic parameters include a tremor parameter, a jump parameter, a gaze probability parameter, and a gaze cycle parameter; the motion characteristic parameters are used to represent the motion law of the artificial eye optical system simulating the human eye to gaze at a target object; the tremor parameter refers to a small motion characteristic parameter generated when the artificial eye optical system simulates the human eye to gaze at a target object; the jump parameter refers to a motion characteristic parameter when the artificial eye optical system simulates the human eye to quickly move from one target object to another target object; the gaze probability parameter refers to a probability index of the artificial eye optical system simulating the human eye to gaze at a target object; and the gaze cycle parameter refers to a complete cycle of the artificial eye optical system simulating the human eye to gaze at one target object and then move to the next target object.

[0056] In step P222, the motion characteristic parameters are input into the trained motion sequence parameter regression mapping model to determine the motion sequence parameters corresponding to the artificial eye optical system gazing at a target object.

[0057] The motion sequence parameters at least include a rotation angle, a rotation speed, and a rotation acceleration; optionally, the motion sequence parameters further include a horizontal displacement parameter and a vertical displacement parameter; the horizontal displacement parameter includes a left-right displacement parameter and a front-back displacement parameter; based on the motion sequence parameters, the artificial eye optical system can be controlled to simulate the human eye to perform corresponding motion and simulate the human eye to automatically adjust the relative position with the intelligent glasses according to the motion sequence parameters.

[0058] Specifically, feature extraction is performed on the to-be-tested image to obtain image feature information corresponding to the to-be-tested image; the image feature information at least includes salient region feature information and text feature information; further, the image feature information is input into the trained feature fusion mapping model to determine the motion characteristic parameters required by the artificial eye optical system to simulate the human eye to gaze at a target object; further, the motion characteristic parameters are input into the trained motion sequence parameter regression mapping model to determine the motion sequence parameters corresponding to the artificial eye optical system gazing at a target object; and then the artificial eye optical system is controlled to simulate the human eye motion to gaze at a target object based on the motion sequence parameters.

[0059] It should be noted that the trained feature fusion mapping model can learn the mapping relationship between the image feature information and the motion characteristic parameters; and the trained motion sequence parameter regression mapping model can learn the mapping relationship between the motion characteristic parameters and the motion sequence parameters. For example, to simulate the human eye to read text, the feature fusion mapping model and the motion sequence parameter regression mapping model are trained based on the OVP theory (optimal visual position theory) and the jump effect, so that the trained feature fusion mapping model and the motion sequence parameter regression mapping model can determine the motion sequence parameters corresponding to the artificial eye optical system simulating the human eye to read text, and control the motion trajectory of the artificial eye optical system to realize the simulation of the human eye reading text.

[0060] It should be noted that the feature fusion mapping model can be but is not limited to a convolutional neural network model constructed based on a convolutional neural network structure, or a recurrent neural network model constructed based on a recurrent neural network structure, which is not specifically limited here; the motion sequence parameter regression mapping model can be but is not limited to a convolutional neural network model constructed based on a convolutional neural network structure, or a recurrent neural network model constructed based on a recurrent neural network structure, which is not specifically limited here.

[0061] In this embodiment, based on the trained feature fusion mapping model and the motion sequence parameter regression mapping model, the motion sequence parameters required by the artificial eye optical system to simulate the human eye's fixation on the target object can be accurately obtained, and then based on the motion sequence parameters, the motion trajectory of the artificial eye optical system can be precisely controlled to simulate the human eye movement. Based on this, multi-dimensional and comprehensive detection of the display quality of the intelligent glasses can be realized, and the applicability of the artificial eye optical system is further improved.

[0062] In one embodiment, before the step P2 "inputting the to-be-tested image into the trained first model to determine the motion sequence parameters corresponding to the fixation of the artificial eye optical system on the target object", steps P201, P202, P203 and P204 are further included.

[0063] Step P201, acquiring a sample image.

[0064] The sample image is an image obtained by collecting the to-be-tested display interface of the intelligent glasses by the artificial eye optical system, and includes a preset object; the preset object is an arbitrary fixation area or fixation point in the sample image.

[0065] Step P202, performing feature extraction on the sample image to obtain sample image feature information corresponding to the sample image.

[0066] The sample image feature information includes salient region feature information and text feature information; the salient region feature information refers to the feature information contained in the most salient and important region in the sample image; the salient region refers to a region in the sample image that attracts the attention of the human eye; and the text feature information refers to the feature information possessed by the text content contained in the sample image.

[0067] Step P203, acquiring human eye prior parameters.

[0068] The human eye prior parameters include human eye rotation prior parameters and human eye fixation prior parameters; the human eye rotation prior parameters at least include a fixation rotation angle, a fixation rotation acceleration and a fixation rotation speed; and the human eye fixation prior parameters at least include a fixation probability parameter, a fixation time parameter, a fixation angle parameter and a fixation direction parameter. It should be noted that the human eye prior parameters can be but are not limited to obtained from a real eye movement trajectory data set.

[0069] Step P204, training the first model according to the sample image feature information and the human eye prior parameter, to obtain a trained first model.

[0070] The trained first model is used to establish a mapping relationship between the sample image feature information and the human eye prior parameter and the motion sequence parameter.

[0071] For example, a display interface of the intelligent glasses is collected based on the artificial eye optical system to obtain a large number of sample images; sample image feature information corresponding to the sample images is determined based on the sample images; human eye prior parameters are obtained based on a real eye movement trajectory dataset; further, a first dataset corresponding to the first model is constructed based on the human eye prior parameters and the sample image feature information; the first model is trained based on the first dataset to establish a mapping relationship between the sample image feature information and the human eye prior parameter and a motion sequence parameter corresponding to the artificial eye optical system gazing at a preset object; based on this, the to-be-tested image is input into the trained first model, and the motion sequence parameter corresponding to the artificial eye optical system gazing at the target object is obtained.

[0072] In this embodiment, the first model is trained based on the sample image feature information and the human eye prior parameter to obtain a trained first model, and a mapping relationship between the sample image feature information and the human eye prior parameter and a motion sequence parameter corresponding to the artificial eye optical system gazing at a preset object is successfully established, which lays a foundation for improving the accuracy of the motion sequence parameter required by the artificial eye optical system to simulate the human eye gazing at a target object.

[0073] In one embodiment, the second model includes a perception decision model and a definition change prediction model; and step P3 of inputting the to-be-tested image and to-be-tested image information into the trained second model to determine a focusing parameter corresponding to the artificial eye optical system gazing at the target object includes step P31 and step P32.

[0074] Step P31, inputting the to-be-tested image, image event information and spectral information into the trained perception decision model to determine target feature information of the target object.

[0075] The target feature information includes positioning information, size information and definition information; the positioning information refers to specific position coordinates of the target object in the to-be-tested image; the size information refers to length, width or height information of the target object in the to-be-tested image; and the definition information is used to represent the definition degree of the artificial eye optical system when gazing at the target object.

[0076] Step P32, inputting the target feature information into the trained definition change prediction model to determine a focusing parameter corresponding to the artificial eye optical system gazing at the target object.

[0077] Specifically, the to-be-tested image, the image event information, and the spectral information are input into the trained perception decision model to determine target feature information of the target object, i.e., positioning information, size information, and definition information; and then, based on the target feature information, the target feature information is input into the trained definition change prediction model to determine a focusing parameter corresponding to the target object when the artificial eye optical system simulates the human eye to gaze at the target object, so that the artificial eye optical system can quickly perform automatic focusing when simulating the human eye to gaze at the target object. It should be noted that the trained perception decision model can learn the mapping relationship between the to-be-tested image, the image event information, and the spectral information and the target feature information of the target object; and the trained definition change prediction model can learn the mapping relationship between the target feature information and the focusing parameter.

[0078] It should be noted that the perception decision model can be, but is not limited to, a convolutional neural network model constructed based on a convolutional neural network structure, or a recurrent neural network model constructed based on a recurrent neural network structure, which is not specifically limited here; and the definition change prediction model can be, but is not limited to, a convolutional neural network model constructed based on a convolutional neural network structure, or a recurrent neural network model constructed based on a recurrent neural network structure, which is not specifically limited here. For example, the perception decision model can be composed of multiple perception decision structures to form an input layer, a hidden layer, and an output layer to achieve accurate prediction of results and output of parameters; each perception decision structure is composed of an input, a weight, a bias, and an output function; the number of inputs is at least two, and each input corresponds to a weight; the number of biases is at least one; and the output function can be, but is not limited to, a linear function or a nonlinear function.

[0079] In this embodiment, based on the trained perception decision model and the definition change prediction model, the focusing parameter corresponding to the target object when the artificial eye optical system simulates the human eye to gaze at the target object can be accurately determined, and then the artificial eye optical system can simulate the human eye to quickly and efficiently perform automatic focusing when gazing at the target object, thereby reducing the focusing time of the artificial eye optical system and improving the detection efficiency of the artificial eye optical system.

[0080] In one embodiment, the step P4 of automatically adjusting the artificial eye optical system according to the motion sequence parameter and the focusing parameter includes a step P41 and a step P42.

[0081] The step P41 controls the motion trajectory of the artificial eye optical system according to the motion sequence parameter.

[0082] The step P42 performs automatic focusing processing on the artificial eye optical system according to the focusing parameter.

[0083] The motion sequence parameters at least include a rotation angle, a rotation speed and a rotation acceleration. Optionally, the motion sequence parameters further include a horizontal displacement parameter and a vertical displacement parameter. The horizontal displacement parameter includes a left-right displacement parameter and a front-back displacement parameter.

[0084] Specifically, according to the motion sequence parameters, the relative position of the artificial eye optical system and the smart glasses and the rotation trajectory of the artificial eye optical system when simulating the fixation of the target object by the human eye can be automatically adjusted, so that the artificial eye optical system can simulate the human eye movement to fix the target object. According to the focusing parameter, the artificial eye optical system can be controlled to quickly and automatically focus when fixing the target object.

[0085] In this embodiment, based on the motion sequence parameters and the adjustment parameters, the motion trajectory of the artificial eye optical system can be accurately and quickly adjusted and the automatic focusing can be realized, so that the artificial eye optical system can completely simulate the fixation of the target object by the human eye, and then the multi-dimensional comprehensive detection of the smart glasses can be realized based on the artificial eye optical system, further improving the applicability of the artificial eye optical system.

[0086] In one embodiment, as shown in FIG. 2, FIG. 2 is a structural schematic diagram of an artificial eye optical system in one embodiment. The artificial eye optical system includes a visual processing component 100, two artificial eye camera components 200 and a servo control component 300 corresponding to the artificial eye camera component 200; the artificial eye camera component 200 is electrically connected with the visual processing component 100, used for collecting a to-be-detected image and to-be-detected image information corresponding to the to-be-detected image, and transmitting the to-be-detected image and the to-be-detected image information to the visual processing component 100; the to-be-detected image is an image collected by detecting a display interface of the smart glasses, containing a target object; the to-be-detected image information includes image event information and spectrum information; the visual processing component 100 is electrically connected with the servo control component 300, used for executing the artificial eye automatic adjustment method in any of the above embodiments, and transmitting motion sequence parameters corresponding to the fixation of the target object by the artificial eye optical system to the servo control component 300, and transmitting focusing parameters corresponding to the fixation of the target object by the artificial eye optical system to the artificial eye camera component 200; the artificial eye camera component 200 is arranged on the corresponding servo control component 300, and the servo control component 300 is used for controlling the motion trajectory of the artificial eye camera component 200 according to the motion sequence parameters; the artificial eye camera component 200 is further used for automatically focusing according to the focusing parameters.

[0087] The intelligent glasses can be, but are not limited to, virtual reality glasses, augmented reality glasses, and mixed reality glasses, and are not limited herein. The image information to be measured includes image event information and spectrum information. The image event information includes image data and event information. The image data refers to original data obtained by collecting the image to be measured, such as pixel value, resolution, and color information of the image to be measured. The event information refers to related information of scene changes of the image to be measured. The spectrum information at least includes brightness information, chrominance information, and illumination information, and is used to represent color feature information of the image to be measured. The target object can be any gaze region or gaze point in the image to be measured, and is not limited herein.

[0088] It should be noted that the artificial eye optical system adopts two artificial eye camera assemblies 200 to simulate the structure of a real human eye. The servo control assembly 300 is arranged in one-to-one correspondence with the artificial eye camera assembly 200, and can independently or cooperatively control the artificial eye camera assembly 200 to simulate the movement of the human eye according to the motion sequence parameters.

[0089] It should be noted that the vision processing assembly 100 needs to be based on a computing chip with strong computing power to realize data processing and analysis. The computing chip can be, but is not limited to, an FPGA, a CPU, and a GPU.

[0090] In this embodiment, based on the two artificial eye camera assemblies 200, the physiological structure of the human eye can be simulated, the image to be measured and the corresponding image information of the image to be measured can be accurately collected, and the human eye can be simulated to realize rapid automatic focusing, thereby laying a foundation for improving the accuracy and efficiency of the detection results of the artificial eye optical system. Based on the vision processing assembly 100, the motion sequence parameters and focusing parameters corresponding to the target object of the artificial eye optical system can be accurately calculated according to the image to be measured and the corresponding image information of the image to be measured, thereby laying a data foundation for simulating the movement and automatic focusing of the human eye of the artificial eye optical system. Based on the servo control assembly 300 arranged in one-to-one correspondence with the artificial eye camera assembly 200, the artificial eye camera assembly 200 can be accurately controlled to simulate the movement of the human eye according to the motion sequence parameters.

[0091] In one embodiment, as shown in FIG. 3, the artificial eye camera assembly 200 of the artificial eye optical system includes an optical collection assembly 1 and a signal sensing assembly 2. The signal sensing assembly 2 is arranged on the optical path formed by the optical collection assembly 1, and is used to receive the light transmitted by the optical collection assembly 1 to obtain the image to be measured and the corresponding image information of the image to be measured.

[0092] In one embodiment, as shown in FIG. 3, the optical collection assembly 1 comprises, in order from the object side to the image side, a cornea lens group 10, an aperture stop 20, and a conventional lens group 30; external light propagates through the optical collection assembly 1 to the signal sensing assembly 2. The cornea lens group 10 has a negative focal power. The conventional lens group 30 comprises a first lens group, a second lens group, a third lens group, a focus-adjustable lens group, and a light-splitting lens group. The first lens group, the second lens group, and the third lens group each has a positive focal power. The first lens group comprises a second lens, a third lens, and a fourth lens; the second lens group comprises a fifth lens, a sixth lens, and a seventh lens; the fifth lens and the sixth lens constitute a cemented lens group; the third lens group comprises an eighth lens; the focus-adjustable lens group comprises a liquid lens for adjusting the focal power; and the light-splitting lens group comprises a light-splitting prism for light-splitting processing of incident light.

[0093] The signal sensing assembly 2 is disposed on the optical path formed by the optical collection assembly 1, and is configured to receive the light transmitted by the optical collection assembly 1. The signal sensing assembly 2 is configured to obtain a to-be-detected image and to-be-detected image information corresponding to the to-be-detected image.

[0094] The cornea lens group 10 is composed of a single aspherical lens, and is configured to simulate the cornea structure of a human eye. The cornea lens group 10 has a radius of curvature consistent with that of the cornea of a human eye, and is coated with an anti-infrared film system. The aperture stop 20 comprises a light-transmitting portion and a light-blocking portion. The light-transmitting portion is configured to simulate a pupil, and the light-blocking portion is configured to simulate an iris. Optionally, the light-blocking portion is provided with a semi-reflective matte finish to simulate the color of a human eye, such as black, gray, brown, or blue. It can be understood that, by selecting a cornea lens group 10 with different curvatures and an aperture stop 20 with different textures and colors, different types of human eyes, such as those of an old person, a child, or a patient, can be simulated. By selecting an aperture stop 20 with different sizes, the physiological functions of a human eye when the pupil changes in the range of 2-8 mm under different external light can be simulated. It should be noted that, when external light enters the artificial eye optical system, the light first passes through the cornea lens group 10 and the aperture stop 20, and then propagates to the conventional lens group 30, thereby realizing the front positioning of the aperture stop 20, which is conducive to simulating the construction sequence and physical parameters of the cornea and pupil of a human eye.

[0095] The conventional mirror group 30 includes a first mirror group, a second mirror group, a third mirror group, a focusing mirror group, and a light splitting mirror group. It should be noted that the setting order of the first mirror group, the second mirror group, the third mirror group, the focusing mirror group, and the light splitting mirror group can be set according to actual practical needs, and is not specifically limited here. The first mirror group, the second mirror group, and the third mirror group all have positive focal power. The first mirror group includes a second lens, a third lens, and a fourth lens. The second mirror group includes a fifth lens, a sixth lens, and a seventh lens. The fifth lens and the sixth lens constitute a cemented lens group. The fifth lens and the sixth lens are cemented in order from the object side to the image side. The third mirror group includes an eighth lens. It should be noted that the setting order of the second lens, the third lens, and the fourth lens can be set according to actual practical needs, and is not specifically limited here. The setting order of the fifth lens, the sixth lens, and the seventh lens can be set according to actual practical needs, and is not specifically limited here.

[0096] The focusing mirror group includes a liquid lens. The liquid lens has two kinds of electronic liquid, which are liquid with positive charge and liquid with negative charge. By controlling the direction and intensity of the electric field, automatic focusing in the range of 0-4D diopter (i.e. the working distance corresponds to Infinity-250mm) can be achieved, so that the resolution of the entire artificial eye optical system remains matched with the 20 / 20 human visual acuity.

[0097] The light splitting mirror group includes a light splitting prism for splitting the incident light to form first split light and second split light. Optionally, the light splitting mirror group can also include a half-mirror, a beam splitter, which is not specifically limited here. It should be noted that the first split light is transmitted to the signal sensing assembly 2 and can be used to perceive static images and motion events within the field of view. The second split light is transmitted to the signal sensing assembly 2 and can be used to measure the brightness and chrominance of the scene within the field of view.

[0098] The signal sensing assembly 2 is arranged on the optical path formed by the optical acquisition assembly 1 and is used to receive the light transmitted by the optical acquisition assembly 1, including the first split light and the second split light. Based on the first split light and the second split light, the signal sensing assembly 2 can simultaneously perceive static images and motion events within the field of view, and measure the brightness and chrominance of the scene.

[0099] Referring to FIG. 4, it should be noted that the artificial eye optical system also includes a housing 3. The housing 3 is used to support the entire artificial eye optical system. The front hemispherical diameter of the housing 3 is consistent with the diameter of the human sclera, and its surface is coated with an anti-infrared film system. When external light enters, the corneal mirror group 10 and the front hemispherical end of the housing 3 can simulate the motion trajectory of the human eye gazing at a target object under the control of the servo control assembly 300, thereby realizing the detection of corresponding eye movement tracking functions of the intelligent glasses.

[0100] In this embodiment, based on the corneal lens group 10, the aperture diaphragm 20 and the conventional lens group 30 arranged in order from the object side to the image side, the structure sequence and physical parameters of the human eye cornea and pupil can be simulated; based on the focusing lens group, automatic focusing in the range of 0-4D diopter can be realized, so that the resolution of the whole artificial eye optical system remains matched with the 20 / 20 human visual acuity; based on the light splitting lens group, the incident light can be split to form the first split light and the second split light; based on the first split light and the second split light, the signal sensing assembly 2 can simultaneously realize the perception of static images and motion events and the measurement of scene brightness and chroma in the field of view; based on this, the artificial eye optical system can be used to realize objective and comprehensive measurement of the display quality of the XR device.

[0101] In one embodiment, the corneal lens group comprises a first lens; the first lens has negative focal power, and the object side surface of the first lens is convex and the image side surface is concave.

[0102] In one embodiment, the first lens is a non-spherical lens structure with negative focal power, and the object side surface of the first lens is convex and the image side surface is concave; optionally, the focal length of the first lens is in the range of -10mm to -15mm; based on this, the corneal structure of different types of human eyes can be simulated.

[0103] In one embodiment, referring to FIG. 4, the signal sensing assembly 2 comprises an image event perception sensor 40 and a spectrometer 50.

[0104] After the external light passes through the optical acquisition assembly 1, the first split light and the second split light are formed.

[0105] The image event perception sensor 40 is arranged on the light path of the first split light and is used to receive the first split light; so as to obtain the to-be-measured image and the image event information corresponding to the to-be-measured image.

[0106] The spectrometer 50 is arranged on the light path of the second split light and is used to receive the second split light; so as to obtain the spectrum information corresponding to the to-be-measured image.

[0107] The image event perception sensor 40 is used to receive the first split light and realize the perception of static images and motion events in the field of view according to the first split light; the spectrometer 50 is used to receive the second split light and realize the measurement of scene brightness and chroma in the field of view according to the second split light.

[0108] It should be noted that the incident light will be divided into two light paths after passing through the optical acquisition assembly 1, wherein the transmitted light is the first split light and the reflected light is the second split light.

[0109] In an embodiment, the image event-aware sensor 40 is an APS and DVS two-in-one sensor.

[0110] The APS and DVS two-in-one sensor is a new type of visual sensor integrating an imaging sensor and an event-aware sensor. The APS and DVS two-in-one sensor can detect motion events while realizing visual imaging, and can output image event information, i.e., image data and event information, in frames.

[0111] In an embodiment, the optical acquisition assembly 1 further includes a field-of-view diaphragm 60, a fiber coupling-in interface 70, and an optical fiber 80. The field-of-view diaphragm 60 and the fiber coupling-in interface 70 are sequentially arranged along the propagation direction of the second split light. The fiber coupling-in interface 70 is connected to the spectrometer 50 via the optical fiber 80. The second split light is sequentially transmitted to the spectrometer 50 via the field-of-view diaphragm 60, the fiber coupling-in interface 70, and the optical fiber 80.

[0112] The field-of-view diaphragm 60 is configured to intercept part of the second split light, so that the remaining light is coupled into the optical fiber 80 via the fiber coupling-in interface 70 and propagates to the spectrometer 50 via the optical fiber 80.

[0113] In an embodiment, the optical acquisition assembly 1 further includes a converging lens group (not labeled in FIG. 4). The converging lens group is arranged between the split mirror group and the field-of-view diaphragm 60 along the propagation direction of the second split light. The second split light is sequentially transmitted to the spectrometer 50 via the converging lens group, the field-of-view diaphragm 60, the fiber coupling-in interface 70, and the optical fiber 80.

[0114] The converging lens group is configured to perform deflection processing on the second split light before the second split light propagates to the field-of-view diaphragm 60, so as to ensure that sufficient light energy is coupled into the optical fiber 80.

[0115] In this embodiment, based on the image event-aware sensor 40, the perception of static images and motion events within the field of view can be realized. Based on the spectrometer 50, the measurement of scene brightness and chrominance within the field of view can be realized. Based on the field-of-view diaphragm 60, the stray light in the second split light can be improved, laying a foundation for improving the accuracy of the measurement results of the spectrometer 50. Based on the converging lens group, the problem that the angle of the second split light, i.e., the reflected light, is too large to affect the accuracy of the brightness and chrominance measurement results can be avoided.

[0116] In one embodiment, referring to FIG. 5 and FIG. 6, the optical collection assembly 1 is arranged in order from the object side to the image side as the corneal lens group 10, the aperture stop 20, the second lens 311, the third lens 312, the fourth lens 313, the fifth lens 321, the sixth lens 322, the seventh lens 323, the focusing lens group 34, the eighth lens 331, and the light splitting lens group 35; the artificial eye optical system satisfies TTL / ImgH≤6.6; wherein TTL is the distance on the optical axis from the lens surface closest to the object side of the optical collection assembly 1 to the imaging surface of the optical collection assembly 1, and ImgH is the image height under the full field of view angle.

[0117] The corneal lens group 10 includes the first lens 11; the first lens group 31 includes the second lens 311, the third lens 312, and the fourth lens 313; the second lens group 32 includes the fifth lens 321, the sixth lens 322, and the seventh lens 323; the fifth lens 321 and the sixth lens 322 constitute a cemented lens group, and the seventh lens 323 is a double cemented lens; the third lens group 33 includes the eighth lens 331; the focusing lens group 34 includes the liquid lens 341; the liquid lens 341 changes the positive and negative of the optical power by electrically controlling the positive and negative of the surface curvature; and the light splitting lens group 35 includes the light splitting prism 351.

[0118] The artificial eye optical system satisfies TTL / ImgH≤6.6, TTL is the distance on the optical axis from the object side surface of the lens closest to the object side of the optical collection assembly 1, i.e., the object side surface of the first lens 11, to the imaging surface of the optical collection assembly 1, and TTL has a value range of <33 mm; and ImgH is the image height under the full field of view angle, and ImgH has a value range of 4 mm to 5 mm. Based on this, the total length of the artificial eye optical system can be effectively reduced, which is conducive to the miniaturization of the artificial eye optical system.

[0119] In one embodiment, the second lens 311 has a negative optical power, the object side surface of the second lens 311 is a concave surface, and the image side surface of the second lens 311 is a concave surface; the third lens 312 has a positive optical power, the object side surface of the third lens 312 is a convex surface, and the image side surface of the third lens 312 is a convex surface; the fourth lens 313 has a positive optical power, the object side surface of the fourth lens 313 is a convex surface, and the image side surface of the fourth lens 313 is a convex surface; the fifth lens 321 has a negative optical power, the object side surface of the fifth lens 321 is a concave surface, and the image side surface of the fifth lens 321 is a convex surface; the sixth lens 322 has a positive optical power, the object side surface of the sixth lens 322 is a concave surface, and the image side surface of the sixth lens 322 is a convex surface; the seventh lens 323 is a double cemented lens; the double cemented lens includes a convex-concave lens and a double convex lens cemented in order; the convex-concave lens and the double convex lens both have a negative optical power; and the eighth lens 331 has a positive optical power, the object side surface of the eighth lens 331 is a convex surface, and the image side surface of the eighth lens 331 is a concave surface.

[0120] The object side of the convex-concave lens is convex, and the image side is concave; the object side of the biconvex lens is convex, and the image side is convex.

[0121] In an embodiment, the focal length of the first lens 11 ranges from -10mm to -15mm; the focal length of the second lens 311 ranges from -5mm to -10mm; the focal length of the third lens 312 ranges from 10mm to 15mm; the focal length of the fourth lens 313 ranges from 10mm to 15mm; the focal length of the fifth lens 321 ranges from -15mm to -20mm; the focal length of the sixth lens 322 ranges from 55mm to 60mm; the focal length of the convex-concave lens ranges from -180mm to -185mm; the focal length of the biconvex lens ranges from -60mm to -65mm; and the focal length of the eighth lens 331 ranges from 35mm to 40mm.

[0122] In an embodiment, the distance between the image side of the first lens 11 and the aperture stop 20 ranges from 0.9mm to 2mm; the distance between the aperture stop 20 and the object side of the second lens 311 ranges from 0.9mm to 2mm; the distance between the image side of the seventh lens 323 and the object side of the liquid lens 341 ranges from 0.9mm to 3mm; the distance between the image side of the liquid lens 341 and the object side of the eighth lens 331 ranges from 0.9mm to 3mm; the distance between the image side of the eighth lens 331 and the object side of the light splitting prism 351 ranges from 0.9mm to 3mm; and the distance between the image side of the light splitting prism 351 and the object side of the protective glass 401 ranges from 0.9mm to 3mm. It should be noted that the distance between the protective glass 401 and the image event sensing sensor 40 is 0.045mm; and the protective glass 401 is a glass provided by the image event sensing sensor 40. Since the protective glass 401 will affect the image quality and the system length, the optical parameters corresponding to the protective glass 401 need to be considered in optical simulation.

[0123] Further, the artificial eye optical system also satisfies F Number < 2.4; wherein the F Number is the aperture number, F number, of the optical system; the F Number is equal to the ratio of the focal length to the entrance pupil diameter; wherein the focal length ranges from 0mm to 9.6mm, and the entrance pupil diameter ranges from 2mm to 4mm. Based on this, the light quantity entering the artificial eye optical system can be effectively increased, thereby effectively improving the light energy reaching the image event sensing sensor 40 or the coupling-in optical fiber 80, and also improving the signal-to-noise ratio of the artificial eye optical system and the image quality.

[0124] Further, the artificial eye optical system also satisfies that at the Nyquist frequency, the full depth MTF > 0.16, and at 1 / 2 Nyquist frequency, the full depth MTF > 0.46; wherein the MTF is a modulation transfer function of the artificial eye optical system, used to represent the resolution capability of the artificial eye optical system, and is commonly used as a standard parameter for evaluating imaging quality such as contrast. Based on this, the imaging quality of the transmitted information can be effectively improved; even under the influence of subsequent processing and assembly errors, a larger tolerance space can be provided, so that the resolution of the entire artificial eye optical system remains matched to 20 / 20 human visual acuity, and the display quality of the XR device can be conveniently detected by objective indicators.

[0125] Further, the artificial eye optical system also satisfies PPD > 71; wherein PPD is Pixcel Per Degree, that is, the angular resolution, representing the number of sensor pixels covered within 1° angle; PPD is used to represent the resolution capability of the artificial eye optical system; it should be noted that in the present embodiment, the field of view angle is 60°, and the sensor resolution value range is greater than 4260. Based on this, the angular resolution of the artificial eye optical system can be effectively improved.

[0126] Further, optical parameters of each functional surface from the object side to the image side of the first lens 11, the aperture stop 20, the second lens 311, the third lens 312, the fourth lens 313, the fifth lens 321, the sixth lens 322, the seventh lens 323, the liquid lens 341, the eighth lens 331 and the light splitting prism 351 are set, including surface type, curvature radius, thickness, refractive index, Abbe number and conic constant, as shown in Table 1; wherein the thickness represents the distance between the current surface and the next surface; the units of the curvature radius and the thickness are mm. In Table 1, OBJ represents the object surface, STOP represents the aperture stop surface, and IMA represents the image surface. S1 and S2 represent the object side surface and the image side surface of the first lens 11, respectively, S4 and S5 represent the object side surface and the image side surface of the second lens 311, respectively, S6 and S7 represent the object side surface and the image side surface of the third lens 312, respectively, S8 and S9 represent the object side surface and the image side surface of the fourth lens 313, respectively, S10 and S11 represent the object side surface and the image side surface of the fifth lens 321, respectively, S11 and S12 represent the object side surface and the image side surface of the sixth lens 322, respectively, S13 and S14 represent the object side surface and the image side surface of the convex-concave lens, respectively, S14 and S15 represent the object side surface and the image side surface of the biconvex lens, respectively, S16-S24 are the factory parameters of the liquid lens 341, S25 and S26 represent the object side surface and the image side surface of the eighth lens 331, respectively, S27 and S28 represent the object side surface and the image side surface of the light splitting prism 351, respectively, and S29 and S30 represent the object side surface and the image side surface of the protective glass 401, respectively. It should be noted that the fifth lens 321 and the sixth lens 322 are cemented lens groups, i.e., the image side surface of the fifth lens 321 is cemented with the object side surface of the sixth lens 322, so the optical parameters corresponding to the image side surface S11 of the fifth lens 321 and the object side surface S11 of the sixth lens 322 are the same; similarly, the image side surface S14 of the convex-concave lens is cemented with the object side surface S14 of the biconvex lens, so the optical parameters corresponding to the image side surface S14 of the convex-concave lens and the object side surface S14 of the biconvex lens are the same.

[0127] It should be noted that, except for the image side surface S2 of the first lens 11, the rest of the surfaces are spherical surfaces, and S2 is an even aspherical surface; the high-order coefficients of the aspherical surface of S2 are shown in Table 2.

[0128] It should be noted that in Table 1, A is the distance from the object plane to S1, representing the working distance of the object, i.e. the diopter; B and C are the radii of curvature of the electrically controlled liquid lens 341; D and E are the face spacing of the electrically controlled liquid lens 341. Further, Table 3 gives the electrically controlled liquid lens 341 curvature radius change, thickness change of the imaging light path of the artificial eye optical system under different working distances, and the five parameters A, B, C, D, E in Table 3 correspond one by one to the five parameters A, B, C, D, E in Table 1, and the unit is mm; case one to case five, respectively, indicate that in different diopter ranges, under the condition of maintaining the image quality, the corresponding parameter condition of the electrically controlled liquid lens 341 focusing is adjusted.

[0129] Table 1 Optical parameter table of artificial eye optical system

[0130] Table 2 Aspheric high-order coefficient table

[0131] Table 3 Parameter change table under different working distances

[0132] Further, by testing the artificial eye optical system of the above embodiment, the MTF curve and the field curvature distortion curve of the artificial eye optical system under different working distances can be obtained, as shown in Figs. 7A-11B. It should be noted that in Figs. 7A-11B, from left to right are the MTF curve, the field curvature curve and the distortion curve; wherein the MTF curve, the horizontal coordinate represents different spatial frequencies, and the vertical coordinate represents the MTF contrast value; the field curvature curve, the horizontal coordinate represents the field curvature value of different wavelengths, and the vertical coordinate represents different fields of view; the distortion curve, the horizontal coordinate represents the relative distortion percentage, and the vertical coordinate represents different fields of view. It should be noted that at the Nyquist frequency, the full view depth MTF > 0.16, the F-θ distortion < 1.25%, meeting the requirements of conventional imaging.

[0133] In this embodiment, the full field of view FOV of the artificial eye optical system is 60°, and the actual working distance covers 0-4D diopter.

[0134] In one specific embodiment, referring to Figs. 12 and 13, the optical acquisition assembly 1 is arranged in order from the object side to the image side as follows: corneal lens group 10, aperture stop 20, second lens 311, third lens 312, fourth lens 313, light splitting lens group 35, fifth lens 321, sixth lens 322, seventh lens 323, focusing lens group 34 and eighth lens 331; the artificial eye optical system satisfies TTL / ImgH≤5.9; wherein TTL is the distance from the lens surface closest to the object side of the optical acquisition assembly 1 to the imaging surface of the optical acquisition assembly 1 on the optical axis, and ImgH is the image height under the full field of view angle.

[0135] Wherein, the cornea lens group 10 comprises a first lens 11; the first lens group 31 comprises a second lens 311, a third lens 312 and a fourth lens 313; the second lens group 32 comprises a fifth lens 321, a sixth lens 322 and a seventh lens 323; wherein the fifth lens 321 and the sixth lens 322 constitute a cemented lens group; the third lens group 33 comprises an eighth lens 331; the focusing lens group 34 comprises a liquid lens 341; the liquid lens 341 changes the positive and negative of the optical power by adjusting the positive and negative of the surface curvature through electric control; the light splitting lens group 35 comprises a light splitting prism 351.

[0136] Wherein, the artificial eye optical system satisfies TTL / ImgH≤5.9, TTL is the distance on the optical axis from the object side surface of the first lens 11 which is the lens surface closest to the object side of the optical acquisition assembly 1 to the imaging surface of the optical acquisition assembly 1, the value range of TTL is <29.5mm; ImgH is the image height under the full field of view angle, the value range of ImgH is 4mm-5mm. Based on this, the total length of the artificial eye optical system can be effectively reduced, which is conducive to the miniaturization of the artificial eye optical system.

[0137] In an embodiment, the second lens 311 has positive optical power, and the object side surface of the second lens 311 is a concave surface and the image side surface is a concave surface; the third lens 312 has negative optical power, and the object side surface of the third lens 312 is a concave surface and the image side surface is a convex surface; the fourth lens 313 has positive optical power, and the object side surface of the fourth lens 313 is a convex surface and the image side surface is a convex surface; the fifth lens 321 has negative optical power, and the object side surface of the fifth lens 321 is a concave surface and the image side surface is a concave surface; the sixth lens 322 has negative optical power, and the object side surface of the sixth lens 322 is a convex surface and the image side surface is a convex surface; the seventh lens 323 has positive optical power, and the object side surface of the seventh lens 323 is a convex surface and the image side surface is a convex surface; the eighth lens 331 has positive optical power, and the object side surface of the eighth lens 331 is a convex surface and the image side surface is a convex surface.

[0138] In an embodiment, the focal length range of the first lens 11 is -10mm--15mm; the focal length range of the second lens 311 is 15mm-20mm; the focal length range of the third lens 312 is -10mm--15mm; the focal length range of the fourth lens 313 is 10mm-15mm; the focal length range of the fifth lens 321 is -20mm--25mm; the focal length range of the sixth lens 322 is -175mm--180mm; the focal length range of the seventh lens 323 is 20mm-25mm; the focal length range of the eighth lens 331 is 15mm-20mm.

[0139] In an embodiment, the distance between the image side surface of the first lens 11 and the aperture stop 20 ranges from 0.9 mm to 2 mm; the distance between the aperture stop 20 and the object side surface of the second lens 311 ranges from 0.9 mm to 2 mm; the distance between the image side surface of the fourth lens 313 and the object side surface of the light splitting prism 351 ranges from 0.9 mm to 3 mm; the distance between the image side surface of the light splitting prism 351 and the object side surface of the fifth lens 321 ranges from 0.9 mm to 3 mm; the distance between the image side surface of the seventh lens 323 and the object side surface of the liquid lens 341 ranges from 0.9 mm to 3 mm; the distance between the image side surface of the liquid lens 341 and the object side surface of the eighth lens 331 ranges from 1 mm to 7 mm; and the distance between the image side surface of the eighth lens 331 and the object side surface of the protective glass 401 ranges from 0.9 mm to 3 mm.

[0140] Further, the artificial eye optical system also satisfies F Number < 2.4. Wherein, the F Number is the aperture number of the optical system, F number; the F Number is equal to the ratio of the focal length and the entrance pupil diameter; wherein, the focal length takes a value < 9.6 mm, and the entrance pupil diameter takes a value ranging from 2 mm to 4 mm. Based on this, the light quantity entering the artificial eye optical system can be effectively increased, and then the light energy reaching the image event perception sensor 40 or the coupling-in optical fiber 80 can be effectively improved, while the signal-to-noise ratio of the artificial eye optical system can also be improved, and the image quality can be improved.

[0141] Further, the artificial eye optical system also satisfies that the full-field MTF is > 0.25 at the Nyquist frequency, and the full-field MTF is > 0.57 at 1 / 2 Nyquist frequency; wherein, the MTF is the modulation transfer function of the artificial eye optical system, which is used to represent the resolution capability of the artificial eye optical system, and is a standard parameter commonly used to evaluate the imaging quality such as contrast. Based on this, the imaging quality of the transmitted information can be effectively improved; even under the influence of subsequent processing and assembly errors, a larger tolerance space can be provided, so that the resolution of the whole artificial eye optical system remains to match the 20 / 20 human visual acuity, and the display quality of the XR device can be conveniently detected by objective indicators.

[0142] Further, the artificial eye optical system also satisfies PPD > 70; wherein, the PPD is Pixcel Per Degree, that is, the angular resolution, which represents the number of sensor pixels covered in 1° angle; the PPD is used to represent the resolution capability of the artificial eye optical system; it should be noted that the field of view angle in the embodiment is 60°, and the sensor resolution takes a value greater than 4260. Based on this, the angular resolution of the artificial eye optical system can be effectively improved.

[0143] Further, the optical parameters of the respective functional surfaces of the first lens 11, the aperture stop 20, the second lens 311, the third lens 312, the fourth lens 313, the light-splitting prism 351, the fifth lens 321, the sixth lens 322, the seventh lens 323, the liquid lens 341 and the eighth lens 331 from the object side to the image side are sequentially set, including the surface type, the curvature radius, the thickness, the refractive index, the Abbe number and the conic constant, as shown in Table 4; wherein the units of the curvature radius and the thickness are mm. In Table 4, OBJ represents the object surface, STOP represents the aperture stop surface, and IMA represents the image surface; S1 and S2 respectively represent the object side surface and the image side surface of the first lens 11, S4 and S5 respectively represent the object side surface and the image side surface of the second lens 311, S6 and S7 respectively represent the object side surface and the image side surface of the third lens 312, S8 and S9 respectively represent the object side surface and the image side surface of the fourth lens 313, S10 and S11 respectively represent the object side surface and the image side surface of the light-splitting prism 351, S12 and S13 respectively represent the object side surface and the image side surface of the fifth lens 321, S13 and S14 respectively represent the object side surface and the image side surface of the sixth lens 322, S15 and S16 respectively represent the object side surface and the image side surface of the seventh lens 323, S17-S25 are the factory parameters of the liquid lens 341, S26 and S27 respectively represent the object side surface and the image side surface of the eighth lens 331, and S28 and S29 respectively represent the object side surface and the image side surface of the protective glass 401. It should be noted that since the fifth lens 321 and the sixth lens 322 are cemented lens groups, i.e., the image side surface of the fifth lens 321 is cemented with the object side surface of the sixth lens 322, the optical parameters corresponding to the image side surface S13 of the fifth lens 321 and the object side surface S13 of the sixth lens 322 are the same.

[0144] It should be noted that, except for the image side surface S2 of the first lens 11, the object side surface S15 and the image side surface S16 of the seventh lens 323, the rest of the surfaces are spherical surfaces; S2, S15 and S16 are even aspheric surfaces; the aspheric high-order coefficients of S2, S15 and S16 are shown in Table 5.

[0145] It should be noted that in Table 4, A is the distance from the object surface to S1, representing the object working distance, i.e., the diopter; B and C are the curvature radii of the liquid lens 341 controlled by electricity; D and E are the face distances of the liquid lens 341 controlled by electricity. Further, Table 6 shows the changes of the curvature radius and the thickness of the electrically controlled liquid lens 341 in the imaging light path of the artificial eye optical system under different working distances, wherein the five parameters A, B, C, D and E in Table 6 correspond to the five parameters A, B, C, D and E in Table 4, and the units are mm; cases one to five respectively represent the corresponding parameter conditions of the electrically controlled liquid lens 341 under different diopter ranges while maintaining the image quality.

[0146] Table 4 Optical parameter table of the artificial eye optical system

[0147] Table 5 Aspheric high-order coefficient table

[0148] Table 6 Parameter change table at different working distances

[0149] Further, by testing the artificial eye optical system of the above embodiment, the MTF curve and the field curvature distortion curve of the artificial eye optical system at different working distances can be obtained, as shown in FIGS. 14A-18B. It should be noted that in FIGS. 14A-18B, from left to right are the MTF curve, the field curvature curve and the distortion curve; wherein the MTF curve, the abscissa represents different spatial frequencies, and the ordinate represents the MTF contrast value; the field curvature curve, the abscissa represents the field curvature value of different wavelengths, and the ordinate represents different fields of view; the distortion curve, the abscissa represents the relative distortion percentage, and the ordinate represents different fields of view. It should be noted that at the Nyquist frequency, the full depth of field MTF is greater than 0.25, and the F-theta distortion is less than 1.71%, which meets the requirements of conventional imaging.

[0150] In this embodiment, the artificial eye optical system has a full field of view FOV = 60°, and the actual working distance covers 0-6D diopters.

[0151] The artificial eye optical system has the following advantages. First, based on the optical acquisition component 1 and the signal sensing component 2, not only can the physiological structures such as the cornea, the sclera, the pupil and the iris of the human eye be simulated, but also the comprehensive perception of the human eye to the static images, motion events, scene brightness and chroma in the field of view can be simulated, so as to realize the comprehensive measurement of the display quality of the XR device; second, based on the optical acquisition component 1, the resolution of the artificial eye optical system can be kept to match the 20 / 20 human visual acuity, and the angular resolution and the signal-to-noise ratio of the artificial eye optical system can be improved, thereby laying a foundation for improving the reliability of the measurement result of the display quality of the XR device; third, based on the optical acquisition component 1, the artificial eye optical system is miniaturized, and the compactness of the artificial eye optical system is improved.

[0152] In one embodiment, the servo control component 300 includes a rotating motion structure; the artificial eye camera component 200 is arranged on the corresponding rotating motion structure, and the rotating motion structure is used to rotate control the artificial eye camera component 200 according to the motion sequence parameters; the rotating control includes vertical rotating control and horizontal rotating control.

[0153] In an embodiment, the servo control assembly 300 further comprises electric displacement tables; the rotating motion structure is arranged on the corresponding electric displacement table, and the electric displacement table is used to adjust the displacement of the artificial eye camera assembly according to the motion sequence parameters; the displacement adjustment includes up-down displacement adjustment, front-back displacement adjustment, and left-right displacement adjustment.

[0154] The rotating motion structure can control the artificial eye camera assembly 200 to realize horizontal rotation and vertical rotation. The rotating motion structure at least includes a motor driving assembly, a worm gear mechanism, and a rotating table. The worm gear mechanism is connected with the artificial eye camera assembly 200 and can realize vertical rotation adjustment of the artificial eye camera assembly 200. The artificial eye camera assembly 200 is fixed on the rotating table through a connecting structure and can realize horizontal rotation adjustment of the artificial eye camera assembly 200 through the rotating table. The motor driving assembly is used to control the worm gear mechanism and the rotating table to move correspondingly according to the motion sequence parameters. It should be noted that the specific structure of the motor driving assembly, the worm gear mechanism, and the rotating table needs to be designed according to actual use requirements, and the embodiment of the present application does not make specific limitations.

[0155] The electric displacement table is used to adjust the relative distance and relative height of the artificial eye camera assembly 200 and the smart glasses, and is also used to adjust the relative position between the two artificial eye camera assemblies 200. For example, each artificial eye camera assembly 200 is arranged on the corresponding electric displacement table. According to the left-right displacement parameters, the corresponding artificial eye camera assembly 200 is driven to adjust the left-right displacement through the electric displacement table to simulate different pupil distances of the human eye. According to the front-back displacement parameters, the corresponding artificial eye camera assembly 200 is driven to adjust the front-back displacement through the electric displacement table to adjust the relative distance of the artificial eye camera assembly 200 and the smart glasses. According to the vertical displacement parameters, the corresponding artificial eye camera assembly 200 is driven to adjust the up-down displacement through the electric displacement table to adjust the relative height of the artificial eye camera assembly 200 and the smart glasses.

[0156] In the embodiment, based on the rotating motion structure, the artificial eye camera assembly 200 can accurately simulate the horizontal rotation and vertical rotation of the human eye. Based on the electric displacement table, different pupil distances of the human eye can be simulated, and the relative distance and relative height of the artificial eye camera assembly 200 and the smart glasses can be automatically adjusted, which lays a foundation for comprehensively detecting the display effect of the smart glasses under different eye movement conditions and different detection positions.

[0157] In one embodiment, the servo control component 300 can control the artificial eye camera component 200 to simulate the human eye posture movement according to the motion sequence parameters generated by the visual processing component 100; for example, the maximum rotation speed can be 720° / s, the horizontal movement range can be 120°, the shortest acceleration time can be 5ms, and other parameters conforming to the real human eye movement can be implemented.

[0158] In one embodiment, referring to FIG. 19, in one embodiment, the rotating movement structure includes a vertical rotating structure 410 and a horizontal rotating structure 420; the vertical rotating structure 410 at least includes a worm gear mechanism and a first motor driving component; the vertical rotating structure 410 is connected with the artificial eye camera component 200, and is used to realize the vertical rotating adjustment of the artificial eye camera component 200; the horizontal rotating structure 420 at least includes a rotating table and a second motor driving component; the artificial eye camera component 200 is fixed on the horizontal rotating structure 420 through a connecting structure; the horizontal rotating structure 420 is used to realize the horizontal rotating adjustment of the artificial eye camera component 200. In one embodiment, the electric displacement table includes a pupil distance adjusting structure 510, a height adjusting structure 520 and a visual point adjusting structure 530; the pupil distance adjusting structure 510 is used to adjust the relative position between the two artificial eye camera components 200; the height adjusting structure 520 is used to adjust the relative height between the artificial eye camera component 200 and the smart glasses; the visual point adjusting structure 530 is used to adjust the relative distance between the artificial eye camera component 200 and the smart glasses. In one embodiment, the artificial eye optical system is arranged on the simulated head type support component 600; the simulated head type support component 600 is used to support the smart glasses.

[0159] It should be understood that, although the steps in the flowcharts involved in the above-described embodiments are shown in sequence according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified herein, the execution of these steps is not strictly limited in sequence, and these steps can be executed in other sequences. Moreover, at least some of the steps in the flowcharts involved in the above-described embodiments can include multiple steps or stages, which are not necessarily executed at the same time, but can be executed at different times, and the execution sequence of these steps or stages is not necessarily sequential, but can be executed in rotation or alternation with other steps or steps or stages in other steps.

[0160] It should be noted that the user information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present application are all information and data authorized by the user or authorized by all parties.

[0161] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer readable storage medium, and when the computer program is executed, the processes of the above-mentioned embodiments of the methods can be included. Any reference to memory, databases or other media used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (Read-Only Memory, ROM), magnetic tape, floppy disk, flash memory, optical storage, high-density embedded non-volatile memory, resistive memory (ReRAM), magnetoresistive random access memory (Magnetoresistive Random Access Memory, MRAM), ferroelectric memory (Ferroelectric Random Access Memory, FRAM), phase change memory (Phase Change Memory, PCM), graphene memory, etc. Volatile memory can include random access memory (Random Access Memory, RAM) or external cache memory, etc. As an illustration but not limitation, the RAM can be in various forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM), etc. The database involved in the embodiments provided in the present application can include at least one of a relational database and a non-relational database. The non-relational database can include a distributed database based on a block chain, etc., without being limited thereto. The processor involved in the embodiments provided in the present application can be a general-purpose processor, a central processing unit, a graphics processing unit, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., without being limited thereto.

[0162] In the description of the present specification, the description referring to the terms "some embodiments", "other embodiments", and the like means that the specific features, structures, materials or characteristics described in connection with the embodiments or examples are included in at least one embodiment or example of the present application. In the present specification, the illustrative description of the above terms does not necessarily mean the same embodiment or example.

[0163] The technical features of the above-mentioned embodiments can be combined arbitrarily. In order to make the description simple, all possible combinations of the technical features in the above-mentioned embodiments are not described, but as long as the combination of the technical features does not exist contradictory, it should be considered as the scope of the present specification.

[0164] The above embodiments only express several implementation ways of the present application, and the description is relatively specific and detailed, but it should not be understood as a limitation to the patent scope of the application. It should be pointed out that for ordinary skilled persons in the art, several modifications and improvements can be made without departing from the concept of the present application, which all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application should be subject to the appended claims.

Claims

1. A method of automatic accommodation of an artificial eye, characterized in that The method comprises: acquiring a to-be-tested image and to-be-tested image information corresponding to the to-be-tested image; the to-be-tested image is an image obtained by collecting a to-be-tested display interface of smart glasses through an artificial eye optical system, and comprises a target object; the to-be-tested image information comprises image event information and spectral information; inputting the to-be-tested image into a trained first model to determine a motion sequence parameter corresponding to the artificial eye optical system gazing at the target object; inputting the to-be-tested image and the to-be-tested image information into a trained second model to determine a focusing parameter corresponding to the artificial eye optical system gazing at the target object; automatically adjusting the artificial eye optical system according to the motion sequence parameter and the focusing parameter.

2. The artificial eye auto- accommodation method of claim 1, wherein, The inputting of the to-be-tested image into the trained first model to determine the motion sequence parameter corresponding to the artificial eye optical system gazing at the target object comprises: performing feature extraction on the to-be-tested image to obtain image feature information corresponding to the to-be-tested image; the image feature information comprises salient region feature information and text feature information; inputting the image feature information into the trained first model to determine the motion sequence parameter corresponding to the artificial eye optical system gazing at the target object.

3. The artificial eye auto- accommodation method of claim 2, wherein, The first model comprises a feature fusion mapping model and a motion sequence parameter regression mapping model; the inputting of the image feature information into the trained first model to determine the motion sequence parameter corresponding to the artificial eye optical system gazing at the target object comprises: inputting the image feature information into the trained feature fusion mapping model to determine a motion feature parameter corresponding to the artificial eye optical system gazing at the target object; the motion feature parameter comprises a tremor parameter, a jump parameter, a gazing probability parameter and a gazing period parameter; inputting the motion feature parameter into the trained motion sequence parameter regression mapping model to determine the motion sequence parameter corresponding to the artificial eye optical system gazing at the target object; the motion sequence parameter comprises a rotation angle, a rotation speed and a rotation acceleration.

4. The artificial eye auto- accommodation method of claim 1, wherein, Before the inputting of the to-be-tested image into the trained first model to determine the motion sequence parameter corresponding to the artificial eye optical system gazing at the target object, the method comprises: acquiring a sample image; the sample image is an image obtained by collecting a to-be-tested display interface of smart glasses through an artificial eye optical system, and comprises a preset object; performing feature extraction on the sample image to obtain sample image feature information corresponding to the sample image; the sample image feature information comprises salient region feature information and text feature information; acquiring human eye priori parameters; the human eye priori parameters comprise human eye rotation priori parameters and human eye gazing priori parameters; training the first model according to the sample image feature information and the human eye priori parameters to obtain the trained first model; the trained first model is used to establish a mapping relationship between the sample image feature information, the human eye priori parameters and the motion sequence parameter.

5. The artificial eye auto- accommodation method of claim 1, wherein, The second model comprises a perception decision model and a definition change prediction model; the trained second model is inputted with the to-be-tested image and to-be-tested image information to determine a focusing parameter corresponding to the target object of the artificial eye optical system, comprising: The to-be-tested image, image event information and spectrum information are inputted into the trained perception decision model to determine target feature information of the target object; the target feature information comprises positioning information, size information and definition information; The target feature information is inputted into the trained definition change prediction model to determine a focusing parameter corresponding to the target object of the artificial eye optical system.

6. The artificial eye auto- accommodation method of claim 1, wherein, The automatic adjustment of the artificial eye optical system according to the motion sequence parameter and the focusing parameter comprises: The motion trajectory control of the artificial eye optical system is performed according to the motion sequence parameter; The automatic focusing processing of the artificial eye optical system is performed according to the focusing parameter.

7. An artificial optical eye system, characterized by The system comprises a visual processing component, two artificial eye camera components and servo control components corresponding to the artificial eye camera components; The artificial eye camera components are electrically connected with the visual processing component, used to collect to-be-tested images and to-be-tested image information corresponding to the to-be-tested images, and transmit the to-be-tested images and to-be-tested image information to the visual processing component; the to-be-tested images are images collected from a to-be-tested display interface of the intelligent eyeglasses and contain target objects; the to-be-tested image information comprises image event information and spectrum information; The visual processing component is electrically connected with the servo control components, used to perform the artificial eye automatic adjustment method in any one of claims 1 to 6, and transmit a motion sequence parameter corresponding to the target object of the artificial eye optical system to the servo control components and transmit a focusing parameter corresponding to the target object of the artificial eye optical system to the artificial eye camera components; The artificial eye camera components are arranged on the corresponding servo control components, and the servo control components are used to perform motion trajectory control on the artificial eye camera components according to the motion sequence parameter; The artificial eye camera components are also used to perform automatic focusing processing according to the focusing parameter.

8. Artificial optical system of the eye according to claim 7, wherein, The artificial eye camera components comprise optical collection components and signal sensing components; The signal sensing components are arranged on an optical path formed by the optical collection components, used to receive light transmitted by the optical collection components to obtain to-be-tested images and to-be-tested image information corresponding to the to-be-tested images.

9. Artificial optical system of the eye according to claim 8, wherein, The optical collection assembly comprises, in order from the object side to the image side, a cornea lens group, an aperture diaphragm, and a regular lens group; external light rays propagate to the signal sensing assembly through the optical collection assembly; the cornea lens group has negative focal power; the regular lens group comprises a first lens group, a second lens group, a third lens group, a focusing lens group, and a light splitting lens group; the first lens group, the second lens group, and the third lens group all have positive focal power; the first lens group comprises a second lens, a third lens, and a fourth lens; the second lens group comprises a fifth lens, a sixth lens, and a seventh lens; the fifth lens and the sixth lens constitute a cemented lens group; the third lens group comprises an eighth lens; the focusing lens group comprises a liquid lens for adjusting the focal power; the light splitting lens group comprises a light splitting prism for light splitting processing of incident light rays; The signal sensing assembly is arranged on the optical path formed by the optical collection assembly and is used for receiving the light rays transmitted by the optical collection assembly.

10. The artificial eye optical system according to claim 9, wherein, The cornea lens group comprises a first lens; the first lens has negative focal power, and the object side surface of the first lens is a convex surface and the image side surface is a concave surface.

11. The artificial optical system of claim 9, wherein, The signal sensing assembly comprises an image event sensing sensor and a spectrometer; After the external light rays pass through the optical collection assembly, first split light rays and second split light rays are formed; The image event sensing sensor is arranged on the optical path of the first split light rays and is used for receiving the first split light rays; The spectrometer is arranged on the optical path of the second split light rays and is used for receiving the second split light rays.

12. Artificial optical system of the eye according to claim 11, wherein, The image event sensing sensor is an APS and DVS two-in-one sensor.

13. The artificial optical system of claim 11, wherein, The optical collection assembly further comprises a field of view diaphragm, a fiber coupling-in interface, and an optical fiber; The field of view diaphragm and the fiber coupling-in interface are arranged in order along the propagation direction of the second split light rays; the fiber coupling-in interface is connected to the spectrometer through the optical fiber; the second split light rays are transmitted to the spectrometer through the field of view diaphragm, the fiber coupling-in interface, and the optical fiber in order.

14. Artificial optical system of the eye according to claim 13, wherein, The optical collection assembly further comprises a converging lens group; The converging lens group is arranged between the light splitting lens group and the field of view diaphragm along the propagation direction of the second split light rays; the second split light rays are transmitted to the spectrometer through the converging lens group, the field of view diaphragm, the fiber coupling-in interface, and the optical fiber in order.

15. The artificial optical system of claim 9, wherein, The optical collection assembly arranges the cornea lens group, the aperture diaphragm, the second lens, the third lens, the fourth lens, the fifth lens, the sixth lens, the seventh lens, the focusing lens group, the eighth lens, and the light splitting lens group in order from the object side to the image side; The artificial eye optical system satisfies TTL / ImgH≤6.6; wherein TTL is the distance on the optical axis between the lens surface closest to the object side in the optical collection assembly and the imaging surface of the optical collection assembly, and ImgH is the image height under the full field of view angle.

16. The artificial eye optical system according to claim 15, wherein, The second lens has negative focal power, and the object side surface of the second lens is a concave surface and the image side surface is a concave surface; The third lens has positive focal power, and object side surface of the third lens is convex, and image side surface is convex; The fourth lens has positive focal power, and object side surface of the fourth lens is convex, and image side surface is convex; The fifth lens has negative focal power, and object side surface of the fifth lens is concave, and image side surface is convex; The sixth lens has positive focal power, and object side surface of the sixth lens is concave, and image side surface is convex; The seventh lens is a double cemented lens; the double cemented lens comprises a biconvex-concave lens and a double convex lens cemented in sequence; the biconvex-concave lens and the double convex lens both have negative focal power; The eighth lens has positive focal power, and object side surface of the eighth lens is convex, and image side surface is concave.

17. The artificial optical system of claim 9, wherein, The optical acquisition assembly sequentially arranges the corneal lens group, the aperture diaphragm, the second lens, the third lens, the fourth lens, the light splitting lens group, the fifth lens, the sixth lens, the seventh lens, the focusing lens group and the eighth lens in order from the object side to the image side; The artificial eye optical system satisfies TTL / ImgH≤5.9; wherein, TTL is the distance on the optical axis from the lens surface closest to the object side in the optical acquisition assembly to the imaging surface of the optical acquisition assembly, and ImgH is the image height under the full field of view angle.

18. The artificial eye optical system according to claim 17, wherein, The second lens has positive focal power, and object side surface of the second lens is concave, and image side surface is concave; The third lens has negative focal power, and object side surface of the third lens is concave, and image side surface is convex; The fourth lens has positive focal power, and object side surface of the fourth lens is convex, and image side surface is convex; The fifth lens has negative focal power, and object side surface of the fifth lens is concave, and image side surface is concave; The sixth lens has negative focal power, and object side surface of the sixth lens is convex, and image side surface is convex; The seventh lens has positive focal power, and object side surface of the seventh lens is convex, and image side surface is convex; The eighth lens has positive focal power, and object side surface of the eighth lens is convex, and image side surface is convex.

19. The artificial optical system of claim 7, wherein, The servo control assembly comprises a rotary motion structure; The artificial eye camera assembly is arranged on the corresponding rotary motion structure, and the rotary motion structure is used for performing rotary control on the artificial eye camera assembly according to the motion sequence parameters; the rotary control comprises vertical rotary control and horizontal rotary control.

20. The artificial optical system of claim 19, wherein, The servo control assembly further comprises an electric displacement table; The rotary motion structure is arranged on the corresponding electric displacement table, and the electric displacement table is used for performing displacement adjustment on the artificial eye camera assembly according to the motion sequence parameters; the displacement adjustment comprises up-down displacement adjustment, front-back displacement adjustment and left-right displacement adjustment.

Images