An image acquisition device, a wearable device and a data acquisition device

Abstract

This application provides an image acquisition device, a wearable device, and a data acquisition device, relating to the field of bioinformatics. It is equipped with two first acquisition modules that acquire images of each eye in a one-to-one manner. This minimizes the number of first acquisition modules, simplifies the structure, and results in a smaller size and lighter weight. Furthermore, the light wavelengths that the first acquisition modules can sense are extended to include the visible light band. This allows the image acquisition device to use the visible light band in ambient light to acquire images of the eyes, thereby enabling eye tracking. This design allows for eye image acquisition in ambient light environments with a simple structure, unlike existing technologies that rely entirely on infrared illuminators, avoiding the high cost and power consumption associated with infrared cameras and their associated hardware. Clear images can be obtained even in strong light.

Description

Technical Field

[0001] This application relates to the field of bioinformatics acquisition technology, and more specifically, to an image acquisition device, a wearable device, and a data acquisition device. Background Technology

[0002] With the development of near-eye display technology and wearable devices, smart wearable electronic products are gradually entering the consumer market. Among them, smart glasses with AR (Augmented Reality), VR (Virtual Reality), MR (Mixed Reality), and XR (Extended Reality) technologies are attracting attention from different customer groups. To further improve the user experience of smart wearable devices, it is necessary to enable these devices to have eye-tracking capabilities, allowing them to recognize the user's gaze direction and thus determine what the user is looking at.

[0003] Currently, the structure of eye-tracking systems is quite complex. Therefore, when they are mounted on glasses, the glasses are relatively large and heavy, which affects the user experience. Utility Model Content

[0004] The purpose of this application is to address the shortcomings of the prior art by providing an image acquisition device, a wearable device, and a data acquisition device.

[0005] To achieve the above objectives, the technical solutions adopted in the embodiments of this application are as follows:

[0006] One aspect of this application provides an image acquisition device, including:

[0007] Two first acquisition modules are provided, each corresponding to one of the two eyes. The field of view of each first acquisition module covers at least part of the corresponding eye. The reflected light from the eye is received by the first acquisition module corresponding to that eye and the image of the eye is acquired. The reflected light includes at least the visible light band.

[0008] Optionally, the first acquisition module includes:

[0009] An image sensor is formed when reflected light is incident on it without being filtered.

[0010] Optionally, the image acquisition device further includes:

[0011] An infrared light source is used to emit infrared light towards the field of view of the two first acquisition modules when the brightness of visible light in the environment is below a brightness threshold; the reflected light also includes infrared light.

[0012] Optionally, the image acquisition device further includes:

[0013] The second acquisition module has a field of view that covers at least a portion of the visual field of the two eyes, and is used to acquire images of the covered visual field.

[0014] In another aspect of the embodiments of this application, a wearable device is provided, including a wearable body and an image acquisition device as described above, wherein the image acquisition device is disposed on the wearable body.

[0015] Alternatively, wearable devices may also include:

[0016] The communication module is electrically connected to the image acquisition device, and the wearable device is used to interact with the electronic device via the communication module.

[0017] In another aspect of this application, a data acquisition device is provided, comprising:

[0018] A target gaze device, which has markings for eye gaze;

[0019] In any of the above-mentioned image acquisition devices or wearable devices, during the movement of the target gaze object, the two first acquisition modules of the wearable device are used to acquire multiple frames of images of the eye.

[0020] Optionally, the data acquisition device also includes:

[0021] A mobile device is driven to connect to a target gaze device. The mobile device is used to move the target gaze device within a preset area, which is at least part of the eye's observation area.

[0022] Optionally, the mobile device includes:

[0023] A dual-axis moving mechanism is used, with the target viewing component set within the dual-axis moving mechanism. The preset area is a two-dimensional planar region.

[0024] Alternatively, a three-axis moving mechanism, with the target viewing component set on the three-axis moving mechanism, and the preset area being a three-dimensional solid area;

[0025] Alternatively, a multi-axis robotic arm may be used, with the target viewing element positioned at the end of the multi-axis robotic arm, and the preset area being a three-dimensional region.

[0026] Optionally, the moving device includes a robotic arm, with a target viewing element disposed at the end of the robotic arm, and the other end of the robotic arm opposite to the end being rotatably connected to a fixed point.

[0027] Optionally, the target viewing device is a reflective display screen, and the identifier is a pattern displayed on the reflective display screen.

[0028] The beneficial effects of this application include:

[0029] This application provides an image acquisition device, a wearable device, and a data acquisition device. The image acquisition device is optimized by equipping two first acquisition modules to acquire images of each eye in a one-to-one manner. This minimizes the number of first acquisition modules, simplifies the structure, and results in a smaller size and lighter weight. Furthermore, the light wavelengths that the first acquisition modules can sense are extended to include the visible light band. This allows the image acquisition device to use the visible light band in ambient light to acquire images of the eyes, enabling eye tracking. This design allows for eye image acquisition in ambient light environments with a simple structure, unlike existing technologies that rely entirely on infrared illuminators. This avoids the high cost and power consumption associated with high-precision infrared cameras and their associated hardware. When applied to wearable devices, this image acquisition device not only achieves small size and light weight but also allows the wearable device to maintain its original structural form without significant changes. Furthermore, existing technologies rely entirely on infrared fill lights for illumination, which makes infrared cameras susceptible to interference from ambient light in bright environments. In contrast, this application directly utilizes visible light from the ambient light spectrum, thus enabling the acquisition of clear and stable eye images even in bright light conditions. Attached Figure Description

[0030] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of this application and should not be regarded as a limitation of the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0031] Figure 1 This is one of the structural schematic diagrams of an image acquisition device provided in an embodiment of this application;

[0032] Figure 2 This is a second schematic diagram of the structure of an image acquisition device provided in an embodiment of this application;

[0033] Figure 3 This is the third schematic diagram of the structure of an image acquisition device provided in the embodiments of this application;

[0034] Figure 4 This is a schematic diagram of the structure of a smart glasses provided in an embodiment of this application;

[0035] Figure 5 This is one of the structural schematic diagrams of a data acquisition device provided in an embodiment of this application;

[0036] Figure 6 This is a second schematic diagram of the structure of a data acquisition device provided in an embodiment of this application;

[0037] Figure 7 This is the third schematic diagram of a data acquisition device provided in an embodiment of this application.

[0038] Icons: 100 - Eye; 101 - Visible light band; 110 - Observation area; 210 - First acquisition module; 211 - Image sensor; 213 - Field of view of the first acquisition module; 230 - Second acquisition module; 231 - Field of view of the second acquisition module; 220 - Infrared light source; 221 - Infrared light band; 300 - Smart glasses; 310 - Lens; 410 - Target viewing device; 411 - Identifier; 420 - Mobile device; 421 - Frame; 422 - Guide rail; 424 - Multi-axis robotic arm; 425 - Fixed point; 426 - Movable range of the target viewing device; 427 - Robotic arm. Detailed Implementation

[0039] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0040] In one aspect of this application, an image acquisition device is provided, comprising: two first acquisition modules, each corresponding to one of two eyes, the field of view of each first acquisition module covering at least a portion of the corresponding eye, and reflected light from the eye being received by the first acquisition module corresponding to that eye and the image of the eye being acquired, wherein the reflected light includes at least visible light.

[0041] In the design of the eye-tracking system, the system structure is optimized by equipping it with two primary acquisition modules to capture images of each eye in a one-to-one manner. This minimizes the number of primary acquisition modules, simplifies the structure, and results in a smaller size and lighter weight. Furthermore, the light wavelengths that the primary acquisition modules can sense are extended to include the visible light band. This allows the image acquisition device to utilize the visible light band in ambient light to capture images of the eyes, thus enabling eye tracking. This design allows for eye image acquisition in ambient light environments with a simple structure, unlike existing technologies that rely entirely on infrared supplemental lighting. This makes it possible for the image acquisition device to be small and lightweight when applied to wearable devices, while also allowing the wearable device to maintain its original structural form without significant alterations.

[0042] Figure 1 This is one of the structural schematic diagrams of an image acquisition device provided in an embodiment of this application. For ease of description and understanding, in... Figure 1 The image acquisition device also shows the object of acquisition—the eye 100. It should be understood that when the image acquisition device acquires images of the eye 100, the target acquired may include, but is not limited to, one or more of the periorbital area, eyelids, etc., in addition to the eyeball.

[0043] Reference Figure 1 The image acquisition device specifically acquires images of the eye 100 through the first acquisition module 210. The acquired images can be used for eye tracking to determine the user's gaze direction. Therefore, the field of view formed by the first acquisition module 210 should correspond to the position of the eye 100. For example, when the eye 100 is open, the field of view 213 of the first acquisition module should cover part or all of the exposed area of ​​the eyeball. Figure 1 (As shown). Of course, while acquiring eyeball images, reflected light from the surrounding areas of the eye 100 can also be received, thereby obtaining images containing the eyeball and the surrounding areas of the eye 100 (such as eyebrows), providing the possibility to obtain facial information through algorithms, and to identify facial features, facial expressions and other information.

[0044] Figure 2 This is a second schematic diagram of the structure of an image acquisition device provided in an embodiment of this application. Figure 2 The image shows the user's two eyes 100, and also illustrates the structure of the image acquisition device adapted to both eyes. Figure 2 The following explanation is provided:

[0045] Users typically observe their environment using both eyes; therefore, to improve the accuracy of eye-tracking, please refer to... Figure 2This design allows the image acquisition device to include two first acquisition modules 210. One of these modules can acquire images of the left eye 100, while the other can acquire images of the right eye 100. By comprehensively analyzing the image information acquired by each of the two modules 210, accurate identification of the user's gaze direction can be achieved. It should be understood that using two first acquisition modules 210 corresponding to both eyes 100 improves gaze tracking accuracy while minimizing the number of components in the image acquisition device, thus simplifying its structure and making it suitable for wearable devices.

[0046] After clarifying the correspondence between the two first acquisition modules 210 and the two eyes 100, combined with Figure 1 The process of one of the first acquisition modules 210 acquiring an image of its corresponding eye 100 is described below (the other first acquisition module 210 should be understood in the same way): The image acquisition device is placed in a suitable position so that the field of view 213 of one of the first acquisition modules can match the position of its corresponding eye 100. Here, matching only means that the field of view 213 of the first acquisition module can at least cover part of the eye 100. After the ambient light is reflected by the user's eye 100, a portion of the light (including light 101 in the visible light band) will propagate towards and enter the first acquisition module 210 as reflected light. In this way, the first acquisition module 210 can at least sense the visible light band in the reflected light and form an image accordingly.

[0047] Please continue to refer to Figure 1 The first acquisition module 210 includes an image sensor 211.

[0048] The image sensor 211 can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) sensor; both technologies are within the scope of protection of this application. This application does not limit the specific sensor type, and the appropriate sensor can be flexibly selected according to actual application requirements. As the core component of photoelectric conversion, the image sensor 211 receives light signals through its photosensitive unit and converts them into corresponding electrical signals. These electrical signals then undergo analog-to-digital conversion, signal amplification, and digital processing to ultimately form image information that can be analyzed.

[0049] In an optional embodiment of this application, the first acquisition module does not include a filter. Therefore, reflected light incident on the first acquisition module 210 can be incident on the image sensor for imaging without being filtered by a filter. This further simplifies the structure of the first acquisition module 210, making it thinner and lighter. For example, the first acquisition module does not include a filter with an infrared bandpass. As mentioned above, the image acquisition device of this application can use visible light from ambient light to acquire images of the eye, so it does not need to include a filter with an infrared bandpass. This also distinguishes the image acquisition device of this application from the prior art, which uses an infrared bandpass filter because it relies entirely on an infrared supplementary light lamp for light.

[0050] It should be understood that the visible light band in this application refers to the light band that can be perceived by the human eye, such as about 380nm to 780nm, although it may vary appropriately.

[0051] As described above, the image acquisition device is capable of acquiring images of the eye 100 for eye tracking. To further enrich the information that the image acquisition device can acquire, in some possible implementations, such as... Figure 2 As shown, the image acquisition device can also be configured with a second acquisition module 230. The second acquisition module 230 can acquire image information of the surrounding environment. In other words, the field of view of the second acquisition module 230 covers at least part of the visual field of both eyes, making it possible to obtain more scene information through subsequent analysis of this image information, and helping to expand more functions based on the image acquisition device. The following will combine... Figure 2 Here is an illustrative explanation of one of its extended functions:

[0052] Building upon the ability of the first acquisition module 210 to achieve eye tracking, environmental image information acquired by the second acquisition module 230 can be overlaid. This allows devices equipped with image acquisition devices to perceive the content the user is looking at, thereby enabling interaction and improving the user experience. Figure 2As shown, the field of view 231 of the second acquisition module is roughly equivalent to the observation area 110 of the user's eyes 100 (the field of view of both eyes). This allows the device to acquire the scene information visible to the user's eyes 100 via the second acquisition module 230. When the device knows the direction of the user's gaze based on the first acquisition module 210, it can determine the content the user is interested in and output interactive information accordingly. For example, when the user's gaze is focused on clothing in a shop window, the device can obtain the image information of the clothing based on the first and second acquisition modules 210 and 230, thus responding to the user's needs by outputting interactive information related to the clothing's material, price, etc. Of course, in other embodiments, the field of view 231 of the second acquisition module can be appropriately larger or smaller than the observation area 110 of the user's eyes 100. When the field of view 231 of the second acquisition module is smaller than the observation area 110 of the user's eyes 100, it should ideally cover the center of the observation area 110 of the user's eyes 100.

[0053] In some possible implementations, such as Figure 2 As shown, the second acquisition module 230 can be positioned between the two first acquisition modules 210. This centrally located structure can make full use of the field of view of the second acquisition module 230.

[0054] In some possible implementations, similar to the first acquisition module 210, the second acquisition module 230 can also use ambient light to acquire images.

[0055] In some possible implementations, the second acquisition module 230 may have wide-angle characteristics, such as a field of view of 90 to 120 degrees, thereby enabling the second acquisition module 230 to receive light at a wide angle, thus enabling it to acquire scene information over a wider range.

[0056] The image acquisition device described above can acquire images using ambient light. Therefore, when the first acquisition module 210 and / or the second acquisition module 230 acquire images, they are inevitably affected by the intensity of ambient light. Therefore, it is necessary to improve the adaptability of the first acquisition module 210 and the second acquisition module 230 to the environment. Taking the first acquisition module 210 as an example, the following explanation is provided:

[0057] The first acquisition module 210 can automatically adjust its exposure parameters according to the ambient light intensity, such as automatically adjusting the exposure time: when the ambient light increases from weak to strong, it can shorten the exposure time to avoid overexposure and ensure image quality; while when the ambient light decreases from strong to weak, it can extend the exposure time to ensure the amount of light entering the camera and ensure image quality. This enables the first acquisition module 210 to have stable image quality under different ambient light conditions.

[0058] Figure 3 This is the third schematic diagram of the structure of an image acquisition device provided in the embodiments of this application. Figure 3 The image acquisition device also includes an infrared light source 220. In low-light scenarios, such as extremely dark scenes (e.g., at night), the ambient light entering the first acquisition module 210 is minimal. Simply adjusting exposure parameters may significantly reduce image acquisition efficiency, for example, by requiring excessively long exposure times. To ensure image clarity while maintaining the usability of the image acquisition device, the first acquisition module 210 can receive infrared light 221. Specifically, in addition to the visible light band, the reflected light also includes the infrared band. Furthermore, an infrared light source 220 that emits infrared light is included, thus constructing a solution that enables the image acquisition device to acquire image information from the eye 100 in extremely dark scenes.

[0059] Specifically, in extremely low-light scenarios, turn on the infrared light source 220 for supplemental lighting, as shown in the following example. Figure 3 Infrared light source 220 emits infrared light 221 towards the field of view 213 of the first acquisition module. After the infrared light 221 reaches the eye 100, at least a portion is reflected by the eye 100 as reflected light and then enters the first acquisition module 210. The infrared light 221 can directly enter the image sensor 211 for imaging without filtering. Finally, in conjunction with an infrared gaze tracking algorithm, the gaze of the eye 100 can be tracked even in extremely low-light conditions.

[0060] It should be understood that the activation time of the infrared light source 220 can be reasonably controlled according to actual needs. For example, in a strong light environment, the infrared light source 220 is not activated to avoid interference caused by the strong light environment on the infrared light source 220's supplementary lighting. However, when the ambient light is so weak that adjusting the exposure parameters alone cannot guarantee image quality (such as in extremely low light scenes), in other words, when the brightness of the visible light band in the environment where the image acquisition device is located is lower than the brightness threshold, the infrared light source 220 is activated. Utilizing the characteristic that the first acquisition module 210 can receive infrared light, image quality is guaranteed. Of course, the brightness threshold can be reasonably set according to actual conditions.

[0061] In some possible implementations, the two first acquisition modules 210 can share the infrared light source 220 to minimize the number of infrared light sources 220. Of course, in combination with... Figure 2 and Figure 3Alternatively, each first acquisition module 210 may be equipped with at least one infrared light source 220. In addition, each infrared light source 220 may include at least one infrared light emitter (laser or LED), and their arrangement can be reasonably set according to actual needs, such as being located on one side of the first acquisition module 210, or arranged around the first acquisition module 210.

[0062] In summary, the solution for improving the environmental adaptability of the first acquisition module 210 is illustrated using the first acquisition module 210 as an example. Based on this, when the second acquisition module 230 is required to also have high environmental adaptability, similar settings can be made for the second acquisition module 230 by referring to the first acquisition module 210. For example, the second acquisition module 230 can be equipped with the ability to automatically adjust exposure parameters and to configure the form of supplementary lighting.

[0063] To ensure image quality, the object plane of the first acquisition module 210 can be positioned approximately at the eye 100. Furthermore, the first acquisition module 210 can also be configured with an optical path guiding structure. This structure guides the light rays incident on the first acquisition module 210 smoothly into the image sensor 211, further improving image quality. The optical path guiding structure can be a lens group (formed by one or more large lenses) or a microlens structure (integrated on the surface or inside the image sensor 211). This application does not limit its application; it should be understood that... Figures 1 to 3 The image shows the lens barrel on which the lens assembly is mounted.

[0064] In some possible implementations, the first acquisition module 210 and / or the second acquisition module 230 may be presented as a camera or a webcam.

[0065] In another aspect of the embodiments of this application, a wearable device is provided, including a wearable body and an image acquisition device as described above, wherein the image acquisition device is disposed on the wearable body.

[0066] By applying an image acquisition device to wearable devices, images of the user's eyes can be captured, especially in bright light environments, thereby improving the eye-tracking recognition performance of wearable devices.

[0067] The wearable device in this application can be a head-mounted device such as AR (Augmented Reality), VR (Virtual Reality), MR (Mixed Reality), or XR (Extended Reality), and this application does not limit it. For ease of understanding, the following will be combined with... Figure 4 An illustrative explanation is provided for wearable devices used as smart glasses 300:

[0068] Figure 4 This is a schematic diagram of the structure of a smart glasses 300 provided in an embodiment of this application. The smart glasses 300 includes a wearable main body and an image acquisition device disposed on the wearable main body. The wearable main body includes a frame and a lens 310 mounted to the frame, through which the user's eyes can observe the external environment. Figure 4 Only the lens 310 portion of the wearable body is shown; the frame (frame and temples) is not shown. A first acquisition module 210 and an infrared light source 220 (optional) are provided at the edge of the lens 310 to minimize obstruction of the eye 100's line of sight while the first acquisition module 210 acquires images of the eye 100.

[0069] In addition, a second data acquisition module 230 can also be set in the wearable body, for example... Figure 4 In the middle, the second acquisition module 230 is integrated into the lens 310, and it is located at the connection between the left and right lenses 310.

[0070] In different implementations, the image acquisition device may also be mounted on the frame of the smart glasses.

[0071] In some possible implementations, the wearable device also includes a communication module electrically connected to the image acquisition device. This allows the wearable device to interact with the electronic device via the communication module, enabling the wearable device to perform data processing and analysis with the help of the electronic device, thereby further reducing the size and weight of the wearable device. This data interaction includes both control command interaction and image data interaction. For example, control command interaction: users can control the wearable device using buttons on the program interface of the electronic device, such as turning it on or off. Image data interaction: eye images and environmental images captured by the image acquisition device can be sent to the electronic device for processing, enabling eye tracking and perception of the environment observed by the user's eyes.

[0072] Of course, the electronic devices mentioned here can be mobile phones, tablets, smartwatches, smart bracelets, smart cockpits, etc.

[0073] Before the image acquisition device or wearable device is used by the user, it can be trained to perform eye-tracking learning. Based on this, another aspect of the embodiments of this application is as follows: Figure 5 or Figure 6 A data acquisition device is provided, comprising: a target gaze device 410 and an image acquisition device or a wearable device of any of the above.

[0074] Specifically, refer to Figure 5 or Figure 6When data calibration or prediction training is required, wearable devices can be worn by the data acquisition personnel (ensuring the relative positions of the first acquisition module, glasses, and second acquisition module are fixed). A target gaze device 410 is set within the observation area 110 of the data acquisition personnel's eyes 100. The target gaze device 410 may have an identifier 411 that can be gazed upon by the data acquisition personnel's eyes 100.

[0075] Given that the positions of the marker 411 in the target gaze device 410 and the personnel in space are known, when the personnel gaze at the marker 411, the first acquisition module 210 acquires an image of the eye 100 at that moment. This indicates that the image of the eye 100 corresponds to the marker 411, meaning that the gaze direction of the eye 100 in the current image corresponds to the position of the marker 411 in space. During the movement of the target gaze device, the two first acquisition modules can acquire multiple frames of eye images. These acquired frames are used for data calibration (obtaining the user's personal data for calibration, such as the kappa angle) or for prediction training. Through repeated learning and training, the image acquisition device or wearable device can achieve a relatively accurate gaze tracking function, facilitating user operation. Of course, a processor can be added to run the aforementioned program components.

[0076] In some possible implementations, the data acquisition device further includes a moving device 420, which is driven and connected to the target gaze device 410. The moving device 420 is used to move the target gaze device 410 within a preset area, which is at least a portion of the observation area 110 of the eye 100. The moving device 420 can continuously change the position of the target gaze device 410, thereby enabling multi-position learning and training.

[0077] The preset area for the moving device 420 to move the target gaze component 410 can be a two-dimensional plane area or a three-dimensional solid area. When the requirements for eye tracking are not high, the target gaze component 410 can be moved only in the two-dimensional plane area. When the requirements for eye tracking are higher, the target gaze component 410 can be moved in the three-dimensional solid area, which can achieve more accurate eye tracking.

[0078] In some possible implementations, the moving device 420 is a dual-axis moving mechanism, and the target viewing element 410 is disposed within the dual-axis moving mechanism. The dual-axis moving mechanism can drive the target viewing element 410 to move in two intersecting directions. Therefore, the preset area moved by the target viewing element 410 is a two-dimensional planar area. It should be noted that, generally speaking, the two-dimensional planar area should be perpendicular to the line of sight of the data acquisition personnel 100. For example... Figure 5As shown, the dual-axis movement mechanism includes a frame 421 and guide rails 422 disposed on the frame 421. The target viewing element 410 is slidably connected to the guide rails 422 along a first direction (e.g., horizontal direction) and a second direction (e.g., vertical direction). By adding a driver to drive the guide rails 422 to slide relative to the frame 421 and the target viewing element 410 to slide relative to the guide rails 422, dual-axis movement of the target viewing element 410 is achieved. This allows the target viewing element 410 to move both horizontally and vertically. Alternatively, two guide rails 422 can be added, which can also drive the target viewing element 410 to move along two directions on the two guide rails respectively.

[0079] In some possible implementations, the moving device 420 is a three-axis moving mechanism, and the target viewing element 410 is disposed on the three-axis moving mechanism. Based on the aforementioned two-axis moving mechanism, an additional degree of freedom in the forward and backward direction is added. Figure 5 Based on the above, the three-axis motion mechanism can also drive the target viewing element 410 to move in a direction closer to or further away from the eye 100.

[0080] It should be understood that the above-mentioned dual-axis moving mechanism can use a dual-axis slide table, and the three-axis moving mechanism can use a three-axis slide table.

[0081] In some possible implementations, such as Figure 6 As shown, the moving device 420 is a multi-axis robotic arm 424, which includes sequentially movably connected arm segments. The target viewing element 410 is disposed at the end of the multi-axis robotic arm 424. The multi-axis robotic arm 424 can drive the target viewing element 410 to move within a three-dimensional area.

[0082] In some possible implementations, the mobile device may also be a robotic arm 427, wherein the robotic arm 427 may be a single-segment robotic arm or a multi-axis robotic arm.

[0083] When the robotic arm is a single-segment robotic arm, such as Figure 7As shown, the target viewing element 410 is fixed to the end of a single-section robotic arm. The single-section robotic arm also has an end opposite to the end, which is rotatably connected to a fixed point 425. For example, the fixed point 425 can be located on a wall or frame. Therefore, the single-section robotic arm can drive the target viewing element 410 to rotate around the fixed point 425. Simultaneously, the single-section robotic arm can adjust the distance between the target viewing element 410 and the fixed point 425 by extending and retracting, thereby controlling the movement of the target viewing element 410 within its movable range 426. In actual control, the movement area of ​​the target viewing element 410 can be fan-shaped, circular, etc. Furthermore, the single-section robotic arm can also drive the target viewing element 410 to move in the forward and backward direction, which here refers to the vertical direction. Figure 7 The direction in which the circular plane is enclosed by the dashed lines.

[0084] When the robotic arm is a multi-axis robotic arm, such as Figure 7 As shown, the other end of the multi-axis robotic arm is rotatably connected to a fixed point 425, such as a wall or frame. Therefore, the multi-axis robotic arm can drive the target viewing element 410 to rotate around the fixed point 425. Simultaneously, the multi-axis robotic arm can adjust the distance between the target viewing element 410 and the fixed point 425 by moving different arm segments closer to or further away, thereby controlling the target viewing element to move within its movable range 426. In actual control, the movement area of ​​the target viewing element can be fan-shaped, circular, etc. Furthermore, the multi-axis robotic arm can also drive the target viewing element 410 to move in the forward and backward direction, where forward and backward refers to vertical movement. Figure 7 The direction in which the circular plane is enclosed by the dashed lines.

[0085] In some possible implementations, the shape of the two-dimensional planar region is not limited, such as it can be a triangular region, a square region, or a circular region, and the shape of the three-dimensional solid region is also not limited, such as it can be a triangular pyramid, a cube, or a sphere.

[0086] In some possible implementations, the target viewing device 410 is a self-emissive display screen, such as an LCD screen, LED screen, or OLED screen, and the identifier 411 is a pattern displayed on the self-emissive display screen. It should be understood that because the self-emissive display screen can emit light outwards, the eye 100 is easily affected by this type of light during the data acquisition process. For example, the iris may show a noticeable fixed bright spot. This can lead to significant data bias when the actual usage environment differs greatly from the data acquisition environment, potentially affecting the algorithm's accuracy. Therefore, when performing the aforementioned data acquisition for learning and training, the self-emissive display screen can be placed at a greater distance from the eye 100 to reduce the impact.

[0087] In some possible implementations, the target viewing element 410 is a reflective display screen. A reflective display screen can use external light (such as natural light or ambient light) to reflect images, therefore, the identifier 411 is a pattern displayed on the reflective display screen. This utilizes the non-self-emissive display characteristic of the reflective display screen to improve upon the problems of the aforementioned self-emissive display screens. For example, it avoids the formation of obvious bright spots in the acquired eye images, which could lead to model overfitting. Furthermore, the reflective display screen can display and allow eye viewing smoothly even in strong outdoor light conditions, avoiding the difficulty in clear observation caused by limited screen brightness in strong outdoor light environments. Displaying the identifier 411 on the reflective display screen allows for continuous changes to the identifier 411, such as continuous size changes, thereby alleviating visual fatigue caused by eye fixation during learning and training.

[0088] Reflective displays include reflective liquid crystal displays (LCDs), e-ink displays, etc.

[0089] The basic principles of this application have been described above with reference to specific embodiments. However, it should be noted that the advantages, benefits, and effects mentioned in this application are merely examples and not limitations, and should not be considered as essential features of each embodiment of this application. Furthermore, the specific details disclosed above are for illustrative and facilitative purposes only, and are not limitations. These details do not limit the application to the necessity of employing the aforementioned specific details for implementation.

[0090] The block diagrams of devices, apparatuses, devices, and systems involved in this application are merely illustrative examples and are not intended to require or imply that they must be connected, arranged, or configured in the manner shown in the block diagrams. As those skilled in the art will recognize, these devices, apparatuses, devices, and systems can be connected, arranged, and configured in any manner. Words such as “comprising,” “including,” “having,” etc., are open-ended terms meaning “including but not limited to,” and are used interchangeably with them. The terms “or” and “and” as used herein refer to the terms “and / or,” and are used interchangeably with them unless the context clearly indicates otherwise. The term “such as” as used herein refers to the phrase “such as but not limited to,” and is used interchangeably with it.

[0091] It should also be noted that in the apparatus, equipment, and methods of this application, the components or steps can be disassembled and / or recombined. These disassemblies and / or recombinations should be considered as equivalent solutions of this application.

[0092] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use this application. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein can be applied to other aspects without departing from the scope of this application. Therefore, this application is not intended to be limited to the aspects shown herein, but rather to be accorded the widest scope consistent with the principles and novel features disclosed herein.

[0093] The above description has been given for purposes of illustration and description. Furthermore, this description is not intended to limit the embodiments of this application to the forms disclosed herein. Although numerous exemplary aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, alterations, additions, and sub-combinations thereof.

Claims

1. An image acquisition device, characterized in that, include: Two first acquisition modules are provided, each corresponding to one of the two eyes. The field of view of each first acquisition module covers at least the portion of the corresponding eye. Reflected light from the eye is received by the first acquisition module corresponding to that eye and the image of the eye is acquired. The reflected light includes at least the visible light band.

2. The image acquisition device as described in claim 1, characterized in that, The first acquisition module includes: An image sensor in which the reflected light is incident on the image sensor without being filtered, thus forming an image.

3. The image acquisition device as described in claim 1, characterized in that, The image acquisition device also includes: An infrared light source is used to emit infrared light towards the field of view of the two first acquisition modules when the brightness of visible light in the environment is lower than a brightness threshold. The reflected light also includes light in the infrared band.

4. The image acquisition device according to any one of claims 1 to 3, characterized in that, The image acquisition device also includes: The second acquisition module has a field of view that covers at least a portion of the visual field of the two eyes, and is used to acquire images of the covered visual field.

5. A wearable device, characterized in that, It includes a wearable body and an image acquisition device as described in any one of claims 1 to 4, wherein the image acquisition device is disposed on the wearable body.

6. A data acquisition device, characterized in that, include: A movable target gaze device, the target gaze device having markings for eye gaze; In the image acquisition device according to any one of claims 1 to 4 or the wearable device according to claim 5, during the movement of the target gaze device, the two first acquisition modules of the wearable device are used to acquire multiple frames of images of the eye.

7. The data acquisition device as described in claim 6, characterized in that, The data acquisition device also includes: A mobile device is driven to connect to the target gaze device, and the mobile device is used to move the target gaze device within a preset area, the preset area being at least a portion of the eye's observation area.

8. The data acquisition device as described in claim 7, characterized in that, The mobile device includes: A dual-axis moving mechanism, wherein the target viewing element is disposed on the dual-axis moving mechanism, and the preset area is a two-dimensional planar area; Alternatively, a three-axis moving mechanism, wherein the target viewing element is disposed on the three-axis moving mechanism, and the preset area is a three-dimensional solid area; Alternatively, a multi-axis robotic arm, wherein the target viewing element is disposed at the end of the multi-axis robotic arm, and the preset area is a three-dimensional region.

9. The data acquisition device as described in claim 7, characterized in that, The mobile device includes a robotic arm, the target viewing element is disposed at the end of the robotic arm, and the other end of the robotic arm opposite to the end is rotatably connected to a fixed point.

10. The data acquisition device according to any one of claims 7 to 9, characterized in that, The target viewing device is a reflective display screen, and the identifier is a pattern displayed on the reflective display screen.

Images