Wearable optical equipment

Abstract

Embodiments of the present specification provide a wearable optical device. The wearable optical equipment comprises a main body, a lens module and a shooting module, the main body can be configured to be wearable on the head of a user, the lens module is arranged on the main body, the lens module comprises an eyepiece group and an objective lens group, when the user wears the optical equipment, the eyepiece group faces the eyes of the user, and the objective lens group faces the eyes of the user. The lens module can amplify a target landscape in a preset view field by a preset multiple, at least one of the eyepiece group or the lens group comprises a super-structure lens, the shooting module is also arranged on the main body, and the shooting module can convert the target landscape into image data when working.

Description

Technical Field

[0001] The present invention relates to the field of optics, and in particular to a wearable optical device. Background Art

[0002] Telescopes are widely used in daily life. They not only provide a window for astronomy enthusiasts to observe the starry sky, allowing them to explore the mysteries of the universe, but are also widely used in outdoor activities such as bird watching and hunting, helping enthusiasts observe distant animals and natural landscapes. In sports events and concerts, telescopes enable audiences to clearly see athletes or performers in the distance, enhancing the on-site experience.

[0003] The content of the background technology section is only the information known to the inventor personally, and does not mean that the above information has entered the public domain before the application date of this disclosure, nor does it mean that it can become the prior art of the present disclosure. Summary of the invention

[0004] This specification provides a wearable optical device that uses a meta-lens to achieve a telescopic function, while ensuring the magnification of the device, making the device thinner and lighter, and improving the comfort of the user when wearing the device.

[0005] In a first aspect, the present specification provides a wearable optical device. The wearable optical device includes a main body, a lens module, and a shooting module, wherein the main body can be configured to be wearable on the user's head, the lens module is arranged on the main body, and includes an eyepiece group and an objective lens group, when the user wears the optical device, the eyepiece group faces the user's eyes, and the lens module magnifies the target landscape within a preset field of view by a preset multiple, wherein at least one of the eyepiece group or the objective lens group includes a meta-lens, and the shooting module is arranged on the main body, and when the shooting module is working, the target landscape is converted into image data.

[0006] In some embodiments, the eyepiece group includes a first meta-lens, and the objective lens group includes a second meta-lens, wherein the first meta-lens has positive optical power and the second meta-lens has positive optical power, or the first meta-lens has negative optical power and the second meta-lens has positive optical power.

[0007] In some embodiments, the wearable optical device is eyeglasses.

[0008] In some embodiments, the effective exit pupil diameter range of the lens module corresponding to the exit pupil includes no less than 6 mm; the preset magnification range includes 3 times to 6 times; and the effective entrance pupil diameter range of the lens corresponding to the objective lens group includes no more than 40 mm.

[0009] In some embodiments, the device also includes an adjustment module, which is connected to at least one of the eyepiece group or the objective lens group and is configured to adjust the position of the focus of at least one of the eyepiece group or the objective lens group, thereby adjusting the clarity of the target landscape observed by the user to adapt to the user's vision.

[0010] In some embodiments, the target landscape recorded by the shooting module is the target landscape magnified by the preset multiple.

[0011] In some embodiments, ambient light enters the lens module through the objective lens group, propagates along the first optical path and exits from the eyepiece group; the shooting module includes a shooting incident end and a shooting output end; the ambient light enters the shooting module through the shooting incident end, propagates along the second optical path, exits from the shooting output end, and enters the photosensitive device of the shooting module; and the first optical path and the second optical path are different.

[0012] In some embodiments, the shooting module includes a front lens group and a rear lens group; the front lens group is the shooting incident end, and the rear lens group is the shooting output end; and the front lens group has the same optical focal length as the objective lens group, and the rear lens group has the same optical focal length as the eyepiece group.

[0013] In some embodiments, the device also includes a spectrometer located on the first optical path; ambient light enters the lens module through the objective lens group, propagates along the first optical path and is incident on the spectrometer; the spectrometer divides the ambient light into first ambient light and second ambient light; the first ambient light is emitted from the eyepiece group and enters the user's eyes, and the second ambient light enters the second optical path; the shooting module is located on the second optical path, including a shooting incident end and a shooting output end; the second ambient light enters the shooting module through the shooting incident end, leaves from the shooting output end, and enters the photosensitive device of the shooting module.

[0014] In some embodiments, the device also includes an interactive module, which is disposed on the main body, receives target instructions and image data collected by the shooting module, and performs corresponding target operations on the shooting module based on the AI ​​model.

[0015] In some embodiments, the interaction module includes a sound pickup component, a communication component and a control component. The sound pickup component is configured to collect the user's voice information; the communication component is configured to establish a connection with a remote server where the AI ​​model is deployed to transmit the user's voice information and the image data to the server; the control component is configured to receive the target instruction sent by the server, and to perform the target operation based on the target instruction, wherein the target instruction is an instruction obtained by the AI ​​model analyzing the voice information.

[0016] In some embodiments, the voice information includes daily language uttered by the user, the daily language does not include instruction language, and the target instruction is an instruction obtained by the AI ​​model through autonomous analysis of the daily language.

[0017] In some embodiments, the interaction module further includes a speaker component, and the speaker component is configured to receive an execution result of the target operation through the communication component and emit the execution result.

[0018] It can be seen from the above technical solutions that the wearable optical device provided in this specification includes a main body, a lens module and a shooting module, wherein the main body can be configured to be wearable on the user's head, the lens module is arranged on the main body, including an eyepiece group and an objective lens group, when the user wears the optical device, the eyepiece group faces the user's eyes, and the lens module magnifies the target landscape in the preset field of view by a preset multiple, wherein at least one of the eyepiece group or the lens group includes a meta-lens, and the shooting module is arranged on the main body, and the shooting module converts the target landscape into image data when working. The above optical device uses a small-sized and light-weight meta-lens to form a lens module, while ensuring the magnification of the device, it can greatly compress the distance between the eyepiece group and the objective lens group, realize the thinness of the device, and thus improve the comfort of the user when wearing the device. The shooting module can synchronously and stably record the target landscape seen by the user's eyes. And because the device is thin, the user is more willing to wear the device, and the user has a longer interaction time with the device. In this case, the interactive module on the device can interact with the user when the user wears the device, obtain the user's voice information, and process the voice information more intelligently based on the AI ​​model.

[0019] In summary, other functions of the wearable device provided by this specification will be partially listed in the following description. According to the description, the contents introduced by the following figures and examples will be obvious to those of ordinary skill in the art. The creative aspects of the wearable optical device provided by this specification can be fully explained by practicing or using the methods, devices and combinations described in the following detailed examples. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the embodiments of this specification, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0021] Figure 1 A schematic diagram of the structure of a wearable optical device provided according to some embodiments of this specification is shown;

[0022] Figure 2A A schematic diagram of an optical structure inside a device provided according to some embodiments of this specification is shown;

[0023] Figure 2B A schematic diagram of an optical structure inside another device provided according to some embodiments of this specification is shown;

[0024] Figure 3A A schematic diagram of an optical structure inside a device provided according to some embodiments of this specification is shown;

[0025] Figure 3B A schematic diagram of an optical structure inside another device provided according to some embodiments of this specification is shown;

[0026] Figure 4 A schematic diagram of an internal optical path of a device provided according to some embodiments of this specification is shown;

[0027] Figure 5 A schematic diagram showing an internal optical path of another device provided according to some embodiments of this specification; and

[0028] Figure 6 A schematic diagram of an application scenario of a device according to some embodiments of this specification is shown. DETAILED DESCRIPTION

[0029] The following description provides specific application scenarios and requirements of this specification, with the purpose of enabling those skilled in the art to make and use the contents of this specification. Various local modifications to the disclosed embodiments will be apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of this specification. Therefore, this specification is not limited to the embodiments shown, but to the widest scope consistent with the claims.

[0030] The terms used herein are only used for the purpose of describing specific example embodiments and are not restrictive. For example, unless the context clearly indicates otherwise, as used herein, the singular forms "a", "an" and "the" may also include plural forms. When used in this specification, the terms "include", "comprise" and / or "contain" mean that the associated integers, steps, operations, elements and / or components exist, but do not exclude the existence of one or more other features, integers, steps, operations, elements, components and / or groups or that other features, integers, steps, operations, elements, components and / or groups may be added in the system / method.

[0031] In view of the following description, these and other features of the present specification, as well as the operation and function of the related elements of the structure, and the economy of the combination and manufacture of the parts can be significantly improved. Reference is made to the accompanying drawings, all of which form a part of this specification. However, it should be clearly understood that the drawings are for illustration and description purposes only and are not intended to limit the scope of this specification. It should also be understood that the drawings are not drawn to scale.

[0032] The flowcharts used in this specification illustrate the operations implemented by the system according to some embodiments in this specification. It should be clearly understood that the operations of the flowcharts may not be implemented in sequence. On the contrary, the operations may be implemented in reverse order or simultaneously. In addition, one or more other operations may be added to the flowchart. One or more operations may be removed from the flowchart.

[0033] In this specification, "X includes at least one of A, B or C" means that X includes at least A, or X includes at least B, or X includes at least C. That is, X may include only any one of A, B, and C, or may include any combination of A, B, and C and other possible contents / elements at the same time. The any combination of A, B, and C may be A, B, C, AB, AC, BC, or ABC.

[0034] In this specification, unless explicitly stated otherwise, the association relationship between structures can be a direct association relationship or an indirect association relationship. For example, when describing "A is connected to B", unless it is explicitly stated that A is directly connected to B, it should be understood that A can be directly connected to B or indirectly connected to B; for another example, when describing "A is above B", unless it is explicitly stated that A is directly above B (AB is adjacent and A is above B), it should be understood that A can be directly above B or indirectly above B (AB is separated by other elements and A is above B). And so on.

[0035] Figure 1 A schematic structural diagram of a wearable optical device 100 provided according to some embodiments of the present specification is shown. Figure 1The wearable optical device 100 (hereinafter referred to as the device 100) shown in the figure is glasses. The following description is based on the example that the device 100 is glasses. It can be known that the device 100 can also be other optical devices such as AR / VR / MR head-mounted integrated device, telescope, GoPro, etc. Figure 1 As shown, the device 100 includes a main body 110 and a lens module 120. In some embodiments, the device may further include a shooting module 130. In some embodiments, the device 100 may further include an interaction module 140.

[0036] The main body 110 is configured to be wearable on the user's head. The shape of the main body 110 can adapt to the user's head. For example, the main body 110 of the glasses includes a frame and temples. The frame can be used to fix other modules (for example, the lens module 120, the shooting module 130, and the interactive module 140, etc.). The temples can fix the device 100 on the user's ears. For another example, the main body 110 can be a fixing seat and a headband of a telescope. The fixing seat can be used to fix other modules. The headband can fix the device 100 on the user's head. The material of the main body 110 can be any material, such as metal, plastic, polymer, rubber, etc. This specification does not limit the shape and material of the main body 110.

[0037] The device 100 is fixed on the user's head through the main body 110, so that the user does not need to hold the device 100 when using it in various activities or scenarios, which can reduce the burden on the user's hands, thereby increasing the interaction time between the user and the device 100 and ensuring that the shooting module 130 can obtain more stable image data when working.

[0038] The lens module 120 is disposed on the main body 110. The lens module 120 includes an eyepiece group and an objective lens group. When the user wears the optical device 100, the eyepiece group faces the user's eyes, and the lens module 120 magnifies the target landscape within the preset field of view by a preset multiple, thereby meeting the user's telescopic needs. The preset field of view can be an area or range that can be observed by both eyes of the user, or it can be other defined ranges.

[0039] When the device 100 is a pair of glasses, the user can see the magnified target landscape by simply wearing the glasses. For example, in a concert scene, the user can watch the performance of a favorite singer more clearly by wearing the glasses. For another example, in an animal observation scene, the user can watch the animal more clearly and safely by wearing the glasses.

[0040] By magnifying the target landscape through the lens module 120, the user can clearly observe the distant scene, thereby satisfying the user's telescopic needs. In addition, the telescopic function is directly set on the lightweight glasses, which can provide the user with a wide field of view while ensuring the comfort and convenience of the user when using. In particular, when the user's head moves quickly, such as shaking the head, the device 100 can synchronously and quickly magnify the details that the user needs to observe after the line of sight changes, thereby providing a continuous and stable magnified visual effect.

[0041] Figure 2A A schematic diagram of the optical structure inside a device 100 provided according to some embodiments of the present specification is shown. Figure 2B FIG. 1 shows a schematic diagram of an optical structure inside another device 100 provided according to some embodiments of this specification. Figure 2A and Figure 2B As shown, the lens module 120 includes an eyepiece group 121 and an objective lens group 122. The eyepiece group 121 and the objective lens group 122 may include one or more lenses. The lens may be a single lens. The single lens may achieve the refraction of light through its physical curvature.

[0042] like Figure 2A As shown, the eyepiece group 121 may include a convex lens with positive optical power, and the objective lens group 122 may include a convex lens with positive optical power. Figure 2B As shown, the eyepiece group 121 may include a concave lens with negative optical power, and the objective lens group 122 may include a convex lens with positive optical power.

[0043] Ambient light, such as light emitted by a target scene, may be incident on the objective lens group 122 , enter the lens module 120 through the objective lens group 122 , and be incident on the user's eye E from the eyepiece group 121 .

[0044] The magnification of the telescope can be defined as the ratio of the focal length of the objective lens of the telescope divided by the focal length of the eyepiece, or the ratio of the effective entrance pupil diameter of the objective lens to the effective exit pupil diameter of the eyepiece. Assume that the effective entrance pupil diameter of the objective lens group 122 is D1, and the effective exit pupil diameter of the eyepiece group 121 is D2. The magnification M of the lens module 120 can be expressed as D1 / D2. The magnification can be a preset multiple.

[0045] The length L of the lens module 120 can be considered as the distance between the eyepiece group 121 and the objective lens group. Figure 2A and Figure 2BL in the figure may not be equal. The length 120 can also be considered as the thickness of the glasses. The length L of the lens module 120 is usually related to multiple factors such as the magnification, the diopter of the lens, etc. By changing these factors, the length of the lens module 120 can be shortened and the thickness of the glasses can be reduced. For example, by reducing the diopter of the eyepiece, the preset magnification of the telephoto part is reduced, so that the length of the lens module 120 is shortened. For another example, in some embodiments, the length of the lens module 120 can be shortened by enhancing the diopter of the lens group. However, in geometric optics, the refractive power of a single lens for light is limited, and it may not be possible for the device 100 to reach a predetermined magnification at such a thin thickness as the glasses. In some embodiments, the number of lenses can be increased to achieve a preset magnification with multiple lenses. However, in an optical device with a simple structure of glasses, adding lenses will make the structure of the entire glasses more complicated and increase the weight, thereby greatly affecting the user's comfort when wearing it, and greatly reducing the interaction time between the user and the device 100.

[0046] Therefore, in order to reduce the weight and thickness of the entire glasses and improve the user's comfort when wearing them, this specification provides a lens module using a meta lens. Figure 3A A schematic diagram of the optical structure inside a device 100 provided according to some embodiments of the present specification is shown. Figure 3B A schematic diagram of the optical structure inside another device 100 provided according to some embodiments of the present specification is shown, wherein at least one of the eyepiece lens group 121 or the objective lens group 122 includes a meta-lens.

[0047] For the convenience of demonstration, the following embodiments in this specification will be described by taking the example that the eyepiece group 121 and the objective lens group 122 are both composed of meta-lenses. However, those skilled in the art can fully understand other implementations, for example, the eyepiece group 121 is composed of a meta-lens, the objective lens group 122 is composed of a traditional optical lens, or the eyepiece group 121 is composed of a traditional optical lens, and the objective lens group 122 is composed of a meta-lens, which can also be used as embodiments of this specification without departing from the essence of the invention.

[0048] In some embodiments, the eyepiece group 121 includes a first meta-lens M1, and the objective lens group 122 includes a second meta-lens M2. The first meta-lens M1 has a positive optical power, and the second meta-lens M2 has a positive optical power. Figure 3A As shown. Or as Figure 3B As shown, the first meta-lens M1 may have a negative optical power, and the second meta-lens M2 may have a positive optical power. The distance between the eyepiece group 121 and the objective lens group 122 is L'. It is worth noting that Figure 3A and Figure 3B The L's may not be equal.

[0049] Ambient light, such as light emitted by a target scene, may be incident on the objective lens group 122 (the second meta-lens M2 ), enter the lens module 120 through the objective lens group 122 , and be incident on the user's eye E from the eyepiece group 121 (the first meta-lens M1 ).

[0050] The device 100 can adjust the polarization, phase, amplitude and other properties of light by adjusting the shape, rotation direction, height and other parameters of the surface structure of the meta-lens. Therefore, by accurately controlling the phase of the incident light and the outgoing light, the device 100 can achieve large-angle deflection of the light by the meta-lens. In this way, the distance between the eyepiece group 121 and the objective lens group 122 can be greatly compressed without sacrificing the magnification of the telescope, thereby achieving a thin and light device 100.

[0051] by Figure 3A For example, Figure 3A The effective entrance pupil diameter of the objective lens group 121 is D1, and the effective exit pupil diameter of the eyepiece lens group 121 is D2', D2' <D2。 Figure 3A The magnification of the lens module is greater than Figure 2A Magnification in . Figure 3A The length of the middle lens module 120 is L', L' <L。 Figure 3A The length of the lens module is less than Figure 2A By using meta-lenses, a device 100 with greater magnification and smaller size can be produced.

[0052] In some embodiments, according to the optical parameters of the human eye, the effective exit pupil diameter range of the lens module 120 corresponding to the exit pupil can be no less than 6 mm. That is, the diameter of the exit light beam is no less than 6 mm. For example, the effective exit pupil diameter of the exit pupil is 6 mm, 6.5 mm, 7 mm, 7.5 mm, etc. and any value between two values. In this way, it can be ensured that the effective exit pupil diameter of the exit pupil matches the pupil diameter of the user's eye, and even in a dark environment, enough light can enter the user's eyes to provide a better observation effect.

[0053] The range of the preset magnification may include 3 times to 6 times. For example, the preset magnification may be 3 times, 4 times, 5 times, etc., and any value between two values. This ensures that the telephoto function provided by the device 100 is sufficient for users to use in daily scenes such as watching games and concerts.

[0054] The effective entrance pupil diameter range of the lens corresponding to the objective lens group 122 includes no more than 40 mm. For example, the effective entrance pupil diameter is 40 mm, 39.5 mm, 39 mm, 38 mm, 37 mm, 35 mm, 30 mm, 25 mm, etc. and any values ​​between any two values. The objective lens group 122 under this size belongs to the normal eyeglass size range, so that the size of the device 100 can be made into the size of normal eyeglasses, which is convenient for users to wear.

[0055] In some embodiments, the device 100 may further include an adjustment module. The adjustment module may be connected to at least one of the eyepiece group 110 or the objective lens group 120, and is configured to adjust the position of the focus of at least one of the eyepiece group 121 or the objective lens group 122, thereby adjusting the clarity of the target landscape observed by the user to adapt to the user's vision. For example, the adjustment module may be an adjustment knob connected to the eyepiece group 121. The adjustment knob may drive the eyepiece group 121 to move along the optical axis. The user may adjust the distance between the eyepiece group 121 and the objective lens group 122 by adjusting the knob so that the user can clearly observe the target landscape.

[0056] In some embodiments, by adjusting the metalens parameters to regulate the properties of the metalens, the clarity of the target landscape observed by the user can also be adjusted to suit the user's vision.

[0057] Therefore, by using a meta-lens to form a lens module, the distance L between the eyepiece group 121 and the objective lens group 122 and the weight of the eyepiece group 121 and the objective lens group 122 can be greatly compressed without sacrificing or reducing the magnification of the device 100, thereby achieving a lightweight device, thereby ensuring the user's comfort when wearing the device 100, making the user willing to use the device 100, and increasing the interaction time between the user and the device 100.

[0058] The shooting module 130 is disposed on the main body 110 and converts the target landscape into image data when working. Figure 1 As shown, the shooting module 130 can be embedded in the glasses frame. The shooting module 130 may include a camera with functions of shooting images, recording images, etc. The shooting module 130 may include a photosensitive device. In this way, the shooting module 130 can shoot the scene at the same viewing angle as the lens module 120. Of course, due to different actual designs, the actual position of the lens of the shooting module 130 may be different from the position of the lens module 120. For example, when the shooting module 130 is installed on the legs of the glasses, there will be a slight difference in the viewing angle between the shooting module 130 and the user 200. The technical solution of this specification ignores these tiny differences in viewing angles and assumes that the lens module 120 and the shooting module 130 have the same viewing angle for the scene.

[0059] In some embodiments, the target landscape recorded by the shooting module 130 is the target landscape after being magnified by a preset multiple. The image data converted by the shooting module 130 is the image data of the magnified target landscape. When the user observes the target landscape with his eyes, the shooting module 130 can record the magnified target landscape observed by the user in real time and synchronously. In other words, the shooting module 130 can be equivalent to the user's "other pair of eyes", and can record the scene that the user is interested in without hindering the user's observation, so as to achieve what you see is what you get.

[0060] In summary, by setting the shooting function on lightweight glasses, the shooting module 130 can record the same viewing angle and field of view as the user 200. At the same time, the shooting module 130 can move synchronously with the user's head and line of sight. In particular, when the user's head moves quickly, the shooting module 130 can synchronously, continuously and stably record the magnified target landscape. In this way, the synchronization degree between the shooting content and the scene seen by the user is higher, and the shooting content can record or restore the scene seen by the user's eyes approximately one-to-one.

[0061] Due to the use of a small, thin meta-lens, the size of the device 100 with a telescopic function is smaller and lighter, for example, it is made into a pair of glasses with the same size and weight as normal glasses. In this way, after the camera module 130 is set on the glasses, the overall weight of the device 100 is still relatively light, so that the user can still maintain comfort when wearing the device 100 for a long time.

[0062] The optical path for the shooting module 130 to shoot the target landscape and the optical path for the user to observe the target landscape may be completely different, or may be at least partially the same. Figure 4 FIG. 1 shows a schematic diagram of an internal optical path of a device 100 provided according to some embodiments of this specification. Figure 4 As shown, the shooting module 130 includes a shooting incident end 130A and a shooting emission end 130B. When the device 100 is used, on the one hand, ambient light enters the lens module 120 through the objective lens group 122 of the device 100, propagates along the first optical path P1, and is emitted from the eyepiece group 121 to enter the user's eye E; on the other hand, ambient light enters the shooting module 130 through the shooting incident end 130A, propagates along the second optical path P2, and leaves from the shooting emission end 130B to enter the photosensitive device IS of the shooting module 130.

[0063] The first optical path P1 and the second optical path P2 may be different. Figure 4As shown, the shooting module 130 may include a front lens group 131 and a rear lens group 132. The front lens group 131 may be a shooting incident end 130A, and the rear lens group 132 may be a shooting emission end 130B. The second optical path P2 passes through the front lens group 131 and the rear lens group 132. The ambient light is emitted from the rear lens group 132 to the photosensitive device IS via the second optical path.

[0064] Since the distance between the shooting module 130 and the lens module 120 is very close, it can be considered that the scenery recorded by the shooting module 130 is the same or approximately the same as the target scenery seen by the user's eyes. In order to enable the shooting module 130 to record the target scenery, in some embodiments, the optical focal length of the front lens group 131 and the objective lens group 122 can be the same, and the optical focal length of the rear lens group 132 and the eyepiece group 121 can be the same.

[0065] In order to compress the volume of the device 100 and reduce the internal space occupied by components, the optical path inside the device 100 can share some optical devices, so two different optical paths may overlap partially.

[0066] Figure 5 FIG. 1 shows a schematic diagram of an internal optical path of another device 100 provided according to some embodiments of this specification. Figure 5 As shown, the shooting module 130 further includes a beam splitter 133 located on the first optical path P1.

[0067] The ambient light enters the lens module 120 through the objective lens group 122, propagates along the first optical path P1 and is incident on the beam splitter 133. The beam splitter 133 can separate the ambient light into the first ambient light and the second ambient light. The first ambient light can be emitted from the eyepiece group 121 and enter the user's eyes. The second ambient light can enter the second optical path P2 (shown by the dotted line). The second ambient light enters the shooting module 130 through the shooting incident end 130A, leaves from the shooting emission end 130B, and enters the photosensitive device IS of the shooting module 130.

[0068] The beam splitter 133 may be coated with a beam splitter film, which can transmit visible light in the ambient light and reflect infrared light or ultraviolet light responded by the photosensitive device IS, thereby branching a second optical path P1 from the first optical path P1, and different ambient lights propagate in different directions.

[0069] In order to facilitate the layout of the internal structure, the propagation direction of the second ambient light can be changed to adapt to the layout requirements. In some embodiments, the shooting module 130 also includes a reflector 134 located on the second optical path P2. Figure 5 As shown, the second ambient light may be incident on the reflective member 134 and reflected by the reflective member 134 to the light sensing device IS.

[0070] In some embodiments, the device 100 may further include an interaction module 140. The interaction module may be provided on the main body 110, receive target instructions and image data collected by the shooting module 130, and perform corresponding target operations on the shooting module 130 based on the AI ​​model. The AI ​​model is combined with the device 100 through the interaction module 140, so that more intelligent operations can be completed after the user wears the device 100, so that the device 100 can be applied in more scenarios.

[0071] Figure 6 FIG. 1 is a schematic diagram showing an application scenario of a device 100 according to some embodiments of this specification. Figure 6 As shown, scene 006 may include device 100 , user 200 , server 300 , and network 400 .

[0072] The user 200 may be a user who wears the device 100 and makes an interactive request.

[0073] The server 300 may be a server that provides various services to the device 100. For example, an AI model may be deployed on the server 300 to intelligently analyze the data information transmitted by the device 100. For example, the AI ​​model may be any applicable artificial intelligence model. For example, the AI ​​model may be a general artificial intelligence model; or a speech recognition model. For another example, the AI ​​model may be a language translation model. For another example, the AI ​​model may be an image content understanding model. The image content understanding model can identify tens of thousands of common objects and scenes such as animals, plants, commodities, buildings, landscapes, cartoons, ingredients, public figures, etc. The server 300 may include a hardware device with data information processing functions and the necessary programs required to drive the hardware device to work.

[0074] The network 400 can facilitate the exchange of information and / or data. The network 400 can be any type of wired or wireless network, or a combination thereof. For example, the network 400 can include a cable network, a wired network, a fiber optic network, a telecommunications network, an intranet, the Internet, a local area network (LAN), a wide area network (WAN), a wireless local area network (WLAN), a metropolitan / urban network (MAN), a public switched telephone network (PSTN), a Bluetooth network, a ZigBee network, a near field communication (NFC) network, or a similar network. The network 400 may include one or more network access points. For example, the network 400 may include a wired or wireless network access point, such as a base station and / or an Internet exchange point. Through the access point, the device 100, the server 300, and one or more components can connect to the network 400 to exchange data and / or information. Figure 6As shown, the device 100 and the server 300 may be connected to the network 400 and transmit information and / or data to each other through the network 400. For example, the device 100 may obtain services from the server 300 through the network 400.

[0075] The interaction module 140 of the device 100 may include a sound pickup component 141 , a communication component 142 , and a control component 143 . In some embodiments, the interaction module 140 may also include a speaker component 144 .

[0076] The sound pickup component 141 is configured to collect voice information of the user 200. For example, the sound pickup component 141 may include a microphone. The microphone may capture the voice information of the user 200 and convert it into an electrical signal for further processing or transmission. The voice information may be the voice of the user 200. The voice information may directly contain or hide the interaction needs of the user 200. In order to prevent the surrounding noisy environment from interfering with the collection of the user's voice signal, the sound pickup component 141 may include at least one bone conduction microphone.

[0077] The communication component 142 is configured to establish a connection with a remote server 300 where an AI model is deployed to transmit the user's voice information and image data to the server 300. The control component 143 is configured to receive a target instruction sent by the server 300 through the communication component 142, and perform a target operation on the shooting module 130 based on the target instruction. Among them, the target instruction can be an instruction obtained by the AI ​​model analyzing the voice information. For example, the communication component 142 can be Bluetooth, a wireless network card, a cellular network component, etc. The device 100 can access the network 400 through the communication component 142, thereby realizing data exchange with the server 300.

[0078] The following introduces the interaction module 140 by taking the AI ​​model deployed on the server 300 including a general language recognition capability or a speech recognition model as an example.

[0079] In some embodiments, the voice information of the user 200 may directly include a command language. The command language may be a pre-set language. For example, the command language may be a concise and direct language such as "shoot", "record", "pause recording", "delete photos", etc. After the AI ​​model recognizes the command language, it may issue a corresponding target command so that the control component 143 performs the corresponding target operation on the shooting module 130.

[0080] For example, after seeing a wonderful scene, the user 200 makes a sound of "shoot", and the sound pickup component 141 can capture the user's voice. The communication component 142 can transmit the voice information and image data of the user 200 to the server 300. After the AI ​​model on the server 300 recognizes the user's voice, it sends the target instruction of "shooting module saves image data" to the control component 143. The control component 143 controls the shooting module 130 to perform shooting based on the target instruction and record the corresponding image data.

[0081] In some embodiments, the voice information of the user 200 may include information related to the instruction language. For example, the voice information may be "shoot this", "shoot that", "record a 10-second video", etc. Such voice information with instruction meaning can also be quickly and accurately recognized by the AI ​​model.

[0082] In some embodiments, the voice information may include daily language uttered by the user 200. Daily language may not include instruction language. In this case, the target instruction is the instruction obtained by the AI ​​model through autonomous analysis of daily language. Daily language may not include language with direct indicative meaning, but the instructions of the user 200 may be hidden in the daily language. After obtaining the voice information, the AI ​​model can perform intelligent autonomous analysis based on the daily language, personal expression habits, contextual scenarios, etc. of the user 200 to obtain the instructions hidden by the user 200.

[0083] For example, when the user 200 uses the telephoto function of the device 100 to observe nature, he exclaims "There is a beautiful butterfly here, it is flapping its wings". The voice information does not include information that directly expresses that the user 200 wants to shoot, but the AI ​​model can recognize that the scene currently collected by the device 100 is subjectively very special to the user 200 based on the voice information of the user 200, such as the user 200 is very excited about the scenery in front of him and likes it very much, so it has special meaning. Therefore, the AI ​​model will think that it is likely that the user 200 wants to shoot the scene or image with the butterfly. Therefore, although the user 200 did not directly issue a recording instruction, the AI ​​model still autonomously decided to record the scene that has special meaning to the user 200 so that the user 200 can play it back in the future. Therefore, the target instruction can be to shoot a video of the target duration (such as 5 seconds) to record the process of the butterfly flapping its wings. The control component 143 causes the shooting module 130 to shoot the video of the target duration based on the target instruction. The target duration may be a duration pre-set by the user 200 , or a duration determined autonomously by the AI ​​model based on the video images captured by the shooting module 130 according to the actual scene and based on an understanding of the user's 200 past behavioral habits.

[0084] In order to ensure that the target landscape that the user 200 wants to save can be recorded in a timely and complete manner. The shooting module 130 can always be in a shooting state, or in a loop recording mode. In the loop recording mode, the shooting module 130 will continue to record a video of a predetermined length, and when a loop of video recording is completed, the newly recorded video will automatically overwrite the earliest video file, thereby achieving loop recording. The time interval for loop recording may include but is not limited to 15 seconds, 30 seconds, 1 minute, etc. In this way, the most recent event records are retained as much as possible within the limited storage space, so as to ensure that the target landscape that the user 200 wants to save can be recorded in a timely and complete manner.

[0085] As an example, when user 200 uses the telephoto function of device 100 to observe a football game, the voice information of user 200 can be picked up by the sound pickup component 141 of device 100 and transmitted to server 300 in real time through communication component 142. At the same time, shooting module 130 can also record the live game in real time with the same perspective and field of view as user 200, and transmit it to server 300 in real time through communication component 142. An AI model is running on the server, which analyzes the voice information of user 200 and the game scene seen in real time. When user 200 exclaims "good ball!", the voice information is picked up by the sound pickup component 141 of device 100, and the AI ​​model recognizes that user 200 is excited about the scene recorded by the current shooting module 130, so it has special significance. Therefore, the AI ​​model believes that it is highly likely that user 200 wants to keep the current scene for future playback. Therefore, although user 200 does not directly issue a recording instruction, the AI ​​model sends a shooting instruction to control component 143 based on autonomous decision. The control component 143 controls the shooting module 130 to store the video data of the target duration before and after the user 100 exclaims. For example, the control component 143 controls the shooting module 130 to store the video of 15 seconds before the user 100 exclaims and 10 seconds after the user exclaims, for a total of 25 seconds. The AI ​​model can also understand and select the "wonderful" shots of the goal moment from the video and save the relevant image data.

[0086] The target duration can be pre-set or the result of active analysis by the AI ​​model. For example, in some embodiments, the AI ​​model determines that the video data is about a ball game by analyzing the video data transmitted by the device 100, and the video data shows that a goal has been scored at the moment when the user 200 shouts "Good shot!" The AI ​​model sets the target duration to 15 seconds before and 10 seconds after the user 200 shouts, for a total of 25 seconds, based on its own judgment, and sends the target duration information to the communication component 142.

[0087] In some embodiments, the interaction module 140 may further include a speaker component 144. The speaker component 144 may be configured to receive the execution result of the target operation through the communication component 142 and send the execution result. For example, after the shooting module 130 completes shooting, the speaker component 144 plays a message "shooting completed".

[0088] In some embodiments, the speaker component 144 can be used for the device 100 to understand the interaction needs of the user 200. For example, after the user 200 sends a voice message, due to the noisy surrounding environment, the signal-to-noise ratio of the voice message is low, and the needs of the user 200 cannot be accurately recognized. The speaker component 144 can broadcast "The operation is not completed, please repeat your needs."

[0089] In some embodiments, the control component 143 may be configured to receive a target instruction sent by the server 300 , and perform a target operation on the speaker component 144 based on the target instruction.

[0090] The following introduces the interaction module 140 by taking the AI ​​model deployed on the server 300 including general language recognition capabilities and general scene recognition capabilities, or including a speech recognition model and an image content understanding model as an example.

[0091] In some embodiments, the instruction language may be "identify organisms in the field of view", "identify the type of bird", "identify the type of tree", "identify the type of animal", etc. When the user 200 uses the telephoto function of the device 100 to observe an animal, he makes a sound of "identify the type of animal", and the sound pickup component 141 can capture the user's voice. The communication component 142 can transmit the user's voice information and image data to the server 300. The AI ​​model on the server 300 can identify the user's needs. Subsequently, the image content understanding model on the server 300 can perform biometric identification based on the image data and send a target instruction of "broadcasting biometric information" to the control component 143. The control component 143 can control the speaker component 144 to broadcast relevant information about the identified organism.

[0092] In some embodiments, the lens module 120 may further include a display screen to display the understanding results of the image content understanding model on the display screen.

[0093] In summary, the device 100 provided in this specification uses a small-sized and light-weight meta-lens to form a lens module 120. Without reducing the magnification of the device 100, the distance L between the eyepiece group 110 and the objective lens group 120 can be greatly compressed and the weight of the eyepiece group 110 and the objective lens group 120 can be reduced, so as to achieve the lightness and thinness of the device 100, thereby ensuring the comfort of the user when wearing the device 100. The device 100 is also provided with a shooting module 130, which can synchronously and stably record the magnified target landscape seen by the user. Since the overall size of the device 100 is small and the weight is light, it is almost the same as ordinary glasses, so that the user is more willing to wear the device 100, and the user and the device 100 have a longer interaction time. In this case, the interactive module 140 on the device 100 can interact with the user when the user wears the device, obtain the user's voice information, handle more complex tasks, and provide more intelligent analysis. Through the interactive module 140, a large AI model with a large number of parameters and a large amount of calculation can be applied to the above-mentioned small device 100 with limited resources and low computing and storage capabilities, thereby broadening the use scenarios of the device 100 and maintaining the algorithm performance of the AI ​​model.

[0094] The above is a description of a specific embodiment of the present specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require a specific order or a continuous order to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0095] In summary, after reading this detailed disclosure, those skilled in the art will appreciate that the foregoing detailed disclosure may be presented only by way of example and may not be limiting. Although not explicitly stated herein, those skilled in the art will appreciate that this specification requires various reasonable changes, improvements and modifications to the embodiments. These changes, improvements and modifications are intended to be proposed by this specification and are within the spirit and scope of the exemplary embodiments of this specification.

[0096] In addition, certain terms in this specification have been used to describe embodiments of this specification. For example, "one embodiment", "an embodiment" and / or "some embodiments" mean that a particular feature, structure or characteristic described in conjunction with the embodiment may be included in at least one embodiment of this specification. Therefore, it can be emphasized and should be understood that two or more references to "an embodiment" or "one embodiment" or "an alternative embodiment" in various parts of this specification do not necessarily refer to the same embodiment. In addition, specific features, structures or characteristics may be appropriately combined in one or more embodiments of this specification.

[0097] It should be understood that in the foregoing description of the embodiments of this specification, in order to help understand a feature and for the purpose of simplifying this specification, this specification combines various features in a single embodiment, figure or its description. However, this does not mean that the combination of these features is necessary. When reading this specification, it is entirely possible for a person skilled in the art to mark out some of the devices as separate embodiments. In other words, the embodiments in this specification can also be understood as the integration of multiple secondary embodiments. This is also true when the content of each secondary embodiment is less than all the features of a single aforementioned disclosed embodiment.

[0098] Each patent, patent application, patent application publication, and other material, such as articles, books, specifications, publications, documents, articles, etc., cited herein may be incorporated herein by reference in its entirety for all purposes, except for any prosecution document history related thereto, any equivalent that may be inconsistent or conflicting with this document, or any equivalent prosecution document history that may have a limiting effect on the broadest scope of the claims now or later associated with this document. For example, if there is any inconsistency or conflict between the description, definition, and / or use of a term associated with any of the incorporated materials and the term, description, definition, and / or use associated with this document, the term in this document shall control.

[0099] Finally, it should be understood that the embodiments of the application disclosed herein are explanations of the principles of the embodiments of this specification. Other modified embodiments are also within the scope of this specification. Therefore, the embodiments disclosed in this specification are only used as examples and not as limitations. Those skilled in the art can adopt alternative configurations according to the embodiments in this specification to implement the applications in this specification. Therefore, the embodiments of this specification are not limited to the embodiments accurately described in the application.

Claims

1. A wearable optical device comprising: a main body configured to be wearable on a user's head; A lens module, arranged on the main body, comprising an eyepiece group and an objective lens group, wherein when the user wears the optical device, the eyepiece group faces the eyes of the user, and the lens module magnifies the target scene within a preset field of view by a preset multiple, wherein at least one of the eyepiece group or the objective lens group comprises a meta-lens; as well as The shooting module is arranged on the main body and converts the target landscape into image data when in operation.

2. The device according to claim 1, wherein: The eyepiece group includes a first meta-lens, and the objective lens group includes a second meta-lens. The first meta-lens has a positive optical power and the second meta-lens has a positive optical power, or the first meta-lens has a negative optical power and the second meta-lens has a positive optical power.

3. The device according to claim 1, wherein: The wearable optical device is glasses.

4. The device according to claim 3, wherein: The effective exit pupil diameter range of the lens module corresponding to the exit pupil includes not less than 6mm; The preset multiple ranges from 3 times to 6 times; and The effective entrance pupil diameter range of the lens corresponding to the objective lens group includes no more than 40 mm.

5. The device according to claim 1, wherein: Also includes: An adjustment module is connected to at least one of the eyepiece group or the objective lens group, and is configured to adjust the position of the focus of at least one of the eyepiece group or the objective lens group, thereby adjusting the clarity of the target landscape observed by the user to adapt to the user's vision.

6. The device according to claim 1, wherein: The target landscape recorded by the shooting module is the target landscape after being magnified by the preset multiple.

7. The device according to claim 1, wherein: Ambient light enters the lens module through the objective lens group, propagates along the first optical path, and is emitted from the eyepiece group; The shooting module includes a shooting incident end and a shooting output end; The ambient light enters the shooting module through the shooting incident end, propagates along the second optical path, leaves from the shooting output end, and enters the photosensitive device of the shooting module; and The first optical path and the second optical path are different.

8. The device according to claim 7, wherein: The shooting module includes a front lens group and a rear lens group; The front lens group is the shooting incident end, and the rear lens group is the shooting exit end; and The front lens group has the same optical power as the objective lens group, and the rear lens group has the same optical power as the eyepiece lens group.

9. The device according to claim 1, wherein: It also includes a light splitter located on the first light path; Ambient light enters the lens module through the objective lens group, propagates along the first optical path and is incident on the beam splitter; The light splitting element splits the ambient light into a first ambient light and a second ambient light; The first ambient light is emitted from the eyepiece assembly and enters the user's eyes, and the second ambient light enters the second optical path; The shooting module is located on the second optical path and includes a shooting incident end and a shooting output end; as well as The second ambient light enters the shooting module through the shooting incident end, leaves from the shooting output end, and enters the photosensitive device of the shooting module.

10. The device according to claim 1, wherein: Also includes: The interactive module is arranged on the main body, receives target instructions and image data collected by the shooting module, and performs corresponding target operations on the shooting module based on the AI ​​model.

11. The device according to claim 10, wherein: The interaction module includes: A sound pickup component, configured to collect voice information of the user; A communication component configured to establish a connection with a remote server where the AI ​​model is deployed to transmit the user's voice information and the image data to the server; and a control component configured to receive the target instruction sent by the server through the communication component, and execute the target operation based on the target instruction, Among them, the target instruction is the instruction obtained by the AI ​​model analyzing the voice information.

12. The device according to claim 11, wherein The voice information includes daily language uttered by the user, the daily language does not include instruction language, and the target instruction is an instruction obtained by the AI ​​model through autonomous analysis of the daily language.

13. The apparatus according to claim 10, wherein: The interaction module also includes: The speaker component is configured to receive the execution result of the target operation through the communication component and emit the execution result.

Images