Lens module, head-mounted display device, and computer-readable storage medium

Abstract

The present application relates to the technical field of terminals, and discloses a lens module, a head-mounted display device, and a computer-readable storage medium. The lens module comprises a support base, and a first lens barrel and a first camera which are provided on the support base. The first lens barrel and the first camera are oppositely arranged in a first direction, the optical axis of the first lens barrel and the optical axis of the first camera extend in the first direction, the first lens barrel and the first camera can translate in a second direction, and the second direction is perpendicular to the first direction. The first lens barrel is connected to the first camera by means of a linkage mechanism, so that the translation of the first lens barrel triggers the translation of the first camera, and after the translation, the distance between the optical axis of the first lens barrel and the optical axis of the first camera is less than or equal to a first threshold. The lens module can effectively relieve depth perception errors and reduce discomfort such as visual fatigue and dizziness, does not require the use of complex algorithms and does not consume large computing power, and there is no problem of image distortion caused by algorithm limitations, so as to achieve good visual experience.

Description

Lens module, head display device and computer-readable storage medium

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on November 30, 2023, with application number 202311634455.4 and application name “Lens module, head-mounted display device and computer-readable storage medium”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of terminal technology, and in particular to a lens module, a head-mounted display device, and a computer-readable storage medium. Background Art

[0003] Video see-through (VST) technology is a key component of mixed reality (MR), virtual reality (VR), and augmented reality (AR). It's widely used in head-mounted displays (HMDs) with six degrees of freedom (6DOF) or virtual-reality fusion capabilities. Specifically, a camera on the HMD captures a real image of the real scene, combines it with computer-generated virtual information, and then outputs it to the human eye through a display screen to create a perspective fusion effect.

[0004] However, due to the limitations of the hardware structure and the overall appearance of the device, the camera in the head-mounted display device is usually fixed. Therefore, for users with different pupil distances, the optical axis of the camera is difficult to align with their pupils. There is a deviation between the scene seen by the user through the video perspective and the real scene, which will cause depth perception errors, resulting in visual fatigue, dizziness and other discomforts, and a poor visual experience. To this end, in some technical solutions, the global depth information can be calculated pixel by pixel or pixel block to achieve perspective reconstruction, thereby correcting the deviation caused by the mismatch between the camera position and the pupil distance. However, due to the limitations of its own algorithm, there will be problems with image distortion, and the visual experience is also poor.

[0005] Summary of the Invention

[0006] In order to solve the above technical problems, the present application provides a lens module, a head-mounted display device and a computer-readable storage medium. The present application is introduced from multiple aspects below, and the implementation methods and beneficial effects of the following aspects can be referenced with each other.

[0007] In a first aspect, embodiments of the present application provide a lens module. The lens module includes a support base, a first lens barrel, and a first camera disposed on the support base. The first lens barrel and the first camera are arranged relative to each other along a first direction, and the optical axis of the first lens barrel and the optical axis of the first camera extend along the first direction. The first lens barrel and the first camera are each capable of translation relative to the support base along a second direction, where the second direction is perpendicular to the first direction. The first lens barrel and the first camera are connected via a linkage mechanism, such that translation of the first lens barrel triggers translation of the first camera, and the distance between the optical axis of the first lens barrel and the optical axis of the first camera after translation is less than or equal to a first threshold.

[0008] According to the embodiment of the present application, since the first lens barrel and the first camera are connected by a linkage mechanism, the translation of the first lens barrel along the second direction will cause the first camera to also translate along the second direction. Therefore, when the first lens barrel is translated to adjust the pupil distance, the position adjustment of the first camera can be achieved, thereby effectively alleviating the problems of depth perception error, visual fatigue, dizziness, etc. caused by the poor alignment between the optical axis of the first camera and the user's pupil. In addition, the above-mentioned lens module connects the first lens barrel and the first camera through a linkage mechanism, so that the position of the first camera can be adjusted during the process of adjusting the pupil distance without the need to use a complex algorithm. Therefore, there is no problem of image distortion caused by algorithm limitations, and the visual experience is good. In addition, no additional computing power is consumed, and the overall load and power consumption are smaller.

[0009] In some embodiments, the linkage mechanism includes a first drive device, a second drive device, and a control device, wherein the first drive device is used to drive the first lens barrel to translate along the second direction, and the second drive device is used to drive the first camera to translate along the second direction, and the first drive device and the second drive device are respectively in communication with the control device. When the first drive device drives the first lens barrel to translate along the second direction by a first distance so that the first lens barrel is located at a first position, the control device can control the second drive device to drive the first camera to translate along the second direction to a second position based on the first distance, and the distance between the optical axis of the first camera at the second position and the optical axis of the first lens barrel at the first position is less than or equal to a first threshold.

[0010] According to the implementation mode of the present application, through the first driving device, the second driving device and the control device, the translation of the first lens barrel can trigger the translation of the first camera, thereby effectively alleviating the depth perception errors, visual fatigue, dizziness and other problems caused by the poor alignment between the optical axis of the first camera and the user's pupil, and providing a good visual experience.

[0011] In some embodiments, the driving end of the first driving device includes a gear and a first rack, the rotation axis of the gear extends along the first direction, the first rack extends along the second direction, the gear and the first rack are engaged with each other, and the first rack is fixedly connected to the first lens barrel.

[0012] In some embodiments, the linkage mechanism includes a connector, and the first lens barrel and the first camera are fixedly connected via the connector. Thus, translation of the first lens barrel triggers translation of the first camera, thereby effectively alleviating depth perception errors, eye fatigue, dizziness, and other issues caused by poor alignment between the optical axis of the first camera and the user's pupil, providing a better visual experience.

[0013] In some embodiments, the connecting member is a connecting rod, a fastener, a clip or an adhesive.

[0014] In some embodiments, the first threshold is 0-1 mm, for example, 0, 0.1 mm, 0.2 mm, 0.3 mm, etc.

[0015] In some embodiments, the support base includes a support rail extending along the second direction, and the first lens barrel is disposed on the support rail and can slide relative to the support rail along the second direction.

[0016] The supporting slide rail can support the first lens barrel and guide the first lens barrel to translate along the second direction, thereby ensuring the stability of the movement of the first lens barrel.

[0017] In some embodiments, a avoidance hole is opened on the support base, and the avoidance hole passes through the support base along the first direction, and at least a portion of the first camera extends from the side of the support base facing the first lens barrel to the side of the support base facing away from the first lens barrel through the avoidance hole.

[0018] In this way, the avoidance hole can effectively prevent the support base from blocking the shooting of the first camera, and at the same time prevent the support base from interfering with the translation of the first camera along the second direction.

[0019] In some embodiments, the lens module further includes a second lens barrel and a second camera disposed on the support base, wherein the second lens barrel is spaced apart from the first lens barrel, and the second camera is spaced apart from the first camera along the second direction. The second lens barrel and the second camera are disposed opposite each other along the first direction, and the optical axis of the second lens barrel and the optical axis of the second camera extend along the first direction. The second lens barrel and the second camera are each capable of translationally moving relative to the support base along the second direction. The second lens barrel and the second camera are connected via a linkage mechanism such that translation of the second lens barrel triggers translation of the second camera, and the distance between the optical axis of the second lens barrel and the optical axis of the second camera after translation is less than or equal to a first threshold.

[0020] According to the embodiments of the present application, since the second lens barrel and the second camera are connected via a linkage mechanism, translation of the second lens barrel in the second direction causes translation of the first camera in the second direction as well. Therefore, when the second lens barrel is translated to adjust the interpupillary distance, the position of the second camera can also be adjusted, effectively alleviating problems such as depth perception errors, eye fatigue, and dizziness caused by poor alignment between the optical axis of the second camera and the user's pupil.

[0021] In some embodiments, a first driving device is provided on the support seat, and a driving end of the first driving device is connected to the first lens barrel and the second lens barrel for driving the first lens barrel and the second lens barrel to translate along the second direction.

[0022] That is to say, the first lens barrel and the second lens barrel share a first driving device. Therefore, there is no need to set up additional driving devices to drive the second lens barrel to translate, which effectively reduces the number of parts, thereby improving the assembly efficiency of the lens module and reducing production costs.

[0023] In some embodiments, the first lens barrel and the second lens barrel are located on opposite sides of the first drive device along the second direction. The driving end of the first drive device includes a gear, a first rack, and a second rack. The rotation axis of the gear extends along the first direction, and the first rack and the second rack extend along the second direction. The first rack and the second rack are respectively engaged with the gear and fixedly connected to the first lens barrel and the second lens barrel.

[0024] In a second aspect, an embodiment of the present application provides a head-mounted display device, which includes a housing and a lens module provided by any embodiment of the first aspect of the present application, wherein the lens module is arranged on the housing.

[0025] In a third aspect, embodiments of the present application provide an adjustment method for a head-mounted display device. The head-mounted display device includes a lens module, the lens module including a first lens barrel, a first camera, a first drive device, a second drive device, and a control device. The first drive device is configured to drive the first lens barrel, and the second drive device is configured to drive the first camera. Furthermore, the first drive device and the second drive device are each communicatively connected to the control device.

[0026] The adjustment method includes: when the head-mounted display device is worn on the user's head, a control device detects a first offset between the optical axis of the first lens barrel and the user's first pupil, and the optical axis of the first lens barrel extends along a first direction; the control device controls a first driving device to drive the first lens barrel to translate a first distance along a second direction according to the first offset, so that the first lens barrel is located at a first position, and the second direction is perpendicular to the first direction; the control device controls a second driving device to drive the first camera to translate along the second direction to a second position according to the first distance, and the distance between the optical axis of the first camera located at the second position and the optical axis of the first lens barrel located at the first position is less than or equal to a first threshold.

[0027] The above adjustment method, through the first drive device, the second drive device and the control device, can enable the translation of the first lens barrel to trigger the translation of the first camera, thereby effectively alleviating depth perception errors, visual fatigue, dizziness and other problems caused by the poor alignment between the optical axis of the first camera and the user's left pupil, and the user's visual experience is excellent.

[0028] In some embodiments, the adjustment method also includes: a control device detects a second offset between the optical axis of the first lens barrel located at the first position and the user's first pupil, and determines whether the second offset is less than or equal to a first threshold; corresponding to the second offset being greater than the first threshold, the control device controls the first lens barrel to translate a second distance along the second direction according to the second offset, so that the first lens barrel translates from the first position to the third position; the control device controls the second driving device to drive the first camera to translate from the second position to the fourth position along the second direction according to the second distance, and the distance between the optical axis of the first camera located at the fourth position and the optical axis of the first lens barrel located at the third position is less than or equal to the first threshold.

[0029] The above adjustment method can effectively reduce measurement errors by repeatedly detecting the offset between the optical axis of the first lens barrel in the first position and the user's first pupil, and performing corresponding adjustment operations based on the measured offset, so that the optical axis of the first lens barrel and the optical axis of the first camera can be more accurately aligned with the user's first pupil.

[0030] In some embodiments, the adjustment method further includes: the head-mounted display device detecting the user's pupil distance; and the head-mounted display device adjusting the display parameters according to the detected user's pupil distance.

[0031] According to the embodiments of the present application, the head-mounted display device can optimize parameters such as the parameters of the virtual camera in the virtual scene, distortion parameters, dispersion parameters, etc. based on the detected pupil distance, so as to increase the matching degree between the head-mounted display device and the user's pupil distance, thereby further reducing the blur and dizziness caused by the mismatch of pupil distance, and at the same time making the display effect clearer, more comfortable and realistic, thereby improving the visual experience.

[0032] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, on which instructions are stored. When the instructions are executed on a computer, the computer executes the adjustment method provided by any embodiment of the third aspect of the present application.

[0033] In a fifth aspect, embodiments of the present application provide a head-mounted display device, comprising a memory for storing instructions and one or more processors. When the instructions are executed by the one or more processors, the processors perform the adjustment method provided in any embodiment of the third aspect of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] FIG1 shows an exemplary structure of a head-mounted display device according to an embodiment of the present application;

[0035] FIG2A shows the relative positional relationship between the first lens barrel, the second lens barrel, and the left and right pupils of a user when the head-mounted display device is worn on the user's head in an embodiment of the present application;

[0036] FIG2B shows the relative positional relationship between the first camera, the second camera, and the left and right pupils of the user when the head-mounted display device is worn on the user's head in an embodiment of the present application;

[0037] FIG3A shows a structural schematic diagram 1 of a lens module in some technical solutions;

[0038] FIG3B shows a second structural diagram of a lens module in some technical solutions;

[0039] FIG4A is a schematic diagram showing depth perception errors caused by users with different pupil distances in some technical solutions;

[0040] FIG4B is a second schematic diagram showing depth perception errors caused by users with different pupil distances in some technical solutions;

[0041] FIG5A is a schematic diagram showing a real scene observed by a user wearing a head-mounted display device in some other technical solutions;

[0042] FIG5B is a schematic diagram showing a real scene observed by a user wearing a head-mounted display device in some other technical solutions;

[0043] FIG5C is a schematic diagram showing a real scene observed by a user wearing a head-mounted display device in some other technical solutions;

[0044] FIG6A shows a front view of the lens module according to an embodiment of the present application;

[0045] FIG6B shows a rear view of the lens module according to an embodiment of the present application;

[0046] FIG6C shows a cross-sectional view of the lens module along line AA in FIG6A according to an embodiment of the present application;

[0047] FIG7A shows a rear view 1 of the first lens barrel, the second lens barrel, the first camera and the second camera in translation in an embodiment of the present application;

[0048] FIG7B shows a top view 1 of the first lens barrel, the second lens barrel, the first camera and the second camera in translation in an embodiment of the present application;

[0049] FIG8A shows a second rear view of the first lens barrel, the second lens barrel, the first camera, and the second camera in translation according to an embodiment of the present application;

[0050] FIG8B shows a second top view of the first lens barrel, the second lens barrel, the first camera, and the second camera in translation in an embodiment of the present application;

[0051] FIG9A shows an exemplary structure 1 of a connector according to an embodiment of the present application;

[0052] FIG9B shows an exemplary structure 2 of a connector according to an embodiment of the present application;

[0053] FIG9C shows an exemplary structure 3 of the connector according to an embodiment of the present application;

[0054] FIG9D shows an exemplary structure 4 of a connector according to an embodiment of the present application;

[0055] FIG10A shows a partial enlarged view of the first driving device in the region S1 in FIG6A in an embodiment of the present application;

[0056] FIG10B shows a cross-sectional view of the first driving device along line BB in FIG10A in an embodiment of the present application;

[0057] FIG11A shows a schematic diagram 1 of electrical connection between the first lens barrel and the first camera in an embodiment of the present application;

[0058] FIG11B shows a second schematic diagram of electrical connection between the first lens barrel and the first camera in an embodiment of the present application;

[0059] FIG11C shows a third schematic diagram of electrical connection between the first lens barrel and the first camera in an embodiment of the present application;

[0060] FIG12 shows a flow chart of the adjustment method in an embodiment of the present application;

[0061] FIG13A shows an exemplary adjustment process 1 of the head-mounted display device according to an embodiment of the present application;

[0062] FIG13B shows an exemplary second adjustment process of the head-mounted display device according to an embodiment of the present application;

[0063] FIG13C shows an exemplary adjustment process three of the head-mounted display device according to an embodiment of the present application;

[0064] FIG14 shows another adjustment method in an embodiment of the present application;

[0065] FIG15A shows an exemplary adjustment process 1 of another head-mounted display device according to an embodiment of the present application;

[0066] FIG15B shows another exemplary adjustment process 2 of a head-mounted display device according to an embodiment of the present application;

[0067] FIG16 shows a flowchart of adjusting display parameters in an embodiment of the present application;

[0068] FIG17 shows a structural block diagram of a head-mounted display device in an embodiment of the present application. DETAILED DESCRIPTION

[0069] In order to make the objectives, technical solutions and advantages of this application clearer, the implementation methods of this application will be further described in detail below with reference to the accompanying drawings.

[0070] The embodiments of the present application provide a lens module and a head-mounted display device including the lens module. The lens module can effectively alleviate depth perception errors caused by the misalignment between the optical axis of a camera used to achieve video see-through and the position of the human pupil, reducing discomfort such as eyestrain and dizziness. It does not require the use of complex algorithms, thus consuming no additional computing power, and does not suffer from image distortion caused by algorithmic limitations, resulting in a superior visual experience.

[0071] In this application, the head-mounted display device may be a mixed reality (MR) head-mounted display device, a virtual reality (VR) head-mounted display device, an augmented reality (AR) head-mounted display device, or any other head-mounted display device that utilizes video see-through technology, and this application does not specifically limit this. For ease of description, the following uses a mixed reality head-mounted display device as an example of the head-mounted display device 1.

[0072] FIG1 illustrates an exemplary structure of a head-mounted display device 1 according to an embodiment of the present application. Referring to FIG1 , the head-mounted display device 1 includes a lens module 10, a housing 20, a first leg 30a, and a second leg 30b. The lens module 10 is mounted on the housing 20. The housing 20 includes a first connecting portion 21a and a second connecting portion 21b. The first connecting portion 21a is connected to one end of the first leg 30a. The second connecting portion 21b is connected to one end of the second leg 30b. When a user wears the head-mounted display device 1, they can view both virtual and real scenes through the lens module 10.

[0073] For ease of description, before introducing the working principle of the lens module 10, the X-axis, Y-axis, and Z-axis directions of the head-mounted display device 1 are first defined in conjunction with the accompanying drawings. The X-axis direction is the length direction of the head-mounted display device 1, for example, the positive direction of the X-axis is the direction from the first connecting portion 21a to the second connecting portion 21b; the Z-axis direction is the thickness direction of the head-mounted display device 1, for example, the positive direction of the Z-axis is the direction from the first connecting portion 21a of the housing 20 to the first leg 30a; and the Y-axis direction is the width direction of the head-mounted display device 1, for example, the Y-axis direction can be perpendicular to the X-axis direction and the Z-axis direction. In this application, the Z-axis direction is used as an example of the first direction, and the X-axis direction is used as an example of the second direction, and will not be further described below.

[0074] Continuing with FIG1 , the lens module 10 may include a first lens barrel 110, a second lens barrel 120, a first camera 210, and a second camera 220. The first lens barrel 110 and the second lens barrel 120 are spaced apart along the X-axis direction and are used to support a lens assembly (not shown). The first lens barrel 110 and the first camera 210 are disposed opposite each other along the Z-axis direction. The second lens barrel 120 and the second camera 120 are disposed opposite each other along the Z-axis direction. It will be understood that when the head-mounted display device 1 is worn on the user's head, along the Z-axis direction, the first lens barrel 110 and the second lens barrel 120 are closer to the user's head than the first camera 210 and the second camera 220.

[0075] Figure 2A shows the relative positional relationship between the first lens barrel 110 and the second lens barrel 120 and the user's left and right pupils when the head-mounted display device 1 is worn on the user's head in accordance with an embodiment of the present application. Figure 2B shows the relative positional relationship between the first camera 210 and the second camera 220 and the user's left and right pupils when the head-mounted display device 1 is worn on the user's head in accordance with an embodiment of the present application.

[0076] For ease of understanding, the optical axis L11 of the first lens barrel 110, the optical axis L12 of the second lens barrel 120, the center distance Dg of the first lens barrel 110 and the second lens barrel 120, the optical axis L21 of the first camera 210, the optical axis L22 of the second camera 220, the baseline Lc (baseline) of the first camera 210 and the second camera 220, and the user's interpupillary distance Le (IPD) are introduced here with reference to Figures 2A and 2B.

[0077] The optical axis L11 of the first lens barrel 110 is the center line of the light beam passing through the first lens barrel 110. The optical axis L12 of the second lens barrel 120 is the center line of the light beam passing through the second lens barrel 120. The center distance Dg between the first lens barrel 110 and the second lens barrel 120 is the distance between the optical axis L11 of the first lens barrel 110 and the optical axis L12 of the second lens barrel 120.

[0078] The optical axis L21 of the first camera 210 is the centerline of a light beam passing through the center point of the lens of the first camera 210. The optical axis L22 of the second camera 220 is the centerline of a light beam passing through the center point of the lens of the second camera 220. The baseline Lc of the first camera 210 and the second camera 220 is the distance between the optical axis L21 of the first camera 210 and the optical axis L22 of the second camera 220.

[0079] The user's pupil distance Le refers to the distance between the user's left eye pupil and right eye pupil.

[0080] The optical axis L11 of the first lens barrel 110 , the optical axis L12 of the second lens barrel 120 , the optical axis L21 of the first camera 210 , and the optical axis L22 of the second camera 220 are all parallel to the Z-axis direction.

[0081] 2A and 2B , when the head-mounted display device 1 is worn on a user's head, the first lens barrel 110 and the first camera 210 correspond to the user's left pupil, and the second lens barrel 120 and the second camera 220 correspond to the user's right pupil, allowing the user to view both virtual and real scenes normally. The distances between the optical axis L11 of the first lens barrel 110 and the user's left pupil, the optical axis L21 of the first camera 210 and the user's left pupil, the optical axis L12 of the second lens barrel 120 and the user's right pupil, and the optical axis L22 of the second camera 220 and the user's right pupil are all less than or equal to a first threshold. The first threshold can be 0-1 mm, for example, 0, 0.1 mm, 0.2 mm, etc. This ensures that the optical axes L11 of the first lens barrel 110 and L21 of the first camera 210 are approximately aligned with the user's left pupil, and the optical axes L12 of the second lens barrel 120 and L22 of the second camera 220 are approximately aligned with the user's right pupil. That is to say, the center distance Dg of the first lens barrel 110 and the second lens barrel 120, the baseline Lc of the first camera 210 and the second camera 220 are respectively roughly the same as the user's pupil distance Le. In this way, the optical devices (e.g., lens assembly, etc.) in the first lens barrel 110 and the second lens barrel 120 can project the virtual image generated by the computer into the user's left eye pupil and right eye pupil respectively. The first camera 210 and the second camera 220 can shoot objects in the real scene (e.g., objects located at Wc) and image them on the display screen 109L and the display screen 109R so that the real scene can be presented to the user. Thus, an information loop of interactive feedback is set up between the real scene, the virtual scene and the user, realizing the fusion of the real scene and the virtual scene, and then enhancing the sense of reality of the user experience.

[0082] The following describes exemplary configurations of the lens barrel and camera in the lens module with reference to the accompanying drawings.

[0083] 3A and 3B show schematic structural diagrams of the lens module 10' in some technical solutions, wherein FIG3A shows a side of the lens module 10' including the first lens barrel 110' and the second lens barrel 120', and FIG3B shows a side of the lens module 10' including the first camera 210' and the second camera 220'.

[0084] 3A and 3B , in some technical solutions, the first lens barrel 110 ′ and the second lens barrel 120 ′ in the lens module 10 ′ can move relative to each other along the X-axis direction, thereby driving the lens assembly (not shown) located therein to move relative to each other along the X-axis direction to achieve pupil distance adjustment, that is, the center distance Dg between the first lens barrel 110 ′ and the second lens barrel 120 ′ can be matched with the pupil distance of different users, thereby presenting clear images for users with different pupil distances.

[0085] However, due to the hardware structure and overall appearance of the lens module 10', the first and second cameras 210', 220' are fixed. Therefore, for users with different interpupillary distances, there may be some difference between the first and second cameras 210', 220' and the user's left and right pupils. This can cause depth perception errors, leading to dizziness and eye discomfort, and affecting the user's visual experience.

[0086] Specifically, Figures 4A and 4B show schematic diagrams of depth perception errors caused by users with different pupil distances in some technical solutions. Referring to Figure 4A, the first camera 210' and the second camera 220' capture an object located at point Wc and form an image on the display screen 109L and the display screen 109R. However, for users with a large pupil distance, the baseline Lc of the first camera 210' and the second camera 220' is smaller than the user's pupil distance Le. Therefore, the object perceived by the user is located at point We, which is closer to the user than point Wc, and the sense of distance is close. Referring to Figure 4B, for users with a small pupil distance, the baseline Lc of the first camera 210' and the second camera 220' is larger than the user's pupil distance Le. Therefore, the object perceived by the user is located at point We, which is farther away from the user than point Wc, and the sense of distance is far.

[0087] To this end, other technical solutions can reconstruct the depth perspective by calculating global depth information pixel by pixel or pixel block by pixel, thereby correcting the deviation caused by the mismatch between the camera baseline Lc and the pupil distance Le. Currently, due to the limitations of this binocular depth algorithm, pixel-by-pixel modeling cannot be supported. Depth perspective reconstruction can only be performed by pixel-by-pixel depth reprojection, which can lead to image distortion and a poor user visual experience.

[0088] For example, Figures 5A to 5C illustrate schematic diagrams of several real-world scenes viewed by a user wearing a head-mounted display (HMD) in other technical solutions. As shown in Figure 5A , in the image viewed through the HMD, the user's phone 2 and background object 3 appear distorted. Furthermore, as shown in Figures 5B and 5C , the user's phone 2 appears distorted in the image viewed through the HMD.

[0089] The present application provides a lens module to improve the above-mentioned problem. Compared to the above-mentioned head-mounted display device, the camera in the lens module provided by the present application can translate along with the translation of the lens barrel. Therefore, when the user translates the lens barrel to adjust the interpupillary distance, the camera can also translate, so that the optical axis of the camera can be aligned with the user's pupil. This can meet the viewing needs of users with different interpupillary distances without using a binocular depth algorithm, effectively alleviate the problem of depth perception errors when users view images, reduce discomfort such as visual fatigue and dizziness, and eliminate the problem of image distortion caused by algorithm limitations, resulting in a better visual experience.

[0090] The technical solution of this application is introduced below with reference to the accompanying drawings.

[0091] Figures 6A to 6C illustrate an exemplary structure of the lens module 10 according to an embodiment of the present application, wherein Figure 6A is a front view of the lens module 10, Figure 6B is a rear view of the lens module 10, and Figure 6C is a cross-sectional view of the lens module 10 along line AA in Figure 6A. The front side of the lens module 10 refers to the side of the lens module 10 facing the user when in use, and the rear side of the lens module 10 refers to the side opposite to the front side along the Z-axis.

[0092] 6A to 6C , the lens module 10 includes a support base 100, a first lens barrel 110, a second lens barrel 120, a first camera 210, and a second camera 220. The first lens barrel 110, the second lens barrel 120, the first camera 210, and the second camera 220 are all disposed on the support base 100.

[0093] The first lens barrel 110 and the second lens barrel 120 are spaced apart along the X-axis. The first camera 210 and the second camera 220 are spaced apart along the X-axis. The first lens barrel 110 and the first camera 210 are disposed opposite each other along the Z-axis, and the optical axis L11 of the first lens barrel 110 and the optical axis L21 of the first camera 210 both extend along the Z-axis. The second lens barrel 120 and the second camera 220 are disposed opposite each other along the Z-axis, and the optical axis L12 of the second lens barrel 120 and the optical axis L22 of the second camera 220 both extend along the Z-axis.

[0094] The first lens barrel 110, the second lens barrel 120, the first camera 210, and the second camera 220 can all be translated relative to the support base 100 along the X-axis direction. The first lens barrel 110 and the first camera 210 are connected via a linkage mechanism 300, such that translation of the first lens barrel 110 triggers translation of the first camera 210, and the distance between the optical axis L11 of the first lens barrel 110 and the optical axis L21 of the first camera 210 after translation is less than or equal to a first threshold. The second lens barrel 120 and the second camera 220 are connected via a linkage mechanism 300, such that translation of the second lens barrel 120 triggers translation of the second camera 220, and the distance between the optical axis L12 of the second lens barrel 120 and the optical axis L22 of the second camera 220 after translation is less than or equal to the first threshold. Thus, when the first lens barrel 110 and the second lens barrel 120 are translated to adjust the pupil distance, the position of the first camera 210 and the second camera 220 can be adjusted to accommodate users with different pupil distances, thereby effectively enhancing the user's visual experience.

[0095] For example, Figures 7A and 7B illustrate a first schematic diagram of the translation of the first lens barrel 110, the second lens barrel 120, the first camera 210, and the second camera 220 in accordance with an embodiment of the present application, wherein Figure 7A is a rear view of the lens module 10, and Figure 7B is a top view of the lens module 10. Figures 8A and 8B illustrate a second schematic diagram of the translation of the first lens barrel 110, the second lens barrel 120, the first camera 210, and the second camera 220 in accordance with an embodiment of the present application, wherein Figure 8A is a rear view of the lens module 10, and Figure 8B is a top view of the lens module 10.

[0096] 7A to 8B , interpupillary distance adjustment can be achieved by translating the first lens barrel 110. For example, for a user with a small interpupillary distance, the first lens barrel 110 can be translated along the positive direction of the X-axis toward the second lens barrel 120, moving from the position shown in FIG7A and FIG7B to the position shown in FIG8A and FIG8B . This allows the optical axis L11 of the first lens barrel 110 to be roughly aligned with the user's left pupil, reducing the center distance Dg between the first lens barrel 110 and the second lens barrel 120 to meet the needs of users with a small interpupillary distance.

[0097] Because the first lens barrel 110 and the first camera 210 are connected via a linkage mechanism 300, translation of the first lens barrel 110 along the positive X-axis direction causes the first camera 210 to also translate along the positive X-axis direction closer to the second camera 220, moving from the position shown in Figures 7A and 7B to the position shown in Figures 8A and 8B. This causes the optical axis L21 of the first camera 210 to be roughly aligned with the user's left pupil, reducing the baseline Lc between the first camera 210 and the second camera 220 to meet the needs of users with a small interpupillary distance. It can be understood that at this time, the optical axis L21 of the first camera 210 and the optical axis L11 of the first lens barrel 110 are roughly aligned, that is, the distance between the optical axis L21 of the first camera 210 and the optical axis L11 of the first lens barrel 110 is less than or equal to the first threshold.

[0098] Conversely, for users with a large interpupillary distance, the first lens barrel 110 can be translated along the negative direction of the X-axis away from the second lens barrel 120, and the first camera 210 can be translated along the negative direction of the X-axis away from the second camera 220, so as to move from the position shown in Figures 8A and 8B to the position shown in Figures 7A and 7B. At this time, the axis L11 of the first lens barrel 110 and the axis L21 of the first camera 210 are respectively roughly aligned with the user's left pupil, and the center distance Dg between the first lens barrel 110 and the second lens barrel 120 and the baseline Le of the first camera 210 and the second camera 220 are increased to meet the usage needs of users with a large interpupillary distance.

[0099] In this way, problems such as depth perception errors, visual fatigue, and dizziness caused by poor alignment between the optical axis L21 of the first camera 210 and the user's left pupil can be effectively alleviated. Furthermore, the lens module 10 connects the first lens barrel 110 and the first camera 210 via a linkage mechanism 300, allowing the position of the first camera 210 to be adjusted during pupil distance adjustment without the need for complex algorithms. Therefore, compared to the aforementioned solution using a binocular depth algorithm to achieve depth perspective reconstruction, there is no problem of image distortion caused by algorithm limitations, resulting in a better visual experience. Furthermore, no additional computing power is consumed, resulting in lower overall machine load and power consumption.

[0100] It is understood that the movement process of the second lens barrel 120 and the second camera 220 is substantially the same as the movement process of the first lens barrel 110 and the first camera 210 described above. Therefore, reference can be made to the description of the first lens barrel 110 and the first camera 210 herein, and no further details are given here. Furthermore, for ease of description, the specific implementation of the lens barrel-camera connection will be described below using the example of the first lens barrel 110 and the first camera 210 being connected via the linkage mechanism 300.

[0101] It should be noted that the term "connected" in the aforementioned description of the first lens barrel 110 and the first camera 210 being connected via the linkage mechanism 300 can refer to either a mechanical or electrical connection; a fixed connection, a detachable connection, or an integral connection. This application is not limited to this; any connection method that enables translation of the first lens barrel 110 to trigger translation of the first camera 210 is within the scope of protection of this application.

[0102] In an implementable solution, the first lens barrel 110 and the first camera 210 may be mechanically connected via a linkage mechanism 300 .

[0103] Continuing with FIG6C , in some embodiments of the present application, the linkage mechanism 300 includes a connector 310. The connector 310 is connected between the first lens barrel 110 and the first camera 210, thereby integrally connecting the first lens barrel 110 and the first camera 210. In this way, when the first lens barrel 110 translates along the X-axis, it can drive the first camera 210 to translate along the X-axis.

[0104] In some embodiments of the present application, the connecting member 310 can be any one of a connecting rod, a fastener, a clamping member or an adhesive member.

[0105] 9A to 9D show exemplary structures of several connectors 310 in the embodiments of the present application.

[0106] 9A , in some implementations, the connecting member 310 is a connecting rod, and both ends of the connecting rod can be fixedly connected to the first lens barrel 110 and the base 211 of the first camera 210 , respectively, so that the first camera 210 can translate along with the translation of the first lens barrel 110 .

[0107] In some implementations, the connecting member 310 is a fastener, and the first lens barrel 110 and the first camera 210 can be fastened together by the fastener. For example, as shown in FIG9B , the connecting member 310 can be a screw, the screw rod of which is disposed through the base 211 of the first camera 210, the support member 100, and the first lens barrel 110, and is fixedly connected to the first lens barrel 110 by a threaded connection.

[0108] In some implementations, the connector 310 is a snap-fit ​​connector, allowing the first lens barrel 110 and the first camera 210 to be snap-fitted to each other. For example, as shown in FIG9C , the connector 310 may include a snap-fit ​​hole 311 and a snap-fit ​​block 312 disposed within the snap-fit ​​hole 311. One of the snap-fit ​​hole 311 and the snap-fit ​​block 312 is disposed on the first lens barrel 110, and the other is disposed on the base 211 of the first camera 210.

[0109] 9D , in some implementations, the connector 310 may be an adhesive, so that the first lens barrel 110 and the base 211 of the first camera 210 can be bonded to each other via the adhesive. For example, the connector 310 may be an adhesive (e.g., an acrylic adhesive or an epoxy resin adhesive).

[0110] It can be understood that the above embodiments are only part of the implementation of the connector 310 in this application, and other structural forms of the connector 310 that can achieve a fixed connection between the first lens barrel 110 and the first camera 210 are within the scope of protection of this application.

[0111] Continuing to refer to FIG. 6C in conjunction with FIG. 7A and FIG. 8A , in some embodiments of the present application, a clearance hole 130 is defined in the support base 100. The clearance hole 130 extends through the support base 100 along the Z-axis. At least a portion of the first camera 210 extends through the clearance hole 130 from the side of the support base 100 facing the first lens barrel 110 to the side of the support base 100 facing away from the first lens barrel 110.

[0112] In this way, the avoidance hole 130 can effectively prevent the support base 100 from blocking the shooting of the first camera 210, and can also prevent the support base 100 from interfering with the translation of the first camera 210 along the X-axis direction.

[0113] For example, the base 211 of the first camera 210 can be located on the side of the support base 100 facing the first lens barrel 110, so that it is fixedly connected to the first lens barrel 110 through the base 211. The lens 212 of the first camera 210 can capture the real scene outside the lens module 10 through the avoidance hole 130. At the same time, when the first camera 210 is translated along the Y-axis direction, the lens 212 can slide in the avoidance hole 130 without colliding with the support base 100.

[0114] After introducing the specific implementation of the mechanical connection between the first lens barrel 110 and the first camera 210, since the translation of the first camera 210 is achieved by translating the first lens barrel 110, the specific implementation of the translation of the first lens barrel 110 is further introduced below.

[0115] 6A and 6B , in some embodiments of the present application, the lens module 10 includes a first driving device 400. The first driving device 400 is used to drive the first lens barrel 110 to translate along the X-axis direction.

[0116] Specifically, Figures 10A and 10B illustrate an exemplary structure of the first drive device 400 in an embodiment of the present application, wherein Figure 10A is a partial enlarged view of the S1 region in Figure 6A, and Figure 10B is a cross-sectional view of the first drive device 400 along line BB in Figure 10A. Referring to Figures 10A and 10B and in conjunction with Figures 6A and 6B, the first drive device 400 includes a mounting end 410 and a driving end 420 that are connected. The mounting end 410 can be located on a side of the support base 100 facing away from the first lens barrel 110. One end of the driving end 420 is connected to the mounting end 410, and the other end passes through the support base 100 along the Z-axis direction and extends to the side of the support base 100 facing the first lens barrel 110 to be fixedly connected to the first lens barrel 110, thereby being able to transmit a driving force to the first lens barrel 110 to drive the first lens barrel 110 to translate along the X-axis direction.

[0117] For example, the translation of the first lens barrel 110 can be achieved by a gear rack. Specifically, the driving end 420 of the first driving device 400 includes a gear 430 and a first rack 441. The rotation axis of the gear 430 (for example, the axis L430 in Figure 10B) extends along the Z-axis. The gear 430 and the first rack 441 are meshed with each other. The first rack 441 extends along the X-axis, and one end of the first rack 441 is fixedly connected to the outer circumference of the first lens barrel 110, thereby achieving translation of the first lens barrel 110. For example, when the gear 430 rotates about the axis L430 in the C direction, the first rack 441 translates along the positive direction of the X-axis, thereby driving the first lens barrel 110 to translate along the positive direction of the X-axis toward the second lens barrel 120. For example, the first lens barrel 110 can move along the positive direction of the X-axis from the position shown in Figures 7A and 7B to the position shown in Figures 8A and 8B.

[0118] Alternatively, in other alternative embodiments, the driving end 420 may further include a cam mechanism or a crank slider mechanism, which may be used to achieve translation of the first lens barrel 110. This application does not impose any restrictions on this, and any driving end 420 that can achieve translation of the first lens barrel 110 along the X-axis direction is within the scope of protection of this application.

[0119] Continuing to refer to Figures 10A and 10B, in some embodiments of the present application, the drive end 420 may further include a drive shaft 450 extending in the Z-axis direction. The drive shaft 450 passes through the support base 100, and the two ends of the drive shaft 450 are respectively connected to the mounting end 410 and the gear 430 located on opposite sides of the support base 100. The drive shaft 450 can rotate around the axis L430, thereby driving the gear 430 to rotate, thereby achieving the translation of the first lens barrel 110. Exemplarily, a protrusion 452 is provided on the outer circumferential surface of the end 451 of the drive shaft 450, so that the cross section of the end 451 of the drive shaft 450 is similar to a "convex" shape. The center of the gear 430 is formed with an axial hole (not shown) that matches the shape of the end 451 of the drive shaft 450, and is sleeved on the end 451 of the drive shaft 450 through the axial hole, thereby achieving the circumferential fixation of the gear 430. In addition, the axial fixation of the gear 430 can be achieved by fixing parts such as a shaft end baffle, a shaft shoulder, a shaft ring or a sleeve.

[0120] In other embodiments of the present application, the translation of the first lens barrel 110 can also be achieved manually. For example, an adjustment block can be provided on the outer circumference of the first lens barrel 110, and the user can drive the first lens barrel 110 to translate along the X-axis by turning the adjustment block. In another example, an outer sleeve can be provided on the outer circumference of the first lens barrel 110, and the user can also push the outer sleeve to drive the first lens barrel 110 to translate along the X-axis. In another example, the user can also directly push the first lens barrel 110 along the X-axis to achieve translation of the first lens barrel 110. This application is not limited to this, as long as the first lens barrel 110 can be translated along the X-axis.

[0121] Continuing with FIG6A , in some embodiments of the present application, a support rail 140 is provided on the support base 100. The support rail 140 extends along the X-axis. The first lens barrel 110 is slidably connected to the support rail 140. While supporting the first lens barrel 110, the support rail 140 can also guide the first lens barrel 110 to translate along the X-axis, thereby ensuring the smooth movement of the first lens barrel 110.

[0122] Exemplarily, as shown in FIG6A , the support base 100 may be provided with two support rails 140. Both support rails 140 extend along the X-axis direction and are arranged relative to each other along the Y-axis direction. The support rails 140 may be fixed to the support base 100 by fasteners (e.g., screws), clamping, or bonding. The first lens barrel 110 is provided with mounting ends 111 that are compatible with the support rails 140. Exemplarily, the number of mounting ends 111 may be four. Two of the mounting ends 111 are sleeved on the same support rail 140. The other two mounting ends 111 are sleeved on another support rail 140. This allows the first lens barrel 110 to translate more stably along the X-axis direction.

[0123] It will be understood that FIG6A above merely schematically illustrates the structural form of the support rail 140 and the mounting end 111. In other embodiments, the support rail 140 and the mounting end 111 may also have other structural forms, which are not limited in this application. For example, the support rail 140 may also be a groove defined in the support base 100. The mounting end 111 may be a slider that is retained within the groove-structured support rail 140 and is capable of sliding relative to the support rail 140.

[0124] Continuing to refer to FIG. 10A and FIG. 10B and in conjunction with FIG. 6A and FIG. 6B , in some embodiments of the present application, the first driving device 400 can also be used to drive the second lens barrel 120 to translate along the X-axis direction. That is, the driving end 420 of the first driving device 400 can also be connected to the second lens barrel 120. In other words, the first lens barrel 110 and the second lens barrel 120 share the same first driving device 400. Therefore, there is no need to provide an additional driving device to drive the second lens barrel 120 to translate, effectively reducing the number of parts, thereby improving the assembly efficiency of the lens module 10 and reducing production costs.

[0125] In some implementations, the driving end 420 of the first driving device 400 may include a second rack 442 extending along the X-axis direction. The second rack 442 is meshed with the gear 430, and one end of the second rack 442 is fixedly connected to the outer circumference of the second lens barrel 120, thereby achieving translation of the second lens barrel 120. The transmission process for achieving translation of the second lens barrel 120 is substantially the same as the transmission process for achieving translation of the first lens barrel 110 described above, and will not be described in detail here.

[0126] As mentioned above, the connection between the first lens barrel 110 and the first camera 210 is not limited to a mechanical connection. In another feasible solution, the first lens barrel 110 and the first camera 210 can also be electrically connected via a linkage mechanism 300.

[0127] Figures 11A to 11C illustrate schematic diagrams of the electrical connection between the first lens barrel 110 and the first camera 210 in embodiments of the present application. Figure 11A is a front view of the lens module 10, Figure 11B is a rear view of the lens module 10, and Figure 11C is a cross-sectional view of the lens module 10 along line DD in Figure 11A. Referring to Figures 11A to 11C, in some embodiments of the present application, the linkage mechanism 300 includes a first drive device 400, a second drive device 500, and a control device 600.

[0128] The first driving device 400 is used to drive the first lens barrel 110 to translate along the X-axis direction. The specific implementation of the first driving device 400 driving the first lens barrel 110 can be referred to Figures 10A and 10B and their related descriptions, which will not be repeated here.

[0129] The second driving device 500 is used to drive the first camera 210 to translate along the X-axis. The specific implementation of the second driving device 500 driving the first camera 210 can be consistent with the specific implementation of the first driving device 400 driving the first lens barrel 110. For similar purposes, reference can be made to Figures 10A and 10B and the related descriptions thereof, and no further details are given here.

[0130] The first drive device 400 and the second drive device 500 are respectively connected to the control device 600 for communication. For example, the first drive device 400 and the second drive device 500 can be connected to the control device 600 for communication via a wired communication method such as a signal transmission line. Alternatively, in other alternative embodiments, the first drive device 400 and the second drive device 500 can also be connected to the control module 200 for communication via a wireless communication method such as Bluetooth, which is not limited in this application.

[0131] When the first drive device 400 drives the first lens barrel 110 to translate along the X-axis a first distance (e.g., the first distance D1 shown in FIG. 13B below), so that the first lens barrel 110 is in the first position, the control device 600 can obtain the first distance and, based on the first distance, control the second drive device 400 to drive the first camera 210 to translate along the X-axis to the second position. Furthermore, the distance between the optical axis L21 of the first camera 210 in the second position and the optical axis L11 of the first lens barrel 110 in the first position is less than or equal to a first threshold. In this way, when the first lens barrel 110 is translated to adjust the interpupillary distance, the position of the first camera 210 can be adjusted to accommodate users with different interpupillary distances, thereby effectively improving the user's visual experience.

[0132] In some embodiments of the present application, the second driving device 500 can also be used to drive the second camera 220 to translate along the X-axis. That is, the first camera 210 and the second camera 220 share the same second driving device 500, thereby effectively reducing the number of parts, thereby improving the assembly efficiency of the lens module 10 and reducing production costs.

[0133] The specific implementation method of the second driving device 500 driving the first camera 210 and the second camera 220 to translate is substantially the same as the specific implementation method of the first driving device 400 driving the first lens barrel 110 and the second lens barrel 120 described above. For details, please refer to Figures 10A and 10B and the related descriptions, and will not be repeated here. For ease of description, the following will continue to use the first lens barrel 110 and the first camera 210 electrically connected via the linkage mechanism 300 as an example to explain the exemplary adjustment process of the head-mounted display device 1.

[0134] Based on the electrical connection between the first lens barrel 110 and the first camera 210 via the linkage mechanism 300, the present application further provides an adjustment method applicable to the head-mounted display device 1 described above. FIG12 shows a flow chart of the adjustment method in an embodiment of the present application. FIG13A to FIG13C show an exemplary adjustment process of the head-mounted display device 1 in an embodiment of the present application. Referring to FIG12 and in conjunction with FIG13A to FIG13C, the adjustment method provided by the present application specifically includes the following steps:

[0135] S110 : When the head display device 1 is worn on the user's head, the control device 600 detects the offset between the optical axis L11 of the first lens barrel 110 and the user's left pupil.

[0136] In some embodiments of the present application, the head-mounted display device 1 can detect whether it is in a worn state. For example, the surface of the head-mounted display device 1 that contacts the user includes a pressure sensor. When the head-mounted display device 1 is worn on the user's head, the pressure sensor can sense the contact pressure applied by the user's head. Based on the pressure data sensed by the pressure sensor, it can be determined whether the head-mounted display device 1 is in a worn state.

[0137] Alternatively, in some alternative embodiments, the head-mounted display device 1 includes an optical sensor that can be used to detect the environment around the head. When the head-mounted display device 1 is worn on the user's head, the distribution of light will be different. By analyzing the data from the optical sensor, it can be determined whether the head-mounted display device 1 is in the worn state.

[0138] Alternatively, in some alternative embodiments, the head-mounted display device 1 includes an accelerometer and a gyroscope to detect motion. When the head-mounted display device 1 is worn on the user's head, the motion state of the head-mounted display device 1 will be different from when it is not worn. By detecting the motion data, it can be determined whether the head-mounted display device 1 is in the worn state.

[0139] Referring to FIG. 13A in conjunction with FIG. 11A to FIG. 11C , after the head display device 1 is in the wearing state, the control device 600 begins detecting the offset D0 (as an example of a first offset) between the optical axis L11 of the first lens barrel 110 and the user's left pupil (as an example of a first pupil). For example, the offset D0 is 0.5 mm.

[0140] S120 : The control device 600 controls the first driving device 400 to drive the first lens barrel 110 to translate along the X-axis direction by a first distance according to the offset, so that the first lens barrel 110 is located at the first position.

[0141] According to the above embodiment, referring to FIG13A in conjunction with FIG13B and FIG11A-11C, after detecting that the offset D0 is 0.5 mm, the control device 600 controls the first drive device 400 to translate the first lens barrel 110 along the X-axis by a first distance D1 based on the offset D0, so that the first lens barrel 110 is positioned at the first position. During this process, the optical axis L11 of the first lens barrel 110 translates from point P1 to point P2. It will be appreciated that the first distance D1 can be equal to the offset D0, that is, the first distance D1 can also be 0.5 mm. In this case, the optical axis L11 of the first lens barrel 110 is substantially aligned with the user's left pupil.

[0142] The specific implementation of the first driving device 400 driving the first lens barrel 110 to translate can refer to the above-mentioned FIG. 10A and FIG. 10B and the related descriptions, which will not be repeated here.

[0143] S130: The control device 600 controls the second driving device 500 to drive the first camera 210 to translate to the second position along the X-axis direction according to the first distance, and the distance between the optical axis L21 of the first camera 210 at the second position and the optical axis L11 of the first lens barrel 110 at the first position is less than or equal to the first threshold.

[0144] Referring to FIG. 13B in conjunction with FIG. 13C and FIG. 11A-11C , after the first driving device 400 drives the first lens barrel 110 to translate along the X-axis by a first distance D1, the control device 600 can control the second driving device 500 to translate the first camera 210 along the X-axis to a second position based on the first distance D1. Furthermore, the distance between the optical axis L21 of the first camera 210 in the second position and the optical axis L11 of the first lens barrel 110 in the first position is less than or equal to a first threshold value (e.g., the first threshold value is 0-1 mm). This allows the optical axis L21 of the first camera 210 to be roughly aligned with the user's left pupil.

[0145] For example, referring to Figures 13B and 13C , the second driving device 500 can also be translated along the X-axis by a first distance D1 to move to the second position. The first threshold value can be 0, where the optical axis L21 of the first camera 210 in the second position and the optical axis L11 of the first lens barrel 110 in the first position both pass through point P2 and the user's left pupil. In other embodiments, the first threshold value can also be other values ​​within the range of 0-1 mm, such as 0.1 mm, 0.2 mm, etc., and this application does not impose any specific limitations on this.

[0146] The above adjustment method, through the first drive device 400, the second drive device 500 and the control device 600, can enable the translation of the first lens barrel 110 to trigger the translation of the first camera 210, thereby meeting the usage needs of users with different interpupillary distances, effectively alleviating the depth perception errors, visual fatigue, dizziness and other problems caused by the poor alignment between the optical axis L21 of the first camera 210 and the user's left pupil, and providing the user with a good visual experience.

[0147] In some embodiments of the present application, after step S130, the control device 600 may continue to detect the offset between the first lens barrel 110 in the first position and the user's left pupil, and adjust the positions of the first lens barrel 110 and the first camera 210 accordingly until the offset between the first lens barrel 110 and the user's left pupil is less than or equal to a first threshold. This effectively reduces detection errors, thereby further improving the accuracy of adjusting the position of the first camera 210.

[0148] FIG14 shows another adjustment method in an embodiment of the present application. FIG15A and FIG15B show another exemplary adjustment process of a head-mounted display device 1 in an embodiment of the present application. Referring to FIG14 and in combination with FIG15A and FIG15B, the method specifically includes the following steps:

[0149] S110 ′: When the head display device 1 is worn on the user's head, the control device 600 detects the offset between the optical axis L11 of the first lens barrel 110 and the user's left pupil.

[0150] S120 ′: the control device 600 controls the first driving device 400 to drive the first lens barrel 110 to translate along the X-axis direction by a first distance according to the offset, so that the first lens barrel 110 is located at the first position.

[0151] S130′: The control device 600 controls the second driving device 500 to drive the first camera 210 to translate to the second position along the X-axis direction according to the first distance, and the distance between the optical axis L21 of the first camera 210 at the second position and the optical axis L11 of the first lens barrel 110 at the first position is less than or equal to the first threshold.

[0152] Steps S110 ′-S130 ′ are the same as the aforementioned steps S110 - S130 and are not described in detail here.

[0153] S140 : The control device 600 detects the offset between the optical axis L11 of the first lens barrel 110 located at the first position and the left pupil of the user, and determines whether the offset is less than or equal to a first threshold.

[0154] If the judgment is yes, the adjustment is ended; if the judgment is no, the steps S120 ′ to S140 are continued.

[0155] For ease of description, the following description takes the first threshold value of 0 as an example.

[0156] For example, referring to FIG13C , in some embodiments of the present application, the offset between the optical axis L11 of the first lens barrel 110 in the first position and the user's left pupil is 0 mm, which is less than or equal to the first threshold. That is, the judgment is yes. Therefore, the adjustment ends.

[0157] For another example, referring to Figure 15A , in some other embodiments of the present application, after the first translation, the first lens barrel 110 is located in the first position shown in Figure 15A , wherein the optical axis L11 of the first lens barrel 110 passes through point P2. The first camera 210 is located in the second position shown in Figure 15A , wherein the optical axis L21 of the first camera 210 passes through point P2. The offset D0' (as an example of the second offset) between the optical axis L11 of the first lens barrel 110 in the first position and the user's left pupil is 0.1 mm, which is greater than the first threshold. Therefore, the judgment is negative. Therefore, steps S120'-S140 are continued.

[0158] First, step S120′ is executed. The control device 600 controls the first driving device 400 to drive the first lens barrel 110 to translate along the X-axis direction by a first distance D1′ (as an example of the second distance) based on the offset D0′. This allows the first lens barrel 110 to translate from the first position shown in FIG. 15A to the first position shown in FIG. 15B (as an example of the third position). For example, the optical axis L11 of the first lens barrel 110 translates from point P2 to point P3. This further reduces the misalignment between the first lens barrel 110 and the user's left pupil, thereby improving the alignment between the first lens barrel 110 and the user's left pupil.

[0159] Then, step S130' is executed. The control device 600 controls the second drive device 500 to drive the first camera 210 to translate along the X-axis direction from the second position shown in FIG. 15A to the second position shown in FIG. 15B (as an example of a fourth position) based on the first distance D1'. For example, the optical axis L21 of the first camera 210 translates from point P2 to point P3. Furthermore, as shown in FIG. 15B , the distance between the optical axis L21 of the first camera 210 in the second position and the optical axis L11 of the first lens barrel 110 in the first position is less than or equal to the first threshold. This further reduces the misalignment between the first camera 210 and the user's left pupil, thereby achieving better alignment between the first camera 210 and the user's left pupil.

[0160] The above adjustment method can effectively reduce measurement errors by repeatedly detecting the offset between the optical axis L11 of the first lens barrel 110 in the first position and the user's left pupil, and performing corresponding adjustment operations based on the measured offset, thereby enabling the optical axis L11 of the first lens barrel 110 and the optical axis L21 of the first camera 210 to be more accurately aligned with the user's left pupil.

[0161] It will be appreciated that the above embodiment only uses adjusting the position of the first lens barrel 110 and the first camera 210 as an example to describe the adjustment method provided by this application. However, this application is not limited thereto. For example, in other embodiments, the above adjustment method can also be used to adjust the position of the second lens barrel 120 and the second camera 220.

[0162] In some embodiments of the present application, the head-mounted display device 1 can also detect the user's interpupillary distance during the process of adjusting the positions of the first lens barrel 110, the first camera 210, the second lens barrel 120, and the second camera 220, and then adjust the display parameters based on the user's interpupillary distance to provide the user with a better visual experience. Referring to Figure 16, the adjustment method provided by the present application can further include the following steps:

[0163] S160: The head display device 1 detects the user's pupil distance.

[0164] In some embodiments of the present application, the head-mounted display device 1 can use a linear magnetic detection method to detect the user's interpupillary distance. For example, a linear magnetic coil is placed at a certain distance from the user's eyes. When the user's eyes move, the current in the linear magnetic coil changes. Therefore, the user's interpupillary distance can be obtained based on the current change.

[0165] S170: The head display device 1 adjusts display parameters according to the detected pupil distance.

[0166] The head-mounted display device 1 can optimize the parameters of the virtual camera in the virtual scene, distortion parameters, dispersion parameters and other parameters according to the detected pupil distance, so as to increase the matching degree between the head-mounted display device 1 and the user's pupil distance, thereby further reducing the blur and dizziness caused by the mismatch of pupil distance, and making the display effect clearer, more comfortable and realistic, thereby improving the user's visual experience.

[0167] For example, FIG17 shows a structural block diagram of the head display device 1 in an embodiment of the present application.

[0168] As shown in FIG17 , the head display device 1 may include a processor 101 , a memory 102 , a sensor module 103 , an audio module 104 , a button 105 , an input / output interface 106 , a communication module 107 , a power supply module 108 , and a display screen 109 .

[0169] The processor 101 is generally used to control the overall operation of the head-mounted display device 1 and may include one or more processing units. For example, the processor 101 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a video processing unit (VPU) controller, memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0170] Processor 101 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in processor 101 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 101. If processor 101 needs to use the instruction or data again, it can directly call it from the memory. This avoids repeated accesses, reduces the waiting time of processor 101, and thus improves system efficiency. In this application, processor 101 can execute the adjustment method mentioned in this application.

[0171] In some embodiments, the processor 101 may further be provided with the control device 600 described above, so as to drive the first lens barrel 110 based on the first driving device 400 and drive the first camera 210 based on the second driving device 500 .

[0172] In some embodiments, the processor 101 may further determine the user's interpupillary distance based on the principle of linear magnetic detection, and adjust the display parameters according to the determined interpupillary distance.

[0173] In some embodiments, the processor 101 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general purpose input / output (GPIO) interface, and / or a universal serial bus (USB) interface, a serial peripheral interface (SPI) interface, etc.

[0174] The memory 102 can be used to store computer executable program code, which includes instructions. The processor 101 executes various functional applications and data processing of the head-mounted display device 1 by running the instructions stored in the memory 102. The memory 102 may include a program storage area and a data storage area. The program storage area may store an operating system, an application required for at least one function (such as an image display function, a video playback function), etc. The data storage area may store data created during the use of the head-mounted display device 1 (such as eye images captured during eye tracking of the head-mounted display device 1), etc. In addition, the memory 102 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0175] The sensor module 103 may include sensors for detecting the working state and usage state of the head-mounted display device 1, including but not limited to optical sensors / pressure sensors for detecting whether the user is wearing the head-mounted display device 1, inertial sensors for detecting the user's head movement state, etc.

[0176] The audio module 104 may include a speaker, a microphone, etc., for implementing audio functions.

[0177] The buttons 105 may be one or more. The buttons 105 may be in the form of buttons, switches, dials, and touch or near-touch sensing devices (such as touch sensors). The head-mounted display device 1 can trigger corresponding functions based on the user's operation of one or more of the buttons 105, such as adjusting the position of the first lens barrel 110 and the second lens barrel 120, playing audio, etc.

[0178] The input / output interface 106 can connect other devices to the head-mounted display device 1 through appropriate components. The components may include, for example, audio / video jacks, data connectors, etc.

[0179] The communication module 107 may include a wireless communication module. The wireless communication function may be implemented through an antenna (not shown), a modem processor (not shown), and a baseband processor (not shown). The antenna is used to transmit and receive electromagnetic wave signals. The head-mounted display device 1 may include multiple antennas, each of which can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antenna can be used in conjunction with a tuning switch.

[0180] The wireless communication module can provide wireless communication solutions for the head-mounted display device 1, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), and other wireless communication solutions. The wireless communication module can be one or more devices that integrate at least one communication processing module. The wireless communication module receives electromagnetic waves via an antenna, frequency modulates and filters the electromagnetic wave signals, and transmits the processed signals to the processor 101. The wireless communication module can also receive signals to be transmitted from the processor 101, frequency modulate them, amplify them, and convert them into electromagnetic waves for radiation via the antenna.

[0181] The power supply module 108 may include a battery for supplying power to various modules of the head-mounted display device 1.

[0182] The display module 109 may include a display screen 109L and a display screen 109R, wherein the display screen 109L is used to display images to the left pupil of the user, and the display screen 109R is used to display images to the right pupil of the user.

[0183] It can be understood that the structure of the head display device 1 shown in Figure 17 is only an example. In other embodiments, the head display device 1 may include more or fewer modules, and may also merge or split some modules, which is not limited here.

[0184] The above describes the implementation methods of the present application by means of specific specific embodiments. Those skilled in the art can easily understand other advantages and effects of the present application from the contents disclosed in this specification. Although the description of the present application will be introduced in conjunction with some embodiments, this does not mean that the features of this application are limited to the implementation methods. On the contrary, the purpose of introducing the application in conjunction with the implementation methods is to cover other options or modifications that may be extended based on the claims of the present application. The present application can also be implemented without using these details. In addition, in order to avoid confusion or blurring the focus of the present application, some specific details are omitted in the description. It should be noted that the embodiments in the present application and the features in the embodiments can be combined with each other unless there is a conflict.

[0185] In the description of this application, it should be noted that the terms "center", "up", "down", "left", "right", "vertical", "horizontal", "outside", "inside", "circumferential", "radial", "axial", etc., indicating orientations or positional relationships, are based on the orientations or positional relationships shown in the accompanying drawings. They are only for the convenience of describing this application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation. Therefore, they cannot be understood as limitations on this application.

[0186] Obviously, those skilled in the art may make various changes and modifications to this application without departing from the spirit and scope of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalents, this application is intended to include these modifications and variations.

Claims

1. A lens module, characterized in that: It comprises a support base, and a first lens barrel and a first camera disposed on the support base, wherein: The first lens barrel and the first camera are arranged opposite to each other along a first direction, and the optical axis of the first lens barrel and the optical axis of the first camera extend along the first direction, and the first lens barrel and the first camera can respectively translate relative to the support base along a second direction, and the second direction is perpendicular to the first direction; The first lens barrel is connected to the first camera via a linkage mechanism, so that translation of the first lens barrel triggers translation of the first camera, and a distance between an optical axis of the first lens barrel and an optical axis of the first camera after translation is less than or equal to a first threshold.

2. The lens module according to claim 1, characterized in that: The linkage mechanism comprises a first driving device, a second driving device and a control device, wherein the first driving device is used to drive the first lens barrel to translate along the second direction, the second driving device is used to drive the first camera to translate along the second direction, and the first driving device and the second driving device are respectively connected to the control device for communication; When the first driving device drives the first lens barrel to translate a first distance along the second direction so that the first lens barrel is located at a first position, the control device can control the second driving device to drive the first camera to translate along the second direction to a second position according to the first distance, and the distance between the optical axis of the first camera located at the second position and the optical axis of the first lens barrel located at the first position is less than or equal to the first threshold.

3. The lens module according to claim 2, characterized in that: The driving end of the first driving device includes a gear and a first rack, the rotation axis of the gear extends along the first direction, the first rack extends along the second direction, the gear and the first rack are meshed with each other, and the first rack is fixedly connected to the first lens barrel.

4. The lens module according to claim 1, characterized in that: The linkage mechanism includes a connecting piece, and the first lens barrel and the first camera are fixedly connected via the connecting piece.

5. The lens module according to claim 4, characterized in that: The connecting piece is a connecting rod, a fastener, a clamping piece or an adhesive piece.

6. The lens module according to claim 1, characterized in that: The first threshold is 0-1 mm.

7. The lens module according to claim 1, characterized in that: The support seat includes a support slide rail extending along the second direction. The first lens barrel is arranged on the support slide rail and can slide relative to the support slide rail along the second direction.

8. The lens module according to claim 1, characterized in that: The support base is provided with an avoidance hole, which penetrates the support base along the first direction, and at least a portion of the first camera extends from a side of the support base facing the first lens barrel to a side of the support base facing away from the first lens barrel through the avoidance hole.

9. The lens module according to any one of claims 1 to 8, characterized in that: The lens module further includes a second lens barrel and a second camera disposed on the support seat, wherein along the second direction, the second lens barrel is spaced apart from the first lens barrel, and the second camera is spaced apart from the first camera, wherein: The second lens barrel and the second camera are arranged opposite to each other along the first direction, and the optical axis of the second lens barrel and the optical axis of the second camera extend along the first direction, and the second lens barrel and the second camera can respectively translate relative to the support base along the second direction; The second lens barrel is connected to the second camera via the linkage mechanism, so that the translation of the second lens barrel triggers the translation of the second camera, and the distance between the optical axis of the second lens barrel and the optical axis of the second camera after the translation is less than or equal to the first threshold.

10. The lens module according to claim 9, characterized in that: The support seat is provided with a first driving device, and a driving end of the first driving device is connected to the first lens barrel and the second lens barrel, and is used to drive the first lens barrel and the second lens barrel to translate along the second direction.

11. The lens module according to claim 10, characterized in that: Along the second direction, the first lens barrel and the second lens barrel are respectively located on opposite sides of the first driving device, wherein: The driving end of the first driving device includes a gear, a first rack and a second rack, the rotation axis of the gear extends along the first direction, the first rack and the second rack extend along the second direction, the first rack and the second rack are respectively meshed with the gear, and are respectively fixedly connected to the first lens barrel and the second lens barrel.

12. A head mounted display device, characterized in that: It comprises a shell and the lens module described in any one of claims 1 to 11, wherein the lens module is arranged on the shell.

13. A method for adjusting, applied to a head mounted display device, characterized in that: The head display device includes a lens module, and the lens module includes a first lens barrel, a first camera, a first driving device, a second driving device and a control device, wherein the first driving device is used to drive the first lens barrel, and the second driving device is used to drive the first camera, and the first driving device and the second driving device are respectively connected to the control device for communication; The method comprises: When the head display device is worn on the head of the user, the control device detects a first offset between the optical axis of the first lens barrel and the first pupil of the user, and the optical axis of the first lens barrel extends along a first direction; The control device controls the first driving device to drive the first lens barrel to translate a first distance along a second direction according to the first offset, so that the first lens barrel is located at a first position, and the second direction is perpendicular to the first direction; The control device controls the second driving device to drive the first camera to translate to a second position along the second direction according to the first distance, and the distance between the optical axis of the first camera at the second position and the optical axis of the first lens barrel at the first position is less than or equal to a first threshold.

14. The method according to claim 13, characterized in that The method further comprises: The control device detects a second offset between the optical axis of the first lens barrel located at the first position and the first pupil of the user, and determines whether the second offset is less than or equal to the first threshold; Corresponding to the second offset being greater than the first threshold, the control device controls the first lens barrel to translate along the second direction by a second distance according to the second offset, so that the first lens barrel translates from the first position to a third position; The control device controls the second driving device to drive the first camera to translate from the second position to a fourth position along the second direction based on the second distance, and the distance between the optical axis of the first camera at the fourth position and the optical axis of the first lens barrel at the third position is less than or equal to the first threshold.

15. The method according to claim 13, characterized in that The method further comprises: The head display device detects the pupil distance of the user; The head mounted display device adjusts display parameters according to the detected pupil distance of the user.

16. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions, which, when executed on a computer, enable the computer to execute the adjustment method described in any one of claims 13 to 15.

17. A head mounted display device, characterized in that: include: memory for storing instructions, and One or more processors, when the instructions are executed by the one or more processors, the processors perform the adjustment method according to any one of claims 13 to 15.

Images