Lens module, head-mounted display device and computer readable storage medium

Abstract

The invention relates to the technical field of terminals, and discloses a lens module, head display equipment and a computer readable storage medium. The lens module comprises a supporting seat, and a first lens cone and a first camera which are arranged on the supporting seat. Wherein the first lens cone and the first camera are oppositely arranged along a first direction, an optical axis of the first lens cone and an optical axis of the first camera extend along the first direction, the first lens cone and the first camera can translate along a second direction, and the second direction is perpendicular to the first direction; the first lens cone is connected with the first camera through a linkage mechanism, so that the translation of the first lens cone triggers the translation of the first camera, and the distance between the optical axis of the translated first lens cone and the optical axis of the first camera is smaller than or equal to a first threshold value. The lens module can effectively relieve depth perception errors, weaken discomfort such as asthenopia and dizziness, does not need to utilize a complex algorithm, does not consume large computing power, does not have the problem of picture distortion caused by algorithm limitation, and is good in visual experience.

Description

Technical Field

[0001] This application relates to the technical field of terminals, and particularly to a lens module, a head-mounted display device, and a computer-readable storage medium. Background Art

[0002] Video see-through (VST) technology is an important technology in mixed reality (MR), virtual reality (VR), and augmented reality (AR), and is widely used in head-mounted display devices with six degrees of freedom (6DOF) or functions of virtual-real fusion. Specifically, a real image of the real scene is obtained through a camera on the head-mounted display device, then combined with virtual information generated by a computer, and then output to the human eye through a display screen to produce a perspective fusion effect.

[0003] However, due to the limitations of the hardware structure and the overall appearance of the device, the camera in the head-mounted display device is usually fixed. Therefore, for users with different interpupillary distances, it is difficult for the optical axis of the camera to align with their pupils. There is a deviation between the scene seen by the user through video see-through and the real scene, resulting in problems such as incorrect depth perception, and thus discomfort such as visual fatigue and dizziness, and the visual experience is poor. For this reason, in some technical solutions, the perspective reconstruction can be achieved by calculating the global depth information pixel by pixel or in pixel blocks, so as to correct the deviation caused by the mismatch between the camera position and the interpupillary distance. However, due to the limitations of its own algorithm, there will be a problem of image distortion, and the visual experience is also poor. Summary of the Invention

[0004] To solve the above technical problems, this application provides a lens module, a head-mounted display device, and a computer-readable storage medium. The following introduces this application from multiple aspects, and the implementation manners and beneficial effects of the following multiple aspects can be referred to each other.

[0005] In a first aspect, an embodiment of this application provides a lens module. The lens module includes a support base, and a first lens barrel and a first camera disposed on the support base. Among them, the first lens barrel and the first camera are disposed opposite to each other along a first direction, and the optical axes of the first lens barrel and the first camera extend along the first direction. The first lens barrel and the first camera can respectively translate relative to the support base along a second direction, and the second direction is perpendicular to the first direction. The first lens barrel is connected to the first camera through a linkage mechanism, so that the translation of the first lens barrel triggers the translation of the first camera, and the distance between the optical axes of the translated first lens barrel and the first camera is less than or equal to a first threshold.

[0006] According to an embodiment of the present application, since the first lens barrel and the first camera are connected by a linkage mechanism, the translation of the first lens barrel in the second direction will cause the first camera to also translate in the second direction. Therefore, when the first lens barrel is translated to adjust the interpupillary distance, the position adjustment of the first camera can be achieved, thereby effectively alleviating problems such as depth perception errors, visual fatigue, and dizziness caused by the poor alignment of the optical axis of the first camera with the user's pupil. Moreover, the above lens module connects the first lens barrel and the first camera through a linkage mechanism, so that the position of the first camera can be adjusted during the interpupillary distance adjustment process without using complex algorithms. Therefore, there is no problem of image distortion caused by algorithm limitations, and the visual experience is good. In addition, it does not consume a large amount of computing power additionally, and the overall machine load and power consumption are smaller.

[0007] In some embodiments, the linkage mechanism includes a first driving device, a second driving device, and a control device. Among them, the first driving device is used to drive the first lens barrel to translate in the second direction, the second driving device is used to drive the first camera to translate in the second direction, and the first driving device and the second driving device are respectively communicatively connected to the control device. When the first driving device drives the first lens barrel to translate a first distance in the second direction so that the first lens barrel is in the first position, the control device can control the second driving device to drive the first camera to translate to the second position in the second direction according to the first distance, and the distance between the optical axis of the first camera in the second position and the optical axis of the first lens barrel in the first position is less than or equal to a first threshold.

[0008] According to an embodiment of the present application, through the first driving device, the second driving device, and the control device, the translation of the first lens barrel can trigger the translation of the first camera, thereby effectively alleviating problems such as depth perception errors, visual fatigue, and dizziness caused by the poor alignment of the optical axis of the first camera with the user's pupil, and the visual experience is good.

[0009] In some embodiments, the driving end of the first driving device includes a gear and a first rack. The rotation axis of the gear extends in the first direction, the first rack extends in the second direction, the gear meshes with the first rack, and the first rack is fixedly connected to the first lens barrel.

[0010] In some embodiments, the linkage mechanism includes a connecting member, and the first lens barrel and the first camera are fixedly connected through the connecting member. Thus, the translation of the first lens barrel triggers the translation of the first camera, and further effectively alleviates problems such as depth perception errors, visual fatigue, and dizziness caused by the poor alignment of the optical axis of the first camera with the user's pupil, and the visual experience is good.

[0011] In some embodiments, the connecting member is a connecting rod, a fastening member, a clamping member, or an adhesive member.

[0012] In some embodiments, the first threshold is 0 to 1 mm. For example, 0, 0.1 mm, 0.2 mm, 0.3 mm, etc.

[0013] In some embodiments, the support base includes a support slide rail extending in the second direction. The first lens barrel is disposed on the support slide rail and can slide relative to the support slide rail in the second direction.

[0014] While supporting the first lens barrel, the above support slide rail can also guide the first lens barrel to translate in the second direction, thereby ensuring the smoothness of the movement of the first lens barrel.

[0015] In some embodiments, an avoidance hole is formed in the support base. The avoidance hole penetrates the support base in the first direction. At least part of the first camera extends from the side of the support base facing the first lens barrel to the side of the support base facing away from the first lens barrel through the avoidance hole.

[0016] In this way, the avoidance hole can effectively prevent the support base from blocking the shooting of the first camera, and at the same time can also prevent the support base from interfering with the translation of the first camera in the second direction.

[0017] In some embodiments, the lens module further includes a second lens barrel and a second camera disposed on the support base. Along the second direction, the second lens barrel and the first lens barrel are spaced apart, and the second camera and the first camera are spaced apart. Among them, the second lens barrel and the second camera are oppositely arranged in the first direction, and the optical axis of the second lens barrel and the optical axis of the second camera extend in the first direction. The second lens barrel and the second camera can respectively translate relative to the support base in the second direction. The second lens barrel and the second camera are connected by a linkage mechanism so that the translation of the second lens barrel triggers the translation of the second camera, and the distance between the optical axis of the second lens barrel and the optical axis of the second camera after translation is less than or equal to the first threshold.

[0018] According to the embodiments of the present application, since the second lens barrel and the second camera are connected by a linkage mechanism, the translation of the second lens barrel in the second direction will cause the first camera to also translate in the second direction. Therefore, when the second lens barrel is translated to adjust the interpupillary distance, the position adjustment of the second camera can be realized, thereby effectively alleviating problems such as depth perception errors, visual fatigue, and dizziness caused by the poor alignment between the optical axis of the second camera and the user's pupil.

[0019] In some embodiments, a first driving device is provided on the support base. The driving end of the first driving device is connected to the first lens barrel and the second lens barrel for driving the first lens barrel and the second lens barrel to translate in the second direction.

[0020] That is to say, the first lens barrel and the second lens barrel share a first driving device. Therefore, there is no need to additionally set other driving devices to drive the second lens barrel to translate, effectively reducing the number of components, thereby improving the assembly efficiency of the lens module and reducing the production cost.

[0021] In some embodiments, along the second direction, the first lens barrel and the second lens barrel are respectively located on opposite sides of the first driving device. Wherein, the driving end of the first driving device includes a gear, a first rack and a second rack. The rotation axis of the gear extends along the first direction, the first rack and the second rack extend along the second direction, the first rack and the second rack are respectively meshed with the gear, and are respectively fixedly connected to the first lens barrel and the second lens barrel.

[0022] In a second aspect, an embodiment of the present application provides a head-mounted display device, which includes a housing and the lens module provided in any embodiment of the first aspect of the present application, and the lens module is provided on the housing.

[0023] In a third aspect, an embodiment of the present application provides an adjustment method, which is applied to a head-mounted display device. Wherein, the head-mounted display device includes a lens module, the lens module includes a first lens barrel, a first camera, a first driving device, a second driving device and a control device. The first driving device is used to drive the first lens barrel, the second driving device is used to drive the first camera, and the first driving device and the second driving device are respectively communicatively connected to the control device.

[0024] The adjustment method includes: when the head-mounted display device is worn on the user's head, the control device detects a first offset between the optical axis of the first lens barrel and the user's first pupil, and the optical axis of the first lens barrel extends along the first direction; the control device controls the first driving device to drive the first lens barrel to translate a first distance along the second direction according to the first offset, so that the first lens barrel is located at a first position, and the second direction is perpendicular to the first direction; the control device controls the second driving device to drive the first camera to translate to a second position along the second direction according to the first distance, and the distance between the optical axis of the first camera located at the second position and the optical axis of the first lens barrel located at the first position is less than or equal to a first threshold.

[0025] Through the first driving device, the second driving device and the control device, the above adjustment method can trigger the translation of the first camera by the translation of the first lens barrel, thereby effectively alleviating problems such as depth perception errors, visual fatigue, and dizziness caused by poor alignment between the optical axis of the first camera and the user's left pupil, and the user has a good visual experience.

[0026] In some embodiments, the adjustment method further includes: the control device detecting a second offset between the optical axis of the first lens barrel located at the first position and the first pupil of the user, and determining whether the second offset is less than or equal to a first threshold; corresponding to the second offset being greater than the first threshold, the control device controlling the first lens barrel to translate a second distance along a second direction, so that the first lens barrel translates from the first position to the third position; the control device controlling the second driving device to drive the first camera to translate from the second position to the fourth position along the second direction according to the second distance, and the distance between the optical axis of the first camera located at the fourth position and the optical axis of the first lens barrel located at the third position being less than or equal to the first threshold.

[0027] Through the above adjustment method, by detecting the offset between the optical axis of the first lens barrel at the first position and the first pupil of the user multiple times, and performing corresponding adjustment operations according to the measured offset, the measurement error can be effectively reduced, so that the optical axes of the first lens barrel and the first camera can be more accurately aligned with the first pupil of the user.

[0028] In some embodiments, the adjustment method further includes: the head-mounted device detecting the interpupillary distance of the user; the head-mounted device adjusting the display parameters according to the detected interpupillary distance of the user.

[0029] According to the embodiments of the present application, the head-mounted device can optimize parameters such as the parameters of the virtual camera, distortion parameters, and chromatic aberration parameters in the virtual scene according to the detected interpupillary distance, so as to increase the matching degree between the head-mounted device and the user's interpupillary distance, thereby further weakening the blur and dizziness caused by the mismatch of the interpupillary distance, and at the same time making the display effect clearer, more comfortable and more realistic, and thus improving the visual experience.

[0030] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, on which instructions are stored, and when the instructions are executed on a computer, the computer executes the adjustment method provided in any embodiment of the third aspect of the present application.

[0031] In a fifth aspect, an embodiment of the present application provides a head-mounted device, which includes a memory for storing instructions, and one or more processors. When the instructions are executed by the one or more processors, the processors execute the adjustment method provided in any embodiment of the third aspect of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 Shows an exemplary structure of a head-mounted device in an embodiment of the present application;

[0033] Figure 2A Shows the relative positional relationship between the first lens barrel and the second lens barrel and the left and right eye pupils of the user when the head-mounted device in the embodiment of the present application is worn on the user's head;

[0034] Figure 2B Shows the relative positional relationship between the first camera and the second camera and the pupils of the user's left and right eyes when the head-mounted device is worn on the user's head in an embodiment of the present application;

[0035] Figure 3A Shows the structural schematic diagram of the lens module in some technical solutions Figure 1 ;

[0036] Figure 3B Shows the second structural schematic diagram of the lens module in some technical solutions;

[0037] Figure 4A Shows the schematic diagram of depth perception errors generated by users with different interpupillary distances in some technical solutions Figure 1 ;

[0038] Figure 4B Shows the second schematic diagram of depth perception errors generated by users with different interpupillary distances in some technical solutions;

[0039] Figure 5A Shows the schematic diagram of the real scene observed by the user from the perspective of wearing the head-mounted device in some other technical solutions;

[0040] Figure 5B Shows the schematic diagram of the real scene observed by the user from the perspective of wearing the head-mounted device in some other technical solutions;

[0041] Figure 5C Shows the schematic diagram of the real scene observed by the user from the perspective of wearing the head-mounted device in some other technical solutions;

[0042] Figure 6A Shows the front view of the lens module in an embodiment of the present application;

[0043] Figure 6B Shows the rear view of the lens module in an embodiment of the present application;

[0044] Figure 6C Shows that in an embodiment of the present application, the lens module is along Figure 6A The sectional view taken along A-A in;

[0045] Figure 7A Shows the rear view of the translation of the first lens barrel, the second lens barrel, the first camera and the second camera in an embodiment of the present application Figure 1 ;

[0046] Figure 7B Shows the top view of the translation of the first lens barrel, the second lens barrel, the first camera and the second camera in an embodiment of the present application Figure 1 ;

[0047] Figure 8AShows the second rear view of the translation of the first lens barrel, second lens barrel, first camera, and second camera in the embodiments of the present application;

[0048] Figure 8B Shows the second top view of the translation of the first lens barrel, second lens barrel, first camera, and second camera in the embodiments of the present application;

[0049] Figure 9A Shows the first exemplary structure of the connecting member in the embodiments of the present application;

[0050] Figure 9B Shows the second exemplary structure of the connecting member in the embodiments of the present application;

[0051] Figure 9C Shows the third exemplary structure of the connecting member in the embodiments of the present application;

[0052] Figure 9D Shows the fourth exemplary structure of the connecting member in the embodiments of the present application;

[0053] Figure 10A Shows the first driving device in the embodiments of the present application in Figure 6A The partial enlarged view of the S1 area;

[0054] Figure 10B Shows the cross-sectional view of the first driving device along B-B in Figure 10A ;

[0055] Figure 11A Shows the schematic diagram of the electrical connection between the first lens barrel and the first camera in the embodiments of the present application Figure 1 ;

[0056] Figure 11B Shows the second schematic diagram of the electrical connection between the first lens barrel and the first camera in the embodiments of the present application;

[0057] Figure 11C Shows the third schematic diagram of the electrical connection between the first lens barrel and the first camera in the embodiments of the present application;

[0058] Figure 12 Shows the flowchart of the adjustment method in the embodiments of the present application;

[0059] Figure 13A Shows the first exemplary adjustment process of the head-mounted device in the embodiments of the present application;

[0060] Figure 13B Shows the second exemplary adjustment process of the head-mounted device in the embodiments of the present application;

[0061] Figure 13C Shows the third exemplary adjustment process of the head-mounted device in the embodiments of the present application;

[0062] Figure 14 Another adjustment method in the embodiment of the present application is shown;

[0063] Figure 15A An exemplary adjustment process 1 of another head-mounted display device in the embodiment of the present application is shown;

[0064] Figure 15B An exemplary adjustment process 2 of another head-mounted display device in the embodiment of the present application is shown;

[0065] Figure 16 A flowchart for adjusting display parameters in the embodiment of the present application is shown;

[0066] Figure 17 A structural block diagram of a head-mounted display device in the embodiment of the present application is shown. Detailed implementation manners

[0067] To make the objectives, technical solutions, and advantages of the present application clearer, the following will further describe the implementation manners of the present application in detail with reference to the accompanying drawings.

[0068] The embodiment of the present application is used to provide a lens module and a head-mounted display device including the lens module. The lens module can effectively alleviate the depth perception error caused by the inconsistent optical axis of the camera for implementing video perspective and the pupil position of the human eye, weaken discomforts such as visual fatigue and dizziness, and does not require complex algorithms. Therefore, it does not consume additional large computing power, nor does it have the problem of image distortion caused by algorithm limitations, and has a good visual experience.

[0069] In the present application, the head-mounted display device may be a head-mounted display device adopting video perspective technology such as a mixed reality (MR) head-mounted display device, a virtual reality (VR) head-mounted display device, an augmented reality (AR) head-mounted display device, etc., and the present application does not make specific limitations. For ease of description, the mixed reality head-mounted display device will be taken as an example of the head-mounted display device 1 hereinafter.

[0070] Figure 1 An exemplary structure of the head-mounted display device 1 in the embodiment of the present application is shown. Refer to Figure 1 , the head-mounted display device 1 includes a lens module 10, a housing 20, a first leg 30a, and a second leg 30b. Among them, the lens module 10 is disposed on the housing 20. The housing 20 includes a first connection portion 21a and a second connection portion 21b. The first connection portion 21a is connected to one end of the first leg 30a. The second connection portion 21b is connected to one end of the second leg 30b. When the user wears the head-mounted display device 1, the user can view virtual scenes and real scenes through the lens module 10.

[0071] For ease of description, before introducing the working principle of the lens module 10, the X-axis direction, Y-axis direction, and Z-axis direction of the head-mounted device 1 are defined in combination with the accompanying drawings. Among them, the X-axis direction is the length direction of the head-mounted device 1. For example, the positive X-axis direction is the direction from the first connecting portion 21a to the second connecting portion 21b; the Z-axis direction is the thickness direction of the head-mounted device 1. For example, the positive Z-axis direction is the direction from the first connecting portion 21a of the housing 20 to the first leg portion 30a; the Y-axis direction is the width direction of the head-mounted device 1. For example, the Y-axis direction can be perpendicular to the X-axis direction and the Z-axis direction pairwise. In this application, the Z-axis direction is taken as an example of the first direction, and the X-axis direction is taken as an example of the second direction, which will not be elaborated below.

[0072] Continuing to refer to Figure 1 , the lens module 10 may include a first lens barrel 110, a second lens barrel 120, a first camera 210, and a second camera 220. Among them, the first lens barrel 110 and the second lens barrel 120 are arranged at intervals along the X-axis direction and are used to carry a lens assembly (not shown). The first lens barrel 110 and the first camera 210 are arranged opposite to each other along the Z-axis direction. The second lens barrel 120 and the second camera 120 are arranged opposite to each other along the Z-axis direction. It can be understood that when the head-mounted device 1 is worn on the user's head, along the Z-axis direction, the first lens barrel 110 and the second lens barrel 120 are closer to the user's head than the first camera 210 and the second camera 220.

[0073] Figure 2A FIG. shows the relative positional relationship between the first lens barrel 110 and the second lens barrel 120 and the user's left and right eye pupils when the head-mounted device 1 is worn on the user's head in the embodiment of the present application. Figure 2B FIG. shows the relative positional relationship between the first camera 210 and the second camera 220 and the user's left and right eye pupils when the head-mounted device 1 is worn on the user's head in the embodiment of the present application.

[0074] For ease of understanding, first in combination with Figure 2A and Figure 2B the optical axis L11 of the first lens barrel 110, the optical axis L12 of the second lens barrel 120, the center distance Dg between the first lens barrel 110 and the second lens barrel 120, the optical axis L21 of the first camera 210, the optical axis L22 of the second camera 220, the baseline Lc (baseline) of the first camera 210 and the second camera 220, and the interpupillary distance Le (IPD) of the user are introduced.

[0075] Among them, the optical axis L11 of the first lens barrel 110 is the center line of the light beam passing through the first lens barrel 110. The optical axis L12 of the second lens barrel 120 is the center line of the light beam passing through the second lens barrel 120. The center distance Dg between the first lens barrel 110 and the second lens barrel 120 is the distance between the optical axis L11 of the first lens barrel 110 and the optical axis L12 of the second lens barrel 120.

[0076] The optical axis L21 of the first camera 210 is the center line of the light beam passing through the center point of the lens of the first camera 210. The optical axis L22 of the second camera 220 is the center line of the light beam passing through the center point of the lens of the second camera 220. The baseline Lc between the first camera 210 and the second camera 220 refers to the distance between the optical axis L21 of the first camera 210 and the optical axis L22 of the second camera 220.

[0077] The interpupillary distance Le of the user refers to the distance between the left pupil and the right pupil of the user.

[0078] Among them, the optical axis L11 of the first lens barrel 110, the optical axis L12 of the second lens barrel 120, the optical axis L21 of the first camera 210, and the optical axis L22 of the second camera 220 are all parallel to the Z-axis direction.

[0079] Reference Figure 2A and Figure 2B, when the head-mounted device 1 is worn on the user's head, the first lens barrel 110 and the first camera 210 correspond to the user's left eye pupil, and the second lens barrel 120 and the second camera 220 correspond to the user's right eye pupil, so that the user can normally view the virtual scene and the real scene. Among them, the distance between the optical axis L11 of the first lens barrel 110 and the user's left eye pupil, the distance between the optical axis L21 of the first camera 210 and the user's left eye pupil, the distance between the optical axis L12 of the second lens barrel 120 and the user's right eye pupil, and the distance between the optical axis L22 of the second camera 220 and the user's right eye pupil are all less than or equal to the first threshold. Among them, the first threshold can be 0 to 1 mm, for example, 0, 0.1 mm, 0.2 mm, etc. Thus, the optical axis L11 of the first lens barrel 110 and the optical axis L21 of the first camera 210 are respectively approximately aligned with the user's left eye pupil, and the optical axis L12 of the second lens barrel 120 and the optical axis L22 of the second camera 220 are respectively approximately aligned with the user's right eye pupil. That is to say, the center distance Dg between the first lens barrel 110 and the second lens barrel 120 and the baseline Lc between the first camera 210 and the second camera 220 are respectively approximately the same as the pupil distance Le of the user. In this way, the optical devices (such as lens assemblies, etc.) in the first lens barrel 110 and the second lens barrel 120 can project the computer-generated virtual images into the user's left eye pupil and right eye pupil respectively. The first camera 210 and the second camera 220 can capture the objects in the real scene (such as the objects located at Wc) and form images on the display screens 109L and 109R, so as to present the real scene to the user. Thus, an information loop for interactive feedback is established among the real scene, the virtual scene, and the user, realizing the fusion of the real scene and the virtual scene, and further enhancing the realism of the user experience.

[0080] The following introduces an exemplary setting method of the lens barrel and the camera in the lens module with reference to the accompanying drawings.

[0081] Figure 3A and Figure 3B shows a schematic structural diagram of the lens module 10' in some technical solutions, where Figure 3A is the side where the lens module 10' includes the first lens barrel 110' and the second lens barrel 120', Figure 3B is the side where the lens module 10' includes the first camera 210' and the second camera 220'.

[0082] Combined with Figure 3A and Figure 3B, in some technical solutions, the first lens barrel 110' and the second lens barrel 120' in the lens module 10' can move relative to each other along the X-axis direction, thereby driving the lens assembly (not labeled) located inside to move relative to each other along the X-axis direction to achieve pupil distance adjustment. That is, the center distance Dg between the first lens barrel 110' and the second lens barrel 120' can be matched with the pupil distances of different users, so as to present clear images for users with different pupil distances.

[0083] However, due to the limitations of the hardware structure and overall appearance of the lens module 10', the first camera 210' and the second camera 220' are fixed. Therefore, for users with different pupil distances, there will be a certain difference between the first camera 210' and the second camera 220' and the left and right eye pupils of the user, resulting in depth perception errors, causing problems such as dizziness and eye discomfort, and affecting the user's visual experience.

[0084] Specifically, Figure 4A and Figure 4B shows schematic diagrams of depth perception errors generated by users with different pupil distances in some technical solutions. Referring to Figure 4A , the first camera 210' and the second camera 220' capture an object located at point Wc and form images on the display screen 109L and the display screen 109R. However, for users with large pupil distances, the baseline Lc of the first camera 210' and the second camera 220' is smaller than the pupil distance Le of the user. Therefore, the object perceived by the user is located at point We, and point We is closer to the user than point Wc, with a sense of distance being on the closer side. Referring to Figure 4B , for users with small pupil distances, the baseline Lc of the first camera 210' and the second camera 220' is larger than the pupil distance Le of the user. Therefore, the object perceived by the user is located at point We, and point We is farther away from the user than point Wc, with a sense of distance being on the farther side.

[0085] To this end, in some other technical solutions, depth perspective reconstruction can be achieved by calculating global depth information pixel by pixel or in pixel blocks, so as to correct the deviation caused by the mismatch between the camera baseline Lc and the pupil distance Le. Currently, due to the limitations of this binocular depth algorithm, it does not support pixel-by-pixel modeling and can only use the method of depth reprojection in pixel blocks for depth perspective reconstruction, but this will cause problems of image distortion, and the user's visual experience is also poor.

[0086] For example, Figures 5A to 5C shows schematic diagrams of several real-world scenes observed by users wearing a head-mounted display device in some other technical solutions. As Figure 5A shown, in the image seen through the head-mounted display device, the mobile phone 2 held by the user and the objects 3 in the background are all distorted. Another example is Figure 5B and Figure 5CAs shown, in the image seen through the head-mounted device, the mobile phone 2 held by the user is in a distorted state.

[0087] The present application provides a lens module for improving the above problems. Compared with the above head-mounted device, the camera in the lens module provided by the present application can translate along with the translation of the lens barrel. Therefore, during the process of the user translating the lens barrel to adjust the interpupillary distance, the translation of the camera can be achieved, so that the optical axis of the camera can be aligned with the pupil of the user, and the viewing needs of users with different interpupillary distances can be met without using a binocular depth algorithm, effectively alleviating the problem of depth perception error generated by the user when viewing images, weakening discomforts such as visual fatigue and dizziness, and there is also no problem of image distortion caused by algorithm limitations, and the visual experience is good.

[0088] The technical solution of the present application will be introduced below with reference to the accompanying drawings.

[0089] Figures 6A to 6C FIG. shows an exemplary structure of the lens module 10 in an embodiment of the present application, wherein, Figure 6A is a front view of the lens module 10, Figure 6B is a rear view of the lens module 10, Figure 6C is a cross-sectional view of the lens module 10 along Figure 6A A-A in FIG. Among them, the front of the lens module 10 refers to the side facing the user in the use state of the lens module 10, and the back of the lens module 10 is the side opposite to the front along the Z-axis direction.

[0090] Combined with Figures 6A to 6C , the lens module 10 includes a support base 100, a first lens barrel 110, a second lens barrel 120, a first camera 210 and a second camera 220. Among them, the first lens barrel 110, the second lens barrel 120, the first camera 210 and the second camera 220 are all arranged on the support base 100.

[0091] Among them, the first lens barrel 110 and the second lens barrel 120 are arranged at intervals along the X-axis direction. The first camera 210 and the second camera 220 are arranged at intervals along the X-axis direction. The first lens barrel 110 and the first camera 210 are arranged opposite to each other along the Z-axis direction, and the optical axis L11 of the first lens barrel 110 and the optical axis L21 of the first camera 210 both extend along the Z-axis direction; the second lens barrel 120 and the second camera 220 are arranged opposite to each other along the Z-axis direction, and the optical axis L12 of the second lens barrel 120 and the optical axis L22 of the second camera 220 both extend along the Z-axis direction.

[0092] The first lens barrel 110, the second lens barrel 120, the first camera 210, and the second camera 220 can all be translated relative to the support base 100 along the X-axis direction. Among them, the first lens barrel 110 and the first camera 210 are connected by a linkage mechanism 300, so that the translation of the first lens barrel 110 triggers the translation of the first camera 210, and the distance between the optical axis L11 of the first lens barrel 110 after translation and the optical axis L21 of the first camera 210 is less than or equal to the first threshold. The second lens barrel 120 and the second camera 220 are connected by a linkage mechanism 300, so that the translation of the second lens barrel 120 triggers the translation of the second camera 220, and the distance between the optical axis L12 of the second lens barrel 120 after translation and the optical axis L22 of the second camera 220 is less than or equal to the first threshold. In this way, when the first lens barrel 110 and the second lens barrel 120 are translated for interpupillary distance adjustment, the position adjustment of the first camera 210 and the second camera 220 can be realized to adapt to users with different interpupillary distances, thereby effectively improving the visual experience of users.

[0093] Exemplarily, Figure 7A and Figure 7B show the schematic diagrams of the translation of the first lens barrel 110, the second lens barrel 120, the first camera 210, and the second camera 220 in the embodiments of the present application Figure 1 where Figure 7A is the rear view of the lens module 10, Figure 7B is the top view of the lens module 10.

[0094] Figure 8A and Figure 8B show the second schematic diagrams of the translation of the first lens barrel 110, the second lens barrel 120, the first camera 210, and the second camera 220 in the embodiments of the present application, where Figure 8A is the rear view of the lens module 10, Figure 8B is the top view of the lens module 10.

[0095] Referring to Figures 7A to 8B , the interpupillary distance adjustment can be realized by translating the first lens barrel 110. For example, for users with a small interpupillary distance, the first lens barrel 110 can be translated closer to the second lens barrel 120 along the positive X-axis direction to move from the positions shown in Figure 7A and Figure 7B to the positions shown in Figure 8A and Figure 8B , so that the optical axis L11 of the first lens barrel 110 is roughly aligned with the left eye pupil of the user, reducing the center distance Dg between the first lens barrel 110 and the second lens barrel 120 to meet the usage requirements of users with a small interpupillary distance.

[0096] Since the first lens barrel 110 and the first camera 210 are connected via a linkage mechanism 300, the translation of the first lens barrel 110 along the positive direction of the X-axis will cause the first camera 210 to also translate along the positive direction of the X-axis close to the second camera 220, so as to Figure 7A and Figure 7B Move the position shown to Figure 8A and Figure 8B The position shown in the figure makes the optical axis L21 of the first camera 210 also roughly aligned with the left pupil of the user, reducing the baseline Lc between the first camera 210 and the second camera 220 to meet the use requirements of users with a small pupil distance. It can be understood that at this time, the optical axis L21 of the first camera 210 and the optical axis L11 of the first lens barrel 110 are roughly aligned, that is, the distance between the optical axis L21 of the first camera 210 and the optical axis L11 of the first lens barrel 110 is less than or equal to the first threshold.

[0097] On the contrary, for users with a large pupil distance, the first lens barrel 110 can be translated away from the second lens barrel 120 along the negative direction of the X axis, and the first camera 210 is translated away from the second camera 220 along the negative direction of the X axis to obtain a better viewing experience. Figure 8A and Figure 8B Move the position shown to Figure 7A and Figure 7B At this time, the axis L11 of the first lens barrel 110 and the axis L21 of the first camera 210 are roughly aligned with the left pupil of the user, respectively, and the center distance Dg between the first lens barrel 110 and the second lens barrel 120 and the baseline Le of the first camera 210 and the second camera 220 are increased to meet the use requirements of users with large pupil distance.

[0098] In this way, the problems of depth perception error, visual fatigue, dizziness, etc. caused by the poor alignment between the optical axis L21 of the first camera 210 and the user's left pupil can be effectively alleviated. In addition, the lens module 10 connects the first lens barrel 110 and the first camera 210 through the linkage mechanism 300, so that the position of the first camera 210 can be adjusted during the pupil distance adjustment without using a complex algorithm. Therefore, compared with the above-mentioned solution of using a binocular depth algorithm to achieve depth perspective reconstruction, there is no problem of picture distortion caused by algorithm limitations, and the visual experience is good. In addition, it will not consume a large amount of computing power, and the whole machine load and power consumption are smaller.

[0099] It can be understood that the movement processes of the second lens barrel 120 and the second camera 220 are substantially the same as those of the first lens barrel 110 and the first camera 210 described above. Therefore, reference can be made to the descriptions of the first lens barrel 110 and the first camera 210 in this article, and details will not be elaborated here. Additionally, for ease of description, the following will continue to use the example of the first lens barrel 110 and the first camera 210 being connected by a linkage mechanism 300 to introduce the specific implementation manner of connecting the lens barrel and the camera.

[0100] It should be noted that the term "connected" in the connection between the first lens barrel 110 and the first camera 210 by the linkage mechanism 300 above can be a mechanical connection or an electrical connection; it can be a fixed connection, a detachable connection, or an integral connection. This application does not limit this, and any connection method that can trigger the translation of the first camera 210 when the first lens barrel 110 is translated is within the protection scope of this application.

[0101] In an implementable solution, the first lens barrel 110 and the first camera 210 can be mechanically connected through the linkage mechanism 300.

[0102] Continue to refer to Figure 6C , in some embodiments of this application, the linkage mechanism 300 includes a connecting member 310. The connecting member 310 is connected between the first lens barrel 110 and the first camera 210, so that the first lens barrel 110 and the first camera 210 are integrated. In this way, when the first lens barrel 110 is translated along the X-axis direction, it can drive the first camera 210 to be translated along the X-axis direction.

[0103] In some embodiments of this application, the connecting member 310 can be any one of a connecting rod, a fastener, a clamping member, or an adhesive member.

[0104] Figures 9A to 9D Illustrates exemplary structures of several connecting members 310 in the embodiments of this application.

[0105] Refer to Figure 9A , in some of these implementation manners, the connecting member 310 is a connecting rod, and both ends of the connecting rod can be fixedly connected to the bases 211 of the first lens barrel 110 and the first camera 210 respectively, so that the first camera 210 can be translated along with the translation of the first lens barrel 110.

[0106] In some of these implementation manners, if the connecting member 310 is a fastener, the first lens barrel 110 and the first camera 210 can be tightly connected by the fastener. For example Figure 9B as shown, the connecting member 310 can be a screw, and the screw rod of the screw passes through the base 211 of the first camera 210, the support member 100, and the first lens barrel 110, and is fixedly connected to the first lens barrel 110 by threads.

[0107] In some of these implementations, the connecting member 310 is a snap - on member, and the first lens barrel 110 and the first camera 210 can be snap - connected to each other through the snap - on member. For example Figure 9C As shown, the connecting member 310 may include a snap hole 311 and a snap block 312 disposed in the snap hole 311. One of the snap hole 311 and the snap block 312 is disposed on the first lens barrel 110, and the other is disposed on the base 211 of the first camera 210.

[0108] Refer to Figure 9D , in some of these implementations, the connecting member 310 may also be an adhesive member, and the first lens barrel 110 and the base 211 of the first camera 210 can be adhesively connected to each other through the adhesive member. For example, the connecting member 310 can be an adhesive (such as acrylic adhesive or epoxy resin adhesive, etc.).

[0109] It can be understood that the above - mentioned embodiments are only partial implementation manners of the connecting member 310 in this application. Other structural forms of the connecting member 310 that can achieve the fixed connection between the first lens barrel 110 and the first camera 210 are within the protection scope of this application.

[0110] Continue to refer to Figure 6C and in combination with Figure 7A and Figure 8A , in some embodiments of this application, an avoidance hole 130 is formed in the support base 100. The avoidance hole 130 penetrates the support base 100 along the Z - axis direction. At least a part of the first camera 210 extends from the side of the support base 100 facing the first lens barrel 110 to the side of the support base 100 facing away from the first lens barrel 110 through the avoidance hole 130.

[0111] In this way, the avoidance hole 130 can effectively prevent the support base 100 from blocking the shooting of the first camera 210, and at the same time, it can also prevent the support base 100 from interfering with the translation of the first camera 210 along the X - axis direction.

[0112] For example, the base 211 of the first camera 210 can be located on the side of the support base 100 facing the first lens barrel 110 to facilitate the fixed connection with the first lens barrel 110 through the base 211. The lens 212 of the first camera 210 can capture the real - world scene outside the lens module 10 through the avoidance hole 130. At the same time, when the first camera 210 translates along the Y - axis direction, the lens 212 can slide in the avoidance hole 130 without colliding with the support base 100.

[0113] After introducing the specific implementation manners of the mechanical connection between the first lens barrel 110 and the first camera 210. Since the translation of the first camera 210 is achieved by translating the first lens barrel 110, therefore, the following further introduces the specific implementation manners of the translation of the first lens barrel 110.

[0114] Continue to refer to Figure 6A and Figure 6B , in some embodiments of the present application, the lens module 10 includes a first driving device 400. The first driving device 400 is used to drive the first lens barrel 110 to translate in the X-axis direction.

[0115] Specifically, Figure 10A and Figure 10B show an exemplary structure of the first driving device 400 in an embodiment of the present application, wherein, Figure 10A is Figure 6A a partial enlarged view of the S1 area in Figure 10B is a sectional view of the first driving device 400 along Figure 10A B-B in Figure 10A and Figure 10B With reference to Figure 6A and Figure 6B , the first driving device 400 includes a connected mounting end 410 and a driving end 420. Among them, the mounting end 410 can be provided on the side of the support base 100 facing away from the first lens barrel 110. One end of the driving end 420 is connected to the mounting end 410, and the other end passes through the support base 100 along the Z-axis direction and extends to the side of the support base 100 facing the first lens barrel 110 to be fixedly connected to the first lens barrel 110, so as to be able to transmit a driving force to the first lens barrel 110 to drive the first lens barrel 110 to translate in the X-axis direction.

[0116] Exemplarily, the translation of the first lens barrel 110 can be realized by a gear and rack. Specifically, the driving end 420 of the first driving device 400 includes a gear 430 and a first rack 441. Among them, the rotation axis of the gear 430 (for example, Figure 10B the central axis L430) extends along the Z-axis direction. The gear 430 meshes with the first rack 441. The first rack 441 extends in the X-axis direction, and one end of the first rack 441 is fixedly connected to the outer peripheral surface of the first lens barrel 110, so as to realize the translation of the first lens barrel 110. For example, when the gear 430 rotates around the axis L430 in the C direction, the first rack 441 translates in the positive X-axis direction, thereby driving the first lens barrel 110 to translate closer to the second lens barrel 120 in the positive X-axis direction. For example, the first lens barrel 110 can move from the positions shown in Figure 7A and Figure 7B to the positions shown in Figure 8A and Figure 8B .

[0117] Alternatively, in other alternative embodiments, the driving end 420 may also include a cam mechanism or a crank slider mechanism, and the cam mechanism or the crank slider mechanism is used to achieve the translation of the first lens barrel 110. The present application does not impose any restrictions on this, and any driving end 420 that can achieve the translation of the first lens barrel 110 along the X-axis direction is within the protection scope of the present application.

[0118] Continue reading Figure 10A and Figure 10B In some embodiments of the present application, the driving end 420 may further include a driving shaft 450 extending in the Z-axis direction. The driving shaft 450 passes through the support seat 100, and the two ends of the driving shaft 450 are respectively connected to the mounting end 410 and the gear 430 located on opposite sides of the support seat 100. The driving shaft 450 can rotate around the axis L430, thereby driving the gear 430 to rotate, thereby realizing the translation of the first lens barrel 110. Exemplarily, a protrusion 452 is provided on the outer peripheral surface of the end 451 of the driving shaft 450, so that the cross section of the end 451 of the driving shaft 450 is similar to a "convex" shape. The center of the gear 430 is formed with an axial hole (not shown) that matches the shape of the end 451 of the driving shaft 450, and is sleeved on the end 451 of the driving shaft 450 through the axial hole, thereby realizing the circumferential fixation of the gear 430. In addition, the axial fixation of the gear 430 can be realized by fixing members such as an end baffle, a shoulder, a collar or a sleeve.

[0119] In some other embodiments of the present application, the translation of the first lens barrel 110 can also be achieved manually. For example, an adjustment block can be provided on the outer circumference of the first lens barrel 110, and the user can drive the first lens barrel 110 to translate along the X-axis direction by toggling the adjustment block. For another example, an outer sleeve can be sleeved on the outer circumference of the first lens barrel 110, and the user can also push the outer sleeve to drive the first lens barrel 110 to translate along the X-axis direction. For another example, the user can also directly push the first lens barrel 110 along the X-axis direction to achieve the translation of the first lens barrel 110. The present application does not limit this, as long as the first lens barrel 110 can be translated along the X-axis direction.

[0120] Continue reading Figure 6A In some embodiments of the present application, a support rail 140 is provided on the support seat 100. The support rail 140 extends along the X-axis direction. The first lens barrel 110 is slidably connected to the support rail 140. The support rail 140 can guide the first lens barrel 110 to translate along the X-axis direction while supporting the first lens barrel 110, thereby ensuring the stability of the movement of the first lens barrel 110.

[0121] For example, Figure 6AAs shown, two support slide rails 140 may be provided on the support base 100. The two support slide rails 140 both extend along the X-axis direction and are oppositely arranged along the Y-axis direction. Among them, the support slide rails 140 can be fixed to the support base 100 by means of connection, clamping or bonding with fasteners (such as screws). The first lens barrel 110 is provided with a mounting end 111 adapted to the support slide rails 140. Exemplarily, the number of the mounting ends 111 can be four. Two of the mounting ends 111 are sleeved on the same support slide rail 140. The other two mounting ends 111 are sleeved on the other support slide rail 140. Thus, the first lens barrel 110 can be translated more stably along the X-axis direction.

[0122] It can be understood that the above Figure 6A only schematically shows the structural forms of the support slide rails 140 and the mounting ends 111. In other embodiments, the support slide rails 140 and the mounting ends 111 may also have other structural forms, and the present application does not limit this. For example, the support slide rails 140 may also be grooves formed on the support base 100. The mounting ends 111 may be sliders clamped in the groove-structured support slide rails 140 and can slide relative to the support slide rails 140.

[0123] Continue to refer to Figure 10A and Figure 10B and in combination with Figure 6A and Figure 6B , in some embodiments of the present application, the first driving device 400 can also be used to drive the second lens barrel 120 to translate along the X-axis direction. That is, the driving end 420 of the first driving device 400 can also be connected to the second lens barrel 120. That is to say, the first lens barrel 110 and the second lens barrel 120 share a first driving device 400. Therefore, there is no need to additionally provide other driving devices to drive the second lens barrel 120 to translate, effectively reducing the number of components, thereby improving the assembly efficiency of the lens module 10 and reducing the production cost.

[0124] In some of these implementation manners, the driving end 420 of the first driving device 400 may include a second rack 442 extending along the X-axis direction. The second rack 442 meshes with the gear 430, and one end of the second rack 442 is fixedly connected to the outer peripheral surface of the second lens barrel 120, so that the translation of the second lens barrel 120 can be realized. Among them, the transmission process of realizing the translation of the second lens barrel 120 is substantially the same as the above-mentioned transmission process of realizing the translation of the first lens barrel 110, and will not be elaborated here.

[0125] As mentioned above, the connection between the first lens barrel 110 and the first camera 210 is not limited to mechanical connection. In another feasible solution, the first lens barrel 110 and the first camera 210 can also be electrically connected through the linkage mechanism 300.

[0126] Figures 11A to 11C The figure shows a schematic diagram of the electrical connection between the first lens barrel 110 and the first camera 210 in an embodiment of the present application. Among them, Figure 11A is a front view of the lens module 10, Figure 11B is a rear view of the lens module 10, Figure 11C is the lens module 10 along Figure 11A the sectional view taken along D-D in Figures 11A to 11C Referring to

[0127] In some embodiments of the present application, the linkage mechanism 300 includes a first driving device 400, a second driving device 500, and a control device 600. Figure 10A and Figure 10B and their related descriptions, which will not be elaborated here.

[0128] The second driving device 500 is used to drive the first camera 210 to translate in the X-axis direction. Among them, the specific implementation manner of the second driving device 500 driving the first camera 210 can be the same as that of the first driving device 400 driving the first lens barrel 110, and can also refer to the above Figure 10A and Figure 10B and their related descriptions, which will not be elaborated here.

[0129] The first driving device 400 and the second driving device 500 are respectively communicatively connected to the control device 600. For example, the first driving device 400 and the second driving device 500 can be communicatively connected to the control device 600 through a wired communication method such as a signal transmission line. Or, in other alternative embodiments, the first driving device 400 and the second driving device 500 can also be communicatively connected to the control module 200 through a wireless communication method such as Bluetooth. The present application does not limit this.

[0130] When the first driving device 400 drives the first lens barrel 110 to translate a first distance (for example, the first distance D1 shown below Figure 13B ) in the X-axis direction so that the first lens barrel 110 is located at the first position, the control device 600 can obtain the first distance and control the second driving device 400 to drive the first camera 210 to translate to the second position in the X-axis direction according to the first distance. And, the distance between the optical axis L21 of the first camera 210 located at the second position and the optical axis L11 of the first lens barrel 110 located at the first position is less than or equal to the first threshold. In this way, when translating the first lens barrel 110 for pupil distance adjustment, the position adjustment of the first camera 210 can be realized to adapt to users with different pupil distances, thereby effectively improving the user's visual experience.

[0131] In some embodiments of the present application, the second driving device 500 can also be used to drive the second camera 220 to translate in the X-axis direction. That is, the first camera 210 and the second camera 220 share a second driving device 500, thereby effectively reducing the number of components, improving the assembly efficiency of the lens module 10, and reducing the production cost.

[0132] Among them, the specific implementation manner in which the second driving device 500 drives the first camera 210 and the second camera 220 to translate is substantially the same as the specific implementation manner in which the first driving device 400 drives the first lens barrel 110 and the second lens barrel 120, and specific reference can be made to Figure 10A and Figure 10B and its related descriptions, which will not be elaborated here. For ease of description, the exemplary adjustment process of the head-mounted device 1 will continue to be introduced below by taking the first lens barrel 110 and the first camera 210 being electrically connected through the linkage mechanism 300 as an example.

[0133] Based on the first lens barrel 110 and the first camera 210 being electrically connected through the linkage mechanism 300, the present application further provides an adjustment method, which is applicable to the above-mentioned head-mounted device 1. Figure 12 FIG. shows the flowchart of the adjustment method in the embodiments of the present application. Figures 13A to 13C FIG. shows the exemplary adjustment process of the head-mounted device 1 in the embodiments of the present application. Refer to Figure 12 and in combination with Figures 13A to 13C , the adjustment method provided by the present application specifically includes the following steps:

[0134] S110: When the head-mounted device 1 is worn on the user's head, the control device 600 detects the offset between the optical axis L11 of the first lens barrel 110 and the user's left pupil.

[0135] In some embodiments of the present application, the head-mounted device 1 can detect whether it is in a worn state. For example, the surface of the head-mounted device 1 that comes into contact with the user includes a pressure sensor. When the head-mounted device 1 is worn on the user's head, the pressure sensor can sense the contact pressure exerted by the user's head. According to the pressure data sensed by the pressure sensor, it can be determined whether the head-mounted device 1 is in a worn state.

[0136] Alternatively, in some other alternative embodiments, the head-mounted device 1 includes an optical sensor, and the optical sensor can be used to detect the environment around the head. When the head-mounted device 1 is worn on the user's head, the distribution of light will be different. By analyzing the data of the optical sensor, it can be determined whether the head-mounted device 1 is in a worn state.

[0137] Alternatively, in some alternative embodiments, the head-mounted display device 1 includes an accelerometer and a gyroscope to detect the motion state. When the head-mounted display device 1 is worn on the user's head, the motion state of the head-mounted display device 1 will be different from when it is not worn. By detecting the motion data, it can be determined whether the head-mounted display device 1 is in a worn state.

[0138] Reference Figure 13A and in combination with Figures 11A to 11C , after the head-mounted display device 1 is in a worn state, the control device 600 starts to detect the offset D0 (as an example of the first offset) between the optical axis L11 of the first lens barrel 110 and the left pupil of the user (as an example of the first pupil). For example, the offset D0 is 0.5 mm.

[0139] S120: The control device 600 controls the first driving device 400 to drive the first lens barrel 110 to translate a first distance along the X-axis direction according to the offset, so that the first lens barrel 110 is located at the first position.

[0140] According to the above embodiment, reference Figure 13A and in combination with Figure 13B , Figures 11A to 11C , after the control device 600 detects that the offset D0 is 0.5 mm, it controls the first driving device 400 to drive the first lens barrel 110 to translate a first distance D1 along the X-axis direction according to the offset D0, so that the first lens barrel 110 is located at the first position. In this process, the optical axis L11 of the first lens barrel 110 translates from point P1 to point P2. It can be understood that the first distance D1 can be equal to the offset D0, that is, the first distance D1 can also be 0.5 mm. At this time, the optical axis L11 of the first lens barrel 110 is substantially aligned with the left eye pupil of the user.

[0141] Among them, the specific implementation manner of the first driving device 400 driving the first lens barrel 110 to translate can refer to the above Figure 10A and Figure 10B and its related descriptions, which will not be elaborated here.

[0142] S130: The control device 600 controls the second driving device 500 to drive the first camera 210 to translate to the second position along the X-axis direction according to the first distance, and the distance between the optical axis L21 of the first camera 210 located at the second position and the optical axis L11 of the first lens barrel 110 located at the first position is less than or equal to the first threshold.

[0143] Reference Figure 13B and in combination with Figure 13C , Figures 11A to 11C, after the first driving device 400 drives the first lens barrel 110 to translate a first distance D1 in the X-axis direction, the control device 600 can, according to the first distance D1, control the second driving device 500 to drive the first camera 210 to translate to a second position in the X-axis direction. Moreover, the distance between the optical axis L21 of the first camera 210 at the second position and the optical axis L11 of the first lens barrel 110 at the first position is less than or equal to a first threshold value (for example, the first threshold value is 0 to 1 mm). Thereby, the optical axis L21 of the first camera 210 can be approximately aligned with the left eye pupil of the user.

[0144] Exemplarily, referring to Figure 13B and Figure 13C , the second driving device 500 can also translate a first distance D1 in the X-axis direction to move to the second position. Wherein, the first threshold value can be 0, and the optical axis L21 of the first camera 210 at the second position and the optical axis L11 of the first lens barrel 110 at the first position both pass through the point P2 and the left eye pupil of the user. In other embodiments, the first threshold value can also be other values within the range of 0 to 1 mm, for example, 0.1 mm, 0.2 mm, etc., and the present application does not make specific limitations thereto.

[0145] Through the first driving device 400, the second driving device 500 and the control device 600, the above adjustment method can trigger the translation of the first camera 210 by the translation of the first lens barrel 110, thereby meeting the usage requirements of users with different interpupillary distances, effectively alleviating problems such as depth perception errors, visual fatigue, dizziness, etc. caused by the poor alignment between the optical axis L21 of the first camera 210 and the left pupil of the user, and providing a good visual experience for the user.

[0146] In some embodiments of the present application, after the above step S130, the control device 600 can continue to detect the offset between the first lens barrel 110 at the first position and the left eye pupil of the user, and accordingly adjust the positions of the first lens barrel 110 and the first camera 210 until the offset between the first lens barrel 110 and the left eye pupil of the user is less than or equal to the first threshold value. In this way, the detection error can be effectively reduced, thereby further improving the accuracy of adjusting the position of the first camera 210.

[0147] Figure 14 shows another adjustment method in the embodiments of the present application. Figure 15A and Figure 15B show an exemplary adjustment process of another head-mounted device 1 in the embodiments of the present application. Referring to Figure 14 and combining Figure 15A and Figure 15B , this method specifically includes the following steps:

[0148] S110': When the head-mounted device 1 is worn on the user's head, the control device 600 detects the offset between the optical axis L11 of the first lens barrel 110 and the user's left pupil.

[0149] S120': The control device 600 controls the first driving device 400 to drive the first lens barrel 110 to translate a first distance along the X-axis according to the offset, so that the first lens barrel 110 is located at the first position.

[0150] S130': The control device 600 controls the second driving device 500 to drive the first camera 210 to translate to the second position along the X-axis according to the first distance, and the distance between the optical axis L21 of the first camera 210 located at the second position and the optical axis L11 of the first lens barrel 110 located at the first position is less than or equal to the first threshold.

[0151] Steps S110' to S130' are the same as the aforementioned steps S110 to S130 and will not be elaborated here.

[0152] S140: The control device 600 detects the offset between the optical axis L11 of the first lens barrel 110 located at the first position and the user's left eye pupil, and determines whether the offset is less than or equal to the first threshold.

[0153] If the determination is yes, the adjustment ends; if the determination is no, steps S120' to S140 are continued.

[0154] For ease of description, the following takes the first threshold as 0 as an example for introduction.

[0155] For example, referring to Figure 13C , in some embodiments of the present application, the offset between the optical axis L11 of the first lens barrel 110 at the first position and the user's left eye pupil is 0 mm, which is less than or equal to the first threshold. That is, the determination is yes. Therefore, the adjustment ends.

[0156] Another example, referring to Figure 15A , in some other embodiments of the present application, after the first translation, the first lens barrel 110 is located at Figure 15A the first position shown, where the optical axis L11 of the first lens barrel 110 passes through point P2. The first camera 210 is located at Figure 15A the second position shown, where the optical axis L21 of the first camera 210 passes through point P2. Among them, the offset D0' (as an example of the second offset) between the optical axis L11 of the first lens barrel 110 moved to the first position and the user's left eye pupil is 0.1 mm, which is greater than the first threshold. That is, the determination is no. Therefore, steps S120' to S140 are continued.

[0157] First, perform step S120'. The control device 600 controls the first driving device 400 to drive the first lens barrel 110 to translate a first distance D1' (as an example of the second distance) in the X-axis direction according to the offset D0', so that the first lens barrel 110 can move from Figure 15A the first position shown in Figure 15B to the first position shown in (as an example of the third position). For example, the optical axis L11 of the first lens barrel 110 translates from point P2 to point P3. Thus, the deviation between the first lens barrel 110 and the user's left eye pupil can be further reduced, making the alignment between the first lens barrel 110 and the user's left eye pupil better.

[0158] Then, perform step S130'. The control device 600 controls the second driving device 500 to drive the first camera 210 to continue translating in the X-axis direction from Figure 15A the second position shown in Figure 15B to the second position shown in (as an example of the fourth position). For example, the optical axis L21 of the first camera 210 translates from point P2 to point P3. And, as Figure 15B shown, the distance between the optical axis L21 of the first camera 210 at the second position and the optical axis L11 of the first lens barrel 110 at the first position is less than or equal to the first threshold. In this way, the deviation between the first camera 210 and the user's left eye pupil can be further reduced, making the alignment between the first camera 210 and the user's left eye pupil better.

[0159] In the above adjustment method, by repeatedly detecting the offset between the optical axis L11 of the first lens barrel 110 at the first position and the user's left eye pupil, and performing corresponding adjustment operations according to the measured offset, the measurement error can be effectively reduced, so that the optical axis L11 of the first lens barrel 110 and the optical axis L21 of the first camera 210 can be more accurately aligned with the user's left eye pupil.

[0160] It can be understood that the above embodiments only introduce the adjustment method provided by the present application by taking the adjustment of the positions of the first lens barrel 110 and the first camera 210 as examples. However, the present application is not limited to this. For example, in other embodiments, the above adjustment method can also be used to adjust the positions of the second lens barrel 120 and the second camera 220.

[0161] In some embodiments of the present application, during the process of adjusting the positions of the first lens barrel 110, the first camera 210, the second lens barrel 120, and the second camera 220, the head-mounted device 1 can also detect the user's interpupillary distance, and then adjust the display parameters according to the user's interpupillary distance to provide a better visual experience for the user. Referring to Figure 16 , the adjustment method provided by the present application may further include the following steps:

[0162] S160: The head-mounted device 1 detects the user's interpupillary distance.

[0163] In some embodiments of the present application, the head-mounted device 1 may detect the user's interpupillary distance by means of wire magnetic detection. For example, a wire magnetic coil is kept at a certain distance from the user's eyes. When the user's eyes move, it will cause a change in the current in the wire magnetic coil. Therefore, according to the change in the current, the user's interpupillary distance can be obtained.

[0164] S170: The head-mounted device 1 adjusts the display parameters according to the detected interpupillary distance.

[0165] The head-mounted device 1 can optimize parameters such as the parameters of the virtual camera, distortion parameters, and chromatic dispersion parameters in the virtual scene according to the detected interpupillary distance, so as to increase the matching degree between the head-mounted device 1 and the user's interpupillary distance, further weaken the blurring and dizziness caused by the mismatch of the interpupillary distance, and at the same time make the display effect clearer, more comfortable and more realistic, thereby improving the user's visual experience.

[0166] Exemplarily, Figure 17 The structural block diagram of the head-mounted device 1 in the embodiment of the present application is shown.

[0167] As Figure 17 shown, the head-mounted device 1 may include a processor 101, a memory 102, a sensor module 103, an audio module 104, a button 105, an input / output interface 106, a communication module 107, a power supply module 108, a display screen 109, etc.

[0168] The processor 101 is generally used to control the overall operation of the head-mounted device 1, and may include one or more processing units. For example, the processor 101 may include an application processor (AP), a modulation and demodulation processor, a graphics processing unit (GPU), an image signal processor (ISP), a video processing unit (VPU) controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.

[0169] A memory may also be provided in the processor 101 for storing instructions and data. In some embodiments, the memory in the processor 101 is a cache memory. This memory can hold instructions or data that the processor 101 has just used or recycled. If the processor 101 needs to use the instruction or data again, it can directly call it from the said memory. This avoids repeated accesses, reduces the waiting time of the processor 101, and thus improves the efficiency of the system. In this application, the processor 101 can execute the adjustment method mentioned in this application.

[0170] In some embodiments, the above control device 600 may also be provided in the processor 101 for driving the first lens barrel 110 based on the first driving device 400 and driving the first camera 210 based on the second driving device 500.

[0171] In some embodiments, the processor 101 may also determine the user's pupil distance based on the principle of linear magnetic detection and adjust the display parameters according to the determined pupil distance.

[0172] In some embodiments, the processor 101 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general purpose input / output (GPIO) interface, and / or a universal serial bus (USB) interface, a serial peripheral interface (SPI) interface, etc.

[0173] The memory 102 can be used to store computer-executable program code, and the executable program code includes instructions. The processor 101 executes various functional applications and data processing of the head-mounted device 1 by running the instructions stored in the memory 102. The memory 102 can include a program storage area and a data storage area. Among them, the program storage area can store an operating system, application programs required for at least one function (such as an image display function, a video playback function), etc. The data storage area can store data created during the use of the head-mounted device 1 (such as an eye image captured during the eye movement tracking of the head-mounted device 1), etc. In addition, the memory 102 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0174] The sensor module 103 can include sensors for detecting the working state and usage state of the head-mounted device 1. Including but not limited to an optical sensor / pressure sensor for detecting whether the user wears the head-mounted device 1, an inertial sensor for detecting the movement state of the user's head, etc.

[0175] The audio module 104 can include a speaker, a microphone, etc., for implementing an audio function.

[0176] The button 105 can be one or more. The form of the button 105 can be a button, a switch, a dial, and a touch or near-touch sensing device (such as a touch sensor). The head-mounted device 1 can trigger corresponding functions according to the operation of one or more of the buttons 105, such as adjusting the positions of the first lens barrel 110 and the second lens barrel 120, playing audio, etc.

[0177] The input / output interface 106 can connect other devices to the head-mounted device 1 through appropriate components. The components can include, for example, an audio / video jack, a data connector, etc.

[0178] The communication module 107 can include a wireless communication module. The wireless communication function can be implemented through an antenna (not shown), a modulation / demodulation processor (not shown), a baseband processor (not shown), etc. The antenna is used to transmit and receive electromagnetic wave signals. The head-mounted device 1 can include multiple antennas, and each antenna can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example: Antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0179] The wireless communication module can provide wireless communication solutions for the head-mounted display device 1, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc. The wireless communication module can be one or more devices integrating at least one communication processing module. The wireless communication module receives electromagnetic waves via an antenna, frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 101. The wireless communication module can also receive the signals to be sent from the processor 101, frequency-modulate them, amplify them, and convert them into electromagnetic waves through the antenna for radiation.

[0180] The power supply module 108 can include a battery for supplying power to each module of the head-mounted display device 1.

[0181] The display module 109 can include a display screen 109L and a display screen 109R. Among them, the display screen 109L is used to display images to the left eye pupil of the user, and the display screen 109R is used to display images to the right eye pupil of the user.

[0182] It can be understood that Figure 17 The structure of the head-mounted display device 1 shown is only an example. In some other embodiments, the head-mounted display device 1 may include more or fewer modules, and some modules may be combined or split, which is not limited herein.

[0183] The above specific embodiments illustrate the implementation manners of the present application. Those skilled in the art can easily understand other advantages and effects of the present application from the content disclosed in this specification. Although the description of the present application will be introduced in combination with some embodiments, this does not mean that the features of this application are limited to this implementation manner. On the contrary, the purpose of introducing the application in combination with the implementation manner is to cover other alternatives or modifications that may be extended based on the claims of the present application. The present application can also be implemented without using these details. In addition, to avoid confusion or obscuring the key points of the present application, some specific details are omitted in the description. It should be noted that, without conflict, the embodiments in the present application and the features in the embodiments can be combined with each other.

[0184] In the description of the present application, it should be noted that the orientation or positional relationship indicated by the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "outer", "inner", "circumferential", "radial", "axial", etc. is based on the orientation or positional relationship shown in the drawings. It is only for the convenience of describing the present application and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation. Therefore, it should not be construed as a limitation to the present application.

[0185] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalent technologies, the present application is also intended to include these changes and modifications.

Claims

1. A lens module, characterized in that, it includes a support base, a first lens barrel and a first camera disposed on the support base, wherein: the first lens barrel and the first camera are oppositely arranged along a first direction, and the optical axes of the first lens barrel and the first camera extend along the first direction. The first lens barrel and the first camera can respectively translate relative to the support base along a second direction, and the second direction is perpendicular to the first direction; the first lens barrel and the first camera are connected by a linkage mechanism, so that the translation of the first lens barrel triggers the translation of the first camera, and the distance between the optical axes of the first lens barrel and the first camera after translation is less than or equal to a first threshold.

2. The lens module according to claim 1, characterized in that, the linkage mechanism includes a first driving device, a second driving device and a control device. Among them, the first driving device is used to drive the first lens barrel to translate along the second direction, the second driving device is used to drive the first camera to translate along the second direction, and the first driving device and the second driving device are respectively communicatively connected to the control device; when the first driving device drives the first lens barrel to translate a first distance along the second direction so that the first lens barrel is in a first position, the control device can control the second driving device to drive the first camera to translate to a second position along the second direction according to the first distance, and the distance between the optical axis of the first camera at the second position and the optical axis of the first lens barrel at the first position is less than or equal to the first threshold.

3. The lens module according to claim 2, characterized in that, the driving end of the first driving device includes a gear and a first rack. The rotation axis of the gear extends along the first direction, the first rack extends along the second direction, the gear meshes with the first rack, and the first rack is fixedly connected to the first lens barrel.

4. The lens module according to claim 1, characterized in that, the linkage mechanism includes a connecting member, and the first lens barrel and the first camera are fixedly connected by the connecting member.

5. The lens module according to claim 4, characterized in that, the connecting member is a connecting rod, a fastener, a clamping member or an adhesive member.

6. The lens module according to claim 1, characterized in that, the first threshold is 0 to 1 mm.

7. The lens module according to claim 1, characterized in that, the support base includes a support slide rail extending along the second direction. The first lens barrel is disposed on the support slide rail and can slide relative to the support slide rail along the second direction.

8. The lens module according to claim 1, characterized in that, an avoidance hole is formed in the support base, and the avoidance hole penetrates the support base along the first direction. At least part of the first camera extends from one side of the support base facing the first lens barrel to the other side of the support base facing away from the first lens barrel through the avoidance hole.

9. The lens module according to any one of claims 1 to 8, wherein, the lens module further includes a second lens barrel and a second camera disposed on the support base. Along the second direction, the second lens barrel is spaced apart from the first lens barrel, and the second camera is spaced apart from the first camera, wherein: the second lens barrel and the second camera are disposed opposite to each other along the first direction, and the optical axes of the second lens barrel and the second camera extend along the first direction. The second lens barrel and the second camera can respectively translate relative to the support base along the second direction; the second lens barrel and the second camera are connected by the linkage mechanism, so that the translation of the second lens barrel triggers the translation of the second camera, and the distance between the optical axes of the second lens barrel and the second camera after translation is less than or equal to the first threshold.

10. The lens module according to claim 9, wherein, a first driving device is disposed on the support base, and a driving end of the first driving device is connected to the first lens barrel and the second lens barrel for driving the first lens barrel and the second lens barrel to translate along the second direction.

11. The lens module according to claim 10, wherein, along the second direction, the first lens barrel and the second lens barrel are respectively located on opposite sides of the first driving device, wherein: the driving end of the first driving device includes a gear, a first rack and a second rack. The rotation axis of the gear extends along the first direction, the first rack and the second rack extend along the second direction, the first rack and the second rack are respectively meshed with the gear, and are respectively fixedly connected to the first lens barrel and the second lens barrel.

12. A head-mounted display device, wherein, it includes a housing and the lens module according to any one of claims 1 to 11, and the lens module is disposed on the housing.

13. An adjustment method applied to a head-mounted display device, wherein, the head-mounted display device includes a lens module, and the lens module includes a first lens barrel, a first camera, a first driving device, a second driving device and a control device. The first driving device is used to drive the first lens barrel, the second driving device is used to drive the first camera, and the first driving device and the second driving device are respectively communicatively connected to the control device; the method includes: when the head-mounted display device is worn on the user's head, the control device detects a first offset between the optical axis of the first lens barrel and the first pupil of the user, and the optical axis of the first lens barrel extends along a first direction; the control device controls the first driving device to drive the first lens barrel to translate a first distance along a second direction perpendicular to the first direction according to the first offset, so that the first lens barrel is located at a first position. The control device controls the second driving device to drive the first camera to translate along the second direction to a second position according to the first distance, and the distance between the optical axis of the first camera at the second position and the optical axis of the first lens barrel at the first position is less than or equal to a first threshold value.

14. The method according to claim 13, wherein, the method further includes: the control device detects a second offset between the optical axis of the first lens barrel at the first position and the first pupil of the user, and determines whether the second offset is less than or equal to the first threshold value; corresponding to the second offset being greater than the first threshold value, the control device controls the first lens barrel to translate a second distance along the second direction, so that the first lens barrel translates from the first position to a third position; the control device controls the second driving device to drive the first camera to translate from the second position to a fourth position along the second direction according to the second distance, and the distance between the optical axis of the first camera at the fourth position and the optical axis of the first lens barrel at the third position is less than or equal to the first threshold value.

15. The method according to claim 13, wherein, the method further includes: the head-mounted display device detects the interpupillary distance of the user; the head-mounted display device adjusts display parameters according to the detected interpupillary distance of the user.

16. A computer-readable storage medium, wherein, instructions are stored on the computer-readable storage medium, and when the instructions are executed on a computer, the computer executes the adjustment method according to any one of claims 13 to 15.

17. A head-mounted display device, wherein, comprises: a memory for storing instructions, and one or more processors, when the instructions are executed by the one or more processors, the processors execute the adjustment method according to any one of claims 13 to 15.

Images