Method and device for mounting optical module, head-mounted display device and storage medium

Abstract

The application discloses a mounting method and device of an optical module, a head-mounted display device and a storage medium. The head-mounted display device comprises a shell, a lens barrel, a lens barrel mounting substrate, and an adjusting unit. The lens barrel comprises an optical module. The lens barrel mounting substrate is fixedly connected with the shell. The adjusting unit is arranged between the lens barrel and the lens barrel mounting substrate and is used for adjusting the angle of the optical module of the lens barrel. The problem that visual deviation is caused by installation errors of the optical module is solved. The installation position of the optical module is adjusted by adding the adjusting unit on the head-mounted display device, the installation errors of the optical module are reduced, and the visual effect is improved by physical adjustment without sacrificing the image quality in a non-electronic image adjustment mode.

Description

Technical Field

[0001] This invention relates to the field of head-mounted display technology, and more particularly to an optical module mounting method, apparatus, head-mounted display device, and storage medium. Background Technology

[0002] With the development of electronic products, head-mounted display devices such as virtual reality headsets, augmented reality headsets, and mixed reality headsets are increasingly appearing in daily life, and people's pursuit of the visual presentation effects of head-mounted display devices is growing stronger. Currently, when the optical module of the lens barrel is installed on the head-mounted display device, if there is an installation error in the optical module, the light rays emitted from the lens barrel display screen will not coincide with the center of the human eye after being refracted and reflected inside the optical module, seriously affecting the visual effect. Summary of the Invention

[0003] This application provides an optical module installation method, apparatus, head-mounted display device, and storage medium, aiming to reduce installation errors of optical modules and improve visual effects.

[0004] This application provides a head-mounted display device, the head-mounted display device comprising:

[0005] case;

[0006] A lens barrel, the lens barrel including an optical module;

[0007] A lens barrel mounting base plate, which is fixedly connected to the housing;

[0008] An adjustment unit is disposed between the lens barrel and the lens barrel mounting substrate, and is used to adjust the angle of the optical module.

[0009] Optionally, the adjustment unit includes:

[0010] The first connector is connected between the first side of the lens barrel and the first position of the lens barrel mounting base plate;

[0011] The second connector is connected between the second side of the lens barrel and the second position of the lens barrel mounting base plate. The second connector is a movable connector used to adjust the distance between the second side of the lens barrel and the lens barrel mounting base plate so that the display image inside the lens barrel is shifted laterally.

[0012] A third connector is connected between the third side of the lens barrel and the third position of the lens barrel mounting base plate. The third connector is a movable connector used to adjust the distance between the third side of the lens barrel and the lens barrel mounting base plate so that the display image inside the lens barrel is shifted vertically.

[0013] Optionally, a first elastic force adjusting component is further provided between the second side of the lens barrel and the lens barrel mounting base plate, and the elastic force of the first elastic force adjusting component increases as the distance between the second side of the lens barrel and the lens barrel mounting base plate decreases;

[0014] A second elastic force adjustment component is also provided between the third side of the lens barrel and the lens barrel mounting base plate. The elastic force of the second elastic force adjustment component increases as the distance between the third side of the lens barrel and the lens barrel mounting base plate decreases.

[0015] Optionally, the elastic adjustment component includes a spring or a spring plate, which is located at the bottom end of the bottom substrate of the lens barrel.

[0016] Optionally, a substrate support point is also provided at the bottom end of the bottom substrate. The bottom substrate forms a locking position with the limiting groove of the lens barrel mounting substrate through the substrate support point, which is used to limit the lateral relative position of the lens barrel and the bottom substrate and support the lens barrel.

[0017] This application provides an optical module mounting method, applied to an optical module mounting device, the optical module mounting device including a data acquisition unit and an adjustment unit; the optical module mounting method includes:

[0018] Acquire the display image inside the lens barrel acquired by the acquisition unit;

[0019] Determine whether the marker position of the displayed image matches the preset theoretical position;

[0020] When the marked position does not match the preset theoretical position, the adjustment unit is adjusted according to the marked position and the preset theoretical position.

[0021] Optionally, the step of adjusting the adjustment unit according to the identification position and the preset theoretical position when the identification position does not match the preset theoretical position includes:

[0022] When the marked position does not match the preset theoretical position, the offset direction of the displayed image is determined based on the marked position and the preset theoretical position;

[0023] The adjustment parameters of the adjustment unit are determined based on the offset direction, and the adjustment parameters include at least one of adjustment direction, number of adjustments, and adjustment distance;

[0024] The adjustment unit is adjusted based on the adjustment parameters.

[0025] Optionally, when the offset direction of the displayed image is a horizontal offset direction, the step of adjusting the adjustment unit based on the adjustment parameter includes: adjusting the adjustment unit based on a first adjustment direction;

[0026] Alternatively, when the offset direction of the displayed image is the vertical offset direction, the step of adjusting the adjustment unit based on the adjustment parameter includes: adjusting the adjustment unit based on the second adjustment direction.

[0027] Optionally, the method for mounting the optical module further includes:

[0028] When the marked position matches the preset theoretical position, an adjustment end command is generated for the adjustment unit to stop adjusting the adjustment unit.

[0029] In addition, to achieve the above objectives, the present invention also provides an optical module mounting apparatus, which includes: a memory, a processor, and an optical module installation program stored in the memory and executable on the processor. When the optical module installation program is executed by the processor, it implements the steps of the optical module mounting method described above.

[0030] Optionally, the mounting device for the optical module further includes an adjustment unit and a data acquisition unit.

[0031] In addition, to achieve the above objectives, the present invention also provides a computer-readable storage medium storing an installation program for an optical module, wherein the installation program for the optical module, when executed by a processor, implements the steps of the above-described installation method for the optical module.

[0032] This application provides a technical solution for installing an optical module, including a method, apparatus, head-mounted display device, and storage medium. By acquiring a display image within the lens barrel captured by a data acquisition unit, it determines whether the marked position of the display image matches a preset theoretical position. If the marked position does not match the preset theoretical position, the adjustment unit is adjusted according to the difference between the marked position and the preset theoretical position. By adding an adjustment unit to the head-mounted display device and adjusting this unit to change the angle of the optical module, the problem of visual deviation caused by installation errors in the optical module is solved, reducing installation errors and improving visual performance. Attached Figure Description

[0033] Figure 1 This is a schematic diagram of the mounting device for the optical module involved in the embodiment of the present invention;

[0034] Figure 2 This is a schematic diagram of an embodiment of the mounting device for the optical module of the present invention;

[0035] Figure 3 This is a schematic diagram of the structure of the head-mounted display device of the present invention;

[0036] Figure 4 This is a schematic diagram of the lens barrel structure of the head-mounted display device of the present invention;

[0037] Figure 5 This is a schematic diagram of the operation of the optical module inside the lens barrel of the present invention;

[0038] Figure 6 This is a schematic diagram of the adjustment structure of the head-mounted display device of the present invention;

[0039] Figure 7 This is a schematic diagram showing the marked position when the optical module of the present invention is offset;

[0040] Figure 8 This is a schematic diagram showing the position of the markings after the optical module of the present invention has been adjusted;

[0041] Figure 9 This is a schematic diagram illustrating the implementation process of the installation method of the optical module of the present invention.

[0042] label name label name 10 Head-mounted display devices 301-2 Second connector 20 Acquisition Unit 301-3 Elastic adjustment component 101 case 301-4 Lens tube 201 Lens tube mounting substrate 301-5 Bottom substrate 301 Left lens tube 301-6 substrate support points 302 Right lens tube 402 Display screen 301-1 Lens tube positioning post 401 human pupil

[0043] The purpose, features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. The accompanying drawings are only one embodiment and not the entirety of the invention. Detailed Implementation

[0044] This application addresses the problem of visual deviation caused by installation errors in optical modules. It proposes an installation method for an optical module. This method involves acquiring a display image within the lens barrel captured by a data acquisition unit, determining whether the marked position of the display image matches a preset theoretical position, and adjusting the adjustment unit based on the mismatch between the marked position and the preset theoretical position if the mismatch is not present. By adding an adjustment unit to the head-mounted display device and adjusting this unit to change the angle of the optical module, installation errors are reduced, and visual effects are improved.

[0045] To better understand the above technical solutions, exemplary embodiments of this disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of this disclosure to those skilled in the art.

[0046] like Figures 3-7 As shown, the head-mounted display device 10 includes:

[0047] Casing 101;

[0048] The lens barrel includes an optical module; wherein the head-mounted display device 10 includes two lens barrels, such as... Figure 3 The left lens tube 301 and the right lens tube 302.

[0049] Lens barrel mounting base plate 201, which is fixedly connected to the housing 101;

[0050] An adjustment unit is disposed between the left lens barrel 301 and the lens barrel mounting base plate 201, and is used to adjust the angle of the optical module.

[0051] Optionally, each lens barrel includes a lens barrel positioning post, at least one adjustment unit, at least one elastic adjustment component, a lens barrel lens, and a bottom base plate. For example, the structure of the left lens barrel 301 is as follows: Figure 4 As shown, the left lens barrel 301 includes a bottom substrate 301-5, a lens barrel 301-4, at least one elastic adjustment component 301-3, at least one adjustment unit 301-2, and at least one lens barrel positioning post 301-1. The lens barrel positioning post 301-1 is disposed on the bottom substrate 301-5 and is used to constrain the bottom substrate 301-5 to the top end of the lens barrel mounting substrate 201. The top end of the lens barrel mounting substrate 201 has a hole corresponding to the lens barrel positioning post 301-1. The bottom substrate 301-5 is connected to the corresponding hole at the top end of the lens barrel mounting substrate 201 through the lens barrel positioning post 301-1, thereby constraining the bottom substrate 301-5 to the top end of the lens barrel mounting substrate 201.

[0052] The working principle of the optical module inside the lens barrel is as follows: Figure 5 As shown, when the optical module is installed in the correct position, the content displayed at the center of the display screen 402, after being reflected by the lens 301-4 inside the optical module, will align with the pupil 401 of the human eye, which is the ideal imaging position. When the optical module is installed at an angle on the head-mounted device, the received light beam will be deflected for the user receiving the image, meaning that the emitted light beam will no longer coincide with the optical axis of the human eye. Therefore, it is necessary to adjust the emitted image by adjusting the angle of the optical module so that the emitted light beam from the display screen 402 is once again aligned with the center of the pupil 401 of the human eye.

[0053] Among them, reference Figure 4 ,Will Figure 4 The elastic adjustment component 301-3 located on the right is called the first elastic adjustment component, and the elastic adjustment component 301-3 located below is called the second elastic adjustment component. Figure 4The adjustment unit 301-2 located on the right is called the second connector, and the adjustment unit 301-2 located below is called the third connector, and so on. By adjusting the second connector and the first elastic adjustment component, the displayed image inside the lens barrel is shifted horizontally. By adjusting the third connector and the second elastic adjustment component, the displayed image inside the lens barrel is shifted vertically.

[0054] Optionally, refer to Figure 4 and Figure 6 The head-mounted display device further includes: a first connector, connected between a first side of the lens barrel and a first position of the lens barrel mounting substrate, i.e. Figure 6 The component on the left side of the left lens barrel 301 that connects the bottom substrate 301-5 to the lens barrel mounting substrate 201 is the first connector. This first connector can be a screw, rivet, or other locking component.

[0055] The second connector is located between the second side of the lens barrel and the second position of the lens barrel mounting base, i.e. Figure 6 The component connecting the bottom substrate 301-5 and the lens barrel mounting substrate 201 on the right side of the left lens barrel 301 is the second connector 301-2. This second connector is a movable connector used to adjust the distance between the second side of the lens barrel and the lens barrel mounting substrate 201. For example, when the second connector 301-2 moves downwards, the distance between the right side of the left lens barrel 301 and the lens barrel mounting substrate 201 shortens; when the second connector 301-2 moves upwards, the distance between the right side of the left lens barrel 301 and the lens barrel mounting substrate 201 lengthens. As the distance between the right side of the left lens barrel 301 and the lens barrel mounting substrate 201 changes, the position of the optical module also changes accordingly, causing the light emitted from the display screen 402 to be reflected by the lens barrel lens 301-4 inside the optical module and then re-align with the center of the human eye's pupil 401.

[0056] Optionally, a first elastic adjustment component is further provided between the second side of the lens barrel and the lens barrel mounting base plate. The elastic force of the first elastic adjustment component increases as the distance between the second side of the lens barrel and the lens barrel mounting base plate decreases. For example, refer to... Figure 6A first elastic adjustment component 301-3 is provided between the right side of the left lens barrel 301 and the lens barrel mounting base 201. When the second connector 301-2 moves downward, the first elastic adjustment component 301-3 is compressed, the elasticity of the first elastic adjustment component 301-3 increases, and the distance between the right side of the left lens barrel 301 and the lens barrel mounting base 201 shortens, causing the marker position of the captured display image to shift to the right. When the second connector 301-2 moves upward, the first elastic adjustment component 301-3 extends, the elasticity of the first elastic adjustment component 301-3 decreases, and the distance between the right side of the left lens barrel 301 and the lens barrel mounting base 201 lengthens, causing the marker position of the captured display image to shift to the left.

[0057] Optionally, the first elastic adjustment component 301-3 can be a spring or a sheet spring, which can be located at the bottom end of the bottom substrate of the lens barrel. For example, when the second connector 301-2 moves downward, the spring or spring 301-3 is compressed, the elastic force of the spring or spring 301-3 increases, and the distance between the right side of the left lens barrel 301 and the lens barrel mounting substrate 201 shortens, causing the marker position of the captured display image to shift to the right. When the second connector 301-2 moves upward, the spring or spring 301-3 extends, the elastic force of the spring or spring 301-3 decreases, and the distance between the right side of the left lens barrel 301 and the lens barrel mounting substrate 201 lengthens, causing the marker position of the captured display image to shift to the left.

[0058] Optionally, adjusting the second connector 301-2 on the right side of the left lens barrel can adjust the marker position of the displayed image in the horizontal axis direction of the acquisition unit. Based on the real-time observed image, when the marker position of the displayed image matches the preset theoretical position, this direction is considered to be adjusted. For example, when the installation position of the optical module is offset, the marker position of the acquired displayed image will be as follows: Figure 7 As shown, after adjustment by the second connector 301-2 and the elastic adjustment component 301-3, the marked position of the displayed image is as follows. Figure 8 As shown, it will shift horizontally to the right or left, thereby improving the binocular vision effect.

[0059] The third connector is located between the third side of the lens barrel and the third position of the lens barrel mounting base plate, i.e. Figure 4The lower adjustment unit 301-2 is called the third connector. This third connector is also a movable connector used to adjust the distance between the third side of the lens barrel and the lens barrel mounting base 201. For example, when the third connector 301-2 moves downwards, the distance between the right side of the left lens barrel 301 and the lens barrel mounting base 201 shortens; when the third connector 301-2 moves upwards, the distance between the right side of the left lens barrel 301 and the lens barrel mounting base 201 lengthens. As the distance between the right side of the left lens barrel 301 and the lens barrel mounting base 201 changes, the position of the optical module also changes accordingly, causing the light emitted from the display screen 402 to be reflected by the lens barrel lens 301-4 inside the optical module and then re-align with the center of the human eye's pupil 401.

[0060] Optionally, a second elastic adjustment component is further provided between the third side of the lens barrel and the lens barrel mounting base plate. The elasticity of the second elastic adjustment component increases as the distance between the third side of the lens barrel and the lens barrel mounting base plate decreases. For example, refer to... Figure 4 When the lower third connector 301-2 moves downward, the lower second elastic adjustment member 301-3 compresses, increasing its elasticity and shortening the distance between the right side of the left lens barrel 301 and the lens barrel mounting base 201, causing the marker position of the captured display image to shift downward. When the lower third connector 301-2 moves upward, the second elastic adjustment member 301-3 extends, decreasing its elasticity and lengthening the distance between the right side of the left lens barrel 301 and the lens barrel mounting base 201, causing the marker position of the captured display image to shift upward.

[0061] Optionally, the second elastic adjustment component 301-3 can be a spring or a spring sheet, which can be located at the bottom end of the bottom substrate of the lens barrel. For example, when the third connector 301-2 moves downward, the spring or spring sheet 301-3 is compressed, the elastic force of the spring or spring sheet 301-3 increases, and the distance between the right side of the left lens barrel 301 and the lens barrel mounting substrate 201 shortens, causing the marker position of the captured display image to shift downward. When the third connector 301-2 moves upward, the spring or spring sheet 301-3 extends, the elastic force of the spring or spring sheet 301-3 decreases, and the distance between the right side of the left lens barrel 301 and the lens barrel mounting substrate 201 lengthens, causing the marker position of the captured display image to shift upward.

[0062] Optionally, refer to Figure 6A base plate support point 301-6 is also provided at the bottom end of the bottom base plate 301-5. The bottom base plate 301-5 is connected to the top end of the lens barrel mounting base plate 201 through the base plate support point 301-6. Due to the base plate support point 301-6 and the elastic adjustment component 301-3, the left lens barrel 301 is slightly movable on the lens barrel mounting base plate 201 at this time, and has a certain amount of room for movement in the compression or extension direction of the elastic adjustment component 301-3.

[0063] like Figure 1 As shown, Figure 1 This is a schematic diagram of the mounting device for the optical module involved in an embodiment of the present invention.

[0064] like Figure 1 As shown, the mounting device for the optical module may include: a processor 1001, such as a CPU; a memory 1005; a user interface 1003; a network interface 1004; and a communication bus 1002. The communication bus 1002 is used to enable communication between these components. The user interface 1003 may include a display screen or an input unit such as a keyboard; optionally, the user interface 1003 may also include a standard wired interface or a wireless interface. The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a Wi-Fi interface). The memory 1005 may be a high-speed RAM or a stable, non-volatile memory, such as a disk storage device. Optionally, the memory 1005 may also be a storage device independent of the aforementioned processor 1001.

[0065] Optionally, refer to Figure 2 The mounting device for the optical module also includes a data acquisition unit 20, which is located above the lens barrel and whose position is calibrated. The position of the data acquisition unit 20 is movable.

[0066] Optionally, the mounting device for the optical module also includes a control unit, which can be connected to the adjustment unit for adjusting the adjustment unit. This control unit can be a robotic arm.

[0067] Those skilled in the art will understand that Figure 1 The mounting structure of the optical module shown does not constitute a limitation on the mounting device of the optical module, and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0068] like Figure 1As shown, the memory 1005, which serves as a storage medium, may include an operating system, a network communication module, a user interface module, and an installation program for the optical module. The operating system is a program that manages and controls the hardware and software resources of the optical module installation device, the installation program for the optical module, and the operation of other software or programs.

[0069] exist Figure 1 In the installation device for the optical module shown, the user interface 1003 is mainly used to connect to the terminal and communicate with the terminal; the network interface 1004 is mainly used to connect to the backend server and communicate with the backend server; the processor 1001 can be used to call the installation program of the optical module stored in the memory 1005.

[0070] In this embodiment, the optical module mounting device includes: a memory 1005, a processor 1001, and an installation program for the optical module stored in the memory and executable on the processor, wherein:

[0071] When processor 1001 calls the installation program for the optical module stored in memory 1005, it performs the following operations:

[0072] Acquire the display image inside the lens barrel acquired by the acquisition unit;

[0073] Determine whether the marker position of the displayed image matches the preset theoretical position;

[0074] When the marked position does not match the preset theoretical position, the adjustment unit is adjusted according to the marked position and the preset theoretical position.

[0075] When processor 1001 calls the installation program for the optical module stored in memory 1005, it also performs the following operations:

[0076] When the marked position does not match the preset theoretical position, the offset direction of the displayed image is determined based on the marked position and the preset theoretical position;

[0077] The adjustment parameters of the adjustment unit are determined based on the offset direction, and the adjustment parameters include at least one of adjustment direction, number of adjustments, and adjustment distance;

[0078] The adjustment unit is adjusted based on the adjustment parameters.

[0079] When processor 1001 calls the installation program for the optical module stored in memory 1005, it also performs the following operations:

[0080] When the offset direction of the displayed image is a horizontal offset direction, the step of adjusting the adjustment unit based on the adjustment parameter includes: adjusting the adjustment unit based on a first adjustment direction;

[0081] Alternatively, when the offset direction of the displayed image is the vertical offset direction, the step of adjusting the adjustment unit based on the adjustment parameter includes: adjusting the adjustment unit based on the second adjustment direction.

[0082] When processor 1001 calls the installation program for the optical module stored in memory 1005, it also performs the following operations:

[0083] When the marked position matches the preset theoretical position, an adjustment end command is generated for the adjustment unit to stop adjusting the adjustment unit.

[0084] like Figure 9 As shown, in the first embodiment of this application, the optical module mounting method is applied to an optical module mounting device, which includes a data acquisition unit and an adjustment unit. Specifically, the optical module mounting method includes the following steps:

[0085] Step S110: Acquire the display image inside the lens barrel acquired by the acquisition unit.

[0086] In this embodiment, the acquisition unit can be moved above the lens barrel, and its position is calibrated. The lens barrel is positioned on a head-mounted display device, which can be an MR head-mounted display device, an XR head-mounted display device, or a VR head-mounted display device. When the head-mounted display device is powered on, a display image appears inside the lens barrel. At this time, the acquisition unit acquires the image displayed inside the lens barrel. This display image can be a test image, which includes at least one marker, and the position of the marker can be set according to the actual situation. Optionally, multiple display images acquired by the acquisition unit at the same time can be obtained and analyzed to improve detection accuracy.

[0087] Step S120: Determine whether the marker position of the displayed image matches the preset theoretical position.

[0088] In this embodiment, after acquiring the display image, the display image is processed to identify the marker positions within the display image.

[0089] Optionally, the displayed image can be converted into a pixel map, and the marker position can be determined based on the pixel coordinates associated with the displayed image. After obtaining the marker position, it is determined whether the marker position matches a preset theoretical position. When the marker position matches the preset theoretical position, it indicates that the installation position of the optical module is appropriate, and the visual effect is better. If the marker position does not match the preset theoretical position, it indicates that there is an error in the installation position of the optical module, and the installation position of the optical module needs to be adjusted to improve the visual effect.

[0090] The preset theoretical position is the standard marker position for displaying the image when the installation error of the optical module is minimized or the visual effect is optimal. This preset theoretical position serves as a standard reference; the marker positions of the displayed images acquired during installation position adjustments must be matched against this preset theoretical position to determine if there are any installation errors in the optical module. This preset theoretical position can be set according to actual conditions, and it can be the center point.

[0091] Optionally, determining whether the marker position of the displayed image matches the preset theoretical position can be as follows: if the marker position of the displayed image overlaps with the preset theoretical position, then the marker position of the displayed image is determined to match the preset theoretical position; if the marker position of the displayed image does not overlap with the preset theoretical position, then the marker position of the displayed image is determined to not match the preset theoretical position. Alternatively, if the marker position of the displayed image is within a preset range of the preset theoretical position, then the marker position of the displayed image is determined to match the preset theoretical position; if the marker position of the displayed image is outside the preset range of the preset theoretical position, then the marker position of the displayed image is determined to not match the preset theoretical position.

[0092] Optionally, when there are multiple identifiers, the positions of each identifier can be obtained separately. If each identifier position overlaps with its corresponding preset theoretical position, or if each identifier position is within a preset range of its corresponding preset theoretical position, it indicates that the identifier position of the displayed image matches the preset identifier position. Optionally, the matching rate between each identifier position and its corresponding preset theoretical position can also be determined. If the matching rate reaches a preset matching rate, it indicates that the identifier position of the displayed image matches the preset theoretical position.

[0093] Step S130: When the marked position does not match the preset theoretical position, adjust the adjustment unit according to the marked position and the preset theoretical position.

[0094] In this embodiment, when the marked position of the displayed image does not match the preset theoretical position, the adjustment unit needs to be adjusted to reduce the installation error of the optical module and improve the visual effect. By adjusting the installation angle of the optical module, the light emitted from the display screen is made to re-align with the center of the human eye after being refracted and reflected inside the module. Specifically, adjusting the adjustment unit according to the marked position and the preset theoretical position may include the following steps:

[0095] Step S131: When the marked position does not match the preset theoretical position, determine the offset direction of the displayed image based on the marked position and the preset theoretical position.

[0096] In this embodiment, the offset direction can be left offset, right offset, up offset, down offset, upper left offset, lower left offset, upper right offset, and lower right offset, etc. The offset direction of the displayed image can be determined based on the pixel coordinates of the marked position and the pixel coordinates of the preset theoretical position. For example, assuming the preset theoretical position is (0, 0), when the marked position is (-1, 2), it indicates that the offset direction of the displayed image is upper left offset; when the marked position is (0, 1), it indicates that the offset direction of the displayed image is right offset.

[0097] Step S132: Determine the adjustment parameters of the adjustment unit according to the offset direction. The adjustment parameters include at least one of adjustment direction, adjustment number, and adjustment distance.

[0098] In this embodiment, after determining the offset direction of the displayed image, the adjustment parameters of the adjustment unit can be determined based on the offset direction. Each offset direction has a corresponding adjustment parameter. This adjustment parameter can be the adjustment direction, the number of adjustments, the adjustment distance, or a combination of multiple adjustment directions, numbers of adjustments, and adjustment distances. Optionally, the adjustment direction can be counterclockwise or clockwise. For example, when the offset direction is leftward, the corresponding number of adjustments can be two, and the adjustment direction can be clockwise.

[0099] Step S133: Adjust the adjustment unit based on the adjustment parameters.

[0100] In this embodiment, after determining the adjustment parameters, the adjustment unit can be adjusted based on these parameters. Specifically, when the offset direction of the displayed image is a horizontal offset direction, the adjustment unit can be adjusted based on a first adjustment direction; when the offset direction of the displayed image is a vertical offset direction, the adjustment unit can be adjusted based on a second adjustment direction. For example, when the horizontal offset direction is to the left, the second connecting member is adjusted downwards; when the horizontal offset direction is to the right, the second connecting member is adjusted upwards. When the vertical offset direction is to the up, the third connecting member is adjusted downwards; when the vertical offset direction is to the left, the third connecting member is adjusted upwards.

[0101] Optionally, when the marked position of the displayed image does not match the preset theoretical position, adjusting the adjustment unit according to the marked position and the preset theoretical position can also be achieved by: upon receiving an adjustment command, determining an adjustment vector based on the adjustment command, and then controlling the movement of the adjustment unit based on the adjustment vector, thereby realizing manual adjustment. The adjustment vector includes the adjustment direction.

[0102] Optionally, the adjustment unit can be adjusted using a combination of automatic and manual adjustment. Optionally, when the current position of the displayed image matches the preset theoretical position, an adjustment end command is generated for the adjustment unit, thereby controlling the adjustment unit to stop adjusting; when the current position of the displayed image does not match the preset theoretical position, the displayed image inside the lens barrel acquired by the acquisition unit is reacquired for analysis.

[0103] This embodiment, based on the above technical solution, acquires the display image inside the lens barrel collected by the acquisition unit, and determines whether the marker position of the display image matches a preset theoretical position. If the marker position does not match the preset theoretical position, the adjustment unit is adjusted according to the marker position of the display image and the preset theoretical position. By adding an adjustment unit to the head-mounted display device and adjusting this adjustment unit to change the angle of the optical module, the problem of visual deviation caused by installation errors in the optical module is solved, the installation error of the optical module is reduced, and the visual effect is improved.

[0104] This invention provides an embodiment of an optical module mounting method. It should be noted that although the logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than that shown here.

[0105] Based on the same inventive concept, this application also provides a computer-readable storage medium storing an installation program for an optical module. When the installation program for the optical module is executed by a processor, it implements the various steps of the optical module installation method described above and achieves the same technical effect. To avoid repetition, it will not be described again here.

[0106] Since the storage medium provided in this application embodiment is the storage medium used to implement the method of this application embodiment, those skilled in the art can understand the specific structure and variations of the storage medium based on the method described in this application embodiment, and therefore will not be repeated here. All storage media used in the method of this application embodiment are within the scope of protection of this application.

[0107] Those skilled in the art will understand that embodiments of the present invention can be provided as methods, systems, or computer program products. Therefore, the present invention can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0108] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0109] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0110] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0111] It should be noted that any reference signs placed between parentheses in the claims should not be construed as limiting the claims. The word "comprising" does not exclude the presence of components or steps not listed in the claims. The word "a" or "an" preceding a component does not exclude the presence of a plurality of such components. The invention can be implemented by means of hardware comprising several different components and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means may be embodied by the same item of hardware. The use of the words first, second, and third, etc., does not indicate any order. These words can be interpreted as names.

[0112] Although preferred embodiments of the invention have been described, those skilled in the art, upon learning the basic inventive concept, can make other changes and modifications to these embodiments. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments as well as all changes and modifications falling within the scope of the invention.

[0113] Obviously, those skilled in the art can make various modifications and variations to this invention without departing from its spirit and scope. Therefore, if these modifications and variations fall within the scope of the claims of this invention and their equivalents, this invention also intends to include these modifications and variations.

Claims

1. A head-mounted display device, comprising: include: case; A lens barrel, the lens barrel including an optical module; A lens barrel mounting base plate, which is fixedly connected to the housing; An adjustment unit is disposed between the lens barrel and the lens barrel mounting substrate for adjusting the angle of the optical module; The adjustment unit includes a second connector, which is connected between the second side of the lens barrel and the second position of the lens barrel mounting base. The second connector is a movable connector used to adjust the distance between the second side of the lens barrel and the lens barrel mounting base so that the display image inside the lens barrel is shifted laterally. A first elastic force adjustment component is also provided between the second side of the lens barrel and the lens barrel mounting base plate. The elastic force of the first elastic force adjustment component increases as the distance between the second side of the lens barrel and the lens barrel mounting base plate decreases. The second connecting member is disposed outside the first elastic force adjustment component.

2. The head-mounted display device of claim 1, wherein, The adjustment unit includes: The first connector is connected between the first side of the lens barrel and the first position of the lens barrel mounting base plate; A third connector is connected between the third side of the lens barrel and the third position of the lens barrel mounting base plate. The third connector is a movable connector used to adjust the distance between the third side of the lens barrel and the lens barrel mounting base plate so that the display image inside the lens barrel is shifted vertically.

3. The head-mounted display device of claim 2, wherein, A second elastic force adjustment component is also provided between the third side of the lens barrel and the lens barrel mounting base plate. The elastic force of the second elastic force adjustment component increases as the distance between the third side of the lens barrel and the lens barrel mounting base plate decreases.

4. The head-mounted display device of claim 3, wherein, The elastic adjustment component includes a spring or a spring plate, which is located at the bottom end of the bottom substrate of the lens barrel.

5. The head-mounted display device of claim 4, wherein, A base plate support point is also provided at the bottom end of the bottom base plate. The bottom base plate forms a locking position with the limiting groove of the lens barrel mounting base plate through the base plate support point, which is used to limit the lateral relative position of the lens barrel and the bottom base plate and support the lens barrel.

6. A method of mounting an optical module, characterized by: A mounting device for a head-mounted display device as described in any one of claims 1-5, wherein the mounting device for the optical module includes a data acquisition unit and an adjustment unit; The installation method of the optical module includes: Acquire the display image inside the lens barrel acquired by the acquisition unit; Determine whether the marker position of the displayed image matches the preset theoretical position; When the marked position does not match the preset theoretical position, the adjustment unit is adjusted according to the marked position and the preset theoretical position.

7. The method of mounting an optical module of claim 6, wherein, The step of adjusting the adjustment unit according to the identification position and the preset theoretical position when the identification position does not match includes: When the marked position does not match the preset theoretical position, the offset direction of the displayed image is determined based on the marked position and the preset theoretical position; The adjustment parameters of the adjustment unit are determined based on the offset direction, and the adjustment parameters include at least one of adjustment direction, number of adjustments, and adjustment distance; The adjustment unit is adjusted based on the adjustment parameters.

8. The method for installing an optical module as described in claim 7, characterized in that, When the shift direction of the displayed image is a horizontal shift direction, the step of adjusting the adjusting unit based on the adjusting parameter comprises adjusting the adjusting unit based on a first adjusting direction. Or, when the shift direction of the displayed image is a vertical shift direction, the step of adjusting the adjusting unit based on the adjusting parameter comprises adjusting the adjusting unit based on a second adjusting direction.

9. The method of claim 6, wherein the optical module is mounted on the substrate by using a plurality of bumps. The method for installing the optical module further comprises: When the identified position matches the preset theoretical position, an adjusting end instruction of the adjusting unit is generated to stop adjusting the adjusting unit.

10. An optical module mounting device, characterized by comprising: The installation device of the optical module comprises a memory, a processor, and an installation program of the optical module stored in the memory and executable on the processor, and the installation program of the optical module, when executed by the processor, implements the steps of the method for installing the optical module according to any one of claims 6-9.

11. The optical module mounting apparatus according to claim 10, wherein The installation device of the optical module further comprises an acquisition unit and an adjusting unit.

12. A computer-readable storage medium, characterized in that, The installation device of the optical module further comprises an acquisition unit and an adjusting unit. The installation device of the optical module further comprises an acquisition unit and an adjusting unit.

Images