Head-mounted display device and binocular image combination calibration method

Abstract

The invention discloses a head-mounted display device and a binocular image combination calibration method. The head-mounted display device comprises a mirror frame, two display modules and two optical waveguides. The two display modules are located in the mirror frame, and the two optical waveguides are connected to the mirror frame; the two display modules and the two optical waveguides are arranged in a one-to-one correspondence manner, the optical waveguides are configured to receive image light emitted by the display modules and form emergent light, the material of the mirror frame comprises a composite material, and the composite material comprises nylon filled with carbon fibers or glass fibers so as to match the precision of binocular image combination. The frame is made of nylon filled with carbon fibers or glass fibers, so that the hardness of the frame can be improved to avoid deformation of the frame, a combined image is prevented from being affected by deformation of the frame, the precision of binocular image combination is matched, and the stability and durability of image display after image combination are improved.

Description

Technical Field

[0001] This disclosure relates to a head-mounted display device and a binocular fusion calibration method. Background Technology

[0002] A head-mounted display device includes a display module and an optical waveguide. Image light emitted from the display module onto the optical waveguide is transmitted through the waveguide and then projected onto the human eye. Binocular fusion technology in head-mounted displays is one of the key technologies for achieving a good visual experience. Summary of the Invention

[0003] Embodiments of this disclosure provide a head-mounted display device and a binocular fusion calibration method.

[0004] This disclosure provides a head-mounted display device, including: a frame, two display modules, and two optical waveguides. The two display modules are located within the frame; the two optical waveguides are connected to the frame. The two display modules and the two optical waveguides are arranged in a one-to-one correspondence. The optical waveguides are configured to receive image light emitted from the display modules and form outgoing light. The frame is made of a composite material, which includes nylon filled with carbon fiber or glass fiber to match the accuracy of binocular image merging.

[0005] For example, according to embodiments of this disclosure, the carbon fiber filling ratio is 25% to 50%.

[0006] For example, according to an embodiment of this disclosure, the glass fiber filling ratio is 25% to 50%.

[0007] For example, according to an embodiment of this disclosure, the density of the frame material is 1.0~2.0 g / cm³. 3 .

[0008] For example, according to an embodiment of this disclosure, the yield strength of the frame is 300~500 MPa.

[0009] For example, according to embodiments of this disclosure, the material of the frame also includes a toughening agent.

[0010] For example, according to an embodiment of this disclosure, the head-mounted display device further includes: a calibration module configured to adjust the position of a reference test pattern displayed by at least one of the two display modules to adjust the position of a pattern projected onto a corresponding optical waveguide, and / or configured to adjust the shape of a reference test pattern displayed by at least one of the two display modules to adjust the shape of a pattern projected onto a corresponding optical waveguide.

[0011] For example, according to an embodiment of this disclosure, each display module includes a display area, the display area including an effective display area and a buffer surrounding the effective display area, the benchmark pattern being located within the effective display area; the effective display area is configured to be offset relative to the center of the display area to adjust the position of the benchmark pattern projected onto the optical waveguide; the display area includes edges extending along a first direction and a second direction, and in at least one of the first direction and the second direction, the size of the buffer is in the ratio of 1 / 10 to 1 / 5 of the size of the effective display area, the first direction intersecting the second direction.

[0012] For example, according to an embodiment of this disclosure, the head-mounted display device further includes: a control interface configured to send instructions to the calibration module to adjust the reference test pattern. The control interface includes a motion control interface and a deformation control interface. The motion control interface includes a first sliding control portion that slides along four different directions. The motion control interface is configured to adjust the position of the pattern projected onto the optical waveguide by sliding the first sliding control portion in at least one of the four different directions. The four different directions include a first sliding direction and a second sliding direction that are parallel to each other and opposite in direction, and a third sliding direction and a fourth sliding direction that are parallel to each other and opposite in direction, wherein the first sliding direction intersects the third sliding direction. The deformation control interface includes a second sliding control portion that slides along the four different directions. The deformation control interface is configured to adjust the shape of the pattern projected onto the optical waveguide by sliding the second sliding control portion in at least one of the four different directions.

[0013] For example, according to an embodiment of this disclosure, the head-mounted display device further includes a storage module configured to encrypt and store the data calibrated by the calibration module.

[0014] For example, according to an embodiment of this disclosure, the head-mounted display device is smart glasses.

[0015] Embodiments of this disclosure provide a binocular image merging calibration method for a head-mounted display device, the head-mounted display device including two display modules and two optical waveguides, the two display modules and the two optical waveguides being configured in a one-to-one correspondence; the method includes: in response to a first instruction, projecting reference test patterns displayed by the two display modules into corresponding optical waveguides; in response to a second instruction, adjusting the position of the reference test pattern displayed by at least one of the two display modules; and / or in response to a third instruction, performing a geometric transformation on the reference test pattern to adjust the shape of the reference test pattern, so that by adjusting at least one of the position and the shape, the projected patterns of the two reference test patterns viewed by the user through the head-mounted display device coincide.

[0016] For example, according to an embodiment of this disclosure, each display module includes a display area, the display area including an effective display area and a buffer surrounding the effective display area, the benchmark pattern being located within the effective display area; adjusting the position of the benchmark pattern displayed in at least one of the two display modules includes: adjusting the position of the effective display area relative to the center of the display area to adjust the position of the benchmark pattern projected onto the optical waveguide.

[0017] For example, according to an embodiment of this disclosure, the display area includes an edge extending along a first direction and a second direction, the first direction intersecting the second direction; adjusting the position of the benchmark pattern displayed in at least one of the two display modules in response to a second instruction includes: adjusting the position of the benchmark pattern displayed in at least one of the two display modules in response to the second instruction to move in at least one of the first direction, the second direction, a third direction, and a fourth direction to adjust the position of the pattern projected onto the optical waveguide by the benchmark pattern, the third direction being parallel to and opposite to the first direction, and the fourth direction being parallel to and opposite to the second direction; performing a geometric transformation on the benchmark pattern in response to a third instruction to adjust the shape of the benchmark pattern includes: adjusting the shape of the pattern projected onto the optical waveguide by the benchmark pattern in at least one of the first direction, the second direction, the third direction, and the fourth direction in response to the third instruction. Attached Figure Description

[0018] To more clearly illustrate the technical solutions of the embodiments of this disclosure, the accompanying drawings of the embodiments will be briefly described below. Obviously, the drawings described below only relate to some embodiments of this disclosure and are not intended to limit this disclosure.

[0019] Figure 1 This is a schematic diagram of a head-mounted display device provided according to an embodiment of the present disclosure.

[0020] Figure 2 A schematic diagram illustrating how a user views an image while wearing a head-mounted display with distorted eyeglass frames.

[0021] Figure 3 A schematic diagram illustrating a user viewing an image while wearing the head-mounted display device provided in this embodiment of the disclosure.

[0022] Figure 4 This is a schematic block diagram of a head-mounted display device provided according to an embodiment of the present disclosure.

[0023] Figure 5 This is a schematic diagram of the display area in the display module.

[0024] Figure 6 This is a schematic diagram of the control interface.

[0025] Figure 7 and Figure 8 A schematic diagram illustrating how to adjust the pattern projected onto an optical waveguide using a reference test pattern in different directions.

[0026] Figure 9 This is a binocular image calibration method for a head-mounted display device according to another embodiment of the present disclosure. Detailed Implementation

[0027] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this disclosure. Based on the described embodiments of this disclosure, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this disclosure.

[0028] Unless otherwise defined, the technical or scientific terms used in this disclosure shall have the ordinary meaning understood by one of ordinary skill in the art to which this disclosure pertains. The terms “first,” “second,” and similar terms used in this disclosure do not indicate any order, quantity, or importance, but are merely used to distinguish different components. Terms such as “comprising” or “including” mean that an element or object preceding the word encompasses the elements or objects listed following the word and their equivalents, without excluding other elements or objects.

[0029] The features such as "parallel" and "perpendicular" used in the embodiments of this disclosure include features in the strict sense of "parallel" and "perpendicular," as well as cases where "approximately parallel" and "approximately perpendicular" include a certain degree of error. Taking into account measurement and errors associated with the measurement of a specific quantity (e.g., limitations of the measurement system), they represent the acceptable deviation range for a specific value as determined by a person skilled in the art. For example, "approximately" can mean within one or more standard deviations, or within 10% or 5% of said value. Unless otherwise specified in the following embodiments of this disclosure, the quantity of a component is implied to mean that the component can be one or more, or can be understood as at least one. "At least one" means one or more, and "more" means at least two.

[0030] At least one embodiment of this disclosure provides a head-mounted display device, including a frame, two display modules, and two optical waveguides. The two display modules are located within the frame, and the two optical waveguides are connected to the frame. The two display modules and the two optical waveguides are arranged in a one-to-one correspondence. The optical waveguides are configured to receive image light emitted from the display modules and form outgoing light. The frame is made of a composite material, including nylon filled with carbon fiber or glass fiber to match the accuracy of binocular image merging.

[0031] In the head-mounted display device disclosed herein, by setting the material of the lens frame to nylon filled with carbon fiber or glass fiber, the rigidity of the lens frame can be increased to avoid deformation of the lens frame, thereby preventing the image from being affected by the deformation of the lens frame, thus matching the accuracy of binocular image merging, and improving the stability and durability of the image display after image merging; in addition, the lens frame using the above-mentioned composite material is lightweight and low-cost, which is conducive to improving the user experience.

[0032] This disclosure provides at least one embodiment of a binocular image merging calibration method for a head-mounted display device, the head-mounted display device including two display modules and two optical waveguides, the two display modules and the two optical waveguides being configured in a one-to-one correspondence. The binocular image merging calibration method includes: in response to a first instruction, projecting reference test patterns displayed by the two display modules into corresponding optical waveguides; in response to a second instruction, adjusting the position of the reference test pattern displayed by at least one of the two display modules; and / or in response to a third instruction, performing a geometric transformation on the reference test pattern to adjust its shape, so that by adjusting at least one of the position and the shape, the images of the two reference test patterns viewed by a user through the head-mounted display device overlap.

[0033] The binocular image merging calibration method for head-mounted display devices disclosed herein allows users to interactively adjust the original display signal, thereby adjusting the display image in offset position and / or shape to achieve binocular image merging. This method does not require additional hardware modifications to increase hardware costs, and can be restored to use without returning to the factory for repair. It achieves mechanical deformation compensation for head-mounted display devices, solves the problem of image merging failure caused by slight deformation of the lens frame, and greatly improves the user experience.

[0034] The head-mounted display device and binocular fusion calibration method provided in the embodiments of this disclosure are described below with reference to the accompanying drawings.

[0035] Figure 1 This is a schematic diagram of a head-mounted display device provided according to an embodiment of the present disclosure. Figure 2 A schematic diagram illustrating how a user views an image while wearing a head-mounted display with distorted eyeglass frames. Figure 3 A schematic diagram illustrating a user viewing an image while wearing the head-mounted display device provided in this embodiment of the disclosure.

[0036] like Figure 1 As shown, the head-mounted display device provided in this embodiment includes a frame 100, two display modules 200, and two optical waveguides 300. The two display modules 200 are located within the frame 100, and the two optical waveguides 300 are connected to the frame 100. The two display modules 200 and the two optical waveguides 300 are arranged in a one-to-one correspondence. The optical waveguides 300 are configured to receive image light emitted from the display modules 200 and form outgoing light. The frame 100 is made of a composite material, including nylon filled with carbon fiber or glass fiber to match the accuracy of binocular image merging.

[0037] The aforementioned "binocular fusion" refers to the precise adjustment and fusion of the images presented to the user's two eyes through specific optical and display designs, so that the images seen by both eyes are combined in the brain into a clear and three-dimensional image.

[0038] The above-mentioned "two display modules 200 and two optical waveguides 300 are set in a one-to-one correspondence" means that the image light of each display module 200 is projected onto one optical waveguide 300, and the image light of different display modules 200 is projected onto different optical waveguides 300.

[0039] In the head-mounted display device disclosed herein, by setting the material of the frame 100 to nylon filled with carbon fiber or glass fiber, the rigidity of the frame 100 can be increased to prevent deformation of the frame 100, thereby preventing the image from being affected by the deformation of the frame 100, thus matching the accuracy of binocular image merging, and improving the stability and durability of the image display after merging; in addition, the aforementioned composite material has a low density, which helps to reduce the weight of the frame 100 and improve the user experience.

[0040] In some examples, such as Figure 1 As shown, the aforementioned head-mounted display device is a smart glasses.

[0041] For example, such as Figure 1 As shown, the smart glasses can be augmented reality (AR) glasses, virtual reality (VR) glasses, etc.

[0042] For example, such as Figure 1 As shown, these smart glasses can be applied to the automotive field. For example, the smart glasses can interconnect with the vehicle's system to provide users with a personalized and convenient driving assistance experience based on user interaction. The interconnection can be wireless, including Wi-Fi, infrared, and Bluetooth connections.

[0043] For example, these smart glasses can interact with users, displaying driving environment-related information on the lenses to improve both user experience and driving safety. This driving environment-related information could include vehicle speed, navigation information, fuel level, traffic sign recognition, and road conditions ahead.

[0044] Typical smart glasses, such as those with two display modules, require the manufacturer to adjust the relative positions of the display modules and the optical waveguide using specialized equipment before shipping to achieve left-right image merging. However, the frames of typical smart glasses are made of metals such as magnesium-lithium alloy or aluminum alloy. Frames made of these metals are prone to deformation under significant stress or prolonged use, causing changes in the coupling optical axis of the optical waveguide. Figure 2 As shown, when a user wears glasses with deformed frames, the images viewed by the left and right eyes become separated, causing the two corresponding display images to fail to merge, severely impacting the user experience. To restore normal operation, these smart glasses must be returned to the factory for calibration and repair using specialized equipment.

[0045] The nylon filled with carbon fiber or glass fiber provided in this disclosure has higher hardness and lower density than the magnesium-lithium alloy used in conventional eyeglass frames, which can prevent the image from being affected by the deformation of the frame. Because the frame of the smart glasses provided in this disclosure is not easily deformed, the images projected by the two display modules onto the two optical waveguides can have high binocular image-merging accuracy, such as... Figure 3 As shown, when a user wears these glasses, the images viewed by the left and right eyes are basically not separated, thus avoiding phenomena such as ghosting, blurring, and distortion in the combined image seen by the user, and improving the user's viewing experience.

[0046] Furthermore, compared to using carbon fiber / glass fiber and nylon as a composite material in the frame, or using any one of carbon fiber, glass fiber and nylon in the frame, the head-mounted display device provided in this disclosure uses a composite material including nylon filled with carbon fiber or glass fiber as the frame material, which can improve the material properties of the frame to achieve the accuracy of binocular image matching.

[0047] For example, such as Figure 1 As shown, the head-mounted display device may also include temples 110, which are connected to the frame 100. For example, the material of the temples 110 may be the same as or different from the material of the frame 100.

[0048] In some examples, such as Figure 1 As shown, the carbon fiber filling ratio is 25%~50%.

[0049] In some examples, such as Figure 1As shown, the glass fiber filling ratio is 25%~50%.

[0050] The proportion of carbon fiber or glass fiber filled in nylon affects parameters such as the frame's hardness, yield strength, density, and toughness. A higher proportion of carbon fiber results in higher hardness, yield strength, and density, but also lower toughness, making the frame 100 brittle and prone to breakage. Conversely, a lower proportion results in lower hardness, yield strength, and density, but higher toughness. Excessive carbon fiber or glass fiber not only makes the frame 100 brittle and prone to breakage but also requires specialized development and evaluation for specific equipment and products, increasing the manufacturing difficulty. Conversely, insufficient carbon fiber or glass fiber reduces the frame's strength, making it prone to deformation and compromising the accuracy of binocular image focusing. Therefore, by setting the filling ratio of carbon fiber or glass fiber, the strength, density and toughness of the frame 100 can be balanced, effectively preventing the deformation of the frame 100, improving the stability and durability of the image display after binocular ...

[0051] Compared to the use of metals such as magnesium-lithium alloy or aluminum alloy for the frames of ordinary smart glasses, the use of the aforementioned composite material for the frame 100 in the smart glasses disclosed herein can improve the material performance of the frame, thereby achieving greater accuracy in matching binocular images. Furthermore, by adjusting the filling ratio of carbon fiber or glass fiber, the frame can have better performance.

[0052] For example, such as Figure 1 As shown, the carbon fiber filling ratio can be 25%, 50%, 30%~40%, 35%~45%, 37%~43%, or 39%~41%, etc.

[0053] For example, such as Figure 1 As shown, the filling ratio of glass fiber can be 25%, 50%, 30%~40%, 35%~45%, 37%~43%, or 39%~41%, etc.

[0054] For example, the material of the frame 100 includes PA612 filled with 40% carbon fiber.

[0055] In some examples, such as Figure 1 As shown, the density of the material of the frame 100 is 1.0~2.0 g / cm³. 3 .

[0056] In the smart glasses disclosed herein, by using the aforementioned composite material for the frame 100, it is beneficial to reduce density and lighten the weight of the frame 100, such as the overall weight of the frame 100 being 5 to 6 grams, thereby improving the user experience.

[0057] In the composite material used for the eyeglass frame 100, a higher filling ratio of carbon fiber or glass fiber results in a higher density, which not only reduces the toughness of the frame 100 but also increases its weight. Therefore, the filling ratio of carbon fiber or glass fiber in the composite material is adjusted to ensure that the density of the frame 100 material is 1.0~2.0 g / cm³. 3 This helps to balance the hardness, toughness, and weight of the frame.

[0058] For example, the density of the material of the frame 100 can be 1.0~1.5 g / cm³. 3 Or 1.05~1.4g / cm 3 Or 1.1~1.35g / cm 3 Or 1.15~1.3g / cm 3 Or 1.2~1.25g / cm 3 wait.

[0059] In some examples, such as Figure 1 As shown, the yield strength of the frame 100 is 300~500 MPa.

[0060] In the smart glasses disclosed herein, using the aforementioned composite material for the frame 100 improves the yield strength of the frame 100, preventing deformation of the frame 100 from affecting the binocular image alignment. In the composite material used for the frame 100, a higher proportion of carbon fiber or glass fiber results in a higher yield strength, making the frame 100 more brittle and prone to breakage; conversely, a lower proportion of carbon fiber or glass fiber results in a lower yield strength, making the frame 100 more susceptible to deformation and affecting the accuracy of binocular image alignment. Therefore, adjusting the proportion of carbon fiber or glass fiber in the composite material to achieve a yield strength of 300-500 MPa helps balance the hardness, toughness, and other parameters of the frame 100.

[0061] For example, the yield strength of the material of the frame 100 is 350~450Mpa, or 350~400Mpa, or 320~420Mpa, or 370~430Mpa, or 330~440Mpa, or 340~410Mpa, etc.

[0062] In some examples, such as Figure 1 As shown, the material of the frame 100 also includes a toughening agent.

[0063] By setting the material of the frame 100 to include nylon filled with carbon fiber or glass fiber, and adding a toughening agent, such as combining a large proportion of carbon fiber or glass fiber with a toughening agent, not only can the frame 100 have greater hardness, but it can also have higher toughness at the same time. This avoids the frame 100 from deforming and affecting the image, while also preventing the frame 100 from being too brittle and breaking.

[0064] For example, toughening agents can include elastomer toughening agents, resin toughening agents, inorganic toughening agents, nano-toughening agents, etc., and the matching toughening agent can be selected according to the material requirements in the frame 100.

[0065] For example, such as Figure 1 As shown, the frame 100 can be formed by injection molding.

[0066] The frame 100 of the smart glasses provided in this embodiment is integrally formed by injection molding, which is low in cost; and different appearance effects can be displayed by different spraying to meet different appearance requirements.

[0067] Figure 4 This is a schematic block diagram of a head-mounted display device provided according to an embodiment of the present disclosure. Figure 5 This is a schematic diagram of the display area in the display module.

[0068] In some examples, such as Figure 4 As shown, the head-mounted display device also includes a calibration module 400, configured to adjust the position of a reference test pattern displayed by at least one of the two display modules to adjust the position of a pattern projected onto a corresponding optical waveguide, and / or, configured to adjust the shape of a reference test pattern displayed by at least one of the two display modules to adjust the shape of a pattern projected onto a corresponding optical waveguide.

[0069] Even with the aforementioned composite material, the frame may still experience slight deformation in certain situations. If the deformation within a certain range causes image shift, the calibration module 400 allows for user-interactive adjustment of the original display signal, adjusting the display image in terms of offset position and / or shape to achieve binocular image merging. This eliminates the need for additional hardware modifications that would increase hardware costs, and the glasses can be restored to use without returning to the factory for repair. This achieves mechanical deformation compensation for smart glasses, solves the problem of image merging failure caused by slight frame deformation, and greatly improves the user experience.

[0070] For example, such as Figure 4 and Figure 5As shown, the calibration module 400 can adjust the position of the reference test pattern 201 to adjust the offset position of the displayed image, thereby achieving the effect of binocular image merging. For example, the calibration module 400 can adjust the shape of the reference test pattern 201 to adjust the shape of the displayed image, thereby achieving the effect of binocular image merging. For example, the calibration module 400 can first adjust the position of the reference test pattern 201 and then adjust its shape to adjust both the position and shape of the displayed image, thereby achieving the effect of binocular image merging.

[0071] The stage of first adjusting the position of the reference test pattern 201 can be called the coarse adjustment stage, and the stage of adjusting the shape of the reference test pattern 201 can be called the fine adjustment stage. Adjusting the reference test pattern 201 through two stages can improve the adjustment accuracy to match the precision of binocular image merging.

[0072] For example, such as Figure 1 , Figure 4 and Figure 5 As shown, when the display image on only one optical waveguide 300 is affected by the deformation of the lens frame 100, the position and / or shape of the pattern projected onto the optical waveguide 300 by the reference test pattern 201 displayed by only one display module 200 can be adjusted by the calibration module 400. For example, when the display images on both optical waveguides 300 are affected by the deformation of the lens frame 100, the position and / or shape of the patterns projected onto the optical waveguide 300 by the reference test patterns 201 displayed by both display modules 200 can be adjusted by the calibration module 400.

[0073] In some examples, such as Figure 5 As shown, each display module 200 includes a display area 210, which includes an effective display area 211 and a buffer 212 surrounding the effective display area 211. A benchmark pattern 201 is located within the effective display area 211. The effective display area 211 is configured to be offset relative to the center of the display area 210 to adjust the position of the pattern of the benchmark pattern 201 projected onto the optical waveguide 300. The display area 210 includes edges extending along a first direction and a second direction. In at least one of the first and second directions, the size of the buffer 212 is 1 / 10 to 1 / 5 of the size of the effective display area 211. The first and second directions intersect.

[0074] In the display module 200 provided in this disclosure, a portion of the display area 210 serves as an effective display area 211 for displaying images, while another portion serves as a dynamically adjustable buffer 212. The relative positional relationship between the buffer 212 and the effective display area 211 is set. When a slight deformation of the frame 100 causes the image projected onto the optical waveguide 300 by the effective display area 211 to shift and / or deform, the position and / or shape of the image projected onto the optical waveguide 300 can be adjusted by adjusting the position of the effective display area 211 relative to the center of the display area 210 and / or the shape of the effective display area 211, thereby achieving the effect of binocular image merging. Furthermore, by setting the size relationship between the buffer 212 and the effective display area 211, it is possible to avoid the effective display area 211 being too small and affecting the display effect, and also to avoid the effective display area 211 moving outside the buffer 212 and causing the missing displayed image.

[0075] For example, such as Figure 5 As shown, the first direction can be X1, and the second direction can be Y2, but this is not limited to these. The first direction can be one of X3, Y2, or Y4, and the second direction can be a direction that intersects with the first direction. For example, the first and second directions can be interchanged. For example, the angle between the first and second directions can be 85 to 95 degrees. For example, the first and second directions can be perpendicular.

[0076] For example, such as Figure 5 As shown, display area 210 includes multiple pixels arranged in an array along a first direction and a second direction. For example, the number of pixels arranged along the X1 direction is 540, and the number of pixels arranged along the Y2 direction is 280. The physical resolution of display area 210 can be 540×280 pixels. For example, in effective display area 211, the number of pixels arranged along the X1 direction is 500, and the number of pixels arranged along the Y2 direction is 200. The physical resolution of effective display area 211 can be 500×200 pixels. For example, with Y2 direction upward and X1 direction to the right, buffer 212 includes pixels located in the upper, lower, left, and right areas of effective display area 211. For example, effective display area 211 is located in the middle area of ​​display area 210. If rendered in the center by default, the initial offset (ΔX,ΔY) = (0,0).

[0077] For example, such as Figure 5 As shown, the ratio of the size of the buffer 212 to the size of the effective display area 211 can be 1 / 9 to 1 / 6, or 1 / 8 to 1 / 7.

[0078] For example, such as Figure 5 As shown, the benchmark pattern 201 includes crosshairs and rectangles. However, it is not limited to this; the benchmark pattern 201 can be configured as needed.

[0079] For example, such as Figure 5 As shown, the calibration module 400 can be located in the display module 200, or it can be a module electrically connected to the display module 200, such as a device with calibration function located on a printed circuit board.

[0080] Figure 6 This is a schematic diagram of the control interface. Figure 7 and Figure 8 A schematic diagram illustrating how to adjust the pattern projected onto an optical waveguide using a reference test pattern in different directions.

[0081] In some examples, such as Figure 4 and Figure 6 As shown, the head-mounted display device also includes a control interface 500 configured to send instructions to the calibration module 400 to adjust the reference test pattern 201. The control interface 500 includes a motion control interface 510 and a deformation control interface 520. The motion control interface 510 includes a first sliding control portion 511 that slides in four different directions. The motion control interface 510 is configured to adjust the position of the pattern projected onto the optical waveguide 300 by sliding the first sliding control portion 511 in at least one of the four different directions. The four different directions include a first sliding direction U1 and a second sliding direction U2 that are parallel to each other and opposite in direction, and a third sliding direction U3 and a fourth sliding direction U4 that are parallel to each other and opposite in direction. The first sliding direction U1 and the third sliding direction U3 intersect. The deformation control interface 520 includes a second sliding control portion 521 that slides in the aforementioned four different directions. The deformation control interface 520 is configured to adjust the shape of the reference test pattern 201 by sliding the second sliding control portion 521 in at least one of the four different directions, thereby adjusting the shape of the pattern projected onto the optical waveguide.

[0082] For minor deformation of the frame 100, there is no need to return it to the factory for repair. The user can simply adjust the position and / or shape of the image projected onto the waveguide 300 via the control interface 500 to restore its use, thereby improving the user experience.

[0083] For example, such as Figure 6 As shown, the control interface 500 can be a component on the smart glasses, such as a button; or it can be a mobile application (APP) that establishes a wireless connection with the smart glasses. For example, the APP can send control commands to the calibration module 400 via Bluetooth Low Energy (BLE) or Serial Port Protocol (SPP) to control the display output, but it is not limited to these two connection methods.

[0084] For example, such as Figure 6As shown, the control interface 500 includes a switching unit 530 for switching between two display modules 200, so as to adjust the effective display area 211 in the display module 200 after determining the display module 200 to be adjusted.

[0085] For example, such as Figure 5 and Figure 6 As shown, taking a mobile app as an example, the user sends a command through the mobile app to start the calibration module 400 on the smart glasses, such as using the manual calibration method. Figure 6 The schematic diagram shown can be an interface diagram of an APP. The two display modules 200 respectively project the projection pattern of the reference test pattern 201 onto the corresponding optical waveguide 300, such as a crosshair + rectangle; after selecting the display module 200 to be adjusted by the switching unit, at least one of the first sliding control unit 511 and the second sliding control unit 521 is adjusted to adjust at least one of the position and shape of the pattern of the reference test pattern 201 projected onto the optical waveguide 300.

[0086] For example, such as Figure 5 and Figure 6 As shown, when the first sliding control unit 511 slides along the first sliding direction U1, it can control the reference test pattern 201 to move in the first direction X1; when the first sliding control unit 511 slides along the second sliding direction U2, it can control the reference test pattern 201 to move in the third sliding direction X3; when the first sliding control unit 511 slides along the third sliding direction U3, it can control the reference test pattern 201 to move in the second direction Y2; and when the first sliding control unit 511 slides along the fourth sliding direction U4, it can control the reference test pattern 201 to move in the fourth direction Y4. For example, the first sliding control unit 511 may include a four-way slider. By sliding the first sliding control unit 511 in four directions, the reference test pattern 201 can be moved in four directions, thereby controlling the projection pattern of the reference test pattern on the optical waveguide to move in the direction desired by the user.

[0087] The above examples and subsequent examples are described with the first sliding direction U1 corresponding to the first direction X1, the second sliding direction U2 corresponding to the third direction X3, the third sliding direction U3 corresponding to the second direction Y2, and the fourth sliding direction U4 corresponding to the fourth direction Y4 as examples. However, they are not limited to this. The first sliding direction U1, the second sliding direction U2, the third sliding direction U3, and the fourth sliding direction U4 can have various different correspondences with the first direction X1, the second direction Y2, the third direction X3, and the fourth direction Y4, as long as one sliding direction corresponds to one moving direction.

[0088] For example, by sliding the first sliding control unit 511, an instruction to adjust the position of the display output pattern is sent to the calibration module 400, thereby changing the offset position of the effective display area 211 relative to the center of the display area 210, and changing the position of the reference test pattern 201, so that the cross lines in the projection pattern of the reference test pattern 201 seen by the left and right eyes through the optical waveguide 300 coincide.

[0089] Due to the slight deformation of the frame 100, the patterns projected onto the optical waveguide 300 by the two display modules 200 displayed by the user when wearing the smart glasses no longer overlap or are rectangular; their shapes may be different. Figure 7 and Figure 8 The trapezoid shown has a certain degree of distortion.

[0090] When it is necessary to adjust both the position and shape of the reference test pattern 201, the stage of adjusting the position of the reference test pattern 201 by sliding the first sliding control unit 511 can be called the coarse adjustment stage. The coarse adjustment stage mainly adjusts the cross lines of the two reference test patterns 201 projected onto the optical waveguide 300 to coincide.

[0091] For example, such as Figures 6 to 8 As shown, when the second sliding control unit 521 slides along the first sliding direction U1, it can control the reference test pattern 201 to deform in the first direction X1 to adjust the shape of the projection pattern 2011 to be adjusted projected onto the optical waveguide, such as... Figure 8 The trapezoidal projection pattern 2011 to be adjusted shown on the left is deformed into a standard rectangular projection pattern 2010 in the middle; when the second sliding control unit 521 slides along the second sliding direction U2, it can control the reference test pattern 201 to deform in the third direction X3 to adjust the shape of the projection pattern 2011 to be adjusted projected onto the optical waveguide, such as... Figure 8 The trapezoidal projection pattern 2011 to be adjusted shown on the right is deformed into a standard projection pattern 2010 with a rectangular shape in the middle; when the second sliding control unit 521 slides along the third sliding direction U3, it can control the reference test pattern 201 to deform in the second direction Y2 to adjust the shape of the projection pattern 2011 to be adjusted projected onto the optical waveguide, such as... Figure 7 The trapezoidal projection pattern 2011 to be adjusted shown on the right is deformed into a standard projection pattern 2010 with a rectangular shape in the middle; when the second sliding control unit 521 slides along the fourth sliding direction U4, it can control the reference test pattern 201 to deform in the fourth direction Y4 to adjust the shape of the projection pattern 2011 to be adjusted projected onto the optical waveguide, such as... Figure 7The trapezoidal projection pattern 2011 to be adjusted shown on the left is deformed into a standard projection pattern 2010 with a rectangular shape in the middle. For example, the second sliding control unit 521 may include a four-way slider. By sliding the second sliding control unit 521 in four directions, the reference test pattern 201 is deformed in at least one of the four directions, so that the shape of the projection pattern after changing its shape in at least one of the four directions is almost the same as that of the standard projection pattern.

[0092] The stage described above, in which the shape of the reference test pattern 201 is adjusted by the sliding control unit 521, can be referred to as the fine-tuning stage. For example, a software interpolation algorithm can be used to perform a geometric transformation on the original image, changing the geometric shape of the output image until the projection patterns of the reference test pattern 201 seen by the left and right eyes completely overlap. The process of performing a geometric transformation on the original image includes using pixel compensation to change the image shape.

[0093] In some examples, such as Figure 4 As shown, the head-mounted display device also includes a storage module 600, configured to encrypt and store data calibrated by the calibration module 400.

[0094] For example, such as Figure 4 As shown, the control interface 500 is configured to encrypt and store at least one of the motion control data and deformation control data calibrated by the calibration module 400 in the storage module 600. For example, after the user confirms the calibration is complete via an app or a button on the smart glasses, the motion control data of the reference test pattern 201 in the adjusted display module 200 moving in various directions and the deformation control data generated during the shape adjustment process are encrypted and stored in the local flash memory of the smart glasses to achieve data persistence. After the smart glasses are restarted, the motion control data and deformation control data can be automatically loaded from the flash memory and applied to the display module 200.

[0095] For example, the storage module 600 can be located on the printed circuit board or motherboard of the smart glasses. For example, the encrypted storage format of the data includes AES-256 encryption algorithm and CRC checksum.

[0096] This disclosure provides a user-interactive software compensation module to address the image shift problem caused by slight deformation of the eyeglass frame. This module includes at least the aforementioned calibration module 400, control interface 500, and storage module 600. Through the coordination of a reserved buffer 212, a first sliding control unit 511 and a second sliding control unit 521 that move in four directions, and a data solidification and storage mechanism, the user can autonomously adjust the position and deformation of the left and right eye images in real time. This smart glasses requires no hardware modification and can solve the image alignment failure problem caused by slight deformation of the eyeglass frame 100.

[0097] It should be noted that the calibration module 400, control interface 500, and storage module 600 can be implemented by software, hardware, firmware, or any combination thereof. For example, these modules or interfaces can be implemented by a central processing unit (CPU), image processor (GPU), tensor processor (TPU), field-programmable gate array (FPGA), or other forms of processing units with data processing and / or instruction execution capabilities, and corresponding computer instructions. The embodiments of this disclosure do not limit this.

[0098] Figure 9 This is a binocular image calibration method for a head-mounted display device according to another embodiment of the present disclosure.

[0099] Head-mounted display devices include Figure 1 The diagram shows two display modules 200 and two optical waveguides 300, with each display module 200 and optical waveguide 300 configured in a one-to-one correspondence. The display modules 200 and optical waveguides 300 in this embodiment may have the same features as those in the above embodiments, and will not be described again here.

[0100] like Figure 9 As shown, the binocular image merging calibration method includes: S01: In response to a first command, the reference test pattern 201 displayed by the two display modules 200 is projected into the corresponding optical waveguide 300.

[0101] In one example, such as Figure 9 As shown, when the frame 100 undergoes slight deformation or other reasons cause the pattern of the reference test pattern 201 projected onto the optical waveguide 300 to shift or deform in position, the binocular image calibration method further includes: S02: in response to the second instruction, adjusting the position of the reference test pattern 201 displayed in at least one of the two display modules 200; and S03: in response to the third instruction, performing a geometric transformation on the reference test pattern 201 to adjust the shape of the reference test pattern 201.

[0102] In this example, the position of the benchmark pattern 201 is first adjusted, and then the shape of the benchmark pattern 201 is adjusted so that the patterns projected onto the optical waveguide by the two benchmark patterns 201 viewed by the user through the head-mounted display device are basically overlapping.

[0103] In other examples, the binocular fusion calibration method further includes S02: in response to a second instruction, adjusting the position of the reference test pattern 201 displayed by at least one of the two display modules 200; or S03: in response to a third instruction, performing a geometric transformation on the reference test pattern 201 to adjust the shape of the reference test pattern 201.

[0104] In one example of other examples, only the position of the benchmark pattern 201 can be adjusted so that the patterns projected onto the optical waveguide by the two benchmark patterns 201 as viewed by the user through the head-mounted display are substantially coincident. In another example of other examples, only the shape of the benchmark pattern 201 can be adjusted so that the patterns projected onto the optical waveguide by the two benchmark patterns 201 as viewed by the user through the head-mounted display are substantially coincident.

[0105] The binocular image merging calibration method for head-mounted display devices provided in this disclosure allows users to interactively adjust the original display signal, thereby adjusting the display image in terms of offset position and / or shape to achieve binocular image merging. This method does not require additional hardware modifications to increase hardware costs and can be restored to use without returning to the factory for repair. It realizes mechanical deformation compensation for head-mounted display devices, such as smart glasses, and solves the problem of image merging failure caused by slight deformation of the frame, greatly improving the user experience.

[0106] The binocular fusion calibration method for head-mounted display devices provided in this embodiment is not limited to such a head-mounted display device, in which the frame 100 of the head-mounted display device includes a composite material of nylon filled with carbon fiber or glass fiber; the binocular fusion calibration method can also be applied to other head-mounted display devices, in which the frame 100 can be made of materials such as magnesium-lithium alloy, aluminum alloy or other alloys.

[0107] In some examples, each display module 200 includes a display area 210, which includes an effective display area 211 and a buffer 212 surrounding the effective display area 211, with a benchmark pattern 201 located within the effective display area 211; adjusting the position of the benchmark pattern 201 displayed in at least one of the two display modules 200 includes adjusting the position of the effective display area 211 relative to the center of the display area 210 to adjust the position of the benchmark pattern 201 projected onto the optical waveguide 300.

[0108] The method for selecting the effective display area 211 and adjusting the position of the effective display area 211 relative to the center of the display area 210 in this embodiment can be the same as the relevant adjustment method for the effective display area 211 in the above embodiments, and will not be repeated here.

[0109] In some examples, the display area 210 includes edges extending along a first direction and a second direction, the first direction intersecting the second direction; adjusting the position of the benchmark pattern 201 displayed in at least one of the two display modules 200 in response to the second instruction includes: adjusting the position of the benchmark pattern 201 displayed in at least one of the two display modules 200 in response to the second instruction to move in at least one of the first direction, the second direction, the third direction, and the fourth direction to adjust the position of the pattern projected onto the optical waveguide by the benchmark pattern 201, the third direction being parallel to and opposite to the first direction, and the fourth direction being parallel to and opposite to the second direction; performing a geometric transformation on the benchmark pattern 201 in response to the third instruction to adjust the shape of the benchmark pattern 201 includes: adjusting the shape of the pattern projected onto the optical waveguide by the benchmark pattern 201 in at least one of the first direction, the second direction, the third direction, and the fourth direction in response to the third instruction.

[0110] The method for adjusting the position and shape of the reference test pattern 201 projected onto the optical waveguide 300 in this embodiment is the same as the method for adjusting the position and shape of the reference test pattern 201 projected onto the optical waveguide 300 in the above embodiments, and will not be repeated here.

[0111] This disclosure provides a software compensation method based on user interaction to address the problem of image shift caused by slight deformation of the eyeglass frame or other factors. This method utilizes a reserved buffer, a first sliding control unit and a second sliding control unit that move in four directions, and a data storage mechanism to enable users to autonomously adjust the position and deformation of the left and right eye images in real time. This smart glasses requires no hardware modification and can solve the problem of image alignment failure.

[0112] The following points need to be explained:

[0113] (1) The accompanying drawings of the embodiments of this disclosure only involve the structures involved in the embodiments of this disclosure, and other structures can be referred to the general design.

[0114] (2) Where there is no conflict, features of the same embodiment and different embodiments of this disclosure may be combined with each other.

[0115] The above description is merely an exemplary embodiment of this disclosure and is not intended to limit the scope of protection of this disclosure, which is determined by the appended claims.

Claims

1. A head-mounted display device, comprising: Picture frames; Two display modules are located within the frame; Two optical waveguides are connected to the frame; The two display modules are configured to correspond one-to-one with the two optical waveguides. The optical waveguides are configured to receive image light emitted by the display modules and form outgoing light. The frame material includes composite materials, which include nylon filled with carbon fiber or glass fiber to match the accuracy of binocular image merging.

2. The head-mounted display device according to claim 1, wherein, The carbon fiber filling ratio is 25% to 50%.

3. The head-mounted display device according to claim 1, wherein, The glass fiber filling ratio is 25% to 50%.

4. The head-mounted display device according to claim 1, wherein, The density of the frame material is 1.0~2.0 g / cm³. 3 .

5. The head-mounted display device according to claim 1, wherein, The yield strength of the frame is 300~500 MPa.

6. The head-mounted display device according to claim 1, wherein, The frame material also includes a toughening agent.

7. The head-mounted display device according to claim 1, further comprising: The calibration module is configured to adjust the position of a reference test pattern displayed by at least one of the two display modules to adjust the position of the pattern projected onto the corresponding optical waveguide, and / or is configured to adjust the shape of a reference test pattern displayed by at least one of the two display modules to adjust the shape of the pattern projected onto the corresponding optical waveguide.

8. The head-mounted display device according to claim 7, wherein, Each display module includes a display area, which includes an effective display area and a buffer surrounding the effective display area, and the benchmark pattern is located within the effective display area; The effective display area is configured to be offset relative to the center of the display area to adjust the position of the benchmark pattern projected onto the optical waveguide; The display area includes edges extending along a first direction and a second direction. In at least one of the first direction and the second direction, the size of the buffer is 1 / 10 to 1 / 5 of the size of the effective display area. The first direction intersects the second direction.

9. The head-mounted display device according to claim 7, further comprising: The control interface is configured to send commands to the calibration module to adjust the benchmark pattern. The control interface includes a motion control interface and a deformation control interface. The motion control interface includes a first sliding control part that slides in four different directions. The motion control interface is configured to adjust the position of the reference test pattern projected onto the optical waveguide by sliding the first sliding control part in at least one of the four different directions. The four different directions include a first sliding direction and a second sliding direction that are parallel to each other and opposite in direction, and a third sliding direction and a fourth sliding direction that are parallel to each other and opposite in direction. The first sliding direction intersects with the third sliding direction. The deformation control interface includes a second sliding control portion that slides along the four different directions. The deformation control interface is configured to adjust the shape of the pattern projected onto the optical waveguide by sliding the second sliding control portion in at least one of the four different directions.

10. The head-mounted display device according to claim 7, further comprising: The storage module is configured to encrypt and store the data calibrated by the calibration module.

11. The head-mounted display device according to any one of claims 1-10, wherein, The head-mounted display device is a smart glasses.

12. A binocular image merging calibration method for head-mounted display devices, wherein, The head-mounted display device includes two display modules and two optical waveguides, with the two display modules and the two optical waveguides arranged in a one-to-one correspondence; The method includes: In response to the first command, the benchmark test patterns displayed by the two display modules are projected into the corresponding optical waveguides; In response to the second instruction, adjust the position of the benchmark pattern displayed in at least one of the two display modules; and / or In response to a third instruction, a geometric transformation is performed on the benchmark pattern to adjust the shape of the benchmark pattern so that the projected patterns of the two benchmark patterns viewed by the user through the head-mounted display device coincide by adjusting at least one of the position and the shape.

13. The method according to claim 12, wherein, Each display module includes a display area, which includes an effective display area and a buffer surrounding the effective display area, and the benchmark pattern is located within the effective display area; Adjusting the position of the benchmark pattern displayed in at least one of the two display modules includes: Adjust the position of the effective display area relative to the center of the display area to adjust the position of the reference test pattern projected onto the optical waveguide.

14. The method according to claim 12, wherein, The display area includes an edge extending along a first direction and a second direction, the first direction intersecting the second direction; The step of adjusting the position of the benchmark pattern displayed in at least one of the two display modules in response to the second instruction includes: adjusting the position of the benchmark pattern displayed in at least one of the two display modules in response to the second instruction to move in at least one of the first direction, the second direction, the third direction, and the fourth direction to adjust the position of the pattern projected onto the optical waveguide by the benchmark pattern, wherein the third direction is parallel to the first direction and opposite in direction, and the fourth direction is parallel to the second direction and opposite in direction; In response to a third instruction, performing a geometric transformation on the reference test pattern to adjust the shape of the reference test pattern includes: in response to the third instruction, adjusting the shape of the pattern projected onto the optical waveguide by the reference test pattern in at least one of the first direction, the second direction, the third direction, and the fourth direction.

Images