Control method and control device of smart glasses, and smart glasses

Abstract

The application provides a control method and device of smart glasses and the smart glasses, and relates to the technical field of smart glasses. The control method of the smart glasses comprises the following steps: acquiring deformation data of a glasses frame, and determining a corresponding actual combined image distance based on the deformation data; determining a corresponding target projection image based on the actual combined image distance, so that the combined image distance corresponding to the target projection image is at a preset combined image distance. The application acquires the deformation data of the glasses frame, determines the actual combined image distance corresponding to the deformation data, determines the corresponding target projection image, so that the combined image distance corresponding to the target projection image is at the preset combined image distance, realizes offset compensation of the offset pixels of the smart glasses, optimizes the display effect, and enables the projection image to be completely presented when the head size of a user is large or small.

Description

Technical Field

[0001] This application relates to the field of smart glasses technology, and in particular to a control method, control device, and smart glasses for smart glasses. Background Technology

[0002] Currently available smart glasses, such as AR glasses, VR glasses, and MR glasses, suffer from problems with incomplete image display when used with users who have larger or smaller head sizes due to the fixed design of their optical frames. Summary of the Invention

[0003] The main objective of this invention is to provide a control method for smart glasses, which aims to adjust the offset pixels of the smart glasses so that users with different head sizes can see the complete projected image.

[0004] To achieve the above objectives, the present invention provides a control method for smart glasses, the method comprising: Obtain the deformation data of the eyeglass frame, and determine the corresponding actual image-matching distance based on the deformation data; Based on the actual image merging distance, a corresponding target projection image is determined so that the image merging distance of the corresponding target projection image is at a preset image merging distance.

[0005] Optionally, the deformation data includes deformation angles, wherein the deformation angle of the eyeglass frame is the angle formed by the edge of the eyeglass frame along the center point of the frame before and after deformation; Determining the corresponding actual alignment distance based on the deformation data includes: The actual image alignment distance is determined based on the preset frame length, the preset alignment distance, and the deformation angle.

[0006] Optionally, the method for obtaining the deformation angle is as follows: Obtain the deformation displacement of the edge of the eyeglass frame after deformation; The deformation angle is determined based on the preset frame length and the deformation displacement.

[0007] Optionally, an IMU sensor is provided on the edge of the eyeglass frame; The process of obtaining the deformation displacement of the edge of the eyeglass frame after deformation includes: The angular velocity and acceleration data of the edge of the frame are acquired using an IMU sensor, and the deformation distance corresponding to the angular velocity and acceleration data is determined.

[0008] Optionally, the specific process of determining the actual alignment distance based on the preset frame length, the preset alignment distance, and the deformation angle is as follows: ; In the formula, H is the actual image-combining distance, θ is the angle between the horizontal plane of the eyeglass frame and the image-combining distance of the projected image, θ is the complementary angle of the deformation angle in the direction of the projected image, and D2 is half the length of the eyeglass frame.

[0009] Optionally, determining the corresponding projected image based on the actual image convergence distance specifically involves: Determine the pixel offset in at least one direction between the actual image alignment distance and the preset image alignment distance; The image to be projected is offset by pixels in at least one direction according to the pixel offset, and the adjusted image to be projected is determined as the target projection image.

[0010] Optionally, the step of offsetting the image to be projected in at least one direction according to the pixel offset, and determining the adjusted image to be projected as the target projection image, includes: Calculate the new pixel position of the image to be projected based on the pixel offset; The size and pixel position of the image to be projected are adjusted according to the new pixel position, and the adjusted image to be projected is determined as the target projection image.

[0011] Optionally, the direction includes at least one of the four directions: up, down, left, and right.

[0012] In addition, to achieve the above objectives, the present invention also provides a control device, the control device comprising: a memory, a processor, and a control program for smart glasses stored in the memory and executable on the processor, the control program for smart glasses being configured to implement the control method for smart glasses as described above.

[0013] In addition, to achieve the above objectives, the present invention also provides smart glasses, including the control device described above.

[0014] This invention obtains deformation data of the eyeglass frame and then determines the actual merging distance corresponding to the deformation data, thereby determining the corresponding target projection image. This ensures that the merging distance of the target projection image is within a preset merging distance, thereby achieving offset compensation for the offset pixels of the smart glasses to optimize the display effect. This allows the projected image to be fully presented when adapting to users with larger or smaller head sizes. Attached Figure Description

[0015] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0016] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0017] Figure 1 This is a schematic flowchart of a control method for smart glasses according to an embodiment of the present invention; Figure 2 This is a schematic flowchart of a control method for smart glasses according to another embodiment of the present invention; Figure 3 This is a schematic flowchart of a control method for smart glasses according to another embodiment of the present invention; Figure 4 This is a schematic flowchart of a control method for smart glasses according to another embodiment of the present invention; Figure 5 This is a schematic flowchart of a control method for smart glasses according to another embodiment of the present invention; Figure 6 This is a schematic flowchart of a control method for smart glasses according to another embodiment of the present invention; Figure 7 This is a schematic diagram showing the change in the image-combining distance of the smart glasses of the present invention before and after deformation; Figure 8 for Figure 7 A schematic diagram of the mathematical model of the image-combining distance before and after the frame deformation of the smart glasses.

[0018] The realization of the objective, functional features and advantages of the present invention will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0019] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Well-known modules, units, and their connections, links, communications, or operations are not shown or described in detail. Furthermore, the described features, architectures, or functions can be combined in any way in one or more embodiments. Those skilled in the art should understand that the various embodiments described below are only for illustrative purposes and not for limiting the scope of protection of the present invention. It is also readily understood that the modules, units, or processing methods in the various embodiments described herein and shown in the accompanying drawings can be combined and designed in various different configurations. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0020] The definitions of various terms or methods used in the following embodiments are, except where logically impossible, generally defined as broad concepts that can be implemented under the premise of the content disclosed in the embodiments. Under this understanding, all specific subordinate limitations of the terms or methods should be considered as part of the invention and should not be narrowly interpreted or biased simply because the specification does not disclose such a specific limitation. Similarly, provided that it is logically feasible, the order of the steps in the method is flexible and varied, and all specific subordinate limitations in the broad concepts of various terms or methods fall within the scope of protection of this invention.

[0021] Due to the fixed optical frame design of existing smart glasses, such as AR glasses, VR glasses, and MR glasses, users with larger heads often experience frame deformation after wearing smart glasses, resulting in incomplete image display.

[0022] It's important to understand that when smart glasses are fitted to a user with a suitable head size, such as... Figure 7 As shown in the left image, the image-combining distance can be perfectly matched to the imaging position of the projected image, allowing the user to see the complete projected image after wearing the smart glasses. However, if a user with a larger head size wears the smart glasses, such as... Figure 7 As shown in the right part of the image, the user's head pushes the temples of the glasses outward, causing them to expand outward. This results in a slight deformation of the frame edges towards the projected image. In smart glasses design, the relative positions of the optical engine (light source and display module) and the waveguide or mirror are fixed. If the frame deforms, the distances between these components may change, altering the light path and affecting the image convergence distance, ultimately leading to a loss of field of view for the user.

[0023] To address the aforementioned technical problems, this application proposes a control method for smart glasses. By acquiring deformation data of the glasses frame and determining the actual alignment distance corresponding to the deformation data, a corresponding target projection image is determined, so that the alignment distance of the target projection image is at a preset alignment distance.

[0024] This application provides a solution to compensate for the offset of pixels in smart glasses in order to optimize the display effect, so that the projected image can be fully displayed when adapting to users with large or small head sizes.

[0025] In the various embodiments of the present invention, for ease of description, the following description uses the control device as the execution subject.

[0026] Therefore, this invention proposes a control method for smart glasses; it is understood that the smart glasses are equipped with a control device for storing and executing the following method. The control device can be implemented using a main controller, such as an MCU (Microcontroller Unit), a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Array), or a SOC (System On Chip).

[0027] Reference Figure 1 In one embodiment of the present invention, the control method for smart glasses includes steps S100-S200, wherein: S100: Obtain deformation data of the eyeglass frame and determine the corresponding actual image-matching distance based on the deformation data; S200. Based on the actual image merging distance, determine the corresponding target projection image so that the image merging distance of the corresponding target projection image is at a preset image merging distance.

[0028] In this embodiment, the deformation data may include the degree of bending of the eyeglass frame, the change in the relative position of the lens and the eyeglass frame, and information such as the movement and tilt of the user's head. The actual image-alignment distance refers to the shortest distance from the user's eye to the projected image after the eyeglass frame has deformed, such as... Figure 8 As shown, the actual image-merging distance is the length of H.

[0029] By monitoring and analyzing deformation data, the control device can dynamically adjust the parameters of the projected image, including adjusting the image size, position, and focus to accommodate different user head sizes.

[0030] In practical applications, such as Figure 7 As shown, Figure 7The left part of the image shows the image-aligning distance of the smart glasses before deformation, and the right part shows the image-aligning distance after deformation. Assuming the original image-aligning distance is 1 meter, when a user with a large head wears the smart glasses, the temples are compressed and expand outwards due to the user's large head size, causing deformation at the edges of the glasses frame. After deformation, assuming the image-aligning distance changes to 0.8 meters, the projected image appears magnified and closer to the user's eyes due to the shortened image-aligning distance. This results in the user not being able to see the complete projected image. Therefore, it is necessary to adjust the projected image based on the actual image-aligning distance of 0.8 meters to obtain the target projected image, making the image-aligning distance of the target projected image comparable to the preset distance. This compensates for the pixel offset of the smart glasses, optimizing the display effect and ensuring that the projected image is fully presented when adapting to users with either large or small head sizes.

[0031] This embodiment obtains the deformation data of the eyeglass frame, then determines the actual merging distance corresponding to the deformation data, thereby determining the corresponding target projection image. This ensures that the merging distance of the target projection image is within a preset merging distance, thereby achieving offset compensation for the pixels offset by the smart glasses, optimizing the display effect, and enabling the projection image to be fully presented when adapting to users with larger or smaller head sizes.

[0032] It should be understood that the deformation data includes the deformation angle, wherein the deformation angle of the eyeglass frame is the angle formed by the edge of the eyeglass frame along the center point of the frame before and after deformation.

[0033] Optionally, refer to Figure 2 Another embodiment of the present invention provides a control method for smart glasses, based on the above. Figure 1 In the embodiment shown, determining the corresponding actual coincidence distance based on the deformation data includes step S110, wherein: S110. Determine the actual image alignment distance based on the preset frame length, preset image alignment distance, and the deformation angle.

[0034] In this embodiment, the preset frame length is a fixed value, a theoretical length that will not change regardless of whether the frame deforms. The preset alignment distance is the ideal distance between the user's eyes and the projected image, set during the design phase to ensure the user receives the best visual experience. By combining these two preset values ​​with the actually measured deformation angle, and using the mathematical relationship between the preset frame length, preset alignment distance, and the deformation angle, the actual alignment distance can be quickly calculated. This ensures that the smart glasses provide a consistent visual effect for users with different head sizes.

[0035] Optionally, such as Figure 8As shown, the deformation angle is set to Then we have: ; In the formula, D1 represents the deformation displacement of the frame edge, and D2 represents half the length of the deformed eyeglass frame. Let the complementary angle of the deformation angle in the direction perpendicular to the center of the eyeglass frame be . Then we have: ; Since the angle between the optical engine and the waveguide plate is fixed, meaning that the angle between the horizontal plane of the lens frame and the image-combining distance of the projected image remains the same regardless of whether the deformation occurs, therefore...

[0036] ; Let the preset coincidence distance be A, then we have: ; In the formula, D4 is half the length of the eyeglass frame before deformation; Let the actual coincidence distance be H. At the vertex of the actual coincidence distance, draw an auxiliary line perpendicular to D2. Let the auxiliary line be F, and establish the following relationship based on the auxiliary line F: ; ; and ; From this we can obtain ; Solving for F using the above formula, we get: ; The actual image distance H is: ; By using the above formula for calculation, the actual image-merging distance H can be accurately obtained. This allows for better precise control of the smart glasses, ensuring a consistent visual experience for users with different head sizes.

[0037] Optionally, refer to Figure 3 Another embodiment of the present invention provides a control method for smart glasses, based on the above. Figure 1 In the embodiment shown, the method for obtaining the deformation angle specifically comprises steps S120-S130, wherein: S120. Obtain the deformation displacement of the edge of the eyeglass frame after deformation; S130. Determine the deformation angle based on the preset frame length and the deformation displacement.

[0038] In this embodiment, as Figure 8 As shown, deformation displacement refers to the offset position h of the eyeglass frame after deformation. By measuring the distance the frame edge moves relative to its original position, the deformation angle can be calculated, thus determining the actual alignment distance. Deformation displacement can be measured in various ways, such as using an IMU sensor to acquire angular velocity and acceleration, using a high-precision displacement sensor, or using image recognition technology to track the movement of the frame edge. Once the deformation displacement is determined, combined with the preset frame length, the deformation angle α can be calculated using trigonometric functions. In this way, the control device can monitor and respond to changes in the user's head size in real time, thereby adjusting the parameters of the projected image and more accurately and reliably determining the alignment distance, thus meeting the data requirements of subsequent adjustment processes.

[0039] It is important to understand that the eyeglasses frame has an IMU sensor on its edge.

[0040] Optionally, refer to Figure 4 Another embodiment of the present invention provides a control method for smart glasses, based on the above. Figure 1 In the embodiment shown, obtaining the deformation displacement of the edge of the eyeglass frame after deformation includes step S121, wherein: S121. Obtain the angular velocity and acceleration data of the edge of the frame using an IMU sensor, and determine the deformation distance corresponding to the angular velocity and acceleration data.

[0041] In this embodiment, the IMU sensor can monitor the motion state of the eyeglass frame edge in real time, including angular velocity and acceleration, thereby accurately calculating the deformation displacement. The use of the IMU sensor improves the accuracy and response speed of data acquisition. When a user wears the smart glasses, it can quickly determine whether there will be a loss of field of view after the user wears them, based on the user's head size, and thus quickly adjust the projected image to meet the viewing angle adjustment needs of users with larger head sizes, so that the smart glasses can present a complete projected image when worn by different users.

[0042] Optionally, refer to Figure 5 The present invention also provides a control method for smart glasses, based on the above. Figure 1 In the embodiment shown, determining the corresponding projected image based on the actual merging distance specifically comprises steps S210-S220, wherein: S210. Determine the pixel offset in at least one direction between the actual image merging distance and the preset image merging distance; S220. The image to be projected is offset by pixels in at least one direction according to the pixel offset, and the adjusted image to be projected is determined as the target projection image.

[0043] In this embodiment, the control device of the smart glasses can adjust the projected image in real time by calculating the pixel offset. Specifically, the control device calculates the number of pixels that need to be moved based on the difference between the actual and preset alignment distances. Then, the control device shifts the projected image horizontally or vertically to ensure the image maintains the correct proportions and position in the user's eyes. In this way, even with different head sizes, the smart glasses can provide a consistent visual experience, avoiding image distortion or incomplete field of view. Finally, the adjusted image is determined as the target projected image that the user will see, thus achieving precise control and a personalized visual experience for the smart glasses.

[0044] By adjusting the pixel positions of the image, smart glasses can adapt to the visual needs of different users. For example, when a user has a large head, the actual alignment distance H will be larger than the preset alignment distance. In this case, the control device will move the image downwards vertically and left and right horizontally based on the calculated pixel offset to ensure that the image is correctly positioned in the user's field of vision, and vice versa. In this way, smart glasses can adjust the image for different users, ensuring that everyone gets the best visual experience.

[0045] Optionally, the calculated pixel offset can be adjusted in at least one of the four directions: up, down, left, and right. Depending on the specific situation, adjustments can be made only in the up, down, left, and right directions, or a combination of several directions, to ensure that the projected image is fully displayed when adapting to users with large or small head sizes.

[0046] Optionally, refer to Figure 6 Another embodiment of the present invention provides a control method for smart glasses, based on the above. Figure 1 In the embodiment shown, the step of offsetting the image to be projected in at least one direction according to the pixel offset, and determining the adjusted image to be projected as the target projection image includes steps S221-S222, wherein: S221. Calculate the new pixel position of the image to be projected based on the pixel offset; S222. Adjust the size and pixel position of the image to be projected according to the new pixel position, and determine the adjusted image to be projected as the target projection image.

[0047] In this embodiment, the control device first determines the pixel positions of the image to be projected, and then recalculates the new position of each pixel in the image based on the calculated pixel offset, to ensure that each part of the image can be adjusted according to the correct proportions and positions. In this way, the size and pixel positions of the image can be precisely adjusted to accommodate users with different head sizes, so that the projected image can be fully presented.

[0048] The present invention also proposes a control device, the control device comprising: a memory, a processor, and a wearable device program stored in the memory and executable on the processor, the wearable device program being configured to implement the control method for smart glasses as described above.

[0049] It is worth noting that since the control device of the present invention is based on the control method of the above-mentioned smart glasses, the embodiments of the control device of the present invention include all the technical solutions of all embodiments of the control method of the above-mentioned smart glasses, and the technical effects achieved are exactly the same, so they will not be repeated here.

[0050] The present invention also proposes a smart glasses, which includes a control device as described in the above embodiments.

[0051] It is worth noting that since the smart glasses of the present invention are based on the above-mentioned control device, the embodiments of the smart glasses of the present invention include all the technical solutions of all the embodiments of the above-mentioned control device, and the technical effects achieved are exactly the same, so they will not be repeated here.

[0052] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.

[0053] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0054] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0055] The above are merely preferred embodiments of the present invention and do not limit the scope of the patent. Any equivalent structural or procedural transformations made based on the description and drawings of the present invention, or direct or indirect applications in other related technical fields, are similarly included within the scope of patent protection of the present invention.

Claims

1. A control method for smart glasses, characterized in that, The method includes: Obtain the deformation data of the eyeglass frame, and determine the corresponding actual image-matching distance based on the deformation data; Based on the actual image merging distance, a corresponding target projection image is determined so that the image merging distance of the corresponding target projection image is at a preset image merging distance.

2. The control method for smart glasses as described in claim 1, characterized in that, The deformation data includes deformation angles, wherein the deformation angle of the eyeglass frame is the angle formed by the edge of the eyeglass frame along the center point of the frame before and after deformation; Determining the corresponding actual alignment distance based on the deformation data includes: The actual image alignment distance is determined based on the preset frame length, the preset alignment distance, and the deformation angle.

3. The control method for smart glasses as described in claim 2, characterized in that, The method for obtaining the deformation angle is as follows: Obtain the deformation displacement of the edge of the eyeglass frame after deformation; The deformation angle is determined based on the preset frame length and the deformation displacement.

4. The control method for smart glasses as described in claim 3, characterized in that, An IMU sensor is provided on the edge of the eyeglass frame; The process of obtaining the deformation displacement of the edge of the eyeglass frame after deformation includes: The angular velocity and acceleration data of the edge of the frame are acquired using an IMU sensor, and the deformation distance corresponding to the angular velocity and acceleration data is determined.

5. The control method for smart glasses as described in claim 2, characterized in that, The specific process of determining the actual alignment distance based on the preset frame length, preset alignment distance, and the deformation angle is as follows: ； In the formula, H is the actual image combination distance. The angle between the horizontal plane of the mirror frame and the coincidence distance of the projected image is denoted as . D2 is the complementary angle of the deformation angle in the direction of the projected image, and D2 is half the length of the eyeglass frame.

6. The control method for smart glasses as described in any one of claims 1-5, characterized in that, The determination of the corresponding projected image based on the actual image combination distance specifically involves: Determine the pixel offset in at least one direction between the actual image alignment distance and the preset image alignment distance; The image to be projected is offset by pixels in at least one direction according to the pixel offset, and the adjusted image to be projected is determined as the target projection image.

7. The control method for smart glasses as described in claim 6, characterized in that, The step of offsetting the image to be projected in at least one direction according to the pixel offset, and determining the adjusted image to be projected as the target projection image, includes: Calculate the new pixel position of the image to be projected based on the pixel offset; The size and pixel position of the image to be projected are adjusted according to the new pixel position, and the adjusted image to be projected is determined as the target projection image.

8. The control method for smart glasses as described in claim 6, characterized in that, The direction includes at least one of the four directions: up, down, left, and right.

9. A control device, characterized in that, The control device includes: a memory, a processor, and a control program for smart glasses stored in the memory and executable on the processor, wherein the control program for smart glasses is configured to implement the control method for smart glasses as described in any one of claims 1 to 8.

10. A type of smart glasses, characterized in that, Includes the control device as described in claim 9.

Images