Method, apparatus and device for maintaining near-eye display device

Abstract

The application relates to the technical field of equipment maintenance, and provides a maintenance method, device and equipment for a near-eye display device, the method comprising the following steps: acquiring a target image obtained by shooting a lens of the near-eye display device; determining a deformation degree of the lens according to the target image; and performing maintenance on the near-eye display device according to the deformation degree of the lens, so as to improve the convenience degree of maintaining the face shape of the lens of the near-eye display device, thereby improving the display effect of the near-eye display device.

Description

Technical Field

[0001] This application relates to the field of equipment maintenance technology, and in particular to a maintenance method, apparatus and equipment for near-eye display devices. Background Technology

[0002] Currently, near-eye display devices can be used in daily life. During use, these devices can move with the user into different environments. However, changes in the environment can negatively affect the lens shape of the near-eye display device, leading to poor display performance. Summary of the Invention

[0003] The main objective of this application is to provide a method, apparatus, and device for maintaining a near-eye display device, which aims to improve the ease of maintaining the surface shape of the lens of the near-eye display device, thereby improving the display effect of the near-eye display device.

[0004] In a first aspect, this application provides a maintenance method for a near-eye display device, applied to a maintenance device for a near-eye display device, the maintenance method comprising the following steps:

[0005] Acquire a target image obtained by capturing a lens of the near-eye display device;

[0006] Based on the target image, determine the degree of deformation of the lens;

[0007] The near-eye display device is maintained according to the degree of deformation of the lens.

[0008] Secondly, this application also provides a maintenance device for a near-eye display device, the maintenance device comprising:

[0009] The acquisition module is used to acquire target images obtained by capturing images of the lenses of near-eye display devices;

[0010] A deformation determination module is used to determine the degree of deformation of the lens based on the target image;

[0011] The maintenance module is used to maintain the near-eye display device according to the degree of deformation of the lens.

[0012] Thirdly, this application also provides a maintenance device for a near-eye display device, the maintenance device including a memory and a processor;

[0013] The memory is used to store computer programs;

[0014] The processor is configured to execute the computer program and, in executing the computer program, implement the maintenance method for the near-eye display device as described above.

[0015] This application provides a maintenance method, apparatus, and device for a near-eye display device. The maintenance method includes: acquiring a target image obtained by photographing the lens of the near-eye display device; determining the degree of lens deformation based on the target image; and maintaining the near-eye display device according to the degree of lens deformation. When the maintenance device acquires the target image obtained by photographing the lens of the near-eye display device, the maintenance device can determine whether the surface shape of the lens has been deformed based on the target image, such as determining whether the degree of lens deformation is greater than or equal to a preset deformation threshold. Based on this, the maintenance device can maintain the near-eye display device according to the degree of lens deformation, which improves the convenience of maintaining the surface shape of the lens of the near-eye display device and thus improves the display effect of the near-eye display device. Attached Figure Description

[0016] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0017] Figure 1 This is a flowchart illustrating a maintenance method for a near-eye display device provided in an embodiment of this application;

[0018] Figure 2 This is an application scenario diagram of a maintenance method for a near-eye display device according to an embodiment of this application;

[0019] Figure 3 This is an application scenario diagram of a maintenance method for a near-eye display device according to another embodiment of this application;

[0020] Figure 4 This is a schematic block diagram of a maintenance device for a near-eye display device provided in an embodiment of this application;

[0021] Figure 5 This is a schematic block diagram of the structure of a near-eye display device provided in an embodiment of this application. Detailed Implementation

[0022] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0023] The flowchart shown in the attached diagram is for illustrative purposes only and does not necessarily include all content and operations / steps, nor does it necessarily have to be performed in the order described. For example, some operations / steps can be broken down, combined, or partially merged, so the actual execution order may change depending on the actual situation.

[0024] This application provides a method, apparatus, and device for maintaining a near-eye display device. The maintenance method for the near-eye display device can be applied to a maintenance device for a near-eye display device.

[0025] For example, the maintenance device for a near-eye display device may have at least one of maintenance function and storage function.

[0026] In some implementations, the maintenance device for the near-eye display device may include a storage case for the near-eye display device. For example, when the near-eye display device is AR glasses or VR glasses, the maintenance device may be the individual glasses case for the AR glasses or VR glasses, without limitation. For instance, when the near-eye display device is stored in its storage case, the storage case can be used for maintenance of the near-eye display device.

[0027] For example, near-eye display devices may include VR glasses, AR glasses, VR headsets, AR headsets, etc., without limitation. The lenses of the near-eye display device may be lenses for AR glasses, VR glasses, AR headsets, VR headsets, etc., without limitation. The lenses of the near-eye display device can serve as the display screen for the near-eye display device, displaying corresponding content.

[0028] In some implementations, the lens material of the near-eye display device may include a deformable material. For example, the lens material may include resin, and this is not a limitation.

[0029] Taking AR glasses as an example, the optical unit of AR glasses typically consists of two parts: an optical engine and an optical combiner. The optical engine can also be called a light engine. It can include an image source and a projection lens. The image source generates the image to be displayed. The projection lens projects the image to infinity or a specified location. The optical combiner directs the signal light emitted from the optical engine to the user's eyes, forming the image on the user's retina. The optical combiner is transparent to ambient light. When ambient light passes through the optical combiner, the user can clearly see their surroundings, such as real-world objects. Therefore, when using AR glasses, the user can simultaneously see both their surroundings and the image projected by the optical engine. Resin diffractive waveguides are a preferred choice for optical combiners due to their high reliability, light weight, and good light transmittance. However, resin is hygroscopic. For example, in humid environments, resin can absorb moisture, affecting the surface shape or optical properties of the resin waveguide. Furthermore, resin is flexible. For example, resin materials are prone to deformation during use due to external forces, air pressure, or temperature, which can affect the surface shape or optical properties of the resin waveguide. This can negatively impact the display performance of AR glasses.

[0030] Based on this, when the lens material of the near-eye display device includes a deformable material, the surface shape of the lens of the near-eye display device can be maintained by the maintenance method of the near-eye display device provided in the embodiments of this application, thereby improving the convenience of maintaining the surface shape of the lens of the near-eye display device and improving the display effect of the near-eye display device.

[0031] The following detailed description of some embodiments of this application is provided in conjunction with the accompanying drawings. Unless otherwise specified, the following embodiments and features can be combined with each other.

[0032] Please see Figure 1 , Figure 1 This is a schematic flowchart illustrating a maintenance method for a near-eye display device according to an embodiment of this application. It should be noted that the maintenance method for a near-eye display device provided in this embodiment can be used for maintenance equipment of near-eye display devices.

[0033] like Figure 1 As shown, the maintenance method for the near-eye display device includes steps S101 to S103.

[0034] S101. Acquire the target image obtained by photographing the lens of the near-eye display device.

[0035] In some implementations, when the user does not need to use the near-eye display device temporarily, the near-eye display device can be maintained using a maintenance device for the near-eye display device.

[0036] For example, maintenance equipment for near-eye display devices may have an imaging function. For instance, the maintenance equipment may include an image sensor. The equipment can use the image sensor to capture an image of the lens of the near-eye display device, obtaining a target image. This acquired image can then be used to determine the degree of lens deformation, thereby determining whether maintenance is necessary for the near-eye display device.

[0037] Taking a storage box for a near-eye display device as an example, when the storage box detects a near-eye display device stored within its preset location range, it can perform lens surface type detection on that device to determine whether maintenance is required. For instance, the storage box can control an image sensor within it to capture an image of the near-eye display device's lens, obtaining the target image. Of course, maintenance devices are not limited to storage boxes for near-eye display devices, and this is not a specific limitation here.

[0038] For example, the maintenance device can capture images of the lenses of the near-eye display device in different ways, based on the optical characteristics of the lenses. For instance, it can capture images of the lenses by utilizing either the refraction or reflection of light by the lenses.

[0039] In some implementations, the lenses of near-eye display devices may be relatively thin. If the maintenance equipment directly photographs the lenses of the near-eye display device to obtain a target image, the thinness of the lens means that, even with minimal changes in its surface shape, the degree of lens deformation may exceed or equal a preset deformation threshold, resulting in poor display performance. Furthermore, because the thinness of the lens makes it impossible to directly determine the surface shape changes based on the target image, it may prevent the near-eye display device from being maintained. Therefore, a method combining light refraction and reflection by the lens, along with a preset surface shape detection image, can be used to assist the maintenance equipment in photographing the lenses of the near-eye display device to obtain a target image for subsequent maintenance.

[0040] For example, the preset face shape detection image can include patterns such as dot patterns, grid patterns, and stripe patterns. For instance, the preset face shape detection image can be obtained by periodically arranging any one of these patterns. However, it is not limited to this; for example, the preset face shape detection image can include random patterns. Random patterns can include speckle patterns, etc., and are not limited here.

[0041] In some implementations, the display of the near-eye display device is controlled to display a preset facial shape detection image; the facial shape detection image displayed on the lens is captured by the image sensor of the maintenance device to obtain the target image.

[0042] like Figure 2 As shown, when the maintenance equipment detects that the near-eye display device is within a preset position range, the maintenance equipment can establish a communication connection with the near-eye display device. Based on this communication connection, the maintenance equipment can send a preset face shape detection image to the near-eye display device and control the display of the near-eye display device to display the preset face shape detection image. When the display of the near-eye display device displays the preset face shape detection image, the lens included in the display will also display the preset face shape detection image accordingly. Based on this, the image sensor in the maintenance equipment can capture an image of the lens of the near-eye display device displaying the preset face shape detection image, thereby obtaining a target image.

[0043] For example, the pattern included in the preset surface shape detection image can serve as feature points. The display position of these feature points on the lens will change, for instance, before and after the lens surface shape is deformed. Based on this, the changes in the lens surface shape can be identified using the target image to determine the degree of lens deformation, thereby enabling maintenance of the near-eye display device.

[0044] In this way, when the maintenance equipment captures and displays a lens with a preset surface detection image to obtain the target image, the subsequent maintenance equipment can determine the changes in the display position of the corresponding feature points in the surface detection image on the lens based on the target image, so as to maintain the near-eye display device. This helps to improve the convenience of maintaining the surface of the lens of the near-eye display device, thereby improving the display effect of the near-eye display device.

[0045] In some implementations, a preset face shape detection image is projected onto the lens of the near-eye display device by the image generator of the maintenance device; the target image is obtained by capturing the lens by the image sensor of the maintenance device.

[0046] For example, maintenance equipment may have projection capabilities. For instance, the maintenance equipment may include an image generator. The image generator may include a projector or a projection device. The projection device may include, but is not limited to, devices that project images using a diffuser or a diffractive optical element (DOE).

[0047] like Figure 3 As shown, when the maintenance equipment detects that the near-eye display device is within a preset position range, the maintenance equipment can project a preset surface detection image onto the lens of the near-eye display device through an image generator. Then, the image sensor of the maintenance equipment can receive the surface detection image reflected by the lens surface and obtain the target image.

[0048] For example, the pattern included in the preset surface shape detection image can serve as feature points. Before and after the lens surface shape is deformed, the projection positions of these feature points on the lens will change. Based on this, the surface shape changes of the lens can be identified using the target image to determine the degree of lens deformation, thereby enabling maintenance of the near-eye display device.

[0049] In this way, when the maintenance equipment captures and displays the target image of the lens with the preset surface detection image, the subsequent maintenance equipment can determine the changes in the projection position of the corresponding feature points in the surface detection image on the lens based on the target image, and perform maintenance on the near-eye display device. This helps to improve the convenience of maintaining the surface of the lens of the near-eye display device, thereby improving the display effect of the near-eye display device.

[0050] S102. Determine the degree of lens deformation based on the target image.

[0051] For example, since the target image can be obtained by the maintenance equipment through an image sensor capturing a lens of a near-eye display device displaying a preset face shape detection image, or by the maintenance equipment through an image sensor capturing a lens of a near-eye display device projecting a preset face shape detection image, if the preset face shape detection image includes a corresponding pattern, the target image can also include a corresponding pattern.

[0052] Based on this, the corresponding patterns included in the preset surface shape detection image can be used as feature points to determine the degree of lens deformation. For example, the display position of the same pattern before and after the lens surface shape is deformed may be different, and the projection position of the same pattern before and after the lens surface shape is deformed may also be different. Therefore, the degree of lens deformation can be determined based on the change in the display position or projection position of the same pattern before and after the lens surface shape is deformed. That is, the degree of lens deformation can be determined based on the change in the display position or projection position of the same feature point before and after the lens surface shape is deformed.

[0053] For example, based on the target image, a first position of the feature point on the target image is determined; based on the first position of the feature point on the target image and a second position of the feature point on a preset surface detection image, the degree of lens deformation is determined.

[0054] In some implementations, upon acquiring a target image, the maintenance device can detect the positions of feature points in the target image to determine a first position of the feature points on the target image. Correspondingly, the maintenance device can acquire a second position of the feature points on a preset surface detection image. Since there is a one-to-one correspondence between the feature points in the target image and the feature points in the preset surface detection image, the first position of the feature points on the target image and the second position of the feature points on the preset surface detection image can be compared to determine whether the positions of the feature points have changed, thereby determining the degree of lens deformation.

[0055] For example, a preset position detection algorithm can be used to analyze and process the target image to obtain the first position of the feature point on the target image. Of course, it is not limited to this, and no limitation is made here.

[0056] For example, the second position of the feature point on the preset face shape detection image can be determined based on an image obtained by the maintenance device of the lens when the face shape of the lens of the near-eye display device is not distorted. Depending on the method of acquiring the target image, the second position of the feature point on the preset face shape detection image can also be different. For example, if the target image is obtained by an image sensor capturing the lens of the near-eye display device displaying the preset face shape detection image, the second position of the feature point on the preset face shape detection image can be determined based on an image obtained by the maintenance device of the lens of the near-eye display device displaying the preset face shape detection image and with an undistorted face shape. As another example, if the target image is obtained by an image sensor capturing the lens of the near-eye display device projecting the preset face shape detection image, the second position of the feature point on the preset face shape detection image can be determined based on an image obtained by the maintenance device of the lens of the near-eye display device projecting the preset face shape detection image and with an undistorted face shape. Of course, this is not limited to these methods; the second position of the feature point on the preset face shape detection image can also be pre-stored in the maintenance device, without limitation.

[0057] Thus, based on the first position of the feature point on the target image and the second position of the feature point on the preset surface detection image, the positional difference of the feature point before and after the surface change of the lens can be determined, such as the display position difference or the projection position difference, so as to determine the degree of lens deformation, which helps to improve the convenience and flexibility of determining the degree of lens deformation.

[0058] For example, the maintenance device can set a corresponding threshold for the degree of lens deformation, such as a preset deformation threshold, to evaluate the impact of lens deformation on the display effect of the near-eye display device. For instance, when the lens deformation is greater than or equal to the preset deformation threshold, the display effect of the near-eye display device will decrease, requiring maintenance. When the lens deformation is less than the preset deformation threshold, the display effect of the near-eye display device remains unchanged or changes only slightly, temporarily eliminating the need for maintenance. The preset deformation threshold can be pre-set or user-defined; no restriction is placed here.

[0059] In some implementations, when the positional difference between the first and second positions of at least one feature point is greater than or equal to a first positional difference threshold, the degree of deformation of the lens is determined to be greater than or equal to a preset deformation threshold.

[0060] For example, when comparing the positional difference between the first and second positions of a feature point, the maintenance device can set a corresponding threshold for the positional difference, such as a first positional difference threshold. This first positional difference threshold allows the maintenance device to determine whether the positional difference corresponding to the feature point will cause a decrease in the display effect of the near-eye display device, thus determining whether maintenance is required.

[0061] Taking an example where the maintenance equipment determines the first positions of multiple feature points on a target image and the second positions of multiple feature points on a preset surface detection image, if the maintenance equipment detects that the position difference between the first and second positions of at least one feature point is greater than or equal to a first position difference threshold, then the corresponding position of that feature point on the lens has been deformed, and this deformation can lead to a decrease in the display effect of the near-eye display device. Based on this, it can be determined that the degree of lens deformation is greater than or equal to a preset deformation threshold, which is equivalent to determining that the surface of the lens has been severely deformed and requires surface repair. The maintenance equipment can then perform maintenance on the lens of the near-eye display device.

[0062] In some implementations, when the position difference between the first and second positions of a feature point is greater than or equal to a second position difference threshold, and the number of feature points with a position difference greater than or equal to the second position difference threshold is greater than or equal to a preset number threshold, the degree of lens deformation is determined to be greater than or equal to a preset deformation threshold; the second position difference threshold is less than the first position difference threshold.

[0063] For example, when comparing the positional difference between the first and second positions of a feature point, the maintenance device can set a corresponding threshold for the positional difference between the first and second positions of the feature point, such as a second positional difference threshold. The second positional difference threshold is less than the first positional difference threshold. This second positional difference threshold allows the maintenance device to determine whether the positional difference corresponding to the feature point will affect the display effect of the near-eye display device, thereby determining whether maintenance is required.

[0064] Taking an example where a maintenance device determines the first position of multiple feature points on a target image and the second position of each feature point on a preset surface detection image, if the maintenance device detects that the positional difference between the first and second positions of a feature point is greater than or equal to a second positional difference threshold, then the corresponding position of that feature point on the lens may have undergone deformation. This deformation may not necessarily lead to a decrease in the display effect of the near-eye display device. Based on this, to improve the accuracy of maintenance of the near-eye display device, the maintenance device can further calculate the cumulative amount of deformation and, in conjunction with this cumulative amount, determine whether the positional differences corresponding to the feature points affect the display effect of the near-eye display device, thus deciding whether maintenance is necessary. For example, the maintenance device can set a preset quantity threshold. This preset quantity threshold can be used to evaluate the cumulative amount of positional differences corresponding to feature points. Accordingly, the maintenance device can further calculate the number of feature points with positional differences greater than or equal to the second positional difference threshold. For instance, when the maintenance device detects that the number of feature points with positional differences greater than or equal to the second positional difference threshold is greater than or equal to the preset quantity threshold, it can determine that the cumulative amount of deformation may lead to a decrease in the display effect of the near-eye display device. Based on this, it can be determined that the degree of lens deformation is greater than or equal to the preset deformation threshold, which is equivalent to determining that the surface shape of the lens has been severely deformed and needs to be repaired. Then, the subsequent maintenance equipment can maintain the lens of the near-eye display device.

[0065] Once the lens deformation is determined to be greater than or equal to a preset deformation threshold, the maintenance device can automatically perform maintenance on the near-eye display. For example, the maintenance device can repair the lens surface shape. Of course, it is not limited to this, and no restrictions are imposed here.

[0066] Thus, by determining whether the positional difference between the first and second positions of a feature point is greater than or equal to a first positional difference threshold, or whether the positional difference between the first and second positions of a feature point is greater than or equal to a second positional difference threshold, and whether the number of feature points with positional differences greater than or equal to the second positional difference threshold is greater than or equal to a preset number threshold, it is possible to determine whether the surface shape of the lens has undergone severe deformation. This improves the convenience and flexibility of judging the degree of lens deformation. Based on the determination of the degree of lens deformation, subsequent maintenance of near-eye display devices can be performed.

[0067] Of course, the methods for determining the degree of lens deformation based on the target image are not limited to this.

[0068] In other embodiments, the maintenance equipment can determine the current surface profile information of the lens based on the target image; and determine the degree of lens deformation based on the comparison result between the current surface profile information and the preset surface profile information.

[0069] For example, upon acquiring a target image, the maintenance device can perform image recognition processing on the target image to determine the current surface profile information of the lens. For instance, the surface profile information may include the surface height of the lens. The maintenance device can analyze and process the target image according to a preset surface height detection algorithm to obtain the current surface height of the lens. As another example, the surface profile information may include the outline of the lens. The maintenance device can identify the lens in the target image according to a preset edge detection algorithm to obtain the current outline of the lens. No further limitations are imposed here.

[0070] For example, the preset surface profile information could be the surface profile information of the lens when it is not deformed. The maintenance device, for example, pre-stores an initial image of the lens of the near-eye display device when it is not deformed, and then the maintenance device determines the initial surface profile information of the lens based on the initial image.

[0071] For example, the current surface profile information of a lens can be compared with its initial surface profile information, such as determining the lens's profile offset based on its current contour and its contour before deformation. Similarly, the change in lens surface height can be determined based on the lens's current surface height and its surface height before deformation. No limitations are imposed here.

[0072] In one exemplary embodiment, the maintenance device can determine whether the lens contour offset is greater than or equal to a preset offset threshold, and / or determine whether the lens surface height change is greater than or equal to a preset change threshold. If at least one of the following conditions is met: the lens contour offset is greater than or equal to a preset offset threshold, or the lens surface height change is greater than or equal to a preset change threshold, it can be determined that the lens deformation degree is greater than or equal to a preset deformation threshold. The preset offset threshold and preset change threshold can be preset or user-defined, and are not limited herein.

[0073] Once the lens deformation is determined to be greater than or equal to a preset deformation threshold, the maintenance device can automatically perform maintenance on the near-eye display. For example, the maintenance device can repair the lens surface shape. Of course, it is not limited to this, and no restrictions are imposed here.

[0074] Thus, based on the acquisition of the target image, the degree of lens deformation can be determined in different ways, which improves the convenience and flexibility of determining the lens deformation degree. Based on the determination of the lens deformation degree, the maintenance equipment can determine whether the lens needs maintenance, so as to facilitate subsequent maintenance of the near-eye display device, which improves the convenience of lens maintenance for near-eye display devices and thus improves the display effect of near-eye display devices.

[0075] S103. Maintain the near-eye display device according to the degree of lens deformation.

[0076] In some embodiments, maintenance of the near-eye display device includes at least one of the following: heating the near-eye display device using a heating unit of the maintenance device; dehumidifying the near-eye display device using a dehumidifying unit of the maintenance device; simultaneously heating and dehumidifying the near-eye display device by activating both the heating unit and the dehumidifying unit of the maintenance device; and alternately heating and dehumidifying the near-eye display device by alternately activating both the heating unit and the dehumidifying unit of the maintenance device.

[0077] For example, when the lens of a near-eye display device absorbs excessive moisture from the environment, causing the lens deformation to exceed or equal to a preset deformation threshold, the maintenance device can heat the near-eye display device using a heating unit. Heating the near-eye display device accelerates the evaporation of moisture within the lens. If the lens material is resin, the thermoplasticity of the resin can be used to reshape the lens surface, thereby repairing the lens shape. In an exemplary embodiment, to ensure the safety and reliability of maintaining the near-eye display device, the maintenance device can adjust the heating temperature of the near-eye display device within a preset heating range during maintenance using the heating unit. The preset heating range can be from 30°C to 80°C, and is not limited thereto.

[0078] For example, when the lenses of a near-eye display absorb excessive moisture from the environment, causing lens deformation to exceed or equal a preset deformation threshold, the maintenance equipment can dehumidify the near-eye display using a dehumidification unit. By dehumidifying the near-eye display, the humidity of the display can be reduced, decreasing the amount of water absorbed by the lenses and thus restoring the lens shape.

[0079] For example, during the lens reshaping process, the maintenance equipment can simultaneously activate its heating and dehumidification units to simultaneously heat and dehumidify the near-eye display device. Correspondingly, the maintenance equipment can also alternately activate its heating and dehumidification units to alternately heat and dehumidify the near-eye display device. For instance, the near-eye display device can be heated for 30 minutes using the heating unit, followed by dehumidification for 10 minutes using the dehumidification unit, and so on. Of course, this is not a limitation and is not specified here.

[0080] Thus, by maintaining the near-eye display device through at least one of the heating unit and dehumidification unit, the convenience and flexibility of maintaining the surface shape of the lens of the near-eye display device can be improved, thereby enhancing the display effect of the near-eye display device.

[0081] For example, the maintenance method for near-eye display devices can be determined based on the degree of lens deformation.

[0082] In some embodiments, the maintenance function of the maintenance device for the near-eye display device may include at least one of a charging function and a facial contouring function. However, this is not a limitation and is not intended to be restrictive. Therefore, depending on the degree of lens deformation, at least one of the charging function and the facial contouring function of the maintenance device can be selected to maintain the near-eye display device.

[0083] For example, when the lens deformation is greater than or equal to a preset deformation threshold, the maintenance device can repair the surface shape of the lens in the near-eye display device. However, it's not limited to this; for instance, when the lens deformation is greater than or equal to the preset deformation threshold, the maintenance device can also charge the near-eye display device. The maintenance device can charge the near-eye display device via wired or wireless means, without limitation.

[0084] For example, when the deformation of the lens is less than a preset deformation threshold, the maintenance device may temporarily refrain from repairing the surface shape of the lens of the near-eye display device, and the maintenance device can then charge the near-eye display device. Charging the near-eye display device can be done wirelessly or via a wired connection, for example; there are no restrictions on this.

[0085] In other embodiments, since the maintenance device is equipped with different maintenance units, such as heating units and dehumidification units, to repair the surface shape of the lens, the maintenance device can select the appropriate maintenance unit based on the degree of lens deformation to maintain the near-eye display device. For example, when the degree of lens deformation is greater than or equal to a target deformation threshold, the maintenance device maintains the near-eye display device using either the heating unit or the dehumidification unit. When the degree of lens deformation is greater than or equal to a preset deformation threshold, but less than the target deformation threshold, the maintenance device maintains the near-eye display device using both the heating unit and the dehumidification unit. Here, the target deformation threshold is greater than the preset deformation threshold. However, this is not a limitation and is not specified herein.

[0086] Therefore, by determining the maintenance method for near-eye display devices based on the degree of lens deformation, it is beneficial to improve the flexibility and convenience of maintaining the surface shape of the lenses of near-eye display devices, thereby improving the display effect of near-eye display devices.

[0087] For example, the operating parameters of at least one of the heating unit and the dehumidification unit can be determined based on the degree of lens deformation.

[0088] For example, when the lens deformation is greater than or equal to a target deformation threshold, the maintenance equipment can increase the current operating parameter of at least one of the heating unit and dehumidification unit to determine the operating parameter of at least one of the heating unit and dehumidification unit. When the lens deformation is greater than or equal to a preset deformation threshold but less than a target deformation threshold, the maintenance equipment can decrease the current operating parameter of at least one of the heating unit and dehumidification unit to determine the operating parameter of at least one of the heating unit and dehumidification unit. Of course, this is not a limitation and is not set forth herein.

[0089] In this way, based on the adjustment of operating parameters, the maintenance equipment can adopt appropriate operating parameters according to the degree of lens deformation to repair the lens surface shape, thereby saving repair resources and improving the repair efficiency.

[0090] In some implementations, a maintenance instruction for a near-eye display device is received from a target terminal device; the target terminal device includes a device that has established a communication connection with the maintenance device; and maintenance is performed on the near-eye display device according to the maintenance instruction.

[0091] For example, the maintenance device may have communication capabilities. For instance, the maintenance device can establish a communication connection with the target terminal device via Bluetooth or Wi-Fi, etc. The target terminal device can be a user's terminal device such as a mobile phone, tablet, laptop, television, etc., without limitation. When the user places the near-eye display device within the preset location range of the maintenance device, the maintenance device can perform maintenance on the near-eye display device automatically, or it can perform maintenance on the near-eye display device according to the user's instructions.

[0092] For example, when maintenance equipment needs to perform maintenance on a near-eye display device according to user instructions, the maintenance equipment can receive maintenance instructions from the target terminal device. These instructions might include whether to start charging the near-eye display device, whether to perform timed charging, whether to inspect the lens shape, whether to repair the lens shape, how to set operating parameters for at least one of the heating and dehumidifying units, etc., without limitation. Based on this, the maintenance equipment can perform maintenance on the near-eye display device according to the received instructions.

[0093] In some implementations, the maintenance device can also send information to the target terminal device based on the communication connection between the maintenance device and the target terminal device. For example, the maintenance device can send information such as the charging status of the near-eye display device, the surface type information of the lens, the degree of lens deformation, and lens repair information to the target terminal device, so that the user can view the maintenance progress of the near-eye display device through the target terminal device. Of course, this is not the only possible approach, and no limitation is made here.

[0094] Thus, through the communication connection between the maintenance equipment and the target terminal equipment, users can view or control the maintenance process of the near-eye display device through the target terminal equipment, which helps to improve the ease of control over the maintenance equipment and thus enhances the user experience of the maintenance equipment.

[0095] The maintenance method for a near-eye display device provided in the above embodiments includes: acquiring a target image obtained by photographing the lens of the near-eye display device; determining the degree of lens deformation based on the target image; and maintaining the near-eye display device based on the degree of lens deformation, thereby improving the convenience of maintaining the surface shape of the lens of the near-eye display device and thus improving the display effect of the near-eye display device.

[0096] Please see Figure 4 , Figure 4 This is a schematic block diagram of a maintenance device for a near-eye display device provided in an embodiment of this application. This maintenance device can be configured in a server or a maintenance device for a near-eye display device, and is used to perform the aforementioned maintenance method for the near-eye display device.

[0097] like Figure 4 As shown, the maintenance device for the near-eye display device includes: an acquisition module 110, an information determination module 120, a deformation determination module 130, and a maintenance module 140.

[0098] The acquisition module 110 is used to acquire the target image obtained by capturing the lens of the near-eye display device.

[0099] The deformation determination module 120 is used to determine the degree of deformation of the lens based on the target image.

[0100] The maintenance module 130 is used to maintain the near-eye display device according to the degree of deformation of the lens.

[0101] For example, the acquisition module 110 includes a display submodule and a first shooting submodule.

[0102] The display submodule is used to control the display of the near-eye display device to display a preset face shape detection image.

[0103] The first imaging submodule is used to capture the surface detection image displayed on the lens through the image sensor of the maintenance device to obtain the target image.

[0104] For example, the acquisition module 110 includes a projection submodule and a second shooting submodule.

[0105] The projection submodule is used to project a preset surface detection image onto the lens of the near-eye display device through the image generator of the maintenance device.

[0106] The second imaging submodule is used to capture images of the lens using the image sensor of the maintenance equipment to obtain a target image.

[0107] For example, maintenance module 130 includes a first maintenance submodule, a second maintenance submodule, a third maintenance submodule, and a fourth maintenance submodule.

[0108] The first maintenance submodule is used to heat the near-eye display device through the heating unit of the maintenance equipment.

[0109] The second maintenance submodule is used to dehumidify the near-eye display device through the dehumidification unit of the maintenance equipment.

[0110] The third maintenance submodule is used to simultaneously heat and dehumidify the near-eye display device by activating the heating unit and dehumidification unit of the maintenance equipment.

[0111] The fourth maintenance submodule is used to alternately heat and dehumidify the near-eye display device by alternately activating the heating unit and dehumidification unit of the maintenance equipment.

[0112] For example, maintenance device 130 includes a fifth maintenance submodule.

[0113] The fifth maintenance submodule is used to determine the maintenance method for maintaining the near-eye display device based on the degree of deformation of the lens, and / or to determine the operating parameters of at least one of the heating unit and the dehumidification unit.

[0114] For example, the deformation determination module 120 includes a first information determination submodule and a second information determination submodule.

[0115] The first information determination submodule is used to determine the first position of the feature point on the target image based on the target image.

[0116] The second information determination submodule is used to determine the degree of deformation of the lens based on the first position of the feature point on the target image and the second position of the feature point on a preset surface detection image.

[0117] For example, the deformation determination module 120 includes a first deformation determination submodule and a second deformation determination submodule.

[0118] The first deformation determination submodule is used to determine that the degree of deformation of the lens is greater than or equal to a preset deformation threshold when the position difference between the first position and the second position of at least one feature point is greater than or equal to a first position difference threshold.

[0119] The second deformation determination submodule is used to determine that the degree of deformation of the lens is greater than or equal to a preset deformation threshold when the position difference between the first and second positions of the feature points is greater than or equal to a second position difference threshold, and the number of feature points with position differences greater than or equal to the second position difference threshold is greater than or equal to a preset number threshold; the second position difference threshold is less than the first position difference threshold.

[0120] The maintenance device 130 also includes a sixth maintenance submodule.

[0121] The sixth maintenance submodule is used to maintain the near-eye display device when the deformation of the lens is greater than or equal to a preset deformation threshold.

[0122] For example, the maintenance device 130 further includes an instruction receiving submodule and a seventh maintenance submodule.

[0123] The instruction receiving submodule is used to receive maintenance instructions from the target terminal device for the near-eye display device; the target terminal device includes a device that has established a communication connection with the maintenance device.

[0124] The seventh maintenance submodule is used to perform maintenance on the near-eye display device according to the maintenance instructions.

[0125] It should be noted that those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the above-described apparatus and its modules and units can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0126] The method of this application can be used in a wide variety of general-purpose or special-purpose computer system environments or configurations. Examples include: personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronics devices, network PCs, minicomputers, mainframe computers, and distributed computing environments including any of the above systems or devices. This application can be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc., that perform specific tasks or implement specific abstract data types. This application can also be practiced in distributed computing environments where tasks are performed by remote processing devices connected via a communication network. In distributed computing environments, program modules can reside in local and remote computer storage media, including storage devices.

[0127] For example, the above-described method and apparatus can be implemented as a computer program that can run on a maintenance device for a near-eye display device. For example, the maintenance device for a near-eye display device may include a storage box for the near-eye display device, without limitation herein.

[0128] Please see Figure 5 , Figure 5 This is a schematic block diagram of the structure of a maintenance device for a near-eye display device provided in an embodiment of this application.

[0129] like Figure 5 As shown, the maintenance equipment of this near-eye display device includes a memory and a processor. The memory and processor can be connected via a system bus, and the memory may include a storage medium and internal memory.

[0130] The storage medium can store the operating system and computer programs. When the computer program is executed, it enables the processor to perform any maintenance method for the near-eye display device.

[0131] The processor provides computing and control capabilities to support the operation of the entire maintenance equipment.

[0132] The internal memory provides an environment for the execution of computer programs stored in the storage medium. When the computer program is executed by the processor, it enables the processor to perform any maintenance method for near-eye display devices.

[0133] Those skilled in the art will understand that Figure 5 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the maintenance device of the near-eye display device to which the present application is applied. The maintenance device of a specific near-eye display device may include more or fewer components than shown in the figure, or combine certain components, or have different component arrangements.

[0134] It should be understood that a processor can be a Central Processing Unit (CPU), but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other convertible logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among these, a general-purpose processor can be a microprocessor or any conventional processor.

[0135] In one embodiment, the processor is configured to execute a computer program and, when executing the computer program, perform the following steps:

[0136] Acquire a target image obtained by capturing a lens of the near-eye display device;

[0137] Based on the target image, determine the degree of deformation of the lens;

[0138] The near-eye display device is maintained according to the degree of deformation of the lens.

[0139] It should be noted that those skilled in the art will understand that, for the sake of convenience and brevity, the specific work process for maintaining near-eye display devices described above can be referred to the corresponding process in the aforementioned embodiments of the maintenance method for near-eye display devices, and will not be repeated here.

[0140] This application also provides a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, the method implemented can be referred to in various embodiments of the maintenance method for near-eye display devices of this application.

[0141] The computer-readable storage medium can be an internal storage unit of the maintenance device for the near-eye display device described in the foregoing embodiments, such as a hard disk or memory of the maintenance device. Alternatively, the computer-readable storage medium can be an external storage device of the maintenance device, such as a plug-in hard disk, Smart Media Card (SMC), Secure Digital (SD) card, or Flash Card equipped on the maintenance device.

[0142] It should be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the scope of the application. As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms unless the context clearly indicates otherwise.

[0143] It should also be understood that the term "and / or" as used in this specification and the appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes such combinations. It should be noted that, herein, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.

[0144] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments. The above descriptions are merely specific implementations of this application, but the scope of protection of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A maintenance method for a near-eye display device, characterized in that, A maintenance device for near-eye display devices, wherein the maintenance method includes: Acquire a target image obtained by capturing a lens of the near-eye display device; Based on the target image, determine the degree of deformation of the lens; The near-eye display device is maintained according to the degree of deformation of the lens; The step of acquiring the target image obtained by capturing the lens of the near-eye display device includes: The display of the near-eye display device is controlled to display a preset facial shape detection image; The target image is obtained by capturing the surface shape detection image displayed on the lens using the image sensor of the maintenance device; or... The image generator of the maintenance device projects a preset face shape detection image onto the lens of the near-eye display device; The image sensor of the maintenance device captures the lens to obtain a target image; the surface detection image includes any one of dot matrix pattern, grid pattern, stripe pattern, and random pattern.

2. The maintenance method according to claim 1, characterized in that, The maintenance of the near-eye display device includes at least one of the following: The near-eye display device is heated by the heating unit of the maintenance equipment; The near-eye display device is dehumidified by the dehumidification unit of the maintenance equipment; By simultaneously activating the heating unit and dehumidification unit of the maintenance equipment, the near-eye display device is simultaneously subjected to heating and dehumidification treatment. The near-eye display device is subjected to alternating heating and dehumidification processes by alternately activating the heating unit and dehumidification unit of the maintenance equipment.

3. The maintenance method according to claim 2, characterized in that, The maintenance of the near-eye display device based on the degree of lens deformation further includes: Based on the degree of deformation of the lens, determine the maintenance method for maintaining the near-eye display device, and / or determine the operating parameters of at least one of the heating unit and the dehumidification unit.

4. The maintenance method according to any one of claims 1 to 3, characterized in that, Determining the degree of deformation of the lens based on the target image includes: Based on the target image, determine the first position of the feature point on the target image; The degree of lens deformation is determined based on the first position of the feature point on the target image and the second position of the feature point on a preset surface detection image.

5. The maintenance method according to claim 4, characterized in that, The step of determining the degree of lens deformation based on the position comparison information between the first position of the feature point on the target image and the second position of the feature point on the preset surface detection image includes at least one of the following: When the position difference between the first and second positions of at least one feature point is greater than or equal to the first position difference threshold, the deformation degree of the lens is determined to be greater than or equal to the preset deformation threshold. When the position difference between the first and second positions of a feature point is greater than or equal to the second position difference threshold, and the number of feature points with position differences greater than or equal to the second position difference threshold is greater than or equal to a preset number threshold, the degree of deformation of the lens is determined to be greater than or equal to the preset deformation threshold. The second position difference threshold is less than the first position difference threshold; The maintenance of the near-eye display device based on the degree of lens deformation includes: When the deformation of the lens is greater than or equal to a preset deformation threshold, the near-eye display device is maintained.

6. The maintenance method according to any one of claims 1 to 3, characterized in that, The maintenance method further includes: Receive maintenance instructions from a target terminal device for the near-eye display device; the target terminal device includes a device that has established a communication connection with the maintenance device. The near-eye display device is maintained according to the maintenance instructions.

7. A maintenance device for a near-eye display device, characterized in that, The maintenance device includes: The acquisition module is used to acquire target images obtained by capturing images of the lenses of near-eye display devices; A deformation determination module is used to determine the degree of deformation of the lens based on the target image; A maintenance module is used to maintain the near-eye display device according to the degree of deformation of the lens; The step of acquiring the target image obtained by capturing the lens of the near-eye display device includes: The display of the near-eye display device is controlled to display a preset facial shape detection image; The target image is obtained by capturing the surface shape detection image displayed on the lens using the image sensor of the maintenance equipment; or... The image generator of the maintenance device projects a preset face shape detection image onto the lens of the near-eye display device; The image sensor of the maintenance device captures the lens to obtain a target image; the surface detection image includes any one of dot matrix pattern, grid pattern, stripe pattern, and random pattern.

8. A maintenance device for a near-eye display device, characterized in that, The maintenance device includes a memory and a processor; The memory is used to store computer programs; The processor is configured to execute the computer program and, in executing the computer program, implement the maintenance method for the near-eye display device as described in any one of claims 1 to 6.

Images