Near-to-eye display equipment maintenance method, device and equipment

Abstract

The invention relates to the technical field of equipment maintenance, and provides a near-to-eye display equipment maintenance method, device and equipment, and the method comprises the steps: obtaining a target image obtained by shooting a lens of the near-to-eye display equipment; determining the deformation degree of the lens according to the target image; and according to the deformation degree of the lens, maintaining the near-to-eye display equipment so as to improve the convenience degree of maintaining the surface type of the lens of the near-to-eye display equipment, thereby improving the display effect of the near-to-eye display equipment.

Description

Technical Field

[0001] The present application relates to the technical field of equipment maintenance, and in particular to a maintenance method, device and equipment for a near-eye display device. Background Art

[0002] At present, near-eye display devices can be used in daily life. When a user uses a near-eye display device, the near-eye display device can follow the user's movement into different environments. However, changes in the environment can easily have an adverse effect on the surface shape of the lens of the near-eye display device, resulting in poor display effects of the near-eye display device. Summary of the invention

[0003] The main purpose of the present application is to provide a maintenance method, device and equipment for a near-eye display device, aiming to improve the convenience of maintaining the surface shape of the lens of the near-eye display device, so as to improve the display effect of the near-eye display device.

[0004] In a first aspect, the present application provides a maintenance method for a near-eye display device, which is applied to a maintenance device for a near-eye display device, and the maintenance method comprises the following steps:

[0005] Acquire a target image obtained by photographing a lens of the near-eye display device;

[0006] Determining the degree of deformation of the lens according to the target image;

[0007] The near-eye display device is maintained according to the degree of deformation of the lens.

[0008] In a second aspect, the present application further provides a maintenance device for a near-eye display device, the maintenance device comprising:

[0009] An acquisition module, used to acquire a target image obtained by photographing a lens of a near-eye display device;

[0010] A deformation determination module, used to determine the deformation degree of the lens according to the target image;

[0011] A maintenance module is used to maintain the near-eye display device according to the degree of deformation of the lens.

[0012] In a third aspect, the present application further provides a maintenance device for a near-eye display device, the maintenance device comprising a memory and a processor;

[0013] The memory is used to store computer programs;

[0014] The processor is used to execute the computer program and implement the maintenance method of the near-eye display device as described above when executing the computer program.

[0015] The present application provides a maintenance method, apparatus and equipment for a near-eye display device. The maintenance method for the near-eye display device includes: obtaining a target image obtained by photographing the lens of the near-eye display device; determining the degree of deformation of the lens based on the target image; and maintaining the near-eye display device based on the degree of deformation of the lens. When the maintenance device obtains the target image obtained by photographing the lens of the near-eye display device, the maintenance device can determine whether the surface shape of the lens is deformed based on the target image, such as determining whether the degree of deformation of the lens is greater than or equal to a preset deformation threshold. Based on this, the maintenance device can maintain the near-eye display device based on the degree of deformation of the lens, which is conducive to improving the convenience of maintaining the surface shape of the lens of the near-eye display device, so as to improve the display effect of the near-eye display device. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0017] Figure 1 It is a flowchart of a maintenance method of a near-eye display device provided in an embodiment of the present application;

[0018] Figure 2 This is an application scenario diagram of a maintenance method for a near-eye display device according to an embodiment of the present application;

[0019] Figure 3 is an application scenario diagram of a maintenance method for a near-eye display device according to another embodiment of the present application;

[0020] Figure 4 is a schematic block diagram of a maintenance device for a near-eye display device provided in an embodiment of the present application;

[0021] Figure 5 It is a schematic block diagram of the structure of a near-eye display device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0022] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0023] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions.

[0024] The embodiments of the present application provide a method, apparatus and device for maintaining a near-eye display device, wherein the method for maintaining a near-eye display device can be applied to a maintenance device for a near-eye display device.

[0025] Exemplarily, the maintenance device of the near-eye display device may have at least one of a maintenance function and a storage function.

[0026] In some embodiments, the maintenance device of the near-eye display device may include a storage box of the near-eye display device. For example, when the near-eye display device is an AR glasses or a VR glasses, the maintenance device of the near-eye display device may be a glasses box of the AR glasses or the VR glasses, which is not limited here. For example, when the near-eye display device is stored in the storage box of the near-eye display device, the storage box can maintain the near-eye display device.

[0027] Exemplarily, the near-eye display device may include VR glasses, AR glasses, VR helmets, AR helmets, and the like, which are not limited here. The lenses of the near-eye display device may be lenses of AR glasses, lenses of VR glasses, lenses of AR helmets, lenses of VR helmets, and the like, which are not limited here. Among them, the lenses of the near-eye display device may be used as the display of the near-eye display device to display corresponding content.

[0028] In some embodiments, the material of the lens of the near-eye display device may include a deformable material. For example, the material of the lens may include a resin material, which is not limited here.

[0029] Taking AR glasses as an example, the optical unit of AR glasses is usually composed of two parts: an optical machine and an optical combiner. Among them, the optical machine can also be called an optical engine. The optical machine may include an image source and a projection lens. The image source is used to generate an image to be displayed. The projection lens is used to project the image to be displayed to an infinitely far position or a specified position. The optical combiner can be used to transmit the signal light emitted by the optical machine to the user's eyes in a directional manner, thereby forming an image to be displayed on the user's retina. The optical combiner can be transparent to ambient light. When ambient light passes through the optical combiner, the user can see the environment in which he is located, such as the scenery in the real world. Based on this, when using AR glasses, the user can see the environment in which he is located and the image projected by the optical machine at the same time. Since the resin diffraction optical waveguide has the characteristics of good reliability, light weight and good light transmittance, it can be used as a preferred solution for the optical combiner. However, the resin material is water-absorbent. For example, the resin material can absorb water vapor in a humid environment, thereby affecting the surface shape or optical properties of the resin waveguide. In addition, the resin material is flexible. For example, the resin material is easily deformed by external force, air pressure or temperature during use, thereby affecting the surface shape or optical properties of the resin waveguide, which can easily have an adverse effect on the display effect of AR glasses.

[0030] Based on this, when the material of the lens of the near-eye display device includes an easily deformable material, the surface shape of the lens of the near-eye display device can be maintained by the maintenance method of the near-eye display device provided in the embodiments of the present application, thereby improving the convenience of maintaining the surface shape of the lens of the near-eye display device and improving the display effect of the near-eye display device.

[0031] In conjunction with the accompanying drawings, some embodiments of the present application are described in detail below. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0032] See also Figure 1 , Figure 1 It is a flowchart of a maintenance method of a near-eye display device provided in an embodiment of the present application. It should be noted that the maintenance method of a near-eye display device provided in an embodiment of the present application can be used for a maintenance device of a near-eye display device.

[0033] like Figure 1 As shown, the maintenance method of the near-eye display device includes steps S101 to S103.

[0034] S101, acquiring a target image obtained by photographing a lens of a near-eye display device.

[0035] In some embodiments, when the user does not need to use the near-eye display device temporarily, the near-eye display device can be maintained by a maintenance device of the near-eye display device.

[0036] For example, the maintenance device of the near-eye display device has a shooting function. For example, an image sensor may be provided in the maintenance device. The maintenance device may shoot the lens of the near-eye display device through the image sensor to obtain a target image. The obtained target image can be used to subsequently determine the degree of deformation of the lens, thereby determining whether to perform maintenance on the near-eye display device.

[0037] Taking the example of a storage box in which the maintenance device is a near-eye display device, when the storage box of the near-eye display device detects that there is a near-eye display device stored in a preset position range of the storage box, the storage box can perform lens surface detection on the near-eye display device to determine whether to perform maintenance on the near-eye display device. For example, the storage box can control the image sensor provided in the storage box to shoot the lens of the near-eye display device to obtain a target image. Of course, the maintenance device is not limited to the storage box of the near-eye display device, and this is not limited here.

[0038] For example, the maintenance device can obtain the target image by photographing the lens of the near-eye display device in different ways according to the optical characteristics of the lens of the near-eye display device, for example, by photographing the lens to obtain the target image by using any one of the refraction of light by the lens and the reflection of light by the lens.

[0039] In some embodiments, the lens thickness of the lens of the near-eye display device may be relatively thin. If the maintenance device directly photographs the lens of the near-eye display device, a target image is obtained. Since the thickness of the lens is relatively thin, when the surface shape of the lens changes slightly, the degree of deformation of the lens may be greater than or equal to a preset deformation threshold, resulting in a poor display effect of the near-eye display device. However, since the thickness of the lens is relatively thin, it is impossible to directly determine the surface shape change of the lens based on the target image, for example, resulting in a situation where the near-eye display device cannot be maintained. Based on this, any one of the refraction of light by the lens, the reflection of light by the lens, and the preset surface shape detection image can be combined to assist the maintenance device in photographing the lens of the near-eye display device to obtain a target image for subsequent maintenance of the near-eye display device.

[0040] For example, the preset face detection image may include a dot pattern, a grid pattern, a stripe pattern, and the like. For example, the preset face detection image may be obtained by periodically arranging any one of the dot pattern, the grid pattern, the stripe pattern, and the like. Of course, it is not limited thereto. For example, the preset face detection image may include a random pattern. The random pattern may include a speckle pattern, and the like, which are not limited here.

[0041] In some embodiments, the display of the near-eye display device is controlled to display a preset face detection image; the face detection image displayed by the lens is photographed by an image sensor of the maintenance device to obtain a target image.

[0042] like Figure 2 As shown, when the maintenance device detects that the near-eye display device is in a preset position range, the maintenance device can establish a communication connection with the near-eye display device. Based on the communication connection between the maintenance device and the near-eye display device, the maintenance device can send a preset face detection image to the near-eye display device, and control the display of the near-eye display device to display the preset face detection image. When the display of the near-eye display device is controlled to display the preset face detection image, the lens included in the display will also display the preset face detection image accordingly. Based on this, the image sensor in the maintenance device can shoot the lens of the near-eye display device that displays the preset face detection image to obtain a target image.

[0043] For example, the pattern included in the preset face detection image can be used as a feature point. Before the lens face shape is not deformed and after the lens face shape is deformed, the display position of the feature point on the lens will change, for example. Based on this, the face shape change of the lens can be identified according to the target image to determine the degree of deformation of the lens, thereby maintaining the near-eye display device.

[0044] In this way, when the maintenance device captures a lens displaying a preset face shape detection image to obtain a target image, the subsequent maintenance device can determine the change in the display position of the corresponding feature points in the face shape detection image on the lens based on the target image to perform maintenance on the near-eye display device, which is beneficial to improving the convenience of maintaining the face shape of the lens of the near-eye display device, thereby improving the display effect of the near-eye display device.

[0045] In some embodiments, a preset face shape detection image is projected onto a lens of a near-eye display device by an image generator of the maintenance device; and the lens is photographed by an image sensor of the maintenance device to obtain a target image.

[0046] For example, the maintenance device may have a projection function. For example, an image generator is provided in the maintenance device. The image generator may include a projector or a projection device. The projection device may include a device that projects an image using a diffuser or a diffractive optical element (DOE), which is not limited here.

[0047] like Figure 3 As shown, when the maintenance device detects that the near-eye display device is in a preset position range, the maintenance device can project a preset face detection image onto the lens of the near-eye display device through an image generator, and the image sensor of the maintenance device can receive the face detection image after reflection from the lens surface to obtain a target image.

[0048] For example, the pattern included in the preset face detection image can be used as a feature point. Before the lens face shape is not deformed and after the lens face shape is deformed, the projection position of the feature point on the lens will change, for example. Based on this, the face shape change of the lens can be identified according to the target image to determine the degree of deformation of the lens, thereby maintaining the near-eye display device.

[0049] In this way, when the maintenance device captures a lens displaying a preset face shape detection image to obtain a target image, the subsequent maintenance device can determine the change in the projection position of the corresponding feature points in the face shape detection image on the lens according to the target image, and perform maintenance on the near-eye display device, which is beneficial to improving the convenience of maintaining the face shape of the lens of the near-eye display device, thereby improving the display effect of the near-eye display device.

[0050] S102: Determine the degree of deformation of the lens according to the target image.

[0051] For example, since the target image can be obtained by the maintenance device through an image sensor photographing the lens of a near-eye display device that displays a preset face detection image, or the maintenance device through an image sensor photographing the lens of a near-eye display device that projects a preset face detection image, when the preset face detection image includes a corresponding pattern, the target image may also include the corresponding pattern.

[0052] Based on this, the corresponding pattern included in the preset face shape detection image can be used as a feature point to determine the degree of deformation of the lens. For example, the display position of the same pattern before and after the face shape of the lens is deformed may be different, and the projection position of the same pattern before and after the face shape of the lens is deformed may also be different. Then, the degree of deformation of the lens can be determined based on the change in the display position or projection position of the same pattern before and after the face shape of the lens is deformed, that is, the degree of deformation of the lens can be determined based on the change in the display position or projection position of the same feature point before and after the face shape of the lens is deformed.

[0053] Exemplarily, based on the target image, a first position of the feature point on the target image is determined; based on the first position of the feature point on the target image and a second position of the feature point on a preset face detection image, the degree of deformation of the lens is determined.

[0054] In some embodiments, when the target image is acquired, the maintenance device can detect the position of the feature point in the target image to determine the first position of the feature point on the target image. Accordingly, the maintenance device can acquire the second position of the feature point on the preset face detection image. Since the feature point in the target image corresponds to the feature point in the preset face detection image one by one, the first position of the feature point on the target image and the second position of the feature point on the preset face detection image can be compared to determine whether the position of the feature point has changed, so as to determine the degree of deformation of the lens.

[0055] For example, the target image may be analyzed and processed by a preset position detection algorithm to obtain the first position of the feature point on the target image. Of course, this is not limited to this and is not limited here.

[0056] For example, the second position of the feature point on the preset face detection image can be determined based on the image obtained by the maintenance device when the lens of the near-eye display device is not deformed. In the case of different acquisition methods of the target image, the second position of the feature point on the preset face detection image can also be different accordingly. For example, if the target image is obtained by an image sensor photographing a lens of a near-eye display device that displays a preset face detection image, the second position of the feature point on the preset face detection image can be determined based on the image obtained by the maintenance device photographing the lens of the near-eye display device that displays a preset face detection image and whose face shape is not deformed. For another example, if the target image is obtained by an image sensor photographing the lens of a near-eye display device that projects a preset face detection image, the second position of the feature point on the preset face detection image can be determined based on the image obtained by the maintenance device photographing the lens of the near-eye display device that projects a preset face detection image and whose face shape is not deformed. Of course, it is not limited to this, and the second position of the feature point on the preset face detection image can also be pre-stored in the maintenance device, which is not limited here.

[0057] In this way, based on the first position of the feature point on the target image and the second position of the feature point on the preset face shape detection image, the position difference of the feature point before and after the face shape of the lens changes, such as the display position difference or the projection position difference, can be determined to determine the deformation degree of the lens, which is conducive to improving the convenience and flexibility of determining the deformation degree of the lens.

[0058] Exemplarily, the maintenance device may set a corresponding threshold value for the degree of deformation of the lens, such as a preset deformation threshold value, and evaluate the effect of the degree of deformation of the lens on the display effect of the near-eye display device. For example, when the degree of deformation of the lens is greater than or equal to the preset deformation threshold value, the display effect of the near-eye display device will decrease, and the maintenance device is required to maintain the near-eye display device. When the degree of deformation of the lens is less than the preset deformation threshold value, the display effect of the near-eye display device does not change or changes slightly, and the maintenance device is temporarily not required to maintain the near-eye display device. The preset deformation threshold value may be pre-set or may be set by the user, and is not limited here.

[0059] In some embodiments, when there is a position difference between a first position and a second position of at least one feature point that is greater than or equal to a first position difference threshold, it is determined that the deformation degree of the lens is greater than or equal to a preset deformation threshold.

[0060] For example, when comparing the position difference between the first position and the second position of the feature point, the maintenance device may set a corresponding threshold value, such as a first position difference threshold value, for the position difference between the first position and the second position of the feature point. The first position difference threshold value can be used by the maintenance device to determine whether the position difference corresponding to the feature point will cause a decrease in the display effect of the near-eye display device, so as to determine whether to perform maintenance on the near-eye display device.

[0061] Take the example of a maintenance device determining the first position of each of the multiple feature points on the target image and the second position of each of the multiple feature points on the preset face detection image. If the maintenance device detects that the position difference between the first position and the second position of at least one feature point is greater than or equal to the first position difference threshold, then the corresponding position of the feature point on the lens has been deformed, and the deformation can cause the display effect of the near-eye display device to deteriorate. Based on this, it can be determined that the degree of deformation of the lens is greater than or equal to the preset deformation threshold, which is equivalent to determining that the face shape of the lens has been severely deformed and needs to be repaired. The subsequent maintenance device can then perform maintenance on the lens of the near-eye display device.

[0062] In some embodiments, when there is a position difference between a first position and a second position of a feature point that is greater than or equal to a second position difference threshold, and the number of feature points whose position difference is greater than or equal to the second position difference threshold is greater than or equal to a preset number threshold, it is determined that the deformation degree of the lens is greater than or equal to the preset deformation threshold; the second position difference threshold is less than the first position difference threshold.

[0063] For example, when comparing the position difference between the first position and the second position of the feature point, the maintenance device may set a corresponding threshold value, such as a second position difference threshold value, for the position difference between the first position and the second position of the feature point. The second position difference threshold value is smaller than the first position difference threshold value. The second position difference threshold value can be used by the maintenance device to determine whether the position difference corresponding to the feature point will affect the display effect of the near-eye display device, so as to determine whether to perform maintenance on the near-eye display device.

[0064] Take the case where the maintenance device determines the first position of each of the multiple feature points on the target image and the second position of each of the multiple feature points on the preset face detection image as an example. If the maintenance device detects that the position difference between the first position and the second position of the feature point is greater than or equal to the second position difference threshold, the position corresponding to the feature point on the lens may be deformed, and the current deformation may not cause the display effect of the near-eye display device to decrease. Based on this, in order to improve the accuracy of maintaining the near-eye display device, the maintenance device can further count the cumulative amount of the deformation currently occurring, and combine the cumulative amount of the deformation currently occurring to determine whether the position difference corresponding to the feature point will affect the display effect of the near-eye display device, so as to determine whether to maintain the near-eye display device. For example, the maintenance device can set a preset number threshold. The preset number threshold can be used to evaluate the cumulative amount of the position difference corresponding to the feature point. Accordingly, the maintenance device can further count the number of feature points whose position difference is greater than or equal to the second position difference threshold. For example, when the maintenance device detects that the number of feature points whose position difference is greater than or equal to the second position difference threshold is greater than or equal to the preset number threshold, it can be determined that the cumulative amount of the deformation currently occurring can cause the display effect of the near-eye display device to decrease. Based on this, it can be determined that the deformation degree of the lens is greater than or equal to the preset deformation threshold, which is equivalent to determining that the surface shape of the lens has been severely deformed and needs to be repaired. Subsequent maintenance equipment can then maintain the lens of the near-eye display device.

[0065] When it is determined that the deformation degree of the lens is greater than or equal to the preset deformation threshold, the maintenance device can automatically maintain the near-eye display device. For example, the maintenance device can repair the surface shape of the lens. Of course, it is not limited to this and is not limited here.

[0066] In this way, by determining whether the position difference between the first position and the second position of the feature point is greater than or equal to the first position difference threshold, or determining whether the position difference between the first position and the second position of the feature point is greater than or equal to the second position difference threshold, and determining whether the number of feature points whose position difference is greater than or equal to the second position difference threshold is greater than or equal to the preset number threshold, it is judged whether the surface shape of the lens is seriously deformed, which is conducive to improving the convenience and flexibility of judging the degree of deformation of the lens. The determination based on the degree of deformation of the lens can be used for subsequent maintenance of the near-eye display device.

[0067] Of course, the method of determining the degree of deformation of the lens according to the target image is not limited to this.

[0068] In other embodiments, the maintenance device may determine the current face shape information of the lens according to the target image; and determine the degree of deformation of the lens according to the comparison result of the current face shape information and the preset face shape information.

[0069] For example, when a target image is acquired, the maintenance device may perform image recognition processing on the target image to determine the current face shape information of the lens. For example, the face shape information may include the surface height of the lens. The maintenance device may analyze and process the target image according to a preset surface height detection algorithm to obtain the current surface height of the lens. For another example, the face shape information may include the outline of the lens. The maintenance device may identify the lens in the target image according to a preset edge detection algorithm to obtain the current outline of the lens. This is not limited here.

[0070] For example, the preset face shape information may be the face shape information of the lens when it is not deformed. The maintenance device may for example pre-store an initial image of the lens of the near-eye display device when it is not deformed, and the maintenance device determines the initial face shape information of the lens according to the initial image.

[0071] For example, the current face shape information and the initial face shape information of the lens can be compared, such as determining the contour offset of the lens based on the current contour of the lens and the contour of the lens when it is not deformed. For another example, determining the surface height change of the lens based on the current surface height of the lens and the surface height of the lens when it is not deformed. This is not limited here.

[0072] In an exemplary embodiment, the maintenance device can determine whether the profile offset of the lens is greater than or equal to a preset offset threshold, and / or determine whether the surface height change of the lens is greater than or equal to a preset change threshold. In the case where at least one of the following is met: the profile offset of the lens is greater than or equal to the preset offset threshold, and the surface height change of the lens is greater than or equal to the preset change threshold, it can be determined that the deformation degree of the lens is greater than or equal to the preset deformation threshold. The preset offset threshold and the preset change threshold can be pre-set or set by the user, and are not limited here.

[0073] When it is determined that the deformation degree of the lens is greater than or equal to the preset deformation threshold, the maintenance device can automatically maintain the near-eye display device. For example, the maintenance device can repair the surface shape of the lens. Of course, it is not limited to this and is not limited here.

[0074] In this way, based on the acquisition of the target image, the degree of deformation of the lens can be determined in different ways, which is conducive to improving the convenience and flexibility of determining the degree of deformation of the lens. Based on the determination of the degree of deformation of the lens, the maintenance device can determine whether to maintain the lens according to the degree of deformation of the lens, so as to facilitate the subsequent maintenance of the near-eye display device, which is conducive to improving the convenience of maintaining the lens of the near-eye display device and improving the display effect of the near-eye display device.

[0075] S103: Maintain the near-eye display device according to the degree of deformation of the lens.

[0076] In some embodiments, maintaining the near-eye display device includes at least one of the following: heating the near-eye display device through a heating unit of the maintenance device; dehumidifying the near-eye display device through a dehumidification unit of the maintenance device; simultaneously heating and dehumidifying the near-eye display device by simultaneously starting the heating unit and the dehumidification unit of the maintenance device; alternatingly heating and dehumidifying the near-eye display device by alternately starting the heating unit and the dehumidification unit of the maintenance device.

[0077] For example, when the lens of the near-eye display device absorbs too much moisture from the environment, causing the deformation of the lens to be greater than or equal to a preset deformation threshold, the maintenance device can heat the near-eye display device through a heating unit. By heating the near-eye display device, the evaporation of moisture in the lens can be accelerated. In the case where the lens is made of resin material, the thermoplasticity of the resin material can also be used to reshape the surface shape of the lens, thereby repairing the surface shape of the lens. In an exemplary embodiment, in order to ensure the maintenance safety and maintenance reliability of the near-eye display device, the maintenance device can adjust the heating temperature of the near-eye display device within a preset heating range during the maintenance of the near-eye display device through a heating unit. The preset heating range can be 30°C to 80°C, which is not limited here.

[0078] For example, when the lens of the near-eye display device absorbs too much moisture from the environment, causing the deformation of the lens to be greater than or equal to a preset deformation threshold, the maintenance device can perform a dehumidification process on the near-eye display device through the dehumidification unit. By performing a dehumidification process on the near-eye display device, the humidity of the near-eye display device can be reduced, the amount of water absorbed by the lens can be reduced, and the surface shape of the lens can be repaired.

[0079] For example, in the process of repairing the surface shape of the lens, the maintenance device can also simultaneously start the heating unit and the dehumidification unit of the maintenance device to simultaneously perform heating and dehumidification treatments on the near-eye display device. Correspondingly, the maintenance device can also alternately start the heating unit and the dehumidification unit of the maintenance device to alternately perform heating and dehumidification treatments on the near-eye display device. For example, the near-eye display device can be heated for 30 minutes by the heating unit, and then the near-eye display device can be dehumidified for 10 minutes by the dehumidification unit, and this cycle can be repeated. Of course, this is not limited to this, and no limitation is made here.

[0080] In this way, maintaining the near-eye display device through at least one of the heating unit and the dehumidification unit is beneficial to improving the convenience and flexibility of maintaining the surface shape of the lens of the near-eye display device, so as to improve the display effect of the near-eye display device.

[0081] For example, the maintenance method of the near-eye display device can be determined according to the degree of deformation of the lens.

[0082] In some embodiments, the maintenance function of the maintenance device for the near-eye display device may include at least one of a charging function and a facial repair function. Of course, this is not limited to this and is not limited here. Based on this, at least one of the charging function and the facial repair function of the maintenance device can be selected according to the degree of deformation of the lens to maintain the near-eye display device.

[0083] For example, when the degree of deformation of the lens is greater than or equal to a preset deformation threshold, the maintenance device can repair the surface shape of the lens of the near-eye display device. Of course, it is not limited to this. For example, when the degree of deformation of the lens is greater than or equal to the preset deformation threshold, the maintenance device can also charge the near-eye display device. The maintenance device can charge the near-eye display device in a wired or wireless manner, which is not limited here.

[0084] For example, when the deformation degree of the lens is less than the preset deformation threshold, the maintenance device may temporarily not repair the surface shape of the lens of the near-eye display device, and the maintenance device may charge the near-eye display device. For example, the near-eye display device is charged wirelessly or wired, which is not limited here.

[0085] In other embodiments, since different maintenance units, such as a heating unit, a dehumidification unit, etc., are provided in the maintenance device to repair the surface shape of the lens, the maintenance device can select the corresponding maintenance unit of the maintenance device according to the degree of deformation of the lens to maintain the near-eye display device. For example, when the degree of deformation of the lens is greater than or equal to the target deformation threshold, the maintenance device maintains the near-eye display device through any one of the heating unit and the dehumidification unit. When the degree of deformation of the lens is greater than or equal to the preset deformation threshold, and the degree of deformation of the lens is less than the target deformation threshold, the maintenance device maintains the near-eye display device through the heating unit and the dehumidification unit. Among them, the target deformation threshold is greater than the preset deformation threshold. Of course, it is not limited to this, and no limitation is made here.

[0086] In this way, by determining the maintenance method for the near-eye display device according to the degree of deformation of the lens, it is helpful to improve the flexibility and convenience of maintaining the surface shape of the lens of the near-eye display device, thereby improving the display effect of the near-eye display device.

[0087] Exemplarily, the operating parameters of at least one of the heating unit and the dehumidification unit may be determined according to the degree of deformation of the lens.

[0088] For example, when the deformation degree of the lens is greater than or equal to the target deformation threshold, the maintenance device can increase the current operating parameters of at least one of the heating unit and the dehumidification unit to determine the operating parameters of at least one of the heating unit and the dehumidification unit. When the deformation degree of the lens is greater than or equal to the preset deformation threshold and less than the target deformation threshold, the maintenance device can decrease the current operating parameters of at least one of the heating unit and the dehumidification unit to determine the operating parameters of at least one of the heating unit and the dehumidification unit. Of course, it is not limited to this and is not limited here.

[0089] In this way, based on the adjustment of operating parameters, the maintenance equipment can take appropriate operating parameters according to the degree of deformation of the lens to repair the surface shape of the lens, so as to save repair resources for repairing the surface shape of the lens and improve the repair efficiency of repairing the surface shape of the lens.

[0090] In some embodiments, a maintenance instruction for a near-eye display device is received from a target terminal device; the target terminal device includes a device that has established a communication connection with the maintenance device; and the near-eye display device is maintained according to the maintenance instruction.

[0091] Exemplarily, the maintenance device may have a communication function. For example, the maintenance device may establish a communication connection with the target terminal device via a communication connection method such as Bluetooth or Wifi. The target terminal device may be a user's terminal device such as a mobile phone, tablet computer, laptop computer, television, etc., which is not limited here. When the user places the near-eye display device within the preset position range of the maintenance device, the maintenance device may maintain the near-eye display device by itself, or may maintain the near-eye display device according to the user's instructions.

[0092] For example, when the maintenance device needs to perform maintenance on the near-eye display device according to the user's instructions, the maintenance device can receive maintenance instructions for the near-eye display device from the target terminal device. For example, the maintenance instruction can be used to instruct the maintenance device whether to start charging the near-eye display device, whether to perform timed charging on the near-eye display device, whether to detect the surface shape of the lens of the near-eye display device, whether to repair the surface shape of the lens, how to set the operating parameters of at least one of the heating unit and the dehumidification unit, etc., which are not limited here. Based on this, the maintenance device can perform maintenance on the near-eye display device according to the received maintenance instruction.

[0093] In some embodiments, the maintenance device may also feed back information to the target terminal device based on the communication connection between the maintenance device and the target terminal device. For example, the maintenance device may send the charging status of the near-eye display device, the surface shape information of the lens, the degree of deformation of the lens, the repair information of the lens, etc. to the target terminal device, and the user may view the maintenance progress of the near-eye display device by the maintenance device through the target terminal device. Of course, this is not limited to this and is not limited here.

[0094] In this way, through the communication connection between the maintenance device and the target terminal device, the user can view or control the maintenance process of the near-eye display device through the target terminal device, which is conducive to improving the convenience of controlling the maintenance device, thereby helping to improve the user's experience of using the maintenance device.

[0095] The above-mentioned embodiment provides a maintenance method for a near-eye display device, and the maintenance method includes: acquiring a target image obtained by photographing a lens of the near-eye display device; determining a degree of deformation of the lens based on the target image; and maintaining the near-eye display device based on the degree of deformation of the lens to improve the convenience of maintaining the surface shape of the lens of the near-eye display device, thereby improving the display effect of the near-eye display device.

[0096] See also Figure 4 , Figure 4 This is a schematic block diagram of a maintenance device for a near-eye display device provided in an embodiment of the present application. The maintenance device for a near-eye display device can be configured in a server or a maintenance device for a near-eye display device, and is used to execute the aforementioned maintenance method for a near-eye display device.

[0097] like Figure 4 As shown, the maintenance device of the near-eye display device includes: an acquisition module 110, an information determination module 120, a deformation determination module 130 and a maintenance module 140.

[0098] The acquisition module 110 is used to acquire a target image obtained by photographing a lens of a near-eye display device.

[0099] The deformation determination module 120 is used to determine the deformation degree of the lens according to the target image.

[0100] The maintenance module 130 is used to maintain the near-eye display device according to the degree of deformation of the lens.

[0101] Exemplarily, the acquisition module 110 includes a display submodule and a first shooting submodule.

[0102] The display submodule is used to control the display of the near-eye display device to display a preset face detection image.

[0103] The first shooting submodule is used to shoot the face shape detection image displayed by the lens through the image sensor of the maintenance equipment to obtain a target image.

[0104] Exemplarily, the acquisition module 110 includes a projection submodule and a second shooting submodule.

[0105] The projection submodule is used to project a preset face detection image onto the lens of the near-eye display device through the image generator of the maintenance device.

[0106] The second shooting submodule is used to shoot the lens through the image sensor of the maintenance equipment to obtain a target image.

[0107] Exemplarily, the maintenance module 130 includes a first maintenance submodule, a second maintenance submodule, a third maintenance submodule, and a fourth maintenance submodule.

[0108] The first maintenance submodule is used to heat the near-eye display device through a heating unit of the maintenance device.

[0109] The second maintenance submodule is used to dehumidify the near-eye display device through a dehumidification unit of the maintenance device.

[0110] The third maintenance submodule is used to simultaneously start the heating unit and the dehumidification unit of the maintenance device to perform heating and dehumidification processing on the near-eye display device.

[0111] The fourth maintenance submodule is used to alternately heat and dehumidify the near-eye display device by alternately starting the heating unit and the dehumidification unit of the maintenance device.

[0112] Exemplarily, the maintenance device 130 includes a fifth maintenance submodule.

[0113] The fifth maintenance submodule is used to determine a maintenance method for the near-eye display device according to the degree of deformation of the lens, and / or determine an operating parameter of at least one of the heating unit and the dehumidification unit.

[0114] Exemplarily, the deformation determination module 120 includes a first information determination submodule and a second information determination submodule.

[0115] The first information determination submodule is used to determine a first position of a feature point on the target image according to the target image.

[0116] The second information determination submodule is used to determine the deformation degree of the lens according to the first position of the feature point on the target image and the second position of the feature point on the preset face detection image.

[0117] Exemplarily, the deformation determination module 120 includes a first deformation determination submodule and a second deformation determination submodule.

[0118] The first deformation determination submodule is used to determine that the deformation degree of the lens is greater than or equal to a preset deformation threshold when the position difference between the first position and the second position of at least one feature point is greater than or equal to a first position difference threshold.

[0119] The second deformation determination submodule is used to determine that the deformation degree of the lens is greater than or equal to a preset deformation threshold when the position difference between the first position and the second position of the feature point is greater than or equal to a second position difference threshold, and the number of feature points whose position difference is greater than or equal to the second position difference threshold is greater than or equal to a preset number threshold; and the second position difference threshold is less than the first position difference threshold.

[0120] The maintenance device 130 further includes a sixth maintenance submodule.

[0121] The sixth maintenance submodule is used to maintain the near-eye display device when the deformation degree of the lens is greater than or equal to a preset deformation threshold.

[0122] Exemplarily, the maintenance device 130 further includes an instruction receiving submodule and a seventh maintenance submodule.

[0123] The instruction receiving submodule is used to receive the maintenance instruction of the target terminal device to the near-eye display device; the target terminal device includes a device that has established a communication connection with the maintenance device.

[0124] A seventh maintenance submodule is used to maintain the near-eye display device according to the maintenance instruction.

[0125] It should be noted that technicians in the relevant field can clearly understand that for the convenience and simplicity of description, the specific working processes of the above-described devices and modules and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0126] The method of the present application can be used in many general or special computer system environments or configurations. For example: personal computers, server computers, handheld devices or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronic devices, network PCs, minicomputers, mainframe computers, distributed computing environments including any of the above systems or devices, etc. The present application can be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The present application can also be practiced in distributed computing environments, in which tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules can be located in local and remote computer storage media including storage devices.

[0127] Exemplarily, the above method and apparatus may be implemented in the form of a computer program, which may be run on a maintenance device for a near-eye display device. Exemplarily, the maintenance device for a near-eye display device may include a storage box for the near-eye display device, which is not limited here.

[0128] See also Figure 5 , Figure 5 It is a schematic block diagram of the structure of a maintenance device for a near-eye display device provided in an embodiment of the present application.

[0129] like Figure 5 As shown, the maintenance device of the near-eye display device includes a memory and a processor. The memory and the processor may be connected via a system bus, and the memory may include a storage medium and an internal memory.

[0130] The storage medium may store an operating system and a computer program. When the computer program is executed, the processor may execute any one of the maintenance methods for the near-eye display device.

[0131] The processor is used to provide computing and control capabilities to support the operation of the entire maintenance equipment.

[0132] The internal memory provides an environment for the operation of the computer program in the storage medium. When the computer program is executed by the processor, the processor can execute any maintenance method of the near-eye display device.

[0133] Those skilled in the art will understand that Figure 5 The structure shown in the figure is only a block diagram of a part of the structure related to the scheme of the present application, and does not constitute a limitation on the maintenance color of the near-eye display device to which the scheme of the present application is applied. The maintenance device of the specific near-eye display device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0134] It should be understood that the processor may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0135] In one embodiment, the processor is used to execute a computer program and implement the following steps when executing the computer program:

[0136] Acquire a target image obtained by photographing a lens of the near-eye display device;

[0137] Determining the degree of deformation of the lens according to the target image;

[0138] The near-eye display device is maintained according to the degree of deformation of the lens.

[0139] It should be noted that technicians in the relevant field can clearly understand that for the convenience and conciseness of description, the specific working process of the maintenance of the near-eye display device described above can refer to the corresponding process in the aforementioned near-eye display device maintenance method embodiment, and will not be repeated here.

[0140] An embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored. The method implemented when the computer program is executed by a processor can refer to the various embodiments of the maintenance method of the near-eye display device of the present application.

[0141] The computer-readable storage medium may be an internal storage unit of the maintenance device of the near-eye display device described in the aforementioned embodiment, such as a hard disk or memory of the maintenance device of the near-eye display device. The computer-readable storage medium may also be an external storage device of the maintenance device of the near-eye display device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (SecureDigital, SD) card, a flash card (Flash Card), etc., equipped on the maintenance device of the near-eye display device.

[0142] It should be understood that the terms used in this application specification are only for the purpose of describing specific embodiments and are not intended to limit the application. As used in this application specification and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.

[0143] It should also be understood that the term "and / or" used in the specification of this application and the appended claims refers to any combination of one or more of the associated listed items and all possible combinations, including these combinations. It should be noted that, in this article, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "including a..." does not exclude the presence of other identical elements in the process, method, article or system including the element.

[0144] The serial numbers of the embodiments of the present application are for description only and do not represent the advantages and disadvantages of the embodiments. The above description is only a specific implementation mode of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A method for maintaining a near-eye display device, characterized in that: A maintenance device applied to a near-eye display device, wherein the maintenance method comprises: Acquire a target image obtained by photographing a lens of the near-eye display device; Determining the degree of deformation of the lens according to the target image; The near-eye display device is maintained according to the degree of deformation of the lens.

2. The maintenance method according to claim 1, characterized in that: The acquiring of a target image obtained by photographing a lens of the near-eye display device comprises: Controlling the display of the near-eye display device to display a preset face detection image; The face shape detection image displayed by the lens is photographed by the image sensor of the maintenance equipment to obtain a target image.

3. The maintenance method according to claim 1, characterized in that: The acquiring of a target image obtained by photographing a lens of the near-eye display device comprises: Projecting a preset face shape detection image onto a lens of the near-eye display device through an image generator of the maintenance device; The lens is photographed by the image sensor of the maintenance equipment to obtain a target image.

4. The maintenance method according to claim 1, characterized in that: The maintaining of the near-eye display device includes at least one of the following: Performing heating treatment on the near-eye display device by a heating unit of the maintenance device; Dehumidifying the near-eye display device by using a dehumidification unit of the maintenance device; By simultaneously starting the heating unit and the dehumidification unit of the maintenance device, the near-eye display device is heated and dehumidified at the same time; By alternately starting the heating unit and the dehumidification unit of the maintenance device, the near-eye display device is alternately heated and dehumidified.

5. The maintenance method according to claim 4, characterized in that: The method of maintaining the near-eye display device according to the degree of deformation of the lens further includes: According to the deformation degree of the lens, a maintenance method for maintaining the near-eye display device is determined, and / or an operating parameter of at least one of the heating unit and the dehumidification unit is determined.

6. The maintenance method according to any one of claims 1 to 5, characterized in that: Determining the degree of deformation of the lens according to the target image includes: According to the target image, determining a first position of the feature point on the target image; The deformation degree of the lens is determined according to a first position of the feature point on the target image and a second position of the feature point on a preset face detection image.

7. The maintenance method according to claim 6, characterized in that: Determining the degree of deformation of the lens according to position comparison information between a first position of the feature point on the target image and a second position of the feature point on a preset face shape detection image comprises at least one of the following: When there is a position difference between the first position and the second position of at least one feature point that is greater than or equal to a first position difference threshold, determining that the deformation degree of the lens is greater than or equal to a preset deformation threshold; When there is a feature point whose position difference between the first position and the second position is greater than or equal to a second position difference threshold, and the number of feature points whose position difference is greater than or equal to the second position difference threshold is greater than or equal to a preset number threshold, it is determined that the deformation degree of the lens is greater than or equal to the preset deformation threshold; The second position difference threshold is less than the first position difference threshold; The maintaining the near-eye display device according to the deformation degree of the lens includes: When the deformation degree of the lens is greater than or equal to a preset deformation threshold, the near-eye display device is maintained.

8. The maintenance method according to any one of claims 1 to 5, characterized in that: The maintenance method further comprises: Receiving a maintenance instruction from the target terminal device to the near-eye display device; the target terminal device includes a device that has established a communication connection with the maintenance device; The near-eye display device is maintained according to the maintenance instruction.

9. A maintenance device for a near-eye display device, characterized in that: The maintenance device comprises: An acquisition module, used to acquire a target image obtained by photographing a lens of a near-eye display device; A deformation determination module, used to determine the deformation degree of the lens according to the target image; A maintenance module is used to maintain the near-eye display device according to the degree of deformation of the lens.

10. A maintenance device for a near-eye display device, characterized in that: The maintenance device includes a memory and a processor; The memory is used to store computer programs; The processor is used to execute the computer program and implement the maintenance method of the near-eye display device according to any one of claims 1 to 8 when executing the computer program.

Images