Image processing method and device, near-eye display device, and storage medium
By setting a variable resistor in the frame of the near-eye display device, the display image is adjusted in real time based on the change in resistance, thus solving the ghosting problem caused by frame deformation and ensuring the clarity and consistency of the display.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- GOERTEK INC
- Filing Date
- 2024-12-30
- Publication Date
- 2026-06-30
Smart Images
Figure CN122307918A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of image processing technology, and in particular to image processing methods, apparatus, near-eye display devices, and storage media. Background Technology
[0002] Currently, in near-eye display devices employing binocular vision systems (such as AR (Augmented Reality) glasses), achieving high-quality image fusion is a key technology to ensure users receive a clear, ghosting-free view. In other words, AR glasses require binocular fusion to ensure a clear, ghosting-free display. However, due to significant differences in head circumference between individuals and the influence of the AR glasses' frame strength, the frame may deform to some extent due to external forces when the wearer puts on or takes off the AR glasses, or during prolonged wear. This deformation directly alters the relative position between the two eyes, thus affecting the optical parameters of the binocular vision system, leading to problems with binocular fusion and ghosting. Therefore, how to prevent ghosting caused by frame deformation in near-eye display devices has become an urgent problem to solve.
[0003] The above content is only used to help understand the technical solution of this application and does not represent an admission that the above content is prior art. Summary of the Invention
[0004] The main objective of this application is to provide an image processing method, apparatus, near-eye display device, and storage medium, aiming to solve the technical problem of how to avoid ghosting in the displayed image due to lens deformation in near-eye display devices.
[0005] To achieve the above objectives, this application proposes an image processing method applied to a near-eye display device, the near-eye display device including a lens frame with a variable resistor, and the image processing method comprising the following steps:
[0006] The resistance change of the variable resistor is detected in real time after the wearer wears the near-eye display device;
[0007] The deformation parameters of the mirror frame are determined based on the resistance change value, wherein the deformation parameters include the amount and direction of deformation of the mirror frame;
[0008] The deformation parameters are used to adjust at least one of the left-eye display and the right-eye display in the near-eye display device until the left-eye display and the right-eye display overlap.
[0009] Optionally, the step of adjusting at least one of the left-eye display image and the right-eye display image in the near-eye display device according to the deformation parameters until the left-eye display image and the right-eye display image overlap includes:
[0010] The target display image that needs to be adjusted within the near-eye display device is determined based on the deformation parameters, wherein the target display image includes at least one of the left-eye display image and the right-eye display image;
[0011] The direction of movement of the target display screen is determined based on the deformation direction of the frame, and the number of pixels that the target display screen needs to move in the direction of movement is determined based on the amount of deformation of the frame.
[0012] The target display screen is adjusted according to the moving direction and the number of pixels until the left eye display screen and the right eye display screen overlap.
[0013] Optionally, the frame includes a left eyeglass frame and a right eyeglass frame, and the step of determining the target display image that needs to be adjusted within the near-eye display device based on the deformation parameters includes:
[0014] If the deformation parameters include the deformation parameters of the left eyeglass frame, then the left eye display image is determined to be the target display image;
[0015] If the deformation parameters include the deformation parameters of the right eyeglass frame, then the right eye display image is determined to be the target display image;
[0016] If the deformation parameters include the deformation parameters of the left eyeglass frame and the deformation parameters of the right eyeglass frame, then the left eye display image and the right eye display image are determined as the target display images.
[0017] Optionally, the step of controlling the target display screen to adjust pixels based on the movement direction and the number of pixels includes:
[0018] If the target display screen is a left-eye display screen, then control the left-eye display screen to move by the number of pixels in the moving direction;
[0019] Detect whether the left-eye display screen is horizontally and vertically aligned with the right-eye display screen after the movement;
[0020] If the moved left-eye display is not horizontally or vertically aligned with the right-eye display, the moved left-eye display is scaled according to a preset first scaling factor until the left-eye display and the right-eye display are horizontally and vertically aligned.
[0021] Optionally, the step of controlling the target display screen to adjust pixels based on the movement direction and the number of pixels further includes:
[0022] If the target display is a right-eye display, then control the right-eye display to move by the number of pixels in the moving direction;
[0023] Detect whether the right-eye display screen is horizontally and vertically aligned with the left-eye display screen after the movement;
[0024] If the right-eye display after movement is not horizontally or vertically aligned with the left-eye display, the right-eye display after movement is scaled according to a preset second scaling factor until the left-eye display and the right-eye display are horizontally and vertically aligned.
[0025] Optionally, the movement direction includes a first movement direction in which the left eye display needs to move and a second movement direction in which the right eye display needs to move, and the number of pixels includes the number of first pixels to be moved in the first movement direction and the number of second pixels to be moved in the second movement direction;
[0026] The step of controlling the target display screen to adjust pixels based on the movement direction and the number of pixels further includes:
[0027] If the target display screen is a left-eye display screen and a right-eye display screen, then the left-eye display screen is controlled to move by the first number of pixels in the first moving direction, and the right-eye display screen is controlled to move by the second number of pixels in the second moving direction;
[0028] Detect whether the left-eye display after movement is horizontally and vertically aligned with the right-eye display after movement;
[0029] If the moved left-eye display and the moved right-eye display are horizontally and vertically aligned, then the left-eye display and the right-eye display are determined to overlap.
[0030] Optionally, the step of detecting the resistance change of the variable resistor in real time includes:
[0031] The resistance difference between the actual resistance value of the variable resistor and the preset reference resistance value is determined in real time, and the resistance difference is used as the resistance change value;
[0032] The step of determining the deformation parameters of the mirror frame based on the resistance change value includes:
[0033] If the resistance difference is positive, then the deformation of the frame is determined to be the deformation caused by stretching the frame.
[0034] If the resistance difference is negative, then the deformation of the frame is determined to be the deformation caused by compression of the frame.
[0035] Furthermore, to achieve the above objectives, this application also proposes an image processing apparatus disposed in a near-eye display device, the near-eye display device further comprising a lens frame provided with a variable resistor, the image processing apparatus comprising:
[0036] The detection module is used to detect the resistance change of the variable resistor in real time after the wearer wears the near-eye display device;
[0037] A determining module is used to determine the deformation parameters of the mirror frame based on the resistance change value, wherein the deformation parameters include the deformation amount and deformation direction of the mirror frame;
[0038] An adjustment module is used to adjust at least one of the left-eye display image and the right-eye display image in the near-eye display device according to the deformation parameters, until the left-eye display image and the right-eye display image overlap.
[0039] In addition, to achieve the above objectives, this application also proposes a near-eye display device, which includes: a lens frame provided with a variable resistor, a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the image processing method described above.
[0040] In addition, to achieve the above objectives, this application also proposes a storage medium, which is a computer-readable storage medium, on which a computer program is stored, and which, when executed by a processor, implements the steps of the image processing method described above.
[0041] In this application, a variable resistor is installed in the frame of the near-eye display device, and the deformation of the frame can be accurately detected by the resistance value of the variable resistor. Furthermore, after the wearer puts on the near-eye display device, the change in resistance of the variable resistor is detected in real time, and the deformation parameters of the frame, namely the amount and direction of deformation, are determined based on the resistance change. Then, at least one of the left-eye and right-eye display images in the near-eye display device is adjusted according to the amount and direction of deformation until the left-eye and right-eye display images overlap. This avoids the phenomenon of ghosting caused by frame deformation when different users wear the near-eye display device due to different head circumferences. By checking the resistance change of the variable resistor after the user wears the near-eye display device, it is determined whether the frame has been deformed. If deformation is found, at least one of the left-eye and right-eye display images is adjusted according to the amount and direction of deformation until the left-eye and right-eye display images overlap. This allows different users to see a clear, ghost-free display image when wearing the near-eye display device. Attached Figure Description
[0042] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.
[0043] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0044] Figure 1 This is a partial architectural diagram of the near-eye display device in the image processing method of this application;
[0045] Figure 2 This is a schematic diagram of a scene in the image processing method of this application where a lens frame with a variable resistor is provided inside the near-eye display device;
[0046] Figure 3 This is a schematic flowchart of the steps in the first embodiment of the image processing method of this application;
[0047] Figure 4 This is a schematic diagram of pixel adjustment of a target display image in the first embodiment of the image processing method of this application;
[0048] Figure 5 This is another schematic diagram illustrating pixel adjustment of the target display image in the first embodiment of the image processing method of this application;
[0049] Figure 6 This is another schematic diagram illustrating pixel adjustment of the target display image in the first embodiment of the image processing method of this application;
[0050] Figure 7 This is a schematic diagram showing the change in the virtual image distance at the meeting point of the eyes after the frame is deformed in the first embodiment of the image processing method of this application.
[0051] Figure 8 This is a schematic diagram of the module architecture of the image processing device of this application;
[0052] Figure 9 This is a schematic diagram of the device structure of the hardware operating environment involved in the image processing method in the embodiments of this application.
[0053] The purpose, features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation
[0054] It should be understood that the specific embodiments described herein are merely illustrative of the technical solutions of this application and are not intended to limit this application.
[0055] To better understand the technical solution of this application, a detailed description will be provided below in conjunction with the accompanying drawings and specific implementation methods.
[0056] It should be noted that the entity executing the image processing method in this embodiment can be a near-eye display device, and the near-eye display device includes a frame with a variable resistor. Optionally, the near-eye display device can be AR glasses, or other smart glasses. The following is only an example using AR glasses.
[0057] Optionally, such as Figure 1 As shown, the AR glasses include a processor (CPU), a display module (including but not limited to Birdbathfreeform waveguide), a camera module, a microphone (MIC), a speaker (SPK), an inertial measurement unit (IMU) sensor, a Wi-Fi BT communication module, and a deformation detection module.
[0058] Optionally, the CPU acts as the main processor, processing various information, controlling the operation of each module, and implementing the various steps of the image processing method in this embodiment. The deformation detection module can detect the amount of change in the lens frame. The display module can improve the binocular fusion effect by controlling the up, down, left, and right movement of the pixels on the display screen based on the amount and direction of the change in the lens frame, thereby avoiding ghosting caused by lens frame deformation in near-eye display devices.
[0059] Optionally, such as Figure 2As shown, a variable resistor can be installed in the frame of the near-eye display device. Specifically, the variable resistor can be installed in the left frame (the frame in front of the wearer's left eye when the wearer is wearing the near-eye display device) or the right frame (the frame in front of the wearer's right eye when the wearer is wearing the near-eye display device). Alternatively, variable resistors can be installed in both the left and right frames of the near-eye display device.
[0060] Optionally, when setting the variable resistor in the frame, the location of the variable resistor in the frame (such as the area with the largest deformation of the frame) can be determined based on the experimental results of the simulation experiment conducted in advance, and at least one set of variable resistors can be set in that location.
[0061] Optionally, the variable resistor can be a strain gauge or a resistance sensor that detects frame deformation. Optionally, the resistance value of the variable resistor can change as the frame deforms. For example, if variable resistors are provided in both the left and right eyeglass frames, when both frames deform, the resistance value of the variable resistor in the left frame will change, and the resistance value of the variable resistor in the right frame will also change.
[0062] Based on this, embodiments of this application provide an image processing method, referring to... Figure 3 , Figure 3 This is a flowchart illustrating the first embodiment of the image processing method of this application.
[0063] In this embodiment, the image processing method is applied to a near-eye display device, which includes a lens frame with a variable resistor.
[0064] Optionally, the image processing method includes steps S10 to S30.
[0065] Step S10: After the wearer wears the near-eye display device, the resistance change value of the variable resistor is detected in real time;
[0066] Optionally, due to differences in head circumference among wearers—for example, a child's head circumference is smaller than an adult's, and a larger-faced, heavier person's head circumference is larger than a smaller-faced, thinner person's—different users wearing near-eye display devices may experience frame distortion (e.g., distortion of the left and / or right eyeglass frame). This can lead to ghosting in the displayed image, affecting the wearer's viewing experience.
[0067] Optionally, the near-eye display device in this embodiment is in normal working condition. After the wearer puts on the near-eye display device, the resistance value of the variable resistor is detected in real time to determine whether the resistance of the variable resistor has changed based on the actual detected resistance value. If the resistance of the variable resistor changes, it can be determined that the frame of the near-eye display device has been deformed.
[0068] Optionally, if the left eyeglass frame of the near-eye display device is equipped with a variable resistor, and the resistance value of the variable resistor in the left eyeglass frame changes after the wearer wears the near-eye display device, then it can be determined that the left eyeglass frame has been deformed.
[0069] Optionally, if the right eyeglass frame of the near-eye display device is equipped with a variable resistor, and the resistance value of the variable resistor in the right eyeglass frame changes after the wearer wears the near-eye display device, then it can be determined that the right eyeglass frame has been deformed.
[0070] Optionally, when it is determined that the left and / or right eyeglass frames of the near-eye display device are deformed, it is also necessary to determine the resistance change value of the variable resistor in real time. For the same eyeglass frame, the actual resistance value of the variable resistor detected at the current moment can be compared with the resistance value set at the factory of the near-eye display device to determine the corresponding resistance change value.
[0071] Optionally, in one scenario embodiment, for the same frame, the difference between the resistance value of the variable resistor when the near-eye display device is not worn by the wearer and the resistance value of the variable resistor after the near-eye display device is worn by the wearer can be detected and used as the resistance change value.
[0072] Step S20: Determine the deformation parameters of the frame based on the resistance change value;
[0073] It should be noted that the deformation parameters include the amount and direction of deformation of the eyeglass frame. Optionally, the deformation parameters may include the amount and direction of deformation of the left eyeglass frame. The deformation parameters may also include the amount and direction of deformation of the right eyeglass frame.
[0074] Optionally, when it is determined that the lens frame in the near-eye display device is deformed, the direction of deformation of the lens frame, such as left, right, up, or down, can be determined.
[0075] Optionally, the deformation direction of the mirror frame can be determined by collecting data from a direction sensor installed on the frame.
[0076] Optionally, in one scenario embodiment, a direction-sensitive variable resistor can be installed at different key locations on the frame, or multiple variable resistors arranged in different directions can be installed at the same location to capture the deformation of the frame in different directions and obtain the deformation direction of the frame.
[0077] Optionally, if a variable resistor is provided in the left eyeglass frame, the deformation direction of the left eyeglass frame can be determined when the deformation occurs based on the resistance change of the variable resistor, and the deformation amount of the left eyeglass frame can be determined based on the resistance change. The deformation amount and direction of the left eyeglass frame are then used as deformation parameters of the left eyeglass frame. Optionally, a simulation experiment can be conducted on the near-eye display device in advance to obtain a first mapping relationship between the resistance change of the left eyeglass frame and the deformation amount of the left eyeglass frame. After detecting the actual resistance change of the left eyeglass frame, the corresponding deformation amount of the left eyeglass frame is determined according to the first mapping relationship.
[0078] Optionally, if a variable resistor is provided in the right eyeglass frame, the deformation direction of the right eyeglass frame can be determined when the deformation occurs based on the resistance change of the variable resistor, and the deformation amount of the right eyeglass frame can be determined based on the resistance change. The deformation amount and direction of the right eyeglass frame are then used as deformation parameters of the right eyeglass frame. Optionally, a simulation experiment can be conducted on the near-eye display device in advance to obtain a second mapping relationship between the resistance change of the right eyeglass frame and the deformation amount of the right eyeglass frame. After detecting the actual resistance change of the right eyeglass frame, the corresponding deformation amount of the right eyeglass frame is determined according to the second mapping relationship.
[0079] Step S30: Adjust at least one of the left-eye display and the right-eye display in the near-eye display device according to the deformation parameters until the left-eye display and the right-eye display overlap.
[0080] Optionally, the left eye display is the display that the wearer can see through the left eyeglass of the near-eye display device.
[0081] Optionally, the right eye display is the display that the wearer can see through the right eyeglasses of the near-eye display device.
[0082] Optionally, the pixel position of the left-eye display can be adjusted according to the deformation parameters, the pixel position of the right-eye display can be adjusted according to the deformation parameters, or the pixel position of both the left-eye and right-eye display can be adjusted simultaneously according to the deformation parameters.
[0083] Optionally, when the deformation parameter is the deformation parameter of the frame corresponding to the left eye display, the pixel position of the left eye display can be adjusted, such as by moving it horizontally or vertically, until the left eye display and the right eye display overlap.
[0084] Optionally, when the deformation parameter is the deformation parameter of the frame corresponding to the right eye display, the pixel position of the right eye display can be adjusted, such as by moving it horizontally or vertically, until the left eye display and the right eye display overlap.
[0085] Optionally, when the deformation parameters include the deformation parameters of the lens frame corresponding to the left-eye display and the lens frame corresponding to the right-eye display, the pixel positions of both the left-eye and right-eye displays can be adjusted simultaneously, such as by moving them horizontally or vertically. For example, the left-eye display moves 5 pixels to the right and then 3 pixels upwards. The right-eye display moves 5 pixels to the left and then 3 pixels downwards. At this point, the left-eye and right-eye displays are aligned horizontally and vertically. Therefore, the left-eye and right-eye displays can be considered to overlap.
[0086] For example, such as Figure 4 As shown, the graphic is aligned vertically by adjusting the screen's vertical movement. Figure 5 As shown, the horizontal alignment of the graphic is achieved by adjusting the display screen to move left or right. Figures 4-5 The operation yields the following result: Figure 6 The horizontal and vertical directions are blended as shown. Optionally, the moving display screen can be a left-eye display screen and / or a right-eye display screen.
[0087] Optionally, different users can have different head circumference sizes adapted based on the detected amount of frame deformation when using near-eye display devices.
[0088] Different head circumferences exert different pressures on the eyeglass frames, resulting in varying degrees of frame deformation. Consequently, the angle at which the displayed image enters the wearer's eyes changes with the frame deformation, causing the perceived image to shift forward or backward. Figure 7 As shown, the point of convergence between the wearer's left and right eyes changes from virtual image distance 1 to virtual image distance 2.
[0089] In this embodiment, a variable resistor is installed in the frame of the near-eye display device, allowing for accurate detection of frame deformation based on the resistance value. Furthermore, the resistance change of the variable resistor is monitored in real-time after the wearer puts on the near-eye display device, and the deformation parameters of the frame, namely the amount and direction of deformation, are determined based on this change. Then, at least one of the left-eye and right-eye display images within the near-eye display device is adjusted according to the amount and direction of deformation until the left-eye and right-eye display images overlap. This avoids the ghosting phenomenon caused by frame deformation due to different head circumferences among different users. By checking the resistance change of the variable resistor after the user puts on the near-eye display device to determine if the frame is deformed, and adjusting at least one of the left-eye and right-eye display images according to the amount and direction of deformation until the left-eye and right-eye display images overlap, different users can see a clear, ghosting-free display image when wearing the near-eye display device.
[0090] Based on the first embodiment of this application, a second embodiment of this application is proposed. In this second embodiment, content that is the same as or similar to the above embodiment can be referred to the above description and will not be repeated hereafter. Based on this, step S30, which involves adjusting at least one of the left-eye display image and the right-eye display image in the near-eye display device according to deformation parameters until the left-eye display image and the right-eye display image overlap, includes steps a10-a30.
[0091] Step a10: Determine the target display image that needs to be adjusted within the near-eye display device based on the deformation parameters;
[0092] It should be noted that the target display includes at least one of the left-eye display and the right-eye display.
[0093] Optionally, after determining the deformation parameters, the frame that will be deformed can be determined based on the deformation parameters. If the deformation parameters are the deformation parameters of the frame corresponding to the left-eye display, then the frame that will be deformed is determined to be the frame corresponding to the left-eye display, and the left-eye display can be used as the target display that needs to be adjusted.
[0094] Optionally, if the deformation parameter is the deformation parameter of the frame corresponding to the right eye display, then the frame that is deformed is determined to be the frame corresponding to the right eye display, and the right eye display can be used as the target display that needs to be adjusted.
[0095] Optionally, if the deformation parameters include the deformation parameters of the frame corresponding to the left-eye display and the deformation parameters of the frame corresponding to the right-eye display, then it is determined that both the frame corresponding to the left-eye display and the frame corresponding to the right-eye display are deformed. In this case, the left-eye display and the right-eye display can be used as the target display images that need to be adjusted.
[0096] Furthermore, in one feasible embodiment, the frame includes a left eyeglass frame and a right eyeglass frame.
[0097] Optionally, the left eyeglass frame can be the frame directly in front of the wearer's left eye after the wearer wears the near-eye display device, that is, the frame corresponding to the display screen on the left eye.
[0098] Optionally, the right eyeglass frame can be the frame directly in front of the wearer's right eye after the wearer wears the near-eye display device, that is, the frame corresponding to the display screen on the right eye.
[0099] Optionally, step a10, which involves determining the target display image that needs to be adjusted within the near-eye display device based on the deformation parameters, includes steps a11-a13.
[0100] Step a11: If the deformation parameters include the deformation parameters of the left eyeglass frame, then the left eye display image is determined as the target display image;
[0101] Optionally, at least one set of variable resistors can be provided in the left eyeglass frame of the near-eye display device.
[0102] Optionally, when the wearer is wearing the near-eye display device, the resistance change of the variable resistor in the left eyeglass frame can be detected in real time. That is, it detects whether the resistance value of the variable resistor in the left eyeglass frame changes. If a change occurs, it is determined that the left eyeglass frame has deformed. At this point, the deformation parameters of the left eyeglass frame can be directly determined based on the resistance change of the variable resistor, and the left-eye display image can be identified as the target display image that needs adjustment. Optionally, the deformation parameters of the left eyeglass frame include the amount and direction of deformation.
[0103] Optionally, simulation experiments can be conducted in advance to determine the mapping relationship between the resistance change of the variable resistor in the left eyeglass frame and the deformation of the left eyeglass frame, and this mapping relationship can be used as the first mapping relationship.
[0104] Optionally, when the resistance change value of the variable resistor in the left eyeglass frame is obtained at the current moment, the corresponding deformation amount can be found in the first mapping relationship based on the resistance change value, and used as the deformation amount of the left eyeglass frame at the current moment.
[0105] Optionally, the deformation direction of the left eyeglass frame can be determined based on a direction-sensitive variable resistor within the left eyeglass frame. Alternatively, a deformation direction detection sensor can be installed in the left eyeglass frame, and the deformation direction can be determined based on the result detected by the sensor.
[0106] Step a12: If the deformation parameters include the deformation parameters of the right eyeglass frame, then determine the right eye display as the target display;
[0107] Optionally, at least one set of variable resistors can be provided in the right eyeglass frame of the near-eye display device.
[0108] Optionally, when the wearer is wearing the near-eye display device, the resistance change of the variable resistor in the right eyeglass frame can be detected in real time. That is, it detects whether the resistance value of the variable resistor in the right eyeglass frame changes. If a change occurs, it is determined that the right eyeglass frame is deformed. At this point, the deformation parameters of the right eyeglass frame can be directly determined based on the resistance change of the variable resistor, and the right-eye display image can be determined as the target display image that needs adjustment. Optionally, the deformation parameters of the right eyeglass frame include the amount and direction of deformation.
[0109] Optionally, simulation experiments can be conducted in advance to determine the mapping relationship between the resistance change of the variable resistor in the right eyeglass frame and the deformation of the right eyeglass frame, and this relationship can be used as a second mapping relationship.
[0110] Optionally, when the resistance change value of the variable resistor in the right eyeglass frame is obtained at the current moment, the corresponding deformation amount can be found in the second mapping relationship based on the resistance change value, and used as the deformation amount of the right eyeglass frame at the current moment.
[0111] Optionally, the deformation direction of the right eyeglass frame can be determined based on a direction-sensitive variable resistor within the right eyeglass frame. Alternatively, a deformation direction detection sensor can be installed in the right eyeglass frame, and the deformation direction can be determined based on the result detected by the sensor.
[0112] Step a13: If the deformation parameters include the deformation parameters of the left eyeglass frame and the right eyeglass frame, then the left eye display image and the right eye display image are determined as the target display images.
[0113] Optionally, at least one set of variable resistors can be provided in the left and right eyeglass frames of the near-eye display device, respectively.
[0114] Optionally, after the wearer wears the near-eye display device, the resistance change of the variable resistors in the left and right eyeglass frames can be detected simultaneously to determine whether the left and right eyeglass frames have been deformed.
[0115] If both the left and right eyeglass frames are deformed, the deformation parameters of the left and right eyeglass frames can be determined. The specific determination process can be found in steps a11-a12 above. The left-eye display image and the right-eye display image can then be directly used as the target display image.
[0116] In this embodiment, when the deformation parameters include the deformation parameters of the left eyeglass frame, the left eye display is determined as the target display image; when the deformation parameters include the deformation parameters of the right eyeglass frame, the right eye display is determined as the target display image; and when the deformation parameters include the deformation parameters of both the left and right eyeglass frames, both the left and right eye display images are determined as target display images. This ensures that the target display image that needs adjustment is closely related to the deformed eyeglass frame, guaranteeing the effectiveness of the determined target display image.
[0117] Step a20: Determine the moving direction of the target display image based on the deformation direction of the frame, and determine the number of pixels that the target display image needs to move in the moving direction based on the deformation amount of the frame.
[0118] Optionally, when the frame is stretched and deformed, the direction of movement of the target display image is the opposite of the deformation direction of the frame. This means that the pixel positions of the target display image need to be adjusted outwards.
[0119] Optionally, when the frame is compressed and deformed, the movement direction of the target display image is consistent with the deformation direction of the frame. This means that the pixel positions of the target display image need to be adjusted inwards.
[0120] Optionally, the deformation amount is directly proportional to the number of pixels that need to be moved; the greater the deformation amount, the more pixels need to be moved. Furthermore, simulation experiments can be conducted in advance to determine the number of pixels that need to be moved for different deformation amounts, and a corresponding mapping relationship can be established, serving as a third mapping relationship. Then, after determining the direction of movement of the target display image at the current moment, the number of pixels that the target display image needs to move in that direction can be obtained by querying the deformation amount of the frame and the third mapping relationship.
[0121] Optionally, in one scenario embodiment, simulation experiments can be conducted in advance to determine the direction of movement and the number of pixels in the movement direction required to adjust the frame when it undergoes different degrees of stretching deformation, and this information is stored in a preset deformation pixel file. In practical applications, if the frame deforms, the direction of movement required for the target display image can be determined based on the deformation direction of the frame. The deformation pixel file is then queried based on this direction and the amount of deformation of the frame to obtain the number of pixels the target display image needs to move in that direction. This allows control to move the target display image by the specified number of pixels in that direction, ensuring that the left-eye and right-eye display images overlap.
[0122] Optionally, in one scenario embodiment, a large model can be created. The deformation amount and deformation direction of the frame are input into the large model, and the number of pixels that the target display image needs to move in the movement direction is output. The large model can determine how to change the position of each pixel in the target display image based on the deformation amount, that is, it can determine the movement direction based on the deformation direction and determine the number of pixels to move in the movement direction based on the deformation amount.
[0123] Step a30: Adjust the pixels of the target display screen according to the movement direction and the number of pixels until the left eye display screen and the right eye display screen overlap.
[0124] Optionally, pixel adjustment may include operations such as translation, scaling, and rotation of individual pixels in the target display screen.
[0125] Optionally, there can be one or more movement directions, and each movement direction has a corresponding number of pixels.
[0126] Optionally, the target display screen can be controlled to move a certain number of pixels in the direction of movement. For example, if the direction of movement includes horizontal movement, and the movement is to the left, and the number of pixels is 3, the target display screen can be controlled to move 3 pixels to the left in the horizontal direction.
[0127] Then, check whether the left-eye and right-eye displays are aligned horizontally and vertically.
[0128] If the left-eye display and the right-eye display are aligned horizontally and vertically, then the left-eye display and the right-eye display are considered to overlap.
[0129] If the images displayed to the left and right eyes are not aligned horizontally and / or vertically, pixel adjustments can be made to the images to ensure they overlap. This can be done by scaling down or enlarging the images, rotating them, etc.
[0130] In this embodiment, the target display screen is determined based on the deformation parameters, and the movement direction of the target display screen is determined based on the deformation direction of the lens frame. The number of pixels that need to be moved in the movement direction is determined based on the deformation amount. Then, the target display screen is controlled to adjust the pixels according to the movement direction and the number of pixels until the left eye display screen and the right eye display screen overlap. This can prevent the near-eye display device from displaying ghosting due to lens frame deformation.
[0131] Furthermore, in a feasible embodiment, step a30, which involves controlling the pixel adjustment of the target display screen based on the movement direction and the number of pixels, further includes steps b10-b30.
[0132] Step b10: If the target display is the left eye display, then control the left eye display to move by a certain number of pixels in the moving direction.
[0133] Step b20: Detect whether the left-eye display is horizontally and vertically aligned with the right-eye display after the movement;
[0134] Step b30: If the moved left-eye display is not horizontally or vertically aligned with the right-eye display, then the moved left-eye display is scaled according to the preset first scaling factor until the left-eye display and the right-eye display are horizontally and vertically aligned.
[0135] Optionally, if the target display is the left-eye display (i.e., the left eyeglass frame is distorted while the right eyeglass frame is not), then pixel adjustment of the left-eye display is required. After determining the direction in which the left-eye display needs to be moved and the number of pixels that need to be moved in that direction, the number of pixels moved in the left-eye display in that direction can be controlled. After this movement, the left-eye and right-eye displays will be located in the same area.
[0136] Alternatively, horizontal and vertical alignment can be either horizontal alignment or vertical alignment.
[0137] Optionally, it can be detected whether the moved left-eye display is horizontally aligned with the right-eye display and vertically aligned. If the moved left-eye display is horizontally aligned with the right-eye display and vertically aligned, then the left-eye display and the right-eye display are determined to overlap.
[0138] If the horizontal or vertical alignment is incorrect, it indicates that the left and right eye displays are not overlapping, and the pixels of the moved left eye display need to be adjusted again.
[0139] If the left eyeglass frame is stretched and deformed, and the left eye display after the movement is smaller than the right eye display, then the magnification factor in the first scaling factor is determined, and the left eye display after the movement is magnified according to the magnification factor until the adjusted left eye display and the right eye display overlap.
[0140] If the left eyeglass frame is compressed and deformed, and the left eye display is larger than the right eye display after the movement, then the reduction factor in the first scaling factor is determined, and the left eye display is reduced according to the reduction factor until the adjusted left eye display and the right eye display overlap.
[0141] Optionally, the magnification factor and reduction factor in the first scaling factor can be set according to user needs.
[0142] In addition, if the display angles of the left-eye and right-eye images are inconsistent after the movement, the left-eye image can be rotated until the display angles of the left-eye and right-eye images are consistent and overlap.
[0143] In this embodiment, when the target display screen is determined to be the left-eye display screen, the left-eye display screen is moved by a number of pixels in the moving direction. When the left-eye display screen and the right-eye display screen are not horizontally or vertically aligned after the movement, the left-eye display screen is scaled according to the first scaling factor until the left-eye display screen and the right-eye display screen are horizontally and vertically aligned, that is, the left-eye display screen and the right-eye display screen overlap at this time. This can avoid the phenomenon of ghosting caused by the deformation of the lens frame in the near-eye display device.
[0144] Furthermore, in a feasible embodiment, step a30, which involves controlling the target display screen to adjust pixels based on the direction of movement and the number of pixels, further includes steps c10-c30.
[0145] Step c10: If the target display is the right eye display, then control the right eye display to move by a certain number of pixels in the moving direction.
[0146] Step c20: Detect whether the right eye display is horizontally and vertically aligned with the left eye display after the movement;
[0147] Step c30: If the right eye display after movement is not horizontally or vertically aligned with the left eye display, then the right eye display after movement is scaled according to the preset second scaling factor until the left eye display and the right eye display are horizontally and vertically aligned.
[0148] Optionally, if the target display is for the right eye (i.e., the right eyeglass frame is distorted while the left eyeglass frame is not), then pixel adjustment of the right eye display is required. After determining the direction in which the right eye display needs to move and the number of pixels that need to be moved in that direction, the number of pixels moved in that direction can be controlled. After this movement, the right eye display and the left eye display will be located in the same position area.
[0149] Alternatively, horizontal and vertical alignment can be either horizontal alignment or vertical alignment.
[0150] Optionally, it can be detected whether the right-eye display after movement is horizontally aligned with the left-eye display and vertically aligned. If the right-eye display after movement is horizontally aligned with the left-eye display and vertically aligned, then it is determined that the left-eye display and the right-eye display overlap.
[0151] If the horizontal or vertical alignment is incorrect, it indicates that the left and right eye displays are not overlapping, and the right eye display needs to be re-adjusted in pixels after being moved.
[0152] If the right eyeglass frame is stretched and deformed, and the right eye display after the movement is smaller than the left eye display, then the magnification factor in the second scaling factor is determined, and the right eye display after the movement is magnified according to the magnification factor until the adjusted right eye display and the left eye display overlap.
[0153] If the right eyeglass frame is compressed and deformed, and the right eye display is larger than the left eye display after the movement, then the reduction factor in the first scaling factor is determined, and the right eye display is reduced according to the reduction factor until the adjusted right eye display and the left eye display overlap.
[0154] Optionally, the magnification factor and reduction factor in the second scaling factor can be set according to user needs.
[0155] In addition, if the display angles of the right-eye display and the left-eye display are inconsistent after the movement, the right-eye display can be rotated until the display angles of the left-eye display and the right-eye display are consistent and overlap.
[0156] In this embodiment, when the target display screen is determined to be the right-eye display screen, the number of pixels that the right-eye display screen moves in the moving direction is controlled. When the right-eye display screen and the left-eye display screen are not horizontally and vertically aligned after the movement, the right-eye display screen is scaled according to the second scaling factor until the left-eye display screen and the right-eye display screen are horizontally and vertically aligned, that is, the left-eye display screen and the right-eye display screen overlap at this time. This can avoid the phenomenon of ghosting caused by the deformation of the lens frame in the near-eye display device.
[0157] Furthermore, in one feasible embodiment, the movement direction includes a first movement direction in which the left eye display needs to move and a second movement direction in which the right eye display needs to move, and the number of pixels includes the number of first pixels to be moved in the first movement direction and the number of second pixels to be moved in the second movement direction.
[0158] Optionally, step a30, which involves adjusting the pixels of the target display screen based on the direction of movement and the number of pixels, further includes steps d10-d30.
[0159] Step d10: If the target display screen is a left-eye display screen and a right-eye display screen, then control the left-eye display screen to move by a first number of pixels in the first moving direction, and control the right-eye display screen to move by a second number of pixels in the second moving direction.
[0160] Step d20: Detect whether the left eye display after the movement is horizontally and vertically aligned with the right eye display after the movement;
[0161] In step d30, if the left-eye display and the right-eye display are horizontally and vertically aligned after the movement, then the left-eye display and the right-eye display are confirmed to overlap.
[0162] Optionally, if both the left and right eyeglass frames in the near-eye display device are deformed, pixel adjustments can be made to both the left-eye and right-eye display images. Alternatively, pixel adjustments can be made to only one of the left-eye and right-eye display images; the specific steps for pixel adjustment can be found in the above embodiments.
[0163] Optionally, a first movement direction corresponding to the left-eye display and the number of first pixels to be moved in the first movement direction can be determined. A second movement direction corresponding to the right-eye display and the number of second pixels to be moved in the second movement direction can also be determined.
[0164] Optionally, the left eye display can be moved by a first number of pixels in the first moving direction, and the right eye display can be moved by a second number of pixels in the second moving direction.
[0165] The first and second movement directions can be at least one of the following: horizontal movement to the left, horizontal movement to the right, vertical movement upward, and vertical movement downward.
[0166] For example, control the left eye to move the display horizontally to the right by 5 pixels, and control the right eye to move the display horizontally to the left by 5 pixels.
[0167] Optionally, it can be detected whether the moved left-eye display is horizontally aligned with the moved right-eye display, and vertically aligned as well. If the moved left-eye display is horizontally aligned with the moved right-eye display, and vertically aligned as well, then it is determined that the left-eye display and the right-eye display overlap.
[0168] If the horizontal or vertical alignment is incorrect, it indicates that the left and right eye displays are not overlapping, and the pixels of the moved left eye display need to be adjusted again.
[0169] For example, at least one of the moved left-eye display and the moved right-eye display can be scaled down, and / or scaled up, and / or rotated, and / or translated until the left-eye display and the right-eye display overlap.
[0170] In this embodiment, when the target display screen is determined to be the left-eye display screen and the right-eye display screen, the left-eye display screen is controlled to move by a first number of pixels in the first moving direction, and the right-eye display screen is controlled to move by a second number of pixels in the second moving direction. When the moved left-eye display screen and the moved right-eye display screen are horizontally and vertically aligned, it is determined that the left-eye display screen and the right-eye display screen coincide. This can prevent the near-eye display device from displaying ghosting due to lens frame deformation.
[0171] Based on the first or second embodiment of this application, a third embodiment of this application is proposed. In this third embodiment, content that is the same as or similar to the above embodiments can be referred to the above description and will not be repeated hereafter. Based on this, step S10, the step of real-time detection of the resistance change value of the variable resistor, includes step c10.
[0172] Step c10: Determine the resistance difference between the actual resistance value of the variable resistor and the preset reference resistance value in real time, and use the resistance difference as the resistance change value.
[0173] Optionally, the reference resistance value includes the reference resistance value of the variable resistor in the left and / or right eyeglass frames, and is the resistance value of the variable resistor when the left and right eyeglass frames in the near-eye display device are not deformed.
[0174] Optionally, the left and / or right eyeglass frames equipped with variable resistors can be detected in real time.
[0175] Optionally, if, after the wearer wears the near-eye display device, a difference is found between the actual resistance value of the variable resistor in the left eyeglass frame and the preset reference resistance value, then it is determined that the left eyeglass frame is deformed, and the resistance difference between the actual resistance value and the reference resistance value in the left eyeglass frame is determined as the resistance change value of the left eyeglass frame. If a difference is found between the actual resistance value of the variable resistor in the right eyeglass frame and the preset reference resistance value, then it is determined that the right eyeglass frame is deformed, and the resistance difference between the actual resistance value and the reference resistance value in the right eyeglass frame is determined as the resistance change value of the right eyeglass frame.
[0176] Optionally, step S20, which involves determining the deformation parameters of the frame based on the resistance change value, includes steps d10 and d20.
[0177] Step d10: If the resistance difference is positive, then the deformation of the frame is determined to be the deformation caused by stretching the frame.
[0178] In step d20, if the resistance difference is negative, the deformation of the frame is determined to be the deformation caused by compression of the frame.
[0179] Optionally, if the resistance difference of the left eyeglass frame is positive, the deformation of the left eyeglass frame is determined to be the deformation caused by the stretching of the frame, and the direction of the stretching deformation of the left eyeglass frame is detected based on a variable resistor with direction sensitivity. If the resistance difference of the right eyeglass frame is positive, the deformation of the right eyeglass frame is determined to be the deformation caused by the stretching of the frame, and the direction of the stretching deformation of the right eyeglass frame is detected based on a variable resistor with direction sensitivity.
[0180] Optionally, if the resistance difference of the left eyeglass frame is negative, the deformation of the left eyeglass frame is determined to be the deformation caused by frame compression, and the direction of deformation of the left eyeglass frame during stretching is detected based on a variable resistor with direction sensitivity. If the resistance difference of the right eyeglass frame is negative, the deformation of the right eyeglass frame is determined to be the deformation caused by frame compression, and the direction of deformation of the right eyeglass frame during stretching is detected based on a variable resistor with direction sensitivity.
[0181] In this embodiment, the resistance change value is determined based on the resistance difference between the actual resistance value of the variable resistor and the reference resistance value. When the resistance difference is positive, the deformation amount is determined to be the deformation amount generated after the frame is stretched. When the resistance difference is negative, the deformation amount is determined to be the deformation amount generated after the frame is compressed. This ensures the effectiveness of the determined deformation amount of the frame.
[0182] Furthermore, embodiments of this application provide an image processing apparatus disposed in a near-eye display device, which also includes a lens frame provided with a variable resistor, as shown in the reference. Figure 8 The image processing apparatus includes:
[0183] The detection module A10 is used to detect the resistance change of the variable resistor in real time after the wearer wears the near-eye display device;
[0184] The module A20 is used to determine the deformation parameters of the frame based on the resistance change value, wherein the deformation parameters include the amount and direction of deformation of the frame.
[0185] The adjustment module A30 is used to adjust at least one of the left-eye display and the right-eye display in the near-eye display device according to the deformation parameters until the left-eye display and the right-eye display overlap.
[0186] The image processing apparatus provided in this application, employing the image processing method described in the above embodiments, can solve the technical problem of how to avoid ghosting in the displayed image due to lens frame deformation in near-eye display devices. Compared with the prior art, the beneficial effects of the image processing apparatus provided in this application are the same as those of the image processing method described in the above embodiments, and other technical features in the image processing apparatus are the same as those disclosed in the methods of the above embodiments, and will not be repeated here.
[0187] This application provides a near-eye display device, which includes: a lens frame provided with a variable resistor; at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, which are executed by the at least one processor to enable the at least one processor to perform the image processing method in the above embodiment 1.
[0188] The following is for reference. Figure 9 The figure illustrates a structural schematic diagram suitable for implementing near-eye display devices according to embodiments of this application. Near-eye display devices in embodiments of this application may include, but are not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Description), PMPs (Portable Media Players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. The device shown in the figure is merely an example and should not impose any limitations on the functionality and scope of use of embodiments of this application.
[0189] The near-eye display device may include a processing unit 1001 (e.g., a central processing unit, a graphics processing unit, etc.) that can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1003 into a random access memory (RAM) 1004. The RAM 1004 also stores various programs and data required for device operation. The processing unit 1001, ROM 1002, and RAM 1004 are interconnected via a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Typically, the following systems can be connected to the I / O interface 1006: input devices 1007 including, for example, touchscreens, touchpads, keyboards, mice, image sensors, microphones, accelerometers, gyroscopes, etc.; output devices 1008 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 1003 including, for example, magnetic tapes, hard disks, etc.; and communication devices 1009. The communication device 1009 allows the near-eye display device to communicate wirelessly or wiredly with other devices to exchange data. Although near-eye display devices with various systems are shown in the figures, it should be understood that implementation or possession of all the systems shown is not required. More or fewer systems may be implemented alternatively.
[0190] Specifically, according to the embodiments disclosed in this application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed in this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device, or installed from storage device 1003, or installed from ROM 1002. When the computer program is executed by processing device 1001, it performs the functions defined in the methods of the embodiments disclosed in this application.
[0191] The near-eye display device provided in this application, employing the image processing method described in the above embodiments, can solve the technical problem of how to avoid ghosting in the displayed image due to lens frame deformation. Compared with the prior art, the beneficial effects of the near-eye display device provided in this application are the same as those of the image processing method described in the above embodiments, and other technical features of this near-eye display device are the same as those disclosed in the previous embodiment method, and will not be repeated here.
[0192] It should be understood that the various parts disclosed in this application can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in any suitable manner in one or more embodiments or examples.
[0193] The above are merely specific embodiments of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
[0194] This application provides a computer-readable storage medium having computer-readable program instructions (i.e., a computer program) stored thereon, the computer-readable program instructions being used to execute the image processing method described in the above embodiments.
[0195] The computer-readable storage medium provided in this application may be, for example, a USB flash drive, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, system, or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination thereof.
[0196] The aforementioned computer-readable storage medium may be included in the near-eye display device; or it may exist independently and not assembled into the near-eye display device.
[0197] The aforementioned computer-readable storage medium carries one or more programs, which, when executed by a near-eye display device, enable the near-eye display device to perform the steps of the aforementioned image processing method.
[0198] Computer program code for performing the operations of this application can be written in one or more programming languages or a combination thereof, including object-oriented programming languages such as Java, Smalltalk, and C++, and conventional procedural programming languages such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a Local Area Network (LAN) or a Wide Area Network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0199] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.
[0200] The modules described in the embodiments of this application can be implemented in software or hardware. The names of the modules do not necessarily limit the functionality of the unit itself.
[0201] The readable storage medium provided in this application is a computer-readable storage medium that stores computer-readable program instructions (i.e., a computer program) for performing the above-described image processing method. This solves the technical problem of how to avoid ghosting in near-eye display devices due to lens frame distortion. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as those of the image processing method provided in the above embodiments, and will not be repeated here.
[0202] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the image processing method described above.
[0203] The computer program product provided in this application can solve the technical problem of how to avoid ghosting in near-eye display devices caused by lens frame deformation. Compared with the prior art, the beneficial effects of the computer program product provided in this application are the same as those of the image processing method provided in the above embodiments, and will not be repeated here.
[0204] The above are only some embodiments of this application and do not limit the patent scope of this application. All equivalent structural transformations made under the technical concept of this application and using the content of this application specification and drawings, or direct / indirect applications in other related technical fields, are included in the patent protection scope of this application.
Claims
1. An image processing method, characterized in that, The image processing method is applied to a near-eye display device, the near-eye display device including a lens frame with a variable resistor, and the image processing method includes the following steps: The resistance change of the variable resistor is detected in real time after the wearer wears the near-eye display device; The deformation parameters of the mirror frame are determined based on the resistance change value, wherein the deformation parameters include the amount and direction of deformation of the mirror frame; The deformation parameters are used to adjust at least one of the left-eye display and the right-eye display in the near-eye display device until the left-eye display and the right-eye display overlap.
2. The image processing method as described in claim 1, characterized in that, The step of adjusting at least one of the left-eye display image and the right-eye display image in the near-eye display device according to the deformation parameters until the left-eye display image and the right-eye display image overlap includes: The target display image that needs to be adjusted within the near-eye display device is determined based on the deformation parameters, wherein the target display image includes at least one of the left-eye display image and the right-eye display image; The direction of movement of the target display screen is determined based on the deformation direction of the frame, and the number of pixels that the target display screen needs to move in the direction of movement is determined based on the amount of deformation of the frame. The target display screen is adjusted according to the moving direction and the number of pixels until the left eye display screen and the right eye display screen overlap.
3. The image processing method as described in claim 2, characterized in that, The frame includes a left eyeglass frame and a right eyeglass frame. The step of determining the target display image that needs to be adjusted within the near-eye display device based on the deformation parameters includes: If the deformation parameters include the deformation parameters of the left eyeglass frame, then the left eye display image is determined to be the target display image; If the deformation parameters include the deformation parameters of the right eyeglass frame, then the right eye display image is determined to be the target display image; If the deformation parameters include the deformation parameters of the left eyeglass frame and the deformation parameters of the right eyeglass frame, then the left eye display image and the right eye display image are determined as the target display images.
4. The image processing method as described in claim 3, characterized in that, The step of controlling the target display screen to adjust pixels based on the movement direction and the number of pixels includes: If the target display screen is a left-eye display screen, then control the left-eye display screen to move by the number of pixels in the moving direction; Detect whether the left-eye display screen is horizontally and vertically aligned with the right-eye display screen after the movement; If the moved left-eye display is not horizontally or vertically aligned with the right-eye display, the moved left-eye display is scaled according to a preset first scaling factor until the left-eye display and the right-eye display are horizontally and vertically aligned.
5. The image processing method as described in claim 3, characterized in that, The step of controlling the target display screen to adjust pixels based on the movement direction and the number of pixels further includes: If the target display is a right-eye display, then control the right-eye display to move by the number of pixels in the moving direction; Detect whether the right-eye display screen is horizontally and vertically aligned with the left-eye display screen after the movement; If the right-eye display after movement is not horizontally or vertically aligned with the left-eye display, the right-eye display after movement is scaled according to a preset second scaling factor until the left-eye display and the right-eye display are horizontally and vertically aligned.
6. The image processing method as described in claim 3, characterized in that, The movement direction includes a first movement direction in which the left eye display needs to move and a second movement direction in which the right eye display needs to move; the number of pixels includes the number of first pixels to be moved in the first movement direction and the number of second pixels to be moved in the second movement direction. The step of controlling the target display screen to adjust pixels based on the movement direction and the number of pixels further includes: If the target display screen is a left-eye display screen and a right-eye display screen, then the left-eye display screen is controlled to move by the first number of pixels in the first moving direction, and the right-eye display screen is controlled to move by the second number of pixels in the second moving direction; Detect whether the left-eye display after movement is horizontally and vertically aligned with the right-eye display after movement; If the moved left-eye display and the moved right-eye display are horizontally and vertically aligned, then the left-eye display and the right-eye display are determined to overlap.
7. The image processing method according to any one of claims 1-6, characterized in that, The step of real-time detection of the resistance change value of the variable resistor includes: The resistance difference between the actual resistance value of the variable resistor and the preset reference resistance value is determined in real time, and the resistance difference is used as the resistance change value; The step of determining the deformation parameters of the mirror frame based on the resistance change value includes: If the resistance difference is positive, then the deformation of the frame is determined to be the deformation caused by stretching the frame. If the resistance difference is negative, then the deformation of the frame is determined to be the deformation caused by compression of the frame.
8. An image processing apparatus, characterized in that, The image processing device is disposed in the near-eye display device, the near-eye display device further includes a lens frame with a variable resistor, and the image processing device includes: The detection module is used to detect the resistance change of the variable resistor in real time after the wearer wears the near-eye display device; A determining module is used to determine the deformation parameters of the mirror frame based on the resistance change value, wherein the deformation parameters include the deformation amount and deformation direction of the mirror frame; An adjustment module is used to adjust at least one of the left-eye display image and the right-eye display image in the near-eye display device according to the deformation parameters, until the left-eye display image and the right-eye display image overlap.
9. A near-eye display device, characterized in that, The near-eye display device includes: a lens frame with a variable resistor, a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the image processing method as described in any one of claims 1 to 7.
10. A storage medium, characterized in that, The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, it implements the steps of the image processing method as described in any one of claims 1 to 7.