Pupil distance adjustment method and device, electronic equipment and readable storage medium

Abstract

The application discloses a pupil distance adjusting method and device, electronic equipment and a readable storage medium. The pupil distance adjusting method is used for a display device, the display device comprises two display modules, and the adjusting method comprises the following steps: acquiring a first convergence angle when a double-eye observation image observes a first target in the case of displaying an image; determining a depth distance when the double eyes observe a second target according to a first aberration when the double eyes observe the first target, wherein the first aberration is a distance difference between a position of the first target observed by a left eye in the image and a position of the first target observed by a right eye in the image, and the second target is any target in the image except the first target; determining a second convergence angle when the double eyes observe the second target according to a second aberration when the double eyes observe the second target and the depth distance; determining a pupil distance change value according to the second convergence angle and the first convergence angle; and adjusting a distance between center points of the two display modules according to the pupil distance change value.

Description

Technical Field

[0001] This application belongs to the field of electronic equipment technology, and specifically relates to a method, device, electronic device and readable storage medium for adjusting interpupillary distance. Background Technology

[0002] In related technologies, head-mounted display devices typically have interpupillary distance (IPD) adjustment functionality, which adjusts the distance between the two display modules of the head-mounted display device to accommodate the interpupillary distance between the user's eyes when viewing, ensuring a good viewing experience. Existing adjustment methods simply calculate IPD by detecting eye movement. However, in actual use, even when users are viewing in the same direction, the IPD can vary depending on the object being viewed. Therefore, existing methods that rely solely on eye movement to determine IPD are inaccurate, resulting in a poor viewing experience for the user. Summary of the Invention

[0003] The purpose of this application is to provide a method, apparatus, electronic device, and readable storage medium for adjusting interpupillary distance, which can solve the problem that the method of determining interpupillary distance based on the movement of both eyes is not accurate enough in calculating changes in interpupillary distance.

[0004] In a first aspect, embodiments of this application provide a method for adjusting interpupillary distance. The method is used in a display device, which includes two display modules. The method includes:

[0005] In the case of displaying an image, obtain the first convergence angle when both eyes are observing the first target in the image;

[0006] Based on the first aberration when both eyes observe the first target, the depth distance when both eyes observe the second target is determined. The first aberration is the distance difference between the position of the first target observed by the left eye and the position of the first target observed by the right eye in the image. The second target is any target in the image other than the first target.

[0007] The second convergence angle of the two eyes when observing the second target is determined based on the second aberration and depth distance when the two eyes observe the second target.

[0008] The interpupillary distance variation value is determined based on the second convergence angle and the first convergence angle;

[0009] Adjust the distance between the center points of the two display modules based on the change in interpupillary distance.

[0010] Secondly, embodiments of this application provide an interpupillary distance adjustment device. The adjustment device is used in a display device, which includes two display modules. The adjustment device includes:

[0011] The acquisition unit is used to acquire the first convergence angle when the eyes are observing the first target in the image while the image is displayed;

[0012] The determining unit is used to determine the depth distance between the two eyes when observing the second target based on the first aberration when the two eyes observe the first target, wherein the first aberration is the distance difference between the position of the first target observed by the left eye and the position of the first target observed by the right eye in the image, and the second target is any target in the image other than the first target;

[0013] The determining unit is also used to determine the second convergence angle of the two eyes when observing the second target, based on the second aberration and depth distance when the two eyes observe the second target; and

[0014] The interpupillary distance variation value is determined based on the second convergence angle and the first convergence angle;

[0015] The adjustment unit is used to adjust the distance between the center points of the two display modules according to the change in interpupillary distance.

[0016] Thirdly, embodiments of this application provide an electronic device, including a processor and a memory, wherein the memory stores a program or instructions that can run on the processor, and when the program or instructions are executed by the processor, they implement the steps of the method as described in the first aspect.

[0017] Fourthly, embodiments of this application provide a readable storage medium on which a program or instructions are stored, which, when executed by a processor, implement the steps of the method as described in the first aspect.

[0018] Fifthly, embodiments of this application provide a chip including a processor and a communication interface coupled to the processor, the processor being used to run programs or instructions to implement the steps of the method as described in the first aspect.

[0019] In a sixth aspect, embodiments of this application provide a computer program product stored in a readable storage medium, which is executed by at least one processor to implement the method as described in the first aspect.

[0020] In this embodiment of the application, during the process of a user viewing an image through a display device, firstly, the first convergence angle when both eyes observe the first target in the image is obtained. It can be understood that the first convergence angle is the angle between the user's pupils and the line connecting the first target in the image.

[0021] Furthermore, based on the first aberration when the user's eyes observe the first target, the depth distance when the eyes observe the second target is determined. Here, the first aberration is the distance difference between the position of the first target in the image observed by the user's left eye and the position of the first target in the image observed by the user's right eye. Based on the first aberration, the depth distance of all targets in the image can be calculated, including the first target and any other target besides it. In other words, using the first aberration of the first target, the depth distance of the next target the user needs to view, i.e., the second target, can be calculated.

[0022] Furthermore, based on the second aberration when the second target is observed by both eyes and the depth distance of the second target, the second convergence angle when the user observes the second target can be calculated. Correspondingly, the second aberration when the user observes the second target by both eyes is also the distance difference between the position of the second target in the image observed by the user's left eye and the position of the second target in the image observed by the user's right eye.

[0023] Finally, based on the second convergence angle when both eyes observe the second target and the first convergence angle when both eyes observe the first target, the interpupillary distance variation value can be determined. This variation is the difference between the interpupillary distance when the user's eyes observe the second target and the interpupillary distance when observing the first target. Based on this interpupillary distance variation value, the distance between the center points of the two display modules of the display device can be adjusted to suit the user's interpupillary distance and ensure optimal viewing experience.

[0024] In calculating the interpupillary distance (IPD) when a user observes a second target, this embodiment utilizes not only the second phase difference between the two eyes when observing the second target but also considers the influence of depth distance on the IPD. Therefore, it simultaneously uses the second phase difference and the depth distance to calculate the second convergence angle, and then calculates the IPD based on the second convergence angle and the first convergence angle. This ensures that the change in IPD when a user observes targets in the same direction but at different distances can be calculated, thereby guaranteeing the accuracy of IPD adjustment and ensuring a better viewing experience for the user. Attached Figure Description

[0025] Figure 1 A flowchart illustrating the method for adjusting interpupillary distance according to an embodiment of this application is shown;

[0026] Figure 2 One of the flowcharts of the method for adjusting interpupillary distance according to an embodiment of this application is shown;

[0027] Figure 3 A second flowchart of the method for adjusting interpupillary distance according to an embodiment of this application is shown;

[0028] Figure 4A schematic diagram of the structure of a display device according to an embodiment of this application is shown;

[0029] Figure 5 One of the schematic diagrams of the interface for displaying images on a display device according to an embodiment of this application is shown;

[0030] Figure 6 This is a second schematic diagram of the interface of a display device displaying an image according to an embodiment of this application;

[0031] Figure 7 This is the third schematic diagram of the interface of the display device displaying images according to an embodiment of this application;

[0032] Figure 8 A structural block diagram of an interpupillary distance adjustment device according to an embodiment of this application is shown;

[0033] Figure 9 A structural block diagram of an electronic device according to an embodiment of this application is shown;

[0034] Figure 10 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of this application.

[0035] Figure label:

[0036] 400 Display device, 402 Eye tracking module, 404 Interpupillary distance adjustment module, 406 Display module, 408 Distance adjustment axis, 410 Screen content analysis module, 502 First target, 504 Second target. Detailed Implementation

[0037] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0038] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0039] The following description, in conjunction with the accompanying drawings, details the method, apparatus, electronic device, and readable storage medium for adjusting interpupillary distance provided in this application, through specific embodiments and application scenarios.

[0040] In some embodiments of this application, a method for adjusting interpupillary distance is provided for a display device, the display device including two display modules. Figure 1 A flowchart of the interpupillary distance adjustment method according to an embodiment of this application is shown, as follows: Figure 1 As shown, the methods for adjusting interpupillary distance include:

[0041] Step 102: With the image displayed, obtain the first convergence angle when both eyes are observing the first target in the image;

[0042] Step 104: Determine the depth distance of the two eyes when observing the second target based on the first aberration when observing the first target.

[0043] Wherein, the first aberration is the distance difference between the position of the first target observed by the left eye and the position of the first target observed by the right eye in the image, and the second target is any target in the image other than the first target;

[0044] Step 106: Determine the second convergence angle of the two eyes when observing the second target based on the second aberration and depth distance when the two eyes observe the second target;

[0045] Step 108: Determine the pupillary distance change value based on the second convergence angle and the first convergence angle;

[0046] Step 110: Adjust the distance between the center points of the two display modules according to the interpupillary distance change value.

[0047] In this embodiment of the application, during the process of a user viewing an image through a display device, firstly, the first convergence angle when both eyes observe the first target in the image is obtained. It can be understood that the first convergence angle is the angle between the user's pupils and the line connecting the first target in the image.

[0048] Furthermore, based on the first aberration when the user's eyes observe the first target, the depth distance when the eyes observe the second target is determined. Here, the first aberration is the distance difference between the position of the first target in the image observed by the user's left eye and the position of the first target in the image observed by the user's right eye. Based on the first aberration, the depth distance of all targets in the image can be calculated, including the first target and any other target besides it. In other words, using the first aberration of the first target, the depth distance of the next target the user needs to view, i.e., the second target, can be calculated.

[0049] Furthermore, based on the second aberration when the second target is observed by both eyes and the depth distance of the second target, the second convergence angle when the user observes the second target can be calculated. Correspondingly, the second aberration when the user observes the second target by both eyes is also the distance difference between the position of the second target in the image observed by the user's left eye and the position of the second target in the image observed by the user's right eye.

[0050] Finally, based on the second convergence angle when both eyes observe the second target and the first convergence angle when both eyes observe the first target, the interpupillary distance variation value can be determined. This variation is the difference between the interpupillary distance when the user's eyes observe the second target and the interpupillary distance when observing the first target. Based on this interpupillary distance variation value, the distance between the center points of the two display modules of the display device can be adjusted to suit the user's interpupillary distance and ensure optimal viewing experience.

[0051] In calculating the interpupillary distance (IPD) when a user observes a second target, this embodiment utilizes not only the second phase difference between the two eyes when observing the second target but also considers the influence of depth distance on the IPD. Therefore, it simultaneously uses the second phase difference and the depth distance to calculate the second convergence angle, and then calculates the IPD based on the second convergence angle and the first convergence angle. This ensures that the change in IPD when a user observes targets in the same direction but at different distances can be calculated, thereby guaranteeing the accuracy of IPD adjustment and ensuring a better viewing experience for the user.

[0052] In some embodiments of this application, determining the depth distance of the two eyes when observing a second target based on a first aberration when the two eyes observe a first target includes:

[0053] Based on the first aberration, a depth map of the image is determined, wherein the depth map is used to represent the depth distance of all targets in the image;

[0054] Determine the depth distance of the second target in the depth map.

[0055] In this embodiment, during the process of determining the depth distance when both eyes observe the second target, a depth map of the image is first generated based on the first aberration when both eyes observe the first target. That is, based on the first aberration when both eyes observe the first target, a distribution map representing the depth distances of all targets in the image can be generated. From the depth distribution map, the depth distances of all targets in the image when both eyes observe them can be determined. Therefore, when both eyes observe the second target, the depth distance of the second target can be determined from the depth map. Furthermore, when both eyes observe the second target, the second convergence angle when both eyes observe the second target is determined based on the second aberration and the depth distance of the second target.

[0056] This application embodiment determines the depth map of all targets in an image based on the first aberration when both eyes observe the first target. This allows the user's eyes to directly determine the depth distance of the second target from the depth map when observing it. This effectively simplifies the depth distance determination process, thereby improving the efficiency of the interpupillary distance determination process.

[0057] In some embodiments of this application, before determining the second convergence angle of the eyes when observing the second target based on the second aberration and depth distance when both eyes observe the second target, the adjustment method further includes:

[0058] With both eyes observing the second target, obtain the first position of the second target in the image as observed by the left eye;

[0059] Obtain the second position of the second target observed by the right eye in the image;

[0060] The second aberration is determined based on the first and second positions.

[0061] In this embodiment of the application, the second aberration when the user observes the second target with both eyes can be determined after the user's eyes begin to observe the second target. Specifically, after the user's eyes begin to observe the second target, the first position of the second target observed by the left eye in the image is obtained, and then the second position of the second target observed by the right eye in the image is obtained. The second aberration is then determined based on the first and second positions.

[0062] In this embodiment of the application, when determining the second aberration when the user's eyes begin to observe the second target, the determination of the second aberration can be performed after the user's eyes begin to observe the second target. This ensures the accuracy of the calculation of the second aberration, thereby ensuring the accuracy of the final interpupillary distance difference calculation and ultimately ensuring the accuracy of the interpupillary distance adjustment.

[0063] In some embodiments of this application, before determining the second convergence angle of the eyes when observing the second target based on the second aberration and depth distance when both eyes observe the second target, the adjustment method further includes:

[0064] Obtain image feature information from the image;

[0065] Based on image feature information, determine the attention map for all locations in the image;

[0066] The second aberration is determined based on the attention map corresponding to the second objective.

[0067] In this embodiment, the second aberration when the two eyes observe the second target can be determined before the user's eyes begin to observe the second target. Specifically, firstly, image feature information of the image is acquired. Specifically, image feature information may include spatial feature information and semantic feature information of the image. Using the spatial feature information and semantic feature information of the image, an attention map of all targets in the image can be determined.

[0068] Understandably, an attention map of all targets in an image can display the degree of attention given to each target. Based on this attention map, targets that the eyes are likely to focus on can be prioritized. Furthermore, based on the attention map, the second aberration of targets that the user's eyes are likely to focus on can be calculated first. This allows for the calculation of the phase difference of the second target before the user's eyes begin to observe it. Then, based on the phase difference and depth distance of the second target, the second convergence angle is calculated, thus determining the interpupillary distance change. Finally, when the user's eyes begin to observe the second target, the center points of the two display modules can be directly adjusted based on the interpupillary distance change.

[0069] This application embodiment determines an attention map of all targets in an image based on image feature information such as spatial and semantic features. Then, before the user's eyes begin to observe a second target, the phase difference of the second target can be calculated based on the attention map, thus obtaining the interpupillary distance (IPD) change value. This achieves pre-calculation of IPD changes, allowing for direct adjustment based on the IPD change value when the user begins to observe the second target, improving the efficiency of IPD adjustment.

[0070] In some embodiments of this application, when displaying an image, obtaining the first convergence angle when both eyes are observing a first target in the image includes:

[0071] When displaying an image, obtain the initial interpupillary distance when both eyes are observing the first target in the image;

[0072] Obtain the minimum distance between the first target and the lines connecting both eyes;

[0073] The first convergence angle is determined based on the minimum distance and the initial interpupillary distance.

[0074] In this embodiment of the application, when displaying an image, the initial interpupillary distance (IPD) when both eyes are observing the first target of the image can first be obtained. That is, when the user initially wears the display device, the user's initial IPD can be determined directly based on the user's initial observation target. Alternatively, the user can manually input the initial IPD when initially wearing the display device.

[0075] Furthermore, when the user begins to observe the first target, the minimum distance between the first target and the line connecting both eyes can be obtained. This is equivalent to obtaining the virtual image distance of the first target. Then, based on the initial interpupillary distance and the minimum distance between the first target and the line connecting both eyes, the first convergence angle can be determined.

[0076] In this embodiment, when a user initially wears the display device, a first convergence angle is determined based on the user's initial interpupillary distance and the minimum distance between the first target and the eyes. This allows the user to determine the interpupillary distance change value based on the first and second convergence angles when observing a second target.

[0077] In some embodiments of this application, before determining the depth distance of the two eyes when observing the second target based on the first aberration when the two eyes observe the first target, the adjustment method further includes:

[0078] With both eyes observing the first target, obtain the third position of the first target observed by the left eye in the image;

[0079] Obtain the fourth position of the first target observed by the right eye in the image;

[0080] The first aberration is determined based on the third and fourth positions.

[0081] In this embodiment of the application, the first aberration when the user's eyes observe the first target can be determined after the user's eyes begin to observe the first target. Specifically, after the user's eyes begin to observe the first target, the third position of the first target observed by the left eye in the image is obtained, and then the fourth position of the first target observed by the right eye in the image is obtained. The first aberration is then determined based on the third and fourth positions.

[0082] In this embodiment of the application, when determining the first aberration when the user's eyes begin to observe the first target, the determination of the first aberration can be performed after the user's eyes begin to observe the first target. This ensures the accuracy of the calculation of the first aberration, thereby ensuring the accuracy of the determination of the depth distance of the second target in the image, and ultimately ensuring the accuracy of the determination of the interpupillary distance change value.

[0083] In one specific embodiment, Figure 4 A schematic diagram of the structure of a display device according to an embodiment of this application is shown; as follows: Figure 4As shown, the display device 400 includes an eye-tracking module 402 for tracking the movement of the user's eyes, an image content analysis module 410 for analyzing the content in the image to determine aberrations, depth distance, and calculate the final interpupillary distance change value, and an interpupillary distance adjustment module 404 for adjusting the distance adjustment axis 408 between the two display modules 406 to achieve the distance between the center points of the two display modules.

[0084] Figure 2 One of the flowcharts of the method for adjusting interpupillary distance according to an embodiment of this application is shown; Figure 3 A second flowchart of the method for adjusting interpupillary distance according to an embodiment of this application is shown; Figure 5 One of the schematic diagrams of the interface for displaying images on a display device according to an embodiment of this application is shown; such as Figure 2 , Figure 3 and Figure 5 As shown, when the user initially wears the display device, both eyes are focused on the virtual image distance plane, meaning there is no aberration between the left and right eyes. After the left and right eyes combine, the first target observed is located on the virtual image distance plane. The initial interpupillary distance D and the virtual image distance F of the first target 502 are obtained when the user observes it. The first convergence angle A is determined based on the initial interpupillary distance D and the virtual image distance F. Figure 6 This application shows a second schematic diagram of the interface for displaying images on a display device according to an embodiment of the present application; as shown Figure 6 As shown, during the generation of a depth map based on the first target 502, the first target 502 is observed through both the left and right eyes. At this time, the first target 502 observed by the left and right eyes is located on the virtual image distance plane. There is an aberration between the first target 502 observed by the left and right eyes. After simultaneous observation by both eyes, the first target 502 is located in front of the virtual image distance plane in both the left and right eye views. The distance between the first target 502 and the virtual image distance plane is the depth distance of the first target 502. Based on this depth distance, a depth map of the image can be generated. The depth map is used to illustrate the distribution relationship of different depth distances of all targets in the image.

[0085] Furthermore, Figure 7 This application illustrates a third schematic diagram of the interface for displaying images on a display device according to an embodiment of the present application; as shown... Figure 7As shown, based on the depth map, the second convergence angle α of the second target 504 that the user may focus on is determined. The second target is observed through both the left and right eyes. At this time, the second target 504 observed by the left and right eyes is located on the virtual image distance plane. There is an aberration between the second target 504 observed by the left and right eyes. After simultaneous observation by both eyes, the second target 504 is located in front of the virtual image distance plane of the left and right eyes. At this point, the depth distance of the second target 504 can be determined according to the depth map. Furthermore, based on the aberration and depth distance of the second target, the second convergence angle α can be determined. The convergence angles α of all second targets 504 are stored in memory for easy retrieval.

[0086] The eye-tracking module continuously tracks the user's eyes, acquiring the second target 504 currently being observed by both eyes. It extracts the stored convergence angle 'a' of the corresponding second target 504, combines it with the first convergence angle to determine the convergence angle difference, and calculates the interpupillary distance (IPD) change. Then, based on the IPD change, it determines the IPD 'd' when observing the second target 504. Specifically, the formula for calculating the IPD change is as follows:

[0087]

[0088] Where R is the pupillary distance change, A is the first convergence angle, and a is the second convergence angle.

[0089] Finally, the interpupillary distance adjustment module adjusts the distance between the two display modules based on the change in interpupillary distance.

[0090] In some embodiments of this application, an interpupillary distance adjustment device is provided for electronic devices. Figure 8 A structural block diagram of an interpupillary distance adjustment device according to an embodiment of this application is shown, as follows: Figure 8 As shown, the interpupillary distance adjustment device 800 includes:

[0091] The acquisition unit 802 is used to acquire the first convergence angle when the eyes observe the first target in the image while the image is displayed;

[0092] The determining unit 804 is used to determine the depth distance between the two eyes when observing the second target based on the first aberration when the two eyes observe the first target. The first aberration is the distance difference between the position of the first target observed by the left eye and the position of the first target observed by the right eye in the image. The second target is any target in the image other than the first target.

[0093] The determining unit is also used to determine the second convergence angle of the two eyes when observing the second target, based on the second aberration and depth distance when the two eyes observe the second target; and

[0094] The interpupillary distance variation value is determined based on the second convergence angle and the first convergence angle;

[0095] The adjustment unit 806 is used to adjust the distance between the center points of the two display modules according to the change in interpupillary distance.

[0096] In calculating the interpupillary distance (IPD) when a user observes a second target, this embodiment utilizes not only the second phase difference between the two eyes when observing the second target but also considers the influence of depth distance on the IPD. Therefore, it simultaneously uses the second phase difference and the depth distance to calculate the second convergence angle, and then calculates the IPD based on the second convergence angle and the first convergence angle. This ensures that the change in IPD when a user observes targets in the same direction but at different distances can be calculated, thereby guaranteeing the accuracy of IPD adjustment and ensuring a better viewing experience for the user.

[0097] In some embodiments of this application, the determining unit is specifically used for:

[0098] Based on the first aberration, a depth map of the image is determined, wherein the depth map is used to represent the depth distance of all targets in the image;

[0099] Determine the depth distance of the second target in the depth map.

[0100] This application embodiment determines the depth map of all targets in an image based on the first aberration when both eyes observe the first target. This allows the user's eyes to directly determine the depth distance of the second target from the depth map when observing it. This effectively simplifies the depth distance determination process, thereby improving the efficiency of the interpupillary distance determination process.

[0101] In some embodiments of this application, the acquisition unit is further configured to:

[0102] When observing a second target with both eyes, obtain the first position of the second target in the image observed by the left eye; and obtain the second position of the second target in the image observed by the right eye.

[0103] The determining unit is specifically used to determine the second aberration based on the first position and the second position.

[0104] In this embodiment of the application, when determining the second aberration when the user's eyes begin to observe the second target, the determination of the second aberration can be performed after the user's eyes begin to observe the second target. This ensures the accuracy of the calculation of the second aberration, thereby ensuring the accuracy of the final interpupillary distance difference calculation and ultimately ensuring the accuracy of the interpupillary distance adjustment.

[0105] In some embodiments of this application, the acquisition unit is further configured to acquire image feature information of the image;

[0106] The determining unit is also used to determine the attention map of all targets in the image based on the image feature information; and to determine the second aberration based on the attention map corresponding to the second target.

[0107] This application embodiment determines an attention map of all targets in an image based on image feature information such as spatial and semantic features. Then, before the user's eyes begin to observe a second target, the phase difference of the second target can be calculated based on the attention map, thus obtaining the interpupillary distance (IPD) change value. This achieves pre-calculation of IPD changes, allowing for direct adjustment based on the IPD change value when the user begins to observe the second target, improving the efficiency of IPD adjustment.

[0108] In some embodiments of this application, the acquisition unit is specifically used for:

[0109] Obtain the minimum distance between the first target and the lines connecting both eyes;

[0110] The first convergence angle is determined based on the minimum distance and the initial interpupillary distance.

[0111] In this embodiment, when a user initially wears the display device, a first convergence angle is determined based on the user's initial interpupillary distance and the minimum distance between the first target and the eyes. This allows the user to determine the interpupillary distance change value based on the first and second convergence angles when observing a second target.

[0112] In some embodiments of this application, the acquisition unit is further configured to:

[0113] With both eyes observing the first target, obtain the third position of the first target in the image observed by the left eye; and obtain the fourth position of the first target in the image observed by the right eye.

[0114] The determining unit is also used to determine the first aberration based on the third and fourth positions.

[0115] In this embodiment of the application, when determining the first aberration when the user's eyes begin to observe the first target, the determination of the first aberration can be performed after the user's eyes begin to observe the first target. This ensures the accuracy of the calculation of the first aberration, thereby ensuring the accuracy of the determination of the depth distance of the second target in the image, and ultimately ensuring the accuracy of the determination of the interpupillary distance change value.

[0116] The interpupillary distance adjustment device in this application embodiment can be an electronic device or a component within an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices besides a terminal. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television (TV), ATM, or self-service machine, etc. This application embodiment does not specifically limit the device.

[0117] The interpupillary distance adjustment device in this embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this embodiment does not specifically limit the specific operating system used.

[0118] The interpupillary distance adjustment device provided in this application embodiment can realize the various processes implemented in the above method embodiments, and will not be described again here to avoid repetition.

[0119] Optionally, embodiments of this application also provide an electronic device. Figure 9 A structural block diagram of an electronic device according to an embodiment of this application is shown, such as... Figure 9 As shown, the electronic device 900 includes a processor 902, a memory 904, and a program or instructions stored in the memory 904 and executable on the processor 902. When the program or instructions are executed by the processor 902, they implement the various processes of the above method embodiments and achieve the same technical effects. To avoid repetition, they will not be described again here.

[0120] It should be noted that the electronic devices in the embodiments of this application include the aforementioned mobile electronic devices and non-mobile electronic devices.

[0121] Figure 10 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of this application.

[0122] The electronic device 1000 includes, but is not limited to, components such as: radio frequency unit 1001, network module 1002, audio output unit 1003, input unit 1004, sensor 1005, display unit 1006, user input unit 1007, interface unit 1008, memory 1009, and processor 1010.

[0123] Those skilled in the art will understand that the electronic device 1000 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 1010 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 10 The electronic device structure shown does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0124] The processor 1010 is configured to, when displaying an image, acquire a first convergence angle when both eyes observe a first target in the image; determine the depth distance when both eyes observe a second target based on a first aberration when both eyes observe the first target, wherein the first aberration is the distance difference between the position of the first target observed by the left eye and the position of the first target observed by the right eye in the image, and the second target is any target in the image other than the first target; determine a second convergence angle when both eyes observe the second target based on a second aberration and the depth distance; determine the interpupillary distance change value based on the second convergence angle and the first convergence angle; and adjust the distance between the center points of the two display modules based on the interpupillary distance change value.

[0125] In calculating the interpupillary distance (IPD) when a user observes a second target, this embodiment utilizes not only the second phase difference between the two eyes when observing the second target but also considers the influence of depth distance on the IPD. Therefore, it simultaneously uses the second phase difference and the depth distance to calculate the second convergence angle, and then calculates the IPD based on the second convergence angle and the first convergence angle. This ensures that the change in IPD when a user observes targets in the same direction but at different distances can be calculated, thereby guaranteeing the accuracy of IPD adjustment and ensuring a better viewing experience for the user.

[0126] Optionally, the processor 1010 is further configured to determine a depth map of the image based on a first aberration, wherein the depth map is used to represent the depth distance of all targets in the image; and to determine the depth distance of a second target in the depth map.

[0127] This application embodiment determines the depth map of all targets in an image based on the first aberration when both eyes observe the first target. This allows the user's eyes to directly determine the depth distance of the second target from the depth map when observing it. This effectively simplifies the depth distance determination process, thereby improving the efficiency of the interpupillary distance determination process.

[0128] Optionally, before determining the second convergence angle of the two eyes when observing the second target based on the second aberration and depth distance, the processor 1010 is further configured to, when observing the second target with both eyes, obtain a first position of the second target in the image observed by the left eye; obtain a second position of the second target in the image observed by the right eye; and determine the second aberration based on the first position and the second position.

[0129] In this embodiment of the application, when determining the second aberration when the user's eyes begin to observe the second target, the determination of the second aberration can be performed after the user's eyes begin to observe the second target. This ensures the accuracy of the calculation of the second aberration, thereby ensuring the accuracy of the final interpupillary distance difference calculation and ultimately ensuring the accuracy of the interpupillary distance adjustment.

[0130] Optionally, before determining the second convergence angle of the eyes when observing the second target based on the second aberration and depth distance, the processor 1010 is further configured to acquire image feature information of the image; determine the attention map of all targets in the image based on the image feature information; and determine the second aberration based on the attention map corresponding to the second target.

[0131] This application embodiment determines an attention map of all targets in an image based on image feature information such as spatial and semantic features. Then, before the user's eyes begin to observe a second target, the phase difference of the second target can be calculated based on the attention map, thus obtaining the interpupillary distance (IPD) change value. This achieves pre-calculation of IPD changes, allowing for direct adjustment based on the IPD change value when the user begins to observe the second target, improving the efficiency of IPD adjustment.

[0132] Optionally, the processor 1010 is further configured to, when displaying an image, obtain an initial interpupillary distance when both eyes are observing a first target in the image; obtain a minimum distance between the first target and the line connecting the two eyes; and determine a first convergence angle based on the minimum distance and the initial interpupillary distance.

[0133] In this embodiment, when a user initially wears the display device, a first convergence angle is determined based on the user's initial interpupillary distance and the minimum distance between the first target and the eyes. This allows the user to determine the interpupillary distance change value based on the first and second convergence angles when observing a second target.

[0134] Optionally, before determining the depth distance of the two eyes when observing the second target based on the first aberration when observing the first target, the processor 1010 is further configured to, when observing the first target with both eyes, obtain the third position of the first target observed by the left eye in the image; obtain the fourth position of the first target observed by the right eye in the image; and determine the second aberration based on the third position and the fourth position.

[0135] In this embodiment of the application, when determining the first aberration when the user's eyes begin to observe the first target, the determination of the first aberration can be performed after the user's eyes begin to observe the first target. This ensures the accuracy of the calculation of the first aberration, thereby ensuring the accuracy of the determination of the depth distance of the second target in the image, and ultimately ensuring the accuracy of the determination of the interpupillary distance change value.

[0136] It should be understood that, in this embodiment, the input unit 1004 may include a graphics processing unit (GPU) 10041 and a microphone 10042. The GPU 10041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 1006 may include a display panel 10061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 1007 includes a touch panel 10071 and at least one of other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 may include a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, and joysticks, which will not be described in detail here.

[0137] The memory 1009 can be used to store software programs and various data. The memory 1009 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 1009 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 1009 in this embodiment includes, but is not limited to, these and any other suitable types of memory.

[0138] The processor 1010 may include one or more processing units; optionally, the processor 1010 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into the processor 1010.

[0139] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above method embodiments and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0140] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0141] This application also provides a chip, which includes a processor and a communication interface. The communication interface and the processor are coupled. The processor is used to run programs or instructions to implement the various processes of the above method embodiments and achieve the same technical effect. To avoid repetition, it will not be described again here.

[0142] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0143] This application provides a computer program product stored in a readable storage medium. The program product is executed by at least one processor to implement the various processes of the above method embodiments and achieve the same technical effect. To avoid repetition, it will not be described again here.

[0144] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0145] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a readable storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods of the various embodiments of this application.

[0146] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. A method for adjusting interpupillary distance, characterized in that, The adjustment method is used in a display device, the display device including two display modules, and the adjustment method includes: When an image is displayed, obtain the first convergence angle when both eyes observe a first target in the image; The depth distance of the two eyes when observing the second target is determined based on the first aberration when the first target is observed by the two eyes, wherein the first aberration is the distance difference between the position of the first target observed by the left eye in the image and the position of the first target observed by the right eye in the image, and the second target is any target in the image other than the first target; Based on the second aberration when the eyes observe the second target and the depth distance, determine the second convergence angle of the eyes when observing the second target; The interpupillary distance change value is determined based on the second convergence angle and the first convergence angle; The distance between the center points of the two display modules is adjusted according to the interpupillary distance change value.

2. The adjustment method according to claim 1, characterized in that, The step of determining the depth distance of the two eyes when observing the second target based on the first aberration when the two eyes observe the first target includes: Based on the first aberration, a depth map of the image is determined, wherein the depth map is used to represent the depth distance of all targets in the image; The depth distance of the second target is determined in the depth map.

3. The adjustment method according to claim 1 or 2, characterized in that, Before determining the second convergence angle of the eyes when observing the second target based on the second aberration and the depth distance, the adjustment method further includes: When both eyes are observing the second target, the first position of the second target in the image as observed by the left eye of both eyes is obtained; Obtain the second position of the second target in the image as observed by the right eye of both eyes; The second aberration is determined based on the first position and the second position.

4. The adjustment method according to claim 1 or 2, characterized in that, Before determining the second convergence angle of the eyes when observing the second target based on the second aberration and the depth distance, the adjustment method further includes: Obtain the image feature information of the image; Based on the image feature information, determine the attention map for all targets in the image; The second aberration is determined based on the attention map corresponding to the second target.

5. The adjustment method according to claim 1 or 2, characterized in that, The step of obtaining the first convergence angle when both eyes observe a first target in the displayed image includes: With the image displayed, obtain the initial interpupillary distance when both eyes are observing the first target in the image; Obtain the minimum distance between the first target and the line connecting the two eyes; The first convergence angle is determined based on the minimum distance and the initial interpupillary distance.

6. The adjustment method according to claim 1 or 2, characterized in that, Before determining the depth distance of the eyes when observing the second target based on the first aberration when the eyes observe the first target, the adjustment method further includes: When both eyes are observing the first target, the third position of the first target in the image observed by the left eye of the two eyes is obtained; Obtain the fourth position of the first target in the image as observed by the right eye of both eyes; The first aberration is determined based on the third position and the fourth position.

7. A device for adjusting interpupillary distance, characterized in that, The adjustment device is used in a display device, the display device including two display modules, and the adjustment device includes: The acquisition unit is used to acquire a first convergence angle when both eyes observe a first target in the image while the image is displayed. The determining unit is configured to determine the depth distance of the two eyes when observing the second target based on the first aberration when the two eyes observe the first target, wherein the first aberration is the distance difference between the position of the first target observed by the left eye in the image and the position of the first target observed by the right eye in the image, and the second target is any target in the image other than the first target; The determining unit is further configured to determine a second convergence angle of the eyes when observing the second target based on the second aberration and the depth distance; and The interpupillary distance change value is determined based on the second convergence angle and the first convergence angle; An adjustment unit is used to adjust the distance between the center points of the two display modules according to the interpupillary distance change value.

8. The adjusting device according to claim 7, characterized in that, The determining unit is specifically used for: Based on the first aberration, a depth map of the image is determined, wherein the depth map is used to represent the depth distance of all targets in the image; The depth distance of the second target is determined in the depth map.

9. The adjusting device according to claim 7 or 8, characterized in that, The acquisition unit is also used for: When both eyes are observing the second target, the first position of the second target in the image as observed by the left eye of both eyes is obtained; as well as Obtain the second position of the second target in the image as observed by the right eye of both eyes; The determining unit is specifically used to determine the second aberration based on the first position and the second position.

10. The adjusting device according to claim 7 or 8, characterized in that, The acquisition unit is also used to acquire image feature information of the image; The determining unit is further configured to determine an attention map of all targets in the image based on the image feature information; as well as The second aberration is determined based on the attention map corresponding to the second target.

11. The adjusting device according to claim 7 or 8, characterized in that, The acquisition unit is specifically used for: With the image displayed, obtain the initial interpupillary distance when both eyes are observing the first target in the image; Obtain the minimum distance between the first target and the line connecting the two eyes; The first convergence angle is determined based on the minimum distance and the initial interpupillary distance.

12. The adjusting device according to claim 7 or 8, characterized in that, The acquisition unit is also used for: When both eyes are observing the first target, the third position of the first target in the image observed by the left eye of the two eyes is obtained; as well as Obtain the fourth position of the first target in the image as observed by the right eye of both eyes; The determining unit is further configured to determine the first aberration based on the third position and the fourth position.

13. An electronic device, characterized in that, It includes a processor and a memory, the memory storing a program or input that can run on the processor, the program or input being executed by the processor to implement the steps of the method as described in any one of claims 1 to 6.

14. A readable storage medium, characterized in that, The program or input is stored on the readable storage medium, and when the program or input is executed by a processor, it implements the steps of the method as described in any one of claims 1 to 6.

Images