Display method, electronic equipment and medium

Abstract

The invention relates to the technical field of optics, and discloses a display method, electronic equipment and a medium. In the display method provided by the invention, when the processor determines that the user interpupillary distance information is not in the standard interpupillary distance range, the DDIC is indicated to perform translation processing on the to-be-displayed image, and the corresponding display is controlled to display the corresponding image. For example, when the user interpupillary distance is larger than the standard interpupillary distance range, the DDIC is indicated to translate the to-be-displayed image corresponding to the left eye to the left, the display corresponding to the left eye is controlled to display the translated image corresponding to the left eye, and the to-be-displayed image corresponding to the right eye is translated to the right; and controlling the display corresponding to the right eye to display the translated to-be-displayed image corresponding to the right eye. Therefore, the watching requirements of users with different interpupillary distances can be met, the watching experience of the users is improved, in addition, the occupation of processor resources can be reduced by performing translation and other processing on the to-be-displayed image based on DDIC, and thus the power consumption of the processor is saved.

Description

Technical Field

[0001] This application relates to the field of optical technology, and in particular to a display method, electronic device and medium. Background Technology

[0002] Currently, with the development of terminal display technology, head-mounted display devices such as augmented reality (AR), virtual reality (VR), and mixed reality (MR) have gradually been widely used.

[0003] Currently, head-mounted display devices generally set the positions of the left and right lenses as display devices based on the standard interpupillary distance range. Since different users have different interpupillary distances, for example, some users may have interpupillary distances that are larger or smaller than the standard interpupillary distance range, resulting in lower comfort for some users when viewing images and affecting the user experience. Summary of the Invention

[0004] This application provides a display method, an electronic device, and a medium.

[0005] In a first aspect, embodiments of this application provide a display method for an electronic device, the electronic device including a processor and a display driver chip; the processor determines that the user's interpupillary distance information is not within a preset interpupillary distance range, determines image adjustment information based on the user's interpupillary distance information, and sends an image position adjustment instruction to the display driver chip; the display driver chip receives the image position adjustment instruction, adjusts the first coordinate information of a first image to be displayed based on the image adjustment information to obtain second coordinate information, and adjusts the first image to be displayed according to the second coordinate information to obtain a second image to be displayed, the second image to be displayed corresponding to the second coordinate information.

[0006] In some embodiments, after the processor determines the image position adjustment information, it can send an image position adjustment instruction to the DDIC to inform the DDIC of the image position adjustment information, and instruct the DDIC to adjust the position of the first image to be displayed based on the image position adjustment information, and control the corresponding display to display the adjusted second image to be displayed.

[0007] The display method provided in this application can adjust the image display position based on the user's interpupillary distance (IPD) to meet the needs of users with different IPDs and improve the user's viewing experience. Furthermore, by performing translation and other processing on the image to be displayed based on DDIC, compared to a solution based on processor-based processing of the image, processor resource usage can be reduced, thereby saving processor power consumption.

[0008] In one possible implementation of the first aspect, the first image to be displayed includes a third image to be displayed corresponding to the user's left eye and a fourth image to be displayed corresponding to the user's right eye. The first coordinate information includes the third coordinate information of the third image to be displayed and the fourth coordinate information of the fourth image to be displayed. The image adjustment information includes a first translation direction and a first translation distance of the third image to be displayed, and a second translation direction and a second translation distance of the fourth image to be displayed. Adjusting the first coordinate information of the first image to be displayed based on the image position adjustment instruction to obtain the second coordinate information, and adjusting the first image to be displayed according to the second coordinate information to obtain the second image to be displayed, includes: adjusting the third coordinate information of the third image to be displayed based on the first translation direction and the first translation distance to obtain the fifth coordinate information, adjusting the third image to be displayed based on the fifth coordinate information to obtain the fifth image to be displayed; adjusting the fourth coordinate information of the fourth image to be displayed based on the second translation direction and the second translation distance to obtain the sixth coordinate information, and adjusting the fourth image to be displayed based on the sixth coordinate information to obtain the sixth image to be displayed.

[0009] In some embodiments, the third coordinate information may be the coordinate information of each pixel in the third image to be displayed corresponding to the left eye, and the fourth coordinate information may be the coordinate information of each pixel in the fourth image to be displayed corresponding to the right eye.

[0010] The coordinate information of each pixel in the third image to be displayed corresponding to the left eye can refer to the position coordinates of each pixel in the third image to be displayed corresponding to the left eye on the monitor corresponding to the left eye, and the coordinate information of each pixel in the fourth image to be displayed corresponding to the right eye can refer to the position coordinates of each pixel in the fourth image to be displayed corresponding to the right eye on the monitor corresponding to the right eye.

[0011] In one possible implementation of the first aspect, the user interpupillary distance information includes the user interpupillary distance, and determining image adjustment information based on the user interpupillary distance information includes: corresponding to the minimum value of the user interpupillary distance being less than the preset interpupillary distance range, determining a first translation direction as right and a second translation direction as left, and determining a first translation distance and a second translation distance based on the difference between the user interpupillary distance and the minimum value; corresponding to the maximum value of the user interpupillary distance being greater than the preset interpupillary distance range, determining a first translation direction as left and a second translation direction as right, and determining a first translation distance and a second translation distance based on the difference between the user interpupillary distance and the maximum value.

[0012] In some embodiments, when the user's interpupillary distance (IPD) is less than the minimum value of a preset IPD range, the translation direction of the third image to be displayed is determined to be to the right, and the translation direction of the fourth image to be displayed is determined to be to the left. The translation distance between the third and fourth images to be displayed can be determined based on the difference between the user's IPD and the minimum value. For example, the translation distance between the third and fourth images to be displayed can be the pixel distance corresponding to half the absolute value of the difference between the user's IPD and the minimum value. For example, if the user's IPD is 56mm and the minimum value of the preset IPD range is 58mm, the translation distance between the third and fourth images to be displayed can be the pixel distance corresponding to 1mm. For example, when the resolution of the images to be displayed is 300dpi, 1mm is 11.8 pixels. It can be understood that the pixel distance corresponding to 1mm is different depending on the resolution of the images to be displayed.

[0013] When the user's interpupillary distance is greater than the maximum value of the preset interpupillary distance range, the translation direction of the third image to be displayed is determined to be to the left, and the translation direction of the fourth image to be displayed is determined to be to the right. The translation distance of the third and fourth images to be displayed is determined based on the difference between the user's interpupillary distance and the maximum value. For example, the translation distance of the third and fourth images to be displayed can be the pixel distance corresponding to half of the absolute value of the difference between the user's interpupillary distance and the maximum value.

[0014] In this way, the translation distance of the image can be accurately calculated based on the user's interpupillary distance information, so as to achieve precise matching between the image position and the user's interpupillary distance and improve the user's viewing experience.

[0015] In one possible implementation of the first aspect, the user interpupillary distance information includes the user interpupillary distance, and determining image adjustment information based on the user interpupillary distance information includes: determining a target interpupillary distance range corresponding to the user interpupillary distance; determining a target interpupillary distance level corresponding to the target interpupillary distance range; and determining a first translation direction and a first translation distance of a third image to be displayed, and a second translation direction and a second translation distance of a fourth image to be displayed, based on the target interpupillary distance level.

[0016] In some embodiments, the electronic device may be pre-configured with different interpupillary distance (IPD) ranges corresponding to different levels, each level being configured with a translation distance and translation direction corresponding to the image to be displayed. Thus, the processor does not need to calculate the translation distance based on the IPD information; instead, the target IPD level can be determined based on the IPD range corresponding to the IPD information, and the pre-configured translation distance corresponding to the target IPD level can be obtained, further reducing the processor's computational load and saving processor resources.

[0017] For example, for interpupillary distances (IPDs) greater than or equal to 58mm and less than or equal to 72mm (i.e., the standard IPD range), corresponding to the median IPD setting, the translation distance is 0, and there is no translation direction. In other words, at this setting, no translation of the image to be displayed is required; the coordinates of the center pixel of the image to be displayed are the center coordinates of the corresponding monitor. For IPDs less than 58mm, corresponding to the small IPD setting, the translation distance for the image to be displayed for the left eye is A1, with the translation direction to the right, and the translation distance for the image to be displayed for the right eye is A1, with the translation direction to the left. For IPDs greater than 72mm, corresponding to the large IPD setting, the translation distance for the displayed image for the left eye is A2, with the translation direction to the left, and the translation distance for the displayed image for the right eye is A2, with the translation direction to the right.

[0018] In some embodiments, the electronic device may also be pre-configured with a maximum interpupillary distance (IPD) setting corresponding to a maximum IPD range (e.g., greater than 75 mm) and a minimum IPD setting corresponding to a minimum IPD range (e.g., less than 55 mm). For example, for an IPD range less than 55 mm, corresponding to the minimum IPD setting, the translation distance for the image to be displayed for the left eye is A3, with the translation direction to the right, and the translation distance for the image to be displayed for the right eye is A3, with the translation direction to the left. For an IPD range greater than 75 mm, corresponding to the maximum IPD setting, the translation distance for the displayed image for the left eye is A4, with the translation direction to the left, and the translation distance for the displayed image for the right eye is A4, with the translation direction to the right. Wherein, A4 is greater than A2, and A3 is greater than A1. For example, A4 and A3 can be four pixels, and A2 and A4 can be two pixels. The specific values ​​of A1, A2, A3, and A4 can be set according to actual needs, and are not limited in this embodiment.

[0019] It is understandable that configuring the maximum and minimum interpupillary distance ranges can achieve interpupillary distance matching for users with maximum and minimum interpupillary distances, thereby improving the image viewing experience for these users.

[0020] In one possible implementation of the first aspect, the electronic device further includes a first display and a second display, the first display corresponding to the user's left eye and the second display corresponding to the user's right eye; the method further includes: a processor determining that the user's interpupillary distance is within a preset interpupillary distance range, and sending a display command to a display driver chip; the display driver chip controlling the first display to display a third image to be displayed, and controlling the second display to display a fourth image to be displayed, based on the display command; wherein, the effective display area of ​​the first display has a first length in a first direction greater than the second length of the third image to be displayed in a first direction, the effective display area of ​​the second display has a third length in a first direction greater than the fourth length of the fourth image to be displayed in a first direction, the center of the third image to be displayed is aligned with the center of the first display, the center of the fourth image to be displayed is aligned with the center of the second display, and the first direction is the direction of the line connecting the center of the first display and the center of the second display.

[0021] In some embodiments, the coordinates of the center pixel of the third image to be displayed corresponding to the left eye are the center coordinates of the display corresponding to the left eye. The coordinates of the center pixel of the fourth image to be displayed corresponding to the right eye are the center coordinates of the display corresponding to the right eye. That is, the initial display image without translation is displayed in the center of the corresponding display, and there is a preset distance between the left and right sides of the initial image to be displayed and the effective display area of ​​the corresponding display.

[0022] In some embodiments, the first direction can be the left and right direction mentioned in the embodiments of this application. The display corresponding to the left eye and the display corresponding to the right eye both have additional display areas so that the image position can be moved when the user's interpupillary distance is different. This can prevent the display position of the image to be displayed from exceeding the effective display area of ​​the corresponding display and causing image loss.

[0023] In one possible implementation of the first aspect, adjusting the third coordinate information of the third image to be displayed based on a first translation direction and a first translation distance to obtain fifth coordinate information includes: adjusting the third coordinate information of the third image to be displayed based on the first translation direction and the first translation distance to obtain fifth coordinate information when the first translation distance is less than or equal to half the difference between the first length and the second length; and adjusting the third coordinate information of the third image to be displayed based on the first translation direction and the third translation distance to obtain fifth coordinate information when the first translation distance is greater than half the difference between the first length and the second length, wherein the third translation distance is the difference between the first length and the second length. The value is half; the fourth coordinate information of the fourth image to be displayed is adjusted based on the second translation direction and the second translation distance to obtain the sixth coordinate information, including: corresponding to the second translation distance being less than or equal to half the difference between the third length and the fourth length, the fourth coordinate information of the fourth image to be displayed is adjusted based on the second translation direction and the second translation distance to obtain the sixth coordinate information; corresponding to the second translation distance being greater than half the difference between the third length and the fourth length, the fourth coordinate information of the third image to be displayed is adjusted based on the second translation direction and the fourth translation distance to obtain the sixth coordinate information, wherein the fourth translation distance is half the difference between the third length and the fourth length.

[0024] In some embodiments, when it is necessary to translate the third and fourth images to be displayed, if the translation distance of the third and fourth images to be displayed is less than or equal to half the difference between the length of the effective display area of ​​the corresponding display in the left-right direction and the length of the image to be displayed in the left-right direction, then half the difference between the length of the effective display area of ​​the left display in the left-right direction and the length of the image to be displayed in the left-right direction can be used as the translation distance of the image to be displayed. In other words, the maximum translation distance that will not exceed the effective display area of ​​the display is used as the translation distance of the image to be displayed. This avoids the image to be displayed from exceeding the effective display area of ​​the corresponding display, thus preventing image loss.

[0025] In one possible implementation of the first aspect, the method further includes: cropping a first region of a fifth image to be displayed, corresponding to a first translation distance greater than half the difference between a first length and a second length, wherein the first region is the region corresponding to pixels in the third image to be displayed whose pixel coordinates are not within the effective display area of ​​the first display; and cropping a second region of a sixth image to be displayed, corresponding to a second translation distance greater than half the difference between a third length and a fourth length, wherein the second region is the region corresponding to pixels in the fourth image to be displayed whose pixel coordinates are not within the effective display area of ​​the second display.

[0026] In some embodiments, the third and fourth images to be displayed can be translated based on the actual calculated translation distance. If the display position of some areas of the translated images exceeds the effective display area of ​​the corresponding display, that is, the pixel coordinates of some areas are not within the effective display area of ​​the corresponding display, the area can be cropped.

[0027] In this embodiment, when the image extends beyond the effective display area of ​​the monitor after translation, the image to be displayed is still translated by the actual required translation distance. This achieves a high-precision match between the image and the user's interpupillary distance, making the user's viewing experience more comfortable and improving the user experience. Furthermore, cropping the image beyond the display area allows for image adaptation to the monitor.

[0028] In one possible implementation of the first aspect, the user's interpupillary distance (IPD) information is acquired based on an eye-tracking camera of an electronic device; or, the user's IPD information is determined based on an IPD setting manually selected by the user.

[0029] Secondly, embodiments of this application provide a computer-readable storage medium storing instructions that, when executed on an electronic device, cause the electronic device to perform the display method mentioned in embodiments of this application.

[0030] Thirdly, embodiments of this application provide an electronic device, including a processor and a display driver chip, which is used to execute the display method mentioned in embodiments of this application. Attached Figure Description

[0031] Figure 1 A schematic diagram of an AR device 100 is shown according to some embodiments of this application;

[0032] Figure 2A According to some embodiments of this application, a schematic diagram is shown of an image viewed by a user wearing AR glasses 100 when the user's interpupillary distance is within the standard interpupillary distance range;

[0033] Figure 2B According to some embodiments of this application, a schematic diagram is shown of an image viewed by a user wearing AR glasses 100 when the user's interpupillary distance is not within the standard interpupillary distance range;

[0034] Figure 3 According to some embodiments of this application, a structural schematic diagram of an AR device 100 is shown;

[0035] Figure 4 According to some embodiments of this application, a flowchart of a display method is shown;

[0036] Figure 5According to some embodiments of this application, a comparative schematic diagram of the images displayed on the monitor when the user's interpupillary distance is different is shown;

[0037] Figure 6 According to some embodiments of this application, a schematic diagram is shown of the AR device 100 displaying images when users with different interpupillary distances wear the AR device 100.

[0038] Figure 7 According to some embodiments of this application, a flowchart of a display method is shown;

[0039] Figure 8 According to some embodiments of this application, a flowchart of a display method is shown;

[0040] Figure 9 According to some embodiments of this application, a schematic diagram of a process for adjusting a displayed image through rendering is shown;

[0041] Figure 10 According to some embodiments of this application, a schematic diagram of the clipping plane of a virtual camera is shown;

[0042] Figure 11 According to some embodiments of this application, a structural schematic diagram of an AR device 100 is shown;

[0043] Figure 12 According to some embodiments of this application, a flowchart of a display method is shown. Detailed Implementation

[0044] The illustrative embodiments of this application include, but are not limited to, a display method, electronic device, and medium.

[0045] For ease of understanding, the technical terms involved in the embodiments of this application will be explained and described below.

[0046] Binocular fusion, also known as binocular image fusion, is a visual phenomenon. When both eyes observe the same object simultaneously, two images of the object are formed on the retinas of each eye. These images are then transmitted via the optic nerves of both eyes to the same area of ​​the visual cortex in the brain, where they are fused into a complete, single image.

[0047] Interpupillary distance (IPD): This refers to the distance between the centers of the pupils of both eyes.

[0048] The technical solutions in the embodiments of this application will be clearly and thoroughly described below with reference to the accompanying drawings.

[0049] It should be noted that this application does not limit the specific form of the electronic device. The electronic device can be any optical device such as an AR device, VR device, or MR device, and there are no restrictions here. The following description uses an AR device as an example to illustrate the embodiments of this application.

[0050] Figure 1 A schematic diagram of an AR device 100 is shown, as follows: Figure 1 As shown, the AR device 100 includes a display 101 for the left eye and a display 102 for the right eye. Display 101 displays the image for the left eye, and display 102 displays the image for the right eye. This allows the user's left and right eyes to respectively capture the images displayed on display 101 and display 102, which are then fused into a single image by the brain, enabling the viewing of a virtual image.

[0051] It's understandable that current AR devices generally use display components based on the standard interpupillary distance (IPD) range, such as 58-72mm. However, because different users have different IPDs—for example, some users may have IPDs greater than the standard range (e.g., greater than 72mm) or less than the standard range (e.g., less than 58mm)—the images seen by each eye may appear too different, making it difficult for the images to merge. In this case, the brain will forcibly control the eyes to turn inward or to the sides to merge the images. This can lead to eye fatigue, dizziness, and discomfort due to prolonged non-direct viewing, resulting in a poor user experience.

[0052] The following example illustrates the images viewed by users wearing AR devices, using different interpupillary distances for different users.

[0053] Figure 2A Taking a user's interpupillary distance (e.g., 60mm) within the standard interpupillary distance range as an example, this diagram illustrates an image viewed by a user wearing AR glasses 100.

[0054] like Figure 2AAs shown, when the image that the user needs to see is image 200, display 101 displays the left portion of image 200 in full screen, such as image 1010, and display 102 displays the right portion of image 200 in full screen, such as image 1020. Since the visual fields of the user's left and right eyes overlap, the images displayed on display 101 and display 102 also overlap. For example, region 1010-1 in image 1010 overlaps with region 1020-1 in image 1020. Regions 1010-1 and 1020-1 correspond to the overlapping areas of the user's visual fields. Because the user's interpupillary distance is within the standard range, the center C11 of the user's left eye is aligned with or relatively close to the center C1 of image 1010 displayed on display 101, and the center C21 of the user's right eye is aligned with or relatively close to the center C2 of image 1020 displayed on display 102. At this time, the image seen by the user's left eye is the entire image 1010 displayed on monitor 101, and the image seen by the user's right eye is the entire image 1020 displayed on monitor 102. Since regions 1010-1 and 1020-1 are the same (both are the entire girl's head), the brain can fuse regions 1010-1 and 1020-1 into a single image, and combine it with regions 1010-2 seen by the left eye and 1020-2 seen by the right eye to form a complete image corresponding to image 200.

[0055] Figure 2B Taking a user's interpupillary distance (IPD) that is not within the user's IPD range (e.g., 75mm, which is greater than the standard IPD range) as an example, this diagram illustrates an image viewed by a user wearing AR glasses 100.

[0056] like Figure 2B As shown, display 101 displays the left portion of image 200 in full screen, such as image 1010, and display 102 displays the right portion of image 200 in full screen, such as image 1020. Because the user's interpupillary distance is greater than the standard interpupillary distance range, the center C11 of the user's left eye is shifted to the left relative to the center C1 of image 1010 displayed on display 101, and the center C21 of the user's right eye is shifted to the right relative to the center C2 of image 1020 displayed on display 102. At this time, the area seen by the user's left eye is region 1011, meaning that part of region 1012 (the diagonally filled area) of image 1010 is not visible. The area seen by the user's right eye is region 1021, meaning that part of region 1022 (the diagonally filled area) of image 1020 is not visible. The overlapping area of ​​the user's field of view corresponds to region 1010-2 in image 1010 (relative to...). Figure 2A (shifted to the left) and region 1020-2 in image 1020 (relative to) Figure 2A(Shifting to the right) Because the images seen in the overlapping visual fields are quite different (for example, the overlapping visual field corresponding to the left eye cannot see the right part of the little girl's head, and the overlapping visual field corresponding to the right eye cannot see the left part of the little girl's head), the brain will forcibly control the human eye to turn towards the center to make the images seen in the overlapping visual fields of both eyes consistent, thereby causing image fusion. As a result, the human eye will be in a non-direct viewing state for a long time, leading to eye fatigue, dizziness and other discomfort, resulting in a poor user experience.

[0057] As an attempt to address the aforementioned issues, some implementations incorporate mechanical structures such as linkages, motors, and adjustment buttons into the head-mounted display device. This allows users to manually adjust the two displays, moving them closer or further apart, thus aligning the center of the displays with the center of the user's pupils. For example, when the user's interpupillary distance (IPD) is greater than the standard range, the user can manually move the two displays further apart; when the IPD is less than the standard range, the user can manually move them closer together. This improves the user's viewing experience. However, this method requires a large number of mechanical components, making it difficult to meet the requirements for thinner and lighter AR devices.

[0058] Furthermore, in some implementations, the AR device's processor can perform coordinate transformations and other processing on the image to be displayed to change its position, thereby aligning the image center with the user's interpupillary distance (IPD). For example, the AR device's processor can recalculate the position of the image to be displayed based on the user's IPD information obtained by the AR device, and perform coordinate translation (e.g., left or right translation) to regenerate a new display image. Then, it instructs the display driver integrated circuit (DDIC) to control the display to show the new image. This solution eliminates the need for additional mechanical components, meeting the requirements for thinner and lighter AR devices. However, it requires the processor to reprocess the image, resulting in increased processor resource consumption and power consumption.

[0059] The following is combined Figure 3 The structure of the AR device 100 shown and Figure 4 The image display method shown describes the above-mentioned scheme of displaying images based on processor-based coordinate transformation. For example... Figure 3 As shown, the AR device 100 includes a processor 110, a DDIC 120, a display 101, and a display 102. The processor 110 is used to generate images to be displayed for the left and right eyes based on the user's interpupillary distance information. The DDIC 120 is used to control the display 101 to display the image to be displayed for the left eye, and to control the display 102 to display the image to be displayed for the right eye.

[0060] like Figure 4 As shown, the display methods include:

[0061] 101: Processor 110 generates an image to be displayed based on the user's interpupillary distance information.

[0062] For example, the processor 110 can calculate, based on the user interpupillary distance information obtained by the AR device 100, a first offset value of the center position of the displayed image configured on the display 101 corresponding to the left eye (i.e., the center position of the display 101) relative to the center of the user's left pupil, and a second offset value of the center position of the displayed image configured on the display 102 corresponding to the right eye (i.e., the center position of the display 102) relative to the center of the user's right pupil; determine the new image center in stereoscopic space based on the first offset value and the second offset value respectively; and perform coordinate translation on the image to be displayed based on the new image center in stereoscopic space to obtain a new image to be displayed.

[0063] For example, if the user's interpupillary distance is greater than the standard interpupillary distance range, the coordinates of each pixel in the original image to be displayed corresponding to the left eye (i.e., the position coordinates in the display 101) are shifted to the left by the first offset value to obtain a new image to be displayed corresponding to the left eye; the coordinates of each pixel in the original image to be displayed corresponding to the right eye (i.e., the position coordinates in the display 102) are shifted to the right by the second offset value to obtain a new image to be displayed corresponding to the right eye.

[0064] For example, the coordinates corresponding to the image to be displayed are composed of a horizontal X-axis and a vertical Y-axis, where the X-axis corresponds to the left-right direction of the display and the Y-axis corresponds to the up-down direction of the display. Shifting the coordinates of each pixel in the original image to be displayed corresponding to the left eye to the left based on a first offset value can mean subtracting the first offset value from the X-coordinates of the original image to be displayed corresponding to the left eye; shifting the coordinates of each pixel in the original image to be displayed corresponding to the right eye to the right based on a second offset value can mean adding the second offset value to the X-coordinates of the original image to be displayed corresponding to the right eye.

[0065] It is understood that when the first offset value and the second offset value are 0, the processor 110 does not need to perform the above calculations and can directly instruct the DDIC 120 to process the original image to be displayed.

[0066] In some embodiments, the AR device 100 may include an eye-tracking system, which can acquire the user's interpupillary distance (IPD) information based on an eye-tracking camera within the eye-tracking system. For example, the eye-tracking system may include a light source, optical components, and an eye-tracking camera. The light source can emit light towards the user's eyes. When the light emitted by the light source reaches the user's eyes, it is reflected by the eyes to form reflected light. The reflected light is transmitted to the eye-tracking camera via the optical components, and the eye-tracking camera can calculate the user's IPD information based on the acquired light.

[0067] 102: Processor 110 instructs DDIC 120 to process the image to be displayed.

[0068] It is understood that when the first offset value and the second offset value are not 0, that is, when the pupil center of the user's left eye and right eye are offset from the center of the display 101 and the display 102 respectively, the processor 110 sends an instruction to the DDIC 120 to inform that the image to be displayed is the new image to be displayed for the left eye and the new image to be displayed for the right eye after the above coordinate translation, and instructs the DDIC 120 to control the corresponding display to display the new image to be displayed.

[0069] When the first offset value and the second offset value are 0, that is, when there is no offset between the center of the pupil of the user's left eye and the center of the display 101 and the display 102, the processor 110 sends an instruction to the DDIC 120 to inform that the image to be displayed is the original image to be displayed for the left eye and the original image to be displayed for the right eye, and instructs the DDIC 120 to control the corresponding display to display the original image to be displayed.

[0070] In some embodiments, the image to be displayed carries the coordinates of each pixel.

[0071] 103: The DDIC120 controls the display 101 to display the image to be displayed for the left eye, and controls the display 102 to display the image to be displayed for the right eye.

[0072] It can be understood that the image to be displayed corresponding to the left eye carries the coordinates of the image to be displayed corresponding to the left eye, and the image to be displayed corresponding to the right eye carries the coordinates of the image to be displayed corresponding to the right eye.

[0073] like Figure 5As shown in (a), when there is no offset between the center of the user's left pupil and the center of display 101, and no offset between the center of the user's right pupil and the center of display 102, DDIC 120 controls display 101 to display the original image to be displayed corresponding to the left eye (e.g., image 001), and controls display 102 to display the original image to be displayed corresponding to the right eye (e.g., image 002). At this time, the center C10 of image 001 is consistent with the center C1 of display 101, and the center C20 of image 002 is consistent with the center C2 of display 102. It can be understood that in this scheme, both display 101 and display 102 reserve additional display areas for image horizontal movement, that is, the size of the currently displayed image is smaller than the size of the displayable area of ​​the display.

[0074] like Figure 5 As shown in (b), when the center of the user's left pupil is offset to the left from the center of the display 101, and the center of the user's right pupil is offset to the right from the center of the display 101 (i.e., when the user's interpupillary distance is large), the DDIC120 controls the display 101 to display a new image to be displayed after the coordinates of each pixel of the original image to be displayed corresponding to the left eye are shifted to the left (e.g., image 001'), and controls the display 102 to display a new image to be displayed after the coordinates of each pixel of the original image to be displayed corresponding to the right eye are shifted to the right (e.g., image 002').

[0075] At this point, the center C10' of image 001' shifts to the left relative to the center of display 101, and the center C20' of image 002' shifts to the right relative to the center C2 of display 102, aligning the image center with the pupil center of users with larger interpupillary distances. This improves the user's viewing experience.

[0076] However, the above solution requires the processor to perform coordinate transformations and other processing on the image based on the interpupillary distance information to generate a new image to be displayed, which consumes processor resources and increases processor power consumption.

[0077] To address the aforementioned issues, this application provides a display method. When the processor determines that the user's interpupillary distance (IPD) information is not within the standard IPD range, it instructs the DDIC to perform translation processing on the image to be displayed (e.g., adjusting the coordinates of each pixel in the original image to be displayed on the display), and controls the corresponding display to display the corresponding image. For example, if the user's IPD is greater than the standard IPD range, the DDIC is instructed to translate the image to be displayed for the left eye to the left, and the display for the left eye is controlled to display the translated image for the left eye; similarly, the image to be displayed for the right eye is translated to the right, and the display for the right eye is controlled to display the translated image for the right eye. This method can meet the viewing needs of users with different IPDs, improve the user viewing experience, while reducing processor resource usage and saving processor power consumption.

[0078] In some embodiments, the coordinates of the center pixel of the original image to be displayed are the center coordinates of the corresponding display. For example, the coordinates of the center pixel of the original image to be displayed for the left eye are the center coordinates of the display for the left eye, and the coordinates of the center pixel of the original image to be displayed for the right eye are the center coordinates of the display for the right eye.

[0079] In some embodiments, electronic devices (e.g., AR devices) can be pre-configured with different interpupillary distance (IPD) ranges, each with a specified translation distance and direction for the image to be displayed, for calculation by the processor. For example, for an IPD range greater than or equal to 58mm and less than or equal to 72mm (i.e., the standard IPD range), corresponding to the median IPD range, the translation distance is 0, and there is no translation direction. In this range, no translation of the image to be displayed is required; the coordinates of the center pixel of the image to be displayed are the center coordinates of the corresponding display. For an IPD range less than 58mm, corresponding to the small IPD range, the translation distance for the image to be displayed for the left eye is A1, with a rightward translation direction, and the translation distance for the image to be displayed for the right eye is A1, with a leftward translation direction. For an IPD range greater than 72mm, corresponding to the large IPD range, the translation distance for the image to be displayed for the left eye is A2, with a leftward translation direction, and the translation distance for the image to be displayed for the right eye is A2, with a rightward translation direction.

[0080] In this way, the processor does not need to calculate the translation distance based on the pupil distance information. Instead, the translation distance can be determined from the configuration file based on the pupil distance range corresponding to the pupil distance information, which can further reduce the amount of computation for the processor.

[0081] In some embodiments, the electronic device may also be pre-configured with a maximum interpupillary distance (IPD) setting corresponding to a maximum IPD range (e.g., greater than 75 mm) and a minimum IPD setting corresponding to a minimum IPD range (e.g., less than 55 mm) for the processor to perform calculations. For example, for an IPD range less than 55 mm, corresponding to the minimum IPD setting, the translation distance for the image to be displayed for the left eye is A3, with the translation direction to the right, and the translation distance for the image to be displayed for the right eye is A3, with the translation direction to the left. For an IPD range greater than 75 mm, corresponding to the maximum IPD setting, the translation distance for the displayed image for the left eye is A4, with the translation direction to the left, and the translation distance for the displayed image for the right eye is A4, with the translation direction to the right. Wherein, A4 is greater than A2, and A3 is greater than A1. For example, A4 and A3 can be four pixels, and A2 and A1 can be two pixels. The specific values ​​of A1, A2, A3, and A4 can be set according to actual needs, and are not limited in this embodiment.

[0082] It is understandable that when an electronic device is configured with a maximum interpupillary distance (IPD) range, the maximum value of the large IPD range is less than the minimum value of the maximum IPD range. For example, if the maximum IPD range is greater than 75mm, then the large IPD range can be greater than 72mm and less than or equal to 75mm. When an electronic device is configured with a minimum IPD range, the minimum value of the small IPD range is greater than the maximum value of the minimum IPD range. For example, if the minimum IPD range is less than 55mm, then the small IPD range can be greater than 55mm and less than or equal to 58mm.

[0083] It is understood that the above-mentioned division of gears is only an illustrative example. Depending on actual needs, more or fewer gears and the corresponding interpupillary distance range for each gear can be set. This application embodiment does not limit this.

[0084] In some embodiments, both the display corresponding to the left eye and the display corresponding to the right eye reserve additional display areas for the image to move left and right. That is, the size of the image displayed on the display corresponding to the left eye and the display corresponding to the right eye in the left-right direction (or the first direction) is smaller than the size of the effective display area of ​​the display in the left-right direction.

[0085] In some embodiments, for small interpupillary distance (IPD) and large interpupillary distance (IPD) settings, the display position of the image to be displayed can be entirely within the corresponding effective display area of ​​the corresponding display.

[0086] In some embodiments, for the minimum interpupillary distance (MPD) and maximum interpupillary distance (MPD) settings, there may be instances where the display position of a portion of the image to be displayed exceeds the corresponding effective display area of ​​the display. For such portions of the image that exceed the corresponding effective display area of ​​the display, cropping processing can be performed.

[0087] Figure 6Figures (a)-(e) illustrate, using AR device 100 as an example, the images displayed by AR device 100 when users with different interpupillary distances wear AR device 100. AR device 100 includes a display 101 for the left eye and a display 102 for the right eye.

[0088] like Figure 6 As described in (a), when the user's interpupillary distance (IPD) is within the range of 58 mm or greater and 72 mm or less (i.e., the standard IPD range), the electronic device determines the setting based on the user's IPD as the median IPD setting. Display 101 displays image 003 corresponding to the left eye, and display 102 displays image 004 corresponding to the right eye. The center C3 of image 003 coincides with the center C1 of display 101, and the center C4 of image 004 coincides with the center C2 of display 102.

[0089] like Figure 6 As described in (b), when the user's interpupillary distance is greater than or equal to 55 mm and less than 58 mm, the electronic device determines the setting based on the user's interpupillary distance as the small interpupillary distance setting. Display 101 displays image 003 corresponding to the left eye, and display 102 displays image 004 corresponding to the right eye. The center C3 of image 003 is offset to the right by A1 relative to the center C1 of display 101, and the center C4 of image 004 is offset to the left by A1 relative to the center C2 of display 101.

[0090] like Figure 6 As described in (c), when the user's interpupillary distance is within the range of 72-75mm, the electronic device determines the setting based on the user's interpupillary distance as the large interpupillary distance setting. Display 101 displays image 003 corresponding to the left eye, and display 102 displays image 004 corresponding to the left eye. The center C3 of image 003 is offset to the left by A2 relative to the center of display 101, and the center C3 of image 004 is offset to the right by A2 relative to the center of display 101.

[0091] like Figure 6 As described in section (d), when the user's interpupillary distance (IPD) is less than 55mm, the electronic device determines the minimum IPD setting based on the user's IPD. Display 101 displays image 003 corresponding to the left eye, and display 102 displays image 004 corresponding to the right eye. The center C3 of image 003 is offset to the right by A3 relative to the center C1 of display 101, and the center C4 of image 004 is offset to the left by A3 relative to the center C2 of display 102. Region 0031 of image 003 is cropped because it exceeds the effective display area of ​​display 101, and region 0041 of image 004 is cropped because it exceeds the effective display area of ​​display 102.

[0092] like Figure 6As described in (e), when the user's interpupillary distance (IPD) is greater than 75 mm, the electronic device determines the maximum IPD setting based on the user's IPD. Display 101 displays image 003 corresponding to the left eye, and display 102 displays image 004 corresponding to the right eye. The center C3 of image 003 is offset to the left by A4 relative to the center C1 of display 101, and the center C4 of image 004 is offset to the right by A4 relative to the center C2 of display 102. Region 0032 of image 003 is cropped because it exceeds the effective display area of ​​display 101, and region 0042 of image 004 is cropped because it exceeds the effective display area of ​​display 102.

[0093] The following is combined Figure 7 The flowchart illustrating the display method provides a detailed description of the display method provided in this application embodiment. The display method can be executed by an electronic device, which may include a processor, a DDIC, a display corresponding to the left eye (e.g., a first display), and a display corresponding to the right eye (e.g., a second display). Figure 7 As shown, the display methods include:

[0094] 201: The processor determines whether the user's interpupillary distance information is within the preset interpupillary distance range.

[0095] If the processor determines that the user's interpupillary distance information is within the preset interpupillary distance range, then it is not necessary to adjust the image by translation, and the process proceeds to step 206, instructing DDIC to display the first image to be displayed.

[0096] If the processor determines that the user's interpupillary distance information is not within the preset interpupillary distance range, then it is a case where the image needs to be translated and adjusted. In this case, the image position adjustment information can be determined based on the user's interpupillary distance information.

[0097] In some embodiments, the preset interpupillary distance range can be the standard interpupillary distance range mentioned in the embodiments of this application (e.g., 58mm-72mm).

[0098] It can be understood that the first image to be displayed may include the third image to be displayed corresponding to the left eye and the fourth image to be displayed corresponding to the right eye. The first coordinate information may include the coordinate information of each pixel in the third image to be displayed corresponding to the left eye and the coordinate information of each pixel in the fourth image to be displayed corresponding to the right eye.

[0099] The coordinate information of each pixel in the third image to be displayed corresponding to the left eye can refer to the position coordinates of each pixel in the third image to be displayed corresponding to the left eye on the monitor corresponding to the left eye, and the coordinate information of each pixel in the fourth image to be displayed corresponding to the right eye can refer to the position coordinates of each pixel in the fourth image to be displayed corresponding to the right eye on the monitor corresponding to the right eye.

[0100] In some embodiments, the processor determines whether the user's interpupillary distance (IPD) is within a preset IPD range based on the IPD information acquired by the eye-tracking camera of the electronic device.

[0101] In some embodiments, the processor can determine whether the user's interpupillary distance (IPD) information is within a preset IPD range based on the IPD information manually input by the user. For example, the manually input IPD information may be the IPD level, IPD range, or specific IPD value manually selected by the user.

[0102] 202: The processor determines the image position adjustment information based on the user's interpupillary distance information.

[0103] It is understood that when the processor determines that the user's interpupillary distance (IPD) information is not within the preset IPD range, it can determine image position adjustment information based on the user's IPD information. This image position adjustment information may include the translation direction (e.g., the first translation direction) and translation distance (e.g., the first translation distance) of the third image to be displayed corresponding to the left eye, and the translation direction (e.g., the second translation direction) and translation distance (e.g., the second translation distance) of the fourth image to be displayed corresponding to the right eye.

[0104] In some embodiments, the method for determining the translation direction and translation distance of the third image to be displayed and the translation direction and translation distance of the fourth image to be displayed based on the user's interpupillary distance information may include:

[0105] When the user's interpupillary distance (IPD) is less than the minimum value of the preset IPD range, the translation direction of the third image to be displayed is determined to be to the right, and the translation direction of the fourth image to be displayed is determined to be to the left. The translation distance of the third and fourth images to be displayed can be determined based on the difference between the user's IPD and the minimum value. For example, the translation distance of the third and fourth images to be displayed can be the pixel distance corresponding to half the absolute value of the difference between the user's IPD and the minimum value. For example, if the user's IPD is 56mm and the minimum value of the preset IPD range is 58mm, the translation distance of the third and fourth images to be displayed can be the pixel distance corresponding to 1mm. For example, when the resolution of the images to be displayed is 300dpi, 1mm is 11.8 pixels. It can be understood that the pixel distance corresponding to 1mm is different depending on the resolution of the images to be displayed.

[0106] When the user's interpupillary distance is greater than the maximum value of the preset interpupillary distance range, the translation direction of the third image to be displayed is determined to be to the left, and the translation direction of the fourth image to be displayed is determined to be to the right. The translation distance of the third and fourth images to be displayed is determined based on the difference between the user's interpupillary distance and the maximum value. For example, the translation distance of the third and fourth images to be displayed can be the pixel distance corresponding to half of the absolute value of the difference between the user's interpupillary distance and the maximum value.

[0107] In some embodiments, the electronic device may be pre-configured with different interpupillary distance ranges corresponding to different settings, and each setting may be configured with a translation distance and translation direction corresponding to the image to be displayed.

[0108] For example, for interpupillary distances (IPDs) greater than or equal to 58mm and less than or equal to 72mm (i.e., the standard IPD range), corresponding to the median IPD setting, the translation distance is 0, and there is no translation direction. In other words, at this setting, no translation of the image to be displayed is required; the coordinates of the center pixel of the image to be displayed are the center coordinates of the corresponding monitor. For IPDs less than 58mm, corresponding to the small IPD setting, the translation distance for the image to be displayed for the left eye is A1, with the translation direction to the right, and the translation distance for the image to be displayed for the right eye is also A1, with the translation direction to the left. For IPDs greater than 72mm, corresponding to the large IPD setting, the translation distance for the displayed image for the left eye is A2, with the translation direction to the left, and the translation distance for the displayed image for the right eye is also A2, with the translation direction to the right.

[0109] In this way, the processor does not need to calculate the translation distance based on the pupil distance information. The target pupil distance level can be determined based on the pupil distance range corresponding to the pupil distance information, and the translation distance corresponding to the pre-configured target pupil distance level can be obtained, which can further reduce the amount of computation by the processor and save processor resources.

[0110] In some embodiments, the electronic device may also be pre-configured with a maximum interpupillary distance (IPD) setting corresponding to a maximum IPD range (e.g., greater than 75 mm) and a minimum IPD setting corresponding to a minimum IPD range (e.g., less than 55 mm). For example, for an IPD range less than 55 mm, corresponding to the minimum IPD setting, the translation distance for the image to be displayed for the left eye is A3, with the translation direction to the right, and the translation distance for the image to be displayed for the right eye is A3, with the translation direction to the left. For an IPD range greater than 75 mm, corresponding to the maximum IPD setting, the translation distance for the displayed image for the left eye is A4, with the translation direction to the left, and the translation distance for the displayed image for the right eye is A4, with the translation direction to the right. Wherein, A4 is greater than A2, and A3 is greater than A1. For example, A4 and A3 can be four pixels, and A2 and A4 can be two pixels. The specific values ​​of A1, A2, A3, and A4 can be set according to actual needs, and are not limited in this embodiment.

[0111] It is understandable that when an electronic device is configured with a maximum interpupillary distance (IPD) range, the maximum value of the large IPD range is less than the minimum value of the maximum IPD range. For example, if the maximum IPD range is greater than 75mm, then the large IPD range can be greater than 72mm and less than or equal to 75mm. When a DDIC is configured with a minimum IPD range, the minimum value of the small IPD range is greater than the maximum value of the minimum IPD range. For example, if the minimum IPD range is less than 55mm, then the large IPD range can be greater than 55mm and less than or equal to 58mm.

[0112] It is understandable that configuring the maximum and minimum interpupillary distance ranges can achieve interpupillary distance matching for users with maximum and minimum interpupillary distances, thereby improving the image viewing experience for these users.

[0113] It is understood that the above-mentioned division of gears is only an illustrative example. Depending on actual needs, more or fewer gears and the corresponding interpupillary distance range for each gear can be set. This application embodiment does not limit this.

[0114] When an electronic device is pre-configured with different interpupillary distance ranges, the method for determining the translation direction and translation distance of the third image to be displayed and the translation direction and translation distance of the fourth image to be displayed based on the user's interpupillary distance information may also include:

[0115] Determine the target interpupillary distance range corresponding to the user's interpupillary distance, and obtain the target interpupillary distance level corresponding to the target interpupillary distance range. Then, based on the target interpupillary distance level, determine the translation direction and translation distance of the third and fourth images to be displayed.

[0116] For example, when the user's interpupillary distance is 56mm, the electronic device determines the setting based on the user's interpupillary distance as the small interpupillary distance setting. Then, the translation distance corresponding to the third image to be displayed for the left eye is A1, and the translation direction is to the right. The translation distance corresponding to the fourth image to be displayed for the right eye is A1, and the translation direction is to the left.

[0117] 203: The processor instructs DDIC to adjust the first image to be displayed based on the image position adjustment information.

[0118] In some embodiments, after the processor determines the image position adjustment information, it can send an image position adjustment instruction to the DDIC to inform the DDIC of the image position adjustment information, and instruct the DDIC to adjust the position of the first image to be displayed based on the image position adjustment information, and control the corresponding display to display the adjusted second image to be displayed.

[0119] 204: DDIC adjusts the first coordinate information of the first image to be displayed based on the image position adjustment information, obtains the second coordinate information, and adjusts the first image to be displayed based on the second coordinate information to obtain the second image to be displayed.

[0120] In some embodiments, the first image to be displayed corresponds to first coordinate information, which may include the coordinate information of each pixel in the third image to be displayed corresponding to the left eye and the coordinate information of each pixel in the fourth image to be displayed corresponding to the right eye.

[0121] The coordinate information of each pixel in the third image to be displayed corresponding to the left eye can refer to the position coordinates of each pixel in the third image to be displayed corresponding to the left eye on the monitor corresponding to the left eye, and the coordinate information of each pixel in the fourth image to be displayed corresponding to the right eye can refer to the position coordinates of each pixel in the fourth image to be displayed corresponding to the right eye on the monitor corresponding to the right eye.

[0122] In some embodiments, the coordinates of the center pixel of the third image to be displayed corresponding to the left eye are the center coordinates of the display corresponding to the left eye. The coordinates of the center pixel of the fourth image to be displayed corresponding to the right eye are the center coordinates of the display corresponding to the right eye.

[0123] In some embodiments, the coordinate information corresponding to each pixel in the third image to be displayed and the coordinate information corresponding to each pixel in the fourth image to be displayed corresponding to the right eye can both include the horizontal axis X coordinate and the vertical axis Y coordinate, wherein the X coordinate corresponds to the left and right direction of the display and the Y coordinate corresponds to the up and down direction of the display.

[0124] In some embodiments, the first coordinate information of the first image to be displayed is adjusted based on the image position adjustment instruction to obtain the second coordinate information. The method of adjusting the first image to be displayed based on the second coordinate information to obtain the second image to be displayed may include:

[0125] The coordinate information of the third image to be displayed is adjusted based on the translation direction and translation distance of the third image to be displayed, and the adjusted coordinate information is obtained. The third image to be displayed is then adjusted based on the adjusted coordinate information, and the adjusted image to be displayed is obtained. In other words, the adjusted coordinate information of the third image to be displayed can be used as the new coordinate information of the third image to be displayed, so that the display position of the third image to be displayed changes.

[0126] The coordinates of the fourth image to be displayed are adjusted based on the second translation direction and the second translation distance to obtain the adjusted coordinates. The adjusted coordinates are then used to further adjust the fourth image to be displayed, resulting in the adjusted image to be displayed. In other words, the adjusted coordinates of the fourth image to be displayed can be used as the new coordinates for the fourth image to be displayed, thereby changing the display position of the fourth image.

[0127] It is understandable that adjusting the image display position based on the user's interpupillary distance (IPD) can meet the image viewing needs of users with different IPDs and improve the user's viewing experience. At the same time, processing the image to be displayed based on DDIC (Digital Direct Input / Output IC) reduces processor resource usage compared to processor-based methods, thus saving processor power consumption.

[0128] In some embodiments, both the left-eye and right-eye displays have additional display areas. Specifically, the effective display area of ​​the left-eye display is longer in the left-right direction than the length of the image displayed on the left-eye display, and vice versa. This allows for continued display even after the image has been moved. The left-right direction can refer to the direction indicated by the line connecting the centers of the left-eye and right-eye displays.

[0129] In some embodiments, the center of the third image to be displayed corresponding to the left eye (i.e., the image to be displayed without coordinate adjustment) is aligned with the center of the display corresponding to the left eye, and the center of the fourth image to be displayed corresponding to the left eye (i.e., the image to be displayed without coordinate adjustment) is aligned with the center of the display corresponding to the right eye. That is, the initial display image is displayed in a centered manner on the corresponding display, and there is a preset distance between the left and right sides of the initial image to be displayed and the effective display area of ​​the corresponding display.

[0130] In some embodiments, when it is necessary to translate the third and fourth images to be displayed, if the translation distance of the third image to be displayed is less than or equal to half the difference between the length of the effective display area of ​​the display corresponding to the left eye in the left-right direction and the length of the third image to be displayed in the left-right direction, then half the difference between the length of the effective display area of ​​the display corresponding to the left eye in the left-right direction and the length of the third image to be displayed in the left-right direction can be used as the translation distance of the third image to be displayed. Similarly, if the translation distance of the fourth image to be displayed is less than or equal to half the difference between the length of the effective display area of ​​the display corresponding to the right eye in the left-right direction and the length of the fourth image to be displayed in the left-right direction, then half the difference between the length of the effective display area of ​​the second display in the left-right direction and the length of the fourth image to be displayed in the left-right direction can be used as the translation distance of the fourth image to be displayed. This avoids the display position of the image to be displayed exceeding the effective display area of ​​the corresponding display, thus preventing image loss.

[0131] In some embodiments, when it is necessary to translate the third image to be displayed and the fourth image to be displayed, for example, if the translation distance of the third image to be displayed is less than or equal to half the difference between the length of the effective display area of ​​the display corresponding to the left eye in the left-right direction and the length of the third image to be displayed in the left-right direction, the third image to be displayed can be translated based on the translation distance to obtain the translated image to be displayed. At this time, the display position of some areas of the translated image to be displayed exceeds the effective display area of ​​the display corresponding to the left eye, that is, the pixel coordinates of some areas are not within the effective display area of ​​the display corresponding to the left eye, and these areas can be cropped.

[0132] Similarly, the fourth image to be displayed can be translated based on this translation distance to obtain the translated image to be displayed. In this case, some areas of the translated image to be displayed exceed the effective display area of ​​the monitor corresponding to the right eye, meaning that the pixel coordinates of some areas are not within the effective display area of ​​the monitor corresponding to the left eye. These areas can be cropped. For specific examples, please refer to the above. Figure 6 (d) and (e) will not be discussed further here.

[0133] In this embodiment, when the image extends beyond the effective display area of ​​the monitor after translation, the image to be displayed is still translated by the actual required translation distance. This achieves a high-precision match between the image and the user's interpupillary distance, making the user's viewing experience more comfortable and improving the user experience. Furthermore, cropping the image beyond the display area allows for image adaptation to the monitor.

[0134] The following describes how to adjust the coordinates of the images to be displayed (e.g., the third and fourth images to be displayed).

[0135] In some embodiments, the coordinate information corresponding to each pixel in the image to be displayed may include the horizontal X coordinate and the vertical Y coordinate, wherein the X coordinate corresponds to the left and right direction of the display and the Y coordinate corresponds to the up and down direction of the display.

[0136] When the translation direction of the image to be displayed is to the left, the translation distance can be subtracted from the X coordinate of each pixel of the image to obtain the new X coordinate, and combined with the Y coordinate, the new overall coordinates of each pixel of the image to be displayed can be obtained.

[0137] When the translation direction of the image to be displayed is to the right, the translation distance can be added to the X coordinate of each pixel of the image to obtain the new X coordinate, and combined with the Y coordinate, the new overall coordinate of each pixel of the image to be displayed can be obtained.

[0138] It is understood that adjusting the coordinates of the third image to be displayed will result in a fifth image with coordinates different from the third image to be displayed, and adjusting the coordinates of the fourth image to be displayed will result in a sixth image with coordinates different from the fourth image to be displayed. It is understood that the fifth image to be displayed has the same image content as the third image to be displayed, and the sixth image to be displayed has the same image content as the fourth image to be displayed. The fourth and fifth images to be displayed can be referred to as the second image to be displayed mentioned in this application.

[0139] 205: DDIC controls the display to show the second image to be displayed.

[0140] It can be understood that DDIC controlling the display to show the second image to be displayed may include DDIC controlling the display corresponding to the left eye to show the image after the coordinate adjustment of the third image to be displayed (e.g., the fifth image to be displayed), and controlling the display corresponding to the right eye to show the image after the coordinate adjustment of the fourth image to be displayed (e.g., the sixth image to be displayed).

[0141] 206: The processor instructs the DDIC to control the display to show the first image to be displayed.

[0142] It is understandable that if the processor determines that the user's interpupillary distance information is within the preset interpupillary distance range, then there is no need to adjust the image translation. In this case, the processor sends a display instruction to the DDIC. The display instruction is used to instruct the DDIC to control the display to show the first image to be displayed based on the first coordinate information corresponding to the first image to be displayed.

[0143] 207: DDIC controls the display device to display the first image to be displayed.

[0144] It can be understood that DDIC controlling the display to show the first image to be displayed may include DDIC controlling the display corresponding to the left eye to show the third image to be displayed, and controlling the display corresponding to the right eye to show the fourth image to be displayed.

[0145] The display method provided in this application can adjust the image display position based on the user's interpupillary distance (IPD) to meet the needs of users with different IPDs and improve the user's viewing experience. Furthermore, by performing translation and other processing on the image to be displayed based on DDIC, compared to a solution based on processor-based processing of the image, processor resource usage can be reduced, thereby saving processor power consumption.

[0146] Figure 8 This illustration shows a flowchart of the display method in another embodiment of this application, as shown below. Figure 8 As shown, the display method may include:

[0147] DDIC can acquire the image to be displayed for the left eye (or left-eye image) and the image to be displayed for the right eye (or right-eye image). In some embodiments, the image to be displayed for the left eye and the image to be displayed for the right eye can be obtained based on the display content source through a graphics processing unit (GPU) in an electronic device.

[0148] It is understandable that the source of the displayed content can be any frame of the original image data. For example, if the original image data is video data, then the source of the displayed content can be any frame of the video data. The image to be displayed for the left eye is the left-hand portion of each frame of the original image data, and the images to be displayed for the right eye partially overlap.

[0149] As mentioned above Figure 2A As shown, when the content source (i.e., the image that the user needs to see) is image 200, the image to be displayed for the left eye is the left part of image 200, such as image 1010, and the image to be displayed for the right eye is the right part of image 200, such as image 1020. Since the visual fields of the user's left and right eyes overlap, region 1010-1 in image 1010 and region 1020-1 in image 1020 overlap. Regions 1010-1 and 1020-1 correspond to the overlapping areas of the user's visual fields.

[0150] DDIC can move the image to be displayed on the left screen (i.e., the display corresponding to the left eye) and the image to be displayed on the right screen (i.e., the display corresponding to the right eye) based on the image position adjustment instructions sent by the processor. It also controls the left screen to display the moved image corresponding to the left eye and the right screen to display the moved image corresponding to the left eye. The method by which DDIC moves the image corresponding to the left eye and the image corresponding to the right eye can be referred to in step 204 above, and will not be repeated here.

[0151] It is understood that the processor can determine image adjustment information (e.g., the translation direction and translation distance corresponding to the images to be displayed for the left and right eyes, respectively) based on the interpupillary distance parameter obtained from the interpupillary distance parameter input module, and send the aforementioned image position adjustment command to the DDIC. For example, the interpupillary distance parameter input module can be a mode selection module (e.g., a button) to obtain the interpupillary distance parameter manually selected by the user, such as the interpupillary distance mode. The interpupillary distance parameter input module may include an eye-tracking camera to automatically identify the pupil position and obtain the interpupillary distance parameter, such as the specific interpupillary distance value.

[0152] It is understood that in some comparative embodiments, the displayed image can also be adjusted by setting up a virtual camera in the processor, such as the GPU, and adjusting the position of the virtual camera. However, this approach leads to a significant increase in GPU power consumption, reducing the battery life of electronic devices. Furthermore, in scenarios where GPU rendering is not used (such as using an AR device to mirror other devices), it is impossible to adjust the displayed image through rendering.

[0153] It's understandable that various 3D models in AR and VR scenarios possess 3D structural information. Rendering methods can project these 3D models onto a plane, combining information such as the human eye's viewing angle (i.e., the rendering position and direction), to obtain a 2D image from that viewing angle. In GPU rendering engines (such as Unity), the rendering position and direction information used during the rendering process are abstractly represented as virtual cameras. Specifically, the GPU rendering engine constructs two virtual cameras in a virtual 3D space, each capturing images of the scene in that space, thus projecting the 3D space onto a 2D plane. By setting the position coordinates and angles of the two virtual cameras, it's possible to simulate a user's binocular view of a 3D space, achieving a 3D stereoscopic effect through binocular parallax. When the relative positions of the two virtual cameras in the virtual space correspond to the relative positions of the user's eyes in reality, the images rendered by the two virtual cameras are the same as the images seen by the user's eyes in the actual virtual scene, thus simulating the user's eyes. The default positions of the two virtual cameras are set based on the standard interpupillary distance range. When the user's interpupillary distance is not within the standard interpupillary distance range, the default position of the virtual camera can be moved and adjusted to obtain the adjusted left and right screen display images.

[0154] Among them, the method of adjusting the displayed image through rendering is as follows: Figure 9 As shown, it includes:

[0155] When rendering images, the GPU rendering engine adjusts the positions of the virtual cameras corresponding to the left and right eyes based on the interpupillary distance (IPD) parameters, rendering the left and right eye images accordingly to obtain the adjusted left and right eye images. The IPD parameters can be manually selected by the user, such as IPD levels, or automatically obtained from pupil position recognition by the eye-tracking camera, such as specific IPD values.

[0156] Understandable, such as Figure 10As shown, virtual cameras typically have clipping planes (including near and far clipping planes). These planes define the rendering range of the virtual camera, such as the field of view (FOV). Therefore, the clipping planes (including near and far clipping planes) of the virtual camera can be adjusted based on interpupillary distance adjustment parameters to obtain the rendered left and right eye images. DDIC controls the display of the left eye image on the left screen and the display of the right eye image on the right screen.

[0157] It is understandable that the above-mentioned solution, which uses GPU rendering to change the displayed image to match the user's interpupillary distance, will increase GPU power consumption, thereby reducing the battery life of electronic devices. However, the display method provided in this application embodiment can simply shift the image to be displayed using DDIC, eliminating the need for high-power processing such as rendering of the image by the processor, thus saving processor power and improving the battery life of electronic devices.

[0158] The structure of the electronic device will be explained below using AR device 100 as an example.

[0159] Figure 11 A schematic diagram of an AR device 100 is shown, as follows: Figure 11 As shown, the AR device 100 may include a processor 110, a DDIC 120, an interpupillary distance parameter input module 130, a display module 1, a display module 2, a power module 140, a memory 150, a wireless communication module 160, etc.

[0160] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the AR device 100. In other embodiments of this application, the AR device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0161] The processor 110 may include one or more processing units, such as a central processing unit (CPU), graphics processing unit (GPU), digital signal processor, microprocessor, artificial intelligence processor, or programmable logic device, etc. Different processing units may be independent devices or integrated into one or more processors. The processor 110 may include a storage unit for storing instructions and data. In some embodiments, the storage unit in the processor 110 is a memory 150. The processor can be used to execute the steps performed by the processor in the display method mentioned in the embodiments of this application. For example, such as... Figure 12As shown, the processor can be used to acquire an image source and interpupillary distance parameters from the interpupillary distance parameter input module 130, and acquire the image to be displayed for the left eye and the image to be displayed for the right eye based on the image source. Then, the image to be displayed for the left eye and the image to be displayed for the right eye are sent to the DDIC so that the DDIC controls the image movement and controls the display to show the moved image.

[0162] DDIC120 can be used to perform the steps executed by DDIC120 in the display method mentioned in the embodiments of this application. For example, it can be used to perform translation processing on the image to be displayed, and to control the display to display the corresponding image to be displayed.

[0163] The interpupillary distance (IPD) parameter input module 130 may include an eye-tracking camera, which can be used to acquire the user's IPD information. In some embodiments, the IPD parameter input module 130 may include an IPD level selection component (e.g., a button), which can be used to allow the user to manually select the IPD level.

[0164] Display module 1 includes a display 101 for the left eye and an optical device 1001. Display module 2 includes a display 102 for the right eye and an optical device 1002. When the user wears the AR device 100, display module 1 is used to display an image to the user's left eye. Display module 2 is used to display an image to the user's left eye. When the display 101 for the left eye displays an image, the light emitted from the display 101 is focused by the optical device 1001 onto the user's left eye so that the user's left eye can see the image; when the display 102 for the right eye displays an image, the light emitted from the display 102 is focused by the optical device 1002 onto the user's right eye so that the user's right eye can see the image.

[0165] In some embodiments, the number of optical devices and / or displays can be flexibly set according to different needs. For example, the display 101 corresponding to the left eye and the display 102 corresponding to the right eye can be two independent display devices, or two display areas on the same display device. In some embodiments, optical devices 1001 and 1002 can be two independent optical devices, or different parts on the same optical device, which is not limited in the embodiments of this application.

[0166] The power module 140 may include a power supply, a power management component, etc. The power supply may be a battery. The power management component is used to manage the charging of the power supply and the power supply to other modules.

[0167] The wireless communication module 120 may include an antenna, and transmits and receives electromagnetic waves via the antenna. The wireless communication module 120 can provide wireless communication solutions for use on the AR device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), and other wireless communication technologies. The AR device 100 can communicate with networks and other devices through wireless communication technologies.

[0168] This application provides a computer-readable storage medium storing instructions that, when executed on an electronic device, cause the electronic device to perform the display method mentioned in this application.

[0169] This application provides an electronic device, including a processor and a display driver chip, which is used to execute the display method mentioned in this application.

[0170] In some cases, the disclosed embodiments may be implemented in hardware, firmware, software, or any combination thereof. The disclosed embodiments may also be implemented as instructions carried or stored thereon on one or more temporary or non-temporary machine-readable (e.g., computer-readable) storage media, which may be read and executed by one or more processors. For example, the instructions may be distributed via a network or through other computer-readable media. Therefore, machine-readable media may include any mechanism for storing or transmitting information in a machine-readable (e.g., computer-readable) form, including but not limited to floppy disks, optical disks, CD-ROMs, magneto-optical disks, read-only memory (ROM), random access memory (RAM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), magnetic cards or optical cards, flash memory, or tangible machine-readable storage for transmitting information (e.g., carrier waves, infrared signals, digital signals, etc.) using the Internet in the form of electrical, optical, acoustic, or other propagation signals. Therefore, machine-readable media include any type of machine-readable medium suitable for storing or transmitting electronic instructions or information in a machine-readable (e.g., computer-readable) form.

[0171] In the accompanying drawings, some structural or methodological features may be shown in a specific arrangement and / or order. However, it should be understood that such a specific arrangement and / or order may not be necessary. Rather, in some embodiments, these features may be arranged in a manner and / or order different from that shown in the illustrative drawings. Furthermore, the inclusion of structural or methodological features in a particular figure does not imply that such features are required in all embodiments, and in some embodiments, these features may be omitted or may be combined with other features.

[0172] It should be noted that all units / modules mentioned in the device embodiments of this application are logical units / modules. Physically, a logical unit / module can be a physical unit / module, a part of a physical unit / module, or a combination of multiple physical units / modules. The physical implementation of these logical units / modules themselves is not the most important factor; the combination of functions implemented by these logical units / modules is the key to solving the technical problems proposed in this application. Furthermore, to highlight the innovative aspects of this application, the above-described device embodiments of this application have not introduced units / modules that are not closely related to solving the technical problems proposed in this application. This does not mean that the above-described device embodiments do not contain other units / modules.

[0173] It should be noted that in the examples and description of this patent, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one" does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0174] Although this application has been illustrated and described with reference to certain preferred embodiments thereof, those skilled in the art should understand that various changes in form and detail may be made thereto without departing from the spirit and scope of this application.

Claims

1. A display method characterized by comprising: An electronic device, comprising a processor and a display driving chip; The processor determines that user interpupillary distance information is not in a preset interpupillary distance range, determines image adjustment information based on the user interpupillary distance information, and sends an image position adjustment instruction to the display driving chip; The display driving chip receives the image position adjustment instruction, adjusts first coordinate information of a first to-be-displayed image based on the image adjustment information, obtains second coordinate information, and adjusts the first to-be-displayed image according to the second coordinate information to obtain a second to-be-displayed image, the second to-be-displayed image corresponding to the second coordinate information.

2. The display method according to claim 1, wherein The first to-be-displayed image includes a third to-be-displayed image corresponding to a user's left eye and a fourth to-be-displayed image corresponding to a user's right eye, and the first coordinate information includes third coordinate information of the third to-be-displayed image and fourth coordinate information of the fourth to-be-displayed image; The image adjustment information includes a first translation direction and a first translation distance of the third to-be-displayed image, and a second translation direction and a second translation distance of the fourth to-be-displayed image; The adjusting, based on the image position adjustment instruction, of the first coordinate information of the first to-be-displayed image to obtain second coordinate information, and the adjusting of the first to-be-displayed image according to the second coordinate information to obtain a second to-be-displayed image, includes: adjusting the third coordinate information of the third to-be-displayed image based on the first translation direction and the first translation distance to obtain fifth coordinate information, and adjusting the third to-be-displayed image based on the fifth coordinate information to obtain a fifth to-be-displayed image; adjusting the fourth coordinate information of the fourth to-be-displayed image based on the second translation direction and the second translation distance to obtain sixth coordinate information, and adjusting the fourth to-be-displayed image based on the sixth coordinate information to obtain a sixth to-be-displayed image.

3. The display method according to claim 2, wherein The user interpupillary distance information includes a user interpupillary distance, The determining, based on the user interpupillary distance information, of image adjustment information includes: corresponding to the user interpupillary distance being less than a minimum value of the preset interpupillary distance range, determining that the first translation direction is to the right and the second translation direction is to the left, and determining the first translation distance and the second translation distance based on a difference between the user interpupillary distance and the minimum value; corresponding to the user interpupillary distance being greater than a maximum value of the preset interpupillary distance range, determining that the first translation direction is to the left and the second translation direction is to the right, and determining the first translation distance and the second translation distance based on a difference between the user interpupillary distance and the maximum value.

4. The display method according to claim 2, wherein The user interpupillary distance information includes a user interpupillary distance, The determining, based on the user interpupillary distance information, of image adjustment information includes: determining a target interpupillary distance range corresponding to the user interpupillary distance; determining a target interpupillary distance gear corresponding to the target interpupillary distance range; determining the first translation direction and the first translation distance of the third to-be-displayed image, and the second translation direction and the second translation distance of the fourth to-be-displayed image based on the target interpupillary distance gear.

5. The display method according to claim 3 or 4, wherein The electronic device further comprises a first display and a second display, the first display corresponds to the left eye of the user, and the second display corresponds to the right eye of the user; The method further comprises: The processor determines that the user interpupillary distance is in the preset interpupillary distance range, and sends a display instruction to the display driving chip; The display driving chip controls the first display to display the third to-be-displayed image and controls the second display to display the fourth to-be-displayed image based on the display instruction; The first length of the effective display area of the first display in the first direction is greater than the second length of the third to-be-displayed image in the first direction, the third length of the effective display area of the second display in the first direction is greater than the fourth length of the fourth to-be-displayed image in the first direction, the center of the third to-be-displayed image is aligned with the center of the first display, the center of the fourth to-be-displayed image is aligned with the center of the second display, and the first direction is the direction of the line connecting the center of the first display and the center of the second display.

6. The display method according to claim 5, wherein The adjustment of the third coordinate information of the third to-be-displayed image based on the first translation direction and the first translation distance to obtain fifth coordinate information comprises: corresponding to the first translation distance being less than or equal to one half of the difference between the first length and the second length, adjusting the third coordinate information of the third to-be-displayed image based on the first translation direction and the first translation distance to obtain the fifth coordinate information; corresponding to the first translation distance being greater than one half of the difference between the first length and the second length, adjusting the third coordinate information of the third to-be-displayed image based on the first translation direction and a third translation distance to obtain the fifth coordinate information, wherein the third translation distance is one half of the difference between the first length and the second length; The adjustment of the fourth coordinate information of the fourth to-be-displayed image based on the second translation direction and the second translation distance to obtain sixth coordinate information comprises: corresponding to the second translation distance being less than or equal to one half of the difference between the third length and the fourth length, adjusting the fourth coordinate information of the fourth to-be-displayed image based on the second translation direction and the second translation distance to obtain the sixth coordinate information; corresponding to the second translation distance being greater than one half of the difference between the third length and the fourth length, adjusting the fourth coordinate information of the third to-be-displayed image based on the second translation direction and a fourth translation distance to obtain the sixth coordinate information, wherein the fourth translation distance is one half of the difference between the third length and the fourth length.

7. The display method according to claim 5, wherein The method further comprises: corresponding to the first translation distance being greater than one half of the difference between the first length and the second length, performing a clipping process on a first region of the fifth to-be-displayed image, the first region being a region corresponding to a pixel point whose coordinate is not within the effective display area range of the first display in the third to-be-displayed image; Corresponding to the second translation distance greater than half of the difference between the third length and the fourth length, a second region of the sixth to-be-displayed image is cropped, the second region being a region corresponding to a pixel point coordinate not within a range of an effective display region of the second display in the fourth to-be-displayed image.

8. The display method of any one of claims 1-7, wherein the user interpupillary distance information is obtained based on an eye movement camera of the electronic device. Alternatively, the user interpupillary distance information is determined based on a user manually selected interpupillary distance gear. The computer readable storage medium has instructions stored thereon, which when executed on an electronic device, cause the electronic device to perform the display method of any one of claims 1-8.

9. A computer-readable storage medium, characterized in that, The electronic device includes a processor and a display driver chip, and is configured to perform the display method of any one of claims 1-8.

10. An electronic device, comprising: The electronic device includes a processor and a display driver chip, and is configured to perform the display method of any one of claims 1-8.

Images