Display method and display device

By dynamically adjusting the sub-pixel display content and optical path of the pixel island, the problems of reverse viewing and eye tracking errors in 3D display are solved, achieving a continuous 3D visual experience and flexible viewing distance when the user's position changes.

CN116830151BActive Publication Date: 2026-01-02BOE TECHNOLOGY GROUP CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202180003637.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-11-29
Publication Date
2026-01-02
Estimated Expiration
2041-11-29

AI Technical Summary

Technical Problem

In existing 3D display technologies, the fixed sequence of images makes it easy for the human eye to reverse its gaze when moving, resulting in an incorrect 3D visual experience. Furthermore, eye-tracking technology suffers from problems such as reporting errors and limited viewing distance.

Method used

By acquiring the user's viewing position, determining the matching viewpoint image and parallax image set, dynamically adjusting the display content of the central sub-pixel and other sub-pixels of the pixel island, and using a dynamic image arrangement method combined with optical path adjustment structure, a three-dimensional visual experience at any position is achieved.

Benefits of technology

It achieves continuous 3D visual effects as the user's position changes, avoids visual errors caused by parallax jitter and reporting errors, reduces the precision requirements of optical structures, and improves the viewing experience and distance flexibility.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116830151B_ABST
    Figure CN116830151B_ABST
Patent Text Reader

Abstract

A display method and a display device, the display device comprising a plurality of pixel islands (21), at least one pixel island (21) comprising a plurality of sub-pixels (211), the display method comprising: obtaining a viewing position of a user (S310); determining a view point image matching the viewing position from a film source library to obtain a first view point image (S320); determining a plurality of view point images having parallax with the first view point image from the film source library to obtain a parallax image set (S330); for at least one pixel island (21), determining a center sub-pixel (211) from the plurality of sub-pixels (211) of the pixel island (21) according to the positional relationship between the viewing position and the position of at least one sub-pixel (211) in the pixel island (21) (S340); driving the center sub-pixel (211) in the at least one pixel island (21) to display according to the first view point image, and driving other sub-pixels (211) in the at least one pixel island (21) to display according to the parallax image set (S350), to form a target display picture; the target display picture being configured to enable the user to see a three-dimensional image corresponding to the first view point image when viewing the display device at the viewing position.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of display, in particular to a display method and a display device. BACKGROUND

[0002] At present, in three-dimensional display, a fixed sequence is usually adopted for mapping, for example, Figure 1a One of the schematic diagrams showing the mapping effect in an example is shown in FIG. 1. Figure 1a As shown in the figure, in this example, view 1, view 2, view 3 and view 4 are taken as a cycle, and the mapping is performed in a cycle. When the human eye is at the Figure 1a As shown in the figure, when the human eye is at the position shown in the figure, the left eye of the human is at the position of view 1, and the right eye of the human is at the position of view 3. By making view 1 and view 3 have a certain parallax, the human eye can see a three-dimensional image.

[0003] Since the fixed sequence is adopted for mapping, the human eye needs to be at a specific position to see a three-dimensional image. Once the human eye moves, the parallax may occur, resulting in an incorrect three-dimensional visual experience. SUMMARY

[0004] In view of the above problems, the present disclosure provides a display method applied to a display device, the display device comprising a plurality of pixel islands, at least one of the pixel islands comprising a plurality of sub-pixels, the display method comprising:

[0005] obtaining a viewing position of a user;

[0006] determining a viewpoint image matched with the viewing position from a film source library to obtain a first viewpoint image;

[0007] determining a plurality of viewpoint images having parallax with the first viewpoint image from the film source library to obtain a parallax image set;

[0008] for at least one of the pixel islands, determining a center sub-pixel from a plurality of sub-pixels in the pixel island according to a positional relationship between the viewing position and at least one of the sub-pixels in the pixel island;

[0009] driving the center sub-pixel in at least one of the pixel islands to display according to the first viewpoint image, and driving other sub-pixels in at least one of the pixel islands to display according to the parallax image set, to form a target display picture; the target display picture is configured to enable the user to see a three-dimensional image corresponding to the first viewpoint image when the user watches the display device at the viewing position.

[0010] According to an embodiment of the present disclosure, the display area of the display device is configured with a reference point, and the step of determining a first view point image from the slice source library that matches the viewing position includes:

[0011] According to a difference between the viewing position and the position of the reference point, a first view area is determined from a preset view area distribution map that matches the viewing position.

[0012] A view point image that matches the first view area is extracted from the slice source library to obtain the first view point image.

[0013] According to an embodiment of the present disclosure, the step of determining a first view area from a preset view area distribution map that matches the viewing position according to a difference between the viewing position and the position of the reference point includes:

[0014] According to a preset angle coordinate system, an angle coordinate of the viewing position relative to the reference point is determined, and the preset angle coordinate system is an angle coordinate system established according to the reference point and a plane in which the display area is located.

[0015] A first view area is determined from a preset view area distribution map that matches the angle coordinate.

[0016] According to an embodiment of the present disclosure, the reference point is located at the center of the display area.

[0017] According to an embodiment of the present disclosure, the step of determining a plurality of view point images that have parallax with the first view point image from the slice source library to obtain a parallax image set includes:

[0018] A view point image that has a first preset parallax relationship with the first view point image is determined from the slice source library to obtain at least one second view point image.

[0019] A view point image that has a second preset parallax relationship with the first view point image is determined from the slice source library to obtain at least one third view point image.

[0020] The parallax image set is composed of at least one second view point image and the third view point image, wherein the parallax between at least one second view point image and the first view point image is opposite to the parallax between at least one third view point image and the first view point image.

[0021] According to an embodiment of the present disclosure, the number of second view point images is the same as the number of third view point images.

[0022] According to an embodiment of the present disclosure, the number of the second view images and the number of the third view images are both plural, and different second view images have different parallaxes with the first view image, and different third view images have different parallaxes with the first view image.

[0023] According to an embodiment of the present disclosure, the step of determining a center sub-pixel from the plurality of sub-pixels of the pixel island according to the positional relationship between the viewing position and at least one sub-pixel in the pixel island comprises:

[0024] According to the positional relationship between the viewing position and the pixel island, an angle relationship of the viewing position relative to the pixel island is determined;

[0025] An angle spectrum of at least one sub-pixel in the pixel island is obtained from an angle spectrum library;

[0026] According to the angle spectrum of the at least one sub-pixel and the angle relationship, a sub-pixel matching the viewing position is determined from the plurality of sub-pixels of the pixel island;

[0027] The determined sub-pixel is taken as the center sub-pixel.

[0028] According to an embodiment of the present disclosure, the step of driving other sub-pixels in at least one pixel island to display according to the parallax image set to form a target display picture comprises:

[0029] For at least one sub-pixel in other sub-pixels of at least one pixel island,

[0030] According to a preset arrangement rule, a view image matching the sub-pixel is determined from the parallax image set;

[0031] The sub-pixel is driven to display according to the determined view image;

[0032] According to an embodiment of the present disclosure, in other sub-pixels of at least one pixel island, at least one sub-pixel matches at least one view image, and different sub-pixels match different view images.

[0033] According to an embodiment of the present disclosure, the display method further comprises:

[0034] Obtaining a view index number of a plurality of sub-pixels in at least one pixel island;

[0035] The obtained view index number is sorted to form a view index number sequence;

[0036] The step of determining a view point image matching the sub-pixel from the set of view point images according to the preset mapping rule comprises:

[0037] According to the positional relationship between the view point index number of the other sub-pixels and the view point index number of the center sub-pixel in the index number sequence, a view point image matching the view point index number is determined from the set of view point images;

[0038] According to the preset mapping rule, a sub-pixel matching the view point index number is determined, and a view point image matching the view point index number is determined as a view point image matching the sub-pixel.

[0039] According to an embodiment of the present disclosure, the user includes a first observation eye and a second observation eye, and the observation position is located between the first observation eye and the second observation eye;

[0040] The step of determining a view point image matching the sub-pixel from the set of view point images according to the positional relationship between the view point index number of the other sub-pixels and the view point index number of the center sub-pixel in the index number sequence further comprises:

[0041] According to the position of the view point index number of the center sub-pixel in the index number sequence, the remaining view point index numbers are divided into a first view point index number group corresponding to the first observation eye and a second view point index number group corresponding to the second observation eye;

[0042] From the plurality of second view point images, a view point image matching the view point index number in the first view point index number group is determined; and from the plurality of third view point images, a view point image matching the view point index number in the second view point index number group is determined.

[0043] According to an embodiment of the present disclosure, for the first view point index number group, when the view point index numbers therein include the first n view point index numbers and the last m view point index numbers in the sequence of view point index numbers, a view point image matching the view point index number in the first view point index number group is determined from the plurality of second view point images according to a preset first shift extension rule;

[0044] For the second view point index number group, when the view point index numbers therein include the first n view point index numbers and the last m view point index numbers in the sequence of view point index numbers, a view point image matching the view point index number in the second view point index number group is determined from the plurality of third view point images according to a preset second shift extension rule;

[0045] The shift extension directions of the first shift extension rule and the second shift extension rule are opposite.

[0046] According to an embodiment of the present disclosure, the display method further comprises a step of establishing a slice source library, and the step of establishing the slice source library comprises:

[0047] establishing a virtual camera array, the virtual camera array having a first collection step size of δθ and a second collection step size of Δθ;

[0048] wherein the δθ is an angle of each sub-pixel projection, and the Δθ is a preset angle positioning accuracy;

[0049] collecting images of a target object by using the virtual camera array to form the slice source library.

[0050] According to an embodiment of the present disclosure, the display method further comprises a step of establishing an angle spectrum library, and the step of establishing the angle spectrum library comprises:

[0051] for at least one of the pixel islands,

[0052] obtaining angle spectra of a plurality of sub-pixels in the pixel island to obtain a plurality of initial angle spectra;

[0053] processing each of the initial angle spectra according to boundaries of the initial angle spectra to obtain a plurality of target angle spectra;

[0054] constructing the angle spectrum library according to the target angle spectra.

[0055] Another aspect of the present disclosure also provides a display device, wherein the display device comprises a plurality of pixel islands, at least one of the pixel islands comprises a plurality of sub-pixels, and the display device further comprises a processing module configured to perform the following steps:

[0056] obtaining a viewing position of a user;

[0057] determining a viewpoint image matching the viewing position from a slice source library to obtain a first viewpoint image;

[0058] determining a plurality of viewpoint images having parallax with the first viewpoint image from the slice source library to obtain a parallax image set;

[0059] for at least one of the pixel islands, determining a center sub-pixel from a plurality of sub-pixels of the pixel island according to a positional relationship between the viewing position and at least one sub-pixel in the pixel island;

[0060] According to the first view image, the center sub-pixel in at least one of the pixel islands is driven to display, and according to the parallax image set, other sub-pixels in at least one of the pixel islands are driven to display, so as to form a target display picture; the target display picture is configured to enable the user to see a three-dimensional image corresponding to the first view image when the user watches the display device at the watching position.

[0061] According to an embodiment of the present disclosure, the display device further comprises a light path adjusting structure configured to enable the light emitted by at least one of the pixel islands to form a plurality of continuous views on a preset projection surface after passing through the light path adjusting structure.

[0062] According to an embodiment of the present disclosure, the plurality of sub-pixels of at least one of the pixel islands are arranged along a first direction, and the light path adjusting structure comprises a plurality of cylindrical lens units, each cylindrical lens unit comprising a plurality of lenses arranged along the first direction, and each pixel island being covered by one cylindrical lens unit.

[0063] According to an embodiment of the present disclosure, the sub-pixels in the same pixel island are of the same color. BRIEF DESCRIPTION OF DRAWINGS

[0064] The above and other objects, features and advantages of the present disclosure will become more apparent from the following description of embodiments of the present disclosure, taken in conjunction with the accompanying drawings, in which:

[0065] Figure 1a One of the schematic diagrams schematically showing the layout effect in an example is shown;

[0066] Figure 1b The second one of the schematic diagrams schematically showing the layout effect in an example is shown;

[0067] Figure 2a The schematic diagram schematically showing the display device in an embodiment of the present disclosure is shown;

[0068] Figure 2b The flowchart schematically showing the display method in an embodiment of the present disclosure is shown;

[0069] Figures 3a to 3d The schematic diagram schematically showing the display effect of the display method in an embodiment of the present disclosure is shown;

[0070] Figure 4a The schematic diagram schematically showing the view distribution diagram in an embodiment of the present disclosure is shown;

[0071] Figure 4b The first one of the schematic diagrams schematically showing the light path of the display device in an embodiment of the present disclosure is shown;

[0072] Figure 4c The second one of the schematic diagrams schematically showing the light path of the display device in an embodiment of the present disclosure is shown; Figure 4bschematic diagram at position A;

[0073] Figure 5 schematic diagram illustrating determination of a viewing position in an embodiment of the present disclosure;

[0074] Figure 6 schematic diagram illustrating a viewing position and a pixel island in an embodiment of the present disclosure;

[0075] Figure 7a and Figure 7b schematic diagram illustrating a sequence of index numbers in an embodiment of the present disclosure;

[0076] Figure 8 schematic diagram illustrating a viewpoint index number and a physical position of a sub-pixel in an embodiment of the present disclosure;

[0077] Figure 9a schematic diagram illustrating a virtual camera array in an embodiment of the present disclosure;

[0078] Figure 9b schematic diagram illustrating an initial angular spectrum of a part of sub-pixels in a pixel island in an embodiment of the present disclosure;

[0079] Figure 10 schematic diagram illustrating an optical path of a display device in an embodiment of the present disclosure;

[0080] Figure 11 schematic diagram illustrating Figure 10 enlarged view at position C;

[0081] Figure 12 schematic diagram illustrating a cross-sectional view of an optical path adjustment structure in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0082] So that the purposes, technical solutions and superiorities of the embodiments of the present disclosure can be more apparent, the technical solutions of the embodiments of the present disclosure will be described clearly and completely below with reference to the drawings. Obviously, the described embodiments are some but not all of the embodiments of the present disclosure. Based on the described embodiments of the present disclosure, all other embodiments obtained by those of ordinary skill in the art without creative effort fall within the scope of the present disclosure.

[0083] It should be noted that in the drawings, the size and relative size of the elements can be exaggerated for clarity and / or descriptive purposes. Thus, the size and relative size of the elements in the drawings should not be construed as being to scale. In the description and drawings, identical or similar reference numerals indicate identical or similar components.

[0084] When an element is described as being "on" another element, "connected to" another element, or "coupled to" another element, it can be directly on, directly connected to, or directly coupled to the other element, or intervening elements can be present. In contrast, when an element is described as being "directly on," "directly connected to," or "directly coupled to" another element, there are no intervening elements present. Other terms of description used herein, such as "between," "directly between," "adjacent to," "directly adjacent to," or "on" can be interpreted in a like fashion. In addition, the term "connected" can refer to physical or electrical connectivity, communicative connectivity, and / or fluidic connectivity. Furthermore, the X-axis, Y-axis, and Z-axis are not limited to the three axes of a Cartesian coordinate system and can be interpreted in a broader sense. For example, the X-axis, Y-axis, and Z-axis can be perpendicular to each other, or can represent different directions that are not perpendicular to each other. For the purposes of the present disclosure, "at least one of X, Y, and Z" and "at least one selected from the group consisting of X, Y, and Z" can be interpreted to include only X, only Y, only Z, or any combination of two or more of X, Y, and Z such as XYZ, XYY, YZ, and ZZ. As used herein, the term "and / or" includes any and all combinations of one or more of the associated items.

[0085] It should be noted that, although the terms "first," "second," etc. can be used herein to describe various elements, components, regions, layers and / or sections, these elements, components, regions, layers and / or sections should not be limited by these terms. Rather, these terms are used only to distinguish one element, component, region, layer and / or section from another element, component, region, layer and / or section. Thus, a first element, component, region, layer and / or section discussed below could be termed a second element, component, region, layer and / or section without departing from the teachings of the present disclosure.

[0086] Spatially relative terms, such as "on", "above", "left", "right", and the like, can be used herein for ease of description to describe one element or feature's relationship to another element(s) or feature(s) as illustrated in the figures. It will be understood that the spatially relative terms are intended to encompass different orientations of the device in use or operation in addition to the orientations depicted in the figures. For example, if a device described is turned over, elements described as "below" or "under" other elements or features would then be oriented "above" the other elements or features. Similarly, if a device is turned over, elements described as "above" other elements or features would then be oriented "below" the other elements or features.

[0087] Those skilled in the art will understand that, unless otherwise stated herein, the term "thickness" refers to the dimension along the surface perpendicular to the display substrate on which the various film layers are disposed, i.e., the dimension along the light emission direction of the display substrate.

[0088] In this article, unless otherwise stated, the term "patterning process" generally includes steps such as photoresist coating, exposure, development, etching, and photoresist stripping. The term "one-step patterning process" refers to the process of forming patterned layers, components, and parts using a single photomask.

[0089] It should be noted that the terms "same layer," "same layer setup," or similar expressions refer to a layer structure formed by using the same film deposition process to create a film layer for forming a specific pattern, and then using the same photomask to pattern this film layer in a single patterning process. Depending on the specific pattern, a single patterning process may include multiple exposure, development, or etching processes, and the specific pattern in the resulting layer structure may be continuous or discontinuous. These specific patterns may also be at different heights or have different thicknesses.

[0090] In this document, unless otherwise stated, the term "electrical connection" can mean that two components or elements are directly electrically connected, for example, component or element A is in direct contact with component or element B, and an electrical signal can be transmitted between them; it can also mean that two components or elements are electrically connected through a conductive medium, such as a conductive wire, for example, component or element A is electrically connected to component or element B through a conductive wire to transmit an electrical signal between the two components or elements; it can also mean that two components or elements are electrically connected through at least one electronic component, for example, component or element A is electrically connected to component or element B through at least one thin-film transistor to transmit an electrical signal between the two components or elements.

[0091] like Figure 1a As shown, in this example, the display device has multiple sub-pixels (sub-pixel a, sub-pixel b, sub-pixel c, and sub-pixel d), which are divided into multiple groups, each group including multiple sub-pixels. The display device also includes a light path adjustment structure 11, configured to project light rays emitted from sub-pixels in the same group to the same position, and light rays emitted from sub-pixels in different groups to different positions. For example, light rays emitted from sub-pixel a are all projected to the position of view 1, light rays emitted from sub-pixel b are all projected to the position of view 2, light rays emitted from sub-pixel c are all projected to the position of view 3, and light rays emitted from sub-pixel d are all projected to the position of view 4, thus forming a continuous view, allowing the human eye to be in a state of continuous motion. Figure 1a When viewing the display device from the indicated position, a three-dimensional image can be seen. This method of image arrangement requires a high level of precision in the optical path adjustment structure 11 to ensure that the light emitted from each sub-pixel is accurately projected to the designated position.

[0092] Figure 1b Fig. 2 schematically shows a diagram of the layout effect in an example, as shown in Figure 1b When the human eye moves to the position shown in Figure 1b , the left eye of the human is at the position of view 3, and the right eye of the human is at the position of view 1. Compared with Figure 1a , the views watched by the left and right eyes are opposite, and thus the reverse vision occurs, resulting in an incorrect visual experience.

[0093] In another example, the reverse vision problem is solved by an eye tracking technology. By the eye tracking technology, the position of the human eye, i.e., the point position, can be located. Then, the display content is adjusted according to the point position. For example, when the human eye moves to the position shown in Figure 1b , the display content of the two sub-pixels corresponding to view 1 and view 3 is exchanged, so that the positions of view 1 and view 3 are exchanged, thereby solving the reverse vision problem.

[0094] However, the inventors have found in research that the display device in the above example still has the following problems:

[0095] Firstly, since the eye tracking technology has a point error, when the human eye is at rest, the point may jitter, which will cause the parallax of the images watched by the two eyes to jitter, and thus an incorrect visual experience is caused. Furthermore, since the layout in this example is still performed in a fixed order, when the reverse vision problem is solved, only the positions of view 1 and view 3 are exchanged, and thus the stereoscopic vision of the human eye at the position shown in Figure 1a and the position shown in Figure 1b is the same, and the motion parallax is lacking. For example, for a human face image, the human eye at the position shown in Figure 1a and the position shown in Figure 1b sees the front face of the human and cannot see the side face of the human. Finally, as shown in Figure 1a and Figure 1b , the distance between view 1 to view 4 and the position of the display device is fixed, which means that the user can only have a correct three-dimensional visual experience at a fixed viewing distance, and the viewing distance is greatly limited.

[0096] Therefore, the display method provided in the embodiments of the present disclosure is applied to a display device, and Fig. 2 schematically shows a diagram of the display device in the embodiments of the present disclosure, as shown in Figure 2aAs shown, the display device includes a plurality of pixel islands 21, at least one pixel island 21 includes a plurality of sub-pixels 211, optionally, each pixel island 21 includes a plurality of sub-pixels 211, the plurality of sub-pixels 211 in each pixel island 21 are arranged along a first direction, and the plurality of sub-pixels 211 in each pixel island 21 are of the same color. Wherein, the first direction can refer to the horizontal direction in the figure. Figure 2a

[0097] Figure 2b The flowchart of the display method in the embodiment of the present disclosure is schematically shown as Figure 2b The display method of the embodiment of the present disclosure includes steps S210 to S250.

[0098] In step S210, the viewing position of the user is acquired.

[0099] In the embodiment of the present disclosure, the viewing position can be acquired through eye tracking technology, and the viewing position can specifically refer to the position of the user's eyes. Optionally, the viewing position can be the midpoint between the user's two eyes, for example, the brow center. The acquired viewing position can include coordinates, and the coordinates can represent the position of the viewing position in a three-dimensional space.

[0100] In step S220, a viewpoint image matching the viewing position is determined from a clip source library to obtain a first viewpoint image.

[0101] In the embodiment of the present disclosure, the clip source library can be pre-configured. For example, the viewpoint image can be an image obtained by image acquisition of a target object through a virtual camera array, and different viewpoint images have different acquisition angles. Optionally, the acquisition angle can be configured according to the possible viewing positions of the user, so that one viewing position can match at least one viewpoint image, and different viewing positions can match viewpoint images of different angles. For example, the user can watch the display device directly or watch the display device from the side. For a face image, when the user watches the display device directly, the viewpoint image matching the viewing position of the user can be the front of the face; when the user moves to the left or right side, the viewpoint image matching the viewing position of the user can be the side of the face.

[0102] In step S230, a plurality of viewpoint images having parallax with the first viewpoint image are determined from the clip source library to obtain a parallax image set.

[0103] ​In the embodiments of the present disclosure, any two of the plurality of view images can have a preset parallax, which is configured to enable the plurality of continuous view images to achieve a three-dimensional display effect. The number of view images selected from the slice source library and having the parallax with the first view image and the size of the parallax can be determined according to actual needs, and the embodiments of the present disclosure do not limit this, as long as the view images in the final obtained parallax image set can cooperate with the first view image to achieve three-dimensional display.

[0104] In step S240, for at least one pixel island 21, a center sub-pixel 211 is determined from a plurality of sub-pixels 211 of the pixel island 21 according to the positional relationship between the viewing position and at least one sub-pixel 211 in the pixel island 21.

[0105] In the embodiments of the present disclosure, the display device includes a plurality of pixel islands 21, for example, as shown in Figure 6 The display device can include a plurality of pixel islands 21 arranged along the second direction, and the positional relationship between the viewing position and the plurality of pixel islands 21 is different.

[0106] In the embodiments of the present disclosure, according to the positional relationship between the viewing position and each sub-pixel 211 in the pixel island 21, one sub-pixel 211 that has a greater impact on the viewing position can be selected as the center sub-pixel 211. Taking one pixel island 21 as an example, in the pixel island 21, a certain sub-pixel 211 is directly opposite the viewing position, and the content displayed by the sub-pixel 211 plays a major role compared to the content displayed by other sub-pixels 211 in the pixel island 21. Therefore, the sub-pixel 2115 can be selected as the center sub-pixel 211. It should be noted that the above content is only an example of "directly opposite" to schematically illustrate the process of selecting the center sub-pixel 211, and does not constitute a limitation on the method of selecting the center sub-pixel 211. For example, in some specific embodiments, the center sub-pixel 211 can be determined according to the included angle between the viewing position and the pixel island 21 and the angular spectrum of each sub-pixel 211 in the pixel island 21, which will be described in detail below, and will not be described here.

[0107] In step S250, the center sub-pixel 211 in at least one pixel island 21 is driven to display according to the first view image, and the other sub-pixels 211 in at least one pixel island 21 are driven to display according to the parallax image set, to form a target display picture. The target display picture is configured to enable a user to see a three-dimensional image corresponding to the first view image when the user watches the display device at the viewing position.

[0108] Since the display method of this embodiment can determine the central sub-pixel of each pixel island 21 according to the user's viewing position, and then select a matching viewpoint image for each sub-pixel of each pixel island 21 around the central sub-pixel, and the viewing position obtained by eye tracking technology can be any position in three-dimensional space, the arrangement of images for each pixel island according to the viewing position can achieve a three-dimensional visual experience effect at any position, thereby making the user's viewing distance unrestricted and improving the viewing experience. Figures 3a to 3d This schematic diagram illustrates the display effect of the display method according to an embodiment of the present disclosure. Figure 3a and Figure 3b As shown, the display method of this disclosure, since the first viewpoint image matches the user's viewing position, changes the first viewpoint image as the user moves; that is, the viewing angle of the target display screen also changes. For example, taking a kettle as an example, when the user views the display device directly, they can see the front of the kettle; when the user moves to the left or right, they can see the side of the kettle, thus achieving continuous motion parallax. Figure 3a and Figure 3c As shown in this embodiment, the first viewpoint image is displayed in conjunction with a parallax image set. Even if a reporting error occurs during eye tracking (the eye does not move, but the reporting jitters), by displaying the viewpoint image in the parallax image set, the parallax jitter of the image seen by the user can be avoided, thus improving the resulting visual error.

[0109] Furthermore, in some cases, a delay in reporting points may occur during eye tracking (the eye moves, but the reporting point does not). This, combined with... Figure 3a and Figure 3d As shown, through the display method of this embodiment, even if the reporting point remains unchanged, the user can view the correct image by displaying the image in the parallax image set, thereby avoiding visual errors caused by reporting point delay. Furthermore, using the display method of this embodiment, the central sub-pixel 211 in each pixel island 21 can be determined in real time according to changes in the observation position, and then corresponding image arrangement can be performed to achieve dynamic image arrangement, thereby replacing... Figure 1a and Figure 1b The fixed pattern arrangement used reduces the precision requirements for the optical structure.

[0110] The following is combined Figures 2a to 12 The display method of the embodiments of this disclosure will be described in detail.

[0111] In some specific embodiments, a reference point is configured in the display area of ​​the display device, and step S220 includes steps S221 to S222.

[0112] At step S221, according to the position difference between the viewing position and the reference point, a view area matching the viewing position is determined from the preset view area distribution map, to obtain a first view area.

[0113] In the embodiments of the present disclosure, the view area distribution map can be configured to correspond to positions that can be projected by light rays emitted by the pixel island 21. The view area distribution map is described below by taking one pixel island 21 as an example. Specifically, Figure 4a A schematic diagram of the view area distribution map in the embodiments of the present disclosure is shown schematically as Figure 4a As shown in the figure, the view area distribution map includes view areas 41 to 411 arranged continuously along a third direction, Figure 4b A schematic diagram of the light path of the display device in the embodiments of the present disclosure is shown schematically as Figure 4c A schematic diagram of Figure 4b at position A, in combination with FIG. 2, Figures 4a to 4c As shown in the figure, the display device is further provided with a light path adjusting structure 22, which can include a cylindrical lens. The light path adjusting structure can be configured to make the light rays emitted by the pixel island 21 form a plurality of continuous views 31 to 311 corresponding to the view areas 41 to 411 on a preset projection surface S after passing through the light path adjusting structure 22. Optionally, the views 31 to 311 are arranged one by one corresponding to the view areas 41 to 411. The preset projection surface S can refer to one or more planes parallel to the display surface of the display device, and the number of preset projection surfaces is not limited in the embodiments of the present disclosure.

[0114] In some specific embodiments, step S221 includes:

[0115] S2211, according to a preset angle coordinate system, determining an angle coordinate of the viewing position relative to the reference point, the preset angle coordinate system being an angle coordinate system established according to the reference point and the plane where the display area is located.

[0116] S2212, determining a view area matching the angle coordinate from the preset view area distribution map, to obtain the first view area.

[0117] In some specific embodiments, the position of the reference point can be determined according to actual needs. For example, the reference point can be arranged at the top corner of the display area of the display device, or at the center of the display area.

[0118] For example, the reference point is located at the center of the display area, and the preset angle coordinate system can take the reference point as the origin.

[0119] Figure 5 A schematic diagram of determining the viewing position in the embodiments of the present disclosure is shown schematically as Figure 5As shown, in the embodiments of the present disclosure, the viewing position of the user can be obtained by the eye tracking technology. Taking the human eye as an example, first, the coordinates of the two eyeballs of the user in the preset space are located, and then, according to the coordinates of the two eyeballs, the coordinates of the midpoint M between the two eyeballs, that is, the viewing position of the user, are determined. Then, according to the coordinates of the midpoint M and the reference point (for example, the center of the display area) in the display device, the angle coordinates (θ H , θ V ) of the midpoint M relative to the center of the display area can be determined.

[0120] In some specific embodiments, the angle coordinates (θ H , θ V ) are used to represent the angle relationship between the viewing position and the reference point. For example, the angle coordinate system includes x-axis, y-axis and z-axis, θ H may be used to represent the included angle between the line connecting the viewing position and the reference point and the plane where the x-axis and the z-axis of the angle coordinate system are located, and θ V may be used to represent the included angle between the line connecting the viewing position and the reference point and the plane where the y-axis and the z-axis of the angle coordinate system are located.

[0121] According to the angle coordinates, it can be determined that the midpoint M is located at which view position of the preset projection surface S, and then the view area matched with the midpoint M can be determined, so as to obtain the first view area. For example, as shown in Figure 4a and Figure 5 , the midpoint M is located at the position of the view 36 of the preset projection surface S. As described above, the view areas 41 to 411 can be set in one-to-one correspondence with the views 31 to 311, that is, the view area matched with the midpoint M is the view 46.

[0122] In step S222, the viewpoint image matched with the first view area is extracted from the clip source library to obtain the first viewpoint image.

[0123] In the embodiments of the present disclosure, each viewpoint image in the clip source library can be matched with one or more view areas, and when the view area is determined, the corresponding viewpoint image can be determined. Taking the picture of the kettle as an example, when the first view area is the view area 46, the viewpoint image matched with the view area 46 is the front of the kettle, at this time, the observer can see the three-dimensional image of the front of the kettle. When the observer moves, the viewing position changes, and the first view area is updated to the view area 41, and the viewpoint image matched with the view area 41 is the left side of the kettle, at this time, the observer can see the three-dimensional image of the left side of the kettle, so as to realize the motion parallax.

[0124] In some specific embodiments, step S230 includes steps S231 to S233.

[0125] At step S231, a view image having a first preset parallax relationship with the first view image is determined from the slice source library to obtain at least one second view image.

[0126] At step S232, a view image having a second preset parallax relationship with the first view image is determined from the slice source library to obtain at least one third view image.

[0127] At step S233, a parallax image set is constituted by the at least one second view image and the third view image, wherein the parallax between the at least one second view image and the first view image is opposite to the parallax between the at least one third view image and the first view image.

[0128] In the embodiments of the present disclosure, the second view image and the third view image can be extracted from the slice source library according to the view region distribution map. For example, the view region distribution map includes 11 continuous view regions, i.e., view region 41, view region 42, view region 43, view region 44, view region 45, view region 46, view region 47, view region 48, view region 49, view region 410, and view region 411, and the 11 view regions can correspond to 11 view images, and the 11 view images have parallax between each other. When the view region matched with the first view image is view region 46, 10 view images matched with view region 41, view region 42, view region 43, view region 44, view region 45, view region 47, view region 48, view region 49, view region 410, and view region 411 can be selected from the slice source library, and a part of the 10 view images can be selected as the second view image and the other part of the 10 view images can be selected as the third view image.

[0129] In some specific embodiments, the number of the second view images and the number of the third view images are both multiple, different second view images have different parallax with the first view image, and different third view images have different parallax with the first view image.

[0130] For example, the view region distribution map includes the above-mentioned 11 view regions and 11 view images matched with the 11 view regions, when the view region matched with the first view image is view region 46, 5 view images matched with view region 41, view region 42, view region 43, view region 44, and view region 45 can be selected from the slice source library, and a part or all of the 5 view images can be selected as the second view image; 5 view images matched with view region 47, view region 48, view region 49, view region 410, and view region 411 can be selected from the slice source library, and a part or all of the 5 view images can be selected as the third view image.

[0131] In some specific embodiments, the number of the second view images is the same as the number of the third view images.

[0132] For example, the view region distribution diagram includes the above-mentioned 11 view regions and 11 view point images. When the view region matched with the first view point image is view region 46, 5 view point images matched with view region 41, view region 42, view region 43, view region 44 and view region 45 can be selected from the film source library as the second view point images, and 5 view point images matched with view region 47, view region 48, view region 49, view region 410 and view region 411 can be selected from the film source library as the third view point images.

[0133] In some embodiments, step S240 includes steps S241-S244.

[0134] In step S241, the angle relationship of the viewing position relative to the pixel island 21 is determined according to the positional relationship between the viewing position and the pixel island 21.

[0135] For example, the angle relationship can refer to the included angle between the viewing position and the pixel island 21, Figure 6 A schematic diagram of the viewing position and the pixel island in the embodiments of the present disclosure is shown schematically as follows: Figure 6 As shown, the included angles between the viewing position (i.e., the midpoint M) and the plurality of pixel islands 21 are all different, wherein the included angle between the viewing position and the pixel island 21 can refer to the included angle between the line L1 connecting the viewing position and the center of the pixel island 21 and the normal line L2 of the pixel island 21 in the plane shown in FIG. 1. Figure 6

[0136] In step S242, the angle spectrum of at least one sub-pixel 211 in the pixel island 21 is obtained from the angle spectrum library.

[0137] In step S243, the sub-pixel 211 matched with the viewing position is determined from the plurality of sub-pixels 211 of the pixel island 21 according to the angle spectrum of the at least one sub-pixel 211 and the angle relationship.

[0138] In step S244, the determined sub-pixel 211 is taken as the center sub-pixel 211.

[0139] For example, the pixel island 21 includes 11 sub-pixels 211, wherein the angle spectrum range of the first sub-pixel 211 is 25.5°-26.5°, the angle spectrum range of the second sub-pixel 211 is 26.5°-27.5°, the angle spectrum range of the third sub-pixel 211 is 28.5°-29.5°, and so on. The angle spectrum range of each sub-pixel 211 is about 1°. When the included angle between the viewing position and the pixel island 21 is 27°, the second sub-pixel 211 can be determined as the center sub-pixel 211.

[0140] ​In some embodiments, step S250 comprises: performing step S251 and step S252 for at least one of the other sub-pixels 211 in the at least one pixel island 21.

[0141] In step S251, a view point image matching the sub-pixel 211 is determined from the parallax image set according to a preset mapping rule.

[0142] In the embodiments of the present disclosure, the view point image matching the sub-pixel 211 can be determined from the parallax image set according to the view point index number of the sub-pixel 211.

[0143] For example, in some embodiments, the display method further comprises step S261 and step S262.

[0144] In step S261, the view point index numbers of the plurality of sub-pixels 211 in the at least one pixel island 21 are obtained.

[0145] In step S262, the obtained view point index numbers are sorted to form a view point index number sequence, for example, the view point index numbers are sorted according to their sizes to form a view point index number sequence.

[0146] In the embodiments of the present disclosure, the position of the view point index number of each pixel in the view point index number sequence is not the same as the physical position of the sub-pixel 211 in the pixel island 21, so that the moire effect can be eliminated and the display effect can be improved. For example, the pixel island 21 includes 11 sub-pixels 211, Figure 7a and Figure 7b A schematic diagram of the index number sequence in the embodiments of the present disclosure is shown schematically as shown in FIG. 6. Figure 7a As shown, the view point index numbers of the 11 sub-pixels 211 are P1 to P11, and the view point index number sequence is formed in the order from small to large. Figure 8 A schematic diagram of the view point index number and the physical position of the sub-pixel in the embodiments of the present disclosure is shown schematically as shown in FIG. 7. Figure 8As shown, in the pixel island 21, the sub-pixels 211 are sorted in a manner different from the sequence of the viewpoint index numbers, for example, the sub-pixel 211 with the viewpoint index number P1 is located at position 1', the sub-pixel 211 with the viewpoint index number P2 is located at position 7', the sub-pixel 211 with the viewpoint index number P3 is located at position 2', the sub-pixel 211 with the viewpoint index number P4 is located at position 8', the sub-pixel 211 with the viewpoint index number P5 is located at position 3', the sub-pixel 211 with the viewpoint index number P6 is located at position 9', the sub-pixel 211 with the viewpoint index number P7 is located at position 4', the sub-pixel 211 with the viewpoint index number P8 is located at position 10', the sub-pixel 211 with the viewpoint index number P9 is located at position 5', the sub-pixel 211 with the viewpoint index number P10 is located at position 11', and the sub-pixel 211 with the viewpoint index number P11 is located at position 6'.

[0147] In some embodiments, the step S251 comprises a step S2511 and a step S2512.

[0148] In the step S2511, according to the positional relationship between the viewpoint index number of the other sub-pixel and the viewpoint index number of the center sub-pixel 211 in the sequence of the index numbers, the viewpoint image matching the viewpoint index number is determined from the parallax image set.

[0149] For the sake of clarity, hereinafter, the viewpoint index number of the center sub-pixel 211 in the pixel island 21 is referred to as the first index number, and the viewpoint index number of the other sub-pixel 211 is referred to as the second index number.

[0150] In some embodiments, the user comprises a first observation eye and a second observation eye, and the observation position is located between the first observation eye and the second observation eye.

[0151] The step S2511 comprises a step S25111 to a step S25112.

[0152] In the step S25111, according to the position of the viewpoint index number of the center sub-pixel 211 in the sequence of the index numbers, the remaining viewpoint index numbers are divided into a first viewpoint index number group corresponding to the first observation eye and a second viewpoint index number group corresponding to the second observation eye.

[0153] For example, in the embodiments of the present disclosure, the first viewpoint index number group can be composed of a plurality of second index numbers located before the first index number, and the second viewpoint index number group can be composed of a plurality of second index numbers located after the first index number, which will be described in detail hereinafter, and will not be described here in detail.

[0154] In step S25112, a viewpoint image matching the viewpoint index number in the first viewpoint index number group is determined from the plurality of second viewpoint images. A viewpoint image matching the viewpoint index number in the second viewpoint index number group is determined from the plurality of third viewpoint images.

[0155] In combination Figure 4a and Figure 7a As shown in FIG. 46, let the viewpoint index number P6 be the first index number, the viewpoint index numbers P1 to P5 be the first index number group, the viewpoint index numbers P7 to P11 be the second index number group, the view area matching the first viewpoint image be the view area 46, the view areas matching the viewpoint images in the plurality of second viewpoint images be the view areas 41 to 45 respectively, and the view areas matching the viewpoint images in the plurality of third viewpoint images be the view areas 47 to 411 respectively. At this time, the viewpoint image 46' matching the view area 46 can be matched as the first viewpoint image to the viewpoint index number P6, the viewpoint image 41' matching the view area 41 to the viewpoint index number P1, the viewpoint image 42' matching the view area 42 to the viewpoint index number P2, the viewpoint image 43' matching the view area 43 to the viewpoint index number P3, the viewpoint image 44' matching the view area 44 to the viewpoint index number P4, the viewpoint image 45' matching the view area 45 to the viewpoint index number P5, the viewpoint image 47' matching the view area 47 to the viewpoint index number P7, the viewpoint image 48' matching the view area 48 to the viewpoint index number P8, the viewpoint image 49' matching the view area 49 to the viewpoint index number P9, the viewpoint image 410' matching the view area 410 to the viewpoint index number P10, and the viewpoint image 411' matching the view area 411 to the viewpoint index number P11.

[0156] In some embodiments, for the first viewpoint index number group, when the viewpoint index numbers therein include the first n viewpoint index numbers and the last m viewpoint index numbers in the sequence of viewpoint index numbers, the viewpoint images matching the viewpoint index numbers in the first viewpoint index number group are determined from the plurality of second viewpoint images according to a preset first shift extension rule.

[0157] For the second viewpoint index number group, when the viewpoint index numbers therein include the first n viewpoint index numbers and the last m viewpoint index numbers in the sequence of viewpoint index numbers, the viewpoint images matching the viewpoint index numbers in the second viewpoint index number group are determined from the plurality of third viewpoint images according to a preset second shift extension rule.

[0158] The shift extension directions of the first shift extension rule and the second shift extension rule are opposite.

[0159] For example, in combination Figure 4a and Figure 7bAs shown, the view area matched by the first view point image is view area 46, the view areas matched by the view point images in the plurality of second view point images are view areas 41 to 45 respectively, and the view areas matched by the view point images in the plurality of third view point images are view areas 47 to 411 respectively. At this time, the view point image 46' matched with the view area 46 can be matched with the first view point image as the view point index number P3, the view point image 41' matched with the view area 41 can be matched with the view point index number P9, the view point image 42' matched with the view area 42 can be matched with the view point index number P10, the view point image 43' matched with the view area 43 can be matched with the view point index number P11, the view point image 44' matched with the view area 44 can be matched with the view point index number P1, the view point image 45' matched with the view area 45 can be matched with the view point index number P2, the view point image 47' matched with the view area 47 can be matched with the view point index number P4, the view point image 48' matched with the view area 48 can be matched with the view point index number P5, the view point image 49' matched with the view area 49 can be matched with the view point index number P6, the view point image 410' matched with the view area 410 can be matched with the view point index number P7, and the view point image 411' matched with the view area 411 can be matched with the view point index number P8.

[0160] In some specific embodiments, in other sub-pixels 211 of at least one pixel island 21, one sub-pixel 211 can match one view point image, at least two sub-pixels 211 match different view point images, for example, at least one sub-pixel 211 matches at least one view point image, and different sub-pixels 211 match different view point images.

[0161] In step S2512, according to the preset mapping rule, the sub-pixel 211 matched with at least one view point index number is determined, and the view point image matched with the view point index number is determined as the view point image matched with the sub-pixel 211.

[0162] In step S252, the sub-pixel 211 is driven to display according to the determined view point image, so as to form a target display picture.

[0163] In some specific embodiments, the display method further includes a clip source library establishing step, and the clip source library establishing step includes steps S210 and S220.

[0164] In S210, a virtual camera array is established. Figure 9a A schematic diagram of the virtual camera array in the embodiment of the present disclosure is schematically shown as Figure 9a As shown, the virtual camera array has a first collection step length of δθ and a second collection step length of Δθ, wherein δθ is the angle of projection of each sub-pixel 211, and Δθ is the preset angle positioning accuracy.

[0165] At S220, an image of the target object is captured by using the virtual camera array to form a film source library.

[0166] In the embodiments of the present disclosure, a three-dimensional scene model, i.e., an image B of the target object, is first established. Then, according to the parameters of the sub-pixels 211 and the cylindrical lens, the angle size δθ of each sub-pixel 211 in the projection is determined. Along two dimensions, e.g. Figure 9a a fourth direction and a fifth direction in the image B, a virtual camera array is established. The angle step of the virtual camera array in the fourth direction is a first capture step δθ, and the angle step of the virtual camera array in the fifth direction is a second capture step Δθ. Each grid in the virtual camera array can correspond to a view zone in the view zone distribution map, and a picture is taken at each grid position, so as to obtain a multi-view film source library.

[0167] In some specific embodiments, the display method further includes an angular spectrum library establishing step, which includes steps S410 to S430.

[0168] At step S410, the angular spectrum of the plurality of sub-pixels 211 in a pixel island 21 is obtained to obtain a plurality of initial angular spectra.

[0169] At step S420, each initial angular spectrum is processed according to the boundary of the plurality of initial angular spectra to obtain a plurality of target angular spectra. Optionally, the angle ranges of the plurality of target angular spectra do not overlap.

[0170] At step S430, an angular spectrum library is constructed according to the plurality of target angular spectra.

[0171] In the embodiments of the present disclosure, Figure 9b A schematic diagram of the initial angular spectrum of part of the sub-pixels in the pixel island in the embodiments of the present disclosure is shown schematically, wherein, in the Figure 9b the abscissa represents the angle, and the ordinate represents the brightness, as shown in Figure 9b The initial angular spectrum ranges of two adjacent sub-pixels overlap each other, and the boundary of the two, i.e., as shown by the dotted line in Figure 9b the initial angular spectrum, is the boundary of the initial angular spectrum. For the initial angular spectrum of each sub-pixel, the part within the boundary is extracted, i.e., the target angular spectrum of each sub-pixel is obtained.

[0172] In some specific embodiments, when the pitch between the cylindrical lenses is equal to or an integer multiple of the pitch between the pixel islands 21, the angular spectra of the sub-pixels 211 of different pixel islands 21 are the same.

[0173] In some embodiments, when the pitch between the cylindrical lenses and the pitch between the pixel islands 21 are not equal and are not integer multiples of each other, the angular spectrum of the sub-pixels 211 of the pixel islands 21 at multiple positions need to be tested, and the angular spectrum of the sub-pixels 211 of each pixel island 21 is obtained by interpolation.

[0174] Figure 10 Fig. 2 schematically shows a light path of a display device in an embodiment of the present disclosure, Figure 11 Fig. 2 schematically shows a light path of a display device in an embodiment of the present disclosure, Figure 10 Fig. 2 schematically shows a light path of a display device in an embodiment of the present disclosure, Figure 12 Fig. 2 schematically shows a light path of a display device in an embodiment of the present disclosure, Figures 10 to 12 As shown in Fig. 2, in an embodiment of the present disclosure, the maximum value of the point reporting error of the eye tracking is Δ, and the corresponding angle is α, and the corresponding relationship expression is as follows:

[0175] (1)

[0176] (2)

[0177] (3)

[0178] wherein X is the projection width of 11 view images, L is the viewing distance, D is the pitch of the cylindrical lenses, T is the placement height of the cylindrical lenses, n is the refractive index of the spacer dielectric layer 50, and P is the interpupillary distance of the human eye. After rearranging equations (1), (2), and (3), we obtain:

[0179] (4)

[0180] When L = 500 mm, D = 77.055 μm, T = 565 μm, n = 1.5, and P = 65 mm, we obtain α = 2.1° by substituting these values into equation (4). Therefore, in an embodiment of the present disclosure, to ensure that the human eye always sees the correct view of the current position, the point reporting error needs to be less than or equal to 2.1°.

[0181] Based on the display method described above, an embodiment of the present disclosure further provides a display device. In an embodiment of the present disclosure, the display device includes a tablet personal computer (PC), a smart phone, a personal digital assistant (PDA), a portable multimedia player, a game console, or a wristwatch electronic device, etc. However, embodiments of the present disclosure are not intended to limit the type of the display device. In some embodiments, the display device can be used not only in large electronic devices such as a television (TV) or an external billboard, but also in medium or small electronic devices such as a PC, a notebook computer, a car navigation device, or a camera. In combination with Figures 2a to 12As shown, the display device comprises a plurality of pixel islands 21, at least one pixel island 21 comprises a plurality of sub-pixels 211, and the display device further comprises a processing module configured to perform the following steps:

[0182] Obtaining a viewing position of a user.

[0183] Determining a viewpoint image matched with the viewing position from a film source library to obtain a first viewpoint image.

[0184] Determining a plurality of viewpoint images having parallax with the first viewpoint image from the film source library to obtain a parallax image set.

[0185] For at least one pixel island 21, determining a center sub-pixel 211 from a plurality of sub-pixels 211 in the pixel island 21 according to a positional relationship between the viewing position and the at least one sub-pixel 211 in the pixel island 21.

[0186] Driving the center sub-pixel 211 in the at least one pixel island 21 to display according to the first viewpoint image, and driving other sub-pixels 211 in the at least one pixel island 21 to display according to the parallax image set, to form a target display picture. The target display picture is configured to enable the user to see a three-dimensional image corresponding to the first viewpoint image when the user views the display device at the viewing position.

[0187] By using the display device of the embodiment of the present disclosure, since the first viewpoint image is matched with the viewing position of the user, when the user moves, the first viewpoint image changes accordingly, that is, the viewing angle of the target display picture also changes, thereby realizing stereoscopic vision. For example, taking a kettle as an example, when the user views the display device from the front, the front of the kettle can be seen, and when the user moves to the left or right side, the side of the kettle can be seen, thereby realizing continuous motion parallax. At the same time, the display method of the embodiment of the present disclosure displays the first viewpoint image in cooperation with the parallax image set, so that even if a point reporting error occurs when the eyeball is tracked, by displaying the viewpoint images in the parallax image set, the parallax of the image viewed by the user can be avoided from shaking, thereby improving the false visual manifestations caused thereby. Furthermore, by using the display method of the embodiment of the present disclosure, the center sub-pixel 211 in each pixel island 21 can be determined in real time according to the change of the viewing position, and then corresponding mapping is performed, to realize dynamic mapping, thereby replacing Figure 1a and Figure 1b the fixed mapping mode adopted, so that the precision requirement of the optical structure can be further reduced.

[0188] In some embodiments, the display device further comprises a light path adjusting structure 22, such as a lenticular lens. The light path adjusting structure is configured to make the light emitted by the at least one pixel island 21 form a plurality of continuous view zones on a preset projection surface after passing through the light path adjusting structure 22. Among them, at least one sub-pixel 211 in the at least one pixel island 21 is matched with at least one view zone.

[0189] In some embodiments, the plurality of sub-pixels 211 of the at least one pixel island 21 are arranged along a first direction, and the light path adjusting structure 22 comprises a plurality of lenticular lens units, each lenticular lens unit comprising a plurality of lenticular lenses arranged along the first direction, and one pixel island 21 is covered by the plurality of lenticular lenses. For example, each lenticular lens unit comprises two lenticular lenses, and one pixel island 21 is covered by the two lenticular lenses.

[0190] In some embodiments, the sub-pixels 211 in the same pixel island 21 are of the same color.

[0191] According to embodiments of the present disclosure, the processing modules can be combined in one module, or split into multiple modules. Alternatively, at least part of the functions of one or more of the modules can be combined with at least part of the functions of other modules, and implemented in one module. According to embodiments of the present disclosure, the processing modules can be at least partially implemented as hardware circuits, such as field programmable gate array (FPGA), programmable logic array (PLA), system on chip, system on board, system in package, application specific integrated circuit (ASIC), or any other reasonable way of integrating or packaging circuits, etc. hardware or firmware, or implemented in any one of software, hardware and firmware three implementation ways or in a proper combination of any of them. Alternatively, the processing modules can be at least partially implemented as computer program modules which can perform matching functions when running.

[0192] The flowcharts and block diagrams in the drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams can represent a module, a program segment, or a portion of code, which contains one or more executable instructions for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions noted in the blocks can occur in different orders than that shown in the drawings. For example, two blocks that are shown in succession can actually be executed substantially concurrently, or they can be executed in reverse order, depending on the functionality involved. It should also be noted that each block in the flowcharts or block diagrams, and combinations of blocks in the flowcharts or block diagrams, can be implemented by dedicated hardware-based systems that perform the specified functions or operations, or can be implemented by a combination of dedicated hardware and computer instructions.

[0193] Those skilled in the art can understand that the features described in various embodiments and / or claims of the present disclosure can be combined or / and integrated, even if such combinations or integrations are not explicitly described in the present disclosure. In particular, the features described in various embodiments and / or claims of the present disclosure can be combined and / or integrated in various combinations, without departing from the spirit and teachings of the present disclosure. All these combinations and / or integrations fall within the scope of the present disclosure.

[0194] The above describes embodiments of the present disclosure. However, these embodiments are merely for illustrative purposes, and are not intended to limit the scope of the present disclosure. Although each embodiment is described above separately, this does not mean that the measures in each embodiment cannot be used advantageously in combination. The scope of the present disclosure is defined by the appended claims and their equivalents. Without departing from the scope of the present disclosure, those skilled in the art can make various substitutions and modifications, which should all fall within the scope of the present disclosure.

Claims

1. A display method applied to a display device, the display device comprising a plurality of pixel islands, at least one of the pixel islands comprising a plurality of sub-pixels, the display method comprising: obtaining a viewing position of a user; determining a first view point image from a view source library matching the viewing position to obtain the first view point image; determining a plurality of view point images having parallax with the first view point image from the view source library to obtain a parallax image set; for at least one of the pixel islands, determining a center sub-pixel from the plurality of sub-pixels of the pixel island according to a positional relationship between the viewing position and at least one sub-pixel in the pixel island; driving the center sub-pixel in at least one of the pixel islands to display according to the first view point image, and driving other sub-pixels in at least one of the pixel islands to display according to the parallax image set, to form a target display picture; and the target display picture being configured to enable the user to see a three-dimensional image corresponding to the first view point image when the user watches the display device at the viewing position. The display area of the display device is configured with a reference point, and the step of determining a first view point image from a view source library matching the viewing position to obtain the first view point image comprises: determining a first view area from a preset view area distribution map according to a positional difference between the viewing position and the reference point to obtain the first view area; and extracting a view point image matching the first view area from the view source library to obtain the first view point image. The step of determining a first view area from a preset view area distribution map according to a positional difference between the viewing position and the reference point to obtain the first view area comprises: determining an angle coordinate of the viewing position relative to the reference point according to a preset angle coordinate system, the preset angle coordinate system being an angle coordinate system established according to the reference point and a plane in which the display area is located; and determining the first view area from the preset view area distribution map matching the angle coordinate. The reference point is located at the center of the display area. The step of determining a plurality of view point images having parallax with the first view point image from the view source library to obtain a parallax image set comprises: determining at least one second view point image having a first preset parallax relationship with the first view point image from the view source library; determining at least one third view point image having a second preset parallax relationship with the first view point image from the view source library; and the parallax image set being composed of at least one of the second view point image and the third view point image, wherein the parallax between at least one of the second view point image and the first view point image is opposite to the parallax between at least one of the third view point image and the first view point image. The number of the second view point image is the same as the number of the third view point image. ​ 2. The display method according to claim 1, wherein, ​ ​ ​ 3. The display method according to claim 2, wherein, ​ ​ ​ 4. The display method according to claim 3, wherein, ​ 5. The display method according to claim 2, wherein, ​ ​ ​ ​ 6. The display method according to claim 5, wherein ​ 7. The display method according to claim 5, wherein The number of the second view images and the number of the third view images are both plural, different second view images have different parallaxes with the first view image, and different third view images have different parallaxes with the first view image.

8. The display method according to claim 1, wherein The step of determining the center sub-pixel from the plurality of sub-pixels of the pixel island according to the positional relationship between the viewing position and at least one sub-pixel in the pixel island comprises: determining the angular relationship of the viewing position relative to the pixel island according to the positional relationship between the viewing position and the pixel island; obtaining the angular spectrum of at least one sub-pixel in the pixel island from an angular spectrum library; determining the sub-pixel matching the viewing position from the plurality of sub-pixels of the pixel island according to the angular spectrum of at least one sub-pixel and the angular relationship; determining the sub-pixel matching the viewing position from the plurality of sub-pixels of the pixel island according to the angular spectrum of at least one sub-pixel and the angular relationship; 9. The display method according to claim 5, wherein, The step of driving other sub-pixels in at least one pixel island to display according to the parallax image set to form a target display picture comprises: for at least one sub-pixel in other sub-pixels in at least one pixel island, determining the view image matching the sub-pixel from the parallax image set according to a preset mapping rule; and driving the sub-pixel to display according to the determined view image.

10. The display method according to claim 9, wherein In other sub-pixels of at least one pixel island, at least one sub-pixel matches at least one view image, and different sub-pixels match different view images.

11. The display method according to claim 9, wherein The display method further comprises: obtaining the view index number of the plurality of sub-pixels in at least one pixel island; sorting the obtained view index numbers to form a view index number sequence; The step of determining the view image matching the sub-pixel from the parallax image set according to a preset mapping rule for at least one sub-pixel in other sub-pixels in at least one pixel island comprises: determining the view image matching the view index number from the parallax image set according to the positional relationship of the view index number of the other sub-pixel and the view index number of the center sub-pixel in the index number sequence; and determining the sub-pixel matching the view index number according to a preset mapping rule, and taking the view image matching the view index number as the view image matching the sub-pixel.

12. The display method according to claim 11, wherein, The user includes a first observation eye and a second observation eye, and the viewing position is located between the first observation eye and the second observation eye; The step of determining the view image matching the sub-pixel from the parallax image set according to a preset mapping rule for at least one sub-pixel in other sub-pixels in at least one pixel island further comprises: dividing the remaining view index numbers into a first view index number group corresponding to the first observation eye and a second view index number group corresponding to the second observation eye according to the position of the view index number of the center sub-pixel in the index number sequence; and From the plurality of second viewpoint images, a viewpoint image matching a viewpoint index number in the first viewpoint index number group is determined; and from the plurality of third viewpoint images, a viewpoint image matching a viewpoint index number in the second viewpoint index number group is determined.

13. The display method according to claim 12, wherein, For the first viewpoint index number group, when the viewpoint index numbers therein include the first n viewpoint index numbers and the last m viewpoint index numbers in the sequence of viewpoint index numbers, a viewpoint image matching a viewpoint index number in the first viewpoint index number group is determined from the plurality of second viewpoint images according to a preset first shift extension rule; For the second viewpoint index number group, when the viewpoint index numbers therein include the first n viewpoint index numbers and the last m viewpoint index numbers in the sequence of viewpoint index numbers, a viewpoint image matching a viewpoint index number in the second viewpoint index number group is determined from the plurality of third viewpoint images according to a preset second shift extension rule; The shift extension directions of the first shift extension rule and the second shift extension rule are opposite.

14. The display method according to claim 1, wherein, The display method further comprises a slice source library establishing step, which comprises: establishing a virtual camera array, the virtual camera array having a first collection step length of δθ and a second collection step length of Δθ; The δθ is an angle of each sub-pixel projection, and the Δθ is a preset angle positioning accuracy. The image of the target object is collected by using the virtual camera array to constitute the slice source library.

15. The display method according to claim 8, wherein, The display method further comprises an angle spectrum library establishing step, which comprises: For at least one of the pixel islands, obtaining the angle spectrum of the plurality of sub-pixels in the pixel island to obtain a plurality of initial angle spectrums; processing each of the initial angle spectrums according to the boundaries of the initial angle spectrums to obtain a plurality of target angle spectrums; and constructing the angle spectrum library according to the plurality of target angle spectrums.

16. A display device, wherein, The display device comprises a plurality of pixel islands, at least one of the pixel islands comprises a plurality of sub-pixels, and the display device further comprises a processing module configured to perform the following steps: obtaining the viewing position of the user; determining a viewpoint image matching the viewing position from a slice source library to obtain a first viewpoint image; determining a plurality of viewpoint images having parallax with the first viewpoint image from the slice source library to obtain a parallax image set; For at least one of the pixel islands, a center sub-pixel is determined from the plurality of sub-pixels in the pixel island according to the positional relationship between the viewing position and at least one sub-pixel in the pixel island. According to the first viewpoint image, the center sub-pixel in at least one of the pixel islands is driven to display, and according to the parallax image set, other sub-pixels in at least one of the pixel islands are driven to display, so as to form a target display picture. The target display picture is configured to enable the user to see a three-dimensional image corresponding to the first viewpoint image when the user watches the display device at the viewing position.

17. The display device of claim 16, wherein, The display device further comprises a light path adjusting structure configured to make the light emitted by at least one of the pixel islands form a plurality of continuous views on a preset projection surface after passing through the light path adjusting structure.

18. The display device of claim 17, wherein, The plurality of sub-pixels of at least one of the pixel islands are arranged along a first direction, and the light path adjusting structure comprises a plurality of cylindrical lens units, each of which comprises a plurality of cylindrical lenses arranged along the first direction, and each pixel island is covered by one cylindrical lens unit.

19. The display device of claim 16, wherein, The sub-pixels in the same pixel island are of the same color.

Citation Information

Patent Citations

  • Three-dimensional image display device and driving method thereof

    CN102957926A

  • Image processing apparatus, processing method therefor, and non-transitory computer-readable storage medium

    US20110150279A1