Method for implementing 3D image display, 3D display device
By detecting the posture changes of the 3D display device and adjusting the display orientation, using a multi-viewpoint naked-eye 3D display screen and cylindrical grating, the problem of discomfort in the 3D display device after the posture changes is solved, and high-quality 3D display in different postures is achieved.
Patent Information
- Application Number
- CN201911231390.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-12-05
- Publication Date
- 2025-07-25
- Estimated Expiration
- 2039-12-05
AI Technical Summary
Existing 3D display devices cannot maintain the 3D effect after the posture changes, resulting in the unsuitable display.
By detecting the posture changes of the 3D display device, using the multi-viewpoint naked-eye 3D display screen and cylindrical grating design, the display orientation of the 3D image is adjusted to maintain the initial display orientation, ensuring that the appropriate 3D effect can still be displayed under different postures.
It realizes that 3D display devices can maintain good 3D effects before and after posture changes, and improve display resolution through composite pixels, reduce calculation amount, and ensure high-definition naked-eye 3D display.
Smart Images

Figure CN112929646B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of 3D display technology, for example, methods for implementing 3D image display and 3D display devices. Background Art
[0002] Currently, a naked-eye 3D display device achieves a 3D display effect through grating refraction of pixels.
[0003] In the process of implementing the embodiments of the present disclosure, it is found that at least the following problems exist in the related art: The display device is configured to display a suitable 3D effect in one posture and does not have the function of displaying a 3D effect in another posture. Summary of the Invention
[0004] To provide a basic understanding of some aspects of the disclosed embodiments, a simple summary is given below. This summary is not a general review, nor is it intended to identify key / important elements or delineate the scope of protection of these embodiments, but rather serves as a preamble to the following detailed description.
[0005] Embodiments of the present disclosure provide a method for implementing 3D image display and a 3D display device to solve the technical problem that a 3D display device cannot display a 3D image after the orientation is adjusted.
[0006] In some embodiments, a method for implementing 3D image display is provided, including: detecting a posture change of a 3D display device, where the 3D display device includes a multi-viewpoint naked-eye 3D display screen, the multi-viewpoint naked-eye 3D display screen includes a plurality of composite pixels and a lenticular grating covering the plurality of composite pixels, each of the plurality of composite pixels includes a plurality of composite sub-pixels, each of the plurality of composite sub-pixels includes a plurality of sub-pixels, and the lenticular grating is inclined to cover the plurality of sub-pixels along a first direction of the 3D display device to define a plurality of first-posture viewpoints and cover at least two composite pixels along a second direction of the 3D display device to define at least two second-posture viewpoints; and when a posture change of the 3D display device is detected, adjusting the display orientation of the displayed 3D image so that the 3D image maintains the initial display orientation before the posture change of the 3D display device.
[0007] In some embodiments, detecting a posture change of the 3D display device includes: detecting the rotational angular velocity of the 3D display device and determining the posture change of the 3D display device according to the rotational angular velocity; adjusting the display orientation of the 3D image includes: rotating the display orientation of the 3D image in the plane where the 3D image is located so that the 3D image maintains the initial display orientation before the posture change of the 3D display device.
[0008] In some embodiments, the posture of the 3D display device includes at least one of the following: landscape display posture, portrait display posture, and oblique screen display posture.
[0009] In some embodiments, the first posture of the 3D display device before the posture change includes any one of a landscape display posture, a portrait display posture, and an inclined screen display posture; the second posture of the 3D display device after the posture change includes any one of a landscape display posture, a portrait display posture, and an inclined screen display posture that is different from the first posture; adjusting the display orientation of the 3D image includes rotating the 3D image so that the 3D image remains in the initial display orientation corresponding to the first posture.
[0010] In some embodiments, when any one of the first posture and the second posture is an inclined screen display posture, adjusting the display orientation of the 3D image further includes displaying the 3D image in a full-screen display mode.
[0011] In some embodiments, adjusting the display orientation of the 3D image includes rotating the display orientation of the 3D image in the plane where the 3D image is located so that the 3D image remains within the initial display orientation range; wherein, the initial display orientation range includes the initial display orientation.
[0012] In some embodiments, the method further includes adjusting the display orientation of the 3D image according to the user's viewing orientation so that the display orientation of the 3D image is consistent with the user's viewing orientation.
[0013] In some embodiments, the user's viewing orientation includes any one of a horizontal viewing orientation, a vertical viewing orientation, and an oblique viewing orientation; the method further includes performing eye tracking on the user and determining the user's viewing orientation according to the obtained eye tracking data.
[0014] In some embodiments, adjusting the display orientation of the 3D image includes rendering sub-pixels in the multi-view autostereoscopic display screen of the 3D display device based on the adjusted display orientation of the 3D image.
[0015] In some embodiments, a plurality of sub-pixels of each composite sub-pixel are arranged in rows in a first direction of the 3D display device.
[0016] In some embodiments, a plurality of composite sub-pixels of each composite pixel are arranged side by side in a second direction of the 3D display device.
[0017] In some embodiments, the inclination angle θ of the lenticular grating with respect to the second direction of the 3D display device is arranged in such a way that it satisfies the following condition: ±1 / i ≤ tanθ ≤ ±1 / 2.
[0018] In some embodiments, the inclination angle θ of the lenticular grating with respect to the second direction of the 3D display device is arranged in such a way that it satisfies the following condition: tanθ = 1 / j, where 2 ≤ j ≤ i and j is an integer.
[0019] In some embodiments, a 3D display device is provided, including: a processor; and a memory storing program instructions; wherein the processor is configured to execute the method as described above when executing the program instructions.
[0020] In some embodiments, a 3D display device is provided, including: a multi-viewpoint autostereoscopic 3D display screen including a plurality of composite pixels and a lenticular grating covering the plurality of composite pixels, each of the plurality of composite pixels including a plurality of composite sub-pixels, each of the plurality of composite sub-pixels including a plurality of sub-pixels, the lenticular grating being inclined so as to cover the plurality of sub-pixels along a first direction of the 3D display device to define a plurality of first attitude viewpoints and cover at least two composite pixels along a second direction of the 3D display device to define at least two second attitude viewpoints; an attitude detection device configured to detect an attitude change of the 3D display device; and a 3D processing device configured to adjust a display orientation of the displayed 3D image based on the detected attitude change of the 3D display device so that the 3D image maintains an initial display orientation before the attitude change of the 3D display device.
[0021] In some embodiments, the attitude detection device is configured to detect a rotational angular velocity of the 3D display device and determine the attitude change of the 3D display device according to the rotational angular velocity; the 3D processing device is configured to rotate the display orientation of the 3D image in a plane where the 3D image is located so that the 3D image maintains an initial display orientation before the attitude change of the 3D display device.
[0022] In some embodiments, the attitude of the 3D display device includes at least one of the following: a landscape display attitude, a portrait display attitude, and a tilted screen display attitude.
[0023] In some embodiments, a first attitude of the 3D display device before the attitude change includes any one of a landscape display attitude, a portrait display attitude, and a tilted screen display attitude; a second attitude of the 3D display device after the attitude change includes any one different from the first attitude among a landscape display attitude, a portrait display attitude, and a tilted screen display attitude; the 3D processing device is configured to rotate the 3D image so that the 3D image maintains an initial display orientation corresponding to the first attitude.
[0024] In some embodiments, the 3D processing device is configured to display the 3D image in a full-screen display mode when any one of the first attitude and the second attitude is a tilted screen display attitude.
[0025] In some embodiments, the 3D processing device is configured to rotate the display orientation of the 3D image in a plane where the 3D image is located so that the 3D image maintains within an initial display orientation range; wherein the initial display orientation range includes the initial display orientation.
[0026] In some embodiments, the 3D processing device is configured to adjust the display orientation of the 3D image according to the user's viewing orientation, so that the display orientation of the 3D image is consistent with the user's viewing orientation.
[0027] In some embodiments, the user's viewing orientation includes any one of a horizontal viewing orientation, a vertical viewing orientation, and an oblique viewing orientation; the 3D display device further includes an eye tracking data acquisition device configured to acquire eye tracking data; the 3D processing device is configured to determine the user's viewing orientation according to the obtained eye tracking data.
[0028] In some embodiments, the 3D processing device is configured to render the composite pixels in the multi-view autostereoscopic display screen of the 3D display device based on the adjusted display orientation of the 3D image.
[0029] In some embodiments, the multiple sub-pixels of each composite sub-pixel are arranged in rows in the first direction of the 3D display device.
[0030] In some embodiments, the multiple composite sub-pixels of each composite pixel are arranged side by side in the second direction of the 3D display device.
[0031] In some embodiments, the tilt angle θ of the lenticular grating with respect to the second direction of the 3D display device satisfies the following condition: ±1 / i ≤ tanθ ≤ ±1 / 2.
[0032] In some embodiments, the tilt angle θ of the lenticular grating with respect to the second direction of the 3D display device satisfies the following condition: tanθ = 1 / j, where 2 ≤ j ≤ i and j is an integer.
[0033] The method for realizing 3D image display and the 3D display device provided by the embodiments of the present disclosure can achieve the following technical effects:
[0034] The 3D display device can display appropriate 3D effects in both postures and will not be affected by the posture adjustment of the 3D display device. In addition, the 3D display device can adopt a multi-view autostereoscopic display screen. The present disclosure defines the display resolution of the multi-view autostereoscopic display screen in the form of composite pixels, and both the transmission and display take the display resolution defined by the composite pixels as a consideration factor, reducing the calculation amount of transmission and rendering while ensuring high-definition display effects, and realizing high-quality autostereoscopic 3D display.
[0035] The above general description and the following description are only exemplary and explanatory, and are not used to limit this application. Description of the Drawings
[0036] One or more embodiments are illustrated by way of example with reference to the corresponding drawings, which do not constitute a limitation on the embodiments. Elements with the same reference numerals in the drawings are shown as similar elements. The drawings do not constitute a scale limitation, and wherein:
[0037] Figures 1A to 1C is a schematic structural diagram of a 3D display device according to an embodiment of the present disclosure;
[0038] Figure 2A and Figure 2B are two postures of a 3D display device according to an embodiment of the present disclosure and corresponding playback areas;
[0039] Figure 3A and Figure 3B are dynamic renderings of a 3D display device according to an embodiment of the present disclosure in two postures;
[0040] Figure 4 is a schematic hardware structure diagram of a 3D display device according to an embodiment of the present disclosure;
[0041] Figure 5 is a schematic software structure diagram of a 3D display device according to an embodiment of the present disclosure;
[0042] Figure 6 is a schematic diagram of the format and content of an image included in a video frame of a 3D video signal according to an embodiment of the present disclosure;
[0043] Figure 7 is a flowchart for switching to display a 3D image in a 3D display device according to an embodiment of the present disclosure; and
[0044] Figure 8 is a schematic structural diagram of a 3D display device according to an embodiment of the present disclosure.
[0045] Reference numerals:
[0046] 100: 3D display device; 110: multi-view autostereoscopic 3D display screen; 120: processor; 121: register; 130: 3D processing device; 131: buffer; 140: video signal interface; 150: eye tracking device; 160: eye tracking data interface; 171: first pose playback area; 172: second pose playback area; 180: pose detection device; 190: lenticular grating; 200: 3D display device; 201: processor; 202: multi-view autostereoscopic 3D display screen; 203: 3D processing device; 204: video signal interface; 205: eye tracking device; 206: imaging device; 207: indicator; 208: motor; 209: button; 210: memory; 211: subscriber identity module (SIM) card interface; 212: external memory interface; 213: universal serial bus interface; 214: charging management module; 215: power management module; 216: battery; 217: register; 218: GPU; 219: codec; 220: sensor module; 221: proximity light sensor; 222: ambient light sensor; 223: pressure sensor; 224: barometric pressure sensor; 225: magnetic sensor; 226: gravity sensor; 227: gyroscope sensor; 228: acceleration sensor; 229: distance sensor; 230: temperature sensor; 231: fingerprint sensor; 232: touch sensor; 233: bone conduction sensor; 234: audio module; 235: speaker; 236: receiver; 237: microphone; 238: headphone interface; 239: antenna; 240: mobile communication module; 241: antenna; 242: wireless communication module; 300: 3D display device; 310: memory; 320: processor; 330: bus; 340: communication interface; 400: composite pixel; 410: red composite sub-pixel; 420: green composite sub-pixel; 430: blue composite sub-pixel; 510: application layer; 520: framework layer; 530: core class library and runtime; 540: kernel layer; 601: one of the two images included in the video frame of the 3D video signal; 602: one of the two images included in the video frame of the 3D video signal. Detailed implementation manners
[0047] In order to be able to understand the features and technical content of the embodiments of the present disclosure in more detail, the implementation of the embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. The attached drawings are for reference and illustration purposes only and are not used to limit the embodiments of the present disclosure.
[0048] In this document, "autostereoscopic three-dimensional (3D) display" relates to a technology in which a user can observe 3D display images on a flat display without wearing glasses for 3D display.
[0049] As used herein, "multi-viewpoint" has its conventional meaning in the art, referring to different images displayed by different pixels or sub-pixels of a display screen that can be viewed at different positions (viewpoints) in space. In this document, multi-viewpoint will mean at least 3 viewpoints.
[0050] As used herein, a conventional "pixel" means the smallest display unit in terms of its resolution when a 2D display or when displayed as a 2D display.
[0051] However, in some embodiments of this document, the "composite pixel" referred to when applied to multi-viewpoint technology in the field of autostereoscopic 3D display refers to the smallest display unit when the autostereoscopic 3D display provides multi-viewpoint display, but it does not exclude that a single composite pixel used for multi-viewpoint technology may include or be presented as multiple pixels of a 2D display. In this document, unless specifically stated as a composite pixel or 3D pixel for "3D display" or "multi-viewpoint" applications, a pixel will refer to the smallest display unit in 2D display. Similarly, when describing the "composite sub-pixel" of an autostereoscopic 3D display as multi-viewpoint, it will refer to the composite sub-pixel of a single color presented in the composite pixel when the autostereoscopic 3D display provides multi-viewpoint display. In this document, the sub-pixel in "composite sub-pixel" will refer to the smallest display unit of a single color, which often corresponds to a viewpoint.
[0052] According to an embodiment of the present disclosure, a 3D display device is provided, including a multi-viewpoint autostereoscopic 3D display screen, an attitude detection device, a 3D signal interface, and a 3D processing device. The multi-viewpoint autostereoscopic 3D display screen includes a plurality of composite pixels and a lenticular grating covering these composite pixels. Each composite pixel includes a plurality of composite sub-pixels, and each composite sub-pixel includes i sub-pixels. In some embodiments, the multi-viewpoint autostereoscopic 3D display screen has a display panel, and a plurality of composite sub-pixels are formed in the display panel, and the lenticular grating covers the display panel. In some embodiments, i≥3.
[0053] In some embodiments, the 3D processing device is communicatively connected to the multi-viewpoint autostereoscopic 3D display screen. In some embodiments, the 3D processing device is communicatively connected to the driving device of the multi-viewpoint autostereoscopic 3D display screen.
[0054] In some embodiments, each composite sub-pixel includes i same-color sub-pixels arranged in rows in the first direction (e.g., the length direction or the lateral direction) of the 3D display device. In some embodiments, the i same-color sub-pixels arranged in rows can be arranged in a single row, two rows, or more than two rows.
[0055] The cylindrical lens grating is disposed obliquely on the panel, so that the cylindrical lens grating covers i sub-pixels along the first direction (such as the length direction or the transverse direction) of the 3D display device to define i first attitude viewpoints, and covers at least two composite pixels along the second direction (such as the width direction or the vertical direction) of the 3D display device to define at least two second attitude viewpoints. In some embodiments, the i sub-pixels covered by the cylindrical lens grating along the first direction of the 3D display device are the i sub-pixels belonging to the same composite sub-pixel. In some embodiments, the i sub-pixels covered by the cylindrical lens grating along the first direction of the 3D display device belong to different composite sub-pixels. For example, when i = 6, the cylindrical lens grating covers two adjacent composite sub-pixels along the first direction of the 3D display device, where 4 sub-pixels of one composite sub-pixel are covered, and 2 sub-pixels of another composite sub-pixel are covered. In some embodiments, the i sub-pixels covered by the cylindrical lens grating along the first direction of the 3D display device may not belong to the same composite pixel.
[0056] In some embodiments, the multi-viewpoint autostereoscopic 3D display screen may define a first attitude playing area of the 3D display device in the first attitude and a second attitude playing area of the 3D display device in the second attitude. The attitude detection device is configured to detect the attitude of the 3D display device. The 3D signal interface is configured to receive a 3D signal. The 3D processing device is configured to process the 3D signal to play a 3D image from the 3D signal in the first attitude playing area and play a 3D image from the 3D signal in the second attitude playing area. In some embodiments, the attitude of the 3D display device includes at least one of the following: landscape display attitude, portrait display attitude, and oblique screen display attitude. In some embodiments, the first attitude of the 3D display device before the attitude change includes any one of the landscape display attitude, the portrait display attitude, and the oblique screen display attitude, and the second attitude of the 3D display device after the attitude change includes any one different from the first attitude among the landscape display attitude, the portrait display attitude, and the oblique screen display attitude.
[0057] Figure 1A Fig. shows a 3D display device 100 according to an embodiment of the present disclosure. As Figure 1A shown, the 3D display device 100 includes a multi-viewpoint autostereoscopic 3D display screen 110, a 3D processing device 130, a 3D signal interface (such as a video signal interface 140) for receiving video frames of a 3D signal such as a 3D video signal, a processor 120, and an attitude detection device 180. In some embodiments, the 3D signal may be a static image. The 3D display device 100 may define a first direction, such as along the length direction or the transverse direction, and a second direction, such as along the width direction or the vertical direction.
[0058] The multi-view autostereoscopic 3D display screen 110 may include a display panel 111 and a lenticular grating (not shown) covering the display panel 111. The display panel 111 may be provided with m columns and n rows (m×n) of composite pixels 400 and thus define an m×n display resolution.
[0059] Figure 1A Schematically shown is one composite pixel 400 out of the m×n composite pixels 400, including a red composite sub-pixel 410 composed of i = 6 red sub-pixels R, a green composite sub-pixel 420 composed of i = 6 green sub-pixels G, and a blue composite sub-pixel 430 composed of i = 6 blue sub-pixels B. In other embodiments, other values of i greater than or less than 6 can be contemplated.
[0060] In some embodiments, each composite pixel is square. All the composite sub-pixels in each composite pixel are arranged parallel to each other.
[0061] In the embodiments of the present disclosure, each composite sub-pixel has corresponding sub-pixels corresponding to viewpoints. The multiple sub-pixels of each composite sub-pixel are arranged in rows in the lateral direction of the multi-view autostereoscopic 3D display screen, and the multiple sub-pixels in the rows have the same color. Since the multiple viewpoints of the 3D display device are arranged substantially along the lateral direction of the multi-view autostereoscopic 3D display screen, in this way, when the user moves and the human eye is at different viewpoints, it is necessary to dynamically render the different sub-pixels corresponding to the corresponding viewpoints in each composite sub-pixel accordingly. Since the same-color sub-pixels in each composite sub-pixel are arranged in rows, the problem of color bleeding caused by persistence of vision can be avoided. In addition, due to the refraction of the grating, it is possible to see a part of the currently displayed sub-pixel at adjacent viewpoint positions. However, through the same-color and same-row arrangement, even if a part of the currently displayed sub-pixel is seen, there will be no problem of color mixing.
[0062] As described above, the 3D display device may have multiple different postures. Refer to Figure 2A , the 3D display device 100 has a first posture, for example, a landscape display posture, and the multi-view autostereoscopic 3D display screen 110 may define a first posture playback area 171 adapted to the first posture. Refer to Figure 2B , the 3D display device 100 may also have a second posture, for example, a portrait display posture, and the multi-view autostereoscopic 3D display screen 110 may define a second posture playback area 172 adapted to the second posture.
[0063] In some embodiments, the first posture display area 171 and the second posture display area 172 may have different sizes. For example, the area of the first posture display area 171 may account for 80% to 100% of the area of the multi-view autostereoscopic 3D display screen 110. For example, the area of the second posture display area 172 may account for 30% to 60% of the area of the multi-view autostereoscopic 3D display screen 110. When the 3D display device 100 is in the second posture, the second posture display area 172 may be located, for example, in the middle of the multi-view autostereoscopic 3D display screen 110. In some embodiments, the first posture display area 171 and the second posture display area 172 may have different display resolutions.
[0064] In some embodiments, the lenticular gratings are disposed obliquely on the display panel and cooperate with sub-pixels in the composite pixels or the composite sub-pixels of the composite pixels to form 3D effects respectively in different postures of the 3D display device. A plurality of lenticular gratings may be arranged side by side parallel to each other on the surface of the display panel.
[0065] In some embodiments, the tilt angle θ of the lenticular grating with respect to the second direction of the 3D display device satisfies the following condition: ±1 / i ≤ tanθ ≤ ±1 / 2.
[0066] In some embodiments, tanθ = 1 / j, where 2 ≤ j ≤ i and j is an integer.
[0067] See Figure 3A and Figure 3B , which shows an exemplary setting manner of the lenticular grating. In the illustrated embodiment, each composite pixel is square and includes three composite sub-pixels arranged side by side along the second direction of the 3D display device, namely a red composite sub-pixel, a green composite sub-pixel, and a blue composite sub-pixel. Each composite sub-pixel includes i = 6 sub-pixels of the same color, and the i = 6 sub-pixels of the same color in each composite sub-pixel are arranged side by side in the first direction of the 3D display device. The lenticular grating 190 is disposed on the display panel 111 at a tilt angle θ with respect to the second direction of the 3D display device, and tanθ = 1 / 3. As shown in the figure, the lenticular grating 190 covers i = 6 sub-pixels along the first direction of the 3D display device and defines i = 6 first posture viewpoints Vi1-Vi6 in the first posture of the 3D display device (as Figure 3A shown), and the lenticular grating 190 covers three composite pixels along the second direction of the 3D display device and defines 3 second posture viewpoints Vj1-Vj3 in the second posture of the 3D display device (as Figure 3B shown).
[0068] It can be conceived that in other embodiments, the lenticular grating covers i sub-pixels along the first direction of the 3D display device and covers other numbers of composite pixels along the second direction of the 3D display device. In some embodiments, i ≥ 3.
[0069] In some embodiments, the tilt angle θ of the lenticular grating relative to the second direction of the 3D display device satisfies tanθ = 1 / 2. The lenticular grating covers i sub-pixels along the first direction of the 3D display device, where i = 6, thereby defining 6 first-pose viewpoints of the 3D display device in the first pose, and covers 2 composite pixels along the second direction of the 3D display device, thereby defining 2 second-pose viewpoints of the 3D display device in the second pose.
[0070] In some embodiments, the tilt angle θ of the lenticular grating relative to the second direction of the 3D display device satisfies tanθ = 1 / 4. The lenticular grating covers i sub-pixels along the first direction of the 3D display device, where i = 6, thereby defining 6 first-pose viewpoints of the 3D display device in the first pose, and covers 4 composite pixels along the second direction of the 3D display device, thereby defining 4 second-pose viewpoints of the 3D display device in the second pose.
[0071] In some embodiments, the tilt angle θ of the lenticular grating relative to the second direction of the 3D display device satisfies tanθ = 1 / 5. The lenticular grating covers i sub-pixels along the first direction of the 3D display device, where i = 6, thereby defining 6 first-pose viewpoints of the 3D display device in the first pose, and covers 5 composite pixels along the second direction of the 3D display device, thereby defining 5 second-pose viewpoints of the 3D display device in the second pose.
[0072] In some embodiments, the tilt angle θ of the lenticular grating relative to the second direction of the 3D display device satisfies tanθ = 1 / 6. The lenticular grating covers i sub-pixels along the first direction of the 3D display device, where i = 6, thereby defining 6 first-pose viewpoints of the 3D display device in the first pose, and covers 6 composite pixels along the second direction of the 3D display device, thereby defining 6 second-pose viewpoints of the 3D display device in the second pose.
[0073] As Figure 1A shown in the embodiment, the 3D processing device 130 may also selectively include a buffer 131 for buffering the received video frames.
[0074] The 3D display device 100 may further include a processor 120 communicatively connected to the 3D processing device 130 through a video signal interface 140. In some embodiments, the processor 120 is included in a computer or a smart terminal, such as a mobile terminal, or as a processor device.
[0075] In some embodiments, the video signal interface 140 is an internal interface connecting the processor 120 and the 3D processing device 130. Such a 3D display device 100 may be a mobile terminal, for example, and the video signal interface 140 may be a MIPI, mini-MIPI interface, LVDS interface, min-LVDS interface, or Display Port interface.
[0076] In some embodiments, as Figure 1A shown, the processor 120 of the 3D display device 100 may further include a register 121. The register 121 may be configured to temporarily store instructions, data, and addresses.
[0077] The attitude detection device 180 may be communicatively connected to the processor 120. The attitude detection device 180 may be a gravity sensor or a gyroscope sensor.
[0078] In some embodiments, the 3D display device further includes an eye tracking data acquisition device configured to acquire eye tracking data, such as an eye tracking device or an eye tracking data interface. For example Figure 1B in the embodiment shown, the 3D display device 100 includes an eye tracking device 150 communicatively connected to the 3D processing device 130, whereby the 3D processing device 130 may directly receive eye tracking data. In Figure 1C the embodiment shown, the eye tracking device (not shown) may be directly connected to the processor 120, for example, and the 3D processing device 130 obtains eye tracking data from the processor 120 via the eye tracking data interface 160. In other embodiments, the eye tracking device may be connected to both the processor and the 3D processing device simultaneously, such that on the one hand, the 3D processing device 130 may directly obtain eye tracking data from the eye tracking device, and on the other hand, other information obtained by the eye tracking device may be processed by the processor.
[0079] Exemplarily, Figure 4The figure shows a schematic diagram of the hardware structure of a 3D display device 200, such as a mobile terminal, e.g., a smart cellular phone or a tablet computer. In the illustrated embodiment, the 3D display device 200 may include a processor 201, an external memory interface 212, a (built-in) memory 210, a Universal Serial Bus (USB) interface 213, a charging management module 214, a power management module 215, a battery 216, a mobile communication module 240, a wireless communication module 242, antennas 239 and 241, an audio module 234, a speaker 235, a receiver 236, a microphone 237, a headphone interface 238, keys 209, a motor 208, an indicator 207, a Subscriber Identity Module (SIM) card interface 211, a multi-view autostereoscopic 3D display screen 202, a 3D processing device 203, a 3D signal interface (such as a video signal interface 204), a camera device 206, an eye tracking device 205, and a sensor module 220, etc.
[0080] In some embodiments, the sensor module 220 may include a proximity light sensor 221, an ambient light sensor 222, a pressure sensor 223, a barometric pressure sensor 224, a magnetic sensor 225, a gravity sensor 226, a gyro sensor 227, an acceleration sensor 228, a distance sensor 229, a temperature sensor 230, a fingerprint sensor 231, a touch sensor 232, and a bone conduction sensor 233, etc.
[0081] In some embodiments, the processor 201 may include one or more processing units. In some embodiments, the processor 201 may include one of the following or a combination of at least two of the following: an Application Processor (AP), a modem processor, a baseband processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, a Neural Network Processor (NPU), etc. Different processing units may be independent devices or may be integrated in one or more processors.
[0082] In some embodiments, the processor 201 may include one or more interfaces. The interfaces may include an Inter-Integrated Circuit (I2C) interface, an Integrated Circuit Built-in Audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a Universal Asynchronous Receiver / Transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a General-Purpose Input / Output (GPIO) interface, a Subscriber Identity Module (SIM) interface, a Universal Serial Bus (USB) interface, etc.
[0083] The USB interface 213 is an interface that complies with the USB standard specifications and can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 213 can be used to connect a charger to charge the 3D display device 200, and can also be used to transfer data between the 3D display device 200 and peripheral devices. It can also be used to connect headphones and play audio through the headphones.
[0084] The wireless communication function of the 3D display device 200 can be implemented by the antennas 241 and 239, the mobile communication module 240, the wireless communication module 242, the modulation and demodulation processor or the baseband processor, etc.
[0085] In some embodiments, the antenna 239 of the 3D display device 200 is coupled to the mobile communication module 240, and the antenna 241 is coupled to the wireless communication module 242, so that the 3D display device 200 can communicate with the network and other devices through wireless communication technologies.
[0086] In some embodiments, the external interface for receiving 3D video signals may include the USB interface 213, the mobile communication module 240, the wireless communication module 242, or any combination thereof.
[0087] The memory 210 can be used to store computer-executable program code, and the executable program code includes instructions. The processor 201 executes various functional applications and data processing of the 3D display device 200 by running the instructions stored in the memory 210.
[0088] The external memory interface 212 can be used to connect an external memory card, such as a Micro SD card, to implement the storage capacity expansion of the 3D display device 200. The external memory card communicates with the processor 201 through the external memory interface 212 to implement the data storage function.
[0089] In some embodiments, the memory of the 3D display device may include the (internal) memory 210, an external memory card connected to the external memory interface 212, or a combination thereof.
[0090] In the embodiments of the present disclosure, the imaging device 206 can capture images or videos.
[0091] In some embodiments, the 3D display device 200 implements the display function through the video signal interface 204, the 3D processing device 203, the multi-view autostereoscopic 3D display screen 202, and the application processor, etc.
[0092] In some embodiments, the 3D display device 200 may include a GPU 218, for example, inside the processor 201, which is used to process 3D video images and can also process 2D video images.
[0093] In some embodiments, the 3D display device 200 further includes a video codec 219 configured to compress or decompress digital video.
[0094] In some embodiments, the video signal interface 204 is configured to output video frames of a 3D video signal processed by the GPU 218 or the codec 219 or both, such as a decompressed 3D video signal, to the 3D processing device 203.
[0095] In some embodiments, the GPU 218 or the codec 219 is integrated with a formatter.
[0096] In some embodiments, the multi-view autostereoscopic 3D display screen 202 is used to display three-dimensional (3D) images, videos, etc. The multi-view autostereoscopic 3D display screen 202 may include a display panel and a grating.
[0097] In some embodiments, the eye tracking device 205 is communicatively connected to the 3D processing device 203, so that the 3D processing device 203 can render corresponding sub-pixels in the composite pixels (composite sub-pixels) based on the eye tracking data. In some embodiments, the eye tracking device 205 may also be connected to the processor 201, such as a bypass connection to the processor 201.
[0098] The 3D display device 200 may implement audio functions through an audio module 234, a speaker 235, a receiver 236, a microphone 237, a headphone jack 238, and an application processor, etc.
[0099] The keys 209 include a power-on key, a volume key, etc. The keys 209 may be mechanical keys or touch keys. The 3D display device 200 can receive key inputs and generate key signal inputs related to user settings and function controls of the 3D display device 200.
[0100] The motor 208 can generate a vibration prompt. The motor 208 may be configured to vibrate to indicate an incoming call or to vibrate to provide feedback for a touch.
[0101] The SIM card interface 211 is configured to connect a SIM card. In some embodiments, the 3D display device 200 uses an embedded SIM card (eSIM).
[0102] The pressure sensor 223 is configured to sense a pressure signal and can convert the pressure signal into an electrical signal.
[0103] The barometric pressure sensor 224 is used to measure barometric pressure.
[0104] The magnetic sensor 225 includes a Hall sensor.
[0105] The gravity sensor 226, as an attitude detection device, can convert motion or gravity into an electrical signal and is configured to measure parameters such as tilt angle, inertial force, shock, and vibration.
[0106] The gyroscope sensor 227, as an attitude detection device, is configured to determine the motion attitude of the 3D display device 200.
[0107] With the help of the gravity sensor 226 or the gyroscope sensor 227, it can be detected that the 3D display device 200 is in the first attitude or in a second attitude different from the first attitude, or the 3D display device is switching between the first attitude and the second attitude.
[0108] The acceleration sensor 228 can detect the magnitude of the acceleration of the 3D display device 200 in each direction (generally three axes).
[0109] The distance sensor 229 can be configured to measure distance
[0110] The temperature sensor 230 can be configured to detect temperature.
[0111] The fingerprint sensor 231 can be configured to collect fingerprints.
[0112] The touch sensor 232 can be disposed in the multi-view autostereoscopic 3D display screen 202. The touch sensor 232 and the multi-view autostereoscopic 3D display screen 202 form a touch screen, also known as a "touch control screen".
[0113] The bone conduction sensor 233 can acquire vibration signals.
[0114] The charging management module 214 is configured to receive a charging input from a charger.
[0115] The power management module 215 is configured to connect the battery 216 and the charging management module 214 to the processor 201. The power management module 215 receives an input from at least one of the battery 216 or the charging management module 214 and supplies power to the processor 201, the memory 210, the external memory, the multi-view autostereoscopic 3D display screen 202, the imaging device 206, the wireless communication module 242, etc. In some other embodiments, the power management module 215 and the charging management module 214 may also be disposed in the same device.
[0116] The software system of the 3D display device 200 can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture. The embodiments shown in this disclosure take the Android system with a layered architecture as an example to exemplarily illustrate the software structure of the 3D display device 200. However, it can be envisioned that the embodiments of this disclosure can be implemented in different software systems, such as operating systems.
[0117] Figure 5It is a schematic diagram of the software structure of a 3D display device 200, such as a mobile terminal. The layered architecture divides the software into several layers. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer 510, the framework layer 520, the core class libraries and the Runtime 530, and the kernel layer 540.
[0118] The application layer 510 may include a series of application packages. Such as Figure 6 shown, the application packages may include applications such as Bluetooth, WLAN, navigation, music, camera, calendar, call, video, gallery, map, and short message.
[0119] The framework layer 520 provides application programming interfaces (APIs) and programming frameworks for the applications in the application layer. Such as Figure 5 shown, the framework layer 520 may include a resource manager, a telephone manager, a content manager, a notification manager, a window manager, a view system installer and manager, etc.
[0120] The Android Runtime includes core libraries and a virtual machine. The Android Runtime is responsible for the scheduling and management of the Android system. The core libraries contain two parts: one part is the functional functions to be called by the Java language, and the other part is the core libraries of Android.
[0121] The application layer and the framework layer run in the virtual machine. The virtual machine executes the Java files in the application layer and the framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
[0122] The core class libraries may include multiple functional modules. For example: 3D graphics processing libraries (such as: OpenGL ES), surface managers, image processing libraries, media libraries, and graphics engines (such as: SGL), etc.
[0123] The kernel layer 540 is the layer between the hardware and the software. The kernel layer at least includes a camera driver, an audio-video interface, a call interface, a Wifi interface, a sensor driver, a power management, and a GPS interface.
[0124] Next, refer to Figure 6 to describe the transmission and display of 3D video signals in a 3D display device according to an embodiment of the present disclosure. As described above, the 3D display device defines multiple viewpoints corresponding to each posture. The user's eyes can see the display of the corresponding sub-pixels in each composite pixel or each composite sub-pixel in the multi-viewpoint autostereoscopic display screen at the viewpoints (spatial positions) corresponding to each posture. The two different pictures seen by the user's two eyes at different viewpoints form a parallax, and a 3D picture is synthesized in the brain.
[0125] In some embodiments of the present disclosure, the 3D processing device 130 receives video frames, such as decompressed 3D video signals, from the processor 120 through, for example, a video signal interface 140 that serves as an internal interface. Each video frame may include two images, or a composite image, or be composed of them.
[0126] In some embodiments, the two images or the composite image may include different types of images and may be arranged in various forms.
[0127] As Figure 6 shown, the video frames of the 3D video signal include two side-by-side images 601, 602 or are composed of them. In some embodiments, the two images may be a left-eye disparity image and a right-eye disparity image, respectively. In some embodiments, the two images may be a rendered color image and a depth-of-field image, respectively.
[0128] In some embodiments, the video frames of the 3D video signal include an interleaved composite image. In some embodiments, the composite image may be an interleaved left-eye and right-eye disparity composite image, an interleaved rendered color and depth-of-field composite image.
[0129] In some embodiments, after receiving a video frame including two images 601, 602, at least one 3D processing device 130 renders at least one sub-pixel in each composite sub-pixel based on one of the two images and renders at least another sub-pixel in each composite sub-pixel based on the other of the two images.
[0130] In other embodiments, after receiving a video frame including a composite image, at least one 3D processing device renders at least two sub-pixels in each composite sub-pixel based on the composite image. For example, at least one sub-pixel is rendered according to the first image (portion) in the composite image, and at least another sub-pixel is rendered according to the second image (portion).
[0131] In some embodiments, the rendering of the sub-pixels may be dynamic rendering based on real-time eye-tracking data. The real-time eye-tracking data can be obtained through an eye-tracking device or an eye-tracking data interface.
[0132] In some embodiments, the eye-tracking device of the 3D display device is configured to be communicatively connected to the pose detection device of the 3D display device to obtain the position of the viewing point where the user's eyes are located in relation to the pose of the 3D display device. The pose detection device may be, for example, a gyroscope sensor or a gravity sensor, and can detect that the 3D display device is in a first pose, a second pose, and the switching between the two poses.
[0133] In some embodiments, obtaining the position of the viewpoint where the user's eyes are located in relation to the pose of the 3D display device includes obtaining the position of the viewpoint of the first pose where the user's eyes are located when the 3D display device is in the first pose. In other embodiments, obtaining the position of the viewpoint where the user's eyes are located in relation to the pose of the 3D display device includes obtaining the position of the viewpoint of the second pose where the user's eyes are located when the 3D display device is in the second pose.
[0134] In some embodiments, the 3D processing device is configured to render relevant sub-pixels within the first pose playback area based on the viewpoint of the first pose where the user's eyes are located, according to the 3D image from the 3D signal.
[0135] See Figure 3A , which shows an example of dynamic rendering corresponding to the first pose. As Figure 3A shown, when the pose detection device detects that the 3D display device is in the first pose or switches from the second pose towards the first pose, the eye tracking device detects the viewpoints of the first pose corresponding to the user's binocular eyes. For example, the left eye corresponds to the viewpoint Vi2 in the viewpoints of the first pose, and the right eye corresponds to Vi5 in the viewpoints of the first pose. An image of the viewpoints of the first pose corresponding to the user's binocular eyes is generated based on the video frame of the 3D video signal, and the sub-pixels corresponding to the viewpoints Vi2 and Vi5 of the first pose in the composite sub-pixels are rendered within the first playback area 171. Figure 3A Schematically shows the rendering of some sub-pixels.
[0136] In some embodiments, the 3D processing device is configured to render the relevant sub-pixels corresponding to the second pose viewpoint in the covered composite pixels within the second pose playback area based on the viewpoint of the second pose where the user's eyes are located, according to the 3D image of the 3D signal.
[0137] See Figure 3B , which shows an example of dynamic rendering corresponding to the second pose. As Figure 3B shown, when the pose detection device detects that the 3D display device is in the second pose or switches from the first pose towards the second pose, the eye tracking device detects the viewpoints of the second pose corresponding to the user's binocular eyes. For example, the left eye corresponds to the viewpoint Vj1 in the viewpoints of the second pose, and the right eye corresponds to Vj3 in the viewpoints of the second pose. An image of the viewpoints of the second pose corresponding to the user's binocular eyes is generated based on the video frame of the 3D video signal, and the sub-pixels corresponding to the viewpoints Vj1 and Vj3 of the second pose in the three covered composite pixels by the lenticular grating 190 are rendered within the second playback area 172. Figure 3B Schematically shows the rendering of the sub-pixels in some of the covered composite pixels.
[0138] In some embodiments, the 3D display device further includes a format adjuster (not shown), configured to adjust the format of the 3D signal, such as preprocessing the video frames of the 3D video signal to be suitable for playing 3D images in the first posture playing area and the second posture playing area respectively. For example, when the resolution of the 3D signal is inconsistent with the display resolution of the first posture playing area or the second posture playing area, the format adjuster preprocesses the resolution of the 3D signal to adapt to the display resolution of the first posture playing area or the second posture playing area.
[0139] According to an embodiment of the present disclosure, a method for implementing 3D image display in the 3D display device as described above is provided. The method for implementing 3D image display includes:
[0140] Detecting the posture of the 3D display device, including detecting the posture in which the 3D display device is located, or detecting the posture change of the 3D display device, or detecting both;
[0141] When it is detected that the 3D display device has a posture change, adjusting the display of the 3D image so that the display orientation of the 3D image remains at the initial display orientation before the 3D display device has a posture change. This can make the displayed 3D image always adapt to the user's viewing orientation.
[0142] In some embodiments, as Figure 7 shown, the method for implementing 3D image display includes:
[0143] S100, detecting the posture change of the 3D display device; and
[0144] S200, when it is detected that the posture of the 3D display device has changed, adjusting the display orientation of the displayed 3D image so that the 3D image remains at the initial display orientation before the 3D display device has a posture change.
[0145] In some embodiments, detecting the posture in which the 3D display device is located or the posture change can be completed by a posture detection device, and adjusting the display of the 3D image so that the display orientation of the 3D image remains at the initial display orientation before the 3D display device has a posture change can be completed by a 3D processing device.
[0146] In some embodiments, detecting the posture in which the 3D display device is located or the posture change includes: detecting the rotational angular velocity of the 3D display device, and determining the posture in which the 3D display device is located or the posture change according to the rotational angular velocity.
[0147] In some embodiments, adjusting the display orientation of the 3D image includes: rotating the display orientation of the 3D image in the plane where the 3D image is located so that the 3D image remains at the initial display orientation before the 3D display device has a posture change.
[0148] In some embodiments, the posture of the 3D display device includes at least one of the following: landscape display posture, portrait display posture, and diagonal screen display posture.
[0149] In some embodiments, the first posture of the 3D display device before the posture change includes any one of the landscape display posture, portrait display posture, and diagonal screen display posture, and the second posture of the 3D display device after the posture change includes any one different from the first posture among the landscape display posture, portrait display posture, and diagonal screen display posture.
[0150] In some embodiments, adjusting the display orientation of the 3D image includes: rotating the 3D image so that the 3D image remains in the initial display orientation corresponding to the first posture. In this way, for the user, no matter how the posture of the 3D display device is adjusted, the display orientation of the 3D image seen is consistent.
[0151] In some embodiments, when any one of the first posture and the second posture is the diagonal screen display posture, adjusting the display orientation of the 3D image further includes: displaying the 3D image in a full-screen display mode.
[0152] In some embodiments, adjusting the display orientation of the 3D image includes: rotating the display orientation of the 3D image in the plane where the 3D image is located so that the 3D image remains within the initial display orientation range; wherein the initial display orientation range includes the initial display orientation. In this way, the display orientation of the displayed 3D image can be finely adjusted or adjusted according to the movement of the user to adapt to the movement of the user.
[0153] In some embodiments, the method for implementing the display of the 3D image in the 3D display device further includes: adjusting the display orientation of the 3D image according to the viewing orientation of the user so that the display orientation of the 3D image is consistent with the viewing orientation of the user. The viewing orientation of the user can include any one of a horizontal viewing orientation, a vertical viewing orientation, and a diagonal viewing orientation.
[0154] In some embodiments, it is also possible to perform eye tracking on the user and determine the viewing orientation of the user according to the obtained eye tracking data. This can be achieved, for example, by an eye tracking device.
[0155] In some embodiments, adjusting the display orientation of a 3D image includes: rendering composite pixels in a multi-view autostereoscopic display screen of a 3D display device based on the adjusted display orientation of the 3D image (or the changed posture of the 3D display device). For example, in one posture, based on the correspondence between the sub-pixels of each composite sub-pixel in the multi-view autostereoscopic display screen and the viewpoints, the sub-pixels corresponding to the viewpoints determined by the eye tracking data are rendered according to the 3D image to be displayed. Or, for another example, in another posture, based on the correspondence between each composite pixel in the multi-view autostereoscopic display screen and the viewpoints, the sub-pixels in the composite pixels corresponding to the viewpoints determined by the eye tracking data are rendered according to the 3D image to be displayed.
[0156] The above adjustment of the display orientation of the 3D image and the rendering of the sub-pixels can be completed by a 3D processing device.
[0157] In some embodiments, a method for implementing the display of a 3D image in a 3D display device includes:
[0158] Obtaining a 3D signal;
[0159] In response to a signal that the 3D display device is in a first posture or switching to a first posture, playing a 3D image from the 3D signal in a first posture playing area; and
[0160] In response to a signal that the 3D display device is in a second posture or switching to a second posture, playing a 3D image from the 3D signal in a second posture playing area.
[0161] In the embodiments of the present disclosure, the "posture" of the 3D display device is equivalent to the "orientation" of the 3D display device.
[0162] In some embodiments, the switching method further includes: obtaining real-time eye tracking data related to the posture of the 3D display device.
[0163] In some embodiments, obtaining real-time eye tracking data related to the posture of the 3D display device includes: in response to a signal that the 3D display device is in a first posture, obtaining the position of the first posture viewpoint where the user's eyes are located.
[0164] In some embodiments, obtaining real-time eye tracking data related to the posture of the 3D display device includes: in response to a signal that the 3D display device is in a second posture, obtaining the position of the second posture viewpoint where the user's eyes are located.
[0165] In some embodiments, playing a 3D image from the 3D signal in the first posture playing area includes: based on the first posture viewpoint where the user's eyes are located, rendering relevant sub-pixels in the same-color sub-pixels of each composite sub-pixel in the first posture playing area according to the 3D image of the 3D signal.
[0166] In some embodiments, playing a 3D image from a 3D signal in the second posture playback area includes: based on the second posture viewing point where the user's eyes are located, rendering, in the second posture playback area, the relevant sub-pixels corresponding to the second posture viewing point among the covered composite pixels according to the 3D image of the 3D signal.
[0167] Embodiments of the present disclosure provide a 3D display device 300. Refer to Figure 8 , the 3D display device 300 includes a processor 320 and a memory 310. The 3D display device 300 may further include a communication interface 340 and a bus 330. The processor 320, the communication interface 340, and the memory 310 complete communication with each other through the bus 330. The communication interface 340 can be configured to transmit information. The processor 320 can call the logical instructions in the memory 310 to execute the method of switching and displaying a 3D image in the 3D display device in the above embodiments. When the logical instructions in the above memory 310 are implemented in the form of a software functional device and sold or used as an independent product, they can be stored in a computer-readable storage medium.
[0168] The above description and the drawings fully illustrate the embodiments of the present disclosure so that those skilled in the art can practice them. Other embodiments may include structural, logical, electrical, process, and other changes. Unless explicitly required, the individual components and functions are optional, and the order of operations can vary. Parts and features of some embodiments may be included in or replace parts and features of other embodiments. The scope of the embodiments of the present disclosure includes the entire scope of the claims and all available equivalents of the claims. The terms used in this application are only used to describe the embodiments and do not limit the claims. When used in this application, the term "including" and the like mean the presence of at least one of the stated features, but do not exclude the presence of other features.
[0169] In the embodiments disclosed herein, the disclosed methods, products (including but not limited to devices, equipment, etc.) can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of units can be merely a logical function division. In actual implementation, there can be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Additionally, the displayed or discussed couplings or direct couplings or communication connections to each other can be through some interfaces. The indirect couplings or communication connections of devices or units can be in electrical, mechanical, or other forms. The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units. Some or all of the units can be selected according to actual needs to implement this embodiment. Additionally, in the embodiments of the present disclosure, the various functional units can be integrated in one processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit.
[0170] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to the embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram can represent a module, a program segment, or a part of code that contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions marked in the blocks can also occur in a different order than that marked in the accompanying drawings. For example, two consecutive blocks can actually be executed substantially in parallel, and they can sometimes be executed in the reverse order, which can depend on the functions involved. In the descriptions corresponding to the flowcharts and block diagrams in the accompanying drawings, the operations or steps corresponding to different blocks can also occur in a different order than that disclosed in the description. Sometimes, there is no specific order between different operations or steps. For example, two consecutive operations or steps can actually be executed substantially in parallel, and they can sometimes be executed in the reverse order, which can depend on the functions involved. Each block in the block diagram and / or flowchart, and the combination of blocks in the block diagram and / or flowchart, can be implemented by a dedicated hardware-based system for performing the specified functions or actions, or can be implemented by a combination of dedicated hardware and computer instructions.
Claims
1. A method for realizing 3D image display, characterized in that, Comprising: Detecting the attitude change of a 3D display device, wherein the 3D display device includes a multi-viewpoint autostereoscopic 3D display screen, the multi-viewpoint autostereoscopic 3D display screen includes a plurality of composite pixels and a lenticular grating covering the plurality of composite pixels, each of the plurality of composite pixels includes a plurality of composite sub-pixels, each of the plurality of composite sub-pixels includes a plurality of sub-pixels of the same color, and the lenticular grating is inclined to cover a plurality of sub-pixels along a first direction of the 3D display device to define a plurality of first attitude viewpoints corresponding to the plurality of sub-pixels and cover at least three composite pixels along a second direction of the 3D display device to define at least three second attitude viewpoints corresponding to the at least three composite pixels; and When detecting that the attitude of the 3D display device changes, adjusting the display orientation of the displayed 3D image so that the 3D image remains in the initial display orientation before the attitude change of the 3D display device, wherein, based on the first attitude viewpoint where the user's eyes are located, rendering the sub-pixels corresponding to the first attitude viewpoint in a first attitude playback area according to the 3D image from the 3D signal, and based on the second attitude viewpoint where the user's eyes are located, rendering the sub-pixels corresponding to the second attitude viewpoint in the covered composite pixels in a second attitude playback area according to the 3D image of the 3D signal.
2. The method according to claim 1, wherein: Detecting the attitude change of the 3D display device includes: detecting the rotational angular velocity of the 3D display device, and determining the attitude change of the 3D display device according to the rotational angular velocity; Adjusting the display orientation of the 3D image includes: rotating the display orientation of the 3D image in the plane where the 3D image is located so that the 3D image remains in the initial display orientation before the attitude change of the 3D display device.
3. The method according to claim 2, wherein: The attitude of the 3D display device includes at least one of the following: landscape display attitude, portrait display attitude.
4. The method according to claim 3, wherein: The first attitude of the 3D display device before the attitude change includes: any one of the landscape display attitude, portrait display attitude; The second attitude of the 3D display device after the attitude change includes: any one different from the first attitude among the landscape display attitude, portrait display attitude; Adjusting the display orientation of the 3D image includes: rotating the 3D image so that the 3D image remains in the initial display orientation corresponding to the first attitude.
5. The method according to claim 2, wherein Adjusting the display orientation of the 3D image includes: Rotating the display orientation of the 3D image in the plane where the 3D image is located so that the 3D image remains within the initial display orientation range; Wherein, the initial display orientation range includes the initial display orientation.
6. The method according to claim 1, wherein Further comprising: Adjusting the display orientation of the 3D image according to the user's viewing orientation so that the display orientation of the 3D image is consistent with the user's viewing orientation.
7. The method according to claim 6, wherein: The user's viewing orientation includes: any one of a horizontal viewing orientation, a vertical viewing orientation; The method further includes: performing eye tracking on the user, and determining the viewing orientation of the user according to the obtained eye tracking data.
8. The method according to any one of claims 1 to 7, characterized in that Adjusting the display orientation of the 3D image includes: Based on the adjusted display orientation of the 3D image, rendering sub-pixels in the multi-view autostereoscopic display screen of the 3D display device.
9. The method according to any one of claims 1 to 7, characterized in that, Arranging multiple sub-pixels of each composite sub-pixel in rows in the first direction of the 3D display device.
10. The method according to claim 9, characterized in that, Arranging multiple composite sub-pixels of each composite pixel side by side in the second direction of the 3D display device.
11. The method according to claim 10, wherein Arranging the lenticular grating at an inclination angle θ with respect to the second direction of the 3D display device in such a way that the following conditions are satisfied: ±1 / i ≤ tanθ ≤ ±1 / 2, where i is the number of sub-pixels that the composite sub-pixel has.
12. The method according to claim 11, wherein Arranging the lenticular grating at an inclination angle θ with respect to the second direction of the 3D display device in such a way that the following conditions are satisfied: tanθ = 1 / j, where 2 ≤ j ≤ i and j is an integer.
13. A 3D display device, characterized in that, Including: A processor; And A memory storing program instructions; Wherein, the processor is configured to execute the method according to any one of claims 1 to 12 when executing the program instructions.
14. A 3D display device, characterized in that, Including: A multi-view autostereoscopic display screen, including a plurality of composite pixels and a lenticular grating covering the plurality of composite pixels. Each composite pixel in the plurality of composite pixels includes a plurality of composite sub-pixels, and each composite sub-pixel in the plurality of composite sub-pixels includes a plurality of sub-pixels of the same color. The lenticular grating is inclined so as to cover a plurality of sub-pixels in the first direction of the 3D display device to define a plurality of first pose viewpoints corresponding to the plurality of sub-pixels and cover at least three composite pixels in the second direction of the 3D display device to define at least three second pose viewpoints corresponding to the at least three composite pixels; A pose detection device configured to detect a change in the pose of the 3D display device; And A 3D processing device configured to adjust the display orientation of the displayed 3D image based on the detected change in the pose of the 3D display device so that the 3D image remains in the initial display orientation before the pose change of the 3D display device. The 3D processing device is further configured to render sub-pixels corresponding to the first pose viewpoint in the first pose playback area according to the 3D image from the 3D signal based on the first pose viewpoint where the user's eyes are located, and render sub-pixels corresponding to the second pose viewpoint in the covered composite pixels in the second pose playback area according to the 3D image of the 3D signal based on the second pose viewpoint where the user's eyes are located.
15. The 3D display device according to claim 14, characterized in that, The pose detection device is configured to detect the rotational angular velocity of the 3D display device and determine the change in the pose of the 3D display device according to the rotational angular velocity; The 3D processing device is configured to rotate the display orientation of the 3D image in the plane where the 3D image is located so that the 3D image remains in the initial display orientation before the pose change of the 3D display device.
16. The 3D display device according to claim 15, characterized in that, The pose of the 3D display device includes at least one of the following: landscape display pose, portrait display pose.
17. The 3D display device according to claim 16, wherein the first posture of the 3D display device before posture change includes any one of a landscape display posture and a portrait display posture; the second posture of the 3D display device after posture change includes any one of a landscape display posture and a portrait display posture that is different from the first posture; the 3D processing device is configured to rotate the 3D image so that the 3D image maintains an initial display orientation corresponding to the first posture.
18. The 3D display device according to claim 15, wherein, the 3D processing device is configured to rotate the display orientation of the 3D image in the plane where the 3D image is located so that the 3D image maintains within an initial display orientation range; wherein, the initial display orientation range includes the initial display orientation.
19. The 3D display device according to claim 14, characterized in that, the 3D processing device is configured to adjust the display orientation of the 3D image according to the user's viewing orientation so that the display orientation of the 3D image is consistent with the user's viewing orientation.
20. The 3D display device according to claim 19, wherein, the user's viewing orientation includes any one of a horizontal viewing orientation and a vertical viewing orientation; the 3D display device further includes an eye tracking data acquisition device configured to acquire eye tracking data; the 3D processing device is configured to determine the user's viewing orientation according to the obtained eye tracking data.
21. The 3D display device according to any one of claims 14 to 20, characterized in that, the 3D processing device is configured to render composite pixels in the multi-view autostereoscopic 3D display screen of the 3D display device based on the adjusted display orientation of the 3D image.
22. The 3D display device according to any one of claims 14 to 20, characterized in that, A plurality of sub-pixels of each composite sub-pixel are arranged in rows in the first direction of the 3D display device.
23. The 3D display device according to claim 22, wherein, A plurality of composite sub-pixels of each composite pixel are arranged side by side in the second direction of the 3D display device.
24. The 3D display device according to claim 23, wherein, The inclination angle θ of the lenticular grating with respect to the second direction of the 3D display device satisfies the following conditions: ±1 / i ≤ tanθ ≤ ±1 / 2.
25. The 3D display device according to claim 24, wherein The inclination angle θ of the lenticular grating with respect to the second direction of the 3D display device satisfies the following conditions: tanθ = 1 / j, where 2 ≤ j ≤ i and j is an integer.
Citation Information
Patent Citations
Autostereoscopic display equipment sub-pixel arranging method based on vertical column mirror grating
CN102183842A
Stereoscopic image display method and hand-held terminal
CN104661011A
Multi-view-point liquid crystal display LCD naked-eye 3D (Three Dimensional) display method and device
CN105911712A
3D display device
CN211930763U
Cited By
Method for implementing 3D image display and 3D display device
WO2021110027A1