Method of realizing 3D image display, 3D display device

Abstract

The application relates to 3D display technology, and discloses a method for realizing 3D image display, which comprises the following steps: detecting the posture change of a 3D display device, wherein the 3D display device comprises a multi-view naked-eye 3D display screen, the multi-view naked-eye 3D display screen comprises a plurality of composite pixels and a plurality of spherical gratings covering the plurality of composite pixels, each composite pixel in the plurality of composite pixels comprises a plurality of composite sub-pixels, and each composite sub-pixel in the plurality of composite sub-pixels comprises a plurality of sub-pixels corresponding to a plurality of views; and when the posture change of the 3D display device is detected, the display orientation of the displayed 3D image is adjusted so that the 3D image remains at the initial display orientation before the posture change of the 3D display device. The disclosure solves the problem that the electronic device cannot display a suitable picture after adjusting the posture. The application also discloses a 3D display device.

Description

Technical Field

[0001] This application relates to the field of 3D display technology, such as methods for displaying 3D images and 3D display devices. Background Technology

[0002] Currently, glasses-free 3D display devices achieve 3D display effects by using gratings to refract pixels.

[0003] In the process of implementing the embodiments of this disclosure, it has been found that at least the following problems exist in the related technology: the display device is configured to display a suitable 3D effect in one posture, but does not have the function of displaying a 3D effect in another posture. Summary of the Invention

[0004] To provide a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. This summary is not intended as a general commentary, nor is it intended to identify key / important components or describe the scope of protection of these embodiments, but rather as a prelude to the detailed description that follows.

[0005] This disclosure provides a method and a 3D display device for displaying 3D images, in order to solve the technical problems of 3D display devices being unable to display 3D images after adjusting their posture and the large amount of rendering computation.

[0006] In some embodiments, a method for displaying a 3D image is provided, comprising: detecting a pose change of a 3D display device, wherein the 3D display device includes a multi-viewpoint glasses-free 3D display screen, the multi-viewpoint glasses-free 3D display screen includes a plurality of composite pixels and a plurality of spherical gratings covering the plurality of composite pixels, each of the plurality of composite pixels includes a plurality of composite sub-pixels, each of the plurality of composite sub-pixels including a plurality of sub-pixels corresponding to a plurality of viewpoints; and when a pose change of the 3D display device is detected, adjusting the display orientation of the displayed 3D image so that the 3D image remains in the initial display orientation before the pose change of the 3D display device.

[0007] In some embodiments, detecting the attitude change of the 3D display device includes: detecting the rotational angular velocity of the 3D display device and determining the attitude change of the 3D display device based on the rotational angular velocity; adjusting the display orientation of the 3D image includes: rotating the display orientation of the 3D image in the plane where the 3D image is located so that the 3D image remains in the initial display orientation before the attitude change of the 3D display device.

[0008] In some embodiments, the posture of the 3D display device includes at least one of the following: landscape display posture, portrait display posture, and angled display posture.

[0009] In some embodiments, the first posture of the 3D display device before the posture change includes any one of the following: landscape display posture, portrait display posture, and angled display posture; the second posture of the 3D display device after the posture change includes any one of the following: landscape display posture, portrait display posture, and angled display posture, which is different from the first posture; adjusting the display orientation of the 3D image includes rotating the 3D image so that the 3D image remains in the initial display orientation corresponding to the first posture.

[0010] In some embodiments, when either the first posture or the second posture is a tilted screen display posture, adjusting the display orientation of the 3D image further includes: displaying the 3D image in a full-screen display mode.

[0011] In some embodiments, adjusting the display orientation of a 3D image includes: rotating the display orientation of the 3D image in the plane in which the 3D image is located so that the 3D image remains within the initial display orientation range; wherein the initial display orientation range includes the initial display orientation.

[0012] In some embodiments, the method further includes: adjusting the display orientation of the 3D image according to the user's viewing orientation, so that the display orientation of the 3D image is consistent with the user's viewing orientation.

[0013] In some embodiments, the user's viewing orientation includes any one of: horizontal viewing orientation, vertical viewing orientation, and diagonal viewing orientation; the method further includes: performing eye tracking on the user and determining the user's viewing orientation based on the obtained eye tracking data.

[0014] In some embodiments, adjusting the display orientation of a 3D image includes: rendering a corresponding sub-pixel in a composite sub-pixel in a multi-view naked-eye 3D display based on the adjusted display orientation of the 3D image.

[0015] In some embodiments, rendering a corresponding sub-pixel in a composite sub-pixel in a multi-view naked-eye 3D display includes: rendering the sub-pixel in each composite sub-pixel corresponding to the viewpoint after the pose change of the 3D display device, based on the viewpoint corresponding to the sub-pixel in each composite sub-pixel.

[0016] In some embodiments, the plurality of sub-pixels in each composite sub-pixel are arranged in an i×j array, wherein the i×j array sub-pixels of each composite sub-pixel correspond to i viewpoints before the 3D display device undergoes a pose change; or the i×j array sub-pixels of each composite sub-pixel correspond to j viewpoints after the 3D display device undergoes a pose change.

[0017] In some embodiments, a 3D display device is provided, including: a processor; and a memory storing program instructions; wherein the processor is configured to perform the method described above when executing the program instructions.

[0018] In some embodiments, a 3D display device is provided, comprising: a multi-viewpoint glasses-free 3D display screen, including a plurality of composite pixels and a plurality of spherical gratings covering the plurality of composite pixels, each of the plurality of composite pixels including a plurality of composite sub-pixels, each of the plurality of composite sub-pixels including a plurality of sub-pixels corresponding to a plurality of viewpoints; a posture detection device configured to detect posture changes of the 3D display device; and a 3D processing device configured to adjust the display orientation of a displayed 3D image based on the detected posture changes of the 3D display device so that the 3D image remains in the initial display orientation before the posture change of the 3D display device.

[0019] In some embodiments, the attitude detection device is configured to detect the rotational angular velocity of the 3D display device and determine the attitude change of the 3D display device based on the rotational angular velocity; the 3D processing device is configured to rotate the display orientation of the 3D image in the plane where the 3D image is located so that the 3D image remains in the initial display orientation before the attitude change of the 3D display device.

[0020] In some embodiments, the posture of the 3D display device includes at least one of the following: landscape display posture, portrait display posture, and angled display posture.

[0021] In some embodiments, the first posture of the 3D display device before the posture change includes any one of a landscape display posture, a portrait display posture, and an angled display posture; the second posture of the 3D display device after the posture change includes any one of a landscape display posture, a portrait display posture, and an angled display posture that is different from the first posture; the 3D processing device is configured to rotate the 3D image so that the 3D image remains in the initial display orientation corresponding to the first posture.

[0022] In some embodiments, the 3D processing device is configured to display a 3D image in full-screen mode when either the first posture or the second posture is a tilted screen display posture.

[0023] In some embodiments, the 3D processing apparatus is configured to rotate the display orientation of the 3D image in the plane in which the 3D image is located, so that the 3D image remains within an initial display orientation range; wherein the initial display orientation range includes the initial display orientation.

[0024] In some embodiments, the 3D processing apparatus is configured to adjust the display orientation of a 3D image according to the user's viewing orientation, such that the display orientation of the 3D image is consistent with the user's viewing orientation.

[0025] In some embodiments, the user's viewing orientation includes any one of a horizontal viewing orientation, a vertical viewing orientation, and an oblique viewing orientation; the 3D display device further includes an eye-tracking device or an eye-tracking data interface configured to acquire eye-tracking data; and the 3D processing device is configured to determine the user's viewing orientation based on the acquired eye-tracking data.

[0026] In some embodiments, the 3D processing apparatus is configured to render composite pixels in a multi-view naked-eye 3D display of a 3D display device based on the display orientation of an adjusted 3D image.

[0027] In some embodiments, the 3D processing apparatus is configured to render the sub-pixels corresponding to the viewpoints in the composite sub-pixels included in the multi-view naked-eye 3D display based on the viewpoints corresponding to the sub-pixels in each composite sub-pixel after a change in the pose of the 3D display device.

[0028] In some embodiments, the plurality of sub-pixels in each composite sub-pixel are arranged in an i×j array, wherein the i×j array sub-pixels of each composite sub-pixel correspond to i viewpoints before the 3D display device undergoes a pose change; or the i×j array sub-pixels of each composite sub-pixel correspond to j viewpoints after the 3D display device undergoes a pose change.

[0029] The method and 3D display device for displaying 3D images provided in this disclosure can achieve the following technical effects:

[0030] The 3D display device can display appropriate 3D effects in both orientations without being affected by adjustments to the device's orientation. Furthermore, the 3D display device can employ a multi-viewpoint glasses-free 3D display. This disclosure defines the display resolution of the multi-viewpoint glasses-free 3D display using composite pixels. During transmission and display, the display resolution defined by composite pixels is taken into consideration, reducing the computational load of transmission and rendering while ensuring high-definition display effects, thus achieving high-quality glasses-free 3D display.

[0031] The above general description and the description below are exemplary and illustrative only and are not intended to limit this application. Attached Figure Description

[0032] One or more embodiments are illustrated by way of example with reference to the accompanying drawings. These illustrations and drawings do not constitute a limitation on the embodiments. Elements having the same reference numerals in the drawings are shown as similar elements. The drawings are not to be scaled. And wherein:

[0033] Figures 1A to 1C This is a schematic diagram of the structure of a 3D display device according to an embodiment of the present disclosure;

[0034] Figure 2This is a schematic diagram showing the correspondence between a spherical grating and a composite sub-pixel according to an embodiment of the present disclosure;

[0035] Figure 3A and Figure 3B This is a schematic diagram illustrating the correspondence between composite sub-pixels and viewpoints in different postures of a 3D display device according to embodiments of the present disclosure.

[0036] Figure 4 This is a schematic diagram of the arrangement of composite sub-pixels in a composite pixel according to an embodiment of the present disclosure;

[0037] Figure 5 This is a schematic diagram of the hardware structure of a 3D display device according to an embodiment of the present disclosure;

[0038] Figure 6 This is a schematic diagram of the software structure of a 3D display device according to an embodiment of the present disclosure;

[0039] Figure 7 This is a schematic diagram illustrating the format and content of images contained in a video frame of a 3D video signal according to an embodiment of the present disclosure;

[0040] Figure 8A and Figure 8B This is a schematic diagram of a 3D display device rendering sub-pixels in a first pose according to an embodiment of the present disclosure;

[0041] Figure 9A and Figure 9B This is a schematic diagram of a 3D display device rendering sub-pixels in a second pose according to an embodiment of the present disclosure;

[0042] Figure 10 This is a flowchart illustrating the switching of 3D images displayed in a 3D display device according to embodiments of the present disclosure; and

[0043] Figure 11 This is a schematic diagram of the structure of a 3D display device according to an embodiment of the present disclosure.

[0044] Figure label:

[0045] 100: 3D display device; 110: Multi-viewpoint glasses-free 3D display screen; 120: Processor; 121: Register; 130: 3D processing unit; 131: Buffer; 140: Video signal interface; 150: Eye tracking device; 160: Eye tracking data interface; 171: First posture playback area; 172: Second posture playback area; 180: Posture detection device; 190: Spherical grating; 200: 3D display device; 201: Processor; 202: Multi-viewpoint glasses-free 3D display screen; 203: 3D processing unit; 2 04: Video signal interface; 205: Eye tracking device; 206: Camera device; 207: Indicator; 208: Motor; 209: Button; 210: Memory; 211: Subscriber Identity Module (SIM) card interface; 212: External memory interface; 213: Universal Serial Bus interface; 214: Charging management module; 215: Power management module; 216: Battery; 217: Register; 218: GPU; 219: Codec; 220: Sensor module; 221: Proximity light sensor; 222: Ambient light sensor 223: Pressure sensor; 224: Barometric pressure sensor; 225: Magnetic sensor; 226: Gravity sensor; 227: Gyroscope sensor; 228: Accelerometer sensor; 229: Proximity sensor; 230: Temperature sensor; 231: Fingerprint sensor; 232: Touch sensor; 233: Bone conduction sensor; 234: Audio module; 235: Speaker; 236: Receiver; 237: Microphone; 238: Headphone jack; 239: Antenna; 240: Mobile communication module; 241: Antenna; 242: Wireless communication Module; 300: 3D display device; 310: Memory; 320: Processor; 330: Bus; 340: Communication interface; 400: Composite pixel; 410: Red composite subpixel; 420: Green composite subpixel; 430: Blue composite subpixel; 510: Application layer; 520: Framework layer; 530: Core class library and runtime; 540: Kernel layer; 601: One of the two images contained in a video frame of a 3D video signal; 602: One of the two images contained in a video frame of a 3D video signal. Detailed Implementation

[0046] To gain a more detailed understanding of the features and technical content of the embodiments of this disclosure, the implementation of the embodiments of this disclosure will be described in detail below with reference to the accompanying drawings. The accompanying drawings are for reference and illustration only and are not intended to limit the embodiments of this disclosure.

[0047] In this article, "glasses-free 3D display" refers to a technology that allows users to observe 3D display images on a flat panel display without wearing 3D display glasses.

[0048] In this article, "multi-viewpoint" has its conventional meaning in the art, referring to the different images displayed by different pixels or subpixels of a display screen that can be viewed from different locations (viewpoints) in space. In this article, multi-viewpoint will mean at least 3 viewpoints.

[0049] In this article, the term "pixel" generally refers to the smallest display unit in terms of resolution when a 2D display is used or when it is displayed as a 2D display.

[0050] However, in some embodiments herein, the term "composite pixel" used when applied to multi-view technology in the field of glasses-free 3D displays refers to the smallest display unit when a glasses-free 3D display provides multi-view display, but this does not preclude a single composite pixel used for multi-view technology from including or being presented as multiple 2D display pixels. In this document, unless specifically stated as a composite pixel or 3D pixel for "3D display" or "multi-view" applications, a pixel will refer to the smallest display unit in 2D display. Similarly, when described as a "composite subpixel" in glasses-free 3D displays for multi-view, it will refer to a composite subpixel of a single color presented within a composite pixel when a glasses-free 3D display provides multi-view display. In this document, a subpixel in "composite subpixel" will refer to the smallest display unit of a single color, which is often corresponding to a viewpoint.

[0051] An embodiment of this disclosure provides a 3D display device, including a multi-viewpoint glasses-free 3D display screen, a posture detection device, a 3D signal interface, and a 3D processing device. The 3D display device has multiple viewpoints, and each viewpoint corresponds to a posture based on the posture of the 3D display device.

[0052] A multi-viewpoint glasses-free 3D display includes multiple composite pixels and multiple spherical gratings. Each composite pixel includes multiple composite sub-pixels. The multiple composite sub-pixels are covered by multiple spherical gratings. In some embodiments, the composite sub-pixels and spherical gratings are arranged in a one-to-one correspondence. Each composite sub-pixel includes multiple sub-pixels, for example, multiple sub-pixels arranged in an i×j array. In some embodiments, each composite sub-pixel includes multiple sub-pixels of the same color arranged in an i×j array. In some embodiments, the i×j array sub-pixels or the i×j array sub-pixels of the same color correspond to i first-pose viewpoints in a first pose of the 3D display device and to j second-pose viewpoints in a second pose of the 3D display device. In some embodiments, i≥3, j≥3. The multi-viewpoint glasses-free 3D display can define a first-pose playback area of ​​the 3D display device in a first pose and a second-pose playback area of ​​the 3D display device in a second pose. The first-pose playback area and the second-pose playback area can be the same, different, or have overlapping locations.

[0053] The attitude detection device is configured to detect the attitude of the 3D display device, including detecting attitude changes of the 3D display device, detecting the current attitude of the 3D display device, or both. The 3D signal interface is configured to receive 3D signals.

[0054] The 3D processing device is configured to adjust the display of a 3D image based on the detected pose of the 3D display device, or a change in the pose of the 3D display device, or both, so that the display orientation of the 3D image remains at the initial display orientation before the change in the pose of the 3D display device. This ensures that the display orientation of the 3D image always remains consistent with the user's orientation.

[0055] In some embodiments, the 3D processing device processes 3D signals to play 3D images from 3D content in a first posture playback area and a second posture playback area. The 3D images played in the first and second posture playback areas are displayed in the same orientation for the user.

[0056] In this embodiment of the disclosure, the “posture” of the 3D display device is equivalent to the “orientation” of the 3D display device.

[0057] In some embodiments, the 3D processing device is communicatively connected to a multi-viewpoint glasses-free 3D display. In some embodiments, the 3D processing device is communicatively connected to a driving device for the multi-viewpoint glasses-free 3D display. In some embodiments, the 3D processing device is communicatively connected to an attitude detection device.

[0058] Figure 1A A 3D display device 100 according to an embodiment of the present disclosure is shown. For example... Figure 1A As shown, the 3D display device 100 includes a multi-view naked-eye 3D display screen 110, a 3D processing unit 130, a 3D signal interface (such as a video signal interface 140) configured to receive video frames of 3D signals, such as 3D video signals, a processor 120, and a posture detection device 180. Figure 1A In the illustrated embodiment, the multi-view naked-eye 3D display 110 may include a display panel and a grating covering the display panel. The display panel may include m columns and n rows (m×n) of composite pixels, thus defining an m×n display resolution.

[0059] In some embodiments, each composite pixel includes a red composite sub-pixel composed of red sub-pixels of the i×j array, a blue composite sub-pixel composed of blue sub-pixels of the i×j array, and a green composite sub-pixel composed of green sub-pixels of the i×j array. Figure 1A An example of a red composite subpixel 410 consisting of an i×j array of red subpixels is shown.

[0060] In embodiments of this disclosure, each composite subpixel has a corresponding subpixel corresponding to a viewpoint. Multiple subpixels of each composite subpixel are arranged in rows along the horizontal direction of the multi-viewpoint glasses-free 3D display, and the multiple subpixels in each row are of the same color. Since the multiple viewpoints of the 3D display device are arranged approximately along the horizontal direction of the multi-viewpoint glasses-free 3D display, when the user moves and their eyes are in different viewpoints, it is necessary to dynamically render the different subpixels in each composite subpixel corresponding to the corresponding viewpoint. Because the subpixels of the same color in each composite subpixel are arranged in rows, color mixing problems caused by visual persistence can be avoided. Furthermore, due to the refraction of the grating, it is possible to see a portion of the currently displayed subpixel at adjacent viewpoint positions; however, by arranging them in the same color and row, even if a portion of the currently displayed subpixel is seen, color mixing problems will not occur.

[0061] In some embodiments, the grating includes a plurality of spherical gratings, and each composite subpixel in the display panel is covered by a corresponding spherical grating. Figure 2 An example is shown illustrating the correspondence between a red composite sub-pixel 410 and a spherical grating 190. The grating can be composed of multiple spherical gratings 190 arranged in an array, each spherical grating 190 covering a corresponding composite sub-pixel. Although Figure 2 The diagram shows a spherical grating with a square base and a circular arc top, but other configurations of spherical gratings are conceivable. For example, the base of the spherical grating can be rectangular or hexagonal. Another example is that the top surface of the spherical grating can be a circular arc or an elliptical arc. Yet another example is that the top surface of the spherical grating is directly joined to the base surface. Yet another example is that other planes connect the top and bottom surfaces of the spherical grating, such as... Figure 2 As shown, the spherical grating 190 defines four cross-sectional planes between its arc-shaped top surface and its square bottom surface.

[0062] In some embodiments, the top surface of the spherical grating is provided with another refractive layer with a different refractive index than the spherical grating. The surface of this other refractive layer facing the spherical grating is engaged with the top surface of the spherical grating in a concave-convex fit, and the surface facing away from the spherical grating is a plane, for example, a plane parallel to the bottom surface of the spherical grating.

[0063] In some embodiments, the 3D display device 100 may be a mobile terminal. See also Figure 3A and Figure 3B An example of the pose (orientation) of a 3D display device 100 in the form of a mobile terminal is shown. As shown, the 3D display device 100 has a first pose, for example, a landscape display pose (see Figure 100). Figure 3A ) and a second pose, such as a portrait display pose (see Figure 3BThe 3D display device 100 can switch between a first posture and a second posture. The multi-view glasses-free 3D display 110 defines a first posture playback area 171 adapted to the first posture and a second posture playback area 172 adapted to the second posture. In the illustrated embodiment, the first posture playback area 171 and the second posture playback area 172 have different sizes. The area of ​​the first posture playback area 171 may, for example, occupy 80% to 100% of the area of ​​the multi-view glasses-free 3D display. The area of ​​the second posture playback area 172 may, for example, occupy 30% to 60% of the area of ​​the multi-view glasses-free 3D display. When the 3D display device is in the second posture, the second posture playback area 172 may, for example, be located in the center of the multi-view glasses-free 3D display.

[0064] The 3D display device 100 may have i first-pose viewpoints Vi corresponding to a first pose, and j second-pose viewpoints Vj corresponding to a second pose. Accordingly, the i×j array of same-color sub-pixels of each composite sub-pixel corresponds to the i first-pose viewpoints of the 3D display device in the first pose and to the j second-pose viewpoints of the 3D display device in the second pose. Figure 3A and Figure 3B In the illustrated embodiment, the 3D display device 100 has six first pose viewpoints Vi1-Vi6 and three second pose viewpoints Vj1-Vj3, with the subpixels of each composite subpixel arranged in a 6×3 array. The figure only exemplarily shows the correspondence between the i×j array of red subpixels of a single red composite subpixel 410 and the viewpoints in the two poses. In the illustrated embodiment, i = 6 and j = 3; it is conceivable that i and j can be other values ​​equal to or greater than 3.

[0065] In some embodiments, the orientation of the 3D display device includes at least one of a landscape display orientation, a portrait display orientation, and an angled display orientation.

[0066] In some embodiments, the first posture of the 3D display device includes any one of the horizontal display posture, the vertical display posture, and the angled display posture, and the second posture of the 3D display device includes any one of the horizontal display posture, the vertical display posture, and the angled display posture that is different from the first posture.

[0067] exist Figure 1A , Figure 2 , Figure 3A and Figure 3BIn the illustrated embodiment, each composite sub-pixel in the display panel is approximately square, and in the i×j array of the same color sub-pixels of each composite sub-pixel, i > j, and the aspect ratio of each sub-pixel of each composite sub-pixel is equal to i / j. It is conceivable that the composite sub-pixels and sub-pixels can have other suitable shapes. In some embodiments, each composite sub-pixel is approximately square, and in the i×j array of the same color sub-pixels of each composite sub-pixel, i = j, and the aspect ratio of each sub-pixel is approximately 1. In some embodiments, each composite sub-pixel is rectangular, and each sub-pixel in each composite sub-pixel is square or approximately square, and i / j is equal to the aspect ratio of the display panel.

[0068] In some embodiments, composite subpixels of different colors are arranged alternately in the display panel, and multiple composite subpixels of each composite pixel are arranged in a triangular pattern. For example... Figure 4 As shown, in the display panel, red composite sub-pixels 410, green composite sub-pixels 420 and blue composite sub-pixels 430 are arranged alternately, and the red composite sub-pixels 410, green composite sub-pixels 420 and blue composite sub-pixels 430 of each composite pixel 400 are arranged in a triangle.

[0069] In some embodiments, the 3D processing apparatus 130 may also optionally include a buffer 131 to buffer received video frames.

[0070] See Figure 1A The 3D display device 100 may also include a processor 120 that is communicatively connected to the 3D processing device 130 via a video signal interface 140. In some embodiments, the processor 120 is included in a computer or smart terminal, such as a mobile terminal, or is a processor unit.

[0071] In some embodiments, the video signal interface 140 is an internal interface connecting the processor 120 and the 3D processing device 130. Such a 3D display device 100 may be, for example, a mobile terminal, and the video signal interface 140 may be a MIPI, mini-MIPI, LVDS, min-LVDS, or DisplayPort interface.

[0072] In some embodiments, such as Figure 1A As shown, the processor 120 of the 3D display device 100 may also include a register 121. The register 121 may be configured to temporarily store instructions, data, and addresses.

[0073] In some embodiments, the attitude detection device 180 is communicatively connected to the processor 120. The attitude detection device 180 may be a gravity sensor or a gyroscope sensor.

[0074] In some embodiments, the 3D display device further includes an eye-tracking device or an eye-tracking data interface configured to acquire eye-tracking data. For example Figure 1B , Figure 3A and Figure 3B In the illustrated embodiment, the 3D display device 100 includes an eye-tracking device 150 communicatively connected to a 3D processing device 130, whereby the 3D processing device 130 can directly receive eye-tracking data. Figure 1C In the illustrated embodiment, the eye-tracking device (not shown) can be directly connected to the processor 120, for example, while the 3D processing device 130 obtains eye-tracking data from the processor 120 via the eye-tracking data interface 160. In other embodiments, the eye-tracking device can be connected to both the processor and the 3D processing device simultaneously, such that the 3D processing device 130 can directly obtain eye-tracking data from the eye-tracking device, while other information obtained by the eye-tracking device can be processed by the processor.

[0075] For example, Figure 5 A schematic diagram of the hardware structure of a 3D display device 200 implemented as a mobile terminal, such as a smartphone or tablet computer, is shown. In the illustrated embodiment, the 3D display device 200 may include a processor 201, an external memory interface 211, an (internal) memory 210, a universal serial bus (USB) interface 213, a charging management module 214, a power management module 215, a battery 216, a mobile communication module 240, a wireless communication module 242, antennas 239 and 241, an audio module 234, a speaker 235, a receiver 236, a microphone 237, a headphone jack 238, buttons 209, a motor 208, an indicator 207, a Subscriber Identity Module (SIM) card interface 221, a multi-view naked-eye 3D display screen 202, a 3D processing device 203, a 3D signal interface (such as a video signal interface 204), a camera device 206, an eye-tracking device 205, and a sensor module 220, etc.

[0076] In some embodiments, the sensor module 220 may include a proximity light sensor 221, an ambient light sensor 222, a pressure sensor 223, a barometric pressure sensor 224, a magnetic sensor 225, a gravity sensor 226, a gyroscope sensor 227, an acceleration sensor 228, a distance sensor 229, a temperature sensor 230, a fingerprint sensor 231, a touch sensor 232, and a bone conduction sensor 233, etc.

[0077] In some embodiments, processor 201 may include one or more processing units. In some embodiments, processor 201 may include one or a combination of at least two of the following: application processor (AP), modem processor, baseband processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, neural network processor (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0078] In some embodiments, the processor 201 may include one or more interfaces. Interfaces may include an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous transceiver (UART) interface, a mobile industry processor interface (MIPI), a general purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, a universal serial bus (USB) interface, etc.

[0079] USB port 213 is a USB standard compliant interface, which can be a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 213 can be used to connect a charger to charge the 3D display device 200, and can also be used for data transfer between the 3D display device 200 and peripheral devices. It can also be used to connect headphones and play audio through the headphones.

[0080] The wireless communication function of the 3D display device 200 can be implemented through antennas 241 and 239, mobile communication module 240, wireless communication module 242, modem processor or baseband processor, etc.

[0081] In some embodiments, the antenna 239 of the 3D display device 200 is coupled to the mobile communication module 240, and the antenna 241 is coupled to the wireless communication module 242, so that the 3D display device 200 can communicate with the network and other devices through wireless communication technology.

[0082] In some embodiments, the external interface for receiving 3D video signals may include a USB interface 213, a mobile communication module 240, a wireless communication module 242, or any combination thereof.

[0083] The memory 210 can be used to store computer executable program code, which includes instructions. The processor 201 executes various functional applications and data processing of the 3D display device 200 by running the instructions stored in the memory 210.

[0084] The external memory interface 212 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the 3D display device 200. The external memory card communicates with the processor 201 through the external memory interface 212 to perform data storage functions.

[0085] In some embodiments, the memory of the 3D display device may include (internal) memory 210, an external memory card connected to external memory interface 212, or a combination thereof.

[0086] In embodiments of this disclosure, the camera device 206 can capture images or videos.

[0087] In some embodiments, the 3D display device 200 implements display functions through a video signal interface 204, a 3D processing device 203, a multi-view naked-eye 3D display screen 202, and an application processor.

[0088] In some embodiments, the 3D display device 200 may include a GPU 218, for example, within a processor 201 for processing 3D video images, or for processing 2D video images.

[0089] In some embodiments, the 3D display device 200 further includes a video codec 219 configured to compress or decompress digital video.

[0090] In some embodiments, the video signal interface 204 is configured to output video frames of a 3D video signal processed by the GPU 218 or the codec 219 or both, such as a decompressed 3D video signal, to the 3D processing device 203.

[0091] In some embodiments, the GPU 218 or codec 219 integrates a format adjuster.

[0092] The multi-viewpoint glasses-free 3D display 202 is used to display three-dimensional (3D) images or videos, etc. The multi-viewpoint glasses-free 3D display 202 includes a display panel and a spherical grating covering the display panel.

[0093] In some embodiments, the eye-tracking device 205 is communicatively connected to the 3D processing device 203, so that the 3D processing device 203 can render corresponding sub-pixels in a composite pixel (composite sub-pixel) based on eye-tracking data. In some embodiments, the eye-tracking device 205 may also be connected to the processor 201, for example, by bypassing the processor 201.

[0094] The 3D display device 200 can implement audio functions through an audio module 234, a speaker 235, a receiver 236, a microphone 237, a headphone jack 238, and an application processor.

[0095] Buttons 209 include a power button, volume buttons, etc. Buttons 209 can be mechanical buttons or touch-sensitive buttons. The 3D display device 200 can receive button input and generate key signal inputs related to user settings and function control of the 3D display device 200.

[0096] Motor 208 can generate vibration alerts. Motor 208 can be configured to vibrate to alert for incoming calls, or it can be configured to vibrate to provide feedback on touch.

[0097] SIM card interface 211 is configured to connect a SIM card. In some embodiments, the 3D display device 200 employs an embedded SIM card (eSIM).

[0098] The pressure sensor 223 is configured to sense pressure signals and can convert the pressure signals into electrical signals.

[0099] The barometric pressure sensor 224 is used to measure barometric pressure.

[0100] The magnetic sensor 225 includes a Hall sensor.

[0101] The gravity sensor 226, as an attitude detection device, can convert motion or gravity into electrical signals and is configured to measure parameters such as tilt angle, inertial force, impact, and vibration.

[0102] The gyroscope sensor 227 is configured as an attitude detection device to determine the motion attitude of the 3D display device 200.

[0103] In some embodiments, the attitude detection device detects the rotational angular velocity of the 3D display device and determines the attitude change of the 3D display device based on the rotational angular velocity.

[0104] The gravity sensor 226 or the gyroscope sensor 227 can detect whether the 3D display device 200 is in a first posture or a second posture different from the first posture, or whether the 3D display device is switching between the first posture and the second posture.

[0105] Accelerometer 228 can detect the magnitude of acceleration of 3D display device 200 in various directions (generally three axes).

[0106] Distance sensor 229 can be configured to measure distance

[0107] Temperature sensor 230 can be configured to detect temperature.

[0108] The fingerprint sensor 231 can be configured to collect fingerprints.

[0109] The touch sensor 232 can be set in the multi-view naked-eye 3D display 202. The touch sensor 232 and the multi-view naked-eye 3D display 202 together form a touch screen, also known as a "touch screen".

[0110] The bone conduction sensor 233 can acquire vibration signals.

[0111] The charging management module 214 is configured to receive charging input from the charger.

[0112] Power management module 215 is configured to connect battery 216 and charging management module 214 to processor 201. Power management module 215 receives input from at least one of battery 216 or charging management module 214 to power processor 201, memory 210, external memory, multi-view naked-eye 3D display 202, camera device 206, and wireless communication module 242, etc. In other embodiments, power management module 215 and charging management module 214 may also be housed in the same device.

[0113] The software system of the 3D display device 200 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. The embodiments shown in this disclosure use the layered architecture of the Android system as an example to exemplify the software structure of the 3D display device 200. However, it is conceivable that the embodiments of this disclosure can be implemented in different software systems, such as operating systems.

[0114] Figure 6 This is a schematic diagram of the software structure of a 3D display device 200 according to an embodiment of the present disclosure. The layered architecture divides the software into several layers. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: application layer 510, framework layer 520, core class library and runtime 530, and kernel layer 540.

[0115] Application layer 510 may include a series of application packages. For example... Figure 6 As shown, the application package may include applications such as Bluetooth, WLAN, navigation, music, camera, calendar, calling, video, gallery, map, and SMS.

[0116] The framework layer 520 provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. For example... Figure 6 As shown, the framework layer 520 may include a resource manager, a phone manager, a content manager, a notification manager, a window manager, a view system installation package and manager, etc.

[0117] The Android Runtime consists of the core libraries and the virtual machine. The Android Runtime is responsible for the scheduling and management of the Android system. The core libraries consist of two parts: one part contains the functionalities that Java calls, and the other part comprises the Android core libraries.

[0118] The application layer and framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0119] The core library can include multiple functional modules. For example: 3D graphics processing library (e.g., OpenGL ES), surface manager, image processing library, media library, and graphics engine (e.g., SGL).

[0120] Kernel layer 540 is the layer between hardware and software. The kernel layer includes at least camera drivers, audio / video interfaces, voice interfaces, Wi-Fi interfaces, sensor drivers, power management, and GPS interfaces.

[0121] See below. Figure 7 This description pertains to the transmission and display of 3D video signals within a 3D display device according to embodiments of the present disclosure. As described above, the 3D display device corresponds to multiple viewpoints in different postures. The user's eyes, at the viewpoint (spatial location) corresponding to each posture, can see the display of corresponding sub-pixels within the composite sub-pixels of each composite pixel in the display panel. The two different images seen by the user's two eyes at different viewpoints create parallax, which is then synthesized into a 3D image in the brain.

[0122] In some embodiments of this disclosure, the 3D processing device 130 receives video frames, for example decompressed 3D video signals, from the processor 120 via a video signal interface 140, for example, as an internal interface. Each video frame may contain two images, or contain a composite image, or be composed of both.

[0123] In some embodiments, the two images or composite images may include images of different types and may be arranged in various ways.

[0124] like Figure 7 As shown, the video frame of the 3D video signal comprises two side-by-side images 601, 602, or images thereof. In some embodiments, the two images may be a left-eye parallax image and a right-eye parallax image, respectively. In some embodiments, the two images may be a rendered color image and a depth-of-field image, respectively.

[0125] In some embodiments, the video frames of the 3D video signal include interlaced composite images. In some embodiments, the composite image may be an interlaced left-eye and right-eye parallax composite image, or an interlaced rendered color and depth composite image.

[0126] In some embodiments, after receiving a video frame comprising two images 601 and 602, at least one 3D processing device 130 renders at least one sub-pixel of each composite sub-pixel based on one of the two images and renders at least another sub-pixel of each composite sub-pixel based on the other of the two images.

[0127] In other embodiments, upon receiving a video frame comprising a composite image, at least one 3D processing device renders at least two sub-pixels of each composite sub-pixel based on the composite image. For example, at least one sub-pixel is rendered based on a first image (part) of the composite image, and at least another sub-pixel is rendered based on a second image (part).

[0128] As described above, the 3D display device according to embodiments of this disclosure has multiple different postures and adapts to these postures to form different playback areas. In some embodiments, the 3D display device has a landscape display posture and a portrait display posture, and adapts to these two postures to define two playback areas. A posture detection device, such as a gravity sensor or gyroscope sensor, is configured to detect the posture of the 3D display device or a switching / change in posture. A 3D processing device is configured to process video frames of 3D signals, such as 3D video signals, to play 3D images from 3D content in a first posture playback area and to play 3D images from 3D content in a second posture playback area.

[0129] In some embodiments, the 3D display device 100 is provided with an eye-tracking device 150, which is configured to acquire eye-tracking data.

[0130] In some embodiments, the eye-tracking device is configured to communicate with the posture detection device to obtain the viewpoint position of the user's eyes in relation to the posture of the 3D display device.

[0131] In some embodiments, the eye-tracking device is configured to acquire the position of the user's eye at the first pose viewpoint in response to a signal that the 3D display device is in a first pose.

[0132] In some embodiments, the 3D processing apparatus is configured to render relevant sub-pixels in the i×j array of the same color sub-pixels of each composite sub-pixel within the first pose playback area based on the position of the user's eye at a first pose viewpoint.

[0133] In some embodiments, the relevant sub-pixels rendered within the first pose playback area may include all sub-pixels in the j-row of each composite sub-pixel that correspond to the first pose viewpoint of the user's eye.

[0134] See Figure 3A , Figure 3B and Figure 8AIn the illustrated embodiment, the 3D display device 100 may have first pose viewpoints Vi1-Vi6 corresponding to a first pose, and second pose viewpoints Vj1-Vj3 corresponding to a second pose. Each composite pixel in the display panel may include a red composite sub-pixel with an i×j array of red sub-pixels, a green composite sub-pixel with an i×j array of green sub-pixels, and a blue composite sub-pixel with an i×j array of blue sub-pixels. Among the i×j array sub-pixels of the same color in each composite sub-pixel, i = 6 corresponding to the first pose viewpoints Vi1-Vi6 of the first pose, and j = 3 corresponding to the second pose viewpoints Vj1-Vj3 of the second pose. For clarity, only the correspondence between a red composite sub-pixel 410 with i = 6 and j = 3 and the first pose viewpoints Vi1-Vi6 and the second pose viewpoints Vj1-Vj3 of the 3D display device 100 is shown in the figure.

[0135] When the 3D display device 100 is in a first posture or switching from a second posture to a first posture, the eye tracking device 150 detects the first posture viewpoint of the user's eyes, for example, the left eye is in the first posture viewpoint Vi2 and the right eye corresponds to the first posture viewpoint Vi4. Based on the video frames of the 3D video signal, it generates an image of the first posture viewpoint corresponding to the user's eyes, and renders all the red sub-pixels in the j-row of red sub-pixels in the first playback area 171 that correspond to the first posture viewpoint Vi2 and all the red sub-pixels in the j-row of red sub-pixels that correspond to the first posture viewpoint Vi4.

[0136] In some embodiments, the relevant sub-pixels rendered within the first pose playback area may include a sub-pixel in the j-row of sub-pixels corresponding to the first pose viewpoint of the user's eye. For example, the rendered sub-pixels may be a sub-pixel in the j-row corresponding to the first pose viewpoint of the user's left eye, and a sub-pixel in the j-row corresponding to the first pose viewpoint of the user's right eye.

[0137] In some embodiments, when the 3D display device is in a first pose, the eye-tracking device, in response to a signal indicating that the 3D display device is in the first pose, acquires the first pose viewpoint of the user's eye and also acquires the second pose viewpoint of the user's eye. The relevant sub-pixels rendered within the first pose playback area include a sub-pixel in the j-row of the i×j array of color sub-pixels in each composite sub-pixel array, corresponding to the intersection of the first pose viewpoint of the user's eye and the second pose viewpoint of the user in the i-row of sub-pixels.

[0138] See Figure 3A , Figure 3B and Figure 8B ,and Figure 8AThe difference in the illustrated embodiment is that, when the 3D display device 100 is in a first posture or switching from a second posture to a first posture, the eye-tracking device 150 detects the first posture viewpoint of the user's eyes, for example, the left eye corresponds to the first posture viewpoint Vi2 and the right eye corresponds to the first posture viewpoint Vi4. It also detects the second posture viewpoint of the user's eyes, for example, the left and right eyes correspond to the same second posture viewpoint Vj2. Based on the video frames of the 3D video signal, an image of the first posture viewpoint corresponding to the user's eyes is generated, and within the first playback area 171, the red sub-pixels in the j-row of red sub-pixels corresponding to the intersection of the first posture viewpoint Vi2 of the user's eyes and the red sub-pixels in the i-row corresponding to the second posture viewpoint Vj2 of the user's eyes, and the red sub-pixels in the j-row corresponding to the intersection of the first posture viewpoint Vi4 of the user's eyes and the red sub-pixels in the i-row corresponding to the second posture viewpoint Vj2 of the user's eyes are rendered.

[0139] In some embodiments, the eye-tracking device is configured to acquire the second pose viewpoint position of the user's eyes in response to a signal that the 3D display device is in a second pose.

[0140] In some embodiments, the 3D processing apparatus is configured to render relevant sub-pixels in the i×j array of the same color sub-pixels of each composite sub-pixel within the second pose playback area based on the position of the user's eye at the second pose viewpoint.

[0141] In some embodiments, the relevant sub-pixels rendered within the second pose playback area include all sub-pixels in the i-row of each composite sub-pixel that correspond to the second pose viewpoint where the user's eye is located.

[0142] See Figure 3A , Figure 3B and Figure 9A In the illustrated embodiment, the 3D display device 100 may have first pose viewpoints Vi1-Vi6 corresponding to a first pose, and second pose viewpoints Vj1-Vj3 corresponding to a second pose. Each composite pixel in the display panel may include a red composite sub-pixel with an i×j array of red sub-pixels, a green composite sub-pixel with an i×j array of green sub-pixels, and a blue composite sub-pixel with an i×j array of blue sub-pixels. Among the i×j array sub-pixels of the same color in each composite sub-pixel, i = 6 corresponding to the first pose viewpoints Vi1-Vi6 of the first pose, and j = 3 corresponding to the second pose viewpoints Vj1-Vj3 of the second pose. For clarity, only the correspondence between a red composite sub-pixel 410 with i = 6 and j = 3 and the first pose viewpoints Vi1-Vi6 and the second pose viewpoints Vj1-Vj3 of the 3D display device 100 is shown in the figure.

[0143] When the 3D display device 100 is in a second pose or switching from a first pose to a second pose, the eye-tracking device 150 detects the second pose viewpoints corresponding to the user's eyes, for example, the left eye corresponds to the second pose viewpoint Vj1 and the right eye corresponds to the second pose viewpoint Vj3. Based on the video frames of the 3D video signal, an image of the second pose viewpoints corresponding to the user's eyes is generated, and all red sub-pixels corresponding to viewpoint Vj1 and all red sub-pixels corresponding to viewpoint Vj3 in the i-th row of red sub-pixels in the second playback area 172 are rendered.

[0144] In some embodiments, the relevant sub-pixels rendered within the second pose playback area include a sub-pixel in the i-row of each composite sub-pixel that corresponds to the second pose viewpoint of the user's eye. For example, the rendered sub-pixel could be a sub-pixel in the i-row that corresponds to the second pose viewpoint of the user's left eye, or it could be a sub-pixel in the i-row that corresponds to the second pose viewpoint of the user's right eye.

[0145] In some embodiments, when the 3D display device is in a second pose, the eye-tracking device, in response to a signal indicating that the 3D display device is in a second pose, acquires the position of the user's eye at the second pose viewpoint and the position of the user's eye at the first pose viewpoint. The relevant sub-pixels rendered within the second pose playback area include a sub-pixel in the i×j array of the same color sub-pixels in each composite sub-pixel array, corresponding to the intersection of the second pose viewpoint of the user's eye and the first pose viewpoint of the user in the j-row of sub-pixels.

[0146] See Figure 3A , Figure 3B and Figure 9B In the illustrated embodiment, with Figure 9AThe difference in the illustrated embodiment is that, when the 3D display device 100 is in a second posture or switching from a first posture to a second posture, the eye-tracking device 150 detects the second posture viewpoints corresponding to the user's eyes, for example, the left eye corresponds to the second posture viewpoint Vj1 and the right eye corresponds to the second posture viewpoint Vj3, and detects the first posture viewpoints corresponding to the user's eyes, for example, the left and right eyes correspond to the same first posture viewpoint Vi3. Based on the video frames of the 3D video signal, an image of the second posture viewpoints corresponding to the user's eyes is generated, and within the second playback area 172, the red sub-pixels in the i-row corresponding to the intersection of the second posture viewpoint Vj1 where the user's eyes are located and the red sub-pixels in the j-row corresponding to the first posture viewpoint Vi3 where the user's eyes are located, as well as the red sub-pixels in the i-row corresponding to the intersection of the second posture viewpoint Vi3 where the user's eyes are located and the red sub-pixels in the j-row corresponding to the first posture viewpoint Vi3 where the user's eyes are located, are rendered.

[0147] In some embodiments, the 3D display device 100 further includes a format adjuster (not shown) configured to adjust the format of the 3D content, such as preprocessing video frames of a 3D video signal to adapt the 3D image to be played in a first pose playback area and a second pose playback area, respectively. For example, when the resolution of the 3D content is inconsistent with the display resolution of the first pose playback area or the second pose playback area, the format adjuster preprocesses the resolution of the 3D content to adapt it to the display resolution of the first pose playback area or the second pose playback area.

[0148] According to embodiments of this disclosure, a method for switching the display of 3D images in a 3D display device as described above is provided. The method for displaying 3D images in a 3D display device includes:

[0149] Detecting the pose of a 3D display device includes detecting the current pose of the 3D display device, or changes in the pose of the 3D display device, or both; and

[0150] Based on the posture of the 3D display device or changes in posture, the display orientation of the displayed 3D image is adjusted so that the 3D image remains in the initial display orientation before the posture of the 3D display device changes.

[0151] In some embodiments, such as Figure 10 As shown, methods for achieving 3D image display include:

[0152] S10, detects the attitude changes of the 3D display device; and

[0153] S20, when a change in the posture of the 3D display device is detected, the display orientation of the displayed 3D image is adjusted so that the 3D image remains in the initial display orientation before the change in the posture of the 3D display device.

[0154] In some embodiments, step S20 may include: when a change in the posture of the 3D display device is detected, adjusting the display of the 3D image so that the display orientation of the 3D image remains at the initial display orientation before the change in the posture of the 3D display device.

[0155] In some embodiments, the detection of attitude changes of the 3D display device can be performed by an attitude detection device, while the adjustment of the display of the 3D image to keep the display orientation of the 3D image at the initial display orientation before the attitude change of the 3D display device can be performed by a 3D processing device.

[0156] In some embodiments, detecting the attitude change of the 3D display device includes: detecting the rotational angular velocity of the 3D display device and determining the attitude change of the 3D display device based on the rotational angular velocity.

[0157] In some embodiments, adjusting the display orientation of a 3D image includes rotating the display orientation of the 3D image in the plane in which the 3D image is located, so that the 3D image remains in its initial display orientation before the 3D display device undergoes a change in posture.

[0158] In some embodiments, the posture of the 3D display device includes at least one of the following: landscape display posture, portrait display posture, and angled display posture.

[0159] In some embodiments, the first posture of the 3D display device before the posture change includes any one of the following: landscape display posture, portrait display posture, and angled display posture. The second posture of the 3D display device after the posture change includes any one of the following: landscape display posture, portrait display posture, and angled display posture, which is different from the first posture.

[0160] In some embodiments, adjusting the display orientation of a 3D image includes rotating the 3D image to maintain it in an initial display orientation corresponding to a first posture. This ensures that, regardless of how the user adjusts the posture of the 3D display device, the displayed orientation of the 3D image remains consistent.

[0161] In some embodiments, when either the first posture or the second posture is a tilted screen display posture, adjusting the display orientation of the 3D image further includes: displaying the 3D image in a full-screen display mode.

[0162] In some embodiments, adjusting the display orientation of a 3D image includes rotating the display orientation of the 3D image within the plane in which the 3D image is located, so that the 3D image remains within an initial display orientation range; wherein the initial display orientation range includes the initial display orientation. In this way, the display orientation of the displayed 3D image can be fine-tuned or adjusted according to the user's movement to adapt to the user's motion.

[0163] In some embodiments, the method for displaying a 3D image in a 3D display device further includes: adjusting the display orientation of the 3D image according to the user's viewing orientation, so that the display orientation of the 3D image is consistent with the user's viewing orientation. The user's viewing orientation may include any one of a horizontal viewing orientation, a vertical viewing orientation, or an oblique viewing orientation.

[0164] In some embodiments, eye tracking of the user can also be performed to determine the user's viewing orientation based on the obtained eye tracking data. This can be achieved, for example, through an eye tracking device.

[0165] In some embodiments, adjusting the display orientation of a 3D image includes: rendering composite pixels in a multi-viewpoint glasses-free 3D display of the 3D display device based on the adjusted (or, in other words, after the posture of the 3D display device has changed) display orientation of the 3D image. For example, based on the correspondence between the sub-pixels of each composite sub-pixel of each composite pixel in the multi-viewpoint glasses-free 3D display and the viewpoint after the posture change of the 3D display device, the sub-pixels corresponding to the viewpoint determined by human eye tracking data are rendered according to the 3D image to be displayed.

[0166] The aforementioned adjustments to the display orientation of the 3D image and the rendering of sub-pixels can be performed by a 3D processing device.

[0167] In some embodiments, a method for displaying 3D images includes:

[0168] Acquiring 3D signals; and

[0169] In response to changes in the posture of the 3D display device, switch the playback of 3D images from 3D content on the 3D display device.

[0170] In some embodiments, switching the playback of 3D images from 3D content in a 3D display device in response to a change in the device's posture includes: in response to a signal indicating that the 3D display device has changed to or is in a first posture, playing 3D images from 3D content within a first posture playback area defined by a multi-view naked-eye 3D display screen.

[0171] In some embodiments, switching the playback of 3D images from 3D content in a 3D display device in response to a change in the device's posture includes: in response to a signal indicating that the 3D display device has changed to or is in a second posture, playing 3D images from 3D content within a second posture playback area defined by a multi-view naked-eye 3D display screen.

[0172] In some embodiments, the first posture is the horizontal posture of the display device, and the second posture is the vertical posture of the display device.

[0173] In some embodiments, 3D content includes 3D video, such as video frames of a 3D video.

[0174] In some embodiments, the method for switching the display of 3D images in a 3D display device further includes: acquiring real-time eye-tracking data in relation to the posture of the 3D display device.

[0175] In some embodiments, acquiring real-time eye-tracking data in relation to the pose of the 3D display device includes: in response to a signal that the 3D display device is in a first pose, acquiring the position of the user's eye at the first pose viewpoint.

[0176] In some embodiments, playing a 3D image from 3D content within a first pose playback area defined by a multi-viewpoint naked-eye 3D display includes: rendering relevant sub-pixels in the i×j array of the same color sub-pixels of each composite sub-pixel within the first pose playback area based on the position of the user's eye at the first pose viewpoint.

[0177] In some embodiments, the relevant sub-pixels rendered within the first pose playback area include at least one sub-pixel in the j-row of sub-pixels in each composite sub-pixel that corresponds to the first pose viewpoint of the user's eye.

[0178] In some embodiments, acquiring real-time eye-tracking data in relation to the pose of the 3D display device includes: in response to a signal that the 3D display device is in a second pose, acquiring the second pose viewpoint position of the user's eyes.

[0179] In some embodiments, playing a 3D image from 3D content within a second pose playback area defined by a multi-viewpoint naked-eye 3D display includes: rendering relevant sub-pixels in the i×j array of the same color sub-pixels of each composite sub-pixel within the second pose playback area based on the position of the user's eye at the second pose viewpoint.

[0180] In some embodiments, the relevant sub-pixels rendered within the second pose playback area include at least one sub-pixel in the i-row of each composite sub-pixel that corresponds to the second pose viewpoint of the user's eye.

[0181] This disclosure provides a 3D display device 300, with reference to... Figure 11The 3D display device 300 includes a processor 320 and a memory 310. The 3D display device 300 may also include a communication interface 340 and a bus 330. The processor 320, communication interface 340, and memory 310 communicate with each other via the bus 330. The communication interface 340 can be configured to transmit information. The processor 320 can call logical instructions in the memory 310 to execute the method of switching the display of 3D images in the 3D display device described in the above embodiment. The logical instructions in the memory 310 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium.

[0182] The foregoing description and accompanying drawings fully illustrate embodiments of the present disclosure to enable those skilled in the art to practice them. Other embodiments may include structural, logical, electrical, procedural, and other changes. Individual components and functions are optional unless explicitly required, and the order of operation may vary. Parts and features of some embodiments may be included in or replace parts and features of other embodiments. The scope of the embodiments of this disclosure includes the entire scope of the claims and all available equivalents of the claims. The terminology used in this application is for descriptive purposes only and is not intended to limit the claims. When used in this application, the term "comprising" etc., means the presence of at least one of the stated features, but does not exclude the presence of other features.

[0183] The methods and products (including but not limited to devices and equipment) disclosed in the embodiments herein can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For instance, the division of units may be merely a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. In addition, the coupling or direct coupling or communication connection shown or discussed between each other may be through some interfaces, and the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms. Units described as separate components may or may not be physically separate, and components shown as units may not be physical units. Some or all of the units can be selected to implement this embodiment according to actual needs. Furthermore, the functional units in the embodiments of this disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0184] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than that shown in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. In the descriptions corresponding to the flowcharts and block diagrams in the accompanying drawings, the operations or steps corresponding to different blocks may also occur in a different order than disclosed in the description; sometimes there is no specific order between different operations or steps. For example, two consecutive operations or steps may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. Each block in a block diagram and / or flowchart, and combinations of blocks in a block diagram and / or flowchart, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

Claims

1. A method for displaying 3D images, characterized in that, include: Detecting pose changes of a 3D display device, wherein the 3D display device includes a multi-viewpoint glasses-free 3D display screen, the multi-viewpoint glasses-free 3D display screen includes multiple composite pixels and multiple spherical gratings, each of the multiple composite pixels includes multiple composite sub-pixels, the multiple spherical gratings cover the multiple composite sub-pixels one-to-one, each of the multiple composite sub-pixels includes multiple sub-pixels of the same color corresponding to multiple viewpoints, wherein the multiple sub-pixels in each composite sub-pixel are arranged in an i×j array; and When a change in the posture of the 3D display device is detected, the display orientation of the displayed 3D image is adjusted so that the 3D image remains in the initial display orientation before the change in posture of the 3D display device. The i×j array sub-pixels of each composite sub-pixel correspond to i viewpoints before the change in posture of the 3D display device; the i×j array sub-pixels of each composite sub-pixel correspond to j viewpoints after the change in posture of the 3D display device.

2. The method according to claim 1, characterized in that, Detecting pose changes in 3D display devices includes: The rotational angular velocity of the 3D display device is detected, and the attitude change of the 3D display device is determined based on the rotational angular velocity. Adjusting the display orientation of the 3D image includes: The display orientation of the 3D image is rotated within the plane of the 3D image to maintain the initial display orientation of the 3D image before the posture of the 3D display device changes.

3. The method according to claim 2, characterized in that, The posture of the 3D display device includes at least one of the following: Landscape display mode, portrait display mode, and angled display mode.

4. The method according to claim 3, characterized in that, The first posture of the 3D display device before the posture change includes any one of the following: horizontal screen display posture, vertical screen display posture, and diagonal screen display posture; The second posture of the 3D display device after the posture change includes any one of the following: landscape display posture, portrait display posture, and diagonal display posture, which is different from the first posture; Adjusting the display orientation of the 3D image includes rotating the 3D image so that it remains in an initial display orientation corresponding to the first pose.

5. The method according to claim 4, characterized in that, When either the first posture or the second posture is a tilted screen display posture, adjusting the display orientation of the 3D image further includes: The 3D image is displayed in full-screen mode.

6. The method according to claim 2, characterized in that, Adjusting the display orientation of the 3D image includes: Rotate the display orientation of the 3D image within the plane containing the 3D image to keep the 3D image within the initial display orientation range; The initial display orientation range includes the initial display orientation.

7. The method according to any one of claims 1 to 6, characterized in that, Also includes: The display orientation of the 3D image is adjusted according to the user's viewing orientation, so that the display orientation of the 3D image is consistent with the user's viewing orientation.

8. The method according to claim 7, characterized in that, The user's viewing orientation includes any one of the following: horizontal viewing orientation, vertical viewing orientation, and diagonal viewing orientation; The method further includes: performing eye tracking on the user and determining the user's viewing orientation based on the obtained eye tracking data.

9. The method according to any one of claims 1 to 6, characterized in that, Adjusting the display orientation of the 3D image includes: Based on the adjusted display orientation of the 3D image, the corresponding sub-pixels in the composite sub-pixels of the multi-view naked-eye 3D display screen are rendered.

10. The method according to claim 9, characterized in that, Rendering the corresponding sub-pixels in the composite sub-pixels of the multi-view naked-eye 3D display includes: Based on the viewpoint corresponding to the sub-pixel in each composite sub-pixel after the pose change of the 3D display device, render the sub-pixel in each composite sub-pixel that corresponds to the viewpoint.

11. A 3D display device, characterized in that, include: processor; and A memory that stores program instructions; The processor is configured to perform the method as described in any one of claims 1 to 10 when executing the program instructions.

12. A 3D display device, characterized in that, include: A multi-viewpoint naked-eye 3D display screen includes multiple composite pixels and multiple spherical gratings. Each composite pixel includes multiple composite sub-pixels. The multiple spherical gratings cover the multiple composite sub-pixels in a one-to-one correspondence. Each composite sub-pixel includes multiple sub-pixels of the same color corresponding to multiple viewpoints. The multiple sub-pixels in each composite sub-pixel are arranged in an i×j array. An attitude detection device is configured to detect attitude changes of the 3D display device; and A 3D processing apparatus is configured to adjust the display orientation of a displayed 3D image based on detected pose changes of the 3D display device, so that the 3D image remains in its initial display orientation before the pose change of the 3D display device, wherein the i×j array sub-pixels of each composite sub-pixel correspond to i viewpoints before the pose change of the 3D display device; and the i×j array sub-pixels of each composite sub-pixel correspond to j viewpoints after the pose change of the 3D display device.

13. The 3D display device according to claim 12, characterized in that, The attitude detection device is configured to detect the rotational angular velocity of the 3D display device and determine the attitude change of the 3D display device based on the rotational angular velocity. The 3D processing device is configured to rotate the display orientation of the 3D image in the plane where the 3D image is located, so that the 3D image remains in the initial display orientation before the 3D display device undergoes a posture change.

14. The 3D display device according to claim 13, characterized in that, The posture of the 3D display device includes at least one of the following: horizontal display posture, vertical display posture, and diagonal display posture.

15. The 3D display device according to claim 14, characterized in that, The first posture of the 3D display device before the posture change includes any one of the following: horizontal screen display posture, vertical screen display posture, and diagonal screen display posture; The second posture of the 3D display device after the posture change includes any one of the following: landscape display posture, portrait display posture, and diagonal display posture, which is different from the first posture; The 3D processing device is configured to rotate the 3D image so that the 3D image remains in an initial display orientation corresponding to the first pose.

16. The 3D display device according to claim 15, characterized in that, The 3D processing device is configured to display the 3D image in full-screen mode when either the first posture or the second posture is a tilted screen display posture.

17. The 3D display device according to claim 13, characterized in that, The 3D processing device is configured to rotate the display orientation of the 3D image in the plane where the 3D image is located, so that the 3D image remains within an initial display orientation range; wherein the initial display orientation range includes the initial display orientation.

18. The 3D display device according to any one of claims 12 to 17, characterized in that, The 3D processing device is configured to adjust the display orientation of the 3D image according to the user's viewing orientation, so that the display orientation of the 3D image is consistent with the user's viewing orientation.

19. The 3D display device according to claim 18, characterized in that, The user's viewing orientation includes any one of the following: horizontal viewing orientation, vertical viewing orientation, and diagonal viewing orientation; The 3D display device also includes an eye-tracking device or an eye-tracking data interface configured to acquire eye-tracking data. The 3D processing device is configured to determine the user's viewing orientation based on obtained eye-tracking data.

20. The 3D display device according to any one of claims 12 to 17, characterized in that, The 3D processing device is configured to render composite pixels in the multi-view naked-eye 3D display screen of the 3D display device based on the adjusted display orientation of the 3D image.

21. The 3D display device according to claim 20, characterized in that, The 3D processing device is configured to render the sub-pixels corresponding to the viewpoints in the composite sub-pixels included in the multi-viewpoint naked-eye 3D display screen based on the viewpoints corresponding to the sub-pixels in each composite sub-pixel after the pose change of the 3D display device.

Images