Multi-viewpoint naked-eye 3D display screen, naked-eye 3D display terminal
By splitting sub-pixels into composite sub-pixels and directly joining gratings in a multi-view naked-eye 3D display, the problems of reduced resolution and increased thickness are solved, and a high-resolution lightweight 3D display effect is achieved.
Patent Information
- Application Number
- CN201911231362.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-12-05
- Publication Date
- 2025-09-16
- Estimated Expiration
- 2039-12-05
AI Technical Summary
Existing multi-viewpoint naked-eye 3D display screens have problems in their construction, such as reduced resolution, increased rendering calculations, and increased panel thickness. This makes installation and transportation particularly inconvenient when used in large-size display panels.
A multi-viewpoint naked-eye 3D display design is adopted, which splits the sub-pixels on the display panel into composite sub-pixels, and directly bonds the grating to the display panel. The sub-pixel spacing is adjusted to meet the grating refractive index requirements, achieving thickness and weight reduction without a cushion layer.
Without increasing the thickness of the display panel, the same 3D display effect is achieved, the thickness and weight of the display are reduced, the resolution is improved, and the installation and transportation process is simplified.
Smart Images

Figure CN112925109B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of 3D imaging, for example, to a multi-viewpoint naked-eye 3D display screen and a naked-eye 3D display terminal. Background Art
[0002] 3D imaging is one of the hottest technologies in the video industry, driving the technological shift from flat-panel displays to 3D displays. 3D display technology, a key component of the 3D imaging industry, is primarily categorized into two types: glasses-based 3D display and naked-eye 3D display. Naked-eye 3D display technology allows users to directly view 3D images without wearing glasses. Compared to glasses-based 3D display, naked-eye 3D display is a flexible 3D display technology that reduces user constraints.
[0003] Glasses-free 3D displays are viewpoint-based, and multi-viewpoint glasses-free 3D displays have recently been proposed. This creates a sequence of parallax images (frames) at different locations in space, allowing a pair of 3D images with parallax relationships to appear in each eye, giving the user a 3D experience. For traditional multi-viewpoint glasses-free three-dimensional (3D) displays with, for example, N viewpoints, multiple independent pixels on the display panel are required to project the multiple viewpoints in space.
[0004] However, conventional naked-eye 3D display systems only use gratings on one or both sides of a 2D display panel to create a 3D display effect. The transmission and display of 3D images or videos are based on the 2D display panel itself. This leads to a dilemma: reduced resolution and a surge in rendering computations. This also increases the thickness of the display panel, especially for large-size displays. This increased thickness increases the overall mass of the panel, creating installation and transportation issues.
[0005] This background technology is only for the purpose of facilitating understanding of the relevant technology in this field and is not to be regarded as an admission of the prior art. Summary of the Invention
[0006] The following outlines some embodiments in order to provide a basic understanding of some aspects of the disclosed embodiments. It is not intended to identify key / critical elements or delineate the scope of the invention, but rather serves as a prelude to the detailed description that follows.
[0007] The embodiments of the present disclosure provide a multi-viewpoint naked-eye 3D display screen and a naked-eye 3D display terminal, which are intended to overcome or alleviate at least some of the problems mentioned above.
[0008] In some embodiments, a multi-viewpoint naked-eye 3D display screen is provided, comprising: a display panel comprising a plurality of composite pixels, each of the plurality of composite pixels comprising a plurality of composite sub-pixels, each of the plurality of composite sub-pixels comprising a plurality of sub-pixels corresponding to a plurality of viewpoints of the multi-viewpoint naked-eye 3D display screen; and a grating directly bonded to the display panel.
[0009] In some embodiments, the width p of each sub-pixel in the plurality of sub-pixels is constructed as follows: p≤(d×q) / (n×D), where d is the sum of the thicknesses of the display panel and the grating, q is the pupil distance reference distance, D is the preset viewing distance of the multi-viewpoint naked-eye 3D display screen, and n is the refractive index of the grating.
[0010] In some embodiments, 1.3≤n≤1.6.
[0011] In some embodiments, n=1.46.
[0012] In some embodiments, each composite sub-pixel includes a plurality of sub-pixels in a single row or column; or each composite sub-pixel includes a plurality of sub-pixels in an array.
[0013] In some embodiments, the plurality of composite sub-pixels include at least one of a red composite sub-pixel, a green composite sub-pixel, and a blue composite sub-pixel.
[0014] In some embodiments, the size of the multi-viewpoint naked-eye 3D display screen is greater than or equal to 43 inches.
[0015] In some embodiments, the size of the multi-viewpoint naked-eye 3D display screen is 55 inches, 60 inches, 80 inches, or 100 inches; or the multi-viewpoint naked-eye 3D display screen is a cinema screen.
[0016] In some embodiments, a width of each sub-pixel in the plurality of sub-pixels is less than 0.008 mm.
[0017] In some embodiments, a width of each sub-pixel in the plurality of sub-pixels is less than 0.0076 mm.
[0018] In some embodiments, the display panel includes: a first substrate; a second substrate spaced apart from the first substrate; a color filter attached to the surface of the first substrate facing the second substrate; a thin film transistor attached to the surface of the second substrate facing the first substrate; a polarizer attached to the surface of the second substrate facing away from the first substrate; and a liquid crystal layer disposed between the first substrate and the second substrate; wherein the grating is directly bonded to the surface of the first substrate facing away from the second substrate.
[0019] In some embodiments, the grating is attached to the display panel at an angle.
[0020] In some embodiments, the grating comprises a plurality of cylindrical prism gratings.
[0021] In some embodiments, a naked-eye 3D display terminal is provided, comprising the multi-viewpoint naked-eye 3D display screen as described above.
[0022] In some embodiments, the naked-eye 3D display terminal further includes a 3D processing device configured to render corresponding sub-pixels in a plurality of composite sub-pixels in the multi-view naked-eye 3D display screen based on the 3D signal.
[0023] In some embodiments, the 3D processing device is further configured to perform shift rendering on the sub-pixels in the composite sub-pixel according to the viewpoint position corresponding to the currently rendered sub-pixel and the viewpoint position corresponding to the next rendered sub-pixel.
[0024] In some embodiments, the naked-eye 3D display terminal further includes a memory configured to store a correspondence between sub-pixels and viewpoints; wherein the 3D processing device is configured to obtain the correspondence.
[0025] In some embodiments, the naked-eye 3D display terminal further includes an eye tracking data acquisition device configured to acquire eye tracking data of the user.
[0026] The multi-viewpoint naked-eye 3D display screen and the naked-eye 3D display terminal disclosed in the present invention can directly combine the grating on the display panel, effectively reducing the thickness and weight of the multi-viewpoint naked-eye 3D display screen and the naked-eye 3D display terminal.
[0027] The above general description and the following description are exemplary and explanatory only and are not intended to limit the present application. BRIEF DESCRIPTION OF THE DRAWINGS
[0028] One or more embodiments are exemplarily described by corresponding drawings. These exemplary descriptions and drawings do not limit the embodiments. Elements with the same reference numerals in the drawings are shown as similar elements. The drawings do not constitute a scale limitation. In addition,
[0029] Figures 1A to 1D is a structural schematic diagram of a multi-viewpoint naked-eye 3D display screen and a naked-eye 3D display terminal according to an embodiment of the present disclosure;
[0030] Figure 2 is a schematic diagram of the hardware structure of a naked-eye 3D display terminal according to an embodiment of the present disclosure;
[0031] Figure 3 is a schematic diagram of the software structure of the naked-eye 3D display terminal according to an embodiment of the present disclosure;
[0032] Figures 4A to 4C is a schematic diagram of a composite pixel according to an embodiment of the present disclosure;
[0033] Figures 5A to 5E is a schematic diagram of the format and content of images contained in a video frame of a 3D video signal according to an embodiment of the present disclosure;
[0034] Figure 6 is a schematic diagram of providing at least two 3D processing devices according to an embodiment of the present disclosure;
[0035] Figure 7A is a schematic diagram of 3D optical imaging of a multi-view naked-eye 3D display screen according to an embodiment of the present disclosure;
[0036] Figure 7B Schematic diagram of the optical path of the lens area of a multi-viewpoint naked-eye 3D display screen according to an embodiment of the present disclosure;
[0037] Figure 8 is a structural schematic diagram of a multi-view naked-eye 3D display screen according to an embodiment of the present disclosure;
[0038] Figure 9A and 9B is a schematic diagram of pixel splitting of a multi-view naked-eye 3D display screen according to an embodiment of the present disclosure;
[0039] Figure 10 3D is a structural diagram of a multi-view naked-eye 3D display screen according to an embodiment of the present disclosure.
[0040] Reference numerals:
[0041] 100: Multi-viewpoint naked-eye 3D display screen; CP: Composite pixel; CSP: Composite sub-pixel; P: Sub-pixel; 1000: Naked-eye 3D display terminal; 101: Processor; 122: Register; 130: 3D processing device; 131: Buffer; 140: Video signal interface; 150: Eye tracking device; 160: Eye tracking data interface; 200: Naked-eye 3D display terminal; 201: Processor; 202: External memory interface; 203: Memory; 204: USB interface; 205: Charging management module; 206: Power management module; 207: Battery; 208: Mobile communication module; 209: Antenna ; 210: Wireless communication module; 211: Antenna; 212: Audio module; 213: Speaker; 214: Receiver; 215: Microphone; 216: Headphone jack; 217: Button; 218: Motor; 219: Indicator; 220: SIM card interface; 221: Camera unit; 222: Register; 223: GPU; 224: Codec; 230: Sensor module; 2301: Proximity light sensor; 2302: Ambient light sensor; 2303: Pressure sensor; 2304: Air pressure sensor; 2305: Magnetic sensor; 2306: Gravity sensor; 2307: Gyroscope sensor; 230 8: Accelerometer; 2309: Distance sensor; 2310: Temperature sensor; 2311: Fingerprint sensor; 2312: Touch sensor; 2313: Bone conduction sensor; 310: Application layer; 320: Framework layer; 330: Core class library and runtime; 340: Kernel layer; 400: Composite pixel; 410, 420, 430, 440, 450, 460, 470, 480, 490: Composite sub-pixel; 411, 421, 431, 441, 451, 461, 471, 481, 491: Sub-pixel; 501, 502: Two images in parallel format Image; 503, 504: two images in top-bottom format; 505: a composite image in left-right interlaced format; 506: a composite image in top-bottom interlaced format; 507: a composite image in checkerboard format; D: the distance between the display surface and the human eye; d: the thickness of the display; q: the distance between the two eyes; p: the distance between adjacent pixels; n': the refractive index in air; n: the refractive index of the grating; θ1: the angle between the outgoing light of the lens and the normal; θ2: the angle between the incident light of the lens and the normal; 800: a multi-viewpoint naked-eye 3D display; 810: the display panel; 820: the grating; 811: the display TFT layer; 812: the polarizer. DETAILED DESCRIPTION
[0042] In order to enable a more detailed understanding of the features and technical contents of the embodiments of the present disclosure, the implementation of the embodiments of the present disclosure is described in detail below with reference to the accompanying drawings. The accompanying drawings are for reference only and are not intended to limit the embodiments of the present disclosure.
[0043] In this article, "naked-eye three-dimensional (or 3D) display" refers to a technology that enables a user to observe 3D images on a display without wearing glasses for 3D display.
[0044] In this article, "multi-viewpoint" has the conventional meaning in this field, which means that different images displayed by different pixels or sub-pixels of the display screen can be viewed at different positions (viewpoints) in space. In this article, multi-viewpoint will mean at least 3 viewpoints.
[0045] In this document, "grating" has a broad interpretation in the art, including but not limited to "parallax barrier" gratings and "lens" gratings, such as "lenticular lens" gratings.
[0046] Herein, "lens" or "lens grating" has the conventional meaning in the art, including, for example, cylindrical lenses and spherical lenses.
[0047] Conventionally, a “pixel” refers to the smallest display unit in terms of resolution of a 2D display or when displayed as a 2D display.
[0048] However, in some embodiments of this document, when multi-viewpoint technology is applied to the field of naked-eye 3D display, the so-called "composite pixel" refers to the smallest display unit when the naked-eye 3D display device provides multi-viewpoint display, but it does not exclude that a single composite pixel used for multi-viewpoint technology may include or appear as multiple 2D display pixels. In this document, unless specifically stated as a composite pixel or 3D pixel for "3D display" or "multi-viewpoint" application, the pixel will refer to the smallest display unit for 2D display. Similarly, when described as a "composite sub-pixel" for a multi-viewpoint naked-eye 3D display, it will refer to a composite sub-pixel of a single color presented in a composite pixel when the naked-eye 3D display device provides multi-viewpoint display. In this document, the sub-pixel in the "composite sub-pixel" will refer to the smallest display unit of a single color, which is often corresponding to the viewpoint.
[0049] like Figure 7A The figure shows the optical path diagram of the imaging of the multi-view naked-eye 3D display screen. If the audience watches the 3D content at a distance D from the screen, the required thickness d of the multi-view naked-eye 3D display screen can be calculated based on the geometric relationship of the light. For any ray emitted from the display screen, let θ1( Figure 7B The parameters in the figure are expressed as follows: D is the distance between the display surface and the human eye, d is the display thickness, q is the distance between the human eyes, p is the distance between adjacent pixels, n' is the refractive index of air, and n is the refractive index of the grating.
[0050] like Figure 7BThis is a schematic diagram of the magnification of light at the lens. Light emitted by a multi-view naked-eye 3D display passes through any point of the convex lens, enters the air, and ultimately enters the user's eyes. The angle between the incident light and the normal line of the lens is θ2, and the angle between the outgoing light and the normal line of the lens is θ1. According to the definition of refractive index:
[0051]
[0052] Since the angle between the incident and normal light is small, so:
[0053]
[0054] According to formulas ① and ②, we have so
[0055]
[0056] exist Figure 7A middle,
[0057] According to ③, we have the following equation:
[0058]
[0059] Generally speaking, a 55-inch display has a diagonal length of 55 inches, or 1397mm. The typical aspect ratio is 16:9, resulting in a length of 1218mm and a width of 685mm. A 4K display has 3840x2160 pixels. The dimensions of each pixel are 1218 / 3840 = 0.317mm in length and 685 / 2160 = 0.317mm in width. Therefore, the width of a display pixel is approximately 0.317mm. Further splitting the RGB color space (standard RGB arrangement), the sub-pixel width is 0.106mm, p = 0.106mm (the sub-pixel pitch of a 55-inch 4K resolution display), D = 5m (the comfortable viewing distance for 3D effects on a 55-inch display), and q = 0.062m (the average distance between the pupils of an Asian eye).
[0060] According to ④,
[0061] Figure 8The structure of a multi-view naked-eye 3D display screen 800 is shown, including a display panel 810 and a grating 820. The display panel 810 includes a display TFT layer 811 and a polarizer 812. The thickness of the display TFT layer 811 is 0.5mm, the thickness of the polarizer 812 is 0.1mm, and the thickness of the grating 820 is 0.3mm, for a total thickness of 0.9mm. This is 11.5mm short of the required thickness of 12.4mm for a comfortable display effect. Generally, a supplementary cushioning layer (spacer glass) is required between the display panel and the grating. However, currently mainstream TV screens are larger than 50 or 55 inches, and the process of attaching large-sized glass to the display screen is extremely difficult, resulting in a relatively heavy display screen. This significantly increases the thickness of the display screen, taking up installation space. The increased weight also requires the display screen and its mounting structure to be thickened accordingly, or requires a separate design of the corresponding mounting structure, resulting in inconvenience and production problems with multiple specifications.
[0062] The embodiments of the present disclosure provide a new pixel structure design, which is equivalent to splitting the existing TFT pixel into multiple TFT pixels. It can achieve the same 3D display effect at a given distance without increasing the thickness of the display panel or display screen.
[0063] According to ④,
[0064] Without changing the thickness of the display, d = 0.9 mm. Other values remain unchanged: D = 5 m, q = 0.062 m, and n = 1.46. Substitute this into equation ⑥ to find the value of p after the change, which we will set as p'.
[0065]
[0066] According to the calculation results of ⑦, when the sub-pixel pitch of the multi-view naked-eye 3D display is split from the original 0.106.4mm to pixels of about 0.0076mm, the thickness of the display does not need to be artificially increased to achieve the same 3D display effect.
[0067] After the above pixel splitting, the multi-view naked-eye 3D display screen can achieve the same 3D display effect at a predetermined distance between the display panel and the grating without adding an additional cushion layer.
[0068] The way to split TFT pixels is as follows Figure 9A 、 Figure 9B As shown, a multi-view 3D display effect can be achieved by independently controlling the left and right views.
[0069] The first pixel splitting method is as follows Figure 9AAs shown in Figure 2. Every two adjacent pixels form a group, and each group contains the left and right views. Pixels marked with L represent the left view, and pixels marked with R represent the right view.
[0070] The second pixel splitting method is as follows Figure 9B As shown, every N pixels form a group, for example, N is 5. Pixels marked with the same number in the figure display the left view or the right view simultaneously or in time-sharing mode to achieve 3D display.
[0071] The introduction of the above embodiments comparatively illustrates how the spacing between sub-pixels affects the thickness of the display screen. In the actual application of the naked-eye 3D display screen, the spacing between sub-pixels can be guaranteed, which can ensure the thickness of the display terminal and the display screen, and no additional cushioning layer is added. At the same time, since the number of sub-pixels is doubled after splitting, the 3D display screen can have a doubled display resolution relative to the 2D display screen of the same size. For example, if the display resolution of a 2D display screen of the same size is M1×N1, then the display resolution of a 3D display screen of the same size is INT(T / i)×M1×N1, where INT is a rounding function, T is the multiple of splitting, for example, 14, and i is the number of viewpoints, for example, 2, 5, or 7.
[0072] In some embodiments of the present disclosure, Figure 10 、 1A As shown in Figure 1C, a multi-viewpoint glasses-free 3D display screen 100 is provided, including a display panel 110 and a grating 120 disposed on the display panel 110. The display panel 110 is provided with m×n composite pixels CP, thereby defining an m×n display resolution. The composite pixels CP include multiple rows of composite sub-pixels CSP, each row of composite sub-pixels CSP consisting of i sub-pixels P corresponding to i viewpoints, where i ≥ 3. The sub-pixels in each row of composite sub-pixels CSP can be set to the same color. The size of the multi-viewpoint glasses-free 3D display screen in this embodiment is the same as that of a 2D display screen of the same size and display resolution. Therefore, the spacing between sub-pixels P in the composite pixels CP in this embodiment is smaller than the spacing between sub-pixels in a 2D display screen of the same display resolution. For example, in the aforementioned embodiment of pixel splitting on a 55-inch display screen, compared to a 2D 55-inch display screen that achieves a 4k resolution, the spacing between sub-pixels P in this embodiment is 0.0076 mm, which is approximately 14 times smaller, achieving a pad-free effect. The display screen disclosed in the present invention can be particularly used in scenarios with large-size display screens, such as display screens larger than 50 inches, and can effectively reduce weight.
[0073] In the embodiment of the present disclosure, the grating may be directly bonded to the display panel.
[0074] According to the above embodiments, it can be seen that adjusting the spacing between sub-pixels can adjust the thickness of the padding layer until the padding layer is removed. Furthermore, the spacing between sub-pixels P is configured so that the grating 120 is directly attached to the display panel 110 .
[0075] In some embodiments, the spacing p between sub-pixels P satisfies the following relationship: p ≤ (d × q) / (n × D), where d is the sum of the thicknesses of the display panel and the grating, q is the average distance between the pupils of both eyes, D is the predetermined viewing distance of the multi-view naked-eye 3D display, and n is the refractive index of the grating. For example, 1.3 ≤ n ≤ 1.6, and n = 1.46 in some display structure and material settings. In the disclosed embodiments, setting the sub-pixel width as described above allows the grating to be directly integrated with the display panel, achieving a zero-pad height, thereby achieving a pad-free effect.
[0076] In some embodiments, the width of the sub-pixels in each composite sub-pixel is less than 0.008 mm, or less than 0.0076 mm.
[0077] In some embodiments, each composite sub-pixel includes a single row or column of sub-pixels.
[0078] In some embodiments, each composite sub-pixel includes a plurality of sub-pixels in an array.
[0079] In some embodiments, the plurality of composite sub-pixels include a red composite sub-pixel, a green composite sub-pixel, and a blue composite sub-pixel.
[0080] In some embodiments, the size of the multi-viewpoint naked-eye 3D display screen is greater than or equal to 43 inches, for example, 50 inches, 55 inches, 60 inches, 80 inches, 100 inches, 110 inches, etc.
[0081] In some embodiments, the multi-view naked-eye 3D display is a Micro-LED display. The TFT layer includes both the driving circuit and the light-emitting circuit of the Micro-LED.
[0082] In some embodiments of the present disclosure, the width of the grating grid is set based on the overall pixel width of the composite pixel CP. Generally, to meet the requirement of no padding, the spacing between sub-pixels is known after calculation, and the width of the grating grid can be determined based on the number of sub-pixels in the composite sub-pixel. For example, if there are i sub-pixels in the composite sub-pixel, the width of the grating grid is i×p.
[0083] In an embodiment of the present disclosure, the display panel 110 may be a liquid crystal panel. Specifically, the display panel 110 includes: a pair of spaced-apart substrates; a color filter attached to the surface of the first substrate of the pair of substrates facing the second substrate; a thin film transistor attached to the surface of the second substrate facing the first substrate; another polarizer attached to the surface of the second substrate facing away from the first substrate; and a liquid crystal layer arranged between the pair of substrates; wherein the grating 120 is directly bonded to the surface of the first substrate facing away from the second substrate.
[0084] In the embodiment of the present disclosure, a plurality of cylindrical prism gratings in the grating 120 are arranged in parallel and tiltedly bonded to the display panel to prevent the generation of moiré patterns.
[0085] According to the above-mentioned embodiments of the present disclosure, the present disclosure also relates to a naked-eye 3D display screen of the same size as a 2D display screen, in which the sub-pixel area on the original 2D display screen is split into one, two or more composite pixels to achieve a pad-free display. For example, in the above-mentioned 55-inch split pixel embodiment, the original sub-pixel is split into 14 sub-pixels. For the case of 2 viewpoints, 7 composite pixels can be used to display a pixel point on the original 2D display screen. If the same resolution needs to be guaranteed, the sub-pixels corresponding to viewpoint i in the 7 composite pixels display the same color brightness; if the resolution needs to be doubled, the sub-pixels corresponding to viewpoint i in the 7 composite pixels can be arranged to display different color brightnesses, and the specific color brightness can be calculated and obtained through the color brightness of the surrounding pixels. If the viewpoint is 5, since it cannot be divided evenly, the 14 sub-pixels are distributed to 2 composite pixels, and the viewpoint number of each composite pixel is 7, that is, each composite sub-pixel has 7 sub-pixels, and the excess sub-pixels can be controlled not to be displayed, or to display non-interfering color brightness. Correspondingly, the grating grid may not cover the non-displayed sub-pixels. At this time, if the same resolution display is required, the sub-pixels corresponding to the viewpoint i in the two composite pixels can be displayed with the same color brightness. If the resolution needs to be multiplied, the color brightness of the two sub-pixels can be set according to the color brightness of the surrounding sub-pixels.
[0086] In some embodiments of the present disclosure, a glasses-free 3D display terminal 1000 is provided, comprising: a multi-viewpoint glasses-free 3D display screen 100, comprising m×n composite pixels CP and thus defining an m×n display resolution; a video signal interface 140 for receiving a video frame of a 3D video signal, wherein the video frame of the 3D video signal comprises two images having an m×n resolution or a composite image having a 2m×n or m×2n resolution; and at least one 3D processing device 130. The glasses-free 3D display terminal 1000 in the present disclosure may be a glasses-free 3D display terminal or a glasses-free 3D display device.
[0087] In some embodiments, each composite pixel CP includes a plurality of composite sub-pixels CSP, each composite sub-pixel being composed of i same-color sub-pixels corresponding to i viewpoints, where i≧3.
[0088] In some embodiments, at least one 3D processing device 130 is configured to render at least one subpixel in each composite subpixel based on one of the two images and to render at least another subpixel in each composite subpixel based on the other of the two images.
[0089] In some further embodiments, the at least one 3D processing device 130 is configured to render at least two sub-pixels in each composite sub-pixel based on the composite image.
[0090] In some embodiments, the 3D processing device 130 is configured to render sub-pixels corresponding to the viewpoint in the composite pixel based on the 3D image signal.
[0091] Figure 1A A schematic diagram of a multi-view naked-eye 3D display screen according to an embodiment of the present disclosure is shown. Figure 1B FIG2 shows a schematic structural diagram of a naked-eye 3D display terminal 1000 provided by an embodiment of the present disclosure. Figure 1A and Figure 1B In one embodiment of the present disclosure, a naked-eye 3D display terminal 1000 is provided, which may include a multi-viewpoint naked-eye 3D display screen 100, at least one 3D processing device 130 and a video signal interface 140 for receiving video frames of a 3D video signal.
[0092] exist Figure 1A and Figure 1B In the embodiment shown, the multi-view naked-eye 3D display screen 100 may include m×n composite pixels and thus define a display resolution of m×n. Figure 1A and Figure 1B As shown, the multi-viewpoint naked-eye 3D display screen 100 includes m columns and n rows of composite pixels CP and thus defines a display resolution of m×n.
[0093] In some embodiments, each composite pixel CP includes a plurality of composite sub-pixels, each composite sub-pixel being composed of i sub-pixels of the same color corresponding to i viewpoints, where i≥2. Figure 1A In the embodiment shown, i=6, but it is conceivable that i can be other values. In the embodiment shown, the multi-view naked-eye 3D display screen can have i (i=6) viewpoints (V1-V6) accordingly, but it is conceivable that it can have more or fewer viewpoints accordingly.
[0094] Combined with reference Figure 1A and Figure 4AIn the illustrated embodiment, each composite pixel includes three composite sub-pixels, each composed of six sub-pixels of the same color corresponding to six viewpoints (i=6). The three composite sub-pixels correspond to three colors, namely red (R), green (G), and blue (B). In other words, the three composite sub-pixels of each composite pixel have six red, six green, or six blue sub-pixels, respectively.
[0095] exist Figure 1A and Figure 4A In the illustrated embodiment, composite sub-pixels 410, 420, and 430 are arranged in parallel within a composite pixel 400. Each composite sub-pixel 410, 420, and 430 includes sub-pixels 411, 421, and 431 arranged in a single row. However, different arrangements of composite sub-pixels within a composite pixel or different arrangements of sub-pixels within a composite sub-pixel are contemplated.
[0096] like Figure 4B As shown, each composite sub-pixel 440, 450, 460 includes sub-pixels 441, 451, 461 in a single column.
[0097] like Figure 4C As shown, the three composite sub-pixels 470, 480, and 490 in the composite pixel 400 are arranged in a "pin" shape, for example. Figure 4C In the embodiment shown, the sub-pixels 471 , 481 , 491 in each composite sub-pixel 470 , 480 , 490 may be in an array (3×2).
[0098] In some embodiments, for example Figures 1A-1C As shown, the naked-eye 3D display terminal 1000 may be provided with a single 3D processing device 130. The single 3D processing device 130 simultaneously processes the rendering of each composite sub-pixel of each composite pixel of the large-size naked-eye 3D display screen 100.
[0099] In other embodiments, for example Figure 6 As shown, the naked-eye 3D display terminal 1000 may be provided with at least two 3D processing devices 130 , which process the rendering of each composite sub-pixel of each composite pixel of the large-size naked-eye 3D display screen 100 in parallel, serially, or in combination of serial and parallel.
[0100] Those skilled in the art will appreciate that the at least two 3D processing devices may be allocated in other ways and process multiple rows and columns of composite pixels or composite sub-pixels of the large-size naked-eye 3D display screen 100 in parallel, which falls within the scope of the present invention.
[0101] In some embodiments, the at least one 3D processing device 130 may further optionally include a buffer 131 to buffer received video frames.
[0102] In some embodiments, at least one 3D processing device is an FPGA or ASIC chip or an FPGA or ASIC chipset.
[0103] Continue to refer Figure 1A The naked-eye 3D display terminal 1000 may further include a processor 101 communicatively connected to at least one 3D processing device 130 via a video signal interface 140. In some embodiments described herein, the processor 101 is included in a computer or intelligent terminal, such as a mobile terminal, or serves as a processor unit thereof. However, it is contemplated that in some embodiments, the processor 101 may be disposed externally to the naked-eye 3D display terminal. For example, the naked-eye 3D display terminal may be a multi-viewpoint naked-eye 3D display screen with a 3D processing device, such as a non-intelligent naked-eye 3D television.
[0104] For simplicity, the exemplary embodiment of the naked eye 3D display terminal hereinafter includes a processor. Furthermore, the video signal interface 140 is constructed as an internal interface connecting the processor 101 and the 3D processing device 130, referring to FIG. Figure 2 and Figure 3 The naked-eye 3D display terminal 200 implemented in the form of a mobile terminal can further clarify the structure. In some embodiments of the present invention, the video signal interface 140 as the internal interface of the naked-eye 3D display terminal 200 can be a MIPI, mini-MIPI interface, LVDS interface, min-LVDS interface or Display Port interface. In some embodiments, such as Figure 1A As shown, the processor 101 of the naked-eye 3D display terminal 1000 may further include a register 122. The register 122 may be used to temporarily store instructions, data, and addresses.
[0105] In some embodiments, the naked-eye 3D display terminal 1000 may further include an eye tracking device or an eye tracking data interface for acquiring real-time eye tracking data, so that the 3D processing device 130 can render corresponding sub-pixels in a composite pixel (composite sub-pixel) based on the eye tracking data. Figure 1B In the embodiment shown, the naked eye 3D display terminal 1000 further includes an eye tracking device 150 that is communicatively connected to the 3D processing device 130, so that the 3D processing device 130 can directly receive eye tracking data. Figure 1C In the illustrated embodiment, an eye-tracking device (not shown) may be directly connected to the processor 101, and the 3D processing device 130 may obtain eye-tracking data from the processor 101 via the eye-tracking data interface 151. In other embodiments, the eye-tracking device may be connected to both the processor and the 3D processing device. This allows the 3D processing device 130 to obtain eye-tracking data directly from the eye-tracking device, while also allowing other information obtained by the eye-tracking device to be processed by the processor.
[0106] Combined with reference Figure 1A -C and Figure 5A -E, describes the transmission and display of 3D video signals within a naked-eye 3D display terminal according to some embodiments of the present disclosure. In the illustrated embodiment, the display screen 110 can define six viewpoints V1-V6. At each viewpoint (spatial location), the user's eyes can see the corresponding sub-pixels within the composite sub-pixels of each composite pixel in the display panel of the multi-view naked-eye 3D display screen 110. The two different images seen by the user's two eyes at different viewpoints form parallax, which is synthesized into a 3D image in the brain.
[0107] In some embodiments of the present disclosure, the 3D processing device 130 receives video frames, such as decompressed 3D video signals, from the processor 101 via the video signal interface 140, which serves as an internal interface. Each video frame may include or be composed of two images with an m×n resolution or a composite image with a 2m×n or m×2n resolution.
[0108] In some embodiments, the two images or the composite image may include different types of images and may be in various arrangements.
[0109] like Figure 5A As shown, a video frame of a 3D video signal includes or is composed of two images 501 and 502 in a side-by-side format with an m×n resolution. In some embodiments, the two images may be a left-eye parallax image and a right-eye parallax image, respectively. In some embodiments, the two images may be a rendered color image and a depth image, respectively.
[0110] like Figure 5B As shown, a video frame of a 3D video signal includes or is composed of two images 503 and 504 in a top-and-bottom format with an m×n resolution. In some embodiments, the two images may be a left-eye parallax image and a right-eye parallax image, respectively. In some embodiments, the two images may be a rendered color image and a depth image, respectively.
[0111] like Figure 5C As shown, the video frame of the 3D video signal includes a left-right interlaced composite image 505 with a resolution of 2m×n. In some embodiments, the composite image can be a left-right interlaced parallax composite image or a left-right interlaced rendered color and depth composite image.
[0112] like Figure 5D As shown, the video frame of the 3D video signal includes a composite image 506 with a resolution of m×2n in a top-bottom interlaced format. In some embodiments, the composite image can be a top-bottom interlaced left-eye and right-eye parallax composite image. In some embodiments, the composite image can be a top-bottom interlaced composite image with rendered color and depth of field.
[0113] like Figure 5E As shown, the video frame of the 3D video signal includes a checkerboard-format composite image 507 with a resolution of 2m×n. In some embodiments, the composite image may be a checkerboard-format composite image of left and right eye parallax. In some embodiments, the composite image may be a checkerboard-format rendered color image and a depth image.
[0114] Those skilled in the art will appreciate that the embodiments shown in the drawings are merely exemplary, and that the two images or composite images contained in the video frames of the 3D video signal may include other types of images and may be arranged in other forms, which fall within the scope of the present invention.
[0115] In some embodiments, the resolution of m×n may be a resolution higher than full high definition (FHD), including but not limited to 1920×1080, 1920×1200, 2048×1280, 2560×1440, 3840×2160, etc.
[0116] In some embodiments, upon receiving a video frame comprising two images, at least one 3D processing device 130 renders at least one sub-pixel in each composite sub-pixel based on one of the two images and at least another sub-pixel in each composite sub-pixel based on the other of the two images. Similarly, in some embodiments, upon receiving a video frame comprising a composite image, at least one 3D processing device renders at least two sub-pixels in each composite sub-pixel based on the composite image. For example, at least one sub-pixel may be rendered based on (a portion of) the first image in the composite image and at least another sub-pixel may be rendered based on (a portion of) the second image.
[0117] In some embodiments, this is dynamically rendered based on eye tracking data, for example.
[0118] By way of explanation and not limitation, since the video frame data received by the 3D processing device 130 in the embodiment of the present disclosure through the video signal interface 140, for example, which is constructed as an internal interface, contains two images, the resolution of each image (or half of the resolution of the composite image) corresponds to the composite pixel divided according to the viewpoint (which includes composite sub-pixels divided according to the viewpoint). On the one hand, since the viewpoint information is independent of the transmission process, this can achieve naked-eye 3D display with small processing calculation amount and no loss of resolution; on the other hand, since the composite pixel (composite sub-pixel) corresponds to the viewpoint setting, the rendering of the display screen can be achieved in a "point-to-point" manner, which greatly reduces the amount of calculation. In contrast, the transmission and display of images or videos on conventional naked-eye 3D display screens are still based on 2D display panels, which not only have the problems of reduced resolution and a sharp increase in rendering calculation amount, but may also have the problems of multiple format adjustments and image or video display adaptation.
[0119] In some embodiments, the register 122 of the processor 101 may be configured to receive information regarding the display requirements of the multi-view auto-glasses 3D display screen 110. This information is typically information that is independent of the number of viewpoints i and is related to the m×n resolution of the multi-view auto-glasses 3D display screen 110, so that the processor 101 can send video frames of a 3D video signal that meets the display requirements to the multi-view auto-glasses 3D display screen 110. This information may be, for example, a data packet used to initially establish video transmission.
[0120] Therefore, when transmitting video frames of a 3D video signal, the processor 101 does not need to consider information related to the i viewpoints (i ≥ 3) of the multi-view auto-glasses 3D display screen 110. Instead, the processor 101 can transmit video frames of a 3D video signal that meet the requirements of the multi-view auto-glasses 3D display screen 110 based on information related to the m×n resolution of the multi-view auto-glasses 3D display screen 100 received from the register 122.
[0121] In some embodiments, the 3D processing device 130 is further configured to perform shift rendering on the sub-pixels in the composite pixel according to the viewpoint position corresponding to the currently rendered sub-pixel and the next viewpoint position corresponding to the sub-pixel rendered in the next frame.
[0122] In some embodiments, the naked-eye 3D display terminal 1000 may further include a codec configured to decompress and encode / decode the compressed 3D video signal and send the decompressed 3D video signal to the at least one 3D processing device 130 via the video signal interface 140 .
[0123] In some embodiments, the processor 101 of the naked-eye 3D display terminal 1000 reads video frames of a 3D video signal from a memory or receives video frames from outside the naked-eye 3D display terminal 1000, for example, through an external interface, and then transmits the read or received video frames of the 3D video signal to at least one 3D processing device 130 via the video signal interface 140.
[0124] In some embodiments, the naked-eye 3D display terminal 1000 further includes a format adjuster (not shown), which is, for example, integrated in the processor 101 and constructed as a codec or as part of a GPU, for preprocessing the video frames of the 3D video signal so that the two images it contains have a resolution of m×n or the composite image it contains has a resolution of 2m×n or m×2n.
[0125] As previously mentioned, the naked-eye 3D display terminal provided in some embodiments of the present disclosure may be a naked-eye 3D display terminal including a processor. In some embodiments, the naked-eye 3D display terminal may be configured as a smart cellular phone, a tablet computer, a smart TV, a wearable device, an in-vehicle device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), etc.
[0126] In another embodiment, a naked-eye 3D display system is provided, including a processor unit and the above-mentioned naked-eye 3D display terminal, wherein the processor unit is communicatively connected to the naked-eye 3D display terminal.
[0127] In some embodiments, the naked-eye 3D display system is constructed as a smart TV with a processor unit; or, the naked-eye 3D display system is a smart cellular phone, tablet computer, personal computer or wearable device; or, the naked-eye 3D display system includes a set-top box or a cellular phone or tablet computer with screen projection as the processor unit and a digital TV as a naked-eye 3D display terminal connected to the set-top box, cellular phone or tablet computer by wire or wireless; or, the naked-eye 3D display system is constructed as a smart home system or a part thereof, wherein the processor unit includes a smart gateway or central controller of the smart home system, and the smart home system also includes an eye tracking device for obtaining eye tracking data; or, the naked-eye 3D display system is constructed as an entertainment interactive system or a part thereof.
[0128] For example, Figure 2 The hardware structure diagram of a naked-eye 3D display terminal 200 implemented as a large-scale mobile terminal is shown. The naked-eye 3D display terminal 200 may include a processor 201, an external storage interface 202, an (internal) memory 203, a universal serial bus (USB) interface 204, a charging management module 205, a power management module 206, a battery 207, a mobile communication module 208, a wireless communication module 210, antennas 209 and 211, an audio module 212, a speaker 213, a receiver 214, a microphone 215, an earphone interface 216, a button 217, a motor 218, an indicator 219, a subscriber identity module (SIM) card interface 220, a multi-view naked-eye 3D display screen 110, a 3D processing device 130, a video signal interface 140, a camera unit 221, an eye tracking device 150, and a sensor module 230. The sensor module 230 may include a proximity light sensor 2301, an ambient light sensor 2302, a pressure sensor 2303, an air pressure sensor 2304, a magnetic sensor 2305, a gravity sensor 2306, a gyroscope sensor 2307, an acceleration sensor 2308, a distance sensor 2309, a temperature sensor 2310, a fingerprint sensor 2311, a touch sensor 2312, a bone conduction sensor 2313, and the like.
[0129] It should be understood that the structures illustrated in the embodiments of the present disclosure do not constitute a specific limitation on the naked-eye 3D display terminal 200. In other embodiments of the present disclosure, the naked-eye 3D display terminal 200 may include more or fewer components than illustrated, or may combine or separate certain components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0130] The processor 201 may include one or more processing units. For example, the processor 201 may include an application processor (AP), a modem processor, a baseband processor, a graphics processing unit (GPU) 223, an image signal processor (ISP), a controller, a memory, a video codec 224, a digital signal processor (DSP), a baseband processor, a neural network processor (NPU), etc., or a combination thereof. The different processing units may be independent devices or integrated into one or more processors.
[0131] A cache may also be provided in the processor 201 for storing instructions or data that have just been used or circulated by the processor 201. If the processor 201 needs to use the instruction or data again, it can be directly called from the memory.
[0132] In some embodiments, the processor 201 may include one or more interfaces. The interfaces may include an Inter-Integrated Circuit (I2C) interface, an Inter-Integrated Circuit Sound (I2S) interface, a Pulse Code Modulation (PCM) interface, a Universal Asynchronous Receiver / Transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a General Purpose Input / Output (GPIO) interface, a Subscriber Identity Module (SIM) interface, a Universal Serial Bus (USB) interface, and the like.
[0133] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 201 may include multiple I2C bus interfaces. The processor 201 can communicate with the touch sensor 2312, the charger, the flash, the camera unit 221, the eye tracking device 150, and the like through different I2C bus interfaces.
[0134] Both I2S and PCM interfaces can be used for audio communication.
[0135] The UART interface is a universal serial data bus used for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is used to connect the processor 201 and the wireless communication module 210.
[0136] exist Figure 2In the embodiment shown, the MIPI interface can be used to connect the processor 201 and the multi-view naked-eye 3D display screen 110. In addition, the MIPI interface can also be used to connect peripheral devices such as the camera unit 221 and the eye tracking device 150.
[0137] The GPIO interface can be configured via software. The GPIO interface can be configured as either a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 201 to the camera unit 221, the multi-view naked-eye 3D display screen 110, the wireless communication module 210, the audio module 212, the sensor module 230, and the like.
[0138] The USB interface 204 is an interface that complies with USB standards and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. The USB interface 204 can be used to connect a charger to charge the naked-eye 3D display terminal 200, transfer data between the naked-eye 3D display terminal 200 and peripheral devices, and connect headphones to play audio.
[0139] It should be understood that the interface connection relationship between the modules illustrated in the embodiment of the present disclosure is only for illustrative purposes and does not constitute a structural limitation on the naked-eye 3D display terminal 200 .
[0140] The wireless communication function of the naked-eye 3D display terminal 200 can be implemented through the antennas 209 and 211, the mobile communication module 208, the wireless communication module 210, a modem processor or a baseband processor, etc.
[0141] Antennas 209 and 211 are used to transmit and receive electromagnetic wave signals. Each antenna in the naked-eye 3D display terminal 200 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
[0142] The mobile communication module 208 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the naked-eye 3D display terminal 200. The mobile communication module 208 may include at least one filter, a switch, a power amplifier, a low-noise amplifier (LNA), etc. The mobile communication module 208 can receive electromagnetic waves through the antenna 209, filter, amplify, and process the received electromagnetic waves, and transmit them to the modem processor for demodulation. The mobile communication module 208 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation through the antenna 209. In some embodiments, at least some of the functional modules of the mobile communication module 208 can be set in the processor 201. In some embodiments, at least some of the functional modules of the mobile communication module 208 can be set in the same device as at least some of the modules of the processor 201.
[0143] The wireless communication module 210 can provide wireless communication solutions including wireless local area network (WLAN), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication technology (NFC), infrared technology (IR), etc. applied to the naked eye 3D display terminal 200. The wireless communication module 210 can be one or more devices integrating at least one communication processing module. The wireless communication module 210 receives electromagnetic waves via the antenna 211, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 201. The wireless communication module 210 can also receive the signal to be transmitted from the processor 201, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 211.
[0144] In some embodiments, the antenna 209 of the naked-eye 3D display terminal 200 is coupled to the mobile communication module 208, and the antenna 211 is coupled to the wireless communication module 210, so that the naked-eye 3D display terminal 200 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. GNSS may include Global Positioning System (GPS), Global Navigation Satellite System (GLONASS), BeiDou Navigation Satellite System (BDS), Quasi-Zenith Satellite System (QZSS) and / or Satellite-Based Augmentation System (SBAS).
[0145] In some embodiments, the external interface for receiving 3D video signals may include USB interface 204, mobile communication module 208, wireless communication module 209, or a combination thereof. In addition, other feasible interfaces for receiving 3D video signals are also conceivable, such as the above-mentioned interfaces.
[0146] The memory 203 can be used to store computer executable program codes, and the executable program codes include instructions. The processor 201 executes various functional applications and data processing of the naked-eye 3D display terminal 200 by running the instructions stored in the memory 203. The memory 203 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the naked-eye 3D display terminal 200 (such as audio data, a phone book, etc.), etc. In addition, the memory 203 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash memory (UFS), etc.
[0147] The external memory interface 202 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the naked-eye 3D display terminal 200. The external memory card communicates with the processor 201 through the external memory interface 202 to implement data storage.
[0148] In some embodiments, the memory of the naked-eye 3D display terminal may include (internal) memory 203, an external memory card connected to the external memory interface 202, or a combination thereof. In other embodiments of the present disclosure, the video signal interface may also adopt different internal interface connection modes or a combination thereof in the above embodiments.
[0149] In an embodiment of the present disclosure, the camera unit 221 may capture images or videos.
[0150] In some embodiments, the naked-eye 3D display terminal 200 implements a display function through the video signal interface 140 , the 3D processing device 130 , the multi-viewpoint naked-eye 3D display screen 110 , and an application processor.
[0151] In some embodiments, the naked-eye 3D display terminal 200 may include a GPU, for example, in the processor 201 for processing 3D video images, and may also process 2D video images.
[0152] In some embodiments, the naked-eye 3D display terminal 200 further includes a video codec 224 for compressing or decompressing digital video.
[0153] In some embodiments, the video signal interface 140 is configured to output a 3D video signal, such as a video frame of a decompressed 3D video signal, processed by the GPU or the codec 224 or both, to the 3D processing device 130 .
[0154] In some embodiments, the GPU or codec 224 has an integrated formatter.
[0155] The multi-view naked-eye 3D display screen 110 is used to display 3D images or videos. The multi-view naked-eye 3D display screen 110 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a mini-LED, a micro-LED, a micro-OLED, a quantum dot light-emitting diode (QLED), etc.
[0156] In some embodiments, eye tracking device 150 is communicatively coupled to 3D processing unit 130 so that 3D processing unit 130 can render corresponding sub-pixels within a composite pixel (composite sub-pixel) based on eye tracking data. In some embodiments, eye tracking device 150 can also be coupled to processor 201, for example, bypassing processor 201.
[0157] The naked-eye 3D display terminal 200 can implement audio functions such as music playback and recording through an audio module 212, a speaker 213, a receiver 214, a microphone 215, a headphone jack 216, and an application processor. The audio module 212 is used to convert digital audio information into analog audio signal output and also to convert analog audio input into digital audio signals. The audio module 212 can also be used to encode and decode audio signals. In some embodiments, the audio module 212 can be located within the processor 201, or some functional modules of the audio module 212 can be located within the processor 201. The speaker 213 is used to convert audio electrical signals into sound signals. The naked-eye 3D display terminal 200 can listen to music or make hands-free calls through the speaker 213. The receiver 214, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the naked-eye 3D display terminal 200 receives a call or voice message, the user can hold the receiver 214 close to their ear to receive the voice. The microphone 215 is used to convert sound signals into electrical signals. The headphone jack 216 is used to connect a wired headphone and can be the USB interface 204 or a 3.5mm Open Mobile Glasses-Free 3D Display Terminal Platform (OMTP) standard interface or a Cellular Telecommunications Industry Association (CTIA) standard interface.
[0158] The buttons 217 include a power button, a volume button, and the like. The buttons 217 may be mechanical buttons or touch buttons. The naked-eye 3D display terminal 200 may receive button inputs and generate key signal inputs related to user settings and function control of the naked-eye 3D display terminal 200.
[0159] Motor 218 can generate vibration prompts. Motor 218 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback.
[0160] The SIM card interface 220 is used to connect a SIM card. In some embodiments, the naked-eye 3D display terminal 200 uses an eSIM, ie, an embedded SIM card.
[0161] The pressure sensor 2303 is used to sense the pressure signal and convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 2303 can be provided on the multi-view naked-eye 3D display screen 110, which falls within the scope of the present invention.
[0162] The air pressure sensor 2304 is used to measure air pressure. In some embodiments, the naked-eye 3D display terminal 200 calculates the altitude through the air pressure value measured by the air pressure sensor 2304 to assist in positioning and navigation.
[0163] The magnetic sensor 2305 includes a Hall sensor.
[0164] The gravity sensor 2306 is a sensor that converts motion or gravity into an electrical signal and is mainly used to measure parameters such as tilt angle, inertial force, impact and vibration.
[0165] The gyro sensor 2307 may be used to determine the motion posture of the naked-eye 3D display terminal 200 .
[0166] The acceleration sensor 2308 can detect the magnitude of the acceleration of the naked-eye 3D display terminal 200 in various directions (generally three axes).
[0167] Distance sensor 2309 can be used to measure distance
[0168] The temperature sensor 2310 can be used to detect temperature.
[0169] The fingerprint sensor 2311 is used to collect fingerprints. The naked-eye 3D display terminal 200 can use the collected fingerprint characteristics to realize fingerprint unlocking, access application locks, fingerprint photography, fingerprint answering calls, etc.
[0170] The touch sensor 2312 can be set in the multi-view naked-eye 3D display screen 110. The touch sensor 2312 and the multi-view naked-eye 3D display screen 110 form a touch screen, also called a "touch screen".
[0171] The bone conduction sensor 2313 can acquire vibration signals.
[0172] The charging management module 205 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 205 can receive charging input from the wired charger via the USB interface 204. In some wireless charging embodiments, the charging management module 205 can receive wireless charging input via the wireless charging coil of the naked-eye 3D display terminal 200.
[0173] The power management module 206 is used to connect the battery 207, the charging management module 205, and the processor 201. The power management module 206 receives input from the battery 207 and / or the charging management module 205 and provides power to the processor 201, the memory 203, the external memory, the multi-viewpoint naked-eye 3D display screen 110, the camera unit 221, and the wireless communication module 210. In other embodiments, the power management module 206 and the charging management module 205 may also be provided in the same device.
[0174] The software system of the naked-eye 3D display terminal 200 can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. The embodiments shown in this disclosure use the Android system with a layered architecture as an example to illustrate the software structure of the naked-eye 3D display terminal 200. However, it is conceivable that the embodiments of this disclosure can be implemented in different software systems, such as operating systems.
[0175] Figure 3 This is a schematic diagram of the software structure of the naked-eye 3D display terminal 200 according to an embodiment of the present disclosure. A layered architecture divides software into several layers. Layers communicate with each other via software interfaces. In some embodiments, the Android system is divided into four layers: application layer 310, framework layer 320, core class library and runtime 330, and kernel layer 340, from top to bottom.
[0176] The application layer 310 may include a series of application packages. Figure 3 As shown, the application package may include applications such as Bluetooth, WLAN, navigation, music, camera, calendar, call, video, gallery, map, short message, etc. The 3D video display method according to an embodiment of the present disclosure may be implemented in a video application, for example.
[0177] The framework layer 320 provides an application programming interface (API) and programming framework for applications in the application layer. The framework layer includes some predefined functions. For example, in some embodiments of the present disclosure, functions or algorithms for recognizing captured 3D video images and algorithms for processing images may be included in the framework layer.
[0178] like Figure 3 As shown, the framework layer 320 may include a resource manager, a phone manager, a content manager, a notification manager, a window manager, a view system, an installation package manager, and the like.
[0179] The Android Runtime consists of the core library and the virtual machine. The Android Runtime is responsible for scheduling and management of the Android system.
[0180] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.
[0181] The application and framework layers run in a virtual machine. The virtual machine executes Java files from the application and framework layers as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.
[0182] The core class library can include multiple functional modules, such as 3D graphics processing library (e.g. OpenGL ES), surface manager, image processing library, media library, graphics engine (e.g. SGL), etc.
[0183] The kernel layer 340 is a layer between hardware and software. The kernel layer includes at least camera driver, audio and video interface, call interface, Wi-Fi interface, sensor driver, power management, and GPS interface.
[0184] Here, with Figure 2 and Figure 3 The structure shown is taken as an example of a naked-eye 3D display terminal as a mobile terminal to describe an embodiment of 3D video transmission and display in the naked-eye 3D display terminal; however, it is conceivable that more or fewer features may be included or the features may be changed in other embodiments.
[0185] In some embodiments, a naked-eye 3D display terminal 200, such as a mobile terminal, such as a smart cell phone or tablet, receives, for example, a compressed 3D video signal from a network, such as a cellular network, a WLAN network, or Bluetooth, using, for example, a mobile communication module 208 and an antenna 209 or a wireless communication module 210 and an antenna 211 as an external interface. The compressed 3D video signal undergoes image processing, such as by a GPU 223, and is encoded, decoded, and decompressed by a codec 224. The decompressed 3D video signal is then sent to at least one 3D processing device 130, for example, via a video signal interface 140, such as a MIPI interface or a mini-MIPI interface, as an internal interface. The video frame of the decompressed 3D video signal includes two images or a composite image according to an embodiment of the present disclosure. Furthermore, the 3D processing device 130 renders the sub-pixels in the composite sub-pixels of the display screen accordingly, thereby achieving 3D video playback.
[0186] In other embodiments, the naked-eye 3D display terminal 200 reads the compressed 3D video signal stored in the (internal) memory 203 or the external memory card through the external memory interface 202, and realizes 3D video playback through corresponding processing, transmission and rendering.
[0187] In some embodiments, the playback of the 3D video is implemented in a video application in the Android system application layer 310 .
[0188] In some embodiments, the video frame of the 3D video signal includes a composite image with a resolution of 2m×n or m×2n, so that after the video frame of the 3D video signal is transmitted, at least two sub-pixels in each composite sub-pixel of each composite pixel of the multi-view naked-eye 3D display screen 110 are rendered based on the composite image.
[0189] In some embodiments, the naked-eye 3D display terminal 200 may include an eye tracking device or be capable of reading eye tracking data to obtain or read the user's real-time eye tracking data, thereby achieving dynamic rendering of the multi-view naked-eye 3D display screen 110 .
[0190] The devices, means, modules or units described in the above embodiments can be implemented by various possible entities. A typical implementation entity is a computer or its processor or other component. Specifically, the computer can be, for example, a personal computer, a laptop computer, a vehicle-mounted human-computer interaction device, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, a smart TV, an Internet of Things system, a smart home, an industrial computer, a single-chip computer system or a combination of these devices. In a typical configuration, the computer may include one or more processors (CPU), an input / output interface, a network interface and a memory. The memory may include non-permanent memory in a computer-readable medium, a random access memory (RAM) and / or a non-volatile memory in the form of a read-only memory (ROM) or a flash memory (flash RAM).
[0191] The methods, programs, devices, and apparatuses of the embodiments of the present invention may be executed or implemented in a single or multiple networked computers, or may be practiced in a distributed computing environment. In the embodiments of this specification, tasks are performed by remote processing devices connected via a communication network in these distributed computing environments.
[0192] Those skilled in the art will appreciate that the embodiments of this specification may be provided as methods, devices, or computer program products. Therefore, the embodiments of this specification may take the form of entirely hardware embodiments, entirely software embodiments, or embodiments combining software and hardware.
[0193] Those skilled in the art will appreciate that the functional modules / units or controllers and the related method steps described in the above embodiments can be implemented in software, hardware, or a combination of software / hardware. For example, they can be implemented in pure computer-readable program code, or part or all of the method steps can be logically programmed to enable the controller to implement the same functions in hardware, including but not limited to logic gates, switches, application-specific integrated circuits, programmable logic controllers (such as FPGAs), and embedded microcontrollers.
[0194] In some embodiments of the present invention, the components of the device are described in the form of functional modules / units. It is conceivable that multiple functional modules / units are implemented in one or more "combined" functional modules / units and / or one or more software and / or hardware. It is also conceivable that a single functional module / unit is implemented by a combination of multiple sub-functional modules or sub-units and / or multiple software and / or hardware. The division of functional modules / units can be only a logical functional division. In a specific implementation, multiple modules / units can be combined or integrated into another system. In addition, the connections of the modules, units, devices, systems and components thereof herein include direct or indirect connections, covering feasible electrical, mechanical, and communication connections, and especially including wired or wireless connections between various interfaces, including but not limited to HDMI, Thunderbolt, USB, WiFi, and cellular networks.
[0195] In the embodiments of the present invention, the technical features, flow charts, and / or block diagrams of the methods and programs can be applied to the corresponding devices, equipment, systems, and their modules, units, and components. Conversely, the various embodiments and features of the devices, equipment, systems, and their modules, units, and components can be applied to the methods and programs according to the embodiments of the present invention. For example, computer program instructions can be loaded into a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine that has the functions or features corresponding to one or more flow charts and / or one or more blocks in a block diagram.
[0196] The methods and programs according to embodiments of the present invention may be stored in the form of computer program instructions or programs in a computer-readable memory or medium capable of directing a computer or other programmable data processing device to operate in a specific manner. Embodiments of the present invention also relate to computer-readable memory or media storing the methods, programs, and instructions that can implement embodiments of the present invention.
[0197] Storage media include permanent and non-permanent, removable and non-removable items that can be used to store information using any method or technology. Information can be computer-readable instructions, data structures, program modules, or other data. Examples of storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device.
[0198] Unless explicitly stated, the actions or steps of the methods, procedures, and methods described in accordance with the embodiments of the present invention do not have to be performed in a specific order and can still achieve the desired results. In some implementations, multitasking and parallel processing are also possible or may be advantageous.
[0199] In this document, multiple embodiments of the present invention are described, but for the sake of brevity, the description of each embodiment is not exhaustive, and the same or similar features or parts between the embodiments may be omitted. In this document, "one embodiment", "some embodiments", "example", "specific example", or "some examples" are intended to apply to at least one embodiment or example of the present invention, not all embodiments. And the above terms do not necessarily mean to refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics of each embodiment can be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art can combine and combine the different embodiments or examples described in this specification and the features of different embodiments or examples, unless they are contradictory.
[0200] As used herein, the terms "comprises," "includes," or variations thereof are intended to be inclusive, not exhaustive, so that a process, method, product, or apparatus comprising a list of elements may include those elements without excluding other elements not expressly listed. For purposes of disclosure and unless otherwise specified, "a" or "an" means "one or more." To the extent that the terms "comprises" or "comprising" are used in this specification and claims, it will be non-exhaustive, somewhat similar to "comprising" in that those terms are explanatory when used as transitional conjunctions. Furthermore, to the extent that the term "or" is used (e.g., A or B), it will mean "A or B or both." When the applicant intends to indicate "only A or B but not both," "only A or B but not both" will be used. Therefore, the use of the term "or" is inclusive, not exclusive.
[0201] The exemplary systems and methods of the present invention have been specifically shown and described with reference to the above-described embodiments, which are merely examples of the best modes for implementing the present systems and methods. It will be understood by those skilled in the art that various changes may be made to the embodiments of the systems and methods described herein when implementing the present systems and / or methods without departing from the spirit and scope of the present invention as defined in the appended claims. The appended claims are intended to define the scope of the present systems and methods, and systems and methods falling within these claims and their equivalents are intended to be covered. The above description of the present systems and methods should be understood to include all new and non-obvious combinations of elements described herein, and claims may be present in this or subsequent applications relating to any new and non-obvious combination of elements. In addition, the above-described embodiments are exemplary, and no single feature or element is essential to all possible combinations that may be claimed in this or subsequent applications.
Claims
1. A multi-view naked-eye 3D display screen, characterized in that: include A display panel and a grating directly bonded to the display panel, the display panel including a plurality of composite pixels, each of the plurality of composite pixels including a plurality of composite sub-pixels, each of the plurality of composite sub-pixels including a plurality of same-color sub-pixels corresponding to a plurality of viewpoints of the multi-viewpoint naked-eye 3D display screen, wherein a width p of each sub-pixel of the plurality of same-color sub-pixels is constructed as follows: p≤(d×q) / (n×D), wherein d is the sum of the thicknesses of the display panel and the grating, d=0.9 mm, q is a pupil distance reference distance, D is a preset viewing distance of the multi-viewpoint naked-eye 3D display screen, and n is a refractive index of the grating.
2. The multi-view naked-eye 3D display screen according to claim 1, wherein: 1.3≤n≤1.6。 3. The multi-view naked-eye 3D display screen according to claim 2, characterized in that: n=1.46。 4. The multi-view naked-eye 3D display screen according to any one of claims 1 to 3, characterized in that: Each composite sub-pixel comprises a plurality of sub-pixels in a single row or a single column; or Each composite sub-pixel includes a plurality of sub-pixels in an array.
5. The multi-viewpoint naked-eye 3D display screen according to any one of claims 1 to 3, characterized in that: The plurality of composite sub-pixels include at least one of a red composite sub-pixel, a green composite sub-pixel, and a blue composite sub-pixel.
6. The multi-viewpoint naked-eye 3D display screen according to any one of claims 1 to 3, characterized in that: The size of the multi-viewpoint naked-eye 3D display screen is greater than or equal to 43 inches.
7. The multi-view naked-eye 3D display screen according to claim 6, characterized in that: The size of the multi-view naked-eye 3D display screen is 55 inches, 60 inches, 80 inches or 100 inches; or The multi-view naked-eye 3D display screen is a cinema screen.
8. The multi-view naked-eye 3D display screen according to claim 7, characterized in that: A width of each of the plurality of sub-pixels is less than 0.008 mm.
9. The multi-view naked-eye 3D display screen according to claim 8, characterized in that: A width of each of the plurality of sub-pixels is less than 0.0076 mm.
10. The multi-viewpoint naked-eye 3D display screen according to any one of claims 1 to 3, characterized in that: The display panel includes: a first substrate; a second substrate, spaced apart from the first substrate; a color filter attached to a surface of the first substrate facing the second substrate; a thin film transistor attached to a surface of the second substrate facing the first substrate; a polarizer attached to a surface of the second substrate facing away from the first substrate; and a liquid crystal layer, disposed between the first substrate and the second substrate; The grating is directly bonded to the surface of the first substrate facing away from the second substrate.
11. The multi-view naked-eye 3D display screen according to claim 10, characterized in that: The grating is attached to the display panel at an angle.
12. The multi-view naked-eye 3D display screen according to claim 11, characterized in that: The grating includes a plurality of cylindrical prism gratings.
13. A naked-eye 3D display terminal, characterized in that: It comprises the multi-viewpoint naked-eye 3D display screen according to any one of claims 1 to 12.
14. The naked-eye 3D display terminal according to claim 13, characterized in that: The system further includes a 3D processing device configured to render corresponding sub-pixels of the plurality of composite sub-pixels in the multi-view naked-eye 3D display screen based on a 3D signal.
15. The naked-eye 3D display terminal according to claim 14, characterized in that: The 3D processing device is further configured to perform shift rendering on the sub-pixels in the composite sub-pixel according to a viewpoint position corresponding to a currently rendered sub-pixel and a viewpoint position corresponding to a next rendered sub-pixel.
16. The naked-eye 3D display terminal according to any one of claims 13 to 15, characterized in that: Also included is a memory configured to store a correspondence between sub-pixels and viewpoints; The 3D processing device is configured to obtain the corresponding relationship.
17. The naked-eye 3D display terminal according to any one of claims 13 to 15, characterized in that: It also includes an eye tracking data acquisition device configured to acquire eye tracking data of the user.
Citation Information
Patent Citations
Naked eye three-dimensional display device based on active emitting type display technology
CN105959672A
Image display device, portable terminal device, display panel and image display method using the same
US20100177093A1
Near-eye display with extended effective eyebox via eye tracking
US20180330652A1