2D / 3D fusion display equipment and 2D / 3D fusion display method and device

Abstract

The invention provides 2D / 3D fusion display equipment, a 2D / 3D fusion display method and a 2D / 3D fusion display device, and relates to the technical field of display. The 2D / 3D fusion display equipment comprises a first display panel, a second display panel, a third display panel and a fourth display panel, the first display panel is composed of a self-luminous display device, and the self-luminous display device comprises a MicroLED; the second display panel is located on the light emitting side of the first display panel and is composed of a liquid crystal display device; the micro-lens array layer is coupled to the first surface of the light emitting side of the first display panel and is formed by arranging a plurality of micro-lenses; wherein the first display panel is divided into a plurality of control subareas, each control subarea comprises a preset number of self-luminous display devices, and each control subarea is covered by a corresponding micro lens in the micro lens array layer. According to the invention, accurate and continuous two-dimensional and three-dimensional fusion display can be realized while high resolution of two-dimensional display and space information and display brightness of three-dimensional display are maintained.

Description

Technical Field

[0001] The present invention relates to the field of display technology, and in particular to a 2D / 3D fusion display device, a 2D / 3D fusion display method and an apparatus. Background Art

[0002] With the rapid development of display technology, 3D display technology is becoming a hot topic in research and application, as it can provide depth information and enhance spatial perception. Light field display technology, in particular, as an emerging 3D display method, has attracted widespread attention due to its unique advantages of providing multiple viewing angles and requiring no glasses. By simulating light propagation in different directions, light field displays create realistic 3D images and a realistic viewing experience for the viewer, significantly enhancing visual immersion.

[0003] However, while light field display technology can achieve multi-perspective information, it also faces the challenge of low spatial resolution. Compared with commercial two-dimensional displays, existing light field three-dimensional displays still lack the clarity of detailed information, making it difficult to meet the needs of high-precision display. Moreover, in practical applications, a single two-dimensional or three-dimensional display mode often cannot fully meet the diverse needs of observers. Although previous studies have attempted to achieve the switching or fusion of two-dimensional and three-dimensional displays through technical means such as the superposition and dynamic control of LCD layers and electrically controlled liquid crystal microlens arrays, these solutions still have significant limitations in terms of spatial resolution, brightness attenuation in 3D mode, and viewing angle range.

[0004] Therefore, how to achieve accurate and continuous two-dimensional and three-dimensional fusion display while maintaining the high resolution of two-dimensional display and the spatial information and display brightness of three-dimensional display is a technical problem that needs to be solved urgently. Summary of the Invention

[0005] The present invention provides a 2D / 3D fusion display device, a 2D / 3D fusion display method and an apparatus to address the above-mentioned defects in the prior art, and to achieve accurate and continuous 2D and 3D fusion display while maintaining high resolution of 2D display and spatial information and brightness of 3D display.

[0006] The present invention provides a 2D / 3D fusion display device, comprising: A first display panel, the first display panel is composed of a self-luminous display device; a second display panel located on the light-emitting side of the first display panel, the second display panel is composed of a liquid crystal display device; a microlens array layer coupled to the first surface of the light-emitting side of the first display panel, the microlens array layer is composed of a plurality of microlenses arranged; wherein the first display panel is divided into a plurality of control partitions, each control partition contains a preset number of self-luminous display devices, each control partition is covered by a corresponding microlens in the microlens array layer, and each control partition displays a primitive image according to 3D image data, which is refracted by its corresponding microlens and aggregated into a multi-viewpoint 3D image; wherein, when some or all of the control partitions of the first display panel display primitive images, the pixels in the corresponding area of the second display panel are set to white; wherein, when some or all of the control partitions of the second display panel display 2D data, the corresponding control partitions in the first display panel provide uniform backlight for the second display panel.

[0007] According to a 2D / 3D fusion display device provided by the present invention, the self-luminous display device includes a micro light-emitting diode MicroLED; each control partition of the first display panel contains a preset number of MicroLEDs, and the primitive image displayed by each control partition according to the 3D image data is refracted by its corresponding microlens and aggregated into a multi-viewpoint 3D image.

[0008] The present invention further provides a 2D / 3D fusion display method, which is applied to a fusion display device and includes: Acquire an image to be displayed; wherein, the image to be displayed includes a 3D image area and a 2D image area; according to the projection of the three-dimensional light field display area corresponding to the 3D image area on the second display panel, divide the second display panel into a first display area and a second display area, and use the area corresponding to the first display area in the first display panel as the third display area, and use the area corresponding to the second display area in the first display panel as the fourth display area; determine a 3D mask matrix based on the position information of each pixel in the first display area and the second display area; based on the 3D mask matrix, display the 2D image area in the second display area, and set the pixels of the first display area to white; based on the 3D mask matrix, use the self-luminous display device of the fourth display area to provide uniform backlight for the second display area; use the control partition of the third display area to display the multi-viewpoint primitive image corresponding to the 3D image area, so as to construct a multi-view light field of the 3D image area through the cooperation of the microlens array layer.

[0009] The present invention further provides a 2D / 3D fusion display method, which is applied to a fusion display device and includes: Acquire an image to be displayed; wherein the image to be displayed includes a 3D image area and a 2D image area; generate a first display image based on the 2D image area, and generate a second display image based on the 3D image area; in response to receiving a first display mode switching instruction, display the first display image on a second display panel, and use the self-luminous display device of the first display panel to provide uniform backlight for the second display panel; in response to receiving a second display mode switching instruction, set the pixels of the second display panel to white; and use the control partition of the first display panel to display the multi-viewpoint primitive image corresponding to the second display image, so as to construct a multi-view light field of the 3D image area of the image to be displayed through the cooperation of the microlens array layer; wherein the first display mode switching instruction is a display mode switching instruction for indicating 2D rendering, and the second display mode switching instruction is a display mode switching instruction for indicating 3D rendering.

[0010] According to a 2D / 3D fusion display method provided by the present invention, the first display image is displayed on the second display panel, including: determining the first display brightness of the first display image according to the image brightness and a first brightness coefficient of the first display image; displaying the first display image on the second display panel based on the first display brightness; using the control partition of the first display panel to display the multi-view primitive image corresponding to the second display image, including: determining the second display brightness of the second display image according to the image brightness and a second brightness coefficient of the second display image; based on the second display brightness, displaying the multi-view primitive image corresponding to the second display image using the control partition of the first display panel; wherein the first brightness coefficient and the second brightness coefficient are determined according to the target fusion brightness perceived by the human eye.

[0011] According to a 2D / 3D fusion display method provided by the present invention, displaying the first display image on the second display panel includes: The first display image is stored in a first cache, and the second display image is stored in a second cache; in response to receiving a first display mode switching instruction, the first display image is displayed on the second display panel, and the self-luminous display device of the first display panel is used to provide uniform backlight for the second display panel, including: when the first display mode switching instruction is received, the second display panel responds to a first vertical synchronization signal, obtains the first display image from the first cache, and displays the first display image; the first display panel responds to the first vertical synchronization signal, and provides uniform backlight for the second display panel using a self-luminous display device; in response to receiving a second display mode switching instruction, the pixels of the second display panel are set to white; and the control partition of the first display panel is used to display the multi-view primitive image corresponding to the second display image, including: when the second display mode switching instruction is received, the second display panel responds to a second vertical synchronization signal, sets the pixels to white; and in response to the second vertical synchronization signal, the first display panel obtains the second display image from the second cache, and uses the control partition to display the multi-view primitive image corresponding to the second display image.

[0012] The present invention further provides a 2D / 3D fusion display device, which is provided in a fusion display device and includes: An acquisition template is used to acquire an image to be displayed; wherein the image to be displayed includes a 3D image area and a 2D image area; a division module is used to divide the second display panel into a first display area and a second display area according to the projection of the three-dimensional light field display area corresponding to the 3D image area on the second display panel, and the area corresponding to the first display area in the first display panel is used as the third display area, and the area corresponding to the second display area in the first display panel is used as the fourth display area; a determination module is used to determine a 3D mask matrix based on position information of each pixel in the first display area and the second display area; a first display module is used to display the 2D image area in the second display area based on the 3D mask matrix, and set the pixels of the first display area to white; a backlight providing module is used to provide uniform backlight for the second display area using the self-luminous display device of the fourth display area based on the 3D mask matrix; a second display module is used to display the multi-viewpoint primitive image corresponding to the 3D image area using the control partition of the third display area, so as to construct a multi-view light field of the 3D image area through the cooperation of the microlens array layer.

[0013] The present invention also provides another 2D / 3D fusion display device, which is provided in the fusion display apparatus according to claim 1 or 2, and comprises: An acquisition module for acquiring an image to be displayed; wherein the image to be displayed includes a 3D image area and a 2D image area; a generation module for generating a first display image based on the 2D image area, and generating a second display image based on the 3D image area; a first display module for displaying the first display image on a second display panel in response to receiving a first display mode switching instruction, and using the self-luminous display device of the first display panel to provide uniform backlight for the second display panel; a setting module for setting the pixels of the second display panel to white in response to receiving a second display mode switching instruction; and a second display module for displaying a multi-viewpoint primitive image corresponding to the second display image using a control partition of the first display panel, so as to construct a multi-view light field of the 3D image area of the image to be displayed through the cooperation of a microlens array layer; wherein the first display mode switching instruction is a display mode switching instruction for instructing 2D rendering, and the second display mode switching instruction is a display mode switching instruction for instructing 3D rendering.

[0014] The present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the 2D / 3D fusion display method described above is implemented.

[0015] The present invention further provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements any of the above-mentioned 2D / 3D fusion display methods.

[0016] The present invention further provides a computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the computer program implements any of the above-mentioned 2D / 3D fusion display methods.

[0017] The 2D / 3D fusion display device provided by the present invention achieves the simultaneous presentation of high-resolution 2D images and full-color, full-parallax 3D images on the same screen by employing a first display panel composed of self-luminous display devices, a second display panel located on the light-emitting side of the first display panel and composed of liquid crystal display devices, and a microlens array layer coupled to the first surface of the light-emitting side of the first display panel. The first display panel is divided into multiple control zones, each containing a preset number of self-luminous display devices. Each control zone displays a primitive image based on 3D image data, which is refracted by corresponding microlenses and aggregated to form a multi-viewpoint 3D image, ensuring high brightness and wide viewing angles for the 3D image. Simultaneously, when the first display panel displays the primitive image, the pixels in the corresponding area of the second display panel are set to white to allow underlying light to penetrate unimpeded. When the second display panel displays 2D data, the corresponding control zone in the first display panel provides uniform backlighting, ensuring high-resolution display of the 2D image. The present invention effectively solves the problems of limited spatial resolution, 3D display brightness attenuation and narrow viewing angle existing in traditional 2D / 3D switching display technology, providing observers with a richer, more realistic and flexible visual experience. It can achieve accurate and continuous two-dimensional and three-dimensional fusion display while maintaining two-dimensional display high resolution, three-dimensional display spatial information and display brightness. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the present invention or the prior art, a brief introduction is given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0019] Figure 1 It is a structural schematic diagram of the 2D / 3D fusion display device provided by the present invention.

[0020] Figure 2 This is one of the flow charts of the 2D / 3D fusion display method provided by the present invention.

[0021] Figure 3 This is the second flow chart of the 2D / 3D fusion display method provided by the present invention.

[0022] Figure 4 It is a schematic diagram of image display using a fusion display device provided by the present invention.

[0023] Figure 5 is an exemplary schematic diagram of an image to be displayed.

[0024] Figure 6 It is a schematic diagram of the principle of single-frame fusion display provided by the present invention.

[0025] Figure 7 It is a schematic diagram of the principle of fusion display based on time-series multiplexing provided by the present invention.

[0026] Figure 8 It is a schematic diagram of the process of fusion display based on time sequence multiplexing provided by the present invention.

[0027] Figure 9 It is a structural schematic diagram of the 2D / 3D fusion display device provided by the present invention.

[0028] Figure 10 It is a structural schematic diagram of the electronic device provided by the present invention.

[0029] Reference numerals: 100: fusion display device; 110: first display panel; 120: microlens array layer; 121: microlens; 122: control partition; 130: second display panel. DETAILED DESCRIPTION

[0030] To make the objectives, technical solutions, and advantages of the present invention more clear, the technical solutions of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the embodiments described are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the present invention.

[0031] The following combination Figure 1 The 2D / 3D fusion display device of the present invention is described.

[0032] Figure 1 Schematic diagram of the structure of the 2D / 3D fusion display device provided by the present invention. Figure 1 As shown, the fusion display device 100 includes a first display panel 110 , a microlens array layer 120 , and a second display panel 130 .

[0033] The first display panel 110 is composed of a self-luminous display device.

[0034] Self-luminous display devices are those that can emit light on their own without the need for an external light source. These devices generate light through their own material or structural properties to display images.

[0035] In some embodiments, the self-luminous display device is a MicroLED. MicroLED, a display technology based on micro-LED arrays, offers advantages such as high brightness, high contrast, and low energy consumption. MicroLED units utilize an RGB pixel layout, with each pixel independently emitting light. This supports high dynamic range (HDR) and high brightness output, ensuring high resolution and excellent color reproduction.

[0036] Beneath the MicroLED array lies a control circuit layer, responsible for controlling the luminous intensity and color of each MicroLED pixel. This control circuit layer can include an amorphous silicon or polycrystalline silicon TFT (thin-film transistor) driver layer. Each TFT unit corresponds to a MicroLED pixel, and grayscale control is achieved through PWM (pulse-width modulation) signals, with a 0-255 grayscale range.

[0037] When manufacturing the first display panel, this can be achieved in the following manner.

[0038] 200mm GaN-on-silicon epitaxial wafers are vertically interconnected with CMOS driver wafers. Through a thin film transfer process, the MicroLED light-emitting units are peeled off layer by layer and bonded to the silicon-based driver circuit, enabling independent addressing of each pixel.

[0039] An amorphous silicon or polycrystalline silicon TFT driver layer is integrated beneath the MicroLED array. Each TFT unit corresponds to a MicroLED pixel, and grayscale control is achieved through PWM signals.

[0040] The fabricated MicroLED array and the control circuit layer are packaged to form a first display panel.

[0041] The second display panel 130 is located on the light-emitting side of the first display panel 110 , and is composed of a liquid crystal display device.

[0042] The second display panel 130 is composed of a liquid crystal display (LCD) device, which presents high-resolution color images in 2D display mode and switches to a transparent state in 3D display mode to ensure that the light field display of the underlying first display panel 110 is not disturbed.

[0043] In a specific implementation, when a primitive image is displayed in part or all of the control partitions of the first display panel, a full-color, full-parallax three-dimensional effect is provided to the observer. At this time, the pixels in the corresponding area of the second display panel are set to white (RGB=255, 255, 255), allowing the light field display content of the underlying first display panel to penetrate and be presented to the observer. When 2D data is displayed in part or all of the area of the second display panel, a high-resolution color image is presented. At this time, the corresponding control partition in the first display panel provides uniform backlight for the second display panel.

[0044] The second display panel 130 is a high-resolution LCD panel without a backlight layer, such as a 4K or higher resolution LCD screen. This design enables the LCD panel to provide clear and detailed image quality when displaying 2D images.

[0045] LCD panels adjust light transmittance by controlling the arrangement of liquid crystal molecules, thereby displaying varying shades of brightness. When light passes through the liquid crystal layer, an applied electric field controls the orientation of the liquid crystal molecules, causing them to deflect to varying degrees, thereby changing light transmittance. LCD panels also contain a color filter (RGB filter layer) that further imparts color information to the transmitted light, ultimately creating a high-resolution color image.

[0046] In the specific implementation process, through the control of the rendering algorithm, the second display panel 130 can dynamically switch between 2D and 3D display modes, and work in conjunction with the underlying first display panel 110 to achieve accurate fusion of high-resolution 2D display and full-color and full-parallax light field 3D display. Figure 2 and Figure 3 The relevant content in will not be repeated here.

[0047] The microlens array layer 120 is coupled to the first surface of the light-emitting side of the first display panel 110 . The microlens array layer 120 is composed of a plurality of microlenses 121 . Each microlens 121 has a specific curvature and size for precisely modulating the propagation direction of light.

[0048] The diameter of the microlens 121 strictly matches the pixel pitch of the first display panel 110 to ensure accurate modulation of light and high-quality reconstruction of the 3D light field.

[0049] The micro lenses 121 are densely arranged in the micro lens array layer 120 in a specific arrangement (eg, a rectangular array, a hexagonal array, etc.) to cover the entire light exit area of the first display panel 110 .

[0050] The microlens array layer 120 modulates the propagation direction of light emitted from the first display panel 110 through the refraction of microlenses 121, forming light beams with specific directions. These light beams converge in space to form a multi-perspective 3D light field, providing the observer with a full-color, full-parallax 3D effect.

[0051] The precise arrangement and size matching of the microlenses 121 help reduce light field crosstalk and improve the quality of 3D light field imaging. Light field crosstalk refers to the interference of light rays from different perspectives during the reconstruction process, resulting in blurred or distorted 3D images. Through close coupling and precise matching with the first display panel 110, the microlens array layer 120 significantly improves the brightness, contrast, and resolution of 3D imaging, providing viewers with a more realistic and clear 3D visual experience.

[0052] In practice, the microlens array must achieve both spatial and angular matching with the microLEDs to suppress light field crosstalk and improve 3D imaging quality. Nanoimprint lithography (NIL) is used to create hemispherical or aspherical microlenses on a glass substrate, with the lens diameter strictly matching the microLED pixel pitch (for example, a 5μm lens covers four RGB sub-pixels). Photolithography alignment marks are used to achieve a positional accuracy of ±0.5μm. A black matrix isolation layer is added between the lenses, and a chromium / chromium oxide film is deposited using a sputtering process to reduce light leakage from adjacent lenses from 15% to below 2%.

[0053] In a specific implementation, the first display panel 110 is divided into a plurality of control zones 122. Each control zone 122 includes a predetermined number of self-luminous display devices. Each control zone 122 is covered by a microlens 121 in the microlens array layer 120. A primitive image displayed by each control zone based on 3D image data is refracted by its corresponding microlens and aggregated into a multi-viewpoint 3D image.

[0054] In some embodiments, the self-luminous display device includes micro-light emitting diodes (MicroLEDs); each control partition of the first display panel includes a preset number of MicroLEDs, such as Figure 4 As shown, the primitive images displayed by each control zone based on the 3D image data are refracted by their corresponding microlenses and aggregated into a multi-view 3D image. For example, if the microlens array layer contains 100×100 microlenses, the MicroLED array needs to be divided into 100×100 control zones, each of which independently outputs the primitive images of the corresponding viewing angle.

[0055] The number of self-luminous display devices contained in each control zone depends on the target viewing angles. To support more viewing angles, each control zone must contain more microLEDs to ensure the light information required for 3D image reconstruction. The size of the control zone must precisely match the size and arrangement of the microlenses.

[0056] The following combination Figure 2-Figure 8 The 2D / 3D fusion display method of the present invention is described.

[0057] Figure 2 This is one of the flow charts of the 2D / 3D fusion display method provided by the present invention, which is applied to Figure 1 The control module of the fusion display device shown is as follows Figure 2 As shown, the method includes the following: Step 201: Acquire an image to be displayed; wherein the image to be displayed includes a 3D image area and a 2D image area.

[0058] Just as an example, Figure 5 The image to be displayed shown includes a 3D image area: the image area where the rabbit is located, and a 2D image area: the image area where the grass is located.

[0059] Step 202: Divide the second display panel into a first display area and a second display area based on the projection of the three-dimensional light field display area corresponding to the 3D image area on the second display panel, and use the area of the first display panel corresponding to the first display area as the third display area, and use the area of the first display panel corresponding to the second display area as the fourth display area.

[0060] In specific implementations, to determine the projection position of the 3D light field display area corresponding to the 3D image area on the second display panel, light field depth estimation is first required. This can be achieved by using an epipolar plane image (EPI)-based depth estimation method to reconstruct a depth map of the 3D image area by analyzing changes in the slope of light rays in the light field. Based on this depth map, the 3D light field display area corresponding to the 3D image area can be accurately determined, and the projection area of this 3D light field display area on the second display panel can be further calculated.

[0061] The first display area corresponds to the projection location of the 3D image area in the three-dimensional light field display on the second display panel. When the first display panel displays a 3D image, the pixels in the first display area are set to white to allow light emitted by the first display panel based on the 3D image data to pass through unimpeded.

[0062] The second display area is an area on the second display panel other than the first display area, and is used to display 2D image data.

[0063] The third display area is an area on the first display panel that corresponds to the first display area on the second display panel. The third display area is used to emit light based on the 3D image data and construct a multi-view light field of the 3D image through the cooperation of the microlens array layer.

[0064] The fourth display area is an area on the first display panel corresponding to the second display area on the second display panel. When the second display panel displays 2D image data, the fourth display area provides uniform backlight for the second display panel.

[0065] Step 203: Determine a 3D mask matrix based on the position information of each pixel in the first display area and the second display area.

[0066] During the specific implementation process, a 3D mask matrix can be generated based on the position information of each pixel in the first display area and the second display area, and each element in the 3D mask matrix corresponds to a pixel in the second display panel; the elements at the corresponding positions of the first display area in the 3D mask matrix are marked as a first value (for example, 1), and the elements at the remaining positions are marked as a second value (for example, 0).

[0067] Step 204: Based on the 3D mask matrix, display the 2D image area in the second display area, and set the pixels in the first display area to white.

[0068] In a specific implementation, the 3D mask matrix can be used to determine which pixels on the second display panel belong to the second display area. Data from the 2D image area can then be read and displayed in the second display area. The values of the elements in the 3D mask matrix can be checked to identify which pixels belong to the first display area. The pixels in the first display area are then set to white so that light from the underlying first display panel can pass through the second display panel unimpeded, forming a 3D light field at the user's viewing angle.

[0069] Step 205 : Based on the 3D mask matrix, use the self-luminous display device in the fourth display area to provide uniform backlight for the second display area.

[0070] In a specific implementation, a 3D mask matrix can be used to determine which pixels on the first display panel belong to the fourth display area. Based on the overall brightness requirements of the 2D image displayed on the second display panel, the overall brightness of the MicroLEDs in the fourth display area can be dynamically adjusted. This can be achieved by adjusting the MicroLED drive current or PWM (pulse width modulation) signal.

[0071] In some embodiments, the MicroLEDs in the fourth display area can be zoned and dimmed according to the local brightness distribution of the 2D image to provide a more uniform backlight effect.

[0072] The light emitted from the fourth display area penetrates the second display panel, providing backlight for the 2D image on the second display area; under the illumination of the backlight, the 2D image on the second display panel is clearly displayed.

[0073] Step 206 : Use the control partition of the third display area to display the multi-view primitive image corresponding to the 3D image area, so as to construct a multi-view light field of the 3D image area through the cooperation of the microlens array layer.

[0074] For a detailed description of control partitions, see Figure 1 The relevant content in will not be repeated here.

[0075] Since the pixels in the first display area are set to white, the light in the third display area can penetrate the second display panel without hindrance, thereby constructing a multi-viewing light field of the 3D image area on the user's viewing angle plane.

[0076] In the embodiment provided by the present invention, based on the 3D mask matrix, a 2D image area is displayed in the second display area, and the pixels of the first display area are set to white; based on the 3D mask matrix, the self-luminous display device of the fourth display area is used to provide uniform backlight for the second display area; the multi-view primitive image corresponding to the 3D image area is displayed using the control partition of the third display area, so as to construct a multi-view light field of the 3D image area through the cooperation of the microlens array layer. Figure 6 As shown, the observer can simultaneously observe the three-dimensional image displayed by the first display panel coupled with the microlens array and the two-dimensional image presented by the second display panel in a single frame, thereby achieving a 2D / 3D fusion display with stable brightness.

[0077] In some other embodiments provided by the present invention, a time-series multiplexing algorithm (such as Figure 8 As shown), the first display panel and the second display panel of the fusion display device alternately present 2D images and 3D image content to achieve accurate fusion of high-resolution 2D display and full-color and full-parallax light field 3D display. Figure 7 The principle of this fusion display rendering algorithm is demonstrated. Combined with a high-refresh-rate display driver, the fusion display device switches display modes according to frame timing. One frame is in 2D image display mode, with the second display panel displaying a high-resolution 2D image, while the first display panel provides white backlighting. The next frame switches to 3D image display mode, with the first display panel displaying a multi-viewpoint primitive image, while the second display panel switches to a white screen. By combining the human eye's persistence of vision, the rapidly switching 2D and 3D image content forms a continuous fused image during observation. This is suitable for applications that require both high-definition 2D image display and stereoscopic 3D image visual enhancement.

[0078] In practice, the timing multiplexing algorithm achieves dynamic 2D / 3D image fusion by switching between the aforementioned 2D and 3D image display modes. Its core lies in frame-level display content allocation and synchronization control. For example, at a 120Hz refresh rate, each 1 / 120 second display cycle is divided into two sub-frames: a 3D display sub-frame (60 frames / second) for the aforementioned 3D image display mode, and a 2D display sub-frame (60 frames / second) for the aforementioned 2D image display mode.

[0079] The specific implementation process of the timing multiplexing algorithm is as follows Figure 3 shown.

[0080] Figure 3 This is the second flow chart of the 2D / 3D fusion display method provided by the present invention, which is applied to Figure 1 The control module of the fusion display device shown is as follows Figure 3 As shown, the method includes the following: Step 301: Acquire an image to be displayed; wherein the image to be displayed includes a 3D image area and a 2D image area.

[0081] Step 302: Generate a first display image based on the 2D image area, and generate a second display image based on the 3D image area.

[0082] The first display image is used to display high-resolution 2D image content on the second display panel, which has high resolution and rich color expression.

[0083] The second display image is used to construct a multi-viewing light field on the first display panel through the microlens array layer to achieve full-color and full-parallax 3D image display with high brightness and high contrast characteristics.

[0084] Step 303 : In response to receiving the first display mode switching instruction, display the first display image on the second display panel, and utilize the self-luminous display device of the first display panel to provide uniform backlight for the second display panel.

[0085] The first display mode switching instruction is a display mode switching instruction for instructing to perform 2D rendering. When 2D image display is required, the instruction can be triggered (for example, by system logic or a timing clock).

[0086] In a specific implementation, the first display image data can be sent to the driving circuit of the second display panel. The second display panel adjusts the orientation of the liquid crystal molecules according to the received data, allowing light to pass through the liquid crystal layer and pass through the color filter to form a high-resolution 2D image.

[0087] Step 304 : In response to receiving the second display mode switching instruction, set the pixels of the second display panel to white.

[0088] The second display mode switching instruction is a display mode switching instruction for instructing to perform 3D rendering. When 3D image display is required, the instruction can be triggered (for example, by system logic or a timing clock).

[0089] In a specific implementation process, a control signal may be sent to the second display panel to switch it to a transparent state, so that the second display panel no longer modulates the light but allows the light of the first display panel to pass completely.

[0090] Step 305 : Use the control partition of the first display panel to display the multi-view primitive image corresponding to the second display image, so as to construct a multi-view light field of the 3D image area of the image to be displayed through the cooperation of the microlens array layer.

[0091] For each control zone, the MicroLED pixels within that zone can be independently driven to emit light based on the calculated multi-view primitive image data. By precisely controlling the luminous intensity and color of each pixel, the corresponding multi-view primitive image is generated.

[0092] After emitting light from the first display panel, it is modulated by the microlens array layer, changing its propagation direction based on the refractive properties of the lenses. Because the MicroLED pixels under each microlens unit display a different multi-viewpoint primitive image, the light passing through the microlens array layer forms a light field distribution with continuous perspectives in space. When viewed from different angles, the observer perceives a full-color 3D image with motion parallax, achieving multi-perspective light field construction for the 3D image area to be displayed.

[0093] In some embodiments, a first display image is stored in a first buffer, and a second display image is stored in a second buffer. Upon receiving a first display mode switching instruction, the second display panel, in response to a first vertical synchronization signal, retrieves the first display image from the first buffer and displays the first display image. The first display panel, in response to the first vertical synchronization signal, uses a self-luminous display device to provide uniform backlighting for the second display panel. Upon receiving a second display mode switching instruction, the second display panel, in response to a second vertical synchronization signal, sets pixels to white. Finally, in response to the second vertical synchronization signal, the first display panel retrieves the second display image from the second buffer and displays the multi-view primitive image corresponding to the second display image using a control partition.

[0094] In the embodiments provided herein, a double-buffered rendering method is employed to draw dual-screen images in matching patterns in a background buffer and present them on the display screens in a time-sharing manner, achieving matching dynamic refresh and effectively avoiding occlusion errors or brightness fluctuations during the display process. To achieve seamless switching, upon receiving a vertical synchronization signal, the first and second display panels synchronously switch to the display data of the next subframe, ensuring dual-screen refresh timing alignment with an error within ±0.1ms, effectively avoiding screen tearing caused by timing deviations.

[0095] The above steps describe a 2D / 3D fusion display method based on time-sequential multiplexing. This method uses the human eye's persistence of vision to rapidly alternate between 2D and 3D content, allowing the viewer to perceive a continuous fusion image. To achieve this effect, the MicroLED backlight must rapidly switch its brightness characteristics between 3D and 2D modes.

[0096] To optimize the brightness switching effect, the present invention introduces a dynamic brightness mapping technology, which includes two main parts: local dimming of the 3D subframe (3D image displayed by the first display panel) and global dimming of the 2D subframe (2D image displayed by the second display panel).

[0097] 3D sub-frame local dimming uses PWM (pulse-width modulation) dimming of microLED sub-regions based on the brightness distribution of the primitive image. By analyzing the brightness information of the 3D primitive image, the drive current of dark pixels is reduced. For example, by reducing the drive current of dark pixels from 20mA to 5mA, the contrast ratio of the 3D light field can be significantly improved, even reaching 1,000,000:1. Local dimming can maintain overall brightness balance while highlighting details and layering in the 3D image.

[0098] Global dimming of the 2D subframes dynamically adjusts the overall brightness of the MicroLED backlight, combining the image histogram of the LCD layer. By analyzing the histogram of the 2D image displayed on the LCD layer, the power of the MicroLED backlight is adjusted based on the overall brightness level of the image. For example, if the 2D image is a dark scene, the system reduces the backlight power from 30W to 15W to reduce energy consumption and avoid overbrightness. Simultaneously, localized brightness boosting of the LCD pixels compensates for the brightness loss caused by the reduced backlight, ensuring that the detail and color of the 2D image are not affected. Global dimming ensures that 2D images remain clear in all brightness scenarios while reducing system energy consumption.

[0099] To further enhance the fusion effect, display brightness can be optimized based on human visual characteristics. Based on the exponential decay of the human eye's persistence of vision (with a time constant of approximately 50ms), brightness-weighted overlay is implemented for rapidly switching 2D / 3D subframes. This brightness-weighted overlay achieves smoother brightness transitions in time-sequential multiplexing mode, improving visual comfort and preventing flicker or fragmentation that may be perceived by the naked eye.

[0100] In some embodiments, the first display brightness of the first display image can be determined based on the image brightness and the first brightness coefficient of the first display image; based on the first display brightness, the first display image is displayed on the second display panel; based on the image brightness and the second brightness coefficient of the second display image, the second display brightness of the second display image is determined; based on the second display brightness, the multi-viewpoint primitive image corresponding to the second display image is displayed using the control partition of the first display panel; wherein the first brightness coefficient and the second brightness coefficient are determined based on the target fusion brightness perceived by the human eye.

[0101] In the specific implementation process, the target fusion brightness perceived by the human eye can be determined based on user needs or preset parameters. This target fusion brightness is the overall brightness that the system wants the observer to ultimately see after the fusion of the 2D and 3D images.

[0102] For example, the image brightness of the first display image is , the image brightness of the second display image is , then the fusion brightness perceived by the observer is: (1) Among them, the first brightness coefficient of 0.7 and the second brightness coefficient of 0.3 are determined through psychophysical experiments and target fusion brightness, aiming to reduce the flickering caused by high-frequency switching and make the 2D / 3D fusion image more natural and smooth.

[0103] The following describes a 2D / 3D fusion display device provided by the present invention. The 2D / 3D fusion display device described below and the 2D / 3D fusion display method described above can refer to each other.

[0104] Figure 9 Schematic diagram of the structure of the 2D / 3D fusion display device provided by the present invention. Figure 9 As shown, the apparatus 900 includes: The template acquisition 910 is used to acquire an image to be displayed; wherein the image to be displayed includes a 3D image area and a 2D image area.

[0105] A division module 920 is configured to divide the second display panel into a first display area and a second display area based on a projection of a three-dimensional light field display area corresponding to the 3D image area on the second display panel, and to use an area of the first display panel corresponding to the first display area as a third display area, and an area of the first display panel corresponding to the second display area as a fourth display area.

[0106] The determination module 930 is configured to determine a 3D mask matrix based on position information of each pixel in the first display area and the second display area.

[0107] The first display module 940 is configured to display the 2D image area in the second display area based on the 3D mask matrix, and set the pixels in the first display area to white.

[0108] The backlight providing module 950 is configured to provide uniform backlight for the second display area by utilizing the self-luminous display device in the fourth display area based on the 3D mask matrix.

[0109] The second display module 960 is configured to display the multi-view primitive images corresponding to the 3D image area using the control partition of the third display area, so as to construct a multi-view light field of the 3D image area through the cooperation of the microlens array layer.

[0110] The present invention also provides another 2D / 3D fusion display device, which is provided in a fusion display device and includes: The acquisition module is used to acquire an image to be displayed; wherein the image to be displayed includes a 3D image area and a 2D image area.

[0111] A generating module is configured to generate a first display image based on the 2D image area, and to generate a second display image based on the 3D image area.

[0112] The first display module is configured to display the first display image on the second display panel in response to receiving a first display mode switching instruction, and to provide uniform backlight for the second display panel using the self-luminous display device of the first display panel.

[0113] The setting module is configured to set the pixels of the second display panel to white in response to receiving a second display mode switching instruction.

[0114] and a second display module for displaying a multi-view primitive image corresponding to the second display image using the control partition of the first display panel, so as to construct a multi-view light field of the 3D image area of the image to be displayed through the cooperation of the microlens array layer.

[0115] The first display mode switching instruction is a display mode switching instruction for instructing to perform 2D rendering, and the second display mode switching instruction is a display mode switching instruction for instructing to perform 3D rendering.

[0116] Figure 10 An example of a physical structure diagram of an electronic device is shown below. Figure 10 As shown, the electronic device may include: a processor (processor) 1010 , a communication interface (Communications Interface) 1020 , a memory (memory) 1030 and a communication bus 1040 , wherein the processor 1010 , the communication interface 1020 , and the memory 1030 communicate with each other via the communication bus 1040 . The processor 1010 can call logic instructions in the memory 1030 to execute a 2D / 3D fusion display method, the method comprising: obtaining an image to be displayed; wherein the image to be displayed includes a 3D image area and a 2D image area; dividing the second display panel into a first display area and a second display area based on a projection of a three-dimensional light field display area corresponding to the 3D image area on the second display panel, and using an area of the first display panel corresponding to the first display area as a third display area, and using an area of the first display panel corresponding to the second display area as a fourth display area; determining a 3D mask matrix based on position information of each pixel in the first display area and the second display area; displaying the 2D image area in the second display area based on the 3D mask matrix, and setting the pixels of the first display area to white; based on the 3D mask matrix, using the self-luminous display device of the fourth display area to provide uniform backlight for the second display area; and using the control partition of the third display area to display the multi-viewpoint primitive image corresponding to the 3D image area, so as to construct a multi-view light field of the 3D image area through the cooperation of the microlens array layer.

[0117] Furthermore, the logic instructions in the aforementioned memory 1030 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the portion that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as a USB flash drive, a mobile hard drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0118] On the other hand, the present invention also provides a computer program product, which includes a computer program that can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the 2D / 3D fusion display method provided by the above methods, the method comprising: obtaining an image to be displayed; wherein the image to be displayed includes a 3D image area and a 2D image area; according to the projection of the three-dimensional light field display area corresponding to the 3D image area on the second display panel, dividing the second display panel into a first display area and a second display area, and using the area of the first display panel corresponding to the first display area as a third display area area, and use the area in the first display panel corresponding to the second display area as the fourth display area; determine a 3D mask matrix based on the position information of each pixel in the first display area and the second display area; display the 2D image area in the second display area based on the 3D mask matrix, and set the pixels of the first display area to white; use the self-luminous display device of the fourth display area to provide uniform backlight for the second display area based on the 3D mask matrix; use the control partition of the third display area to display the multi-viewpoint primitive image corresponding to the 3D image area, so as to construct a multi-viewing angle light field of the 3D image area through the cooperation of the microlens array layer.

[0119] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the 2D / 3D fusion display method provided by the above methods, the method comprising: obtaining an image to be displayed; wherein the image to be displayed includes a 3D image area and a 2D image area; dividing the second display panel into a first display area and a second display area according to the projection of a three-dimensional light field display area corresponding to the 3D image area on the second display panel, and using the area of the first display panel corresponding to the first display area as a third display area, and dividing the area of the first display panel corresponding to the first display area into a third display area. The area corresponding to the second display area is used as the fourth display area; based on the position information of each pixel in the first display area and the second display area, a 3D mask matrix is determined; based on the 3D mask matrix, the 2D image area is displayed in the second display area, and the pixels of the first display area are set to white; based on the 3D mask matrix, the self-luminous display device of the fourth display area is used to provide uniform backlight for the second display area; and the multi-viewpoint primitive image corresponding to the 3D image area is displayed using the control partition of the third display area, so as to construct a multi-view light field of the 3D image area through the cooperation of the microlens array layer.

[0120] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, i.e., they may be located in one location or distributed across multiple network units. Some or all of the modules may be selected based on actual needs to achieve the objectives of the present embodiment. Persons of ordinary skill in the art will be able to understand and implement the present invention without inventive effort.

[0121] Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented using software plus a necessary general-purpose hardware platform, or of course, hardware. Based on this understanding, the essence of the above technical solution, or the portion that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a magnetic disk, or an optical disk, and includes a number of instructions for causing a computer device (such as a personal computer, server, or network device) to execute the methods described in each embodiment or certain portions of the embodiments.

[0122] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. A 2D / 3D fusion display device, characterized in that: include: a first display panel, the first display panel being composed of a self-luminous display device; a microlens array layer coupled to the first surface of the light-emitting side of the first display panel, wherein the microlens array layer is composed of a plurality of microlenses arranged; a second display panel located on a light-emitting side of the first display panel, the second display panel being composed of a liquid crystal display device; The first display panel is divided into a plurality of control zones, each control zone comprising a preset number of self-luminous display devices, each control zone being covered by a corresponding microlens in the microlens array layer, and a primitive image displayed by each control zone according to 3D image data is refracted by its corresponding microlens to form a multi-viewpoint 3D image; Wherein, when a part or all of the control partitions of the first display panel display a primitive image, the pixels of the corresponding area in the second display panel are set to white; When 2D data is displayed in a part or all of the area of the second display panel, the corresponding control partition in the first display panel provides uniform backlight for the second display panel.

2. The fusion display device according to claim 1, characterized in that: The self-luminous display device includes a micro light emitting diode MicroLED; Each control partition of the first display panel includes a preset number of MicroLEDs. The primitive image displayed by each control partition according to the 3D image data is refracted by its corresponding micro lens and aggregated into a multi-viewpoint 3D image.

3. A 2D / 3D fusion display method, characterized in that: The method is applied to the fusion display device according to claim 1 or 2, and the method includes: Acquire an image to be displayed; wherein the image to be displayed includes a 3D image area and a 2D image area; dividing the second display panel into a first display area and a second display area according to a projection of a three-dimensional light field display area corresponding to the 3D image area on the second display panel, and using an area of the first display panel corresponding to the first display area as a third display area, and using an area of the first display panel corresponding to the second display area as a fourth display area; determining a 3D mask matrix based on position information of each pixel in the first display area and the second display area; Based on the 3D mask matrix, displaying the 2D image area in the second display area and setting pixels in the first display area to white; Based on the 3D mask matrix, using the self-luminous display device of the fourth display area to provide uniform backlight for the second display area; The multi-view primitive images corresponding to the 3D image area are displayed using the control partitions of the third display area, so as to construct a multi-view light field of the 3D image area through the cooperation of the microlens array layer.

4. A 2D / 3D fusion display method, characterized in that: The method is applied to the fusion display device according to claim 1 or 2, and the method includes: Acquire an image to be displayed; wherein the image to be displayed includes a 3D image area and a 2D image area; generating a first display image based on the 2D image area, and generating a second display image based on the 3D image area; In response to receiving the first display mode switching instruction, displaying the first display image on the second display panel, and using the self-luminous display device of the first display panel to provide uniform backlight for the second display panel; In response to receiving a second display mode switching instruction, setting pixels of the second display panel to white; and Displaying a multi-view primitive image corresponding to the second display image using the control partition of the first display panel, so as to construct a multi-view light field of the 3D image area of the image to be displayed through the cooperation of the microlens array layer; The first display mode switching instruction is a display mode switching instruction for instructing to perform 2D rendering, and the second display mode switching instruction is a display mode switching instruction for instructing to perform 3D rendering.

5. The 2D / 3D fusion display method according to claim 4, characterized in that: The displaying the first display image on the second display panel includes: determining a first display brightness of the first display image according to the image brightness of the first display image and a first brightness coefficient; displaying the first display image on the second display panel based on the first display brightness; The displaying of the multi-view primitive image corresponding to the second display image by using the control partition of the first display panel includes: determining a second display brightness of the second display image according to the image brightness of the second display image and a second brightness coefficient; Based on the second display brightness, displaying the multi-view primitive image corresponding to the second display image using the control partition of the first display panel; The first brightness coefficient and the second brightness coefficient are determined according to the target fusion brightness perceived by the human eye.

6. The 2D / 3D fusion display method according to claim 4, characterized in that: The displaying the first display image on the second display panel includes: The first display image is stored in a first cache, and the second display image is stored in a second cache; In response to receiving the first display mode switching instruction, displaying the first display image on the second display panel and using the self-luminous display device of the first display panel to provide uniform backlight for the second display panel include: When the first display mode switching instruction is received, the second display panel obtains the first display image from the first buffer in response to the first vertical synchronization signal, and displays the first display image; The first display panel provides uniform backlight for the second display panel using a self-luminous display device in response to the first vertical synchronization signal; The method of setting the pixels of the second display panel to white in response to receiving the second display mode switching instruction; and displaying the multi-view primitive image corresponding to the second display image using the control partition of the first display panel, comprises: When receiving the second display mode switching instruction, the second display panel sets the pixels to white in response to the second vertical synchronization signal; and In response to the second vertical synchronization signal, the first display panel obtains the second display image from the second buffer, and displays the multi-view primitive image corresponding to the second display image using the control partition.

7. A 2D / 3D fusion display device, characterized in that: The device is provided in the fusion display device according to claim 1 or 2, and the device includes: Acquire a template for acquiring an image to be displayed; wherein the image to be displayed includes a 3D image area and a 2D image area; a dividing module, configured to divide the second display panel into a first display area and a second display area according to a projection of a three-dimensional light field display area corresponding to the 3D image area on the second display panel, and to use an area of the first display panel corresponding to the first display area as a third display area, and an area of the first display panel corresponding to the second display area as a fourth display area; a determination module, configured to determine a 3D mask matrix based on position information of each pixel in the first display area and the second display area; a first display module, configured to display the 2D image area in the second display area based on the 3D mask matrix, and set pixels in the first display area to white; a backlight providing module, configured to provide uniform backlight for the second display area by utilizing the self-luminous display device of the fourth display area based on the 3D mask matrix; The second display module is used to display the multi-view primitive image corresponding to the 3D image area using the control partition of the third display area, so as to construct a multi-view light field of the 3D image area through the cooperation of the microlens array layer.

8. A 2D / 3D fusion display device, characterized in that: The device is provided in the fusion display device according to claim 1 or 2, and the device includes: An acquisition module, configured to acquire an image to be displayed; wherein the image to be displayed includes a 3D image area and a 2D image area; a generating module, configured to generate a first display image based on the 2D image area, and generate a second display image based on the 3D image area; a first display module, configured to display the first display image on a second display panel in response to receiving a first display mode switching instruction, and provide a uniform backlight for the second display panel using a self-luminous display device of the first display panel; a setting module, configured to set the pixels of the second display panel to white in response to receiving a second display mode switching instruction; and a second display module, configured to display a multi-view primitive image corresponding to the second display image using the control partition of the first display panel, so as to construct a multi-view light field of the 3D image area of the image to be displayed through the cooperation of the microlens array layer; The first display mode switching instruction is a display mode switching instruction for instructing to perform 2D rendering, and the second display mode switching instruction is a display mode switching instruction for instructing to perform 3D rendering.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that: When the processor executes the computer program, the 2D / 3D fusion display method according to any one of claims 2 to 6 is implemented.

10. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the 2D / 3D fusion display method according to any one of claims 2 to 6 is implemented.

Images