Stereoscopic image display system and stereoscopic image display method thereof

Abstract

The invention provides a stereoscopic image display system and a stereoscopic image display method thereof. The method is applicable to a stereoscopic image display system including a first stereoscopic display and includes the following steps. And obtaining a display image frame. A plurality of image regions are identified from the display frame, wherein the plurality of image regions include a two-dimensional content image region and a three-dimensional content image region. The drawing priority of each image region is determined according to the region characteristics of each image region. According to the drawing priority of each image area, sequentially drawing the image content of each image area in a first three-dimensional format image comprising a first left-eye image and a first right-eye image; a first stereoscopic format image is displayed by a first stereoscopic display operating in a stereoscopic display mode. Therefore, the stereoscopic image content and the two-dimensional image content of the display image frame can be ensured to be correctly displayed.

Description

Technical Field

[0001] This invention relates to an image processing technology, and more particularly to a stereoscopic image display system and a stereoscopic image display method thereof. Background Technology

[0002] With advancements in display technology, stereoscopic displays supporting stereoscopic vision technology have become increasingly common. Stereoscopic vision technology allows viewers to experience the three-dimensionality of images, such as the three-dimensional features of a person and depth of field, effects that traditional 2D images cannot achieve. The principle of stereoscopic vision technology is to allow the viewer's left eye to see the left-eye image and their right eye to see the right-eye image, thus creating a 3D visual effect. 3D displays can provide separate left-eye and right-eye images to the viewer's left and right eyes respectively, providing a visually immersive experience. It is known that for specific 3D image formats, 3D displays must employ corresponding 3D display technology to achieve the desired 3D visual effect. However, current 3D displays are mostly full-screen, significantly limiting their application scope. Summary of the Invention

[0003] This disclosure provides a stereoscopic image display system and method that can effectively solve the above-mentioned problems.

[0004] This disclosed exemplary embodiment provides a stereoscopic image display method applicable to a stereoscopic image display system including a first stereoscopic display and comprising the following steps: Acquiring a display frame; Identifying multiple image regions from the display frame, wherein the multiple image regions include two-dimensional content image regions and three-dimensional content image regions; Determining the rendering priority of each image region based on its regional characteristics; Sequentially rendering the image content of each image region onto a first stereoscopic format image including a first left-eye image and a first right-eye image according to the rendering priority of each image region; Displaying the first stereoscopic format image by the first stereoscopic display operating in stereoscopic display mode.

[0005] Another exemplary embodiment disclosed herein provides a stereoscopic image display system including a first stereoscopic display and at least one processor. The processor is coupled to the first stereoscopic display and configured to perform the following operations: acquiring a display frame; identifying a plurality of image regions from the display frame, wherein the plurality of image regions include two-dimensional content image regions and three-dimensional content image regions; determining a rendering priority for each image region based on the region characteristics of each image region; sequentially rendering the image content of each image region onto a first stereoscopic format image including a first left-eye image and a first right-eye image according to the rendering priority of each image region; and displaying the first stereoscopic format image by the first stereoscopic display operating in stereoscopic display mode.

[0006] Based on the above, in this disclosed embodiment, after acquiring the display frame, multiple image regions in the display frame can be identified. These image regions include two-dimensional content image regions and three-dimensional content image regions. The rendering priority of each image region can be determined according to the regional characteristics of each image region. The image content of these image regions will be sequentially rendered in the left-eye and right-eye images of the first stereoscopic format image. Therefore, it can be ensured that the stereoscopic image content and two-dimensional image content of the display frame can be displayed correctly, allowing the user to experience a novel visual experience. Attached Figure Description

[0007] Figure 1 This is a schematic diagram of a stereoscopic image display system according to an embodiment of the present disclosure;

[0008] Figure 2 This is a schematic diagram of a stereoscopic display according to an embodiment of the present disclosure;

[0009] Figure 3 This is a flowchart of a stereoscopic image display method according to an embodiment of the present disclosure;

[0010] Figure 4 This is a schematic diagram of multiple image regions according to an embodiment of the present disclosure;

[0011] Figure 5 This is a schematic diagram illustrating the priority determination based on the embodiments disclosed herein;

[0012] Figure 6 This is a schematic diagram illustrating the priority determination based on the embodiments disclosed herein;

[0013] Figure 7 This is a schematic diagram illustrating the generation and display of a first stereoscopic format image according to an embodiment of this disclosure;

[0014] Figure 8 This is a schematic diagram of a stereoscopic image display system according to an embodiment of the present disclosure;

[0015] Figure 9 This is a schematic diagram of a multi-stereoscopic display according to an embodiment of the present disclosure;

[0016] Figure 10 This is a flowchart of a stereoscopic image display method according to an embodiment of the present disclosure;

[0017] Figure 11 This is a schematic diagram illustrating the drawing of a first stereoscopic format image and a second stereoscopic format image according to an embodiment of this disclosure;

[0018] Figure 12 This is a schematic diagram of a first stereoscopic format image and a second stereoscopic format image according to an embodiment of the present disclosure. Detailed Implementation

[0019] Reference will now be made in detail to exemplary embodiments of the invention, examples of which are illustrated in the accompanying drawings. Wherever possible, the same component reference numerals are used in the drawings and description to denote the same or similar parts.

[0020] Figure 1 This is a schematic diagram of a stereoscopic image display system according to an embodiment of this disclosure. Please refer to... Figure 1 The stereoscopic image display system 100 may include a first stereoscopic display 110, a storage device 120, and at least one processor 130. In different embodiments, the stereoscopic image display system 100 may be implemented as an integrated system or a discrete system. In some embodiments, the first stereoscopic display 110, storage device 120, and processor 130 may be implemented as an all-in-one electronic device, such as a laptop computer, tablet computer, desktop computer, game console, portable electronic device, or other personal electronic device. Alternatively, in some embodiments, the first stereoscopic display 110 may be connected to a calculator device including the storage device 120 and the processor 130 via a wired or wireless transmission interface.

[0021] The first stereoscopic display 110 allows users to experience stereoscopic visual effects. In order to allow users to experience 3D visual effects through the first stereoscopic display 110, the first stereoscopic display 110 can, according to its hardware specifications and the 3D display technology it applies, allow the user's left and right eyes to view image content corresponding to different perspectives (i.e., the first left-eye image and the first right-eye image).

[0022] In some embodiments, the first stereoscopic display 110 may be a naked-eye 3D display, such as a laptop screen, television, desktop screen, or electronic billboard, etc. In some embodiments, the left-eye image and the right-eye image may be displayed simultaneously based on stereoscopic image display technology, such as parallax barrier technology, lens technology, or directional backlight technology. Alternatively, in some embodiments, the first stereoscopic display 110 may be a head-mounted display device, such as a virtual reality display device or a mixed reality display device, etc.

[0023] In another respect, the first stereoscopic display 110 may include a liquid crystal display (LCD), a light-emitting diode (LED) display, an organic light-emitting diode (OLED) display, or other types of displays, and this disclosure is not limited thereto.

[0024] Storage device 120 is used to temporarily or permanently store data, such as images, instructions, program code, software modules, etc. Specifically, storage device 120 may include volatile storage circuitry. Volatile storage circuitry is used to store data in a volatile manner. For example, volatile storage circuitry may include random access memory (RAM) or similar volatile storage media. Alternatively, storage device 120 may include non-volatile storage circuitry. Non-volatile storage circuitry is used to store data in a non-volatile manner. For example, non-volatile storage circuitry may include read-only memory (ROM), solid-state drive (SSD), and / or traditional hard disk drive (HDD) or similar non-volatile storage media. The number of storage devices 120 may be one or more, and this disclosure is not limited thereto.

[0025] Processor 130 is connected to the first stereoscopic display 110 and the storage device 120. For example, processor 130 may include a central processing unit (CPU), a graphics processing unit (GPU) or other programmable general-purpose or special-purpose microprocessor, a digital signal processor (DSP), a programmable controller, an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or other similar devices or combinations thereof. The number of processors 130 may be one or more, and this disclosure does not limit this.

[0026] Figure 2 This is a schematic diagram of a stereoscopic display according to an embodiment of this disclosure. Please refer to... Figure 2In some embodiments, the first stereoscopic display 110 may be a naked-eye stereoscopic display, which provides different images to the left and right eyes through the principle of lens refraction, allowing the viewer to experience a stereoscopic display effect. The first stereoscopic display 110 may include a display panel 111 and a lens layer 112. The lens layer 112 is disposed above the display panel 111, and the viewer can see the image content provided by the display panel 111 through the lens layer 112. The first stereoscopic display 110 may place the pixels of the first left-eye image and the pixels of the first right-eye image at the corresponding pixel positions of the display panel 111. The lens layer 112 refracts different display content (i.e., the left-eye image and the right-eye image) to different positions in space through light refraction, so that the left and right eyes can receive two different images with parallax respectively. As is known, in order to place the pixels of the left-eye image and the right-eye image at the corresponding pixel positions on the display panel 111, the left-eye image and the right-eye image need to undergo image weaving processing to produce a woven frame in which the pixels of the left-eye image and the pixels of the right-eye image are arranged alternately.

[0027] Figure 3 This is a flowchart of a stereoscopic image display method according to an embodiment of this disclosure. Please refer to... Figure 3 The operation process of this embodiment is applicable to the stereoscopic image display system 100 in the above embodiment. The following describes the detailed steps of this embodiment with reference to the various components in the stereoscopic image display system 100.

[0028] In step S310, processor 130 acquires a display frame. In some embodiments, processor 130 may use a screenshot function to acquire a display frame including multiple operation windows. In some embodiments, processor 130 may use a screenshot function to acquire a display frame including a streaming image. The streaming image may be a two-dimensional image or a three-dimensional image (e.g., a side-by-side image). In some embodiments, the streaming image may come from a video conferencing program, a multimedia playback program, or a browser program's video stream. In some embodiments, when processor 130 executes video conferencing software, processor 130 may receive streaming images provided by conference participants via a transceiver and generate a display frame including the window operation interface of the video conferencing software and the streaming image.

[0029] In some embodiments, the processor 130 may capture display frames through an application programming interface (API) provided by the operating system. For example, the processor 130 may use screen capture technologies such as the Windows operating system's "Desktop Duplication API" or "DirectX Graphics Infrastructure (DXGI)" to acquire display frames, but is not limited to these.

[0030] In step S320, the processor 130 can identify multiple image regions from the displayed image frame. These image regions include window areas, desktop areas, component areas of graphical user interface components within a window, display areas of streaming images within a window, or various operation interface areas within a window. The multiple image regions include two-dimensional content image regions and three-dimensional content image regions. The image content of the two-dimensional content image regions is in two-dimensional format. That is, the two-dimensional content image regions include image content from a single perspective. The image content of the three-dimensional content image regions is in a stereoscopic format, such as a side-by-side format. That is, the three-dimensional content image regions include image content from different perspectives.

[0031] In some embodiments, the processor 130 may acquire window information of an application. The processor 130 may identify at least one of a plurality of image regions based on the window information. Further, the processor 130 may identify one or more image regions based on operation interface information and window information provided by the application. In some embodiments, by identifying the window extent of the operation window, the processor 130 may identify one or more image regions from a display frame. By identifying graphical user interface components in the operation window, the processor 130 may identify one or more image regions from a display frame. By identifying the display extent of the streaming image of the operation window, the processor 130 may identify one or more image regions from a display frame.

[0032] In some embodiments, processor 130 can identify 3D content blocks in a display frame to identify three-dimensional content image regions among multiple image regions. More specifically, processor 130 can detect 3D content in a display frame to identify one or more image regions. For example, processor 130 can identify a corresponding three-dimensional content image region by recognizing side-by-side images presented in a window. For example, processor 130 can identify side-by-side images by detecting patterns embedded in a streaming image. Alternatively, processor 130 can utilize a deep learning model to identify side-by-side images in a display frame.

[0033] For example, Figure 4 This is a schematic diagram of multiple image regions according to an embodiment of this disclosure. Please refer to... Figure 4The processor 130 can identify multiple image regions ROI_1 to ROI_7 from the display frame F1. Image region ROI_1 is the desktop area. Image region ROI_2 is the window area. Image region ROI_3 is another window area. Image region ROI_4 is the display area of ​​the first streaming image of the application. Image region ROI_5 is the display area of ​​the second streaming image of the application. Image region ROI_6 is the component area of ​​the GUI component of the application. Image region ROI_7 is the display area of ​​the third streaming image of the application. For example, the above application can be a video conferencing application. The first streaming image can be the screen shared by the meeting participants. The second and third streaming images can be the video screens of the meeting participants. In this example, image regions ROI_1, ROI_2, ROI_3, ROI_6, and ROI_7 can be two-dimensional content image regions. Image regions ROI_4 and ROI_5 can be three-dimensional content image regions. That is, the first streaming image in image region ROI_4 can be a left-right side-by-side image, and the second streaming image in image region ROI_5 can also be a left-right side-by-side image.

[0034] In step S330, the processor 130 can determine the rendering priority of each image region based on the regional characteristics of each image region. That is, the processor 130 can assign a corresponding priority index to each image region. The rendering priority indicates the order in which the image content of each image region is rendered in the stereoscopic image. When the rendering priority of the first image region is higher than that of the second image region, the processor 130 can render the image content of the first image region first, and then render the image content of the second image region. In this case, the image content of the second image region can partially overlap the image content of the first image region.

[0035] In some embodiments, the processor 130 may determine the rendering priority of each image region based on the window depth of the window corresponding to each image region. Further, the processor 130 may identify one or more windows currently displayed in the display frame. These windows may be associated with one or more applications. The operating system's window manager is responsible for managing the stack order and depth information of all windows. The processor 130 may obtain the window depth of each window based on the depth attribute (typically referred to as Z-order or Z-index) assigned to each window by the window manager. In some embodiments, deeper image regions are assigned higher rendering priority. The processor 130 may sort the window depths of each window from largest to smallest and determine the rendering priority of each image region based on the ranking of the window depths.

[0036] For example, the depth attribute of the image region corresponding to the desktop area can be 0 (i.e., Z-order = 0). The depth attribute of the image region corresponding to the first window area can be 1 (i.e., Z-order = 1). The depth attribute of the image region corresponding to the second window area can be 2 (i.e., Z-order = 2). In this case, the drawing priority of the image region corresponding to the desktop area is higher than the drawing priority of the image region corresponding to the first window area. The drawing priority of the image region corresponding to the first window area is higher than the drawing priority of the image region corresponding to the second window area.

[0037] In some embodiments, the processor 130 may determine the rendering priority of each image region based on the block boundary position of each image region. In some embodiments, the processor 130 may determine the rendering priority of each image region based on the distance between the block boundary of each image region and the display boundary. In some embodiments, image regions closer to the display boundary are assigned higher rendering priority. The processor 130 may determine the rendering priority of each image region by looking up a table or by calculating a function.

[0038] In some embodiments, the processor 130 may determine the rendering priority of each image region based on the region size of each image region. The region size may include width, height, or area, etc. Image regions with larger region sizes are assigned higher rendering priority. The processor 130 may determine the rendering priority of each image region by looking up a table or by calculating a function.

[0039] In some embodiments, the processor 130 may determine the rendering priority of each image region based on the region size, block boundary position, window depth of the corresponding window, or a combination thereof.

[0040] For example, Figure 5 This is a schematic diagram illustrating the priority determination based on the embodiments disclosed herein. Please refer to... Figure 5The processor 130 can identify multiple image regions ROI_51 to ROI_54 and determine the drawing priority based on the block boundary positions of each image region ROI_51 to ROI_54. Image region ROI_51 is the desktop area, therefore the processor 130 can determine that the drawing priority of image region ROI_51 is the first priority. The processor 130 can calculate the distances between image regions ROI_52 to ROI_54 and the display boundary. For example, the processor 130 can obtain the distances d3 and d5 between image region ROI_52 and the display boundary. The processor 130 can obtain the distances d1 and d4 between image region ROI_53 and the display boundary. The processor 130 can obtain the distances d2 and d6 between image region ROI_54 and the display boundary. After comparing distances d1, d2, and d3 and comparing distances d4, d5, and d6, the processor 130 can determine that the drawing priority of image region ROI_53 is the second priority, the drawing priority of image region ROI_52 is the third priority, and the drawing priority of image region ROI_54 is the fourth priority.

[0041] For example, Figure 6 This is a schematic diagram illustrating the priority determination based on the embodiments disclosed herein. Please refer to... Figure 6 The processor 130 can identify multiple image regions ROI_61 to ROI_64 and determine the drawing priority based on the window depth of the windows corresponding to each image region ROI_61 to ROI_64. Image region ROI_61 is the desktop area and has the smallest Z-order, therefore the processor 130 can determine that the drawing priority of image region ROI_61 is the first priority. The processor 130 can calculate the window depth of the windows corresponding to image regions ROI_62 to ROI_64. For example, the processor 130 can determine that the Z-order of image region ROI_62 is 2. The processor 130 can determine that the Z-order of image region ROI_63 is 1. The processor 130 can determine that the Z-order of image region ROI_64 is 2. Therefore, the processor 130 can determine that the drawing priority of image region ROI_63 is the second priority.

[0042] It should be noted that image region ROI_64 and image region ROI_62 correspond to the same window and therefore have the same window depth. Next, the processor 130 can compare the region size of image region ROI_64 with the region size of image region ROI_62. Since the region size of image region ROI_64 is smaller than the region size of image region ROI_62, the processor 130 can determine that the rendering priority of image region ROI_62 is the third priority and the rendering priority of image region ROI_64 is the fourth priority.

[0043] Back Figure 3In step S340, the processor 130 can sequentially draw the image content of each image region onto the first stereoscopic format image, which includes the first left-eye image and the first right-eye image, according to the drawing priority of each image region. Based on the drawing priority of each image region, the processor 130 can sequentially draw the image content of each image region onto the first left-eye image and the first right-eye image of the first stereoscopic format image.

[0044] In some embodiments, reflecting the higher rendering priority of the first image region than the second image region, the processor 130 may render the image content of the first image region to the first stereoscopic format image first, and then render the image content of the second image region to the first stereoscopic format image. The image content of the second image region in the first stereoscopic format image partially overlaps the image content of the first image region in the first stereoscopic format image. Furthermore, the higher the rendering priority of the image region, the earlier the image region will be rendered in the first stereoscopic format image.

[0045] In some embodiments, when processing an image region belonging to a three-dimensional content image region in a display frame, the processor 130 may acquire a sub-left-eye image and a sub-right-eye image of the three-dimensional content image region. Then, the processor 130 may draw the sub-left-eye image onto the first left-eye image of the first stereoscopic format image, and the sub-right-eye image onto the first right-eye image of the first stereoscopic format image. When processing an image region belonging to a two-dimensional content image region, the processor 130 may draw the two-dimensional content image region onto the first right-eye image and the first left-eye image of the first stereoscopic format image.

[0046] For example, the first left-eye image of the first stereoscopic format image may include image content of a two-dimensional content image area and a sub-left-eye image of a 3D content image area in the image frame. The first right-eye image of the stereoscopic format image may include image content of a two-dimensional content image area and a sub-right-eye image of a 3D content image area in the image frame. In other words, the first stereoscopic format image may simultaneously include 3D image content with parallax and two-dimensional image content without parallax.

[0047] For example, Figure 7 This is a schematic diagram illustrating the generation and display of a first stereoscopic format image according to an embodiment of this disclosure. Please refer to... Figure 7The processor 130 can capture the display frame F2. Then, the processor 130 can identify multiple image regions ROI_71 to ROI_73 in the display frame F2 and determine the rendering priority of each of the image regions ROI_71 to ROI_73. Image regions ROI_71 and ROI_73 are two-dimensional content image regions, and ROI_72 is a 3D content image region. In this example, the rendering priority of image region ROI_71 is higher than the rendering priority of image region ROI_72 and image region ROI_73. The rendering priority of image region ROI_72 is higher than the rendering priority of image region ROI_73.

[0048] Therefore, processor 130 first draws the image content of image region ROI_71 onto the first left-eye image Img_L1 and the first right-eye image Img_R1 in the first stereoscopic format image SBS71. Next, processor 130 draws the sub-left-eye image SL1 of image region ROI_72 onto the first left-eye image Img_L1 in the first stereoscopic format image SBS71, and draws the sub-right-eye image SR1 of image region ROI_72 onto the first right-eye image Img_R1 in the first stereoscopic format image SBS71. It should be noted that processor 130 can perform image scaling processing on the sub-right-eye image SR1 and sub-left-eye image SL1 of image region ROI_72. Next, processor 130 draws the image content of image region ROI_73 onto the first left-eye image Img_L1 and the first right-eye image Img_R1 in the first stereoscopic format image SBS71. Finally, the processor 130 can perform image weaving processing on the first stereoscopic format image SBS71 and drive the first stereoscopic display 110 to display the weaving frame WF71.

[0049] Therefore, the processor 130 can generate a first stereoscopic format image SBS71 based on the image content of the display frame F2. By identifying multiple image regions ROI_71 to ROI_73 and assigning corresponding rendering priorities, it is possible to avoid the omission or unclear display of two-dimensional content image regions (e.g., image region ROI_73) located in the three-dimensional content image region. That is, it is possible to prevent the image content of image region ROI_73 from being seen only by the viewer's left or right eye.

[0050] Back Figure 3In step S350, the first stereoscopic display 110, operating in stereoscopic display mode, displays the first stereoscopic format image. In some embodiments, in response to receiving a user instruction or determining that the display frame includes a three-dimensional content image area, the processor 130 can control the first stereoscopic display 110 to operate in stereoscopic display mode to display the first stereoscopic format image. Specifically, when the first stereoscopic display 110 is a naked-eye stereoscopic display, the processor 130 can perform image weaving processing on the first stereoscopic format image (e.g., an SBS image) to obtain a woven image. This image weaving processing arranges the pixels of the left-eye image and the right-eye image of the first stereoscopic format image alternately within the woven frame. Subsequently, when the first stereoscopic display 110 operates in stereoscopic display mode, the display panel 111 of the first stereoscopic display 110 displays the woven image, and the refractive function of the lens layer 112 of the first stereoscopic display 110 is enabled, allowing the viewer to experience a stereoscopic visual effect.

[0051] For example, in the scenario where the processor 130 is running video conferencing software, the first stereoscopic display 110 can display stereoscopic streaming content provided by the meeting participants and a two-dimensional window operation interface, and the user can experience stereoscopic visual effects on the stereoscopic streaming content provided by the meeting participants.

[0052] Figure 8 This is a schematic diagram of a stereoscopic image display system according to an embodiment of this disclosure. Please refer to... Figure 8 The stereoscopic image display system 200 may include a first stereoscopic display 110, a storage device 120, at least one processor 130, and a second stereoscopic display 140. The first stereoscopic display 110, storage device 120, and processor 130 may be referenced... Figure 1 The details of the previous description are omitted here. In this embodiment, the stereoscopic image display system 200 may further include a second stereoscopic display 140. The second stereoscopic display 140 may be a display with hardware specifications similar to the first stereoscopic display 110, and is also a display device that allows users to experience stereoscopic visual effects. The second stereoscopic display 140 and the first stereoscopic display 110 can be arranged side by side to achieve a splicing display function.

[0053] For example, Figure 9 This is a schematic diagram of a multi-stereoscopic display according to an embodiment of this disclosure. Please refer to... Figure 9The second stereoscopic display 140 can be arranged side-by-side with the first stereoscopic display 110. It is understood that the combined display of the second stereoscopic display 140 and the first stereoscopic display 110 can increase the display range. Both the second stereoscopic display 140 and the first stereoscopic display 110 can, for example, be glasses-free stereoscopic displays. The first stereoscopic display 110 can be used to display a first stereoscopic format image, while the second stereoscopic display 140 can be used to display a second stereoscopic format image. Both the first and second stereoscopic format images can be side-by-side.

[0054] Figure 10 This is a flowchart of a stereoscopic image display method according to an embodiment of this disclosure. Please refer to... Figure 10 The operation process of this embodiment is applicable to the stereoscopic image display system 200 in the above embodiment. The following describes the detailed steps of this embodiment with reference to the various components in the stereoscopic image display system 200.

[0055] In step S1010, processor 130 acquires a display frame. In step S1020, processor 130 can identify multiple image regions from the display frame. In step S1030, processor 130 can determine the rendering priority of each image region based on its regional characteristics. Detailed implementation of steps S1010 to S1030 can be found in [reference needed]. Figure 3 The explanation is omitted here.

[0056] In this embodiment, in step S1040, the processor 130 can sequentially draw the image content of each image region into a first stereoscopic format image including a first left-eye image and a first right-eye image, and into a second stereoscopic format image including a second left-eye image and a second right-eye image, according to the drawing priority of each image region. Step S1040 can be implemented as steps S1041 to S1048.

[0057] In step S1041, the processor 130 begins to process multiple image regions one by one according to the rendering priority of each image region. That is, the processor 130 begins to render the image content of these image regions one by one into the first stereoscopic format image and / or the second stereoscopic format image according to the rendering priority of each image region.

[0058] In step S1042, the processor 130 determines whether there are any unprocessed image regions. That is, the processor 130 determines whether there are any image regions that have not yet been drawn into the first stereoscopic format image and / or the second stereoscopic format image.

[0059] If step S1042 determines that it is true, the processor 130 selects an image region that has not yet been drawn into the first stereoscopic format image and / or the second stereoscopic format image as the currently processed image region. Next, in step S1043, the processor 130 determines whether the currently processed image region crosses the display splicing boundary. That is, the processor 130 determines whether the currently processed image region has part of its image content appearing in the first stereoscopic display 110 and another part of its image content appearing in the second stereoscopic display 140.

[0060] If step S1043 determines otherwise, in step S1044, processor 130 determines whether the currently processed image region is a two-dimensional content image region or a three-dimensional content image region. If processor 130 determines that the currently processed image region is a two-dimensional content image region, proceed to step S1045. In step S1045, processor 130 draws the two-dimensional content image region in the left-eye and right-eye images of one of the stereoscopic format images. For example, if the currently processed image region is located within the display area of ​​the first stereoscopic display 110, processor 130 draws the two-dimensional content image region in the left-eye and right-eye images of the first stereoscopic format image. Alternatively, if the currently processed image region is located within the display area of ​​the second stereoscopic display 140, processor 130 draws the two-dimensional content image region in the left-eye and right-eye images of the second stereoscopic format image. It should be noted that the two-dimensional content image region will be drawn simultaneously in the left-eye and right-eye images of a stereoscopic format image.

[0061] If the processor 130 determines that the currently processed image region is a three-dimensional content image region, proceed to step S1046. In step S1046, the processor 130 draws the sub-left-eye image of the three-dimensional content image region onto the left-eye image of one of the stereoscopic format images, and draws the sub-right-eye image of the three-dimensional content image region onto the right-eye image of one of the stereoscopic format images. For example, if the currently processed image region is located within the display area of ​​the first stereoscopic display 110, the processor 130 draws the sub-left-eye image of the three-dimensional content image region onto the left-eye image of the first stereoscopic format image, and draws the sub-right-eye image of the three-dimensional content image region onto the right-eye image of the first stereoscopic format image. Alternatively, if the currently processed image region is located within the display area of ​​the second stereoscopic display 140, the processor 130 draws the sub-left-eye image of the three-dimensional content image region onto the left-eye image of the second stereoscopic format image, and draws the sub-right-eye image of the three-dimensional content image region onto the right-eye image of the second stereoscopic format image.

[0062] If step S1043 determines that it is true, in step S1047, the processor 130 divides the currently processed image area into multiple parts. When the currently processed image area is a two-dimensional content image area that spans the boundary of the display splicing, the processor 130 can divide this two-dimensional content image area into a first 2D part and a second 2D part. When the currently processed image area is a three-dimensional content image area that spans the boundary of the display splicing, the processor 130 can divide the sub-left-eye image of this three-dimensional content image area into a first left part and a second left part, and divide the sub-right-eye image of this three-dimensional content image area into a first right part and a second right part.

[0063] Next, in step S1048, the processor 130 draws multiple portions of the image region in the left-eye and right-eye images of the first stereoscopic format image and the left-eye and right-eye images of the second stereoscopic format image. When the currently processed image region is a two-dimensional content image region that spans the display splicing boundary, the processor 130 can draw the first 2D portion in the left-eye and right-eye images of the first stereoscopic format image and draw the second 2D portion in the left-eye and right-eye images of the second stereoscopic format image.

[0064] If the currently processed image area is a three-dimensional content image area that spans the boundary of the display panel, the processor 130 can draw the first left portion of the sub-left-eye image of the three-dimensional content image area in the first left-eye image of the first stereoscopic format image, and draw the first right portion of the sub-right-eye image of the three-dimensional content image area in the first right-eye image of the first stereoscopic format image. Furthermore, the processor 130 can draw the second left portion of the sub-left-eye image of the three-dimensional content image area in the second left-eye image of the second stereoscopic format image, and draw the second right portion of the sub-right-eye image of the three-dimensional content image area in the second right-eye image of the second stereoscopic format image.

[0065] For example, Figure 11 This is a schematic diagram illustrating the drawing of a first stereoscopic image and a second stereoscopic image according to an embodiment of this disclosure. Please refer to... Figure 11 In this example, the first stereoscopic display 110 and the second stereoscopic display 140 have the same display size and resolution. The processor 130 can acquire a display frame F11 jointly displayed by the first stereoscopic display 110 and the second stereoscopic display 140. The processor 130 can identify a three-dimensional content image region ROI_111 from the display frame F11 and determine that the three-dimensional content image region ROI_111 crosses the display splicing boundary. The three-dimensional content image region ROI_111 includes a sub-left-eye image L and a sub-right-eye image R.

[0066] When the 3D content image region ROI_111 crosses the display splicing boundary, the processor 130 can divide the left-eye image L into a first left part L' and a second left part L, and divide the right-eye image R into a first right part R' and a second right part R.

[0067] Subsequently, the processor 130 may draw a first portion of the two-dimensional background area of ​​display frame F11 in the first left-eye image 71L and the first right-eye image 71R of the first stereoscopic format image SBS_1. The processor 130 may then draw a second portion of the two-dimensional background area of ​​display frame F11 in the first left-eye image 72L and the first right-eye image 72R of the second stereoscopic format image SBS_2.

[0068] Next, processor 130 can draw the first left portion L' of the child left-eye image L onto the first left-eye image 71L of the first stereoscopic image SBS_1. Processor 130 can draw the first right portion R' of the child right-eye image R onto the first right-eye image 71R of the first stereoscopic image SBS_1. Processor 130 can draw the second left portion L” of the child left-eye image L onto the second left-eye image 72L of the second stereoscopic image SBS_2. Processor 130 can draw the second right portion R” of the child right-eye image R onto the second right-eye image 72R of the second stereoscopic image SBS_2.

[0069] The processor 130 can perform image weaving processing on the first stereoscopic format image SBS_1 to generate a woven image frame WF1, and perform image weaving processing on the second stereoscopic format image SBS_2 to generate a woven image frame WF2. The woven image frame WF1 is displayed by the first stereoscopic display 110, while the woven image frame WF2 is displayed by the second stereoscopic display 140. Therefore, the stereoscopic image content of the three-dimensional content image region ROI_111 can be presented by splicing the first stereoscopic display 110 and the second stereoscopic display 140, and the user can experience the stereoscopic visual effect brought by the three-dimensional content image region ROI_111.

[0070] For example, Figure 12 This is a schematic diagram of a first stereoscopic format image and a second stereoscopic format image according to an embodiment of this disclosure. Please refer to... Figure 12 In this example, the first stereoscopic display 110 and the second stereoscopic display 140 have the same display size and resolution. The processor 130 can acquire the display frame F12 jointly displayed by the first stereoscopic display 110 and the second stereoscopic display 140. The processor 130 can identify the two-dimensional content image region ROI_121 from the display frame F12 and determine that the two-dimensional content image region ROI_121 crosses the display splicing boundary.

[0071] Processor 130 can divide the two-dimensional content image region ROI_121 into a first 2D portion P1 and a second 2D portion P2. Processor 130 can draw the first 2D portion P1 of the two-dimensional content image region in the first right-eye image 81R and the first left-eye image 81L of the first stereoscopic image SBS_3. Processor 130 can draw the second 2D portion P2 of the two-dimensional content image region in the second right-eye image 82R and the second left-eye image 82L of the second stereoscopic image SBS_4. In this example, the first right-eye image 81R of the first stereoscopic image SBS_3 can be the same as the first left-eye image 81L of the first stereoscopic image SBS_3. The second right-eye image 82R of the second stereoscopic image SBS_4 can be the same as the second left-eye image 82L of the second stereoscopic image SBS_4. The processor 130 can perform image weaving processing on the first stereoscopic format image SBS_3 to generate a woven image frame for the first stereoscopic display 110, and perform image weaving processing on the second stereoscopic format image SBS_4 to generate a woven image frame for the second stereoscopic display 140.

[0072] Back Figure 10 In step S1050, a first stereoscopic image is displayed by a first stereoscopic display 110 operating in stereoscopic display mode, and a second stereoscopic image is displayed by a second stereoscopic display 140 operating in stereoscopic display mode. The processor 130 can perform image weaving processing on the first stereoscopic image and drive the first stereoscopic display 110 to display the woven frame of the first stereoscopic image. The processor 130 can also perform image weaving processing on the second stereoscopic image and drive the second stereoscopic display 140 to display the woven frame of the second stereoscopic image.

[0073] In some embodiments, when the first stereoscopic display 110 and the second stereoscopic display 140 provide a splicing display function, the first stereoscopic display 110 and the second stereoscopic display 140 can synchronously display a first stereoscopic format image and a second stereoscopic format image corresponding to the same display frame according to the vertical synchronization signal (V-sync signal) or other control signals provided by the GPU.

[0074] It should be noted that, in some embodiments, when the processor 130 generates the image content of the second stereoscopic format image or the first stereoscopic format image based on the image area in the display frame, the processor 130 may perform image scaling processing on the image content of the image area in the display frame as needed.

[0075] In summary, in this disclosed embodiment, after acquiring the display frame, multiple image regions in the display frame can be identified. These image regions include two-dimensional content image regions and three-dimensional content image regions. The rendering priority of each image region can be determined based on the regional characteristics of each image region. The image content of these image regions will be sequentially rendered in the left-eye and right-eye images of the first stereoscopic format image. Based on this, it can be ensured that the stereoscopic image content and two-dimensional image content of the display frame can be displayed correctly, allowing users to experience a novel visual experience. Furthermore, in this embodiment of the invention, multiple 3D display devices can be spliced ​​together to create a wider display range. Based on this, the splicing display function of multiple 3D display devices can be realized, allowing users to experience a better 3D immersion due to a larger field of view.

[0076] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A stereoscopic image display method suitable for a stereoscopic image display system including a first stereoscopic display, characterized by, The method comprises: acquiring a display frame; identifying a plurality of image regions from the display frame, wherein the plurality of image regions comprises two-dimensional content image regions and three-dimensional content image regions; determining a rendering priority of each of the plurality of image regions according to a region characteristic of each of the plurality of image regions; rendering image content of each of the plurality of image regions in a first stereoscopic format image comprising a first left-eye image and a first right-eye image according to the rendering priority of each of the plurality of image regions; and displaying the first stereoscopic format image by the first stereoscopic display operating in a stereoscopic display mode. The step of determining the rendering priority of each of the plurality of image regions according to the region characteristic of each of the plurality of image regions comprises:

2. The stereoscopic image display method according to claim 1, characterized by, determining the rendering priority of each of the plurality of image regions according to a window depth of a window corresponding to each of the plurality of image regions. The step of determining the rendering priority of each of the plurality of image regions according to the region characteristic of each of the plurality of image regions comprises:

3. The stereoscopic image display method according to claim 1, characterized by, determining the rendering priority of each of the plurality of image regions according to a block boundary position of each of the plurality of image regions. The step of determining the rendering priority of each of the plurality of image regions according to the region characteristic of each of the plurality of image regions comprises:

4. The stereoscopic image display method according to claim 1, wherein determining the rendering priority of each of the plurality of image regions according to a region size of each of the plurality of image regions. The step of identifying the plurality of image regions from the display frame comprises:

5. The stereoscopic image display method according to claim 1, wherein acquiring window information of an application; and identifying at least one of the plurality of image regions according to the window information. The step of identifying the plurality of image regions from the display frame comprises:

6. The stereoscopic image display method of claim 1, characterized by, identifying a three-dimensional content block in the display frame to identify the three-dimensional content image regions in the plurality of image regions. The step of rendering image content of each of the plurality of image regions in the first stereoscopic format image comprising the first left-eye image and the first right-eye image according to the rendering priority of each of the plurality of image regions comprises:

7. The stereoscopic image display method of claim 1, characterized by, acquiring a sub-left-eye image and a sub-right-eye image of the three-dimensional content image region; rendering the sub-left-eye image in the first left-eye image of the first stereoscopic format image and rendering the sub-right-eye image in the first right-eye image of the first stereoscopic format image; and rendering the two-dimensional content image region in the first right-eye image and the first left-eye image of the first stereoscopic format image. The step of rendering image content of each of the plurality of image regions in the first stereoscopic format image comprising the first left-eye image and the first right-eye image according to the rendering priority of each of the plurality of image regions comprises:

8. The stereoscopic image display method of claim 1, characterized by, rendering image content of a first image region before rendering image content of a second image region in response to the rendering priority of the first image region being higher than the rendering priority of the second image region, wherein the image content of the second image region partially overlaps on the image content of the first image region. ​ 9. The stereoscopic image display method of claim 1, characterized by, The stereoscopic image display system further comprises a second stereoscopic display, and the step of sequentially drawing image contents of the multiple image regions into the first stereoscopic format image comprising the first left-eye image and the first right-eye image according to the drawing priority of each of the multiple image regions comprises: sequentially drawing image contents of the multiple image regions into the first stereoscopic format image comprising the first left-eye image and the first right-eye image and into a second stereoscopic format image comprising a second left-eye image and a second right-eye image according to the drawing priority of each of the multiple image regions, wherein the method further comprises: displaying the second stereoscopic format image by the second stereoscopic display operating in a stereoscopic display mode.

10. The stereoscopic image display method according to claim 9, wherein The stereoscopic image display system further comprises a second stereoscopic display, and the step of sequentially drawing image contents of the multiple image regions into the first stereoscopic format image comprising the first left-eye image and the first right-eye image according to the drawing priority of each of the multiple image regions comprises: when the three-dimensional content image region spans a display tiling boundary, dividing a sub-left-eye image of the three-dimensional content image region into a first left portion and a second left portion, and dividing a sub-right-eye image of the three-dimensional content image region into a first right portion and a second right portion; drawing the first left portion of the sub-left-eye image of the three-dimensional content image region into the first left-eye image of the first stereoscopic format image, and drawing the first right portion of the sub-right-eye image of the three-dimensional content image region into the first right-eye image of the first stereoscopic format image; and drawing the second left portion of the sub-left-eye image of the three-dimensional content image region into the second left-eye image of the second stereoscopic format image, and drawing the second right portion of the sub-right-eye image of the three-dimensional content image region into the second right-eye image of the second stereoscopic format image.

11. A stereoscopic image display system, characterized by comprising: comprises: a first stereoscopic display; and at least one processor coupled to the first stereoscopic display and configured to: obtain a display frame; identify a plurality of image regions from the display frame, wherein the plurality of image regions comprises two-dimensional content image regions and three-dimensional content image regions; determine a drawing priority of each of the plurality of image regions according to a region characteristic of each of the plurality of image regions; and sequentially draw image contents of the multiple image regions into a first stereoscopic format image comprising a first left-eye image and a first right-eye image according to the drawing priority of each of the multiple image regions, wherein the first stereoscopic display operating in a stereoscopic display mode displays the first stereoscopic format image.

12. The stereoscopic image display system of claim 11, wherein, The processor is further configured to: determine the drawing priority of each of the multiple image regions according to a window depth of a window corresponding to each of the multiple image regions.

13. The stereoscopic image display system of claim 11, wherein, The processor is further configured to: determine the drawing priority of each of the multiple image regions according to a block boundary position of each of the multiple image regions.

14. The stereoscopic image display system of claim 11, wherein, The processor is further configured to: The rendering priorities of the multiple image regions are determined according to region sizes of the multiple image regions.

15. The stereoscopic image display system of claim 11, wherein, The processor is further configured to: obtain window information of an application; and identify at least one of the multiple image regions according to the window information.

16. The stereoscopic image display system of claim 11, wherein, The processor is further configured to: identify a 3D content block in the display frame to identify the 3D content image region of the multiple image regions.

17. The stereoscopic image display system of claim 11, wherein, The processor is further configured to: obtain a sub-left-eye image and a sub-right-eye image of the 3D content image region; render the sub-left-eye image in the first left-eye image of the first stereoscopic format image and render the sub-right-eye image in the first right-eye image of the first stereoscopic format image; and render the 2D content image region in the first right-eye image and the first left-eye image of the first stereoscopic format image. The processor is further configured to:

18. The stereoscopic image display system of claim 11, wherein, render image content of a first image region before image content of a second image region in response to the rendering priority of the first image region being higher than the rendering priority of the second image region, wherein the image content of the second image region partially overlaps the image content of the first image region. The system further comprises a second stereoscopic display, and the processor is further configured to:

19. The stereoscopic image display system of claim 11, wherein, render image content of each of the multiple image regions in a first stereoscopic format image comprising the first left-eye image and the first right-eye image and in a second stereoscopic format image comprising a second left-eye image and a second right-eye image in sequence according to the rendering priorities of the multiple image regions, wherein the second stereoscopic format image is displayed by the second stereoscopic display operating in a stereoscopic display mode. The processor is further configured to:

20. The stereoscopic image display system of claim 19, wherein, divide a sub-left-eye image of the 3D content image region into a first left portion and a second left portion and divide a sub-right-eye image of the 3D content image region into a first right portion and a second right portion when the 3D content image region spans a display tiling boundary; render the first left portion of the sub-left-eye image of the 3D content image region in the first left-eye image of the first stereoscopic format image and render the first right portion of the sub-right-eye image of the 3D content image region in the first right-eye image of the first stereoscopic format image; and render the second left portion of the sub-left-eye image of the 3D content image region in the second left-eye image of the second stereoscopic format image and render the second right portion of the sub-right-eye image of the 3D content image region in the second right-eye image of the second stereoscopic format image. ​ ​

Images