Stereo image pair from monoscopic image blur

Abstract

An autostereoscopic display system can generate a stereoscopic image pair from a monoscopic image. Processing circuitry can receive data specifying a monoscopic image. The processing circuitry can generate a plurality of temporary disparity maps from the monoscopic image, the temporary disparity maps having different convergence planes. A final convergence plane can be based on a blur and disparity characteristic of the monoscopic image. For example, the autostereoscopic display system can select a temporary disparity map that is most similar to a blur intensity map as a final disparity map. As another example, the autostereoscopic display system can interpolate between adjacent convergence planes to generate a final disparity map that is most similar to a blur intensity map. The processing circuitry can generate a stereoscopic image pair using the monoscopic image and the final disparity map. The autostereoscopic display system can include an autostereoscopic display to display the stereoscopic image pair.

Description

[0001] Cross-references to related applications

[0002] This application claims the benefit of U.S. Provisional Application No. 63 / 623,747, filed January 22, 2024, the entire contents of which are incorporated herein by reference. Technical Field

[0003] This document generally relates to display systems, and more specifically to multi-view displays, 3D displays, or autostereoscopic displays. Background Technology

[0004] Multi-view displays can provide viewers with different views of a multi-view image. Stereo displays can provide two different views of a three-dimensional image to both of the viewer's eyes. Autostereo displays can provide two different views to both of the viewer's eyes without requiring the viewer to wear special glasses or goggles. Efforts are underway to improve autostereo displays. Summary of the Invention

[0005] In one example, an autostereoscopic display system may include processing circuitry capable of performing operations. These operations may include: receiving data from a specified single-field-of-view image; specifying an initial convergence plane; generating a final disparity map based on the single-field-of-view image and a final convergence plane spaced apart from the initial convergence plane, the final convergence plane being based on the blur and disparity characteristics of the single-field-of-view image; and generating a stereoscopic image pair using the single-field-of-view image and the final disparity map.

[0006] In one example, a method may include generating a stereo image pair from a single field-of-view image. An automatic stereo system may optionally be used to display the stereo image pair. The method may include: receiving data of a specified single field-of-view image using processing circuitry; specifying an initial convergence plane using processing circuitry; generating a final disparity map based on the single field-of-view image and a final convergence plane spaced apart from the initial convergence plane using processing circuitry, the final convergence plane being based on blur and disparity characteristics of the single field-of-view image; and generating a stereo image pair using the single field-of-view image and the final disparity map using processing circuitry.

[0007] The content of this document is intended to provide an overview of the subject matter. It is not intended to provide an exclusive or exhaustive explanation of the invention. Detailed descriptions are included to provide further information about the subject matter. Attached Figure Description

[0008] Figure 1 An exploded perspective diagram of an example of a multi-view display system is shown.

[0009] Figure 2 A front view of an example display panel including an array of light-emitting diodes is shown.

[0010] Figure 3 A front view of an example display panel including backlight and light valve array is shown.

[0011] Figure 4 A front view of an example of a parallax-generating optics device including a lenticular lens is shown.

[0012] Figure 5 It shows Figure 4 A cross-sectional view of a cylindrical lens.

[0013] Figure 6 A front view of an example of a parallax-generating optics including a parallax barrier is shown.

[0014] Figure 7 A transmission slit is shown. Figure 6 A cross-sectional view of the parallax barrier.

[0015] Figure 8 Examples of various quantities associated with generating stereo image pairs from single-view images are shown.

[0016] Figure 9 A flowchart illustrating an example of a method for generating stereo image pairs from a single field-of-view image is shown.

[0017] Figure 10 A schematic diagram illustrating an example of determining the final convergence plane based on the blur and parallax characteristics of a single field-of-view image is shown. Detailed Implementation

[0018] When taking an image, a photographer can choose to draw attention to the object of interest in a scene by making the plane containing the object in sharp focus. Other objects in the scene that are far from the plane may appear blurry, with the amount of blur proportional to their distance from the plane. Blur typically refers to a lack of sharpness or clarity in all or part of an image. Blur occurs when the boundaries between different elements or objects in an image become less distinct, resulting in a softening or trailing effect.

[0019] To generate stereoscopic image pairs from an image, an autostereoscopic display system can use fuzzy information from the image to determine where to locate the convergence plane of the stereoscopic image pairs. This allows the object of interest to appear at or near the plane of the autostereoscopic display.

[0020] Autostereoscopic display systems can use one or more of the following techniques to identify blur characteristics in an image: In edge detection, the system can analyze the sharpness of edges in an image to determine the level of blur. Blurred images may have fewer defined edges. In frequency domain analysis, the system can transform the image to the frequency domain (e.g., using a Fourier transform) to reveal blur characteristics. Blurred images may have fewer high-frequency components. In magnitude, the system can calculate gradient magnitudes on the image to help identify blurred regions. Blurred regions may have lower gradient values. In Laplacian variance, the system can calculate the Laplacian variance of the image to provide a measurement of image focus. Lower variance may indicate more blur. In point spread function (PSF) estimation, the system can estimate the PSF to help characterize the type and degree of blur in the image. In blur kernel, the system can analyze the shape and size of the blur kernel to help identify the nature of the blur (such as motion blur or defocus blur). In machine learning methods, the system can use trained models to detect and classify blur characteristics based on various image features. In histogram analysis, automated stereoscopic display systems can examine the histogram of pixel intensity to reveal blur characteristics. Blurred images can have narrow histograms. These techniques can be used individually or in combination to assess the presence, type, and degree of blur in an image.

[0021] A blur intensity map can quantify the blur of an image, such as a single-view image or a pair of stereo images, one or both. For example, a blur intensity map can be an array, such as one with the same size as the image. The value of the blur intensity map at a specific pixel can correspond to the blur value at that specific pixel in the image.

[0022] Typically, quantity disparity can be represented as the horizontal distance between the left and right images of a stereoscopic image pair of the same point in a scene. In other words, disparity can correspond to the distance between a pixel in the left (right) image and its horizontal counterpart in the right (left) image. This assumes the viewer is orthogonally oriented such that the viewer's left and right eyes are at the same height, and the axis connecting the left and right eyes is horizontal.

[0023] A disparity map quantifies the disparity of a stereo image pair. For example, a disparity map can be an array, such as one with the same size as the images of the stereo image pair. The value of the disparity map at a particular pixel can correspond to the disparity value at that particular pixel in the image of the stereo image pair.

[0024] The convergence plane is the plane in the scene where the parallax is zero. For objects in the scene on one side of the convergence plane, the parallax is positive. For objects in the scene on the other side of the convergence plane, the parallax is negative.

[0025] When an autostereoscopic display shows stereoscopic image pairs, objects in the scene at the convergence plane appear to be at the plane of the autostereoscopic display. Objects in the scene closer to the viewer than the convergence plane appear to be above the autostereoscopic display. Objects in the scene farther from the viewer than the convergence plane appear to be below the autostereoscopic display.

[0026] Generally, a disparity map can contain the same amount of information as a depth map, allowing one disparity map to be generated from another. Furthermore, for a data structure consisting of a left image, a right image, and a disparity map, any two of the three data structures can be used to create the third.

[0027] Furthermore, image processing software exists that can be executed by processing circuitry to generate artificial or simulated disparity maps from a (single) single-view image using artificial intelligence. For example, the processing circuitry system can use a fully convolutional neural network model. The neural network model can include an encoder based on a residual neural network (ResNet). The neural network model can include a decoder configuration with skip connections similar to those in U-Net. The architecture of U-Net can include encoder paths (also called shrinking paths) and decoder paths (also called expanding paths). The encoder can extract features from the input image. The decoder can project these features onto the pixel space to produce dense classifications. The encoder and decoder can be symmetric and connected by paths, which can give the model a "U" shape. The convolutional neural network model can include millions (or more) of trainable parameters, such as those that can be trained on multiple (e.g., thousands, millions) images with known disparity characteristics. The processing circuitry can use this model to process a (single) single-view image and provide the corresponding disparity map.

[0028] Autostereoscopic display systems can partially utilize blur properties to generate stereoscopic image pairs from a single-field-of-view image. For example, an autostereoscopic display system can generate a blur intensity map from a single-field-of-view image. An autostereoscopic display system can generate multiple temporary disparity maps from a single-field-of-view image. These temporary disparity maps can have different convergence planes. In some examples, the autostereoscopic display system can select the temporary disparity map most similar to the blur intensity map as the final disparity map. In some examples, the autostereoscopic display system can interpolate between adjacent convergence planes to generate the final disparity map most similar to the blur intensity map. An autostereoscopic display system can use the single-field-of-view image and the final disparity map to generate stereoscopic image pairs.

[0029] When stereoscopic images are displayed on an autostereoscopic display, objects in the scene that are at or near the convergence plane (e.g., objects that are relatively sharp and in focus in a single-view image) will appear to be at or near the plane of the autostereoscopic display. Objects in the scene that are far from the convergence plane (e.g., objects that are relatively blurry in a single-view image) will appear to be above or below the plane of the autostereoscopic display.

[0030] The preceding paragraphs merely summarize some aspects of the image generation and display techniques described in detail below, and should not be construed as limiting in any way.

[0031] Figure 1 An exploded perspective schematic diagram of an example of a multi-view display system 100 including a multi-view display 110 is shown. Figure 1 The configuration is just one example of the multi-view display system 100; other configurations can be used.

[0032] Figure 1 The notation shown and used below assumes that the multi-view display 110 is in ( x , y The z-axis extends in the plane, and extends away from the multiview display 110 along a direction orthogonal to the plane of the multiview display 110 and generally toward the viewer 42. Other notation conventions may be used.

[0033] The multiview display system 100 may include a multiview display 110. The multiview display 110 may provide different views of a multiview image to a viewer 42. For example, as the viewer 42 moves in space, the multiview display 110 may direct different views of the multiview image to the viewer 42's left and right eyes, allowing the viewer 42 to observe different views of the multiview image from different positions or orientations. In some configurations, the multiview display 110 may provide multiple views at various fixed location areas in space, allowing the multiview display 110 to operate without eye tracking. In other configurations, such as the autostereoscopic configuration described in detail below, the multiview display system 100 may use eye tracking to dynamically and continuously (or at relatively frequent discrete times) determine the viewer 42's position, and in response, may dynamically and continuously control how the multiview display 110 displays the multiview image, such that as the viewer 42 moves in space relative to the position of the multiview display 110, the multiple views follow the viewer 42 or follow the tracked eye position of the viewer 42.

[0034] For a multi-view display 110 configured to provide only two different views of a multi-view image, the multi-view display 110 can be an autostereoscopic display or a three-dimensional (3D) display. An autostereoscopic display can provide a left image to the left eye of viewer 42 and a right image to the right eye of viewer 42. The left and right images can correspond to different views of an object or scene, and can allow viewer 42 to perceive the object or scene in 3D using only the viewer's naked eye without the use of additional glasses or a head-mounted device.

[0035] The multi-view display system 100 may include a viewer tracker 120 capable of dynamically determining the position of a viewer 42. The multi-view display system 100 can use the determined position of the viewer 42 to guide a left image to the viewer 42's left eye and a right image to the viewer 42's right eye. Because the viewer's position can change as the viewer 42 moves in space, eye tracking allows the multi-view display system 100 to follow the viewer 42, enabling the autostereoscopic display to automatically guide the left image to the left eye and the right image to the right eye at the viewer 42's (dynamically changing) position. The viewer tracker 120 can provide the tracking position of the viewer 42, such as the tracking position of the viewer 42's head, the tracking position of one or both eyes of the viewer 42, or the tracking position of another anatomical feature of the viewer 42. Viewer tracker 120 may be coupled to processing circuitry 130 (described below) or a controller, such as by providing viewer 42 positioning data representing the measured position or location of viewer 42 (in Figure 1 The coordinates are shown in the figure. xv , yv and zvViewer tracker 120 may provide viewer 42 position data to processing circuitry 130 at regular or irregular intervals. In a particular example of viewer tracker 120, a camera may capture an image of viewer 42. Viewer tracker 120 may also include an image processor (or a general-purpose computer programmed as an image processor) that can determine the position of viewer 42 within the captured image to provide the tracked position. In some examples, processing circuitry 130 may include the image processor of viewer tracker 120. In other examples, processing circuitry 130 may be separate from the image processor of viewer 42 tracker. Other suitable viewer trackers may be used, including those based on lidar (e.g., using the time-of-flight of reflected light on a scene to determine distances to one or more objects in the scene, such as the viewer's head or the viewer's eyes) or other technologies. Processing circuitry 130 may use the output of viewer tracker 120, along with other data, to perform one or more downstream calculations involving providing a left view or left image to viewer 42's left eye and a right view or right image to viewer 42's right eye.

[0036] An autostereoscopic display can be a lenticular autostereoscopic display. In a lenticular autostereoscopic display, display panel 112 can display multi-view images, and parallax generating optics 118 can guide light from display panel 112 to viewer 42, such that the left image can be seen from viewer 42's left eye and the right image from viewer 42's right eye. During the use of the lenticular autostereoscopic display, processing circuitry 130 can track the position of viewer 42 and can use the tracked position to dynamically determine how to distribute the content of the multi-view images on the surface area of ​​display panel 112 (e.g., using pixels distributed on display panel 112), so that even if viewer 42 changes position, the left image remains visible from viewer 42's left eye and the right image remains visible from viewer 42's right eye. In this way, position tracking and image content distribution can be performed in software, so that following viewer 42's position does not involve physically moving any components of the lenticular autostereoscopic display relative to each other. Examples of suitable display panels and suitable parallax generating optics are described below.

[0037] In the example, display panel 112 can display a multi-view image. Display panel 112 may have an array of subpixels 114 that can display the image according to stereoscopic coordinates associated with viewer 42. Subpixels 114 may be located in a grid with axes (e.g., x shaft and yThe sub-pixel 114 is located at a sub-pixel position in the grid of the axis. Each sub-pixel 114 can generate light with a specified color. For example, sub-pixels 114 may include red sub-pixels, green sub-pixels, and blue sub-pixels that generate red, green, and blue light, respectively. Other color / wavelength schemes may be used. Sub-pixels 114 can be divided into pixels, wherein each pixel includes at least two sub-pixels 114 that generate light of different colors. The display panel 112 can receive display panel drive electrical signals 138 from the processing circuit 130 (described below), which can specify how the content of the multi-view image is distributed on the pixels and / or sub-pixels 114 of the display panel 112. The following description and Figure 2 and Figure 3 The diagram shows two possible configurations for the display panel 112. Other configurations can also be used.

[0038] Figure 2 A front view of an example display panel 112A including an array 202 of light-emitting diodes 204 (such as an array 202 of organic light-emitting diodes) is shown. Each light-emitting diode 204 may correspond to a sub-pixel. The array 202 of light-emitting diodes 204 may include a red light-emitting diode 204R, a green light-emitting diode 204G, and a blue light-emitting diode 204B, which correspond to the red, green, and blue sub-pixels, respectively. Each light-emitting diode 204 may generate light in response to an electrical signal (such as a display panel drive signal 138) provided by processing circuitry 130 or by a suitable light-emitting diode driving circuitry communicating with processing circuitry 130. Processing circuitry 130 may directly power a designated light-emitting diode 204, the power varying according to the intensity at the corresponding location in the image. The power delivered to the light-emitting diodes 204 may optionally be pulse-width modulated at a modulation frequency greater than that perceptible to the human eye. Using pulse-width modulation simplifies the design of the light-emitting diode array controller because it can generate arbitrary average power levels from relatively small amounts of instantaneous power levels by changing the power duty cycle. In some examples, the array 202 of light-emitting diodes 204 may be arranged in a rectangular or square repeating pattern on the surface region 206 of the array 202. For example, the array 202 may have grid axes 208 that are orthogonal to each other. In some examples, the grid axes 208 may be parallel to the edge 210 of the array 202 of light-emitting diodes 204.

[0039] Figure 3 A front view of an example display panel 112B including a backlight 302 and a light valve array 304 is shown. Although Figure 3The backlight 302 and the light valve array 304 are shown as separate, but in practice, the backlight 302 and the light valve array 304 can be in contact or can be brought as close as possible together. The backlight 302 can provide illumination with a uniform or substantially uniform intensity over a surface area of ​​the backlight 302. The backlight 302 can provide illumination with a relatively broad spectrum, such as including most or all of the visible portion of the electromagnetic spectrum. The backlight 302 can provide illumination to a continuous propagation angle toward the light valve array 304. The backlight 302 can provide unmodulated illumination to the light valve array 304. The light valve array 304 can include light valves 306, which can be individually controlled by the processing circuitry 130 or can be controlled by the processing circuitry 130 in one or more groups (described below). Each light valve 306 can controllably attenuate the illumination from the backlight 302, for example, in response to an electrical signal provided by the processing circuitry 130, such as a display panel drive electrical signal 138, or an electrical signal provided by a suitable light valve drive circuit in communication with the processing circuitry 130. Each light valve 306 may have a corresponding color filter that allows only a portion of the electromagnetic spectrum to pass through the light valve. For example, light valve 306 may include a red light valve 306R, a green light valve 306G, and a blue light valve 306B. The red light valve 306R has a red filter that allows only red light to pass through it, the green light valve 306G has a green filter that allows only green light to pass through it, and the blue light valve 306B has a blue filter that allows only blue light to pass through it. Other color schemes and numbers of colors may be used. Suitable light valves may include liquid crystal light valves, electrophoretic light valves, electrowetting-based light valves, etc. In some examples, the light valves 306 of the light valve array 304 may be arranged in a rectangular or square repeating pattern on the surface region 308 of the light valve array 304. For example, the light valve array 304 may have grid axes 208 that are orthogonal to each other. In some examples, the grid axes 208 may be parallel to the edge 312 of the light valve array 304.

[0040] Refer again Figure 1 The autostereoscopic display may include a parallax generating optics 118 that directs light from the display panel 112 to the viewer 42 such that a left view or left image is visible from the viewer 42's left eye, and a right view or right image is visible from the viewer 42's right eye. Two possible configurations of the parallax generating optics 118 are described below and in Figure 4 and Figure 5 China and in Figure 6 and Figure 7 As shown in the diagram. Other configurations can be used. Figure 4 and Figure 5 as well as Figure 6 and Figure 7 Each configuration in can be compared with Figure 2 and Figure 3 Any configuration of the display panel 112 shown (e.g., Figure 2 LED array 204 or Figure 3 The backlight 302 and the light valve array 304 are used in combination.

[0041] Figure 4 A front view of an example of a parallax generating optics 118A including a cylindrical lens 402 is shown. Figure 5 It shows Figure 4 A cross-sectional view of the cylindrical lens 402. The cylindrical lens 402 may include a plurality of cylindrical lenses 504 spaced equidistantly. The cylindrical lens 402 may have a focal plane that coincides with the display panel 112. The cylindrical lens 402 may be positioned to receive light from the display panel 112 and at least partially focus the received light to direct the light to a designated area near the viewer's eye.

[0042] Figure 6 A front view of an example of a parallax generating optics 118B including a parallax barrier 602 is shown. The parallax barrier may include a plurality of equally spaced transmission slits 704. Figure 7 A parallax barrier 602 with a transmission slit 704 is shown. Figure 6 A cross-sectional view of the image is shown. The parallax barrier 602 may include an array of opaque strips 706 and thin transmission slits 704, arranged to obscure portions of the displayed image in the left and right viewing areas. The transmission slits 704 may be spatially arranged to ensure that the left / right image portions are visible only in their intended corresponding left / right viewing areas. The parallax barrier 602 may be provided by a static physical layer, where the slits are precisely positioned, or electronically generated on an adaptive intermediate liquid crystal display layer.

[0043] Parallax generating optics 118 can be positioned along a grid axis (e.g., x shaft and y The optical axis is at an angle to the axis. OA ) remains unchanged, such as the tilt angle of 45 degrees or approximately 45 degrees relative to the grid axis 208. α For example, the parallax generating optics 118 can have transmission characteristics, such as a cylindrical lens or a transmission slit, which are along the optical axis ( OA ) remains unchanged and along the optical axis ( OA Orthogonal axes are periodic.

[0044] Refer again Figure 1An autostereoscopic display may include a material 116 disposed between a display panel 112 and a parallax generating optics 118. In some examples, the material 116 may extend completely between the display panel 112 and the parallax generating optics 118, such that light originating from the display panel 112 passes only through the material 116 (and does not pass through any air or unfilled volume) before reaching the parallax generating optics 118. In other examples, the material 116 may occupy only a portion of the volume between the display panel 112 and the parallax generating optics 118, such that light originating from the display panel 112 passes through at least some of the material 116 and through a volume of air before reaching the parallax generating optics 118. The material 116 may have a quantity of n Refractive index. n The value can be between about 1.3 and about 2, but other suitable values ​​can be used. Suitable material 116 may include glass, plastic, transparent optical adhesive, etc. In some examples, material 116 may be dispensed in liquid form and then cured in place, such as by exposure to ultraviolet light or heat. In other examples, material 116 may be manufactured as a solid unit and placed in its position in the autostereoscopic display. For example, material 116 may be used as a cover glass for display panel 112. In some examples, material 116 may be used as a relatively precise spacer element. For example, material 116 may be manufactured to have a specified thickness within a specified thickness tolerance and the spacing between display panel 112 and parallax generating optics 118 may be set to a value equal to the specified thickness when assembling the autostereoscopic display.

[0045] like Figure 1 As shown, the multi-view display system 100 may include processing circuitry 130. Processing circuitry 130 may include non-transitory computer-readable storage medium 132, such as a hard disk drive, solid-state drive, memory, optical media, magnetic media, semiconductor media, punched card, etc. Non-transitory computer-readable storage medium 132 may be locally incorporated with processing circuitry 130, or may be located remotely from processing circuitry 130 and accessible via a wired or wireless connection. Non-transitory computer-readable storage medium 132 may store instructions 134 for performing some or all of the steps of a specific task or a series of tasks or a method of execution.

[0046] When executed by processing circuitry 130, instruction 134 can cause processing circuitry 130 to perform operation 136. For example, instruction 134 can be used to generate a stereo image pair from a single field-of-view image. Suitable operation 136 for generating a stereo image pair from a single field-of-view image can include the following operations: receiving data of a specified single field-of-view image using processing circuitry 130; generating a blur intensity map based on the single field-of-view image using processing circuitry 130; generating an initial disparity map using processing circuitry 130 based on the single field-of-view image and an initial convergence plane; generating a final disparity map using processing circuitry 130 based on the single field-of-view image and a final convergence plane spaced apart from the initial convergence plane, the final convergence plane being based on the blur and disparity characteristics of the single field-of-view image; and generating a stereo image pair using processing circuitry 130 with the single field-of-view image and the final disparity map. By performing these operations 136, processing circuitry 130 can cause multi-view display system 100 to perform the generation of a stereo image pair from a single field-of-view image. Operation 136 can also include using multi-view display system 100 to display the stereo image pair. These operations 136 are described in detail below.

[0047] Figure 8 Examples of various quantities 800 associated with operation 136, which generates stereo image pairs from a single field-of-view image, are shown. Quantities 800 can be data structures such as arrays, matrices, or variables. Quantities 800 can be stored in memory. When processing circuitry 130 performs operation 136, it can read one or more quantities 800 from memory and write one or more quantities 800 to memory. Quantities 800 are merely examples of quantities that can be used to generate stereo image pairs from a single field-of-view image. Other suitable quantities can be used.

[0048] Processing circuitry 130 can receive data for a specified single-view image 802. Data can be received from memory, local storage, or remote storage. The data can be included as one or more frames of a video signal, which can specify the single-view image 802 as one of a series of sequential single-view images.

[0049] Processing circuitry 130 can generate a blur intensity map 804 based on a single-field-of-view image 802. Typically, quantity blur corresponds to a measure of relative blur or lack of sharpness in an image. For example, in typical photography, a focused object may have relatively small blur, while an out-of-focus object may have relatively large blur. The blur intensity map can be an array with the same size as the accompanying image. The value of the blur intensity map at a specific pixel or pixel region can correspond to the amount of blur at that specific pixel or pixel region in the accompanying image. Objects in the focused scene have relatively small values ​​in the blur intensity map. Out-of-focus objects in the scene have relatively large values ​​in the blur intensity map. Image processing software (such as software executed by processing circuitry 130) can generate the blur intensity map from the single-field-of-view image.

[0050] Processing circuit 130 can generate multiple temporary disparity maps 806A, 806B, and 806C from a single field-of-view image 802. The temporary disparity maps 806A, 806B, and 806C can have different convergence planes. Figure 8 In the example, the multiple 806 temporary disparity maps include three temporary disparity maps 806A, 806B, and 806C. Alternatively, the multiple 806 temporary disparity maps may include two or more temporary disparity maps.

[0051] Processing circuit 130 can compare temporary disparity maps 806A, 806B, and 806C with a blur intensity map 804. Based on the comparison, processing circuit 130 can select the temporary disparity map most similar to blur intensity map 804 to form a final disparity map 808. Alternatively, processing circuit 130 can interpolate between adjacent convergence planes of temporary disparity maps 806A, 806B, and 806C to determine a final convergence plane, and use the final convergence plane to generate the final disparity map 808.

[0052] Processing circuitry 130 can generate a stereoscopic image pair 810 using a single-field-of-view image 802 and a final disparity map 808. The stereoscopic image pair 810 may include a left image 812 and a right image 814. When the autostereoscopic display presents the stereoscopic image pair 810 to a viewer, the autostereoscopic display directs the left image 812 to the viewer's left eye and the right image 814 to the viewer's right eye.

[0053] For method 900 discussed below, a single-view image 802 is the input, and a stereoscopic image pair 810 is the output. The stereoscopic image pair 810 can be displayed on an automated stereoscopic display, such as... Figure 1 A multi-view display system 100.

[0054] Figure 9 A flowchart illustrating an example of a method 900 for generating stereoscopic image pairs from a single field-of-view image is shown. Method 900 can be used in automated stereoscopic display systems (such as...) Figure 1 The method 900 is executed on a multi-view display system 100, applied to an autostereoscopic display system, or may be used by or with an autostereoscopic display system. The method 900 may be stored as instructions 134 on a non-transitory computer-readable storage medium 132. When executed by processing circuitry 130, instructions 134 may cause processing circuitry 130 to perform operation 136. Operation 136 may include operations detailed below with respect to method 900. Method 900 is merely one method for generating stereoscopic image pairs from a single-view image; other suitable methods may be used.

[0055] At operation 902, processing circuit 130 can receive data from a specified single-view image 802.

[0056] At operation 904, processing circuit 130 can generate a blur intensity map 804 based on single-view image 802.

[0057] At operation 906, processing circuit 130 can generate an initial disparity map based on single-view image 802 and initial convergence plane.

[0058] At operation 908, processing circuitry 130 can generate a final disparity map based on a single-view image 802 and a final convergence plane spaced apart from the initial convergence plane. The final convergence plane can be based on the blur and disparity characteristics of the single-view image 802. The similarity between the final disparity map and the blur intensity map can be greater than the similarity between the initial disparity map and the blur intensity map.

[0059] At operation 910, processing circuitry 130 can use single-view image 802 and final disparity map to generate stereo image pair 810.

[0060] The similarity between the final disparity map and the blur intensity map 804 can be greater than the similarity between the initial disparity map and the blur intensity map 804. In other words, the specific disparity map used by the processing circuit 130 to generate the stereo image pair 810 may not be the initial convergence plane.

[0061] Processing circuitry 130 can specify multiple temporary convergence planes spaced apart from each other. These temporary convergence planes may include an initial convergence plane. Processing circuitry 130 can generate multiple temporary disparity maps 806A, 806B, and 806C based on a single field-of-view image 802 and the corresponding multiple temporary convergence planes. These multiple temporary disparity maps 806A, 806B, and 806C may include the initial disparity map.

[0062] The processing circuit 130 can determine multiple similarity values. Each similarity value can represent the similarity between the fuzzy intensity map 804 and the corresponding temporary disparity map in the multiple temporary disparity maps 806.

[0063] As a specific example of forming similarity values, for each pixel (or group of pixels) of a single-view image, each of a plurality of similarity values ​​can be determined by: forming the numerator as a scalar product between the blur intensity map value at the pixel and the corresponding temporary disparity map value at the pixel; forming the denominator as the product of the magnitude of the blur intensity map value at the pixel and the magnitude of the corresponding temporary disparity map value at the pixel; dividing the numerator by the denominator to form a normalized value; and forming a similarity value for the image range from the normalized values ​​of the pixels in the single-view image as the similarity value. Other techniques for forming similarity values ​​can be used, such as using various statistical measures or machine learning methods.

[0064] Several techniques exist for combining pixel-specific values ​​into a single image width value. For example, an image range similarity value can include the sum of squares of the normalized values ​​of pixels in a single field of view. An image range similarity value can also include the square root of the sum of squares of the normalized values ​​of pixels in a single field of view. Alternatively, an image range similarity value can include the sum of the absolute values ​​of the normalized values ​​of pixels in a single field of view. These are merely examples; other techniques for combining pixel-specific values ​​into a single image width value can be used.

[0065] Figure 10 A schematic diagram illustrating an example of determining the final convergence plane based on the blur and parallax characteristics of a single field-of-view image is shown.

[0066] Figure 10 An example of blur intensity map 804 is shown at the top. Processing circuitry 130 can be based on a single field-of-view image 802 ( Figure 8 Generate a blurred intensity map 804. Figure 10 In the example, blur intensity map 804 shows a feature in the shape of a plus sign ("+"). Other shapes can be used. Figure 10 In the example, the plus sign is intended to focus, while the background of the plus sign is intended to defocus. More specifically, the blur intensity map 804 indicates that the single-view image includes a first portion (e.g., shaped like a plus sign ("+")) surrounding a region characterized by a specific blur intensity, and a second portion outside the surrounding region characterized by a different blur intensity. Other shapes can be used, such as those corresponding to various objects in the image. In other examples, more than two different blur intensities can be represented. The blur characteristics of the single-view image 802 are based on the blur intensity map 804.

[0067] Below the blur intensity map 804 Figure 10 Multiple temporary disparity maps 806A, 806B, and 806C are shown. Processing circuitry 130 can generate these multiple temporary disparity maps 806A, 806B, and 806C based on a single field-of-view image 802 and corresponding temporary convergence planes spaced apart from each other. In some examples, processing circuitry 130 can specify multiple temporary convergence planes without user input. The multiple temporary convergence planes may include an initial convergence plane.

[0068] Figure 10 The bottom of the graph shows a similarity value as a function of the convergence plane location. For example, the graph shows the similarity between blur intensity map 804 and the corresponding temporary disparity map. Each circle on the graph can correspond to a different convergence plane location corresponding to a different disparity map. Each linear or curved portion between the circles can correspond to an interpolation between the convergence plane locations.

[0069] The processing circuit 130 can determine the final convergence plane based on multiple similarity values. Two examples of this determination are given below; other techniques can be used to perform this determination.

[0070] In the first example, the processing circuit 130 can identify the maximum similarity value 1030 among a plurality of similarity values, where each similarity value represents a corresponding similarity between the blurred intensity map 804 and a corresponding temporary disparity map among a plurality of temporary disparity maps 806. The processing circuit 130 can select the temporary disparity map corresponding to the maximum similarity value 1030 among the plurality of temporary disparity maps as the final disparity map.

[0071] In the second example, processing circuit 130 can fit a similarity value curve 1020 via interpolation of multiple similarity values. Processing circuit 130 can determine a maximum value 1040 of the similarity value curve 1020. Processing circuit 130 can set a final convergence plane to be positioned corresponding to the maximum value 1040 of the similarity value curve 1020. The maximum value 1040 of the similarity value curve 1020 can be between two adjacent similarity values ​​among multiple similarity values. The final convergence plane can be located between two adjacent temporary convergence planes among multiple temporary convergence planes.

[0072] In the example, an autostereoscopic display such as multi-view display 110 can display a stereoscopic image pair such as stereoscopic image pair 810, such that when the stereoscopic image pair is displayed on the autostereoscopic display, the final convergence plane can coincide with the plane of the autostereoscopic display. In this example, the first portion of the stereoscopic image pair can appear to be above the plane of the autostereoscopic display. In this example, the second portion of the stereoscopic image pair can appear to be below the plane of the autostereoscopic display. A viewer tracker such as viewer tracker 120 can determine the position of a viewer such as viewer 42.

[0073] An autostereoscopic display may include a display panel, such as display panel 112. The autostereoscopic display may have a subpixel array, such as subpixel array 114, capable of displaying stereoscopic image pairs. A parallax generating optics, such as parallax generating optics 118, may direct light from the display panel to the viewer. A parallax generating lens may include a lenticular lens, such as lenticular lens 402. The parallax generating optics may include a parallax barrier (such as parallax barrier 602) having a transmission slit (such as transmission slit 704). The parallax generating optics may be along an optical axis having an angle of inclination relative to the display panel. OA The tilt angle remains unchanged. It is within a specified angular tolerance of forty-five degrees, such as five degrees, two degrees, one degree, or another suitable value. The parallax generating optics can be aligned with the optical axis (…). OAThe orthogonal axes are periodic. The processing circuit 130 can arrange the left and right images of a stereoscopic image pair (such as left image 812 and right image 814) on a subpixel array such that the parallax generating optics guide the left and right images to the viewer's corresponding eyes at the viewer's position.

[0074] To further illustrate the systems and methods disclosed herein, a non-limiting list of examples is provided below. Each of the following non-limiting examples may exist independently or may be combined with any one or more of the other examples in any permutation or combination.

[0075] In Example 1, an autostereoscopic display system may include processing circuitry configured to perform operations. The operations may include: receiving data of a specified single-field-of-view image; specifying an initial convergence plane; generating a final disparity map based on the single-field-of-view image and a final convergence plane spaced apart from the initial convergence plane, the final convergence plane being based on the blur and disparity characteristics of the single-field-of-view image; and generating a stereoscopic image pair using the single-field-of-view image and the final disparity map.

[0076] In Example 2, the autostereoscopic display system of Example 1 may optionally be configured such that the operation further includes: generating a blur intensity map based on a single field-of-view image, the blur characteristics being based on the blur intensity map; and generating an initial disparity map based on the single field-of-view image and an initial convergence plane, wherein the similarity between the final disparity map and the blur intensity map is greater than the similarity between the initial disparity map and the blur intensity map.

[0077] In Example 3, the autostereoscopic display system of any of Examples 1-2 may optionally be configured such that the operation further includes: specifying a plurality of temporary convergence planes spaced apart from each other, the plurality of temporary convergence planes including an initial convergence plane; and generating a plurality of temporary disparity maps based on a single field-of-view image and the corresponding plurality of temporary convergence planes, the plurality of temporary disparity maps including the initial disparity map.

[0078] In Example 4, the autostereoscopic display system of any of Examples 1-3 may optionally be configured such that the operation further includes: determining a plurality of similarity values, each similarity value representing the similarity between a blur intensity map and a corresponding temporary disparity map among a plurality of temporary disparity maps; and determining a final convergence plane based on the plurality of similarity values.

[0079] In Example 5, the automatic stereoscopic display system of any of Examples 1-4 may optionally be configured such that the operation further includes: selecting the largest similarity value among a plurality of similarity values ​​as the selected similarity value; and selecting a temporary disparity map corresponding to the selected similarity value from a plurality of temporary disparity maps as the final disparity map.

[0080] In Example 6, the automatic stereoscopic display system of any of Examples 1-5 may optionally be configured such that the operation further includes: fitting a similarity value curve by interpolation of a plurality of similarity values; determining the maximum value of the similarity value curve; and setting the final convergence plane to be arranged at a position corresponding to the maximum value of the similarity value curve, wherein: the maximum value of the similarity value curve is between two adjacent similarity values ​​among the plurality of similarity values; and the final convergence plane is located between two adjacent temporary convergence planes among a plurality of temporary convergence planes.

[0081] In Example 7, the autostereoscopic display system of any of Examples 1-6 may optionally be configured such that for each pixel of a single field-of-view image, each of a plurality of similarity values ​​is determined by: forming the numerator as a scalar product between the blur intensity map value at the pixel and the corresponding temporary disparity map value at the pixel; forming the denominator as a product of the magnitude of the blur intensity map value at the pixel and the magnitude of the corresponding temporary disparity map value at the pixel; dividing the numerator by the denominator to form a normalized value; and forming a similarity value of the image range from the normalized value of the pixels of the single field-of-view image as the similarity value.

[0082] In Example 8, the autostereoscopic display system of any of Examples 1-7 may optionally be configured such that the image range similarity value includes at least one of the following: the sum of squares of the normalized values ​​of the pixels of a single field of view; the square root of the sum of squares of the normalized values ​​of the pixels of a single field of view; or the sum of the absolute values ​​of the normalized values ​​of the pixels of a single field of view.

[0083] In Example 9, the autostereoscopic display system of any one of Examples 1-8 may optionally further include: an autostereoscopic display configured to display a pair of stereoscopic images such that when the pair of stereoscopic images is displayed on the autostereoscopic display: the final convergence plane coincides with the plane of the autostereoscopic display; a first portion of the pair of stereoscopic images appears to be above the plane of the autostereoscopic display; and a second portion of the pair of stereoscopic images appears to be below the plane of the autostereoscopic display; and a viewer tracker configured to determine the position of a viewer.

[0084] In Example 10, the autostereoscopic display system of any one of Examples 1-9 may optionally be configured such that the autostereoscopic display includes: a display panel having a subpixel array configured to display a stereoscopic image pair; and a parallax generating optics configured to guide light from the display panel to a viewer, the parallax generating optics including either a lenticular lens or a parallax barrier having a transmission slit, the parallax generating optics being constant along an optical axis having an angle of inclination relative to the display panel within a specified angular tolerance of forty-five degrees, the parallax generating optics being periodic along an axis orthogonal to the optical axis; and wherein the operation further includes: arranging the left and right images of the stereoscopic image pair on the subpixel array such that the parallax generating optics guides the left and right images to the viewer's corresponding eye at the viewer's position.

[0085] In Example 11, a method for generating a stereo image pair from a single field-of-view image may include: receiving data of a specified single field-of-view image using processing circuitry; specifying an initial convergence plane using processing circuitry; generating a final disparity map based on the single field-of-view image and a final convergence plane spaced apart from the initial convergence plane using processing circuitry, the final convergence plane being based on the blur and disparity characteristics of the single field-of-view image; and generating a stereo image pair using the single field-of-view image and the final disparity map using processing circuitry.

[0086] In Example 12, the method of Example 11 may optionally further include: generating a blur intensity map based on a single field-of-view image using processing circuitry, the blur characteristics being based on the blur intensity map; and generating an initial disparity map based on the single field-of-view image and an initial convergence plane using processing circuitry, wherein the similarity between the final disparity map and the blur intensity map is greater than the similarity between the initial disparity map and the blur intensity map.

[0087] In Example 13, the method of any one of Examples 11-12 may optionally further include: specifying a plurality of temporary convergence planes spaced apart from each other using processing circuitry, the plurality of temporary convergence planes including an initial convergence plane; generating a plurality of temporary disparity maps based on a single field-of-view image and the corresponding plurality of temporary convergence planes using processing circuitry, the plurality of temporary disparity maps including the initial disparity map; determining a plurality of similarity values ​​using processing circuitry, each similarity value representing the similarity between a blur intensity map and a corresponding temporary disparity map among the plurality of temporary disparity maps; and determining a final convergence plane using processing circuitry based on the plurality of similarity values.

[0088] In Example 14, the method of any one of Examples 11-13 may optionally further include: using processing circuitry to select the largest similarity value among a plurality of similarity values ​​as the selected similarity value; and using processing circuitry to select a temporary disparity map among a plurality of temporary disparity maps corresponding to the selected similarity value as the final disparity map.

[0089] In Example 15, the method of any one of Examples 11-14 may optionally further include: fitting a similarity value curve using a processing circuit via interpolation of multiple similarity values; determining the maximum value of the similarity value curve using the processing circuit; and setting the final convergence plane to be arranged at a position corresponding to the maximum value of the similarity value curve using the processing circuit, wherein: the maximum value of the similarity value curve is between two adjacent similarity values ​​among the multiple similarity values; and the final convergence plane is located between two adjacent temporary convergence planes among a plurality of temporary convergence planes.

[0090] In Example 16, a non-transitory computer-readable storage medium may store instructions for generating stereo image pairs from a single-view image. When executed by processing circuitry, the instructions may cause the processing circuitry to perform operations. These operations may include: receiving data of a specified single-view image using the processing circuitry; specifying an initial convergence plane using the processing circuitry; generating a final disparity map using the processing circuitry based on the single-view image and a final convergence plane spaced apart from the initial convergence plane, the final convergence plane being based on blur and disparity characteristics of the single-view image; and generating stereo image pairs using the single-view image and the final disparity map using the processing circuitry.

[0091] In Example 17, the non-transitory computer-readable storage medium of Example 16 may optionally be configured such that the operation further includes: generating a blur intensity map based on a single field-of-view image using processing circuitry; and generating an initial disparity map based on the single field-of-view image and an initial convergence plane using processing circuitry, wherein the similarity between the final disparity map and the blur intensity map is greater than the similarity between the initial disparity map and the blur intensity map.

[0092] In Example 18, the non-transitory computer-readable storage medium of any of Examples 16-17 may optionally be configured such that the operation further includes: specifying a plurality of temporary convergence planes spaced apart from each other using processing circuitry, the plurality of temporary convergence planes including an initial convergence plane; generating a plurality of temporary disparity maps based on a single field-of-view image and the corresponding plurality of temporary convergence planes using processing circuitry, the plurality of temporary disparity maps including the initial disparity map; determining a plurality of similarity values ​​using processing circuitry, each similarity value representing the similarity between a blur intensity map and a corresponding temporary disparity map among the plurality of temporary disparity maps; and determining a final convergence plane using processing circuitry based on the plurality of similarity values.

[0093] In Example 19, the non-transitory computer-readable storage medium of any of Examples 16-18 may optionally be configured such that the operation further includes: using processing circuitry to select the largest similarity value among a plurality of similarity values ​​as the selected similarity value; and using processing circuitry to select a temporary disparity map among a plurality of temporary disparity maps corresponding to the selected similarity value as the final disparity map.

[0094] In Example 20, the non-transitory computer-readable storage medium of any of Examples 16-19 may optionally be configured such that the operation further includes: fitting a similarity value curve using processing circuitry via interpolation of a plurality of similarity values; determining the maximum value of the similarity value curve using processing circuitry; and setting a final convergence plane using processing circuitry at a position corresponding to the maximum value of the similarity value curve, wherein: the maximum value of the similarity value curve is between two adjacent similarity values ​​among the plurality of similarity values; and the final convergence plane is located between two adjacent temporary convergence planes among a plurality of temporary convergence planes.

[0095] The above detailed description includes reference to the accompanying drawings, which form part of the detailed description. The drawings illustrate specific embodiments in which the invention can be practiced. These embodiments are also referred to herein as “examples.” Such examples may include elements other than those shown or described. However, it is contemplated that examples are provided only with those elements shown or described. Furthermore, other examples may be any combination or substitution of those elements (or one or more aspects thereof) shown or described with respect to a particular example (or one or more aspects thereof) or with respect to other examples (or one or more aspects thereof) shown or described herein.

[0096] In this document, as is common in patent documents, the terms “a” or “an” are used to include one or more, independent of any other instances or uses of “at least one” or “one or more.” In this document, the term “or” is used to refer to a non-exclusive “or,” such that “A or B” can include “A but not B,” “B but not A,” and “A and B,” unless otherwise stated. In the appended claims, the terms “including” and “in which” are used as concise English equivalents to the corresponding terms “comprising” and “wherein.” Furthermore, in the following claims, the terms “comprising” and “including” are open-ended, meaning that a system, apparatus, article, or process that includes elements other than those listed after such terms in the claim is still considered to be within the scope of that claim. Additionally, in the following claims, the terms “first,” “second,” and “third,” etc., are used merely as designations and are not intended to impose numerical requirements on their objects.

[0097] The above description is intended to be illustrative and not restrictive. For example, the examples (or one or more aspects thereof) described above can be used in combination with each other. Other embodiments can be used by those skilled in the art after reading the above description. It should be understood at the time of submission that it is not intended to interpret or limit the scope or meaning of the claims. Moreover, in the above detailed description, various features can be combined together to simplify this disclosure. This should not be construed as meaning that any unclaimed disclosed feature is essential to any claim. Rather, the inventive subject matter may lie in all features of fewer than the embodiments of a particular disclosure. Therefore, the following claims are incorporated herein by reference, wherein each claim is an independent, separate embodiment, and these embodiments are contemplated to be combined with each other in various combinations or arrangements. The scope of the invention should be determined with reference to the appended claims and the full scope of their equivalents.

Claims

1. An automatic stereoscopic display system, comprising: The processing circuit is configured to perform operations, the operations including: Receives data from a specified single field-of-view image; Specify the initial convergence plane; A final disparity map is generated based on the single-view image and a final convergence plane spaced apart from the initial convergence plane, the final convergence plane being based on the blur and disparity characteristics of the single-view image; and A stereo image pair is generated using the single-view image and the final disparity map.

2. The automatic stereoscopic display system according to claim 1, wherein the operation further includes: A blur intensity map is generated based on the single field-of-view image, and the blur characteristics are based on the blur intensity map; and An initial disparity map is generated based on the single-view image and the initial convergence plane. The similarity between the final disparity map and the blur intensity map is greater than the similarity between the initial disparity map and the blur intensity map.

3. The automatic stereoscopic display system according to claim 2, wherein the operation further includes: Specify a plurality of temporary convergence planes spaced apart from each other, the plurality of temporary convergence planes including the initial convergence plane; and Multiple temporary disparity maps are generated based on the single field-of-view image and the corresponding multiple temporary convergence planes, and the multiple temporary disparity maps include the initial disparity map.

4. The automatic stereoscopic display system according to claim 3, wherein the operation further includes: Multiple similarity values ​​are determined, each similarity value representing the similarity between the blurred intensity map and the corresponding temporary disparity map among the multiple temporary disparity maps; and The final convergence plane is determined based on the multiple similarity values.

5. The automatic stereoscopic display system according to claim 4, wherein the operation further includes: The maximum similarity value among the plurality of similarity values ​​is selected as the selected similarity value; and The temporary disparity map corresponding to the selected similarity value among the plurality of temporary disparity maps is selected as the final disparity map.

6. The automatic stereoscopic display system according to claim 4, wherein the operation further includes: A similarity value curve is fitted by interpolating the multiple similarity values; Determine the maximum value of the similarity value curve; and The final convergence plane is positioned at the location corresponding to the maximum value of the similarity value curve, wherein: The maximum value of the similarity value curve is between two adjacent similarity values ​​among the plurality of similarity values; and The final convergence plane is located between two adjacent temporary convergence planes among the plurality of temporary convergence planes.

7. The automatic stereoscopic display system according to claim 4, wherein for each pixel of the single-view image, each of the plurality of similarity values ​​is determined by: The molecule is formed as a scalar product between the blur intensity map value at the pixel and the corresponding temporary disparity map value at the pixel; The denominator is formed as the product of the magnitude of the blur intensity map value at the pixel and the magnitude of the corresponding temporary disparity map value at the pixel; Divide the numerator by the denominator to form a normalized value; and The image range similarity value is formed from the normalized values ​​of the pixels in the single field of view image and used as the similarity value.

8. The automatic stereoscopic display system according to claim 7, wherein the image range similarity value includes at least one of the following: The sum of squares of the normalized values ​​of the pixels in the single field-of-view image; The square root of the sum of the squares of the normalized values ​​of the pixels in the single-view image; or The sum of the absolute values ​​of the normalized values ​​of the pixels in the single-view image.

9. The automatic stereoscopic display system according to claim 1, further comprising: An autostereoscopic display is configured to display the stereoscopic image pair such that when the stereoscopic image pair is displayed on the autostereoscopic display: The final convergence plane coincides with the plane of the automated stereoscopic display; The first portion of the stereoscopic image pair appears to be positioned above the plane of the autostereoscopic display; and The second part of the stereoscopic image pair appears to be located below the plane of the autostereoscopic display; and A viewer tracker is configured to determine the viewer's location.

10. The automatic stereoscopic display system according to claim 9, wherein the automatic stereoscopic display comprises: The display panel has a sub-pixel array configured to display the stereoscopic image pairs; and Parallax generating optics are configured to direct light from the display panel toward the viewer. The parallax generating optics include either a cylindrical lens or a parallax barrier with a transmission slit. The parallax generating optics remain constant along the optical axis, which has an angle of inclination relative to the display panel. The tilt angle is within a specified angular tolerance of 45 degrees. The parallax generating optics are periodic along an axis orthogonal to the optical axis; and The operation further includes: The left and right images of the stereo image pair are arranged on the sub-pixel array such that the parallax generating optics guide the left and right images to the viewer's corresponding eyes at the viewer's position.

11. A method for generating a stereo image pair from a single field-of-view image, the method comprising: The processing circuit receives data from a specified single-view image. The initial convergence plane is specified using the processing circuit; The processing circuit generates a final disparity map based on the single field-of-view image and a final convergence plane spaced apart from the initial convergence plane, the final convergence plane being based on the blur and disparity characteristics of the single field-of-view image; and The processing circuit uses the single-view image and the final disparity map to generate a stereo image pair.

12. The method of claim 11, further comprising: The processing circuit generates a blur intensity map based on the single field-of-view image, and the blur characteristics are based on the blur intensity map. and The processing circuit generates an initial disparity map based on the single-view image and the initial convergence plane. The similarity between the final disparity map and the blur intensity map is greater than the similarity between the initial disparity map and the blur intensity map.

13. The method of claim 12, further comprising: The processing circuitry is used to designate a plurality of temporary convergence planes spaced apart from each other, the plurality of temporary convergence planes including the initial convergence plane; The processing circuit generates multiple temporary disparity maps based on the single field-of-view image and the corresponding multiple temporary convergence planes, the multiple temporary disparity maps including the initial disparity map; The processing circuit is used to determine multiple similarity values, each similarity value representing the similarity between the blurred intensity map and the corresponding temporary disparity map among the multiple temporary disparity maps; and The processing circuit determines the final convergence plane based on the plurality of similarity values.

14. The method of claim 13, further comprising: The processing circuit selects the maximum similarity value among the plurality of similarity values ​​as the selected similarity value; and The processing circuit selects the temporary disparity map corresponding to the selected similarity value from the plurality of temporary disparity maps as the final disparity map.

15. The method of claim 13, further comprising: The processing circuit uses interpolation of the plurality of similarity values ​​to fit a similarity value curve; The maximum value of the similarity value curve is determined using the processing circuit. and The processing circuit uses a position to position the final convergence plane at the location corresponding to the maximum value of the similarity curve, wherein: The maximum value of the similarity value curve is between two adjacent similarity values ​​among the plurality of similarity values; and The final convergence plane is located between two adjacent temporary convergence planes among the plurality of temporary convergence planes.

16. A non-transitory computer-readable storage medium storing instructions for generating stereoscopic image pairs from a single field-of-view image, the instructions causing the processing circuitry to perform operations when executed by the processing circuitry, the operations including: The processing circuit is used to receive data of a specified single field of view image; The initial convergence plane is specified using the processing circuit; The processing circuit generates a final disparity map based on the single field-of-view image and a final convergence plane spaced apart from the initial convergence plane, the final convergence plane being based on the blur and disparity characteristics of the single field-of-view image; and The processing circuit uses the single-view image and the final disparity map to generate a stereo image pair.

17. The non-transitory computer-readable storage medium according to claim 16, wherein, The operation also includes: The processing circuit generates a blur intensity map based on the single-view image; and The processing circuit generates an initial disparity map based on the single-view image and the initial convergence plane. The similarity between the final disparity map and the blur intensity map is greater than the similarity between the initial disparity map and the blur intensity map.

18. The non-transitory computer-readable storage medium according to claim 17, wherein, The operation also includes: The processing circuitry is used to designate a plurality of temporary convergence planes spaced apart from each other, the plurality of temporary convergence planes including the initial convergence plane; The processing circuit generates multiple temporary disparity maps based on the single field-of-view image and the corresponding multiple temporary convergence planes, the multiple temporary disparity maps including the initial disparity map; The processing circuit determines multiple similarity values, each representing the similarity between the blurred intensity map and a corresponding temporary disparity map among the multiple temporary disparity maps; and The processing circuit determines the final convergence plane based on the plurality of similarity values.

19. The non-transitory computer-readable storage medium according to claim 18, wherein, The operation also includes: The processing circuit selects the maximum similarity value among the plurality of similarity values ​​as the selected similarity value; and The processing circuit uses the selected temporary disparity map, which corresponds to the selected similarity value, to be the final disparity map.

20. The non-transitory computer-readable storage medium according to claim 18, wherein, The operation also includes: The processing circuit uses interpolation of the plurality of similarity values ​​to fit a similarity value curve; The maximum value of the similarity value curve is determined using the processing circuit; and The processing circuit uses a position to position the final convergence plane at the location corresponding to the maximum value of the similarity curve, wherein: The maximum value of the similarity value curve is between two adjacent similarity values ​​among the plurality of similarity values; and The final convergence plane is located between two adjacent temporary convergence planes among the plurality of temporary convergence planes.

Images