Reconverging stereoscopic images based on camera focus

Abstract

In an autostereoscopic image generation system, two cameras, spaced apart horizontally and each having an adjustable focus, can form an initial stereoscopic image pair by capturing images of a scene while the cameras are focused on a focus plane of the scene. Processing circuitry can reconverge the initial stereoscopic image pair to have zero disparity at the focus plane of the scene to generate a final stereoscopic image pair of the scene. In other words, for the final stereoscopic image pair, the convergence plane coincides with the focus plane. When the focus of one camera is adjusted, such as manually by a user or automatically in response to a selection of a salient object in the image, the processing circuitry can automatically adjust the focus of the other camera. The processing circuitry can move the convergence plane, optionally with a low-pass filter, to follow the focus plane.

Description

RECONVERGING STEREOSCOPIC IMAGES BASED ON CAMERA FOCUSCROSS-REFERENCE TO RELATED APPLICATION

[0001] This application claims the benefit of U.S. Provisional Application No. 63 / 554,995, filed February 17, 2024, which is hereby incorporated by reference in its entirety.FIELD OF THE DISCLOSURE

[0002] This document relates generally to display systems, and more specifically relates to multiview displays, three-dimensional displays, or autostereoscopic displays.BACKGROUND OF THE DISCLOSURE

[0003] A multiview display can provide different views of a multiview image to a viewer. A stereoscopic display can provide two different views of a three-dimensional image to the two eyes of a viewer. An autostereoscopic display can provide the two different views to the two eyes of the viewer without requiring the viewer to wear special glasses or eyewear. There is ongoing effort to improve autostereoscopic displays.SUMMARY

[0004] In an autostereoscopic image generation system, two cameras, spaced apart horizontally and each having an adjustable focus, can form an initial stereoscopic image pair by capturing images of a scene while the cameras are focused on a focus plane of the scene. Processing circuitry can reconverge the initial stereoscopic image pair to have zero disparity at the focus plane of the scene to generate a final stereoscopic image pair of the scene. In other words, for the final stereoscopic image pair, the convergence plane coincides with the focus plane. When the focus of one camera is adjusted, such as manually by a user or automatically in response to a selection of a salient object in the image, the processing circuitry can automatically adjust the focus of the other camera. The processing circuitry can move the convergence plane, optionally with a low-pass filter, to follow the focus plane.BRIEF DESCRIPTION OF THE DRAWINGS

[0005] FIG. 1 shows an exploded, perspective-view schematic drawing of an example of an autostereoscopic display system.

[0006] FIG. 2 shows a front-view drawing of an example of a display panel that includes an array of light-emitting diodes.

[0007] FIG. 3 shows a front-view drawing of an example of a display panel that includes a backlight and a light valve array.

[0008] FIG. 4 shows a front-view drawing of an example of a parallaxgenerating optic that includes a lenticular lens.

[0009] FIG. 5 shows a cross-sectional view of the lenticular lens of FIG. 4.

[0010] FIG. 6 shows a front-view drawing of an example of a parallaxgenerating optic that includes a parallax barrier.

[0011] FIG. 7 shows a cross-sectional view of the parallax barrier of FIG. 6 having transmissive slits.

[0012] FIG. 8 shows a top-view schematic drawing of an example of an autostereoscopic image generation system that can capture three-dimensional images of a scene.

[0013] FIG. 9 shows a flowchart of an example of a method for operating an autostereoscopic image generation system.DETAILED DESCRIPTION

[0014] In the following description of an autostereoscopic image generation system, the terms focus plane and convergence plane are used extensively. It will be understood that the focus plane and the convergence plane are not tangible objects, but are mathematical constructs that help describe the configuration of other elements in the autostereoscopic image generation system.

[0015] The focus plane corresponds to a location in the scene that is in focus at a sensor of a camera. Objects in the scene closer than the focus plane appear blurry, with the blur increasing at increasing distances away from the focus plane. Objects in the scene farther away than the focus plane also appear blurry, with the blur increasing at increasing distances away from the focus plane. The focus plane location corresponds (uniquely, in a one-to-one correspondence) to a relative spacing between a lens of thecamera and the sensor of the camera. For example, a controller can actively control the spacing between the lens and the sensor, in order to position the focus plane at a desired location in the scene. A focus plane pertains to a single camera, although two cameras can have a same focus plane.

[0016] The convergence plane, for a stereoscopic image pair, corresponds to a location in the scene at which there is zero disparity. In other words, there is no horizontal offset between the left and right images of the stereoscopic image pair, for objects in the scene at the convergence plane. Objects in the scene closer than the convergence plane can have a positive (or negative, depending on sign convention) disparity, with the disparity increasing in absolute value at increasing distances away from the convergence plane. Objects in the scene farther away from the convergence plane can have a negative (or positive) disparity, with the disparity increasing in absolute value at increasing distances away from the convergence plane. Note that the term convergence plane only pertains to multiple images of the scene from different view positions, rather than a single image of the scene.

[0017] In an autostereoscopic image generation system, two cameras, spaced apart horizontally and each having an adjustable focus, can form an initial stereoscopic image pair by capturing images of a scene while the cameras are focused on a focus plane of the scene. Processing circuitry can reconverge the initial stereoscopic image pair to have zero disparity at the focus plane of the scene to generate a final stereoscopic image pair of the scene. In other words, for the final stereoscopic image pair, the convergence plane coincides with the focus plane. When the focus of one camera is adjusted, such as manually by a user or automatically in response to a selection of a salient object in the image, the processing circuitry can automatically adjust the focus of the other camera. The processing circuitry can move the convergence plane, optionally with a low-pass filter, to follow the focus plane.

[0018] FIG. 1 shows an exploded, perspective-view schematic drawing of an example of an autostereoscopic display system 100 that includes an autostereoscopic display 110. The configuration of FIG. 1 is but one example of an autostereoscopic display system 100; other configurations can be used.

[0019] The sign conventions shown in FIG. 1 and used below assume that the autostereoscopic display 110 extends in an (x, y) plane, and that a z-axis extends away from the autostereoscopic display 110 and generally toward a viewer 42, along adirection that is orthogonal to a plane of the autostereoscopic display 110. Other sign conventions can be used.

[0020] The autostereoscopic display system 100 can include an autostereoscopic display 110. The autostereoscopic display 110 can provide different views of a stereoscopic image pair to the viewer 42. For example, as the viewer 42 moves in space, the autostereoscopic display 110 can direct different views of the stereoscopic image pair to the left and right eyes of the viewer 42, so that the viewer 42 can observe the different views of the stereoscopic image pair from different locations or orientations. In some configurations, the autostereoscopic display 110 can provide the multiple views at respective fixed location regions in space, so that the autostereoscopic display 110 can operate without using eye tracking. In other configurations, such as the autostereoscopic configurations described in detail below, the autostereoscopic display system 100 can use eye tracking to dynamically and continuously (or at relatively frequent discrete times) determine a location of the viewer 42, and in response, can dynamically and continuously control how the autostereoscopic display 110 displays the stereoscopic image pair so that the multiple views follow the viewer 42 or follow the tracked eye location(s) of the viewer 42 as the viewer 42 moves in space relative to a position of the autostereoscopic display 110.

[0021] The autostereoscopic display can provide a left image to a left eye of the viewer 42 and a right image to a right eye of the viewer 42. The left image and the right image can correspond to different views of an object or a scene, and can allow the viewer 42 to perceive the object or scene in 3D with just the viewer’s naked eyes, without the use of additional glasses or headgear.

[0022] The autostereoscopic display system 100 can include a viewer tracker 120 that can dynamically determine the location of the viewer 42. The autostereoscopic display system 100 can use the determined location of the viewer 42 to direct the left image to the left eye of the viewer 42 and the right image to the right eye of the viewer 42. Because the viewer’s location can vary as the viewer 42 moves in space, using eye tracking can allow the autostereoscopic display system 100 to follow the viewer 42, so that the autostereoscopic display can automatically direct the left image to the left eye at the viewer’s (dynamically varying) location and automatically direct the right image to the right eye at the viewer’s (dynamically varying) location. The viewer tracker 120 can provide a tracked position of the viewer 42, such as a tracked position of a head of theviewer 42, of one or both eyes of the viewer 42, or of another anatomical feature of the viewer 42. The viewer tracker 120 can be coupled to the processing circuitry 130 (described below) or controller, such as by providing viewer 42 location data (shown in FIG. 1 as coordinates x, y, and z) that represents a measured position or location of the viewer 42. The viewer tracker 120 can provide the viewer 42 location data at regular or irregular intervals to the processing circuitry 130. In a specific example of a viewer tracker 120, a camera can capture an image of the viewer 42. The viewer tracker 120 can further include an image processor (or general-purpose computer programmed as an image processor) that can determine a position of the viewer 42 within the captured image to provide the tracked position. In some examples, the processing circuitry 130 can include the image processor of the viewer tracker 120. In other examples, the processing circuitry 130 can be separate from the image processor of the viewer 42 tracker. Other suitable viewer trackers can be used, including viewer trackers based on lidar (e.g., using time-of-flight of reflected light over a scene to determine distances to one or more objects in the scene, such as a viewer’s head or a viewer’s eyes) or other technologies. The processing circuitry 130 can use an output of the viewer tracker 120, among other data, to perform one or more downstream calculations involved with providing the left view or left image to the left eye of the viewer 42 and the right view or right image to the right eye of the viewer 42.

[0023] The autostereoscopic display can be a lenticular autostereoscopic display. In a lenticular autostereoscopic display, a display panel 112 can display the stereoscopic image pair, and a parallax-generating optic 118 can direct light from the display panel 112 to the viewer 42 such that a left image can be visible from the left eye of the viewer 42 and a right image can be visible from the right eye of the viewer 42. During use of the lenticular autostereoscopic display, the processing circuitry 130 can track the location of the viewer 42, and can use the tracked location to dynamically determine how to distribute content of the stereoscopic image pair over a surface area of the display panel 112 (e.g., using pixels distributed over the display panel 112) such that a left image remains visible from the left eye of the viewer 42 and a right image remains visible from the right eye of the viewer 42, even as the viewer 42 changes location. In this manner, the location tracking and the image content distribution can be performed in software, such that following the location of the viewer 42 may not involve physically moving any components of the lenticular autostereoscopic display with respect to one another.Examples of suitable display panels and examples of suitable parallax-generating optics are described below.

[0024] In an example, a display panel 112 can display the stereoscopic image pair. The display panel 112 can have an array of subpixels 114 that can display an image according to stereo mapping coordinates associated with the viewer 42. The subpixels 114 can be located at subpixel locations in a grid having grid axes (for example, the x- axis and -axis). Each subpixel 114 can generate light having a specified color. For example, the subpixels 114 can include red subpixels, green subpixels, and blue subpixels, which generate red light, green light, and blue light, respectively. Other color / wavelength schemes can be used. The subpixels 114 can be grouped into pixels, with each pixel including at least two subpixels 114 that produce light of different colors. The display panel 112 can receive, from the processing circuitry 130 (described below), a display panel driving electrical signal 136 that can specify how the content of the stereoscopic image pair is distributed over the pixels and / or subpixels 114 of the display panel 112. Two possible configurations for the display panel 112 are described below and shown in FIGS. 2 and 3. Other configurations can be used.

[0025] FIG. 2 shows a front-view drawing of an example of a display panel 112A that includes an array 202 of light-emitting diodes 204, such as an array 202 of organic light-emitting diodes. Each light-emitting diode 204 can correspond to a subpixel. The array 202 of light-emitting diodes 204 can include red light-emitting diodes 204R, green light-emitting diodes 204G, and blue light-emitting diodes 204B, which correspond to the red subpixels, green subpixels, and blue subpixels, respectively. Each light-emitting diode 204 can controllably generate light in response to an electrical signal provided by the processing circuitry 130, such as display panel-driving electrical signal 136, or by suitable light-emitting diode-driving circuitry in communication with the processing circuitry 130. The processing circuitry 130 can cause a specified lightemitting diode 204 to be directly powered with a power that varies as a function of an intensity in a corresponding location in the image. The power delivered to a lightemitting diode 204 can optionally be pulse-width modulated at a modulation frequency that is greater than can be perceived by a human eye. Using pulse-width modulation can simplify a design of a light-emitting diode array controller, because it can generate an arbitrary average power level from a relatively small number of instantaneous power levels by varying a duty cycle of the power. In some examples, the array 202 of light-emitting diodes 204 can be arranged in a rectangular or square repeating pattern over a surface area 206 of the array 202. For example, the array 202 can have grid axes 208 that are orthogonal to each other. In some examples, the grid axes 208 can be parallel to edges 210 of the array 202 of light-emitting diodes 204.

[0026] FIG. 3 shows a front-view drawing of an example of a display panel 112B that includes a backlight 302 and a light valve array 304. Although FIG. 3 shows the backlight 302 and the light valve array 304 as being separated, in practice, the backlight 302 and the light valve array 304 may be in contact or may be located as close together as is practical. The backlight 302 can provide illumination having a uniform or substantially uniform intensity over a surface area of the backlight 302. The backlight 302 can provide illumination having a relatively broad spectrum, such as including most or all of the visible portion of the electromagnetic spectrum. The backlight 302 can provide the illumination into a continuum of propagation angles toward the light valve array 304. The backlight 302 can provide unmodulated illumination to the light valve array 304. The light valve array 304 can include light valves 306 that are individually controllable or controllable in one or more groups by the processing circuitry 130 (described below). Each light valve 306 can controllably attenuate the illumination from the backlight 302, such as in response to an electrical signal provided by the processing circuitry 130, such as display panel-driving electrical signal 136, or by suitable light valve driving circuitry in communication with the processing circuitry 130. Each light valve 306 can have a corresponding color filter that allows only a portion of the electromagnetic spectrum to pass through the light valve. For example, the light valves 306 can include red light valves 306R that have a red filter that allows only red light to pass through the red light valves 306R, green light valves 306G that have a green filter that allows only green light to pass through the green light valves 306G, and blue light valves 306B that have a blue filter that allows only blue light to pass through the blue light valves 306B. Other color schemes and numbers of colors can be used. Suitable light valves can include liquid crystal light valves, electrophoretic light valves, light valves based on electrowetting, and others. In some examples, the light valves 306 of the light valve array 304 can be arranged in a rectangular or square repeating pattern over a surface area 308 of the light valve array 304. For example, the light valve array 304 can have grid axes 208 that are orthogonal to each other. In some examples, the grid axes 208 can be parallel to edges 312 of the light valve array 304.

[0027] Referring again to FIG. 1, the autostereoscopic display can include a parallax-generating optic 118 that can direct light from the display panel 112 to the viewer 42, such that a left view or a left image can be visible from a left eye of the viewer 42 and a right view or a right image can be visible from a right eye of the viewer 42. Two possible configurations for the parallax-generating optic 118 are described below and shown in FIGS. 4 and 5 and in FIGS. 6 and 7. Other configurations can be used. Each of the configurations of FIGS. 4 and 5 and in FIGS. 6 and 7 can be used in combination with any of the configurations of the display panel 112 shown in FIGS. 2 and 3 (e.g., the array of light-emitting diodes 204 in FIG. 2 or the backlight 302 and light valve array 304 in FIG. 3).

[0028] FIG. 4 shows a front-view drawing of an example of a parallaxgenerating optic 118A that includes a lenticular lens 402. FIG. 5 shows a cross-sectional view of the lenticular lens 402 of FIG. 4. The lenticular lens 402 can include a plurality of cylindrical lenses 504 that are equally spaced apart. The lenticular lens 402 can have a focal plane coincident with the display panel 112. The lenticular lens 402 can be positioned to receive light from the display panel 112 and at least partially focus the received light to direct the light to specified regions proximate the viewer’s eyes.

[0029] FIG. 6 shows a front-view drawing of an example of a parallaxgenerating optic 118B that includes a parallax barrier 602. The parallax barrier can include a plurality of transmissive slits 704 that are equally spaced apart. FIG. 7 shows a cross-sectional view of the parallax barrier 602 (FIG. 6) having transmissive slits 704. The parallax barrier 602 can include an array of opaque strips 706 and thin transmissive slits 704 arranged to occlude portions of a displayed image in left and right viewing regions. The transmissive slits 704 can be spatially arranged to ensure that the left / right image portions are only visible in the corresponding left / right viewing regions for which they are intended. The parallax barrier 602 can be provided by a static physical layer in which the slits are precisely positioned, or electronically generated on an adaptive intermediate liquid crystal display layer.

[0030] The parallax-generating optic 118 can be invariant along an optical axis (OA) that is angled with respect to the grid axes (e.g., the x-axis and the -axis), such as at a rotational orientation (a) of 45 degrees or about 45 degrees with respect to the grid axes 208 or the x-axis. For example, the parallax-generating optic 118 can have transmissive features, such as the cylindrical lenses or the transmissive slits, that areinvariant along the optical axis ( A) and are periodic along an axis that is orthogonal to the optical axis (CM).

[0031] Referring again to FIG. 1, the autostereoscopic display can include a material 116 disposed between the display panel 112 and the parallax-generating optic 118. In some examples, the material 116 may extend fully between the display panel 112 and the parallax-generating optic 118, such that a light ray originating at the display panel 112 passes only through the material 116 (and does not pass through any air or unfilled volume) before arriving at the parallax-generating optic 118. In other examples, the material 116 may occupy only a portion of the volume between the display panel 112 and the parallax-generating optic 118, such that a light ray originating at the display panel 112 passes through at least some of the material 116 and passes through a volume of air before arriving at the parallax-generating optic 118. The material 116 may have a refractive index denoted by quantity n. The value of the refractive index n may be between about 1.3 and about 2, although other suitable values may be used. Suitable materials 116 can include glass, plastic, a transparent optical adhesive, and others. In some examples, the material 116 can be dispensed in a liquid form, then cured in place, such as by exposure to ultraviolet light or heat. In other examples, the material 116 can be manufactured as a solid unit and placed in its location in the autostereoscopic display. For example, the material 116 can function as a cover glass for the display panel 112. In some examples, the material 116 can function as a relatively precise spacing element. For example, the material 116 can be manufactured to have a specified thickness to within a specified thickness tolerance, and can set the spacing between the display panel 112 and parallax-generating optic 118 to have a value equal to the specified thickness when the autostereoscopic display is assembled.

[0032] As an alternative configuration, the autostereoscopic display can include, in order along the Z-axis, a backlight, the parallax-generating optic, and a display panel that can selectively modulate light that passes through the pixels or subpixels of the display panel. In other words, the parallax-generating optic may be disposed in an optical path between the backlight and the display panel. The material of refractive index n may be disposed between the parallax-generating optic and the display panel.

[0033] As illustrated in FIG. 1, the autostereoscopic display system 100 can include processing circuitry 130. The processing circuitry 130 can include a processor 132 and memory 134 storing instructions executable by the processor 132. Theinstructions can be executable by the processor 132 to perform data processing activities. The data processing activities can include, among other activities: receiving image data specifying an initial stereoscopic image pair of a scene, the initial stereoscopic image pair including respective captured images of the scene; receiving focus data specifying a focus plane of the scene, objects in the scene at the focus plane being in focus in the captured images, objects in the scene at increasing distances away from the focus plane being increasingly out of focus in the captured images; and generating a final stereoscopic image pair of the scene using the initial stereoscopic image pair and a convergence plane that coincides with the focus plane. By executing these data processing activities, the processing circuitry can control operation of the autostereoscopic display system 100. These data processing activities are described in detail below.

[0034] During use of the autostereoscopic display system 100, the processing circuitry 130 can determine, in real time, whether a particular pixel or subpixel displays a corresponding pixel from the left image or a corresponding pixel from the right image. There are many ways to make this determination; one specific example is described presently.

[0035] One technique for determining whether the left image is used or the right image is used involves calculating a phase function for each pixel or subpixel. The phase function can be a closed-form algebraic expression based on raytracing from the viewer, through the parallax-generating optic, to the display panel. The phase function can be a function of the pixel or subpixel location (e.g., within an operational area of the display panel), a location of the viewer (e.g., dynamically measured in real-time for systems that use a viewer tracker), and stored physical parameter values. The phase function can generate a scalar value as output. If the value of the phase function is within a specified range (such as between 0 and 0.5 after taking a modulus of 1), then the light from the pixel or subpixel is directed to the left eye, and the processing circuitry uses the intensity value of the left image on the pixel or subpixel of the display panel. If the value of the phase function is within another specified range (such as between 0.5 and 1 after taking a modulus of 1), then the light from the pixel or subpixel is directed to the right eye, and the processing circuitry uses the intensity value of the right image on the pixel or subpixel of the display panel. The term “stereo mapping coordinates” can include the data that represents whether a particular pixel or subpixel displays theintensity of the corresponding pixel or subpixel from the left image or the right image. The stereo mapping coordinates can be a function of a viewer location and a pixel or subpixel location.

[0036] FIG. 8 shows a top-view schematic drawing of an example of an autostereoscopic image generation system 800 that can capture three-dimensional images of a scene 802. The autostereoscopic image generation system 800, which is directed toward capturing three-dimensional content, can optionally include some or all of the elements of the autostereoscopic display system 100 of FIG. 1, which is directed toward displaying three-dimensional content. For example, the autostereoscopic image generation system 800 may include the viewer tracker 120 of FIG. 1. Because the viewer tracker 120 may be used to display three-dimensional content, but may not be used to capture the three-dimensional content, the viewer tracker 120 is omitted from FIG. 8

[0037] The autostereoscopic image generation system 800 can include a housing 804. The housing 804 may have a solid exterior. The housing 804 may optionally have one or more ports for charging, connecting with other electronic equipment, and the like. For examples in which the autostereoscopic image generation system 800 is configured as a smart phone, the housing 804 may be an exterior of the smart phone.

[0038] The autostereoscopic image generation system 800 can include processing circuitry 806 disposed in the housing 804. The processing circuitry 806 can include one or more processors disposed in the housing 804, which can optionally communicate via a wired or wireless connection with one or more processors disposed outside the housing 804, such as a server. The processing circuitry 806 can optionally include the processing circuitry 130 of FIG. 1.

[0039] The autostereoscopic image generation system 800 can include a first camera 810 disposed in or on the housing 804. The first camera 810 can include a first lens 812 that can collect and focus light that is emitted or reflected from a scene 802. The first camera 810 can include a first sensor 814, which can receive an image of the scene 802 formed by the first lens 812, convert the image into a first image electrical signal that represents the image, and direct the first image electrical signal to the processing circuitry 806. The first camera 810 can have a first longitudinal axis 816, which can extend from a center of the first sensor 814, through a center of the first lens812, to the scene 802. In the example of FIG. 8, the first longitudinal axis 816 extends parallel to the Z-axis.

[0040] The first lens 812 and the first sensor 814 can form an image of the scene 802, such that a focus plane 830 at the scene 802 is conjugate with the first sensor 814. Objects in the scene 802 at the focus plane 830 are in focus (e.g., have minimal blur) in an image captured by the first sensor 814. Objects in the scene 802 at increasing distances away from the focus plane 830 are increasingly out of focus (e.g., have increasing amounts of blur) in the image captured by the first sensor 814. The spacing (“Di”) between the first lens 812 and the first sensor 814, the spacing (“Do”) between the first lens 812 and the focus plane 830, and the focal length (“F”) of the first lens 812 are related by F'1= Do'1+ Di1. In this manner, any two of the three quantities (Do, Di, F) can determine the third quantity.

[0041] The first camera 810 can have an adjustable focus, which can move the focus plane 830 longitudinally to a desired location in the scene 802. The processing circuitry 806 can control the adjustable focus of the first camera 810. The first camera 810 can optionally include a manual focus that a user can grip and adjust manually. To implement the adjustable focus, the first camera 810 can include a first focus actuator 818. The first focus actuator 818 can controllably vary a first spacing between the first lens 812 and the first sensor 814, such as by longitudinally translating the first sensor 814 with respect to the first lens 812, the first lens 812 with respect to the first sensor 814, or both the first lens 812 and the first sensor 814 with respect to each other. The processing circuitry 806 can control the first focus actuator 818, such as by sending the first focus actuator 818 a first focus actuator control electrical signal that can specify a desired spacing between the first lens 812 and the first sensor 814. Because the spacing between the first lens 812 and the first sensor 814 and the location of the focus plane 830 are related, the first focus actuator control electrical signal can alternately specify a desired location of the focus plane 830.

[0042] The autostereoscopic image generation system 800 can include a second camera 820 disposed in or on the housing 804. The second camera 820 can have an adjustable focus. The second camera 820 can be similar to the first camera 810 in structure and function, and can include a second lens 822, a second sensor 824 coupled to the processing circuitry 806, a second focus actuator 828 configured to controllably vary a longitudinal spacing between the second lens 822 and the second sensor 824 inresponse to an electrical control signal from the processing circuitry 806, and a second longitudinal axis 826. The second longitudinal axis 826 can be parallel or substantially parallel to the first longitudinal axis 816, such that the first camera 810 and the second camera 820 are parallel or substantially parallel (such as to within typical manufacturing and alignment angular tolerances).

[0043] The first camera 810 and the second camera 820 can be spaced apart horizontally (along the X-axis in FIG. 8). Regarding the term horizontal, it will be understood that autostereoscopic systems, such as the autostereoscopic display system 100 of FIG. 1 and the autostereoscopic image generation system 800 of FIG. 8, are typically designed such that the viewer is upright, such as in a sitting or standing position. In the upright position, the left and right eyes of the viewer lie along a horizontally-oriented axis (e.g., are located at a same height above the ground). The stereoscopic effect for an upright viewer is most effective when the left and right views are generated from viewpoints that are separated horizontally. It will be understood that the designation of being spaced apart horizontally is used herein only for convenience, and that the housing 804 of the autostereoscopic image generation system 800 may be handheld (or otherwise repositionable), and may be oriented with any suitable orientation during use.

[0044] The processing circuitry 806 can control the focus of the first camera 810 and the focus of the second camera 820 so that both cameras are focused onto the same focus plane 830. For example, when the processing circuitry 806 adjusts the first focus actuator 818 to locate the focus plane 830 in a specified location, such as a user-specified location, the processing circuitry 806 can automatically (e.g., without intervention from the user or viewer 42) adjust the second focus actuator so focus on the specified location. In other words, the processing circuitry 806 can automatically adjust the focus of the second camera 820 to match the focus of the first camera 810, such that the focus plane 830 is in focus on the first sensor 814 and in focus on the second sensor 824.

[0045] For example, to move the focus plane 830 to a revised focus plane 830’, the processing circuitry 806 can cause the first focus actuator 818 to change a spacing between the first lens 812 and the first sensor 814, such as by longitudinally translating the first lens 812 to be at a revised first lens location 812’. The processing circuitry 806 can cause the second focus actuator 828 to change a spacing between the second lens 822and the second sensor 824, such as by longitudinally translating the second lens 822 to be at a revised second lens location 822’.

[0046] The autostereoscopic image generation system 800 can include a screen 840. The processing circuitry 806 can direct a video signal to the screen 840 for display on the screen 840. For example, in an image capture mode of the autostereoscopic image generation system 800, the screen 840 can display a video image of the scene 802, as captured in real time or near-real time by the first camera 810 and / or the second camera 820. The screen 840 can be touch-sensitive, so that a viewer can use one or more fingers to control a user interface on the screen 840. For example, the viewer can select a particular object in a scene 802 by touching the object as displayed on the screen 840. The screen 840 can direct user-selection information to the processing circuitry 806. The screen 840 can optionally include autostereoscopic features, such as those found in the autostereoscopic display 110 of FIG. 1.

[0047] The processing circuitry 806 can reconverge captured images so that the convergence plane coincides with the focus plane 830. Two examples of convergence techniques are described presently.

[0048] In a first example, the user or viewer 42 can select a focus plane 830, such as by manually manipulating the user interface to adjust the focus of the first camera 810 until the image captured by the first camera 810 and displayed on the screen 840 looks as desired. The processing circuitry 806 can automatically adjust the focus of the second camera 820 to match the focus of the first camera 810. The processing circuitry 806 can automatically reconverge the captured images using a convergence plane that coincides with the focus plane 830 (which is in focus on the first sensor 814 and in focus on the second sensor 824).

[0049] In a second example, the user or viewer 42 can select, such as via the touch-sensitive screen 840, an object in the scene 802. The processing circuitry 806 can automatically adjust the focus of the first camera 810 (such as via an auto-focus technique) and automatically adjust the focus of the second camera 820 (such as via an auto-focus technique and / or explicitly matching the focus of the first camera 810) such that the focus plane 830 coincides with the selected object. The processing circuitry 806 can automatically reconverge the captured images using a convergence plane that coincides with the focus plane 830.

[0050] A non-transitory computer-readable storage medium, such as found in the processing circuitry 806 or in wired or wireless communication with the processing circuitry 806, can store instructions for operating an autostereoscopic image generation system. The instructions, when executed by the processing circuitry 806, can cause the processing circuitry 806 to perform operations that are described below with regard to FIG. 9

[0051] FIG. 9 shows a flowchart of an example of a method 900 for operating an autostereoscopic image generation system. The method 900 is executable on the autostereoscopic image generation system 800 or another suitable autostereoscopic image generation system. The method 900 is but one example of a method for operating an autostereoscopic image generation system. Other suitable methods can be used.

[0052] At operation 902, the processing circuitry, such as processing circuitry 806, can receive image data specifying an initial stereoscopic image pair of a scene, such as scene 802. The initial stereoscopic image pair can include respective captured images of the scene.

[0053] At operation 904, the processing circuitry can receive focus data specifying a focus plane, such as focus plane 830, of the scene. Objects in the scene at the focus plane can be in focus in the captured images. Objects in the scene at increasing distances away from the focus plane can be increasingly out of focus in the captured images.

[0054] At operation 906, the processing circuitry can generate a final stereoscopic image pair of the scene using the initial stereoscopic image pair and a convergence plane that coincides with the focus plane.

[0055] The method can optionally include capturing, with a first camera and a second camera that are spaced apart horizontally and each have an adjustable focus, the captured images of the scene while the first camera and the second camera are focused on the focus plane. The focus plane is in focus at a first sensor of the first camera and at a second sensor of the second camera when the first camera and the second camera are focused on the focus plane. The processing circuitry can generate, from the captured images of the scene, the initial stereoscopic image pair of the scene.

[0056] The method can optionally include receiving an adjustment of the focus of the first camera to vary a location of the focus plane. In response to receiving the adjustment of the focus of the first camera, the processing circuitry can automaticallyadjust the focus of the second camera so that the focus plane remains in focus on the second sensor of the second camera. In response to receiving the adjustment of the focus of the first camera, the processing circuitry can automatically cause the convergence plane to move to follow the focus plane. As explained above, the convergence plane is not a tangible object, but is instead a mathematical construct that describes a location of zero disparity in a pair of stereoscopic images. In this context, causing the convergence plane to move involves reconverging the stereoscopic image pair by introducing a horizontal offset between the images of the stereoscopic image pair such that objects at the convergence plane have zero disparity (e.g., zero horizontal offset).

[0057] In some examples, if the convergence plane moves too quickly or discontinuously, it can induce discomfort or queasiness for the viewer. As a result, it can be beneficial to move the convergence plane relatively slowly and continuously over time, to give the viewer’s eyes time to adapt to the convergence plane location. To accomplish this relatively smooth and continuous movement over time, the method can optionally further include low-pass filtering the movement of the convergence plane such that the movement of the convergence plane is continuous, and therefore more pleasing to the viewer.

[0058] The method can optionally include receiving, via a touch-sensitive screen, saliency information that indicates a region of interest of the initial stereoscopic image pair. The processing circuitry can automatically determine, from the region of interest of the initial stereoscopic image pair, a convergence plane location. The processing circuitry can automatically specify, via the focus data, that the focus plane coincides with the convergence plane location. The method can optionally further include displaying, on an autostereoscopic display including the touch-sensitive screen, the final stereoscopic image pair.

[0059] In some examples, the first camera can include a first lens. The first lens can be spaced apart from the first sensor by a controllable spacing such that the first lens forms an image of the focus plane of the scene on the first sensor. The method can optionally include converting a value of the controllable spacing to a focus value that specifies the focus plane of the scene, and generating the focus data to represent the focus value.

[0060] In some examples, generating the final stereoscopic image pair can include reconverging the initial stereoscopic image pair to have zero disparity at the focus plane of the scene to generate the final stereoscopic image pair of the scene.

[0061] In some examples, an autostereoscopic display can display the final stereoscopic image pair such that when the final stereoscopic image pair is displayed on the autostereoscopic display, the convergence plane coincides with a plane of the autostereoscopic display. Further, when the final stereoscopic image pair is displayed on the autostereoscopic display, a first portion of the final stereoscopic image pair appears to be located between a viewer and the plane of the autostereoscopic display, and a second portion of the final stereoscopic image pair appears to be located such that the plane of the autostereoscopic display is between the viewer and the second portion of the final stereoscopic image pair. In some examples, a viewer tracker can determine a location of the viewer.

[0062] In some examples, the autostereoscopic display can include a display panel having an array of subpixels that can display the final stereoscopic image pair. In some examples, the autostereoscopic display can include a parallax-generating optic that can direct light from the display panel to the viewer. The parallax-generating optic can include one of a lenticular lens or a parallax barrier having transmissive slits. The parallax-generating optic can be invariant along an optical axis having a slant angle relative to the display panel. The slant angle can be within a specified angular tolerance of forty-five degrees. The parallax-generating optic can be periodic along an axis orthogonal to the optical axis. The method can optionally further include arranging left and right images of the final stereoscopic image pair on the array of subpixels such that the parallax-generating optic directs the left and right images to respective eyes of the viewer at the location of the viewer.

[0063] To further illustrate the system and method disclosed herein, a nonlimiting list of examples is provided below. Each of the following non-limiting examples can stand on its own or can be combined in any permutation or combination with any one or more of the other examples.

[0064] In Example 1, an autostereoscopic image generation system can comprise: processing circuitry configured to perform operations, the operations comprising: receiving image data specifying an initial stereoscopic image pair of a scene, the initial stereoscopic image pair including respective captured images of the scene; receivingfocus data specifying a focus plane of the scene, objects in the scene at the focus plane being in focus in the captured images, objects in the scene at increasing distances away from the focus plane being increasingly out of focus in the captured images; and generating a final stereoscopic image pair of the scene using the initial stereoscopic image pair and a convergence plane that coincides with the focus plane.

[0065] In Example 2, the autostereoscopic image generation system of Example 1 can further comprise a first camera and a second camera that are spaced apart horizontally and each have an adjustable focus, wherein the operations further comprise: capturing, with the first camera and the second camera, the captured images of the scene while the first camera and the second camera are focused on the focus plane, the focus plane being in focus at a first sensor of the first camera and at a second sensor of the second camera when the first camera and the second camera are focused on the focus plane; and generating, from the captured images of the scene, the initial stereoscopic image pair of the scene.

[0066] In Example 3, the autostereoscopic image generation system of any one of Examples 1-2 can optionally be configured such that the operations further comprise: receiving an adjustment of the focus of the first camera to vary a location of the focus plane; in response to receiving the adjustment of the focus of the first camera, automatically adjusting the focus of the second camera so that the focus plane remains in focus on the second sensor of the second camera; and in response to receiving the adjustment of the focus of the first camera, automatically causing the convergence plane to move to follow the focus plane.

[0067] In Example 4, the autostereoscopic image generation system of any one of Examples 1-3 can optionally be configured such that the operations further comprise: low-pass filtering the movement of the convergence plane such that the movement of the convergence plane is continuous.

[0068] In Example 5, the autostereoscopic image generation system of any one of Examples 1-4 can optionally be configured such that the operations further comprise: receiving, via a touch-sensitive screen, saliency information that indicates a region of interest of the initial stereoscopic image pair; automatically determining, from the region of interest of the initial stereoscopic image pair, a convergence plane location; and automatically specifying, via the focus data, that the focus plane coincides with the convergence plane location.

[0069] In Example 6, the autostereoscopic image generation system of any one of Examples 1-5 can optionally further comprise an autostereoscopic display configured to display the final stereoscopic image pair and including the touch-sensitive screen.

[0070] In Example 7, the autostereoscopic image generation system of any one of Examples 1-6 can optionally be configured such that: the first camera includes a first lens; the first lens is spaced apart from the first sensor by a controllable spacing such that the first lens forms an image of the focus plane of the scene on the first sensor; and the operations further comprise: converting a value of the controllable spacing to a focus value that specifies the focus plane of the scene; and generating the focus data to represent the focus value.

[0071] In Example 8, the autostereoscopic image generation system of any one of Examples 1-7 can optionally be configured such that generating the final stereoscopic image pair comprises reconverging the initial stereoscopic image pair to have zero disparity at the focus plane of the scene to generate the final stereoscopic image pair of the scene.

[0072] In Example 9, the autostereoscopic image generation system of any one of Examples 1-8 can optionally further comprise: an autostereoscopic display configured to display the final stereoscopic image pair such that when the final stereoscopic image pair is displayed on the autostereoscopic display: the convergence plane coincides with a plane of the autostereoscopic display; a first portion of the final stereoscopic image pair appears to be located between a viewer and the plane of the autostereoscopic display; and a second portion of the final stereoscopic image pair appears to be located such that the plane of the autostereoscopic display is between the viewer and the second portion of the final stereoscopic image pair; and a viewer tracker configured to determine a location of the viewer.

[0073] In Example 10, the autostereoscopic image generation system of any one of Examples 1-9 can optionally be configured such that the autostereoscopic display comprises: a display panel having an array of subpixels configured to display the final stereoscopic image pair; and a parallax-generating optic configured to direct light from the display panel to the viewer, the parallax-generating optic including one of a lenticular lens or a parallax barrier having transmissive slits, the parallax-generating optic being invariant along an optical axis having a slant angle relative to the display panel, the slant angle being within a specified angular tolerance of forty -five degrees, the parallax-generating optic being periodic along an axis orthogonal to the optical axis, wherein the operations further comprise: arranging left and right images of the final stereoscopic image pair on the array of subpixels such that the parallax-generating optic directs the left and right images to respective eyes of the viewer at the location of the viewer.

[0074] In Example 11, a method for operating an autostereoscopic image generation system can comprise: receiving, with processing circuitry, image data specifying an initial stereoscopic image pair of a scene, the initial stereoscopic image pair including respective captured images of the scene; receiving, with the processing circuitry, focus data specifying a focus plane of the scene, objects in the scene at the focus plane being in focus in the captured images, objects in the scene at increasing distances away from the focus plane being increasingly out of focus in the captured images; and generating, with the processing circuitry, a final stereoscopic image pair of the scene using the initial stereoscopic image pair and a convergence plane that coincides with the focus plane.

[0075] In Example 12, the method of Example 11 can further comprise: capturing, with a first camera and a second camera that are spaced apart horizontally and each have an adjustable focus, the captured images of the scene while the first camera and the second camera are focused on the focus plane, the focus plane being in focus at a first sensor of the first camera and at a second sensor of the second camera when the first camera and the second camera are focused on the focus plane; and generating, with the processing circuitry, from the captured images of the scene, the initial stereoscopic image pair of the scene.

[0076] In Example 13, the method of any one of Examples 11-12 can further comprise: receiving an adjustment of the focus of the first camera to vary a location of the focus plane; in response to receiving the adjustment of the focus of the first camera, automatically adjusting the focus of the second camera so that the focus plane remains in focus on the second sensor of the second camera; and in response to receiving the adjustment of the focus of the first camera, automatically causing the convergence plane to move to follow the focus plane.

[0077] In Example 14, the method of any one of Examples 11-13 can further comprise: low-pass filtering the movement of the convergence plane such that the movement of the convergence plane is continuous.

[0078] In Example 15, the method of any one of Examples 11-14 can optionally be configured such that the operations further comprise: receiving, via a touch-sensitive screen, saliency information that indicates a region of interest of the initial stereoscopic image pair; automatically determining, with the processing circuitry, from the region of interest of the initial stereoscopic image pair, a convergence plane location; and automatically specifying, via the focus data, that the focus plane coincides with the convergence plane location.

[0079] In Example 16, a non-transitory computer-readable storage medium storing instructions for operating an autostereoscopic image generation system, such that the instructions, when executed by processing circuitry, cause the processing circuitry to perform operations can comprise: receiving, with processing circuitry, image data specifying an initial stereoscopic image pair of a scene, the initial stereoscopic image pair including respective captured images of the scene; receiving, with the processing circuitry, focus data specifying a focus plane of the scene, objects in the scene at the focus plane being in focus in the captured images, objects in the scene at increasing distances away from the focus plane being increasingly out of focus in the captured images; and generating, with the processing circuitry, a final stereoscopic image pair of the scene using the initial stereoscopic image pair and a convergence plane that coincides with the focus plane.

[0080] In Example 17, the non-transitory computer-readable storage medium of Example 16 can optionally be configured such that the operations further comprise: capturing, with a first camera and a second camera that are spaced apart horizontally and each have an adjustable focus, the captured images of the scene while the first camera and the second camera are focused on the focus plane, the focus plane being in focus at a first sensor of the first camera and at a second sensor of the second camera when the first camera and the second camera are focused on the focus plane; and generating, with the processing circuitry, from the captured images of the scene, the initial stereoscopic image pair of the scene.

[0081] In Example 18 the non-transitory computer-readable storage medium of any one of Examples 16-17 can optionally be configured such that the operations further comprise: receiving an adjustment of the focus of the first camera to vary a location of the focus plane; in response to receiving the adjustment of the focus of the first camera, automatically adjusting the focus of the second camera so that the focus plane remains infocus on the second sensor of the second camera; and in response to receiving the adjustment of the focus of the first camera, automatically causing the convergence plane to move to follow the focus plane.

[0082] In Example 19 the non-transitory computer-readable storage medium of any one of Examples 16-18 can optionally be configured such that the operations further comprise: low-pass filtering the movement of the convergence plane such that the movement of the convergence plane is continuous.

[0083] In Example 20, the non-transitory computer-readable storage medium of any one of Examples 16-19 can optionally be configured such that the operations further comprise: receiving, via a touch-sensitive screen, saliency information that indicates a region of interest of the initial stereoscopic image pair; automatically determining, with the processing circuitry, from the region of interest of the initial stereoscopic image pair, a convergence plane location; and automatically specifying, via the focus data, that the focus plane coincides with the convergence plane location.

[0084] The above detailed description includes references to the accompanying drawings, which form a part of the detailed description. The drawings show, by way of illustration, specific embodiments in which the invention can be practiced. These embodiments are also referred to herein as "examples." Such examples can include elements in addition to those shown or described. However, examples are contemplated in which only those elements shown or described are provided. Moreover, other examples can any combination or permutation of those elements shown or described (or one or more aspects thereof), either with respect to a particular example (or one or more aspects thereof), or with respect to other examples (or one or more aspects thereof) shown or described herein.

[0085] In this document, the terms "a" or "an" are used, as is common in patent documents, to include one or more than one, independent of any other instances or usages of "at least one" or "one or more." In this document, the term "or" is used to refer to a nonexclusive or, such that "A or B" can include "A but not B," "B but not A," and "A and B," unless otherwise indicated. In the appended claims, the terms "including" and "in which" are used as the plain-English equivalents of the respective terms "comprising" and "wherein". Also, in the following claims, the terms "including" and "comprising" are open-ended, that is, a system, device, article, or process that includes elements in addition to those listed after such a term in a claim are still deemed to fall within thescope of that claim. Moreover, in the following claims, the terms "first," "second," and "third," etc. are used merely as labels, and are not intended to impose numerical requirements on their objects.

[0086] The above description is intended to be illustrative, and not restrictive. For example, the above-described examples (or one or more aspects thereof) can be used in combination with each other. Other embodiments can be used, such as by one of ordinary skill in the art upon reviewing the above description. It is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims. Also, in the above Detailed Description, various features can be grouped together to streamline the disclosure. This should not be interpreted as intending that an unclaimed disclosed feature is essential to any claim. Rather, inventive subject matter can lie in less than all features of a particular disclosed embodiment. Thus, the following claims are hereby incorporated into the Detailed Description, with each claim standing on its own as a separate embodiment, and it is contemplated that such embodiments can be combined with each other in various combinations or permutations. The scope of the invention should be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled.

Claims

WHAT IS CLAIMED IS:

1. An autostereoscopic image generation system, comprising: processing circuitry configured to perform operations, the operations comprising: receiving image data specifying an initial stereoscopic image pair of a scene, the initial stereoscopic image pair including respective captured images of the scene; receiving focus data specifying a focus plane of the scene, objects in the scene at the focus plane being in focus in the captured images, objects in the scene at increasing distances away from the focus plane being increasingly out of focus in the captured images; and generating a final stereoscopic image pair of the scene using the initial stereoscopic image pair and a convergence plane that coincides with the focus plane.

2. The autostereoscopic image generation system of claim 1, further comprising a first camera and a second camera that are spaced apart horizontally and each have an adjustable focus, wherein the operations further comprise: capturing, with the first camera and the second camera, the captured images of the scene while the first camera and the second camera are focused on the focus plane, the focus plane being in focus at a first sensor of the first camera and at a second sensor of the second camera when the first camera and the second camera are focused on the focus plane; and generating, from the captured images of the scene, the initial stereoscopic image pair of the scene.

3. The autostereoscopic image generation system of claim 2, wherein the operations further comprise: receiving an adjustment of the focus of the first camera to vary a location of the focus plane; in response to receiving the adjustment of the focus of the first camera, automatically adjusting the focus of the second camera so that the focus plane remains in focus on the second sensor of the second camera; and in response to receiving the adjustment of the focus of the first camera, automatically causing the convergence plane to move to follow the focus plane.

4. The autostereoscopic image generation system of claim 3, wherein the operations further comprise: low-pass filtering the movement of the convergence plane such that the movement of the convergence plane is continuous.

5. The autostereoscopic image generation system of claim 2, wherein the operations further comprise: receiving, via a touch-sensitive screen, saliency information that indicates a region of interest of the initial stereoscopic image pair; automatically determining, from the region of interest of the initial stereoscopic image pair, a convergence plane location; and automatically specifying, via the focus data, that the focus plane coincides with the convergence plane location.

6. The autostereoscopic image generation system of claim 5, further comprising an autostereoscopic display configured to display the final stereoscopic image pair and including the touch-sensitive screen.

7. The autostereoscopic image generation system of claim 2, wherein: the first camera includes a first lens; the first lens is spaced apart from the first sensor by a controllable spacing such that the first lens forms an image of the focus plane of the scene on the first sensor; and the operations further comprise: converting a value of the controllable spacing to a focus value that specifies the focus plane of the scene; and generating the focus data to represent the focus value.

8. The autostereoscopic image generation system of claim 1, wherein generating the final stereoscopic image pair comprises reconverging the initial stereoscopic image pair to have zero disparity at the focus plane of the scene to generate the final stereoscopic image pair of the scene.

9. The autostereoscopic image generation system of claim 1, further comprising: an autostereoscopic display configured to display the final stereoscopic image pair such that when the final stereoscopic image pair is displayed on the autostereoscopic display: the convergence plane coincides with a plane of the autostereoscopic display; a first portion of the final stereoscopic image pair appears to be located between a viewer and the plane of the autostereoscopic display; and a second portion of the final stereoscopic image pair appears to be located such that the plane of the autostereoscopic display is between the viewer and the second portion of the final stereoscopic image pair; and a viewer tracker configured to determine a location of the viewer.

10. The autostereoscopic image generation system of claim 9, wherein the autostereoscopic display comprises: a display panel having an array of subpixels configured to display the final stereoscopic image pair; and a parallax-generating optic configured to direct light from the display panel to the viewer, the parallax-generating optic including one of a lenticular lens or a parallax barrier having transmissive slits, the parallax-generating optic being invariant along an optical axis having a slant angle relative to the display panel, the slant angle being within a specified angular tolerance of forty -five degrees, the parallax-generating optic being periodic along an axis orthogonal to the optical axis, wherein the operations further comprise: arranging left and right images of the final stereoscopic image pair on the array of subpixels such that the parallax-generating optic directs the left and right images to respective eyes of the viewer at the location of the viewer.

11. A method for operating an autostereoscopic image generation system, the method comprising: receiving, with processing circuitry, image data specifying an initial stereoscopic image pair of a scene, the initial stereoscopic image pair including respective captured images of the scene; receiving, with the processing circuitry, focus data specifying a focus plane of the scene, objects in the scene at the focus plane being in focus in the captured images, objects in the scene at increasing distances away from the focus plane being increasingly out of focus in the captured images; and generating, with the processing circuitry, a final stereoscopic image pair of the scene using the initial stereoscopic image pair and a convergence plane that coincides with the focus plane.

12. The method of claim 11, further comprising: capturing, with a first camera and a second camera that are spaced apart horizontally and each have an adjustable focus, the captured images of the scene while the first camera and the second camera are focused on the focus plane, the focus plane being in focus at a first sensor of the first camera and at a second sensor of the second camera when the first camera and the second camera are focused on the focus plane; and generating, with the processing circuitry, from the captured images of the scene, the initial stereoscopic image pair of the scene.

13. The method of claim 12, further comprising: receiving an adjustment of the focus of the first camera to vary a location of the focus plane; in response to receiving the adjustment of the focus of the first camera, automatically adjusting the focus of the second camera so that the focus plane remains in focus on the second sensor of the second camera; and in response to receiving the adjustment of the focus of the first camera, automatically causing the convergence plane to move to follow the focus plane.

14. The method of claim 13, further comprising: low-pass filtering the movement of the convergence plane such that the movement of the convergence plane is continuous.

15. The method of claim 12, wherein the operations further comprise: receiving, via a touch-sensitive screen, saliency information that indicates a region of interest of the initial stereoscopic image pair; automatically determining, with the processing circuitry, from the region of interest of the initial stereoscopic image pair, a convergence plane location; and automatically specifying, via the focus data, that the focus plane coincides with the convergence plane location.

16. A non-transitory computer-readable storage medium storing instructions for operating an autostereoscopic image generation system, the instructions, when executed by processing circuitry, cause the processing circuitry to perform operations, the operations comprising: receiving, with processing circuitry, image data specifying an initial stereoscopic image pair of a scene, the initial stereoscopic image pair including respective captured images of the scene; receiving, with the processing circuitry, focus data specifying a focus plane of the scene, objects in the scene at the focus plane being in focus in the captured images, objects in the scene at increasing distances away from the focus plane being increasingly out of focus in the captured images; and generating, with the processing circuitry, a final stereoscopic image pair of the scene using the initial stereoscopic image pair and a convergence plane that coincides with the focus plane.

17. The non-transitory computer-readable storage medium of claim 16, wherein the operations further comprise: capturing, with a first camera and a second camera that are spaced apart horizontally and each have an adjustable focus, the captured images of the scene while the first camera and the second camera are focused on the focus plane, the focus plane being in focus at a first sensor of the first camera and at a second sensor of the second camera when the first camera and the second camera are focused on the focus plane; and generating, with the processing circuitry, from the captured images of the scene, the initial stereoscopic image pair of the scene.

18. The non-transitory computer-readable storage medium of claim 17, wherein the operations further comprise: receiving an adjustment of the focus of the first camera to vary a location of the focus plane; in response to receiving the adjustment of the focus of the first camera, automatically adjusting the focus of the second camera so that the focus plane remains in focus on the second sensor of the second camera; and in response to receiving the adjustment of the focus of the first camera, automatically causing the convergence plane to move to follow the focus plane.

19. The non-transitory computer-readable storage medium of claim 18, wherein the operations further comprise: low-pass filtering the movement of the convergence plane such that the movement of the convergence plane is continuous.

20. The non-transitory computer-readable storage medium of claim 17, wherein the operations further comprise: receiving, via a touch-sensitive screen, saliency information that indicates a region of interest of the initial stereoscopic image pair; automatically determining, with the processing circuitry, from the region of interest of the initial stereoscopic image pair, a convergence plane location; and automatically specifying, via the focus data, that the focus plane coincides with the convergence plane location.

Images