Multi-view three-dimensional display of content

Abstract

Communication systems that include three-dimensional ("3D") displays and audio and video ("A / V") capturing components, as well as associated systems and methods, are disclosed herein. The 3D displays can be volumetric displays that allow a 3D image to be viewed from multiple angles without requiring observers to wear optical elements. To do so, the 3D displays create one or more surfaces in free space. The surfaces are selectively illuminated (e.g., by light emitters on the surface and / or projection) to create a 3D image. The 3D A / V capture elements can record one or more first users of the communication system to capture 3D A / V data. This data can then be used to generate a 3D A / V of the user that is communicated to one or more second users for display.

Description

MULTI- VIEW THREE-DIMENSIONAL DISPLAY OF CONTENTCROSS-REFERENCE TO RELATED APPLICATIONS

[0001] The application claims priority to U.S. Provisional Application No. 63 / 535,543, filed August 30, 2023, which is incorporated herein by reference in its entirety.TECHNICAL FIELD

[0002] The present technology is generally directed to communication systems and, more specifically, to systems and methods related to capturing and creating real-time three- dimensional images that are viewable from all directions for communication systems.BACKGROUND

[0003] A three-dimensional (“3D”) display is a display device capable of conveying depth in an image to an observer. The most common 3D displays use optical components to create a 3D effect based on stereopsis (e.g. 3D cinema, etc.). While these projection displays are relatively simple to develop, they do not allow observers to view the display from multiple viewing angles / orientations effectively, require eyewear, can fatigue observers’ eyes, and are limited in their ability to create detailed 3D imagery. Few volumetric display devices can form a visual representation of an object in three physical dimensions rather than visual effects. However, these are expensive, require significant power, and are computationally complex to operate.BRIEF DESCRIPTION OF THE DRAWINGS

[0004] FIG. 1. is a block diagram illustrating an overview of an example of a device supporting a multi- view three-dimensional display of content, according to some aspects of this disclosure.

[0005] FIG. 2 is a block diagram illustrating an overview of an environment supporting a multi- view three-dimensional display of content, according to some aspects of this disclosure.

[0006] FIG. 3 is a block diagram illustrating components of a computing device supporting a multi- view three-dimensional display of content, according to some aspects of this disclosure.

[0007] FIGS. 4 and 5 are partially schematic illustrations a communication system supporting a multi- view three-dimensional display of content, according to some aspects of this disclosure.

[0008] FIG. 6 is a partially schematic front view of a primary component for a blade supporting a multi- view three-dimensional display of content, according to some aspects of this disclosure.

[0009] FIG. 7 is a partially schematic cross-sectional view of a blade with primary and secondary components supporting a multi- view three-dimensional display of content, according to some aspects of this disclosure.

[0010] FIG. 8 is a partially schematic isometric view of a three-dimensional display system supporting a multi-view three-dimensional display of content, according to some aspects of this disclosure.

[0011] FIG. 9 is a schematic diagram of a three-dimensional display system supporting a multi- view three-dimensional display of content, according to some aspects of this disclosure.

[0012] FIGS. 10A and 10B are partially schematic side views of a rotating screen system supporting a multi- view three-dimensional display of content, according to some aspects of this disclosure.

[0013] FIG. 11 is a partially schematic cross-section of a magnetically-driven particlelevitation device for a three-dimensional display, according to some aspects of this disclosure.

[0014] FIG. 12 is a schematic diagram of a system for optically trapping a plurality of particles for a multi-view three-dimensional display of content, according to some aspects of this disclosure.

[0015] FIG. 13 is a partially schematic view of a communication system supporting a multi- view three-dimensional display of content, according to some aspects of this disclosure.

[0016] FIGS. 14A and 14B are a partially schematic front view and a partially schematic cross-sectional view, respectively, of a light-field camera supporting a multi- view three- dimensional capture of content, according to some aspects of this disclosure.

[0017] FIG. 15 is a schematic illustration of an example of image data that includes structured light, according to some aspects of this disclosure.

[0018] FIGS. 16A-16D illustrate image data with varying quality filters applied to reduce power consumption for a multi- view three-dimensional display of content, according to some aspects of this disclosure.

[0019] FIGS. 17A-17D are partially schematic diagrams of a system for creating a three- dimensional image, according to some aspects of this disclosure.

[0020] FIGS. 18A and 18B illustrate additional details on the system of FIGS. 17A-17D, according to some aspects of this disclosure.

[0021] FIG. 19 is a flowchart for an example method for a multi-view three-dimensional display of content, according to some aspects of this disclosure.

[0022] The drawings have not necessarily been drawn to scale. Moreover, while the technology is amenable to various modifications and alternative forms, specific implementations have been shown by way of example in the drawings and are described in detail below. The intention, however, is not to limit the technology to the particular implementations described.DETAILED DESCRIPTION

[0023] Provided herein are system, apparatus, device, method, and / or computer program product embodiments, and / or combinations and sub-combinations thereof, for multi- view three-dimensional display of content.

[0024] A volumetric display may form a visual representation of an object in three physical dimensions by emitting and / or scattering light in a 3D space. 3D imagery may be viewed from multiple angles without requiring users to wear optical elements to create the 3D effects. The volumetric display can illustrate significant details in the 3D imagery, creating a life-like representation. As described herein, volumetric displays may be used in telecommunication platforms, providing participants in the telecommunication session with a full-size, lifelike display of other participants.

[0025] According to some aspects of this disclosure, 3D displays (e.g., volumetric displays, etc.) enable a 3D image to be viewed from multiple angles without requiring observers to wear optical elements, such as headsets, head-mounted devices, and other eyewear, to create, view, or output 3D effects and imagery. As described herein, 3Daudiovisual (A / V) capture elements can record users of a communication system to capture 3D A / V data / information. For example, 3D data / information may include, but is not limited to, depth information (e.g., images of a target captured at different angles, LiDAR data, structured light, etc.), color / texture information (e.g., RGB data, infrared data, etc.), positional and orientation data (e.g., motion tracking data, etc.), surface normal, spatial audio, sound reflection / reverberation data, ambient light data, reflection / refraction data, time-stamp data, and / or the like.

[0026] 3D A / V data / information may be used to generate a 3D image of a user (and / or audio) that can be communicated to another communication system for display to one or more other users and / or observers. According to some aspects of this disclosure, 3D data may be gathered and processed in real-time (or near real-time). As a result, the disclosed communication systems can be integrated into a telecommunication platform to facilitate a life-like telecommunication session between multiple users.

[0027] According to some aspects of this disclosure, a communication system that facilitates a multi-view three-dimensional display of content may be portable. As a result, for example, users can transport the communication system with them while traveling and use such systems for telecommuting to meetings, conferences, personal calls, and / or any other suitable telecommunication session. According to some aspects of this disclosure, the communication system (or one or more components thereof) may be movable between a first state (e.g., a collapsed state that is easier to transport) and a second state (e.g., a deployed state that facilitates 3D displays and / or 3D A / V capture). Additionally, or alternative, components of the communication system for multi-view three-dimensional display of content can implement various changes to 3D A / V data capturing, processing, and / or display that help support the portability of the communication system. According to some aspects of this disclosure, A / V capturing components of a communication system for multi- view three-dimensional display of content can be adapted to reduce their power consumption when the communication system is in a portable mode (e.g., not connected to an external power source, such as an outlet).

[0028] For ease of reference, communication systems for multi- view three-dimensional display of content that include 3D displays and / or 3D A / V capturing components are sometimes described herein with reference to top and bottom, upper and lower, upwards and downwards, and / or horizontal plane, x-y plane, vertical, or z-direction relative to the spatial orientation of the examples shown in the figures. It is to be understood, however,that the communication systems and components thereof can be moved to, and used in, different spatial orientations without changing the structure and / or function of embodiments described herein.

[0029] Although 3D displays and 3D A / V capturing components of communication systems for multi-view three-dimensional display of content are primarily discussed herein for use with a real-time communication system (e.g., to support telecommunication platforms), one of skill in the art will understand that the scope of the disclosed technology is not so limited. For example, as described herein, 3D displays and 3D A / V capturing components can be deployed in various other settings, such as entertainment applications (e.g., for movies, conventions, museums, theme parks, and the like), non-real-time communication systems (e.g., to deliver three-dimensional messages), retail settings (e.g., to display items for sale), and / or in various other suitable industries / applications. Accordingly, it will be understood that the scope of the technology is not confined to any subset of embodiments discussed below.Example Computing Environments for Communication Systems for Multi-view Three- Dimensional Display of Content

[0030] FIG. 1 is a block diagram illustrating an overview of an example of a device 100 supporting a multi- view three-dimensional display of content, according to some aspects of this disclosure. Device 100 includes one or more input devices 120 that provide input to one or more CPU(s) (processor, “the CPU”) 110, notifying it of actions. The actions can be mediated by a hardware controller that interprets the signals received from the input device and communicates the information to the CPU 110 using a communication protocol. Input devices 120 include, for example, a mouse, a keyboard, a touchscreen, an infrared sensor, a touchpad, a wearable input device, a stereo camera, a multi- scope camera (or other image-based input devices), a microphone, or other suitable user input devices.

[0031] The CPU 110 can be a single processing unit or multiple processing units in a device or distributed across multiple devices. CPU 110 can be coupled to other hardware devices, for example, with the use of a bus, such as a PCI bus or SCSI bus. The CPU 110 can communicate with a hardware controller for devices, such as for a display 130. The display 130 can be used to display text and graphics in a 3D environment. For example, the display can create a three-dimensional, volumetric image of a human participant of ateleconference that can be viewed from multiple angles. In some embodiments, the display 130 includes the input device as part of the display, such as when the input device is equipped with an eye direction monitoring system. In some embodiments, the display is separate from the input device. Examples of display devices are discussed in more detail below but can generally include: rotating LCDs; rotating LEDs; rotating OLEDs; rotating AMOLEDs; rotating semitransparent screens and associated projectors, lasers, and / or LEDs; digital micromirror devices; photophoretic optical trapping display; goniometers and / or MEMS mirrors; and the like. Other I / O devices 140 can also be coupled to the processor, such as a network card, video card, audio card, USB, firewire or other external device, infrared (or near infrared device) device, speakers, and the like.

[0032] In some embodiments, the device 100 also includes a communication device capable of communicating wirelessly or wire-based with a network node. The communication device can communicate with another device or a server through a network using, for example, TCP / IP protocols, a Q-LAN protocol, or others. Device 100 can utilize the communication device to distribute operations across multiple network devices.

[0033] The CPU 110 can have access to a memory 150 in a device or distributed across multiple devices. A memory includes one or more of various hardware devices for volatile and non-volatile storage, and can include both read-only and writable memory. For example, a memory can comprise random access memory (RAM), various caches, CPU registers, read-only memory (ROM), and writable non-volatile memory, such as flash memory, hard drives, floppy disks, CDs, DVDs, magnetic storage devices, tape drives, device buffers, and so forth. A memory is not a propagating signal divorced from underlying hardware; a memory is thus non-transitory. Memory 150 can include program memory 160 that stores programs and software, such as an Audio / Video Capture 162, 3D Display Control 164, and other application programs 166. Memory 150 can also include data memory 170 that can include data to be operated on by applications, configuration data, settings, options or preferences, etc., which can be provided to the program memory 160 or any element of the device 100.

[0034] Some embodiments can be operational with numerous other computing system environments or configurations. Examples of computing systems, environments, and / or configurations that may be suitable for use with the technology include, but are not limited to, personal computers, AVC I / O systems, networked AVC peripherals, videoconference consoles, server computers, handheld or laptop devices, cellular telephones, wearable electronics, gaming consoles, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, or the like.

[0035] FIG. 2 is a block diagram illustrating an overview of an environment in which some embodiments of the present technology can operate. Environment 200 can include one or more client computing devices 205 A-D, examples of which can include device 100. In the illustrated embodiment, device 205 A is a wireless smartphone or tablet, device 205B is a desktop computer, device 205C is a computer system, and device 205D is a wireless laptop. These are only examples of some of the devices, and other embodiments can include other computing devices. For example, device 205C can be a server that receives audio and video data from multiple participants in a telecommunication session, formats the audio and visual data for 3D displays for one or more of the participants, and / or forwards the audio and visual data between participants. The server can have sufficient computational resources to process the data, as needed, in real time to help facilitate the telecommunication and / or minimize the computational resources needed by the participants. In some embodiments, additional computational and / or audio / visual components can be included in environment 200, such as: one or more third-party servers specializing in mapping video data to a 3D display, one or more additional audio / video sources to capture additional data, and the like.

[0036] In some embodiments, the server computing device 210 is an edge server which receives client requests and coordinates the fulfillment of those requests through other servers, such as servers 220 A-C. Server computing devices 210 and 220 can comprise computing systems, such as device 100. Though each server computing device 210 and 220 is displayed logically as a single server, server computing devices can each be a distributed computing environment encompassing multiple computing devices located at the same or at geographically disparate physical locations. In some embodiments, each server 220 corresponds to a group of servers.

[0037] Client computing devices 205 and server computing devices 210 and 220 can each act as a server or client to other server / client devices. Server 210 can connect to a database 215. Servers 220A-C can each connect to a corresponding database 225 A-C. As discussed above, each server 220 can correspond to a group of servers, and each of theseservers can share a database or can have their own database. Databases 215 and 225 can warehouse (e.g., store) information. Though databases 215 and 225 are displayed logically as single units, databases 215 and 225 can each be a distributed computing environment encompassing multiple computing devices, can be located within their corresponding server, or can be located at the same or at geographically disparate physical locations.

[0038] Network 230 can be a local area network (LAN) or a wide area network (WAN), but can also be other wired or wireless networks. In some embodiments, portions of network 230 can be a LAN or WAN implementing a relevant communication protocol. Portions of network 230 may be the Internet or some other public or private network. Client computing devices 205 can be connected to network 230 through a network interface, such as by wired or wireless communication. While the connections between server 210 and servers 220 are shown as separate connections, these connections can be any kind of local, wide area, wired, or wireless network, including network 230 or a separate public or private network.

[0039] FIG. 3 is a block diagram illustrating components of a computing device 300 configured according to some aspects of this disclosure. The computing device 300 may include hardware 302, general software 320, and specialized components 340. As discussed above, a system implementing the disclosed technology can use various hardware including processing units 304 (e.g., CPUs, GPUs, APUs, etc.), working memory 306, storage memory 308 (local storage or as an interface to remote storage, such as storage 215 or 225), and input and output (I / O) devices 310. In various embodiments, storage memory 308 can be one or more of local devices, interfaces to remote storage devices, or combinations thereof. For example, storage memory 308 can be a set of one or more hard drives (e.g., a redundant array of independent disks (RAID)) accessible through a system bus or can be a cloud storage provider or other network storage accessible via one or more communications networks (e.g., a network accessible storage (NAS) device, such as storage 215 or storage provided through another server 220). Computing device 300 may include and / or be configured as client computing devices 205, server computing devices 210 and 220, and / or any other device component described herein.

[0040] General software 320 can include various applications including a communication system 322 (e.g., a telecommunication platform), local programs 324, and a basic inputoutput system (BIOS) 326. In some embodiments, specialized components 340 can be subcomponents of one or more of the general software applications 320 and / or integrated with one or more of the general software applications 320 (e.g., integrated with the communication system 322). The specialized components 340 can include a 3D display component 342, a 3D audio / video (“A / V”) capture component 344, an A / V processing component 346, a free space surface creator component 348, and / or various other suitable components to implement the features discussed in more detail below. In some embodiments, computing device 300 can be implemented by a computing system that is distributed across multiple computing devices and / or can interface with a server-based application executing one or more of specialized components 340.

[0041] Those skilled in the art will appreciate that the components illustrated in FIGS. 1- 3 described above, and in each of the flow diagrams discussed below, may be altered in a variety of ways. For example, the order of the logic may be rearranged, substeps may be performed in parallel, illustrated logic may be omitted, other logic may be included, etc. In some embodiments, one or more of the components described above can execute one or more of the processes described below.

[0042] FIGS. 4 and 5 are partially schematic illustrations of a communication system 400 configured according to some aspects of this disclosure. In the illustrated embodiments, communication system 400 includes a compact device 402 (e.g., similar to the device 100 of FIG. 1) positioned halfway between a real user (shown in black) and a projected user (shown in gray). According to some aspects of this disclosure, the projected user may be projected onto a medium and / or screen in free space according to any of the embodiments described later herein. The compact device 402 may include multiple 3D A / V capture subsystems and multiple 3D projection subsystems to both record and project a full-sized human (or any other suitable subject, such as an audience in a conference room). In some embodiments, the communication system 400 may include a stack of multiple compact devices, each including 3D capture and projection subsystems, with overlapping fields of view. The multiple devices can be communicatively coupled to another computing device (e.g., one of the client computing devices 205 A-D of FIG. 2, etc.) and / or a server (e.g., the server computing device 210 of FIG. 2, etc.) to share and receive A / V data during a communication session.

[0043] According to some aspects of this disclosure, 3D A / V capture subsystems of compact device 402 can include a variety of components including, but not limited to,stereo cameras and / or multi-scope camera configurations of standard cameras; stereo cameras and / or light field cameras; time-of-flight cameras and / or structured light illumination components; binaural sound systems; multiple microphones; smartphones and other personal electronic devices; and / or various other suitable components and / or combinations thereof. Similarly, the 3D projection subsystem can include a variety of components technology, such as LCDs and / or LCD projectors; laser systems; any suitable light engine, such as light-emitting diodes, laser diodes, and / or super luminescent diodes; optical components such as beam expanders, focusing elements, collimating lenses, and the like; digital micromirror devices; scanning optical devices such as goniometers or micro-electro-mechanical system (MEMS) mirrors; and / or various other suitable components and / or combinations thereof.

[0044] To capture and project images at close ranges (e.g., when the subject and / or screen is within five feet of the compact device 400), the 3D A / V capture subsystems and multiple 3D projection subsystems of compact device 402 may include wide capture and projection angles, respectively, while the compact device (or a server component communicatively coupled to the compact device) includes filters to remove distortion from the wide capture angles and / or prepare a 3D image to be projected with the wide angles. For example, in the embodiment illustrated in Fig. 4, the 3D A / V capture and projection subsystems of compact device 402 each use three cones (capture cones and projection cones, respectively). The three capture cones correspond to three overlapping fields of view that are captured by the 3D A / V capture system and processed to create a final 3D image. Using three separate fields of view can allow the compact device to be positioned closer to the user because the image produced by the overlapping fields of view is less warped than an image from a single field of view covering the same range. Similarly, the three projection cones correspond to three projection components that allow the compact device to be positioned closer to the screen without complex optics and / or pre-processing the 3D image to account for a warped projection.

[0045] According to some aspects of this disclosure, the communication system 400 can include one or more capture and / or projection subsystems that are orientated vertically, for example as illustrated in FIG. 5. The vertical geometry can increase the distance between the user (or the screen) and the compact device and / or help enhance the optical resolution of the projected image (e.g., a larger distance between the compact device and the screen results in less distortion to be accounted for).

[0046] It will be understood that any suitable number of capture and projection cones can be used. Purely by way of example, the 3D A / V capture and projection subsystems each use two capture and projection cones. In various other embodiments, however, the 3D A / V capture system can use one, two, three, four, five, ten, and / or any suitable number of capture cones while the 3D projection subsystem uses one, two, three, four, five, ten, and / or any suitable number of projection cones. In a specific, non-limiting example, the 3D A / V capture system can use five capture cones while the 3D projection subsystem uses a single projection cone. In this example, the user can be positioned relatively close to the compact device while the screen is relatively far away.

[0047] It will also be understood that the 3D A / V capture and projection subsystems of compact device 402 canbe configured to adjust the number of capture and projection cones used based on the parameters of different communication sessions. For example, the 3D A / V capture and projection subsystems can each use a relatively high number of the capture and projection cones when the user is in a relatively small space (e.g., a home office), then use a relatively low number of the capture and projection cones when the user is in a relatively large space (e.g., a conference room).

[0048] In some embodiments, the compact device 402 (or components thereof) can be carried by deployable / retractable mechanisms to improve the portability of the compact device 402 while providing necessary angles for the A / V capture and projection subsystems. According to some aspects of this disclosure, an example compact device 402 can include a telescopically extendable arm that the A / V capture subsystem is mounted on. In some such embodiments, the telescopic arm can allow the A / V capture subsystem to dynamically move to follow a user’s position while using the communication system. According to some aspects of this disclosure, an example compact device 402 can include and / or be communicably coupled to a wearable device to allow users to move while using the communication system.

[0049] According to some aspects of this disclosure, an example compact device 402 may be communicably coupled to a network (e.g., through an internet or cellular component) to communicate with a server to send and receive 3D A / V data during a communication session. For example, the compact device 402 can be communicatively coupled to a smartphone (and / or another suitable electronic device, such as a user’s laptop) to communicate with the server.3D Displays for Multi-View Three-Dimensional Display of Content

[0050] The 3D displays disclosed in accordance with some embodiments herein include volumetric displays that form a visual representation of an image in three physical dimensions. To do so, the volumetric displays disclosed herein create one or more transparent (or semi-transparent) surfaces in free space. Light-emitting components integrated with the surface and / or projected onto the surface can then create the 3D image. The image created in the volumetric display is viewable and unique from multiple angles and does not require observers to wear optical components (e.g., a stereoscope) to view the image. Further, in various embodiments, the volumetric display can provide hundreds, thousands, tens of thousands, or more pixels in the 3D display, allowing the 3D image to illustrate details throughout the image. It will be understood that each of the 3D displays discussed below can be integrated with and / or communicably coupled to a communication device (e.g., the compact device of FIGS. 4 and 5, the device 100 of FIG. 1, the server computing device 210 of FIG. 2, and / or any other suitable device) to be integrated with a communication system. In some embodiments, for example, the 3D displays discussed below are formed integrally with a portable communication device that can capture and display 3D imagery.

[0051] In some embodiments, a 3D volumetric display is created by rotating one or more arrays of LEDs (or other suitable light emitting components, sometimes referred to generically herein as “light emitters”). In such embodiments, the rotational speed takes advantage of human persistence of vision such that blades with the array(s) of light emitters appear to create a surface profile in free space. For example, the blades can rotate between about 100 rotations per minute (RPM) and about 10,000 RPM. At these speeds, unlit portions of the blades disappear while light from the light emitters remains visible on the 3D surface profile. By controlling the light emitters based on their position during rotation (e.g., as a function of time, etc.), the blades can create an image on the 3D surface profile.

[0052] FIG. 6 is a partially schematic front view of a primary component 602 for a blade 600 in a 3D display system configured according to some aspects of this disclosure. As illustrated in Fig. 6, the primary component 602 can include an LED array (or other light emitters) where the number (n) of pixels along a long axis of the primary component 602 is much greater than the number of pixels (m) along the short axis of the primary blade 600, such that n » m. In the illustrated embodiment, the surface layer of the primarycomponent 602 is flat (or generally flat) and light is projected outwards orthogonal to the surface of the primary blade 600 (e.g., out of the page). Accordingly, the primary component 602 can display the image as seen by an observer from a front view.

[0053] In some embodiments, the primary component 602 can include one or more optical elements positioned over the LED array. Examples of suitable optical elements include various collimators, collimating lenses (e.g., total internal reflection lenses), beam expanders, filters, protective lenses, focusing lenses, and the like. The optical elements can be positioned individually over each of the LEDs (or other light emitters) in the array and / or positioned over any combination of the LEDs. In a specific, non-limiting example, the primary component 602 can include one or more focusing lenses each individually corresponding to an LED as well as a protective lens extending over the entire LED array. In some embodiments, the LED array does not include any optical elements or may include detachable optical elements. In such embodiments, the absence of optical elements (e.g., when optical elements are detached, non-present, etc.) can allow the LED array to easily fold and / or fold into a more compact state for a portable 3D display system.

[0054] In embodiments where the blade 600 has a flat surface layer overall, the 3D display system can include one or more secondary components positioned adjacent to the primary component 602 and offset by an angle. The secondary components can, accordingly, display the image as seen by an observer from a side view. Additionally, or alternatively, the secondary components can display a portion of the image as seen from the front view while adding additional 3D depth to the image.

[0055] FIG. 7 is a partially schematic cross-sectional view of a blade with primary and secondary components configured according to some aspects of this disclosure. As illustrated, secondary components (e.g., the 2ndcomponents) can be positioned on either side of the primary component (e.g., the 1stcomponent) and tilted at an angle a with respect to a normal of the primary component’s surface. Each of the second components can be generally similar to the primary component with light emitters arranged in a thin array. The angle a can be any suitable angle, such as 1 degree, 2 degrees, 5 degrees, 10 degrees, and / or any other suitable angle.

[0056] Additional secondary components can then be positioned on either side, with each subsequent array angled at ka, where k is an integer corresponding to the number of secondary components between a particular secondary component and the primary component plus 1. Any number of the second components can be included to provide adesired field of view around the 3D display system and / or to create a desired 3D effect in the generated image.

[0057] It will be understood that, in some embodiments, the surface layer of the blade can have a continuously (or intermittently) curved profile. The curved profile can allow the primary and secondary components into a single array of light emitters. In a specific, nonlimiting example, flexible organic / polymer LED arrays can be used to generate a continuous curved surface rather than the flat surface of each of the primary and secondary components. While flexible organic / polymer arrays are thinner, lighter, and require less driver electronics, they can be more expensive to implement.

[0058] FIGS. 8 and 9 are a partially schematic isometric view and a schematic diagram, respectively, of a 3D display system configured according to some aspects of this disclosure. As illustrated in Fig. 8, several blades can be mounted on a bracket (e.g., a circular bracket, ovular bracket, and / or any other suitable bracket) on the short axis of the blades closest to the center of the bracket. The blades can be generally similar to the blades discussed above with reference to FIGS. 6 and 7 (referred to herein as “Group A” blades). In various embodiments, the Group A blades can include between one and fifteen blades, between one and ten blades, or between two and six blades. According to some aspects of this disclosure, Group A blades may include any numeric combination of blades.

[0059] As illustrated in FIG. 9, the blades (Group A and Group B) can be coupled to a rotating motor (e.g., a high-precision direct current (DC) motor, etc.), power supply, processor, and driver electronics that controllably rotate the blades and operate the light emitters (e.g., the LEDs) to display a 3D image. During operation, rotating motor may rotate the blades at a speed faster than the persistence of vision of the human eye while the light emitters are projecting frame rates higher than the rotation frequency. As a result, the 3D display system can create a 3D image in free space that changes as a function of an observer’s viewing angle.

[0060] Returning to FIG. 8, the 3D display system can also include a second set of blades (referred to herein as “Group B blades”) positioned internal to a motion path of the Group A blades (e.g., behind the surface profile of the Group A blades, etc.). The Group B blades can be generally similar to the blades discussed above with reference to FIGS. 6 and 7 without the primary component. Further, the Group B blades can be electronically driven differently from the Group A blades. For example, the Group B blades can have asweeping motion path (e.g., from top to bottom) instead of the rotational path of the Group A blades. The different motion path results in a different driving pattern for the light emitters on the Group B blades. The Group B blades can expand the coverage of the 3D surface profile of the 3D display system and / or provide another source of depth in the 3D image. In some embodiments, the 3D display system can include additional subsequent groups positioned internally to the Group B blades and / or covering other viewing angles behind the surface profile of the Group A blades.

[0061] In some embodiments, a 3D volumetric display is created by creating a medium in free space for light (e.g., from a projector and / or various laser subsystems) to interact with. For example, a rotating, semitransparent screen can create a medium in free space for light to interact with and create a 3D image. FIGS. 10A and 10B are partially schematic side views of a rotating screen system for a 3D display system configured according to some aspects of this disclosure. In the illustrated embodiment, the rotating screen system includes a micro-perforated screen section that is attached to the rotating rod. The screen is a slice of spherical shape that is configured to be transparent (or mostly transparent) when rotated at speeds above the persistence of vision while creating a surface in free space for light to interact with. A 3D volumetric image can then be projected onto the screen to create an image that can be seen from all angles and / or multiple users without the need for glasses or secondary optical components.

[0062] In another example, a magnetic field can suspend and / or dynamically move particles in space to create the medium (e.g., sometimes referred to herein as “magnetic levitation” and the like). In particular, sub-cm particles of a variety of sized can be suspended in a paramagnetic liquid and / or air by a rapidly changing magnetic field. The magnetic field pushes the particles against gravity to suspend the particles in the paramagnetic fluid and / or air. As a result, and as illustrated in the partially schematic cross-section of FIG. 11, particles of like sizes generally settle into a layer at a given height above the electromagnetic array. Because there are numerous different sizes, the magnetically suspended particles create a 3D medium for light to interact with. Further, the rapid changes in the magnetic field can cause the particles to move faster than the persistence of vision, thereby creating a medium that is semitransparent to the human eye. Light can then be projected into the medium to create a 3D image. In some embodiments, the movement of the particles (e.g., as controlled by the changes of the magnetic field) issynced with a frame rate of the image being projected, which is believed to help improve the quality of the image and the observer’s experience.

[0063] In yet another example, one or more lasers are tightly focused to optically trap particles in space (sometimes also referred to as “photophoretic optical trapping”). As the laser(s) are moved, so too are the particles, thereby creating a dynamic medium to scatter light off in free space. When the particles are moved at a rate above the persistence of vision, the medium becomes semitransparent and the image is suspended in space.

[0064] FIG. 12 is a schematic diagram of a system for optically trapping a plurality of particles configured according to some aspects of this disclosure. In the illustrated embodiment, the system includes an infrared (e.g., non-visible) laser source, a beam expander, and abeam shaping element (e.g., an engineered diffuser and / or a metasurface) to create a plurality of laser beams. The laser beams can be Gaussian laser beams (e.g., with a defined beam waist), or Bessel beams (e.g., with a generally constant beam waist). Each of the beams is tightly focused to trap a particle, such that the plurality of laser beams creates a screen of particles that can then be projected onto one or more projectors. In some embodiments, multiple laser beams are used to trap each particle. For example, particles can be trapped at the intersection of beams. The use of multiple beams can allow for longer ranges between the laser beam generators and the screen since each beam contributes to the forces necessary to trap a particle. By moving the laser beams in three dimensions (e.g., by moving the laser beam generator(s) along the x, y, and z-axes), the screen can appear to have a 3D profile. The one or more projectors can then be synced with the movement of the laser beams to project an image with a 3D appearance.

[0065] The system can generate hundreds, thousands, or tens of thousands of laser beams to create screens with a sufficient number of pixels for the intended image. In the embodiment illustrated in FIG. 12, a single screen of the particles is created by the laser beams. However, it will be understood that, in various other embodiments, the system can include multiple laser beam sources to create multiple layers of a screen to further create a 3D medium for light to be projected onto and / or to provide additional pixels for the generated image.

[0066] In some embodiments, a 3D volumetric display is created by a communication system that includes a curved screen and multiple projection and A / V recording locations. FIG. 13 is a partially schematic view of a communication system configured according to some aspects of this disclosure. As illustrated in FIG. 13, the screen can be human-sizedto capture the full height of one or more users of the communication system and / or to provide a more complete view of the users on the other end of the communication system. Further, the communication system can include one or more pairs of recording units (two illustrated in FIG. 13, e.g., stereo cameras or suitable light field cameras, microphones, laser-based depth imagers, and the like) on each deployable column that are dispersed along the vertical axis to record A / V data at the various heights and / or angles. The acquisition of A / V data from multiple heights and angles allows the communication system to construct a detailed 3D image of the user and / or their surrounding environment.

[0067] For example, according to some aspects of this disclosure, to generate and cause display of a three-dimensional (3D) image of a user / object, 3D image data from a plurality of imaging devices may be combined. Each imaging device may capture spatial information, including depth and texture data, from different viewpoints around the user / object. The 3D image data from the plurality of imaging devices may form a comprehensive dataset that encompasses various perspectives and details of the user / object. According to some aspects of this disclosure, the imaging devices may be calibrated to align their spatial coordinates and synchronize the timing of data capture to ensure that the datasets are consistent both temporally and spatially.

[0068] The 3D image data from the plurality of imaging devices may be preprocessed to reduce noise and normalize the information. For example, preprocessing may include filtering point clouds to remove outliers, rectifying depth maps to ensure consistency, and smoothing surface data to produce a clean and continuous model. Once the data is preprocessed, it may be merged into a unified 3D model by aligning individual 3D datasets from each imaging device using iterative registration techniques to form a cohesive point cloud and / or depth map. According to some aspects of this disclosure, a surface mesh that accurately represents the geometry of the user / object may be generated.

[0069] After the 3D model is formed, texture data, derived from color information captured by the plurality of imaging devices may be mapped onto the surface mesh. For example, textures from multiple viewpoints may be blended to ensure that the surface of the user / object is uniformly covered and appears realistic from all angles. Multiple perspective views of the user / object that each correspond to different viewing angles may be unified into a 3D model (e.g., the projected image of FIG. 13, etc.).

[0070] The 3D model may be displayed sing suitable 3D A / V components. Additional details on examples of suitable 3D A / V components, and associated systems andmethods, are discussed below with reference to FIGS. 14A-16. As further illustrated in FIG. 13, the communication system can include one or more projectors (two are illustrated in FIG. 13, LCD projectors and / or light engines (e.g., LEDs, laser diodes, super luminescent diodes, and the like) in conjunction with digital micromirror devices, goniometers, MEMS mirrors, and the like) and speakers carried by the deployable columns. The multiple projectors can create a 3D image on the curved screen while the multiple speakers create a 3D sound environment around the communication system. In some embodiments, the projectors and / or speakers are collocated with the recording units. In other embodiments, the projectors and / or speakers are positioned in different locations on the columns than the recording units.

[0071] In some embodiments, the communication system can beportable. For example, the screen can be moved between a collapsed, transportation state (e.g., folded up into one of the columns, retracted into one of the columns, and the like) and a deployed state. Additionally, or alternatively, the columns can be moved between the collapsed, transportation state (e.g., folded up, telescopically retracted, and the like) and a deployed state (as illustrated). The collapsed state can allow the communication system to be more easily transported between different locations. As a result, for example, a user can pack the communication system in a bag when they travel. In a specific, non-limiting example, a business professional can transport the communication system while traveling for work and still attend meetings through a life-size, virtual environment.

[0072] In some embodiments, the curved screen can be biased toward (or otherwise configured to return to) its shape along one or more axes when moved from the collapsed state to the deployed state, allowing for quick setup of the communication system. For example, the screen can include a shape memory material that quickly returns to the deployed state when a small voltage is applied to the screen. In various embodiments, the screen can include a semitransparent (e.g., polka-dotted mesh) material, a thermal coating, and / or a dielectric coating. The semitransparent material can allow the user to at least partially see through the screen even in the deployed state. The thermal and dielectric coatings can help protect the screen from damage.3D A / V Capturing Systems and Methods

[0073] Capturing, reconstructing, and communicating A / V data related to 3D images typically requires relatively long exposures to capture sufficient detail in the images, largecomputational resources, and / or large data sizes. Each of these requirements can impose limitations on a communication system, especially for real-time communication sessions (e.g.,on a telecommunication platform). The embodiments of FIGS. 14A-15 are expected to help address these limitations to enable the communication systems disclosed herein to capture and process high-resolution 3D images and / or communicate those images for display at another communication system in real-time (or close to real-time).

[0074] FIGS. 14A and 14B are a partially schematic front view and a partially schematic cross-sectional view, respectively, of a light-field camera configured according to some aspects of this disclosure. The example light-field camera that is illustrated in FIGS. 14A and 14B can be included in a communication system to capture 3D images (or 2D images with a sufficiently high depth of field to approximate 3D images) that can then be processed, communicated, and / or displayed. Typical light-field cameras include a microlens array positioned at a focal length distance from a photosensitive imaging array. However, the microlens design can suffer from surface reflection losses and transmission losses as well as chromatic aberration. To reduce the reflection and / or transmission losses, as illustrated in FIGS. 14A and 14B, the microlens are replaced by miniature reflective objectives that each include two curved reflective surfaces positioned to focus incoming light. In addition to reducing the reflection and transmission losses, the all-reflective technique may not suffer from chromatic aberration and / or can extend the spectral bandwidth range by using a metallic surface for focusing the light.

[0075] In some embodiments, the communication system uses multiple photosensitive detector arrays in combination with structured light projection to capture the 3D A / V data. For example, two cameras can be positioned to achieve stereo vision while software algorithms identify similar features in each scene to match the pixels and map the depth. However, it can be difficult to identify and / or map smaller features and / or similar features using the two cameras. Purely by way of example, when a white paper is positioned in front of a movable whiteboard with a white wall in the background, the two cameras (and the software algorithms connected thereto) may be unable to identify the distinction between the different scene elements and create an accurate 3D image. It can also be difficult to construct 3D images under low light conditions and / or high brightness conditions (e.g., when the contrast between objects is reduced). To address these challenges, the communication system can project a structured light onto the scene and use one or more multi- scope cameras to capture the structured light for use in identifyingobjects in the scene. The multi- spectral cameras can use a hyperspectral camera, optical bandpass filters, and / or optical prisms to separate different spectral channels into an appropriate photosensitive sensor (e.g., an infrared sensor, a red sensor, a blue sensor, and a green sensor).

[0076] The multi-scope cameras can enhance the depth resolution in a 3D image by reliably capturing patterns from the structured light that allow the communication system to identify objects in the field of view. For example, FIG. 15 schematically illustrates an example of the image data that can be captured by the multi-scope cameras, where the black dots represent spots projected by the structured light. The structured light may be an array of dots, squares or stripes in repeated or alternating patterns, or a custom encoded pattern, produced using a variety of standard optical techniques. The size and / or warping of the spots and / or patterns can be used to help identify objects and / or determine depth in each of the images, thereby allowing the communication system to quickly and accurately determine depth resolution, even in conditions with relatively low (or high) light.

[0077] The light sources for the structured light projection can include LEDs or lasers that operate in near-infrared (NIR), infrared (IR), and / or ultraviolet (UV) wavelengths. As a result, the structured light is invisible to the human eye and does not affect the image captured by ordinary image sensors (e.g., RGB sensors of the multi-scope sensors). The power of the structured light emitters can be controlled to reduce and / or mitigate safety concerns with the wavelengths utilized. In some embodiments, the light sources are multicolor light sources (e.g., able to emit both IR and UV light), allowing the system to use different light wavelengths to respond to changes in scene brightness. Purely by way of example, the IR wavelength can be used when brightness levels are low while the UV wavelength can be used when brightness levels are high.

[0078] In one example, the multi-scope cameras can include two or more standard monochrome, 3-color (RGB) image sensors (e.g., silicon-based sensors and the like), and / or other suitable image sensors that are in a combination configuration. The combination arrangement can allow the sensors to have a spectral response to the NIR, IR, and / or UV structural light in addition to the visible light.

[0079] In another example, the multi-scope cameras can use separate image sensors for capturing the visible light and invisible structured light. The visible light sensors could be standard 3-color camera units (or other suitable image sensors) while the invisible structured light sensors could be NIR, IR, and / or UV-specific sensing arrays. In thisexample, the visible and invisible light sensors can be co-located in two or more hybrid sensor pairs, with the pairs arranged in a stereo camera or multi-scope camera configuration. By separating the visible and invisible light, the sensors can improve the fidelity of the resulting 3D color image.

[0080] In yet another example, the communication system can include two or more 4- channel image sensors. The 4-channel sensors can be arranged in a stereo camera or multi- scope configuration. In either case, the 4-channel sensors include 4-channel color filter arrays to separate the light into three visible channels (e.g., blue, green, and red) and an invisible channel (e.g., NIR, IR, and / or UV). The three visible channels provide RGB color images of the subject while the invisible channel captures the structured light information. The 4-channel configuration can require the least amount of space (e.g., compared to the other examples), be relatively lightweight, and / or may be relatively cheap to mass produce. As a result, the 4-channel configuration may be especially useful for portable communication systems.

[0081] In yet another example, the communication system can include multi- sensor receiver units with various optical elements to separate different spectral channels into physically separate image sensors. For example, the multi-sensor receiver units can include bulk optic interference filters, lenses, mirrors, and / or prisms to separate the different spectral channels. While the sensors of this example are more expensive, the individual sensor units can provide the highest quality 3D images (e.g., because they can be more sensitive to the incoming light).

[0082] In each of the examples above, the image sensors can be combined with a variety of suitable optical components, such as fixed and tunable lenses. Tunable lenses include electrostatically deformable liquid lenses. Stereo camera configurations can include point stereo cameras with two imaging subsystems built into a single camera unit and / or stereo vision systems using two separate cameras. Multi-scope camera systems can use three or more sensing locations to provide higher-quality 3D image data and / or minimize deleterious object occlusion effects in the data at any given location.Example Methods for Capturing, Processing, and Displaying 3D Images

[0083] Power consumption and processing resource requirements can impose significant limits on any of the communication systems discussed above, especially for systems operating in low contrast settings (e.g., high or low brightness). The limitations areimpediments to the communication system being portable and / or being able to support a real-time communication session. Accordingly, in some embodiments, the communication system can implement various capture-control, processing, and / or display-control techniques to reduce power and / or lower the processing resources required to support the communication system.

[0084] For example, the communication system can reduce the power output of a structured light supply component to reduce the power consumption of the overall system. In such embodiments, the structured light can be generated by an optical component operating in a pulsed mode instead of a continuous mode. In the pulsed mode, the optical component has a duty cycle that is equal to the proportion of time that the optical component is actively emitting the structured light. By dropping the duty cycle below, for example, 50% (corresponding to emitting the structured light less than half of the time), the optical component can reduce the power consumption of the communication system while emitting enough structured light to process the 3D A / V data. In various specific, nonlimiting examples, the duty cycle can be about 5%, 10%, 20%, 30%, 50%, 75%, or any other suitable duty cycle. An additional benefit of reducing the duty cycle is that the user is exposed to less NIR, IR, and / or UV light while using the communication system. As a result, the reduction may also help improve the safety of the communication system for prolonged use (e.g., during full day conferences).

[0085] In another example, the communication system can intentionally reduce the quality of the 3D image being displayed. The reduction in image quality can include reducing selective pixel brightness, switching off various pixels (e.g., pixels corresponding to the background, lower half of a subject, and / or reducing the resolution of an image), switching from a color image to a monochrome image, and / or reducing a display refresh rate. While each change reduces the image quality created, the changes can reduce the power consumption of the communication system. Examples of various reductions in image quality are illustrated in FIGS. 16A-16D. More specifically, FIG. 16A illustrates an image (in 2D) with full image quality, FIGS. 16B and 16C illustrate the image in various monochromatic modes, and FIG. 16D illustrates the image in monochromatic mode with only pixels corresponding to sharp lines turned on (e.g., a wireframe image).

[0086] In each of the examples above, the power-saving techniques can be selectively performed. For example, the communication system can intentionally reduce the imagequality only when the communication system is not connected to a permanent power source (e.g., unplugged from an outlet). In this example, the communication system can operate with full image quality when the communication system is plugged in, then conserve power when the communication system is in a portable mode. In another example, the communication system can pulse the structured light and / or intentionally reduce the image quality only when a battery powering the communication system is below a predetermined threshold. In this example, the communication system can implement the image quality reductions only when battery life is being threatened. In yet another example, the communication system can pulse the structured light and / or intentionally reduce the image quality only in response to a user prompt to do so, allowing a user to select when to conserve power.

[0087] In yet another example, the communication system can reduce the computational resources required for processing by selectively processing the 3D A / V data. For example, the communication system can extract the difference between subsequent image frames in real-time and then process only the differences to generate subsequent 3D frames. As a result, for example, the communication system can avoid reprocessing portions of the images corresponding to a background in the 3D A / V data that will not change (or change significantly) over time. As a result, less 3D A / V data is required to be processed, thereby reducing the computational resources required to support a real-time communication session. The extraction process can be dynamic, with the rate of change between frames being measured and presented to the communication system (or a server coupled to the communication system, such as a cloud server) to changes of different sizes and / or decide which changes necessitate new processing. Additionally, or alternatively, the 3D A / V data (and / or the delta matrix data) can be compressed and / or factorized, without compromising the resulting 3D image quality. The compression and / or factorization can reduce the size of the data that is transmitted between communication systems (and / or any suitable waypoints, such as a cloud server), thereby requiring less bandwidth to support a real-time communication session. Reducing the data processing, handling, and transmission can also reduce the power consumption of the communication system.Example Systems and Methods for Creating a 3D Display

[0088] In some embodiments, the 3D displays disclosed herein include auto stereoscopic displays, which provide a way to display stereoscopic images without requiring a user to wear special wear optical elements (e.g., headgear, glasses, and / or the like). The stereoscopic images, in turn, rely on the binocular perception of 3D depth to create the 3D effect. Furthermore, the auto stereoscopic displays disclosed herein can be viewed from a range of angles (or any angle), rather than requiring a user to stand in a particular location and / or at a particular angle to view the 3D image.

[0089] FIGS. 17A-17D are partially schematic diagrams of a system 1700 for creating a 3D image 1702 according to some aspects of this disclosure. As illustrated in FIG. 17A, the system 1700 includes a projection subsystem 1710 that generates and directs light beams associated with the 3D image 1702 and an optical subsystem 1720 positioned to shape and / or direct the light beams from the projection subsystem 1710.

[0090] The projection subsystem 1710 includes a processing and control unit 1712 (“controller 1712,” such as the computing device discussed above with reference to FIG. 3), as well as an image generation component 1714 and a scanning mirror 1716 operatively coupled to the controller 1712. The image generation component 1714 can be an LED projector, a liquid crystal display projector, a laser projector, a digital light processing projector, a liquid crystal on a silicon projector, and / or the like having one or more components to generate and project the light beams. The scanning mirror 1716 can be a galvo mirror and / or any other suitable component that includes a single-axis or dualaxis scanning component. As further illustrated in FIG. 17A, the projection subsystem 1710 also includes projection optics 1718 that includes a ID or a 2D array of reflective elements (e.g., convex mirrors) downstream from the scanning mirror 1716.

[0091] The optical subsystem 1720 can include a first Fresnel lens 1722, a mirror 1724 positioned downstream from the first Fresnel lens 1722 with respect to light from the projection subsystem 1710, and final shaping component 1725 downstream from the mirror 1724 that includes one or more components. For example, as illustrated in FIGS. 17B and 17C, the final shaping component 1725 can include a second Fresnel lens 1726 and a diffuser 1728 downstream from the second Fresnel lens 1726.

[0092] Returning to the description of FIG. 17A, when the system 1700 is in operation, the image generation component 1714 generates one or more light beams associated with the 3D image 1702 and directs the light beams toward the scanning mirror 1716. Thescanning mirror 1716 then redirects the light beams such that one or more light beams is incident on each reflective element in the projection optics 1718. As a result, a virtual image is formed on each reflective element in the projection optics 1718 (e.g., on each convex mirror). Each virtual image can correspond to one part of a stereo-image pair for the 3D image 1702 when viewed from a particular angle (e.g., head-on, from the side, and the like). In some embodiments, the array of reflective elements in the projection optics 1718 allows the projection subsystem 1710 to create a plurality of stereo-image pairs such that the 3D image 1702 will be different depending on the angle a viewer 10 observes the 3D image 1702 from. In some embodiments, the 3D image 1702 appears the same to all viewers independent of their viewing angle.

[0093] The projection optics 1718 then reflect the virtual images toward the first Fresnel lens 1722 in the optical subsystem 1720. The first Fresnel lens 1722 then shapes the light beams to form second virtual images on the mirror 1724. The mirror 1724 then reflects the second virtual image back through the first Fresnel lens 1722, thereby creating a real image incident on the final shaping component 1725. The double-pass through the first Fresnel lens 1722 allows the system 1700 to reduce the distance between the final shaping component 1725 and the first Fresnel lens 1722 by using the space available therebetween twice while forming the final image. As a result, for example, a lens with a focal length of 500 millimeters (mm) would ordinarily require a one-to-one imaging distance of 2 meters (m). However, the double pass through the first Fresnel lens 1722 allows the system 1700 to have a one-to-one imaging distance of only 1 m, thereby cutting the thickness of the system 1700 in half. This reduction is further improved by the inclusion of convex reflective components in the projection optics 1718. The convex components create virtual images and imitate the large distances required for physical image sources. As a result, returning to the example above, the system 1700 can have a one-to-one imaging distance of about 0.5 m, about 0.25 m, or of less than 0.25 m, thereby further reducing the overall thickness of the system 1700.

[0094] The final shaping component 1725 isolates each stereo-image pair such that the viewer 10 can only view one half of the pair with each of their eyes independent from the angle they view the final shaping component 1725 from. For example, FIG. 17B illustrates the system 1700 forming a first half of a stereo-image pair for the 3D image 1702. As illustrated, the second Fresnel lens 1726 and the diffuser 1728 help ensure that the first half of the stereo-image pair is only viewable by the right eye of the viewer 10.Fig. 17C illustrates the system 1700 forming a second half of a stereo-image pair for the 3D image 1702. As illustrated, the second Fresnel lens 1726 and the diffuser 1728 help ensure that the second half of the stereo-image pair is only viewable by the left eye of the viewer 10. As a result, the stereo-image pair will create a 3D effect for the viewer 10 as they view the 3D image.

[0095] FIG. 17D schematically illustrates additional details on the formation of the 3D image 1702 in accordance with the processes discussed above. For example, as illustrated, a first virtual image 1704 is formed on a first reflective component 1718a of the projection optics 1718. The first virtual image 1704 is then reflected toward the first Fresnel lens 1722 to form a second virtual image 1706 on the mirror 1724. The second virtual image 1706 is schematically shown to the right of the mirror to emphasize the increase in effective travel distance created by the convex shape of the first reflective component 1718a and the double-pass through the first Fresnel lens 1722. That is, as discussed above, the convex shape of the first reflective component 1718a and the doublepass through the first Fresnel lens 1722 create a virtual travel distance that is more than double the actual travel distance, allowing the virtual travel distance to match the focal length of the first and second Fresnel lenses subsystem, 1726 while the actual travel distance is a fraction of the focal length. The second virtual image 1706 is then reflected as through the first and second Fresnel lenses 1722 to form a real image 1708 on the diffuser 1728. The real image 1708 corresponds to one-half of a stereo-image pair for the 3D image 1702. Accordingly, as illustrated in FIG. 17D, the diffuser 1728 is configured to ensure that the real image 1708 is only visible to one eye of the viewer 10.

[0096] FIGS. 18A and 18B illustrate additional details on the system 1700 of FIGS. 17A- 17D according to some aspects of this disclosure. As illustrated in FIG. 18 A, incoming light beams associated with one-half of the stereo-image pair can be incident on the diffuser 1728 at a diffusion point 1730. Without the diffuser 1728, the viewer 10 would only be able to correctly see the 3D image 1702 when they stood at a specific angle aligned with the diffusion point to isolate the stereo-image pairs to their right and left eyes. The diffuser 1728 can shape the beam divergence and / or scattering angle at the diffusion point 1730 to form n-number of viewing-angle 1732.

[0097] The number of and / or angle of the viewing-angles 1732 can be at least partially dependent on the angle of the light beam incident on the on the diffuser 1728. As a result, as schematically illustrated with respect to FIG. 18B, the diffuser 1728 can create aplurality of stereo-image pairs 1735 that can be viewed from a variety of angles by scattering each incident light beam into a plurality of bundle of light rays 1734. That is, each light beam from the first and second virtual images 1704, 1706 incident on the diffuser 1728 creates bundles of light rays that form corresponding halves of the stereoimage pairs 1735. For example, the diffuser 1728 can split a first light beam 1709a incident on the diffuser 1728 at a first incident-angle into a first bundle of light rays 1734a and shape them according to the scattering property imposed by the diffuser 1728. As a result, the viewer 10, at a first viewing-angle, sees a collection of bundles of rays from a first half 1735a of a stereo-image pair with their left eye. Further, the diffuser 1728 can split a second light beam 1709b incident on the diffuser 1728 at a second incident-angle into a second bundle of light rays 1734b, different from the first bundle of light rays 1734a, and shape them according to the scattering property imposed by the diffuser 1728. As a result, the viewer 10, at the first viewing angle, sees a collection of bundles of rays from a second half 1735b of the stereo-image pair with their right eye. Thus, the first and second halves 1735a, 1735b of the stereo-image pair create a 3D image for the viewer 10. The first and second light beams 1709a, 1709b can be generated by the projection subsystem 1710 of FIG. 17A via rapid movement of the scanning mirror 1716 and / or multiple images being projected by the image generation component 1714 into the scanning mirror 1716 and the projection optics 1718.

[0098] As further illustrated in FIG. 18B, similar stereo-pairs can be viewed from different viewing angles, allowing the 3D image to be viewed from a variety of viewing angles. In some embodiments, the diffuser 1728 creates a continuous (or generally continuous) projection of the stereo-image pairs, allowing the 3D image 1702 (FIG. 18 A) to be viewed from a variety of angles in front of the diffuser 1728. In various embodiments, the total viewing angle can be between about 1 degree and about 180 degrees, between about 1 degree and about 120 degrees, and / or between about 5 degrees and about 90 degrees. In some embodiments, the diffuser 1728 creates a continuous (or generally continuous) projection of the stereo-image pairs in two dimensions, allowing the 3D image 1702 to be viewed irrespective of the viewer’s height with respect to the diffuser. Accordingly, it will be understood that although specific incident light beams and the resulting bundles of light rays and stereo-image pairs have been illustrated and discussed with respect to Fig. 18B, system 1700 can include additional incident light beams, bundles of light rays, and stereo-image pairs. Fig. 18B merely illustrates a specific subsetof the incident light beams, bundles of light rays, and stereo-image pairs for clarity purposes and to avoid obscuring the operation of the system 1700.

[0099] In some embodiments, the diffuser 1728 and / or the second Fresnel lens 1726 have a curved (in one or two dimensions) configuration. In such embodiments, the real images incident on different portions of the diffuser 1728 can correspond to different angles of the 3D image 1702, allowing viewers to see different perspectives of the 3D image 1702 as they move around the system 1700. In some embodiments, the image generation component 1714 and the scanning mirror 1716 operate to create multiple virtual images corresponding to different angles of the 3D image 1702 and direct the different virtual images toward the optical subsystem 1720 at different angles. As a result, the system 1700 can create a different perspective of the 3D image 1702 at different viewing angles, allowing viewers to see the different perspectives as they move around the system 1700.

[0100] In some embodiments, for example as illustrated in FIG. 17A, the system 1700 can also include a recording subsystem 1740. The recording subsystem 1740 can include one or more microphones, one or more cameras, one or more motion sensors, and / or the like to record 3D audio / video data of the viewer 10. The 3D audio / video data can then be sent to another system 1700 for display to another viewer, recorded and played back on the system 1700 later, and / or the like. Additionally, or alternatively, the system 1700 can track the location of the viewer or the head of the viewer 10 around the system 1700. The location can then be used to project different perspectives of the 3D image 1702 associated with the viewer’s change in position.

[0101] FIG. 19 shows a flowchart of an example method 1900 for multi- view three- dimensional display of content, according to some aspects of this disclosure. Method 1900 can be performed by processing logic that can comprise hardware (e.g., circuitry, dedicated logic, programmable logic, microcode, etc.), software (e.g., instructions executing on a processing device), or a combination thereof. It is to be appreciated that not all steps may be needed to perform the disclosure provided herein. Further, some of the steps may be performed simultaneously, or in a different order than shown in FIG. 19, as will be understood by a person of ordinary skill in the art.

[0102] Method 1900 shall be described with reference to FIGs. 1-18B. However, method 1900 is not limited to the aspects of those figures. A computing device (e.g., computing device 300, the compact device of FIGs. 4-5, device 100 of FIG. 1, devices 205A-D andserver 210 of FIG. 2, etc.,) may facilitate multi- view three-dimensional display of content.

[0103] In 1902, server 210 receives first image data that indicates a first view of an object from a first imaging device located at a first position in a first environment and second image data that indicates a second view of the object from a second imaging device located at a second position in the first environment. According to some aspects of this disclosure, server 210 receives the first image data and the second image data based on a request for a communication session between a user located in the first environment and a user located in the second environment.

[0104] In 1904, server 210 generates three-dimensional data indicative of an object. Server 210 may generate the three-dimensional data indicative of the object based on spatial data points from the first image data mapped to spatial data points of the second image data.

[0105] In 1904, server 210 causes display of a three-dimensional representation of the object that comprises at least the first view and the second view. Server 210 may cause the display of the three-dimensional representation of the object based on the three- dimensional data sent to a volumetric display device in a second environment.

[0106] According to some aspects of this disclosure, server 210 causes the display of the three-dimensional representation of the object by causing the volumetric display device to project a different portion of a plurality of portions of the three-dimensional data to each of a plurality of slits of a display panel. According to some aspects of this disclosure, the volumetric display device may adjust a respective angle of projection for the different portion of the plurality of portions of the three-dimensional data projected to each of the plurality of slits of the display panel based on an indication of a change of position of a user of the volumetric display device.

[0107] According to some aspects of this disclosure, server 210 causes the display of the three-dimensional representation of the object by causing the volumetric display device to rotate a rotatable blade about an axis so that the rotatable blade is at a rotation angle as a function of time. The rotatable blade may include a plurality of light-emitting elements disposed on a surface of the rotatable blade. The volumetric display device may illuminate the plurality of light-emitting elements based at least in part on each portion of a plurality of portions of the three-dimensional data mapped to the plurality of light sources based at least in part on the rotation angle.

[0108] According to some aspects of this disclosure, server 210 causes the display of the three-dimensional representation of the object by causing the volumetric display device to project the three-dimensional data to a micro-perforated screen section that is attached to an axis. The micro-perforated screen section may be perceived as transparent based on a rotation of the micro-perforated screen section around the axis.

[0109] According to some aspects of this disclosure, server 210 causes the display of the three-dimensional representation of the object by causing the volumetric display device to project the three-dimensional data to a surface generated from a collection of particles attracted to an area by a laser emitted by the volumetric display device.

[0110] It will be appreciated that although the various examples, embodiments, and aspects have been described herein, the various examples, embodiments, and aspects are non-limiting. That is, any example, embodiment, and / or aspect described herein may include fewer or more elements than described. Any examples, embodiments, and / or aspects may be combined to form different examples, embodiments, and / or aspects. Further, for one or more embodiments, at least one of the components set forth in one or more of the preceding figures may be configured to perform one or more operations, techniques, processes, and / or methods as set forth in the example section below. For example, the communication systems, 3D Displays, 3D capturing components, and / or the like described herein in connection with one or more of the preceding figures may be configured to operate in accordance with one or more of the examples set forth below.EXAMPLES

[0111] Example 1 : A communication system, comprising: a compact device having a memory and processor; a three-dimensional (3D) volumetric display component communicably coupled to the compact device; and a 3D audio and video (A / V) capture component communicably coupled to the compact device, wherein the memory stores instructions that, when executed by the processor, control the compact device to: receive a first set of 3D A / V data from the 3D A / V capture component; communicate the first set of A / V data to a server in real-time with receiving the first set of A / V data; receive a second set of 3D A / V data, the second set of A / V data formatted to create a 3D image on the 3D volumetric display; and control the 3D volumetric display to display the set of A / V data in real-time with receiving the second set of A / V data.

[0112] Example 2: The communication system of Example 1, wherein the 3D volumetric display includes at least one of: a plurality of rotatable blades, wherein each of the plurality of rotatable blades includes an array of light emitting components; a rotatable, curved material; a curved, semi-transparent screen having a plurality of projection components configured to generate a 3D image on the curved screen; an electromagnetic array configured to magnetically suspend particles in free space; or a laser system configured to optically trap a plurality of particles in free space.

[0113] Example 3: The communication system of any of Examples 1-2, wherein the 3D A / V capture component comprises: a light emitting component configured to emit a structured light onto a user of the communication system, the structured light having a wavelength invisible to a human eye; and two or more image sensors positioned in different locations and configured to record light visible to the human eye and light invisible to the human eye.

[0114] Example 4: The communication system of any of Examples 1-3, wherein the instructions further cause the processor to at least partially process, in real-time, the first set of 3D A / V data prior to communicating the first set of A / V data to the server.

[0115] Example 5: The communication system of any of Examples 1-4, wherein processing the first set of 3D A / V data includes extracting a difference between subsequent image frames in the 3D A / V data.

[0116] Example 6: The communication system of any of Examples 1-4, wherein processing the first set of 3D A / V data includes applying an image filter to the 3D A / V data, the filter reducing an image quality of the 3D A / V data.

[0117] Example 7: A communication system for multi- view three-dimensional display of content, comprising: a memory; and at least one processor coupled to the memory and configured to perform operations comprising: capturing, by a first device, image data indicative of an object and parallax information that indicates a change in a position of the object position when viewed from different perspectives; encoding, based on an encryption key, image data indicative of an object and parallax information that indicates a change in a position of the object position when viewed from different perspectives into a data packet; and sending the data packet to a second device, wherein the second device is configured to: decode the packet via the encryption key to obtain the image data and the parallax information; generate a three-dimensional image of the object based on thedecoded image data and decoded parallax information; and project the three-dimensional image of the object to a volumetric display.

[0118] From the foregoing, it will be appreciated that specific embodiments of the technology have been described herein for purposes of illustration, but well-known structures and functions have not been shown or described in detail to avoid unnecessarily obscuring the description of the embodiments of the technology. To the extent any material incorporated herein by reference conflicts with the present disclosure, the present disclosure controls. Where the context permits, singular or plural terms may also include the plural or singular term, respectively. Moreover, unless the word “or” is expressly limited to mean only a single item exclusive from the other items in reference to a list of two or more items, then the use of “or” in such a list is to be interpreted as including (a) any single item in the list, (b) all of the items in the list, or (c) any combination of the items in the list. Furthermore, as used herein, the phrase “and / or” as in “A and / or B” refers to A alone, B alone, and both A and B. Additionally, the terms “comprising,” “including,” “having,” and “with” are used throughout to mean including at least the recited feature(s) such that any greater number of the same features and / or additional types of other features are not precluded. Further, the terms “approximately” and “about” are used herein to mean within at least 10% of a given value or limit. Purely by way of example, an approximate ratio means within 10% of the given ratio.

[0119] Several implementations of the disclosed technology are described above in reference to the figures. The computing devices on which the described technology may be implemented can include one or more central processing units, memory, input devices (e.g., keyboard and pointing devices), output devices (e.g., display devices), storage devices (e.g., disk drives), and network devices (e.g., network interfaces). The memory and storage devices are computer-readable storage media that can store computerexecutable instructions that implement at least portions of the described technology. In addition, the data structures and message structures can be stored or transmitted via a data transmission medium, such as a signal on a communications link. Various communications links can be used, such as the Internet, a local area network, a wide area network, or a point-to-point dial-up connection. Thus, computer-readable media can comprise computer- readable storage media (e.g., “non-transitory” media) and computer-readable transmission media.

[0120] From the foregoing, it will also be appreciated that various modifications may be made without deviating from the disclosure or the technology. For example, one of ordinary skill in the art will understand that various components of the technology can be further divided into subcomponents, or that various components and functions of the technology may be combined and integrated. In addition, certain aspects of the technology described in the context of particular embodiments may also be combined or eliminated in other embodiments.

[0121] Furthermore, although advantages associated with certain embodiments of the technology have been described in the context of those embodiments, other embodiments may also exhibit such advantages, and not all embodiments need necessarily exhibit such advantages to fall within the scope of the technology. Accordingly, the disclosure and associated technology can encompass other embodiments not expressly shown or described herein.

Claims

WHAT IS CLAIMED IS:

1. A method for multi- view three-dimensional display of content, the method comprising: receiving first image data that indicates a first view of an object from a first imaging device located at a first position in a first environment and second image data that indicates a second view of the object from a second imaging device located at a second position in the first environment; generating, based on spatial data points from the first image data mapped to spatial data points of the second image data, three-dimensional data indicative of the object; and causing, based on the three-dimensional data sent to a volumetric display device in a second environment, display of a three-dimensional representation of the object that comprises at least the first view and the second view.

2. The method of claim 1, wherein the causing the display of the three-dimensional representation of the object comprises causing the volumetric display device to project a different portion of a plurality of portions of the three-dimensional data to each of a plurality of slits of a display panel.

3. The method of claim 2, further comprising wherein the causing the display of the three- dimensional representation of the object comprises causing the volumetric display device to adjust a respective angle of projection for the different portion of the plurality of portions of the three-dimensional data projected to each of the plurality of slits of the display panel based on an indication of a change of position of a user of the volumetric display device.

4. The method of claim 1, wherein the causing the display of the three-dimensional representation of the object comprises causing the volumetric display device to: rotate a rotatable blade about an axis so that the rotatable blade is at a rotation angle as a function of time, wherein the rotatable blade comprises a plurality of light emitting elements disposed on a surface of the rotatable blade; andilluminate the plurality of light emitting elements based at least in part on each portion of a plurality of portions of the three-dimensional data mapped to the plurality of light sources based at least in part on the rotation angle.

5. The method of claim 1, wherein the causing the display of the three-dimensional representation of the object comprises causing the volumetric display device to project the three-dimensional data to a micro-perforated screen section that is attached to an axis, wherein the micro-perforated screen section is perceived as transparent based on a rotation of the micro-perforated screen section around the axis.

6. The method of claim 1, wherein the causing the display of the three-dimensional representation of the object comprises causing the volumetric display device to project the three-dimensional data to a surface generated from a collection of particles attracted to an area by a laser emitted by the volumetric display device.

7. The method of claim 1, wherein the receiving the first image data and the second image data is based on a request for a communication session between a user located in the first environment and a user located in the second environment.

8. A system, comprising: a memory; and at least one processor coupled to the memory and configured to perform operations comprising: receiving first image data that indicates a first view of an object from a first imaging device located at a first position in a first environment and second image data that indicates a second view of the object from a second imaging device located at a second position in the first environment; generating, based on spatial data points from the first image data mapped to spatial data points of the second image data, three-dimensional data indicative of the object; andcausing, based on the three-dimensional data sent to a volumetric display device in a second environment, display of a three-dimensional representation of the object that comprises at least the first view and the second view.

9. The system of claim 8, wherein the causing the display of the three-dimensional representation of the object comprises causing the volumetric display device to project a different portion of a plurality of portions of the three-dimensional data to each of a plurality of slits of a display panel.

10. The system of claim 9, the operations further comprising wherein the causing the display of the three-dimensional representation of the object comprises causing the volumetric display device to adjust a respective angle of projection for the different portion of the plurality of portions of the three-dimensional data projected to each of the plurality of slits of the display panel based on an indication of a change of position of a user of the volumetric display device.

11. The system of claim 8, wherein the causing the display of the three-dimensional representation of the object comprises causing the volumetric display device to: rotate a rotatable blade about an axis so that the rotatable blade is at a rotation angle as a function of time, wherein the rotatable blade comprises a plurality of light emitting elements disposed on a surface of the rotatable blade; and illuminate the plurality of light emitting elements based at least in part on each portion of a plurality of portions of the three-dimensional data mapped to the plurality of light sources based at least in part on the rotation angle.

12. The system of claim 8, wherein the causing the display of the three-dimensional representation of the object comprises causing the volumetric display device to project the three-dimensional data to a micro-perforated screen section that is attached to an axis, wherein the micro-perforated screen section is perceived as transparent based on a rotation of the micro-perforated screen section around the axis.

13. The system of claim 8, wherein the causing the display of the three-dimensional representation of the object comprises causing the volumetric display device to project the three-dimensional data to a surface generated from a collection of particles attracted to an area by a laser emitted by the volumetric display device.

14. The system of claim 8, wherein the receiving the first image data and the second image data is based on a request for a communication session between a user located in the first environment and a user located in the second environment.

15. A non-transitory computer-readable medium having instructions stored thereon that, when executed by at least one computing device, causes the at least one computing device to perform operations comprising: receiving first image data that indicates a first view of an object from a first imaging device located at a first position in a first environment and second image data that indicates a second view of the object from a second imaging device located at a second position in the first environment; generating, based on spatial data points from the first image data mapped to spatial data points of the second image data, three-dimensional data indicative of the object; and causing, based on the three-dimensional data sent to a volumetric display device in a second environment, display of a three-dimensional representation of the object that comprises at least the first view and the second view.

16. The non-transitory computer-readable medium of claim 15, wherein the causing the display of the three-dimensional representation of the object comprises causing the volumetric display device to project a different portion of a plurality of portions of the three-dimensional data to each of a plurality of slits of a display panel.

17. The non-transitory computer-readable medium of claim 16, the operations further comprising wherein the causing the display of the three-dimensional representation of the object comprises causing the volumetric display device to adjust a respective angle of projection for the different portion of the plurality of portions of the three-dimensionaldata projected to each of the plurality of slits of the display panel based on an indication of a change of position of a user of the volumetric display device.

18. The non-transitory computer-readable medium of claim 15, wherein the causing the display of the three-dimensional representation of the object comprises causing the volumetric display device to: rotate a rotatable blade about an axis so that the rotatable blade is at a rotation angle as a function of time, wherein the rotatable blade comprises a plurality of light emitting elements disposed on a surface of the rotatable blade; and illuminate the plurality of light emitting elements based at least in part on each portion of a plurality of portions of the three-dimensional data mapped to the plurality of light sources based at least in part on the rotation angle.

19. The non-transitory computer-readable medium of claim 15, wherein the causing the display of the three-dimensional representation of the object comprises causing the volumetric display device to project the three-dimensional data to a micro-perforated screen section that is attached to an axis, wherein the micro-perforated screen section is perceived as transparent based on a rotation of the micro-perforated screen section around the axis.

20. The non-transitory computer-readable medium of claim 15, wherein the receiving the first image data and the second image data is based on a request for a communication session between a user located in the first environment and a user located in the second environment.

Images