Smartphone Plate Accessory for 3D Light Field Capture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current smartphone technologies face challenges in capturing high-quality stereoscopic 3D and light field 4D images and videos due to artifacts from object movement, cumbersome and expensive hardware, and inconvenient use, while virtual reality content viewing is hindered by bulky and uncomfortable head-mounted displays.

Innovation Solution

A portable accessory with optical components that can be attached to smartphones, enabling stereoscopic 3D and light field 4D capturing and viewing by forming multiple images from various angles onto the camera sensor, using computational photographic algorithms, and providing a lightweight, flexible, and affordable solution for virtual reality content display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If software solutions are used to capture 3D images using a single mobile camera, then device complexity is reduced, but image quality deteriorates due to artifacts from object movement and sequential capture

Engineering Contradiction:
Improvecamera system complexityVSAvoidimage quality
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent divides the single camera's field of view into multiple zones using virtual horizons at different angles. The camera captures multiple images by panning across these segmented zones, which are then stitched together to form a complete 360-degree spherical image. This segmentation approach maintains image quality by capturing each zone with the full camera resolution while avoiding the need for complex multi-camera systems.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent pre-calculates and stores virtual horizon angles and stitching parameters before capture. The system prepares the spherical image framework in advance, allowing the camera to simply capture images at predetermined angles and positions. This preliminary preparation eliminates the need for complex real-time processing during capture, maintaining image quality while simplifying the device requirements.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If bulky hardware accessories are used to enable 3D and light field capturing, then imaging capabilities are improved, but ease of operation deteriorates due to cumbersome setup and portability issues

Engineering Contradiction:
Improveimaging capabilityVSAvoidportability
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The patent makes the smartphone camera perform multiple functions: capturing 2D images, 360-degree spherical images, and stereoscopic 3D images using the same single camera sensor. By utilizing software processing and computational photography techniques, the system eliminates the need for separate dedicated cameras or bulky accessories, maintaining full portability while enabling advanced imaging capabilities.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent replaces physical mechanical systems (multiple cameras, mirrors, prisms, bulky housings) with computational methods. The smartphone's processor performs complex image stitching, spherical projection, and 3D reconstruction algorithms to achieve light field and stereoscopic effects that would otherwise require elaborate optical hardware. This substitution maintains ease of operation while delivering advanced imaging capabilities.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Manufacturing precision

If expensive dedicated 3D camera systems are used, then imaging precision is improved, but device complexity and cost increase

Engineering Contradiction:
Improve3D imaging precisionVSAvoidsystem complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent creates virtual copies of the camera's viewing angle by capturing images at different pan angles and reconstructing them into a spherical coordinate system. The computational stitching process generates multiple virtual perspectives from a single physical camera, effectively copying the functionality of multiple cameras without the associated complexity and cost. This allows precise 3D and 360-degree imaging using only one camera sensor.

Inventive Principle:
Principle #26Copying

4Adaptability or versatility

If traditional head-mounted displays are used for virtual reality viewing, then immersion is improved, but ease of operation worsens due to bulkiness and discomfort

Engineering Contradiction:
Improvevirtual reality viewing capabilityVSAvoidcomfort
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent enables the smartphone to function as both the camera for capturing 360-degree content and the display for viewing it. The same device that captures the spherical image can display it in VR mode, eliminating the need for separate head-mounted displays. The smartphone's existing screen and processing capabilities are utilized to provide immersive viewing experiences, maintaining comfort and portability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables high-resolution, real-time stereoscopic 3D and light field 4D media capture and viewing, improving user experience with enhanced quality and convenience, and allowing for the use of existing smartphones as wearable virtual reality viewers and hologram displays.

Implementation Method 1

The optical component can be positioned such that it forms multiple images of the scene from multiple viewing angles onto the camera sensor

Methodology Applied
Scientific EffectLight field capturing: Plenoptic Camera

Implementation Method 2

a plate with an optical component that is attached to a smart device

Methodology Applied
Scientific EffectOptical reflection/refraction: Reflection

Data Source

PatentUS10757396B2Adding new imaging capabilities to smart mobile device
Publication Date: 2020.08.25 TAN WEINING
  • US10757396B2 patent drawing
  • US10757396B2 patent drawing
  • US10757396B2 patent drawing

AI summary

The disclosure presents novel methods and apparatuses to add new imaging functions to an existing smart device, comprising a plate accessory with one or more optical components that is attached to the smart device. The plate can be rotated to the front of the screen and supported at more than one sides of the smart device. The imaging function added could be a virtual reality viewer or a wide light field camera. The plate can also be worn on one's head by self-contained retractable brace, stands and strap. If the plate is moved close to the smart device's cameras, the optical components can form multiple images from multiple viewing angles of the scene onto the camera sensor. The captured images can be used to generate stereoscopic 3D or light field 4D recording of the scene by computational photographic algorithms. The attaching accessory is very light, portable, flexible, affordable and easy to use. Compared to the competitive methods, the present disclosure is a smallest wearable virtual reality smartphone case viewer that can be carried in pockets, and a method and apparatus to enable existing traditional phone cameras to capture light field 4D images and videos.