Movable Microlens Matrix for Switching Between 2D and 3D Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional cameras capture only two-dimensional images, while light field cameras capture three-dimensional images with depth information, but there is no method to shoot both types of images using a single electronic device.

Innovation Solution

A camera module with a movable microlens matrix that can switch between positions to enable the device to function as either a conventional camera or a light field camera, allowing the capture of two-dimensional and three-dimensional images based on user preference.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If a conventional camera structure is used, then the device is simple and easy to manufacture, but it can only capture two-dimensional images without depth information

Engineering Contradiction:
Improvedepth informationVSAvoidcamera structure
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The microlens matrix is designed to be movable between two positions: inserted into the optical path to enable light field photography, and removed to enable conventional photography. This dynamic reconfiguration allows a single device to provide both 2D and 3D imaging capabilities, resolving the contradiction between information completeness and device complexity

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The camera device is designed to perform multiple functions by incorporating a removable microlens matrix. When the microlens matrix is present, the device functions as a light field camera capturing depth information; when removed, it functions as a conventional camera. This multi-functionality eliminates the need for separate devices for 2D and 3D imaging

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Loss of information

If a light field camera with microlens matrix is used, then three-dimensional images with depth information can be captured, but the device complexity increases

Engineering Contradiction:
Improvedepth informationVSAvoidcamera structure
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The microlens matrix is designed as a movable component that can be dynamically inserted into or removed from the optical path. This dynamic design allows the system to switch between light field mode (with depth information) and conventional mode (without the microlens matrix), thereby reducing device complexity while maintaining the capability to capture three-dimensional images when needed

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The camera system is segmented into modular components: the main lens assembly, the removable microlens matrix, and the image sensor. This segmentation allows the microlens matrix to be independently controlled and positioned, enabling flexible configuration between different imaging modes and simplifying the overall device architecture

Inventive Principle:
Principle #1Segmentation

3Reliability

If separate devices are used for two-dimensional and three-dimensional imaging, then each device can be optimized for its specific function, but the overall system complexity and operation difficulty increase

Engineering Contradiction:
Improveimage qualityVSAvoidoperation complexity
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The device integrates both conventional camera and light field camera functionalities into a single unified system. The user can switch between 2D and 3D imaging modes by simply adjusting the microlens matrix position, eliminating the need to operate separate devices and significantly simplifying the user experience while maintaining optimized image quality for both modes

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables a single electronic device to capture high-quality three-dimensional images and process them to incorporate depth information into two-dimensional images, resulting in a final image with both depth and high image quality.

Implementation Method 1

a microlens matrix (also known as a microlens array) is additionally incorporated between the lens assembly and the image sensor on the basis of the conventional camera

Methodology Applied
Scientific EffectRefraction: Refraction

Implementation Method 2

the light passing through the lens assembly is collected by the image sensor

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS11838655B2Image acquiring method and apparatus, electronic device, and storage medium
Publication Date: 2023.12.05 BEIJING XIAOMI MOBILE SOFTWARE CO LTD
  • US11838655B2 patent drawing
  • US11838655B2 patent drawing
  • US11838655B2 patent drawing

AI summary

An image acquiring method includes: providing a camera module of an electronic device including a lens assembly, a microlens matrix and an image sensor, the microlens matrix is movable between a first position and a second position, the microlens matrix is between the image sensor and the lens assembly in the first position to enable the camera module as a light field camera, and the microlens matrix is away from the image sensor and the lens assembly in the second position to enable the camera module as a conventional camera; in response to detecting that the microlens matrix is in the first position, acquiring a three-dimensional image of an object by the light field camera of the electronic device; and in response to detecting that the microlens matrix is in the second position, acquiring a two-dimensional image of the object by the conventional camera.