Projector Distortion Correction via Omnidirectional Camera

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for projecting video images onto non-flat surfaces, such as room walls, face challenges due to geometric distortion and require dedicated screens and sensors, making it difficult to install and costly, especially in residential settings.

Innovation Solution

A projector apparatus equipped with an omnidirectional camera, processing unit, and control system that captures the shape of the projection surface and viewer's position and attitude, allowing for distortion correction and projection of a video image as if onto a flat surface, eliminating the need for physical screens and sensors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a projector projects a video image onto a non-flat surface, then the projection can be performed without a dedicated screen, but the video image becomes geometrically distorted

Engineering Contradiction:
Improveprojection surface adaptabilityVSAvoidimage geometric distortion
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The system performs preliminary actions by capturing the projection surface shape and viewer position in advance, then pre-calculating the distortion correction parameters before projection, allowing the projector to compensate for the non-flat surface geometry

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces the mechanical physical connection system (arm with angle sensors) with an optical-digital system using an omnidirectional camera to capture surface geometry and viewer position, followed by computational processing to determine distortion correction parameters

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If a dedicated screen and physical connection apparatus are used to eliminate distortion, then the video image can be displayed without geometric distortion, but the installation becomes complex and costly

Engineering Contradiction:
Improveimage geometric distortionVSAvoidinstallation complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent merges multiple functions into the projector unit itself: the omnidirectional camera is integrated with the projector, and the control unit combines surface shape detection, viewer position tracking, and distortion correction calculation into a single integrated system, eliminating the need for separate dedicated screens and physical connection apparatus

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The projector system performs self-service by automatically capturing its own projection surface geometry and viewer position, then autonomously calculating and applying the appropriate distortion correction without requiring external measurement equipment or manual calibration

Inventive Principle:
Principle #25Self-service

3Measurement precision

If magnetic sensors or cameras are attached to viewers or screens to acquire viewpoint position, then the viewer position can be detected, but the system becomes complex and requires additional hardware

Engineering Contradiction:
Improveviewer position detectionVSAvoidhardware requirements
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The omnidirectional camera serves multiple functions: it captures the projection surface shape, detects the viewer's position and attitude, and provides the data for distortion correction calculation, eliminating the need for separate magnetic sensors or additional cameras on viewers or screens

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The control unit acts as an intermediary that processes the raw image data from the omnidirectional camera, extracts surface shape and viewer position information, calculates distortion parameters, and generates the corrected video image for projection

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11601627B2Apparatus, control method, and storage medium
Publication Date: 2023.03.07 CANON KK
  • US11601627B2 patent drawing
  • US11601627B2 patent drawing
  • US11601627B2 patent drawing

AI summary

An apparatus includes a projection unit configured to project a video image, a capturing unit configured to capture an image, an identification unit configured to identify a shape of a surface onto which the video image is to be projected, based on the captured image, an inference unit configured to infer a viewpoint position and an attitude of a viewer of the video image based on the captured image, a correction unit configured to correct the video image based on the shape of the surface and the viewpoint position and the attitude of the viewer, and a control unit configured to control the projection unit to project the corrected video image.