Monocular Camera 3D Occupant Tracking for Climate Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing climate control systems, such as air conditioner units, lack the ability to accurately determine the 3D locations of objects in an environment, relying on either expensive 3D sensors or providing only rough 2D location information with 2D sensors.

Innovation Solution

A method and system utilizing a 2D monocular camera with a wide-angle lens and near-infrared capabilities to track and determine the 3D locations of objects by constructing background and foreground models, allowing for accurate 3D object tracking and control of climate control units.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a 3D sensor is used to determine 3D locations, then location determination is simpler, but the cost is higher

Engineering Contradiction:
Improvelocation determination complexityVSAvoidcost
Core Design Contradiction:
Device complexityVSEase of manufacture

Solution Approach 1:

The patent creates a 3D representation (depth map) from a 2D camera image by copying and processing visual information. Instead of using a dedicated 3D sensor, the system synthesizes depth information through image processing algorithms that replicate the function of 3D sensors using only a standard 2D camera

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical/optical 3D sensing system with a computational image processing system. Rather than using physical 3D sensors (TOF, stereo cameras), the system substitutes a 2D camera combined with algorithms that infer depth from 2D image data, eliminating the need for complex 3D sensing hardware

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of manufacture

If a 2D sensor is used to detect object locations, then the cost is lower, but only rough 2D location information is provided

Engineering Contradiction:
ImprovecostVSAvoidlocation precision
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent transforms 2D image data into 3D location information by adding a depth dimension through computational processing. The system takes 2D coordinates from the camera image and derives corresponding 3D spatial positions, effectively adding the missing dimension through mathematical relationships rather than physical sensors

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent changes the interpretation parameters of the 2D camera data by applying depth estimation algorithms. Instead of treating the camera output as purely 2D image coordinates, the system transforms these coordinates into 3D spatial parameters using assumptions about object sizes, distances, and geometric relationships

Inventive Principle:
Principle #35Parameter changes

3Ease of manufacture

If a 2D monocular camera is used, then the cost is lower and resolution is better, but determining 3D locations is more challenging

Engineering Contradiction:
ImprovecostVSAvoid3D location determination difficulty
Core Design Contradiction:
Ease of manufactureVSDifficulty of detecting and measuring

Solution Approach 1:

The patent performs preliminary processing of the 2D image data by creating background models and identifying object regions before attempting depth estimation. This preliminary segmentation and characterization of objects in the 2D image simplifies the subsequent 3D location determination by providing constraints and prior information about object positions and sizes

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS8929592B2Camera-based 3D climate control
Publication Date: 2015.01.06 MITSUBISHI ELECTRIC RESEARCH LABORATORIES INC
  • US8929592B2 patent drawing
  • US8929592B2 patent drawing
  • US8929592B2 patent drawing

AI summary

A climate control unit is controlled by constructing background and foreground models of an environment from images acquired of the environment by a camera. The background model represents the environment when unoccupied, and there is one foreground model for each person in the environment. A 2D location of each person in the environment is determined using the background and foreground models. A 3D location of each person is determined using the 2D locations and inferences made from the images. The controlling of the climate control unit is according to the 3D locations.