Camera-Based Positioning for Environmental Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems lack the ability to effectively control environmental functions based on the position or movement of a mobile device with a camera, such as adjusting lighting or air conditioning, using image information from a camera to determine the device's position within an environment coordinate system.

Innovation Solution

A method and system that utilize image information from a camera on a mobile device to determine its position or movement within an environment coordinate system, allowing for the control of environmental functions like sound systems, lighting, and air conditioning by capturing images of visual content displayed on a mounted display device and reconstructing a model of the environment to provide precise positioning or movement data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If image information from a camera is used to determine position in an environment coordinate system, then position-based control of environmental functions is enabled, but the system complexity increases due to the need for coordinate system transformation and image processing

Engineering Contradiction:
Improveposition-based control capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary coordinate transformation system that bridges the camera coordinate system and the environment coordinate system. This intermediary layer handles the complex transformation calculations, allowing the main control system to simply use position information without dealing with the mathematical complexity of coordinate transformations directly.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs self-calibration of camera positions relative to the ground plane and automatically establishes the coordinate system transformation relationships. This self-service approach eliminates the need for manual calibration and reduces the operational complexity for users while maintaining high adaptability.

Inventive Principle:
Principle #25Self-service

2Measurement precision

If multiple cameras are used to capture images for position determination, then measurement precision improves, but device complexity increases

Engineering Contradiction:
Improveposition determination precisionVSAvoidcamera system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines data from multiple cameras into a unified coordinate system through coordinate transformation. By merging the image information and position data from multiple cameras into a single environment coordinate system, the system achieves high measurement precision without requiring each camera to independently process complex positioning tasks.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The coordinate transformation system serves multiple functions: it processes images from multiple cameras, determines positions in the environment coordinate system, and provides this information for controlling various environmental functions. This multi-functionality reduces the need for separate systems for each task.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Speed

If real-time position information is provided for controlling environmental functions, then responsiveness improves, but processing time and system complexity increase

Engineering Contradiction:
Improvecontrol responsivenessVSAvoidprocessing time
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The system performs preliminary calibration of camera positions and establishes coordinate transformation relationships in advance. This preliminary action ensures that when images are captured, the position determination can proceed quickly using pre-established transformation parameters, reducing real-time processing time while maintaining high responsiveness.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10268216B2Method and system for providing position or movement information for controlling at least one function of an environment
Publication Date: 2019.04.23 APPLE INC
  • US10268216B2 patent drawing
  • US10268216B2 patent drawing
  • US10268216B2 patent drawing

AI summary

A method for providing position information for controlling at least one function of an environment provided with an environment coordinate system comprises the steps of receiving image information associated with at least one image of at least one part of the environment captured by a camera of a mobile device, the mobile device being separate from the environment, determining a position associated with the mobile device in the environment coordinate system according to the image information associated with the at least one image, and providing position information indicative of the position associated with the mobile device in the environment coordinate system to control at least one function of the environment according to the position. There is also provided a method and system which provides movement information indicative of a movement associated with the mobile device relative to the environment coordinate system to control at least one function of the environment according to the movement.