PTZ Camera LIDAR 3D Mapping for Automatic Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current security camera systems, such as PTZ cameras, lack the ability to automatically detect and focus on new points of interest within their 360° view range, making them vulnerable to being distracted from actual security threats, and existing solutions like passive infrared detectors and LIDAR systems have limitations in accuracy and reliability.

Innovation Solution

A camera system that integrates a PTZ camera with a LIDAR detector and computer technology to create a 3D map of the area of interest, allowing for precise automatic pointing and tracking of moving objects, using UDP packets for communication and a dimensional coordinate grid to define rotation and zoom adjustments, ensuring accurate detection and response to potential threats.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If a PTZ camera with auto tracking is used to monitor moving pixels in the camera view, then the camera can automatically track moving objects within its view range, but the camera cannot detect objects outside its current view range and can be distracted from actual security threats

Engineering Contradiction:
Improveautomatic tracking capabilityVSAvoidmonitored view range
Core Design Contradiction:
Extent of automationVSArea of stationary object

Solution Approach 1:

The system divides the monitoring function into two independent parts: a LIDAR detector that scans the entire 360° area to detect moving objects, and a PTZ camera that captures detailed images. The LIDAR handles wide-area detection while the camera handles detailed observation, resolving the contradiction between automatic tracking and view range coverage.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The LIDAR detector acts as an intermediary between the wide monitoring area and the PTZ camera. It detects moving objects in the entire 360° range and provides directional information to the camera control system, enabling the camera to automatically point toward detected objects without being limited by its own view range.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Area of stationary object

If passive infrared detectors are used to detect movement and direct the camera, then the system can detect movement from any direction, but the system cannot recognize distance to objects and reacts to temperature changes causing false alarms

Engineering Contradiction:
Improvedetection coverageVSAvoiddistance measurement accuracy
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The system replaces passive infrared detectors with a LIDAR detector that uses active laser ranging. Instead of passively detecting thermal radiation, the LIDAR actively emits laser pulses and measures the time of flight of reflected light, providing precise distance measurements while maintaining 360° detection coverage and eliminating false alarms from temperature changes.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If a LIDAR system is used to detect movement and create 3D data, then the system can accurately detect objects and their positions, but the system complexity increases due to coordinate system transformation requirements

Engineering Contradiction:
Improveposition detection accuracyVSAvoidcoordinate system integration
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system merges the LIDAR detection system and PTZ camera system into a unified coordinate framework. By establishing a common coordinate system origin at the LIDAR detector and using the detector's rotational angles as reference, the system eliminates complex coordinate transformations and enables direct integration of detection data with camera control.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system provides precise and reliable automatic movement detection and tracking of objects within the 3D mapped area, reducing false alarms and ensuring comprehensive security monitoring without the need for manual calibration or alignment with the detector's axis, even at long distances and in adverse weather conditions.

Implementation Method 1

a LIDAR detector, which is separate from the PTZ camera, monitors an area of interest

Methodology Applied
Scientific EffectLIDAR: LIDAR

Implementation Method 2

The camera system responds only to increased number of moving points. Those points represent moving objects and its precise parameters

Methodology Applied
Scientific EffectLaser: Laser

Data Source

PatentEP3452848B1Monitoring method using a camera system with an area movement detection
Publication Date: 2024.02.14 MAXPROGRES SRO
  • EP3452848B1 patent drawingFigure 1

AI summary

Monitoring method using a camera system with an area movement detection, comprising at least one PTZ camera with a native protocol and with a driver unit for pointing the camera to a point of interest in an area of interest, at least one detector for monitoring of the area of interest, a computer technology provided with a control software intended to create a dimensional coordinate grid of the area of interest on the bases of information gained from the detector about position of single points in the area of interest, where the computer technology is adapted to communicate with the PTZ camera and the detector, and which is further adapted to collect and evaluate the data and the information gained from the PTZ camera and the detector and to automatically set rotation of the PTZ camera with regards to the dimensional coordinates of the area of interest, a switch intended to connect the PTZ camera, the detector and the computer technology provided with the control software, where the detector is a LIDAR detector, whereas the data which transmitted from the detector to the computer technology are in a form of UDP packets, which are comprising information about distance between scanned points and the detector, about a position of scanned points, about calibrated reflection of scanned points, about rotational angle of laser rays sent from the detector and reflected from the scanned points, about synchronised time marks of the laser rays of the detector and about GPS position of the scanned points, where the area of interest is scanned by the detector, the scanned data of the area of interest are send to the computer technology provided with the control software, where the data are processed into the form of a digital model of the area of interest, a minimum size of the object detectable by the detector, which starts further scanning, is defined, a maximum speed of a motion of the object detected by the detector, which starts further scanning, is defined, the detector and the PTZ camera are positioned into the position, where monitoring of the area of interest is ensured, calibration of view of the PTZ camera with regards to the scanned digital model of the area of interest is provided by the computer technology, whereas the camera system is set in the such way, that if a movement in the area of interest is detected the PTZ camera is automatically pointed to the area, where the movement was detected, scanning of another predetermined pre-alert zones with low priority is activated, where the moving object is tracked, whereas automatic turn of the PTZ camera into the point of movement in the area of interest is performed, and if in the area of interest a movement is recognized by the PTZ camera alarm is announced.