Multimode information system based on sensing information and target tracking and fusion method thereof

Abstract

The invention discloses a multimode information system based on sensing information and target tracking. The multimode information system is characterized by comprising a visual information collecting module, a non-visual information collecting module, and an information matching module. The visual information collecting module is established on a distributed multi-camera network and comprises a camera system node and an inspection point camera group. The non-visual information collecting module comprises a sensor information collecting part. The information matching module comprises a cross-camera perform re-identification result module and a multimode data matching module. The multimode information system is wide in application range, and capable of reducing background image identification processing pressure and providing long-acting historical data, and can be widely used in the fields of person tracking, behavior excavation, and public security.

Description

technical field [0001] The invention relates to a target tracking system, in particular to a multi-mode information system based on sensing information and target tracking and a fusion method thereof. Background technique [0002] Multi-camera tracking technology based on video images is a challenging and attractive basic research direction in the field of computer vision; The multi-target tracking system of the camera can better solve these problems by using different fields of view; its key technology is human target re-identification (PRID). [0003] Human target re-identification, in a non-overlapping multi-camera system, spans multiple different camera nodes, and re-identifies human targets through their features and time-space constraints. Due to the influence of shooting angle, lighting information and other factors, it will cause misjudgment of re-identification; the process of re-identification generally includes: [0004] 1) Unchanging appearance characteristics;...

AI Technical Summary

Problems solved by technology

[0011] (1). The independence of physical positions between non-overlapping cameras, the angle problem brought about by it is a problem that cannot be ignored in the re-tracking of human targets;

[0012] (2). The similarity of multiple different features is generally used instead of the distance between multiple features between target objects, and its robustness cannot be guaranteed;

[0013] (3). The main aim is still based on the discrimination of the tracked object, but it does not carry out effective information fusion on the acquired target tracking information, and its camera node is only a unit for simply acquiring video information, and the centralized image processing

Images