A shipborne laser long-range night vision system

By integrating color CCD TV camera system and refrigeration infrared thermal imaging system on the coast guard ship, combined with laser strobe imaging technology, long-distance high-definition imaging and distance tracking problems in night and in bad weather, achieving all-weather and coverage The wide ocean surveillance capabilities have enhanced the surveillance and protection capabilities of the coast guard forces.

CN114173034BActive Publication Date: 2024-11-08HANHAI (BEIJING) TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202111405504.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-11-24
Publication Date
2024-11-08
Estimated Expiration
2041-11-24

AI Technical Summary

Technical Problem

Existing Coast Guard ship-based photoelectric tracking equipment is difficult to achieve long-distance high-definition imaging and distance tracking under night or inclement weather conditions, and cannot effectively solve the problems of long-distance imaging surveillance and evidence collection at night.

Method used

A ship-borne laser remote night vision system was designed, combining color CCD TV camera system and refrigeration infrared thermal imaging system, using laser strobe imaging to identify and confirm targets, equipped with digital high-definition color TV camera sensors, refrigeration infrared thermal imaging sensors, Laser and gyro servo stability system realize monitoring capabilities with all-weather, wide coverage and large range of sight.

Benefits of technology

It has improved the monitoring capabilities of the coast guard forces in night and in severe weather conditions, enhanced the monitoring and protection capabilities of the marine environment and sea and air targets, and provided a more effective basis for maintaining marine rights and interests and law enforcement supervision.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114173034B_ABST
    Figure CN114173034B_ABST
Patent Text Reader

Abstract

The invention discloses a shipborne laser long-range night vision system, which is installed on the top deck of the ship. The shipborne laser long-range night vision system detects and tracks the target through a color CCD television camera system during the day and an infrared thermal imaging system at night, and uses laser gated imaging to identify and confirm the target. The marine environment, marine resources, sea and air targets, etc. are monitored, tracked and recorded to achieve the purpose of maintaining marine rights and interests and protecting the marine environment and resources, and can be used as a basis for marine law enforcement supervision, investigation and evidence collection. The system flexibly selects optical lenses, CCD cameras, refrigerated infrared thermal imagers and lasers of various specifications according to user requirements. The invention improves the ability of the maritime police force to monitor the marine environment, marine resources, sea and air targets at night, in foggy days and rainy days, and more effectively achieves the purpose of maintaining marine rights and interests and protecting the marine environment and resources. It has the advantages of all-weather, wide coverage, large visual range, and stable and clear images.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a shipborne laser long-range night vision system, and relates to computer automatic control technology, image information processing technology, image stabilization technology, automatic tracking technology, GIS technology and other related fields. Background Art

[0002] The Coast Guard is an important force in my country's marine rights protection and law enforcement, and is responsible for maintaining the marine environment, marine resources and marine rights. In recent years, the quantity and quality of my country's Coast Guard equipment have greatly improved, and the ability of maritime reconnaissance and detection has also been greatly improved. Photoelectric detection equipment is an important component of shipborne information equipment and has been widely used in the field of maritime reconnaissance of civilian and military ships.

[0003] At present, the optoelectronic tracking equipment on the coast guard mainly adopts imaging detection technologies such as visible light, low light, and infrared imaging, and non-imaging detection technologies such as laser ranging. Among them, imaging detection has the advantages of long range, large detection field of view, and high target recognition probability. When used in combination with a laser rangefinder, it can obtain both the target image and the target distance information, thereby improving the tracking and positioning accuracy of the target. Therefore, the system combining imaging and ranging has become the mainstream of development. Among them, visible light imaging is mainly used for daytime target monitoring. It has the advantages of clear imaging, high resolution, and long distance, but it is easily affected by sea fog, rain, snow and other weather conditions, and cannot be imaged at night; infrared equipment can be imaged during the day and at night, and has a long range, but there are problems such as large image distortion, low resolution, poor evidence collection effect, and dependence on the temperature contrast characteristics of the target and background; low light imaging is mainly used for nighttime monitoring. Although it can be imaged at low illumination levels, it still requires a certain skylight background illumination to image, and there are problems such as long exposure time, serious image tailing, short range, and lack of imaging capabilities under rain, snow, and foggy weather conditions. The three main existing optoelectronic imaging methods can basically solve the daytime imaging problem through the composite application of infrared and visible light, but they cannot solve the problem of long-distance imaging surveillance and imaging evidence collection at night. There is an urgent need for a shipborne optoelectronic surveillance equipment that can solve the integration of long-range high-definition imaging and ranging and tracking at night or in severe weather conditions. Summary of the invention

[0004] In order to solve the above technical problems, the present invention provides a shipborne laser long-range night vision system. The shipborne laser long-range night vision system is installed on the top deck of the ship. It detects and tracks targets through a color CCD television camera system during the day and an infrared thermal imaging system at night, and uses laser gating imaging to identify and confirm targets. It can monitor, track and record the marine environment, marine resources, and sea and air targets, so as to maintain marine rights and interests and protect the marine environment and resources, and can serve as a basis for marine law enforcement supervision, investigation and evidence collection. The system can flexibly select optical lenses, CCD cameras, cooled infrared thermal imagers and lasers of various specifications according to user requirements.

[0005] The system mainly consists of two parts: imaging equipment installed outside the cabin and display and control equipment installed inside the cabin, which are connected by marine cables. The imaging equipment outside the cabin consists of digital high-definition color TV camera sensors, cooling infrared thermal imaging sensors, lasers, enhanced ICCDs, turntables, gyro servo stabilization systems, etc. The display and control equipment inside the cabin includes the main control chassis, power supply and drive chassis, hard disk recorder, control keyboard, trackball, LCD display, etc. According to user needs, the equipment inside the cabin can be provided in the form of scattered parts, uniformly arranged by the ship design unit, embedded in the console, or provided as a whole display and control console.

[0006] Compared with the prior art, the present invention has the following advantages:

[0007] The invention improves the ability of the Coast Guard to monitor the marine environment, marine resources and sea and air targets at night, in foggy days and rainy days, and more effectively achieves the purpose of maintaining marine rights and interests and protecting the marine environment and resources. In addition, combined with a color CCD camera and a cooled infrared thermal imager, it has the advantages of all-weather, wide coverage, large viewing range, and stable and clear images. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Figure 1 It is a system composition diagram of the present invention;

[0009] Figure 2 It is a diagram of the equipment of the present invention;

[0010] Figure 3 This is the main interface diagram of the display and control terminal software of the present invention; DETAILED DESCRIPTION

[0011] The present invention is further described below in conjunction with the accompanying drawings and embodiments. The system comprises two major parts: an imaging device outside the cabin and a display and control device inside the cabin, and the two parts are connected by a marine cable.

[0012] Extravehicular imaging equipment

[0013] The extravehicular imaging equipment consists of a digital high-definition color television camera sensor, a cooled infrared thermal imaging sensor, a laser, an enhanced ICCD, a turntable, a gyro servo stabilization system and other components.

[0014] S1: The TV camera sensor consists of a variable telephoto lens and a digital high-definition color CCD camera.

[0015] S2: The cooled infrared thermal imaging sensor consists of an infrared zoom lens, a cooled infrared thermal imager and a target tracking module.

[0016] S3: The laser gating system consists of a high-power pulsed semiconductor laser and an enhanced CCD.

[0017] S4: The turntable consists of an azimuth seat, a pitch package and a supporting structure.

[0018] S5: The gyro servo stabilization system consists of a DC torque motor, a DC speed measuring motor, a gyro, a rotary transformer, etc.

[0019] The imaging system consists of a passive detection system, a laser emission system, an APD-based laser unit detection system, a distance-gated laser imaging system, a signal processing and control system, and a tracking servo system.

[0020] Among them, the passive imaging system realizes large-scale target search and rough target tracking; the APD laser unit detection system is used for the detection of long-distance laser echoes; the gated laser imaging system is used for high-synchronous precision distance gated laser imaging to ensure that the image information of the target is obtained while obtaining the distance information of the space target; the laser emission system consists of a small pulse laser, OAGC control and emission optical system, which can provide the laser unit detection system with a small divergence angle and a narrow laser beam for long-distance unit detection, and provide the laser imaging system with a large field of view, a synchronous, uniform wide laser beam that meets the requirements of the laser imaging system. Each system is installed on a two-dimensional tracking servo platform and works uniformly under the control of a high-speed signal processing and control system.

[0021] Since visible or infrared passive detection has a long range, it can be used to capture and roughly track the target. After the rough tracking is completed, the laser detection part mounted on the turntable can be guided. At this time, the target is within the laser illumination range, and the laser unit detection is used to achieve distance measurement. The laser imaging system is used to obtain a high-resolution image of the target to achieve precise tracking.

[0022] The laser imaging detection system is controlled by the information processing and control module. The tracking turntable is equipped with a visible light camera and a laser imaging subsystem to jointly achieve the capture, tracking and three-dimensional imaging of the target. The laser rangefinder is an optional part.

[0023] S1: Infrared guidance camera: The function of the infrared guidance camera is to use an infrared camera with a large field of view to capture and track the target. Its working principle is: it starts to expose in synchronization with the turntable control box, and outputs the image to the turntable control box at the same time after the exposure. The video processing unit calculates the miss distance in real time, and the main control unit controls the turntable to track the space target.

[0024] Its main technical indicators are:

[0025] Field of view: 10°×10°;

[0026] Spectral range: 3-5μm, or 8-12μm;

[0027] Number of pixels: 320×240 or 640×480;

[0028] Pixel size: 32μm;

[0029] Frame rate: 25Hz;

[0030] Image grayscale: 10bit;

[0031] Its main functions are: according to the ground forecast information and instructions of the space target, it can find the target to be imaged in the designated airspace, obtain the image of the target to be imaged, and cooperate with the target tracking processor and the two-dimensional tracking turntable to complete the stable tracking of the target. The guidance process of the guidance camera exchanges data with other systems.

[0032] S2: 2D tracking turntable: Due to the large number of loads, the overall structure will adopt a U-shaped configuration. Based on a comprehensive comparison of the actual design results of each optical load, a configuration with small mass, good rigidity and better dynamic performance will be selected.

[0033] The entire structure is mainly divided into a pitch part and an azimuth part, each of which realizes a rotation of one degree of freedom, so as to ensure that the camera carried can scan a large range. The pitch and azimuth parts each include a motion axis system, an angle sensor, a drive motor and a limit mechanism.

[0034] The structure of the two-dimensional tracking turntable is mainly divided into two parts: the turntable body and the electrical control box. The turntable body carries three optical loads and realizes two-dimensional rotation, which is divided into a pitch part and an azimuth part; the electrical control box is used to place the drive circuit, control circuit, encoder acquisition circuit and secondary power supply, etc.

[0035] During the development process, it is necessary to conduct structural modal analysis, system force analysis, dynamic response analysis and dynamic modeling based on the preliminary design results, and then optimize the design based on the analysis and simulation results to finally determine the structural state.

[0036] S3: Laser imaging: The laser imaging module includes a pulsed semiconductor laser lighting device, a high-speed and high-gain imaging device, a high-precision timing control, and a laser image processing module.

[0037] The external synchronization of the pulse laser and the imaging device is a TTL level signal, which is generated by the information processing and control module. The premise of its setting is to guide the camera to detect the target and lock the target, and the turntable to stably track the target. When the system is guided to the active imaging detection field of view, the target distance information and target depth obtained by laser echo signal processing are combined with the target characteristics analyzed by passive imaging to set the active imaging detection system parameters, start active imaging detection, and the system enters the fine tracking state. By analyzing the active imaging detection image, the target characteristic parameters are obtained, and the parameters are fed back to the control system to fine-tune the system-related parameters, so as to achieve efficient and accurate tracking of the target by the system, and complete the system's coarse tracking and fine tracking dual closed-loop control.

[0038] S4: Information processing and control module: The information processing and control module structure design scheme is adopted. DSP or computer is used for system control and information processing, and FPGA is used for timing control. The interface between the two is a serial port or a network port. According to the use conditions, the system sets the initial parameters of the system through the host computer, and the parameters are transmitted to the FPGA through R232 or the network port, so that the system can start and work normally; during the working process, the system parameters can still be modified in real time or the system can be reset in this way.

[0039] S5: Positioning of imaging targets on GIS: The main purpose of GIS positioning of imaging targets is to achieve the integration of shipborne night vision system information and ECDIS system information; to achieve the geographical location positioning of imaging targets on the ECDIS system. Among them, the shipborne night vision system information includes the gating distance of the imaging target and the turntable tracking target orientation; the ECDIS system information is mainly ship information, including ship position, ship direction and ship attitude. Among them, θ1 is the ship direction (relative to the true north), θ2 is the turntable angle (the default turntable 0 degrees is the bow direction), θ3 is the target direction (relative to the true north), and d is the distance of the target from the ship. According to θ3 and d, the target position can be located on the nautical chart. In order to realize the GIS positioning of imaging targets, this module will create a target positioning processing class TargetPosCtrl, and through a 100ms timer, trigger the slot function slotUpdateTargetInfo() to obtain ship information and target distance and direction information, and obtain the specific latitude and longitude coordinates of the target, and refresh the target to the nautical chart by calling the drawing function.

[0040] In-cabin display and control equipment

[0041] The display and control equipment in the cabin consists of a main control chassis, power supply and drive chassis, hard disk recorder, control keyboard, trackball, LCD display, etc.

[0042] The display and control terminal software is the user operation interactive platform of the entire system and the operation interface of the entire software. It has friendly interactive operation and comprehensive information display functions. The platform uses the QT development toolkit to complete the design and implementation of the interface. The main window of the software interface, the entire software interface will be functionally divided into the chart information system interface part and the shipborne monitoring system interface part. Among them, the shipborne monitoring system interface will be a sub-window of the chart information system interface, embedded in the chart information system platform, to complete the interface control operation of the shipborne night vision system. The chart information system interface will complete the loading, display, and related chart operations of the chart, and at the same time complete the call of the shipborne monitoring system interface, and complete the fusion display of the imaging target positioning information on the chart.

Claims

1. A shipborne laser long-range night vision system, characterized in that: The shipborne laser long-range night vision system is installed on the top deck of the ship. It detects and tracks targets through the color CCD television camera system during the day and the infrared thermal imaging system at night, and uses laser gated imaging to identify and confirm targets. It monitors, tracks and records the marine environment, marine resources and sea and air targets, and serves as a basis for marine law enforcement supervision, investigation and evidence collection. The system can be equipped with optical lenses, CCD cameras, cooled infrared thermal imagers and lasers of various specifications according to user requirements. The system consists of two parts: imaging equipment installed outside the cabin and display and control equipment installed inside the cabin, which are connected by marine cables; the imaging equipment outside the cabin consists of digital high-definition color TV camera sensors, cooling infrared thermal imaging sensors, lasers, enhanced ICCD, turntables, and gyro servo stabilization systems; the display and control equipment inside the cabin includes the main control chassis, power supply and drive chassis, hard disk recorder, control keyboard, trackball, and LCD display; according to user needs, the cabin equipment is provided in parts, uniformly arranged by the ship design unit, and embedded in the console; The shipborne laser long-range night vision system is controlled by the information processing and control module. The tracking turntable is equipped with a visible light camera and a laser imaging subsystem to jointly achieve the capture, tracking and three-dimensional imaging of the target; the laser rangefinder is an optional part; The shipborne laser long-range night vision system includes: an infrared guidance camera, a two-dimensional tracking turntable, a laser imaging module, an information processing and control module, and an imaging target GIS positioning module; The infrared guidance camera uses an infrared camera with a large field of view to achieve the capture and tracking of the target. Its working principle is: the exposure starts in synchronization with the turntable control box, and after the exposure is completed, the image is output to the turntable control box at the same time, the video processing unit calculates the miss distance in real time, and the main control unit controls the turntable to track the space target; According to the ground forecast information and instructions of the space target, the target to be imaged is found in the designated airspace, the image of the target to be imaged is acquired, and the stable tracking of the target is completed in cooperation with the target tracking processor and the two-dimensional tracking turntable; the guiding process of the guiding camera exchanges data with other systems; The two-dimensional tracking turntable adopts a U-shaped configuration; the entire structure is divided into a pitch part and an azimuth part, each of which realizes a rotation of one degree of freedom, thereby ensuring that the camera carried by it performs a large-scale scanning; the pitch and azimuth parts each include a motion axis system, an angle measuring sensor, a drive motor and a limit mechanism; The structure of the two-dimensional tracking turntable is mainly divided into two parts: the turntable body and the electric control box. The turntable body carries three optical loads and realizes two-dimensional rotation, which is divided into the pitch part and the azimuth part; the electric control box is used to place the drive circuit, control circuit, encoder acquisition circuit and secondary power supply; Conduct structural modal analysis, system stress analysis, dynamic response analysis, and dynamic modeling based on the preliminary design results, and then optimize the design based on the analysis and simulation results to ultimately determine the structural state; The laser imaging module includes a pulse semiconductor laser lighting device, a high-speed and high-gain imaging device, a high-precision timing control, and a laser image processing module; The external synchronization of the pulse laser and the imaging device is a TTL level signal, which is generated by the information processing and control module; the premise of its setting is to guide the camera to detect the target and lock the target, and the turntable to stably track the target; when the system is guided to the active imaging detection field of view, the target distance information and target depth obtained by laser echo signal processing are combined with the target characteristics of passive imaging analysis to set the active imaging detection system parameters, start active imaging detection, and at the same time, the system enters the fine tracking state, and obtains the target characteristic parameters by analyzing the active imaging detection image, and feeds the parameters back to the control system to fine-tune the relevant system parameters, so as to achieve efficient and accurate tracking of the target by the system, and complete the system's coarse tracking and fine tracking dual closed-loop control; The information processing and control module adopts the information processing and control module structure design scheme, adopts DSP or computer for system control and information processing, adopts FPGA to realize timing control, and the interface between the two is a serial port or a network port; the system sets the initial parameters of the system operation through the host computer according to the use conditions, and the parameters are transmitted to the FPGA through R232 or the network port, so that the system starts and works normally; the system parameters can still be modified in real time or the system can be reset in this way during the operation; The imaging target GIS positioning module is used to realize the integration of shipborne night vision system information and ECDIS system information; realize the geographical location positioning of the imaging target on the ECDIS system; the shipborne night vision system information includes the gating distance of the imaging target and the turntable tracking target orientation; the ECDIS system information is the ship information, including the ship position, ship direction and ship attitude; among them, θ1 is the ship direction, θ2 is the turntable angle, θ3 is the target direction, and d is the distance between the target and the ship; according to θ3 and d, the target position can be located on the nautical chart.

2. A shipborne laser long-range night vision system according to claim 1, characterized in that: The extravehicular imaging equipment consists of a digital high-definition color television camera sensor, a cooled infrared thermal imaging sensor, a laser, an enhanced ICCD, a turntable, and a gyro servo stabilization system. The specific implementation process is as follows: S1: The TV camera sensor consists of a variable telephoto lens and a digital high-definition color CCD camera; S2: The cooled infrared thermal imaging sensor consists of an infrared zoom lens, a cooled infrared thermal imager, and a target tracking module; S3: The laser gating system consists of a high-power pulsed semiconductor laser and an enhanced CCD; S4: The turntable consists of an azimuth seat, a pitch package and a supporting structure; S5: The gyro servo stabilization system consists of a DC torque motor, a DC speed measuring motor, a gyro, and a rotary transformer.

3. A shipborne laser long-range night vision system according to claim 1, characterized in that: The imaging system consists of a passive detection system, a laser emission system, an APD-based laser unit detection system, a range-gated laser imaging system, a signal processing and control system, and a tracking servo system; The passive imaging system realizes large-scale target search and rough target tracking; the APD laser unit detection system is used for the detection of long-distance laser echoes; the laser imaging system is used for high-synchronous precision distance-gated laser imaging to ensure that the image information of the target is obtained while obtaining the distance information of the space target; the laser emission system consists of a small pulse laser, OAGC control and emission optical system, which provides the laser unit detection system with a narrow laser beam with a small divergence angle for long-distance unit detection, and provides the laser imaging system with a large field of view, which is used to meet the requirements of the laser imaging system. The systems are installed on a two-dimensional tracking servo platform and work uniformly under the control of a high-speed signal processing and control system; Laser unit detection is used to achieve distance measurement, and laser imaging system is used to obtain high-resolution images of the target to achieve precise tracking.

4. A shipborne laser long-range night vision system according to claim 1, characterized in that: The display and control equipment in the cabin consists of the main control chassis, power supply and drive chassis, hard disk recorder, control keyboard, trackball, and LCD display; The display and control terminal software is the user operation interactive platform of the entire system and the operation interface of the entire software. It has friendly interactive operation and comprehensive information display functions. Use QT development toolkit to complete the design and implementation of the interface; The main window of the software interface, the entire software interface will be functionally divided into the chart information system interface part and the shipborne monitoring system interface part. The shipborne monitoring system interface will be embedded in the chart information system platform as a sub-window of the chart information system interface to complete the interface control operation of the shipborne night vision system; the chart information system interface will complete the loading, display and related chart operations of the chart, and at the same time complete the call of the shipborne monitoring system interface, and complete the fusion display of the imaging target positioning information on the chart.