Automatic recording method for illegal sea going of fishing boat in fishing rest period

Abstract

The invention relates to the field of fishery ship management, and discloses an automatic recording method for illegal going-to-sea in a fishing-off period of a fishing boat, and the method comprises the steps: firstly installing and adjusting a monitoring camera and a tracking camera on an iron tower near a fishing boat going-to-sea port, and installing an AIS (Automatic Identification System) base station on the same iron tower; then image relation coefficients a1, b1, c1, a2, b2 and c2 between the monitoring camera and the tracking camera are obtained, then video data and AIS data are processed to obtain the MMSI number of the ship going out of the sea, and finally pictures of the illegal fishing ship going out of the sea are recorded. The system and the method have the advantages that the illegal going-to-sea of the fishing boat during the fishing rest period can be automatically recorded, the MMSI number of the going-to-sea fishing boat and the amplified picture of the fishing boat are acquired, and the illegal going-to-sea supervision efficiency of the fishing boat is greatly improved.

Description

Technical Field

[0001] The invention relates to the field of fishery vessel management, and in particular to a method for automatically recording illegal sea voyages of fishing vessels during a fishing moratorium period. Background Art

[0002] As fishery resource management and protection are increasingly valued, the effective implementation of the fishing moratorium system is particularly important as it is a key measure to maintain the ecological balance of the ocean and ensure the sustainable use of fishery resources. At present, the supervision of illegal fishing boats going out to sea during the fishing moratorium mainly relies on manual work. The staff observes the boats going out to sea through the surveillance video. When a fishing boat goes out to sea illegally during the fishing moratorium, the staff will record the boat.

[0003] However, the manual supervision method requires staff to observe video surveillance 24 hours a day, and more staff are required when the number of outlets to be supervised increases. From the current supervision status, the manual supervision method is relatively inefficient. Summary of the invention

[0004] The present invention provides an automatic recording method for illegal sea voyages of fishing vessels during the fishing moratorium period, which solves the problem of low efficiency of current manual supervision methods.

[0005] The present invention provides a method for automatically recording illegal fishing boats going out to sea during the fishing moratorium period, comprising the steps of:

[0006] Step S01: Install and adjust the monitoring camera and tracking camera. The specific process is as follows:

[0007] Step S01-01: Install a monitoring camera and a tracking camera on the same iron tower near the fishing boat outlet, with the distance between the monitoring camera and the tracking camera not exceeding 1 meter;

[0008] Step S01-02: adjusting the monitoring camera and the tracking camera in step S01-01 so that the shooting directions of the two cameras are in the same direction;

[0009] Step S02: Installing an AIS base station on the same tower near the fishing boat outlet described in step S01;

[0010] Step S03: Obtain the image relationship coefficients a1, b1, c1, a2, b2, c2 between the monitoring camera and the tracking camera. The specific process is as follows:

[0011] Step S03-01: Use a surveillance camera to capture a picture;

[0012] Step S03-02: Use a tracking camera to capture a picture;

[0013] Step S03-03: Find three corresponding scene feature points in the two pictures collected in step S02-01 and step S02-02, and record the pixel position coordinates of the three corresponding scene feature points in the two pictures respectively, where the pixel position coordinates of the three scene feature points in the picture collected by the monitoring camera in step S02-01 are (x jk1 ,y jk1 )、(x jk2 ,y jk2 )、(x jk3 ,y jk3 ), the pixel position coordinates of the three scene feature points in the image captured by the tracking camera in step S02-02 are (x gz1 ,y gz1 )、(x gz2 ,y gz2 )、(x gz3 ,y gz3 );

[0014] Step S03-04: Calculate the image relationship coefficients a1, b1, c1, a2, b2, c2 between the monitoring camera and the tracking camera using the following formula:

[0015] Step S04: Obtain the MMSI number of the seagoing vessel. The specific process is as follows:

[0016] Step S04-01: Use surveillance cameras to continuously collect video data f R (x,y,n),f G (x,y,n),f B (x, y, n), where f R (x, y, n) is the grayscale value of the R channel of the color video, f G (x, y, n) is the grayscale value of the G channel of the color video, f B (x, y, n) is the grayscale value of the B channel of the color video, x is an integer greater than 0 and less than N, y is an integer greater than 0 and less than M, and N>1000, M>1000, n is an integer greater than 0 representing the sequence number of the collected video data frame;

[0017] Step S04-02: Construct a video data f1(x, y, k) using the following formula: Wherein k is an integer greater than 24;

[0018] Step S04-03: Construct a video data f2(x, y, q) using the following formula: Where q is an integer greater than 0, It means to divide q by 25 and then round down to the integer;

[0019] Step S04-04: Construct a video data f3 (x, y, p) using the following formula: f3(x,y,p)=|f2(x,y,p)-f2(x,y,p-25)| (4); Where p is an integer greater than 25;

[0020] Step S04-05: Construct a video data f4 (x, y, p) using the following formula: Where p is an integer greater than 25;

[0021] Step S04-06: for each determined value of p, obtain a parameter x0(p), characterized by making f4(x, y, p) equal to 1 and being the largest x value in f4(x, y, p);

[0022] Step S04-07: for each determined value of p, obtain a parameter y0(p), characterized in that f4(x, y, p) is equal to 1 and is the largest y value in f4(x, y, p);

[0023] Step S04-08: When y0(p) is greater than M / 3 for the first time, find the ship data closest to the AIS base station from the AIS data obtained from the AIS base station and record the MMSI number of the ship, and also record the values ​​of x0(p) and y0(p) at this time;

[0024] Step S05: Record the pictures of illegal fishing boats. The specific process is as follows:

[0025] Step S05-01: Compare the ship MMSI number in step S04 with the fishing vessel MMSI number table provided by the Fisheries Bureau. If the ship MMSI number in step S04 is the MMSI number of the fishing vessel, execute steps S05-02 to S05-05;

[0026] Step S05-02: Calculate x2 and y2 using the following formula: where x 01 and 01 are the values ​​of x0(p) and y0(p) recorded in step S04-08;

[0027] Step S05-03: Calculate x1 and y1 using the following formula:

[0028] Step S05-04: Use the 3D positioning function of the camera to enlarge the area from (x1, y1) to (x2, y2) of the tracking camera, where the area from (x1, y1) to (x2, y2) of the tracking camera refers to a rectangular area with the upper left corner pixel point (x1, y1) and the lower right corner pixel point (x2, y2) in the tracking camera image;

[0029] Step S05-05: Collect and save the tracking camera screen image after the area is enlarged in step S05-04.

[0030] Compared with the existing methods, the advantage of the present invention is that it can automatically record illegal fishing boats going out to sea during the fishing moratorium, obtain the MMSI number of the fishing boat and the enlarged picture of the fishing boat, and greatly improve the efficiency of supervision of illegal fishing boats going out to sea. DETAILED DESCRIPTION

[0031] The present invention is further described in detail below with reference to the embodiments.

[0032] Embodiment: A method for automatically recording illegal fishing boats going out to sea during the fishing moratorium period, comprising the steps of:

[0033] Step S01: Install and adjust the monitoring camera and tracking camera. The specific process is as follows:

[0034] Step S01-01: Install a monitoring camera and a tracking camera on the same iron tower near the fishing boat outlet, with the distance between the monitoring camera and the tracking camera not exceeding 1 meter;

[0035] Step S01-02: adjusting the monitoring camera and the tracking camera in step S01-01 so that the shooting directions of the two cameras are in the same direction;

[0036] Step S02: Installing an AIS base station on the same tower near the fishing boat outlet described in step S01;

[0037] Step S03: Obtain the image relationship coefficients a1, b1, c1, a2, b2, c2 between the monitoring camera and the tracking camera. The specific process is as follows:

[0038] Step S03-01: Use a surveillance camera to capture a picture;

[0039] Step S03-02: Use a tracking camera to capture a picture;

[0040] Step S03-03: Find three corresponding scene feature points in the two pictures collected in step S02-01 and step S02-02, and record the pixel position coordinates of the three corresponding scene feature points in the two pictures respectively, where the pixel position coordinates of the three scene feature points in the picture collected by the monitoring camera in step S02-01 are (x jk1 ,y jk1 )、(x jk2 ,y jk2 )、(x jk3 ,y jk3 ), the pixel position coordinates of the three scene feature points in the image captured by the tracking camera in step S02-02 are (x gz1 ,y gz1 )、(x gz2 ,y gz2 )、(x gz3 ,y gz3 );

[0041] Step S03-04: Calculate the image relationship coefficients a1, b1, c1, a2, b2, c2 between the monitoring camera and the tracking camera using the following formula:

[0042] Step S04: Obtain the MMSI number of the seagoing vessel. The specific process is as follows:

[0043] Step S04-01: Use surveillance cameras to continuously collect video data f R (x,y,n),f G (x,y,n),f B (x, y, n), where f R (x, y, n) is the grayscale value of the R channel of the color video, f G (x, y, n) is the grayscale value of the G channel of the color video, f B (x, y, n) is the grayscale value of the B channel of the color video, x is an integer greater than 0 and less than N, y is an integer greater than 0 and less than M, and N>1000, M>1000, n is an integer greater than 0 representing the sequence number of the collected video data frame;

[0044] Step S04-02: Construct a video data f1(x, y, k) using the following formula: Wherein k is an integer greater than 24;

[0045] Step S04-03: Construct a video data f2(x, y, q) using the following formula: Where q is an integer greater than 0, It means to divide q by 25 and then round down to the integer;

[0046] Step S04-04: Construct a video data f3 (x, y, p) using the following formula: f3(x,y,p)=|f2(x,y,p)-f2(x,y,p-25)| (4); Where p is an integer greater than 25;

[0047] Step S04-05: Construct a video data f4 (x, y, p) using the following formula: Where p is an integer greater than 25;

[0048] Step S04-06: for each determined value of p, obtain a parameter x0(p), characterized by making f4(x, y, p) equal to 1 and being the largest x value in f4(x, y, p);

[0049] Step S04-07: for each determined value of p, obtain a parameter y0(p), characterized in that f4(x, y, p) is equal to 1 and is the largest y value in f4(x, y, p);

[0050] Step S04-08: When y0(p) is greater than M / 3 for the first time, find the ship data closest to the AIS base station from the AIS data obtained from the AIS base station and record the MMSI number of the ship, and also record the values ​​of x0(p) and y0(p) at this time;

[0051] Step S05: Record the pictures of illegal fishing boats. The specific process is as follows:

[0052] Step S05-01: Compare the ship MMSI number in step S04 with the fishing vessel MMSI number table provided by the Fisheries Bureau. If the ship MMSI number in step S04 is the MMSI number of the fishing vessel, execute steps S05-02 to S05-05;

[0053] Step S05-02: Calculate x2 and y2 using the following formula: where x 01 and 01 are the values ​​of x0(p) and y0(p) recorded in step S04-08;

[0054] Step S05-03: Calculate x1 and y1 using the following formula:

[0055] Step S05-04: Use the 3D positioning function of the camera to enlarge the area (x1, y1) to (x2, y2) of the tracking camera, where the area (x1, y1) to (x2, y2) of the tracking camera refers to a rectangular area with the upper left corner pixel point (x1, y1) and the lower right corner pixel point (x2, y2) in the tracking camera image;

[0056] Step S05-05: Collect and save the tracking camera screen image after the area is enlarged in step S05-04.

[0057] It should be noted that in step S01-01, the distance between the monitoring camera and the tracking camera should be as small as possible. When adjusting the shooting directions of the two cameras, the images seen by the two cameras should be as consistent as possible.

[0058] It is also necessary to explain that in step S02, the AIS base station is used to receive the AIS data signal sent by the ship, and the MMSI number of the ship can be obtained from the AIS data signal. The AIS base station must be installed on the same tower where the monitoring camera and the tracking camera are installed to obtain the distance between the ship and the tower.

[0059] It should also be noted that the tracking camera used must have a 3D positioning function (such as the Hikvision camera model iDS-2DY9253IAX-A), so that the video images of the illegal ships can be enlarged and then saved, making the ship name on the hull of the illegal ship clearly visible.

Claims

1. A method for automatically recording illegal fishing boats going out to sea during the fishing moratorium, characterized in that: Includes steps: Step S01: Install and adjust the monitoring camera and tracking camera. The specific process is as follows: Step S01-01: Install a monitoring camera and a tracking camera on the same iron tower near the fishing boat outlet, with the distance between the monitoring camera and the tracking camera not exceeding 1 meter; Step S01-02: adjusting the monitoring camera and the tracking camera in step S01-01 so that the shooting directions of the two cameras are in the same direction; Step S02: Installing an AIS base station on the same tower near the fishing boat outlet described in step S01; Step S03: Obtain the image relationship coefficients a1, b1, c1, a2, b2, c2 between the monitoring camera and the tracking camera. The specific process is as follows: Step S03-01: Use a surveillance camera to capture a picture; Step S03-02: Use a tracking camera to capture a picture; Step S03-03: Find three corresponding scene feature points in the two pictures collected in step S02-01 and step S02-02, and record the pixel position coordinates of the three corresponding scene feature points in the two pictures respectively, where the pixel position coordinates of the three scene feature points in the picture collected by the monitoring camera in step S02-01 are (x jk1 ,y jk1 )、(x jk2 ,y jk2 )、(x jk3 ,y jk3 ), the pixel position coordinates of the three scene feature points in the image captured by the tracking camera in step S02-02 are (x gz1 ,y gz1 )、(x gz2 ,y gz2 )、(x gz3 ,y gz3 ); Step S03-04: Calculate the image relationship coefficients a1, b1, c1, a2, b2, c2 between the monitoring camera and the tracking camera using the following formula: Step S04: Obtain the MMSI number of the seagoing vessel. The specific process is as follows: Step S04-01: Use surveillance cameras to continuously collect video data f R (x,y,n),f G (x,y,n),f B (x, y, n), where f R (x, y, n) is the grayscale value of the R channel of the color video, f G (x, y, n) is the grayscale value of the G channel of the color video, f B (x, y, n) is the grayscale value of the B channel of the color video, x is an integer greater than 0 and less than N, y is an integer greater than 0 and less than M, and N>1000, M>1000, n is an integer greater than 0 representing the sequence number of the collected video data frame; Step S04-02: Construct a video data f1(x, y, k) using the following formula: Wherein k is an integer greater than 24; Step S04-03: Construct a video data f2(x, y, q) using the following formula: Where q is an integer greater than 0, It means to divide q by 25 and then round down to the integer; Step S04-04: Construct a video data f3 (x, y, p) using the following formula: f3(x,y,p)=|f2(x,y,p)-f2(x,y,p-25)| (4); Where p is an integer greater than 25; Step S04-05: Construct a video data f4 (x, y, p) using the following formula: Where p is an integer greater than 25; Step S04-06: for each determined value of p, obtain a parameter x0(p), characterized by making f4(x, y, p) equal to 1 and being the largest x value in f4(x, y, p); Step S04-07: for each determined value of p, obtain a parameter y0(p), characterized in that f4(x, y, p) is equal to 1 and is the largest y value in f4(x, y, p); Step S04-08: When y0(p) is greater than M / 3 for the first time, find the ship data closest to the AIS base station from the AIS data obtained from the AIS base station and record the MMSI number of the ship, and also record the values ​​of x0(p) and y0(p) at this time; Step S05: Record the pictures of illegal fishing boats. The specific process is as follows: Step S05-01: Compare the ship MMSI number in step S04 with the fishing vessel MMSI number table provided by the Fisheries Bureau. If the ship MMSI number in step S04 is the MMSI number of the fishing vessel, execute steps S05-02 to S05-05; Step S05-02: Calculate x2 and y2 using the following formula: where x 01 and 01 are the values ​​of x0(p) and y0(p) recorded in step S04-08; Step S05-03: Calculate x1 and y1 using the following formula: Step S05-04: Use the 3D positioning function of the camera to enlarge the area from (x1, y1) to (x2, y2) of the tracking camera, where the area from (x1, y1) to (x2, y2) of the tracking camera refers to a rectangular area with the upper left corner pixel point (x1, y1) and the lower right corner pixel point (x2, y2) in the tracking camera image; Step S05-05: Collect and save the tracking camera screen image after the area is enlarged in step S05-04.

Images