Ship Recognition Method and Mobile Device for Maritime Boundary Monitoring

Abstract

To provide a vessel recognition method for monitoring a marine boundary and a mobile terminal.SOLUTION: A vessel recognition method for monitoring a marine boundary includes steps for: outputting a real-time camera picture of a sea taken by a camera installed in a mobile terminal S310; transmitting an information request including location information of the mobile terminal to a collection server which collects vessel information in real time in response to output of the real-time camera picture S320; receiving vessel information of a vessel within a preset distance from the location of the mobile terminal from the collection server in response to the information request S330; and fusing the received vessel information with each vessel image of the output real-time camera image and outputting the fusing vessel information by using the received vessel information S340.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a method for recognizing ships and a mobile terminal for maritime boundary surveillance. [Background technology]

[0002] Maritime boundary monitoring can be said to be a series of processes to ensure the safety of citizens and national security by early detection of abnormal situations at sea, such as vessels behaving abnormally, marine accidents, and illegal maritime activities, through continuous marine observation. Recent advances in maritime boundary monitoring have led to the combined use of various sensors and systems, including cameras, radar, AIS, V-Pass, and e-Navigation, to enable more accurate and precise maritime boundary monitoring.

[0003] For rapid and accurate maritime boundary monitoring, it is very important to have a procedure for identifying unidentified vessels through mutual cooperation and information exchange between boundary monitoring units such as indoor general situation rooms, outer coastal areas, and maritime boundary monitoring vessels.

[0004] Figure 1 shows the procedure for identifying unidentified vessels through mutual cooperation between maritime boundary surveillance units.

[0005] Referring to Figure 1, the procedure for identifying unidentified vessels is as follows: when an unidentified vessel that is difficult for one of the maritime boundary monitoring units to identify appears during maritime boundary monitoring by each maritime boundary monitoring unit, the unit sends a vessel identification request to another boundary monitoring unit, which identifies the vessel and returns the results to the requesting unit, and the unidentified vessel is resolved based on the identification results.

[0006] Existing video-based maritime boundary surveillance systems use fixed cameras installed on land to monitor and identify ships at sea, or use a separate surveillance system to identify ships. This requires the installation of numerous coastal boundary surveillance cameras and the manpower required to monitor them.

[0007] FIG. 2 is a diagram showing an example of a ship recognition screen for each maritime boundary surveillance unit.

[0008] When implementing the procedure for identifying unidentified vessels in existing maritime boundary surveillance, the location and situational awareness environment differ for each maritime boundary surveillance unit, as shown in Figure 2. Here, the situational awareness environment can include 2D maps, CCTV footage, maritime boundary surveillance vessels, actual coastal areas, etc. Therefore, when exchanging information between maritime boundary surveillance units, mapping of the same vessel, object, or topographical feature is based on verbal description, which is time-consuming and prone to errors. [Prior art documents] [Patent documents]

[0009] [Patent Document 1] Republic of Korea Patent Registration No. 10-1703906 (2017.02.01) Summary of the Invention [Problem to be solved by the invention]

[0010] The present invention provides a ship recognition method and a mobile device for maritime boundary monitoring that outputs an augmented reality image that combines information about a ship that appears in a real-time maritime image captured by a camera on a mobile device. [Means for solving the problem]

[0011] According to one aspect of the present invention, a method for vessel recognition for mobile terminal-based maritime boundary surveillance is disclosed.

[0012] A ship recognition method for maritime boundary monitoring according to an embodiment of the present invention includes the steps of outputting real-time camera images of the sea taken by a camera installed in the mobile terminal, transmitting an information request including location information of the mobile terminal to a collection server that collects ship information in real time in response to the output of the real-time camera images, receiving ship information of ships within a predetermined distance from the location of the mobile terminal from the collection server in response to the information request, and fusing the received ship information with each ship image of the output real-time camera images and outputting the fusing.

[0013] The collection server receives and stores real-time ship information of all ships sailing within pre-defined control areas from the Automatic Identification System (AIS), V-PASS, and LTE-M.

[0014] The vessel information includes vessel name, vessel specifications, current date and time, call sign, identification number, position, speed, course and turn rate.

[0015] The step of combining and outputting the ship information uses the position, altitude, and PTZ (Pan-Tilt-Zoom) information of the camera of the mobile terminal and the ship information collected about ships within a predetermined distance from the position of the mobile terminal to display the ship information around each ship image appearing in the real-time camera image.

[0016] The step of combining and outputting the ship information includes displaying the name of the ship around each ship image appearing in the real-time camera image, and when a touch input is received on the ship image, outputting the entire ship information of the touch-inputted ship image through a pop-up window.

[0017] According to another aspect of the present invention, a mobile terminal for implementing a vessel recognition method for maritime boundary surveillance is disclosed.

[0018] According to an embodiment of the present invention, a mobile terminal includes a memory for storing commands and a processor for executing the commands, and the commands implement a ship recognition method for maritime boundary monitoring, the method including: outputting real-time camera images of the sea taken by a camera provided in the mobile terminal; transmitting an information request including location information of the mobile terminal to a collection server that collects ship information in real time in response to the output of the real-time camera images; receiving ship information of ships within a predetermined distance from the location of the mobile terminal from the collection server in accordance with the information request; and fusing the received ship information with each ship image in the output real-time camera images and outputting the fusing. [Effects of the Invention]

[0019] The ship recognition method and mobile device for maritime boundary monitoring according to an embodiment of the present invention can output an augmented reality image that combines information about a ship that appears in a real-time maritime image captured by a camera of the mobile device. [Brief explanation of the drawings]

[0020] [Figure 1] This diagram shows the procedure for identifying unidentified vessels through mutual cooperation between maritime boundary surveillance units. [Figure 2] This figure shows an example of a vessel recognition screen by maritime boundary surveillance unit. [Figure 3] 1 is a flowchart illustrating a method for recognizing ships for maritime boundary monitoring performed by a mobile terminal according to an embodiment of the present invention. [Figure 4] 4 is a diagram illustrating a method for recognizing ships for maritime boundary monitoring according to the embodiment of the present invention shown in FIG. 3. [Figure 5] 1 is a diagram illustrating a schematic configuration of a mobile terminal that executes a ship recognition method for maritime boundary monitoring according to an embodiment of the present invention; DETAILED DESCRIPTION OF THE INVENTION

[0021] As used herein, singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, terms such as "comprise" or "include" should not be interpreted as including all of the components or steps described in the specification, but should be interpreted as meaning that some of the components or steps may not be included, or that additional components or steps may be included. Furthermore, terms such as "unit," "module," and the like used in the specification refer to a unit that processes at least one function or operation, and may be implemented in hardware or software, or a combination of hardware and software.

[0022] Various embodiments of the present invention will now be described with reference to the accompanying drawings.

[0023] Fig. 3 is a flowchart illustrating a method for recognizing ships for maritime boundary monitoring performed by a mobile terminal according to an embodiment of the present invention, and Fig. 4 is a diagram for explaining the method for recognizing ships for maritime boundary monitoring according to the embodiment of the present invention shown in Fig. 3. Hereinafter, the method for recognizing ships for maritime boundary monitoring according to the embodiment of the present invention will be explained mainly with reference to Fig. 3 and Fig. 4.

[0024] In step S310, the mobile terminal 100 outputs real-time camera images captured by a camera attached to the mobile terminal 100.

[0025] That is, the mobile terminal 100 can be equipped with a ship recognition application that recognizes ships using camera images of the sea. Therefore, the mobile terminal 100 can drive the ship recognition application in accordance with a user's drive command, activate the camera of the mobile terminal 100, and output the camera image through the ship recognition application. At this time, the mobile terminal 100 can output a guidance message to take a picture of the sea where the user wishes to monitor the boundary in response to the drive of the ship recognition application. As a result, the user can confirm the guidance message and point the camera of the mobile terminal 100 toward the sea where the user wishes to monitor.

[0026] In step S320, the mobile terminal 100 transfers an information request including the location information of the mobile terminal 100 to the collection server 200 that collects ship information in real time according to the output of the real-time camera image.

[0027] Here, the collection server 200 can receive and store real-time ship information of all ships sailing in a pre-defined control area from the Automatic Identification System (AIS), V-PASS, LTE-M, etc. Here, the ship information can include ship name, ship specifications, current date and time (date and time), call sign, MMSI, position (latitude and longitude), speed (SoG), course of G, rate of turn, etc.

[0028] In step S330, the mobile terminal 100 receives, from the collection server 200, ship information about ships within a preset distance from the location of the mobile terminal 100 in accordance with the information request forwarded to the collection server 200.

[0029] That is, the collection server 200 receives a request for information including the location information of the mobile terminal 100, identifies ships within a preset distance from the location of the mobile terminal 100, extracts ship information for the identified ships, and then transfers the information to the requesting mobile terminal 100.

[0030] In step S340, the mobile terminal 100 uses the received ship information to merge the ship information into each ship image in the output real-time camera image and output the merged image.

[0031] In other words, the mobile terminal 100 can display ship information of the ship in question around each ship image appearing in the real-time camera image using the camera position, altitude, and PTZ (pan-tilt-zoom) information of the mobile terminal 100, as well as ship information collected about ships within a predetermined distance from the position of the mobile terminal 100.

[0032] Here, the displayed vessel information may be the vessel name as shown in Fig. 4. When the mobile terminal 100 receives a touch input on the vessel image from the user to view detailed information, the mobile terminal 100 can output the overall vessel information of the vessel, such as the vessel name, vessel specifications, current time and date (date and time), call sign, identification number (MMSI), position (latitude and longitude), speed (SoG), course of G, rate of turn, etc., through another pop-up window.

[0033] FIG. 5 is a diagram illustrating a schematic configuration of a mobile terminal that executes a ship recognition method for maritime boundary monitoring according to an embodiment of the present invention.

[0034] Referring to FIG. 5, a mobile terminal according to an embodiment of the present invention includes a processor 10, a memory 20, a communication unit 30, and an interface unit 40.

[0035] The processor 10 may be a CPU or semiconductor device that executes processing instructions stored in a memory 20 .

[0036] The memory 20 may include various types of volatile or non-volatile storage media, for example, a ROM, a RAM, etc.

[0037] For example, memory 20 may store commands for implementing a vessel recognition method for maritime boundary surveillance according to an embodiment of the present invention.

[0038] The communication unit 30 is a means for transmitting and receiving data to and from other devices via a communication network.

[0039] The interface unit 40 can include a network interface for connecting to a network and a user interface.

[0040] On the other hand, the components of the above-described embodiment can be easily understood from a process perspective. That is, each component can be understood as a separate process. Furthermore, the processes of the above-described embodiment can be easily understood from the perspective of the components of the device.

[0041] Furthermore, the above-described technical content may be embodied in the form of program instructions that can be executed by various computer means and recorded on a computer-readable medium. The computer-readable medium may include, alone or in combination, program instructions, data files, data structures, and the like. The program instructions recorded on the medium may be specially designed and configured for the embodiments, or may be known and available to those skilled in the art of computer software. Examples of computer-readable recording media include hardware devices specially configured to store and execute program instructions, such as magnetic media such as hard disks, floppy disks, and magnetic tape; optical media such as CD-ROMs and DVDs; magneto-optical media such as optical disks; read-only memory (ROM), random access memory (RAM), and flash memory. Examples of program instructions include not only machine language code, such as produced by a compiler, but also high-level language code that can be executed by a computer using an interpreter, for example. A hardware device may be configured to operate as one or more software modules to perform the operations of the embodiments, or vice versa.

[0042] The above-described embodiments of the present invention have been disclosed for illustrative purposes, and those skilled in the art will recognize that various modifications, alterations, and additions may be made within the spirit and scope of the present invention, and all such modifications and additions are to be considered within the scope of the following claims. [Explanation of symbols]

[0043] 10 processors 20 memory 30 Communications Department 40 Interface section 100 mobile devices 200 Collection Server

Claims

1. A method for recognizing ships for maritime boundary monitoring performed by a mobile device, comprising: outputting a real-time camera image of the sea taken by a camera provided on the mobile terminal; a step of transmitting an information request including location information of the mobile terminal to a collection server that collects ship information in real time according to the output of the real-time camera image; receiving, from the collection server in response to the information request, ship information of ships within a predetermined distance from the location of the mobile terminal; Using the received ship information, fusing the ship information with each ship image of the output real-time camera images and outputting the fusing information; Including, The collection server receives and stores real-time ship information of all ships sailing in a predetermined control area from an Automatic Identification System (AIS), a V-PASS, and a LTE-M (Long-Terminal Mobile Communications Network), and identifies ships within a predetermined distance from the location of the mobile terminal by receiving an information request including the location information of the mobile terminal, extracts ship information of the identified ships, and transmits the extracted ship information to the mobile terminal that transmitted the information request; The vessel information includes vessel name, vessel specifications, current date and time, call sign, identification number, position, speed, course and turn rate; The step of fusing and outputting the ship information includes: A method for recognizing ships for maritime boundary monitoring, comprising: displaying a ship name around each ship image appearing in the real-time camera image using the position, altitude, and PTZ (Pan-Tilt-Zoom) information of the camera of the mobile device and the ship information collected about ships within a preset distance from the position of the mobile device; and outputting, via a pop-up window, all ship information of the touch-inputted ship image, including the ship name, ship specifications, current date and time (date and time), call sign, identification number (MMSI), position (latitude and longitude), speed (SoG), course of G, and rate of turn, when a touch input is received on the ship image.

2. A mobile terminal for executing a vessel recognition method for maritime boundary monitoring, a memory for storing commands; a processor for executing the commands; The command outputting a real-time camera image of the sea taken by a camera provided on the mobile terminal; transferring an information request including location information of the mobile terminal to a collection server that collects ship information in real time according to the output of the real-time camera image; receiving, from the collection server in accordance with the information request, vessel information of vessels within a predetermined distance from the location of the mobile terminal; Using the received ship information, fusing the ship information with each ship image in the output real-time camera image and outputting the fusing information; Implementing a vessel recognition method for maritime boundary surveillance, including: The collection server receives and stores real-time ship information of all ships sailing in a predetermined control area from an Automatic Identification System (AIS), a V-PASS, and a LTE-M (Long-Terminal Mobile Communications Network), and identifies ships within a predetermined distance from the location of the mobile terminal by receiving an information request including the location information of the mobile terminal, extracts ship information of the identified ships, and transmits the extracted ship information to the mobile terminal that transmitted the information request; The vessel information includes vessel name, vessel specifications, current date and time, call sign, identification number, position, speed, course and turn rate; The step of fusing and outputting the ship information includes: The mobile terminal displays the name of a ship around each ship image appearing in the real-time camera image using the position, altitude, and PTZ (Pan-Tilt-Zoom) information of the camera of the mobile terminal and the ship information collected about ships within a preset distance from the position of the mobile terminal, and when a touch input is received on the ship image, outputs the entire ship information of the touch input ship image through a pop-up window, including the ship name, ship specifications, current date and time (date and time), call sign, identification number (MMSI), position (latitude and longitude), speed (SoG), course of G, and rate of turn.

Images