Ship identification method for marine perimeter monitoring and mobile terminal

Abstract

The invention discloses a ship identification method for marine perimeter monitoring and a mobile terminal. The ship identification method for marine perimeter monitoring comprises the following steps: outputting a real-time camera image shot at sea by using a camera arranged in the mobile terminal; sending an information request containing the position information of the mobile terminal to a collection server, wherein the collection server collects ship information in real time according to the output of the real-time camera image; ship information of ships within a preset distance from the position of the mobile terminal is received from the collection server according to the information request; and using the received ship information, merging the ship information into each ship image in the output real-time camera images, and outputting the ship information.

Description

Technical Field

[0001] The invention relates to a ship identification method and a mobile terminal for offshore boundary monitoring. Background Art

[0002] Maritime perimeter monitoring can be described as a series of processes that promote public safety and national security by continuously observing the ocean and detecting abnormal marine situations such as abnormally behaving ships, maritime accidents, illegal activities at sea, etc. As technology advances, recent maritime perimeter monitoring uses various sensors and systems such as cameras, radars, AIS, V-Pass, and e-Navigation, making maritime perimeter monitoring more accurate and precise.

[0003] In order to conduct maritime perimeter monitoring quickly and accurately, it is very important to conduct the identification process of unidentified ships through mutual cooperation and information exchange between perimeter monitoring units such as the indoor general situation room, external coastal areas, and maritime perimeter monitoring ships.

[0004] Figure 1 This is a schematic diagram of the process of cooperation between maritime boundary monitoring units to identify unidentified ships.

[0005] See also Figure 1 The identification procedure for unidentified ships is as follows: during the process executed by each maritime perimeter monitoring unit, if an unidentified ship that is difficult to identify by itself appears in a maritime perimeter monitoring unit, a ship identification request is sent to other perimeter monitoring units, and when the other ships identify the requested ships to return their results to the requesting unit, the requesting unit reflects the identification result to resolve the unidentified ship.

[0006] Existing image-based offshore perimeter monitoring systems use fixed cameras installed on land to monitor and identify offshore vessels, or use a separate monitoring system to confirm the vessel. Because of this, multiple coastal perimeter monitoring cameras must be installed and a large number of personnel are required for monitoring.

[0007] Figure 2 This figure shows an example of a ship identification screen for each maritime boundary monitoring unit.

[0008] like Figure 2 As shown in the figure, in the existing maritime boundary monitoring, when performing the identification procedure for unidentified ships, the positions and situational awareness environments of various maritime boundary monitoring units are different. Among them, the situational awareness environment may include 2D maps, closed-circuit surveillance images, maritime boundary monitoring lines, actual coastal areas, etc. Therefore, when the maritime boundary monitoring units exchange information, the mapping of the same ship, object, terrain, etc. is based on verbal description, which is time-consuming and has a high probability of error.

[0009] Prior art literature

[0010] Patent document: Korean Patent Gazette No. 10-1703906 (2017.02.01) Summary of the invention

[0011] Technical problem to be solved by the invention

[0012] The present invention provides a ship identification method and a mobile terminal for maritime boundary monitoring, which output an augmented reality picture, wherein the augmented reality is formed by merging the ship information on the ship displayed in the real-time maritime image taken by the camera of the mobile terminal.

[0013] Technical solutions to solve problems

[0014] According to one aspect of the present invention, a ship identification method for offshore boundary monitoring performed by a mobile terminal is disclosed.

[0015] According to an embodiment of the present invention, a ship identification method for offshore boundary monitoring includes the following steps: outputting a real-time camera image taken at sea using a camera provided in the mobile terminal; sending an information request containing the location information of the mobile terminal to a collection server, the collection server collecting ship information in real time according to the output of the real-time camera image; receiving ship information of ships within a preset distance from the location of the mobile terminal from the collection server according to the information request; and using the received ship information, merging the ship information into each ship image in the output real-time camera image for output.

[0016] The collection server receives and stores the ship information of all ships sailing in a preset control area from the ship automatic identification system (AIS), the vessel position transmitter (V-PASS) and the ultra-high-speed marine wireless communication network (LTE-M) in real time.

[0017] The vessel information includes the vessel name, vessel specifications, current date and time, call sign, identification code, position, speed, heading and turning speed.

[0018] In the step of merging the ship information for output, the position, height, pan-tilt-zoom (PTZ) information of the camera of the mobile terminal and the collected ship information of the ships within a preset distance from the position of the mobile terminal are used to display the ship information around each ship image displayed in the real-time camera image.

[0019] In the step of merging the ship information for output, the ship name is displayed around each ship image displayed in the real-time camera image, and when a touch input to a ship image is received, all the ship information of the touch-input ship image is displayed via a pop-up window.

[0020] According to another aspect of the present invention, a mobile terminal for executing a ship identification method for offshore boundary monitoring is disclosed.

[0021] According to an embodiment of the present invention, a mobile terminal includes: a memory in which instructions are stored; and a processor for executing the instructions, wherein the instructions execute a ship identification method for offshore boundary monitoring including the following steps: outputting a real-time camera image taken at sea using a camera provided in the mobile terminal; sending an information request containing the location information of the mobile terminal to a collection server, the collection server collecting ship information in real time according to the output of the real-time camera image; receiving ship information of ships within a preset distance from the location of the mobile terminal from the collection server according to the information request; and using the received ship information, merging the ship information into each ship image in the output real-time camera image for output.

[0022] Effects of the Invention

[0023] The ship identification method and mobile terminal for maritime boundary monitoring according to the embodiments of the present invention can output an augmented reality picture, which is formed by merging the ship's information on the ship displayed in the real-time maritime image captured by the camera of the mobile terminal. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 This is a schematic diagram of the process of cooperation between maritime boundary monitoring units to identify unidentified ships.

[0025] Figure 2 This figure shows an example of a ship identification screen for each maritime boundary monitoring unit.

[0026] Figure 3 The present invention is a flow chart of a ship identification method for offshore boundary monitoring executed by a mobile terminal according to an embodiment of the present invention.

[0027] Figure 4 For illustration Figure 3 FIG. 2 is a diagram of a ship identification method for offshore boundary monitoring according to an embodiment of the present invention.

[0028] Figure 5 The figure briefly shows the configuration of a mobile terminal for executing a ship identification method for offshore boundary monitoring according to an embodiment of the present invention.

[0029] Description of Reference Numerals

[0030] 10: Processor

[0031] 20: Memory

[0032] 30: Communication unit

[0033] 40: Interface unit

[0034] 100: Mobile terminals

[0035] 200: Collection server DETAILED DESCRIPTION

[0036] Singular expressions used herein include plural expressions unless the context clearly indicates otherwise. In this article, terms such as "consisting of" or "including" should not be interpreted as necessarily including various components or steps described in the specification, and some components or steps may or may not be included, or include additional components or steps. In addition, terms such as "section" and "module" used in this article refer to a unit that processes at least one function or operation, which can be implemented as hardware or software, or a combination of hardware and software.

[0037] Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0038] Figure 3 is a flow chart of a ship identification method for offshore boundary monitoring executed by a mobile terminal according to an embodiment of the present invention. Figure 4 For illustration Figure 3 FIG. 1 is a diagram of a ship identification method for offshore boundary monitoring according to an embodiment of the present invention. Figure 3 Based on the combination Figure 4 , a ship identification method for offshore boundary monitoring according to an embodiment of the present invention is described.

[0039] In step S310 , the mobile terminal 100 outputs a real-time camera image captured at sea using a camera provided in the mobile terminal 100 .

[0040] That is, the mobile terminal 100 may be equipped with a ship recognition application for identifying ships from camera images taken at sea. Therefore, the mobile terminal 100 may run the ship recognition application according to the user's drive command, activate the camera of the mobile terminal 100, and output the camera image through the ship recognition application. At this time, the mobile terminal 100 may output a guidance message according to the operation of the ship recognition application to instruct to shoot the sea area where the perimeter monitoring is desired. Therefore, the user may confirm the guidance message and point the camera of the mobile terminal 100 to the sea area where the user wants to perform perimeter monitoring.

[0041] In step S320, the mobile terminal 100 sends an information request including the location information of the mobile terminal 100 to the collection server 200, and the collection server 200 collects the ship information in real time according to the output of the real-time camera image.

[0042] The collection server 200 can receive and store the ship information of all ships sailing in the preset control area in real time from the ship automatic identification system (AIS), the ship position transmitter (V-PASS), the ultra-high-speed marine wireless communication network (LTE-M), etc. The ship information may include the ship name, ship specifications, current date and time, call sign, identification code (MMSI), position (latitude and longitude), speed (SoG), heading (CoG), turn speed (Rate of Turn), etc.

[0043] In step S330 , the mobile terminal 100 receives the ship information of the ships within a preset distance from the location of the mobile terminal 100 from the collection server 200 according to the information request sent to the collection server 200 .

[0044] That is, when receiving an information request including the location information of the mobile terminal 100, the collection server 200 is configured to extract the ship information of the confirmed ships within a preset distance from the location of the mobile terminal 100 and send it to the mobile terminal 100 requesting the information.

[0045] In step S340, the mobile terminal 100 uses the received ship information to merge the ship information into each ship image in the output real-time camera image for output.

[0046] That is, the mobile terminal 100 uses the position, height, PTZ (Pan-Tilt-Zoom) information of the camera of the mobile terminal 100 and the collected ship information of ships within a preset distance from the position of the mobile terminal 100 to display the ship information of the corresponding ship around each ship image displayed in the real-time camera image.

[0047] Among them, Figure 4 As shown, the displayed ship information may be the ship name. Furthermore, when the mobile terminal 100 receives a touch input from the user on the ship image to view detailed information, all ship information of the corresponding ship may be output through a separate pop-up window, such as the ship name, ship specifications, current date and time, call sign, identification code (MMSI), position (latitude and longitude), speed (SoG), heading (CoG), turn speed (Rate of Turn), etc.

[0048] Figure 5 The figure briefly shows the configuration of a mobile terminal for executing a ship identification method for offshore boundary monitoring according to an embodiment of the present invention.

[0049] See also Figure 5 , the mobile terminal according to the embodiment of the present invention includes a processor 10, a memory 20, a communication unit 30 and an interface unit 40.

[0050] The processor 10 may be a CPU or a semiconductor device that executes processing instructions stored in the memory 20 .

[0051] The memory 20 may include various types of volatile or non-volatile storage media. For example, the memory 20 may include a read-only memory (ROM), a random access memory (RAM), and the like.

[0052] For example, the memory 20 may store instructions for executing the ship identification method for offshore boundary monitoring according to an embodiment of the present invention.

[0053] The communication unit 30 is a unit for transmitting and receiving data with other devices through a communication network.

[0054] The interface unit 40 may include a network interface for connecting to a network and a user interface.

[0055] On the other hand, the components of the above-mentioned embodiments can be easily understood from the perspective of the process. In other words, each component can be understood as a separate process. In addition, the process of the above-mentioned embodiment can be easily understood from the perspective of the components of the device.

[0056] In addition, the above technical content can be implemented in the form of program instructions that can be executed by various computer devices and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., individually or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and available to technicians in the field of computer software. Examples of computer-readable recording media include: magnetic media, such as hard disks, floppy disks, and tapes; optical media, such as read-only compact disks (CD-ROMs), digital video disks (DVDs), etc.; magneto-optical media, such as floppy drives (floptical disks); and hardware devices specially configured to store and execute program instructions, such as read-only memories (ROMs), random access memories (RAMs), flash memories, etc. Examples of program instructions include machine language codes, such as codes generated by compilers, and high-level language codes that can be run by computers using interpreters, etc. The hardware device may be configured to operate as one or more software modules to perform the operations of the embodiment, and vice versa.

[0057] The above-mentioned embodiments of the present invention are disclosed for illustrative purposes, and those skilled in the art will be able to make various modifications, changes and additions within the spirit and scope of the present invention, and such modifications, changes and additions will be deemed to be included within the scope of the appended patent claims.

Claims

1. A ship identification method for offshore perimeter monitoring, executed by a mobile terminal, characterized in that: The ship identification method for offshore perimeter monitoring comprises the following steps: Outputting a real-time camera image captured at sea using a camera provided in the mobile terminal; sending an information request including the location information of the mobile terminal to a collection server, the collection server collecting ship information in real time according to the output of the real-time camera image; receiving, from the collection server according to the information request, ship information of ships within a preset distance from the location of the mobile terminal; and Using the received ship information, the ship information is merged into each ship image in the output real-time camera image for output.

2. The ship identification method for offshore boundary monitoring according to claim 1, characterized in that: The collection server receives and stores the ship information of all ships sailing in a preset control area in real time from the ship automatic identification system, the ship position transmitter and the ultra-high-speed marine wireless communication network.

3. The ship identification method for offshore boundary monitoring according to claim 1, characterized in that: The vessel information includes the vessel name, vessel specifications, current date and time, call sign, identification code, position, speed, heading and turning speed.

4. The ship identification method for offshore boundary monitoring according to claim 1, characterized in that: In the step of merging the ship information for output, the position, height, pan, tilt and zoom information of the camera of the mobile terminal and the collected ship information of the ships within a preset distance from the position of the mobile terminal are used to display the ship information around each ship image displayed in the real-time camera image.

5. The ship identification method for offshore boundary monitoring according to claim 4, characterized in that: In the step of merging the ship information for output, the ship name is displayed around each ship image displayed in the real-time camera image, and when a touch input to a ship image is received, all the ship information of the touch-input ship image is displayed via a pop-up window.

6. A mobile terminal, executing a ship identification method for offshore perimeter monitoring, characterized in that: The mobile terminal comprises: a memory in which the instructions are stored; and a processor for executing the instructions, The instruction executes a ship identification method for offshore perimeter monitoring comprising the following steps: Outputting a real-time camera image captured at sea using a camera provided in the mobile terminal; sending an information request including the location information of the mobile terminal to a collection server, the collection server collecting ship information in real time according to the output of the real-time camera image; receiving, from the collection server according to the information request, ship information of ships within a preset distance from the location of the mobile terminal; and Using the received ship information, the ship information is merged into each ship image in the output real-time camera image for output.

Images