Vessel-land monitoring system and its method

Abstract

A ship shore control system and a method thereof are disclosed. A ship land control system according to an embodiment of the present invention comprises: a ship monitoring server mounted on a ship that analyzes surveillance footage captured by a CCTV (Closed Circuit Television) camera to describe detected objects and event situations as text data and transmits it via satellite communication; and a land control server that analyzes the text data received via satellite communication to composite an object image corresponding to the event situation onto a basic image of the CCTV camera and displays the described surveillance footage.

Description

Technology Field

[0001] The present invention relates to a ship land control system and a method thereof, and more specifically, to a ship land control system and a method thereof for safely controlling a ship in a remote location in a satellite communication environment. Background Technology

[0002] Generally, ships operating from a remote location and land-based control systems that manage their operational status frequently transmit and receive data using satellite communication. For example, a monitoring system installed on a ship transmits status data to land, which analyzes signals and data from various mechanical equipment. Consequently, the land-based control system can monitor for any abnormalities in the ship based on the status data received from the ship monitoring system.

[0003] Satellite communication is utilized for data transmission and reception between ships in remote locations and land due to its wide coverage area and the advantage of not requiring the installation of base stations. However, compared to these advantages, satellite communication has disadvantages such as slow data communication speeds due to low bandwidth and frequent data interruptions caused by weather conditions, while communication costs are too high, which limits its use.

[0004] Meanwhile, recent active research on Maritime Autonomous Surface Ships (MASS) is leading to a trend of decreasing crew numbers as systems replace roles previously performed by human crew members. Conversely, the number of CCTV cameras installed in specific sections is increasing to monitor for abnormal conditions within the vessel.

[0005] Accordingly, conventional onboard CCTV video surveillance systems must transmit onboard video data in real time, but there are limitations in transmitting large amounts of video data via satellite communication and problems such as excessive costs.

[0006] In addition, while transmitting only data regarding the occurrence of video events on board the vessel can reduce the amount of data transmitted, there is a problem in that it is difficult for the receiving onshore control system to identify the specific event situation.

[0007] The matters described in this background technology section are written to enhance understanding of the background of the invention and may include matters that are not prior art already known to those skilled in the art to which this technology belongs. The problem to be solved

[0008] An embodiment of the present invention relates to a ship land control system and a method thereof, wherein an event situation detected in a surveillance video of a CCTV camera on board a ship is described as text data, transmitted to land via satellite communication, and the text data received by a land control server is analyzed to synthesize the event situation onto a basic image of the corresponding CCTV camera and display it. means of solving the problem

[0009] According to one aspect of the present invention, a ship land control system comprises: a ship monitoring server mounted on a ship that analyzes surveillance images captured by a CCTV (Closed Circuit Television) camera to describe detected objects and event situations as text data and transmits it via satellite communication; and a land control server that analyzes the text data received via satellite communication to composite an object image corresponding to the event situation onto a base image of the CCTV camera and displays the described surveillance images.

[0010] Additionally, the ship monitoring server may include: a video collection module that collects surveillance images captured in real time from a plurality of CCTV cameras installed in each zone within the ship; a video analysis module that analyzes the captured surveillance images through a deep learning-based image recognition algorithm to identify whether an object added to the default image or an event situation has occurred through object recognition; a data generation module that generates lightweight text data describing the object or event situation in the default image based on information identified by the video analysis module; and a control module that bundles the text data accumulated over a set period into time-series data and transmits it to the land control server via a satellite communication antenna.

[0011] In addition, the video collection module can extract a camera ID from the captured surveillance video to identify the CCTV camera and distinguish the installation location, and transmit it to the video analysis module.

[0012] In addition, the above video analysis module can identify event situations that can be estimated by analyzing singularities of recognized objects through the analysis of the surveillance video extracted once per certain time interval.

[0013] In addition, the video analysis module can identify at least one event situation among fire, smoke, leakage, explosion, intrusion, intrusion into a restricted area, external attack, crew member collapse, safety accident, and failure to wear safety equipment within the vessel through the recognition of the object.

[0014] In addition, the data generation module can generate lightweight text data by inputting objects and event situations identified in the surveillance video for each camera into a table list at regular intervals.

[0015] In addition, the control module can process the text data into ship monitoring data including sending information at the time when the text data is accumulated for one minute and transmit it via the satellite communication.

[0016] Additionally, the above-mentioned land control server may include: a database (DB) that stores basic images matched by camera IDs installed on the managed vessel; a communication unit that receives vessel monitoring data from the vessel monitoring server via satellite communication; a data analysis unit that performs data parsing based on the text data contained in the vessel monitoring data to determine whether an object is detected and whether an event situation occurs for each camera ID installed on the vessel; and a control unit that retrieves basic images matched to camera IDs from the DB, synthesizes object images corresponding to the identified event situations, and displays the described monitoring video through a display unit.

[0017] In addition, the above DB can store sample object images capable of depicting various objects and event situations on the above base image.

[0018] In addition, the data analysis unit can recognize the described object image, coordinates, and size through parsing the text data contained in the camera ID, and can synthesize the object image by adjusting it to the pixel-based coordinates and size of the corresponding base image.

[0019] In addition, the control unit can update the display unit by playing the surveillance video at the accumulated time intervals of the text data through the GUI (Graphical User Interface).

[0020] In addition, the control unit may display a ship CCTV control video that divides and arranges the entire surveillance video corresponding to the camera ID installed on the ship into one screen, or enlarge and display a single surveillance video selected through the GUI among the ship CCTV control videos.

[0021] In addition, the control unit can continuously display multiple ship monitoring data received through the GUI at one-minute intervals.

[0022] Meanwhile, a ship land control method according to one aspect of the present invention comprises: a step in which a ship monitoring server mounted on a ship analyzes a surveillance image captured by a CCTV (Closed Circuit Television) camera, describes detected objects and event situations as text data, and transmits it to land via satellite communication; and a step in which a land control server analyzes the text data received via satellite communication, synthesizes an object image corresponding to the event situation onto a base image of the CCTV camera, and displays the described surveillance image.

[0023] Additionally, the step of transmitting to land may include: collecting surveillance images from a plurality of CCTV cameras installed in each zone within the vessel; analyzing the surveillance images to determine whether an object is detected or an event situation occurs in addition to the base image; and, if it is determined that the object is detected or the event situation has occurred, generating text data describing the added object or event situation.

[0024] Additionally, the step of generating the text data may include the step of generating the text data regarding the detected object or event situation by analyzing the surveillance video extracted once per second.

[0025] Additionally, the step of transmitting to land may include: a step of accumulating and storing the text data and checking whether it has been accumulated for a set period; a step of generating the ship monitoring data including sending information by bundling the accumulated text data into time-series data when the text data has been accumulated for the set period; and a step of transmitting the ship monitoring data to the land control server.

[0026] Additionally, the step of displaying the surveillance video may include: a step of identifying the vessel corresponding to the transmission information of the text data and the camera ID installed within the vessel; a step of performing syntactic analysis based on the text data to determine whether object detection or an event situation has occurred for each camera ID installed on the vessel; and a step of generating the described surveillance video by synthesizing an object image corresponding to the object detection and event situation with a base image corresponding to the camera ID where the camera ID where the object detection or event situation occurred exists.

[0027] In addition, the step of generating the surveillance video described above may include a step of synthesizing by adjusting the coordinates and size of the object image based on the text data of the camera ID.

[0028] Additionally, after the step of checking whether object detection or event situation occurs for each camera ID, if the object detection and event situation do not occur, the method may further include a step of displaying a default image stored in advance corresponding to the camera ID as a surveillance image. Effects of the invention

[0029] According to an embodiment of the present invention, by describing an event situation detected in CCTV camera footage on a ship as lightweight text data and transmitting it via satellite communication, and by displaying a surveillance video describing the object and the event situation through analysis of the text data received from a land-based control server, there is an effect of enabling ship control via inexpensive satellite communication.

[0030] In addition, by analyzing surveillance footage from a ship and implementing object and event situations described based on time-series text through object images synthesized onto base images on land, it is possible to closely understand the progression of events over time.

[0031] In addition, even if the number of CCTV cameras installed on board increases, transmission via satellite communication using lightweight text data is possible, so it is expected to be effectively utilized for land-based control of Mass Assured Ships (MASS), which require an increased number of cameras. Brief explanation of the drawing

[0032] FIG. 1 is a schematic diagram showing a ship land control system according to an embodiment of the present invention. FIG. 2 illustrates a method for detecting objects and event situations in a surveillance image according to an embodiment of the present invention. FIG. 3 shows an example of text data generation by a data generation module according to an embodiment of the present invention. FIG. 4 illustrates a method for generating surveillance images based on text data according to an embodiment of the present invention. FIG. 5 illustrates a ship monitoring video display method according to an embodiment of the present invention. FIG. 6 is a flowchart schematically illustrating a control method between a ship and land according to an embodiment of the present invention. Specific details for implementing the invention

[0033] Embodiments of the present invention are described below with reference to the attached drawings so that those skilled in the art can easily implement them. However, the present invention may be embodied in various different forms and is not limited to the embodiments described herein. Furthermore, in order to clearly explain the present invention in the drawings, parts unrelated to the explanation have been omitted, and similar parts throughout the specification are denoted by similar reference numerals.

[0034] Throughout the specification, when a part is described as "comprising" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components. Furthermore, terms such as "…part," "…unit," and "module" as used in the specification refer to a unit that processes at least one function or operation, and this may be implemented in hardware, software, or a combination of hardware and software.

[0035] Throughout the specification, terms such as first, second, A, B, etc. may be used to describe various components, but said components should not be limited by said terms. For the sole purpose of distinguishing one component from another, for example, without departing from the scope of rights according to the concept of the present invention, the first component may be named the second component, and similarly, the second component may be named the first component.

[0036] Throughout the specification, when it is stated that one component is 'connected' or 'joined' to another component, it should be understood that it may be directly connected to or joined to the other component, or that there may be other components in between. Conversely, when it is stated that one component is 'directly connected' or 'directly joined' to another component, it should be understood that there are no other components in between.

[0037] Throughout the specification, the terms used are merely for describing specific embodiments and are not intended to limit the invention. Singular expressions include plural expressions unless the context clearly indicates otherwise.

[0038] Throughout the specification, terms related to 'comprising,' 'having,' etc., are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0039] Unless otherwise defined in this specification, all terms used herein, including technical or scientific terms, have the same meaning as generally understood by those skilled in the art to which the present invention pertains. Terms such as those defined in commonly used dictionaries should be interpreted as consistent with their meaning in the context of the relevant technology and should not be interpreted in an ideal or overly formal sense unless explicitly defined in this specification.

[0040] Now, a ship land control system and a method according to an embodiment of the present invention will be described in detail with reference to the drawings.

[0041] FIG. 1 is a schematic diagram showing a ship land control system according to an embodiment of the present invention.

[0042] Referring to FIG. 1, a ship land control system according to an embodiment of the present invention includes a ship monitoring server (100) mounted on a remote ship and a land control server (200) connected to the ship monitoring server (100) via satellite communication to monitor the operational status of the ship.

[0043] The above vessel may be a large-scale ocean-going vessel such as an LNG (Liquefied Natural Gas) carrier, an oil tanker, a container ship, or a bulk carrier.

[0044] The ship monitoring server (100) is installed on the ship and analyzes the surveillance video captured by the CCTV camera (10), describes the detected objects and event situations as text data, and then transmits it via satellite communication.

[0045] The ground control server (200) analyzes text data received via the satellite communication and displays a surveillance video by synthesizing an object image corresponding to the event situation onto the basic image of the CCTV camera (10).

[0046] The ship monitoring server (100) includes an image collection module (110), an image analysis module (120), a data generation module (130), a control module (140), and a satellite communication antenna (150).

[0047] The video collection module (110) collects surveillance images captured in real time from multiple CCTV cameras (10) installed in each area within the ship. The cameras (10) are installed in various areas within the ship, such as passageways, cabins, pipes, engines, cargo holds, distribution boards, and decks, and are connected to the video collection module (110) through camera IDs (10-1, 10-2, 10-3, …, 10-n) capable of wired / wireless communication.

[0048] Accordingly, the video collection module (110) can extract camera IDs (10-1, 10-2, 10-3, …, 10-n) from the captured surveillance video to identify cameras installed at specific locations and distinguish the installed locations (zones) and transmit them to the video analysis module (120).

[0049] The video analysis module (120) analyzes the received surveillance video using a deep learning-based video recognition algorithm to determine whether an object added to the default image or an event situation has occurred through the recognition of said object. Here, the default image refers to a video that is always fixedly captured at the location where each camera (10) is installed, and may also be referred to as a background image to aid in understanding the invention.

[0050] The video analysis module (120) can identify various event situations such as fire, smoke, leakage, explosion, intrusion, intrusion into restricted areas, external attack (pirate), crew member collapse, safety accident, failure to wear helmet / life jacket safety equipment, etc. through the recognition of the object.

[0051] For example, FIG. 2 illustrates a method for detecting objects and event situations in a surveillance image according to an embodiment of the present invention.

[0052] First, referring to FIG. 2(A), a first surveillance image (Cam 1) captured by a first camera (10-1) installed in a specific passageway inside a ship according to an embodiment of the present invention is shown. The first surveillance image (Cam 1) always captures a fixed basic image in which a safe guide line is marked on the floor of the passageway and multiple pipes of different shapes are arranged on the walls on both sides.

[0053] The video analysis module (120) can analyze a first surveillance video (Cam 1) extracted once per set of time (e.g., 1 second) to recognize at least one object added to the basic image, and can identify an event situation that can be estimated through the analysis of singularities of the recognized objects.

[0054] For example, referring to FIG. 2(B), the image analysis module (120) can analyze the first surveillance image (Cam 1) to recognize smoke added to the basic image as the first object and recognize a person as the second object.

[0055] At this time, the video analysis module (120) can determine the coordinates and size of the smoke generated through the analysis of the singularity of the first object, and determine the coordinates and collapse status of a registered specific crew member through the analysis of the singularity of the second object.

[0056] And, the video analysis module (120) can estimate an event situation in which a specific sailor has collapsed due to smoke generated from a specific pipe in the area where the first camera (10-1) is installed by synthesizing the information identified through the singularity analysis. The specific pipe and the specific sailor can be identified through information learned in advance through a deep learning-based video recognition algorithm.

[0057] However, when the video analysis module (120) detects a routine image of a sailor passing through a passageway in the basic image of the first surveillance video (Cam 1), it can recognize that the person is a specific sailor through the face of the person added to the basic image, but if there is no singularity, it does not determine it as an event situation. That is, in the embodiment of the present invention, the object detection may be a situation where only an object is detected without any singularity event, and the event situation can be defined as a situation where a singularity such as fire, smoke, leakage, explosion, or safety accident within the ship is recognized due to object detection. Therefore, object detection does not necessarily include an event situation, but the event situation may necessarily include object detection information that is the cause.

[0058] The image analysis module (120) can match and store the basic image with the area installed for each camera ID (10-1, 10-2, 10-3, …, 10-n) to identify the object recognition and event situation, and transmit it to the land control server (200) in advance to synchronize the data required for ship control on land.

[0059] The data generation module (130) generates lightweight text data describing the object and event situation in the basic image based on information identified by the image analysis module (120).

[0060] FIG. 3 shows an example of text data generation by a data generation module according to an embodiment of the present invention.

[0061] Referring to FIG. 3, the data generation module (130) according to an embodiment of the present invention can generate lightweight text data by inputting objects and event situations identified in surveillance images of each camera (10) into a table list at regular intervals.

[0062] For example, assuming that 16 CCTV cameras (10-1, 10-2, 10-3, …, 10-16) are installed on a vessel according to one embodiment, the data generation module (130) can generate text data detected in the first surveillance video (Cam 1) to the 16th surveillance video (Cam 16) once per second. The text data may include at least one of whether an object is detected, the type and size / coordinates (pixel-based) of the object, whether an event occurs, and the type of the event for each camera (surveillance video) per set time (1 second).

[0063] In addition, the data generation module (130) can generate text data that is lightweight, approximately 15 to 20 kb, by creating a text-based CSV (Comma-Separated Values) file of objects and event situations identified in the surveillance video of each camera (10) at regular intervals.

[0064] The control module (140) is a central processing system that controls the overall operation of each module configured in the ship monitoring server (100) according to an embodiment of the present invention.

[0065] The control module (140) accumulates and stores text data generated by the data generation module (130), bundles the text data accumulated over a set period into time-series data, and transmits it to the ground control server (200) via the satellite communication antenna (150).

[0066] For example, the control module (140) can process the text data into ship monitoring data including sending information at the time when the text data is accumulated for 1 minute, transmit it via satellite communication, and store the backup data in memory.

[0067] Meanwhile, the land control server (200) includes a database (DB) (210), a communication unit (220), a data analysis unit (230), a control unit (240), and a display unit (250).

[0068] The database (DB) (240) stores various programs and data required for the operation of the land control server (200) according to the embodiment of the present invention, and stores data generated according to the operation.

[0069] DB (210) stores information on the vessels under management and stores the basic images (i.e., background images) matched for each camera ID (10-1, 10-2, 10-3, …, 10-n) installed on the vessels.

[0070] Additionally, DB (210) can store sample object images that can depict various objects and / or event situations.

[0071] The communication unit (220) transmits ship monitoring data received from the ship monitoring server (100) via a satellite communication antenna (221) to the data analysis unit (230). The communication unit (220) may include a satellite communication means for transmitting and receiving data for the control of various ships in transit and various wireless communication means capable of communicating in the near sea.

[0072] The data analysis unit (230) performs data parsing based on the text data contained in the ship monitoring data to determine whether an object is detected and whether an event situation occurs for each camera ID (10-2, 10-3, …, 10-16) installed on the ship.

[0073] Specifically, the data analysis unit (230) identifies the vessel corresponding to the transmission information of the vessel monitoring data and the camera ID installed in the vessel, and determines whether object detection or event situation occurs in the monitoring video for each camera ID.

[0074] At this time, the data analysis unit (230) can identify the described event situation based on at least one of the number, type, size, coordinates, and event type of the object through parsing the text data recorded in the camera ID where the object detection or event situation occurred. For example, the data analysis unit (230) can recognize various object and event situations such as fire, smoke, leakage, explosion, intrusion, intrusion into a restricted area, external attack (pirate), SOS distress signal, crew member collapse, failure to wear a helmet / life jacket safety gear, etc., based on parsing, and transmit them to the control unit (240).

[0075] The control unit (240) is a central processing unit that controls the overall operation of the land control server (200) according to an embodiment of the present invention.

[0076] The control unit (240) can store the ship monitoring data received from the communication unit (220) in the DB (210) and analyze it through the data analysis unit (230).

[0077] The control unit (240) retrieves a basic image matched to the camera ID from the DB (210), synthesizes an object image corresponding to the identified event situation, and displays the depicted surveillance video through the display unit (250).

[0078] At this time, the control unit (240) recognizes the object image, coordinates, and size described through data parsing of the text data, and can synthesize the object image by adjusting it to the pixel-based coordinates and size of the corresponding base image.

[0079] For example, FIG. 4 illustrates a method for generating surveillance images based on text data according to an embodiment of the present invention.

[0080] FIG. 5 illustrates a ship monitoring video display method according to an embodiment of the present invention.

[0081] Referring to FIGS. 4 and 5, a control unit (240) according to an embodiment of the present invention analyzes text data corresponding to the first camera (10-1) to recognize an event situation including the type, coordinates, and size of an object.

[0082] Below, it can be assumed that the control unit (240) recognizes an event situation in which a smoke object having specific coordinates and size is detected.

[0083] The control unit (240) can generate a surveillance video depicting an actual event situation by loading an object image corresponding to the smoke against a background of a basic image corresponding to the first camera (10-1), adjusting the size of the object image, and compositing it at a designated coordinate.

[0084] The control unit (240) can update the display unit (250) by playing the surveillance video at 1-second intervals according to the accumulated time of the text data through the GUI (Graphical User Interface) (241). Thus, surveillance video at 1-second frame intervals can be played based on lightweight text data.

[0085] In the same way as above, the control unit (240) can display each depicted surveillance video based on text data recorded in a time series for each camera ID (cam 1, 10-2, 10-3, …, 10-16) installed on the vessel.

[0086] In addition, the control unit (240) can display a ship CCTV control video that divides and arranges the entire surveillance video corresponding to the camera ID installed on the ship into one screen.

[0087] Additionally, the control unit (240) can enlarge and display one surveillance video selected through the GUI (241) from the ship CCTV monitoring video.

[0088] Additionally, the control unit (240) can continuously display multiple ship monitoring data received at intervals of a set time (e.g., 1 minute) through the GUI (241). The GUI (241) can support playback, rewind, loop playback, and playback speed control functions for the monitoring video.

[0089] Meanwhile, based on the configuration of the aforementioned ship land control system, a ship land control method according to an embodiment of the present invention will be described.

[0090] FIG. 6 is a flowchart schematically illustrating a control method between a ship and land according to an embodiment of the present invention.

[0091] Referring to FIG. 6, according to an embodiment of the present invention, a ship monitoring server (100) mounted on a ship can collect monitoring images from a plurality of CCTV cameras (10) installed in each zone within the ship (S10). For example, the ship monitoring server (100) can collect a number of monitoring images (Cam 1 to Cam 16) corresponding to camera IDs (10-1 to 10-16).

[0092] The ship monitoring server (100) can determine whether an event situation has occurred by analyzing the collected monitoring images (Cam 1 to Cam 16) and detecting or recognizing objects added to the basic image (S20).

[0093] At this time, if no object detection or event situation occurs among the above surveillance images (Cam 1 to Cam 16) (S30; No), the ship surveillance server (100) determines that there are no anomalies and can continuously collect surveillance images (S10).

[0094] On the other hand, if the ship monitoring server (100) determines that an object detection or event situation has occurred in at least one of the monitoring videos (Cam 1 to Cam 16) (S30; e.g.), it can generate text data describing the object or event situation added to the basic image of the monitoring video (S40). The ship monitoring server (100) can generate text data about the detected object and event situation by analyzing the monitoring video extracted once per second.

[0095] The ship monitoring server (100) accumulates and stores the generated text data and checks whether it has accumulated for a set time (e.g., 1 minute) (S50).

[0096] At this time, if the ship monitoring server (100) is not in a state where the text data has not been accumulated during the set time (S50; No), it can continue to accumulate the time-series text data generated per second (S10).

[0097] On the other hand, when the text data is accumulated for the set time (e.g., 1 minute) (S50; e.g.), the ship monitoring server (100) generates ship monitoring data including transmission information by combining the accumulated text data into time-series data (S60). Then, the ship monitoring server (100) can transmit the ship monitoring data to the land control server (200) via satellite communication (S70).

[0098] Meanwhile, when the land control server (200) receives the ship monitoring data through the satellite communication, it can identify the ship corresponding to the transmitting information and the camera ID installed in the ship (S80).

[0099] The land control server (200) performs data parsing based on the text data contained in the ship monitoring data (S90) to check whether an object is detected or whether an event situation occurs for each camera ID (10-1 to 10-16) installed on the ship (S100).

[0100] At this time, if the above object detection and event situation does not occur, the ground control server (200) can display a pre-stored default image corresponding to the camera ID as a surveillance image (S120).

[0101] On the other hand, if the ground control server (200) has a camera ID where the object detection or event situation occurred (S100; yes), it can generate a described surveillance image by synthesizing an object image corresponding to the object detection or event situation onto a base image corresponding to the camera ID where the object detection or event situation occurred (S110). At this time, the ground control server (200) can synthesize by adjusting the coordinates and size of the object image based on the text data of the camera ID.

[0102] The ground control server (200) can display the surveillance video described above (S120).

[0103] In this way, according to an embodiment of the present invention, by describing an event situation detected in CCTV camera footage on a ship as lightweight text data and transmitting it via satellite communication, and by displaying a surveillance video describing the object and the event situation through analysis of the text data received from a land-based control server, there is an effect that ship control is possible using inexpensive satellite communication.

[0104] In addition, by analyzing surveillance footage from a ship and implementing object and event situations described based on time-series text through object images synthesized onto base images on land, it is possible to closely understand the progression of events over time.

[0105] In addition, even if the number of CCTV cameras installed on board increases, transmission via satellite communication using lightweight text data is possible, so it is expected to be effectively utilized for land-based control of Mass Assured Ships (MASS), which require an increased number of cameras.

[0106] The embodiments of the present invention are not limited to being implemented only through the apparatus and / or methods described above, but may also be implemented through a program for realizing a function corresponding to the configuration of the embodiments of the present invention, a recording medium on which the program is recorded, etc., and such implementation can be easily achieved by a person skilled in the art to which the present invention pertains from the description of the embodiments described above.

[0107] Although embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements by those skilled in the art using the basic concept of the present invention as defined in the following claims also fall within the scope of the present invention. Explanation of the symbols

[0108] 100: Ship monitoring server 10: CCTV camera 10-1, 10-2, … (1st camera, 2nd camera, …) Com 1, Com2, … (1st surveillance video, 2nd surveillance video, …) 110: Image acquisition module 120: Video Analysis Module 130: Data Generation Module 140: Control Module 150: Satellite communication antenna 200: Ground Control Server 210: Database (DB) 220: Communications Department 221: Satellite communication antenna 230: Data Analysis Department 240: Control unit 241: GUI 250: Display unit

Claims

Claim 1 A ship land control system comprising: a ship monitoring server mounted on a ship that analyzes surveillance video captured by a CCTV (Closed Circuit Television) camera to describe detected objects and event situations as text data and transmits it via satellite communication; and a land control server that analyzes the text data received via satellite communication to composite an object image corresponding to the event situation onto a base image of the CCTV camera and displays the described surveillance video, wherein the ship monitoring server comprises: a video collection module that collects surveillance video captured in real time from a plurality of CCTV cameras installed in each zone within the ship; a video analysis module that analyzes the captured surveillance video through a deep learning-based image recognition algorithm to determine whether an event situation has occurred by recognizing an object added to the base image or an object; a data generation module that generates lightweight text data describing the object or event situation on the base image based on information identified by the video analysis module; and a control module that bundles the text data accumulated over a set period into time-series data and transmits it to the land control server via a satellite communication antenna. Claim 2 delete Claim 3 In claim 1, the image collection module is a ship land control system that extracts a camera ID from the captured surveillance image to identify the CCTV camera, distinguishes the installation location, and transmits it to the image analysis module. Claim 4 In claim 1, the image analysis module is a ship land control system that analyzes the surveillance image extracted once per set of time to identify event situations that can be estimated through the analysis of singularities of recognized objects. Claim 5 In claim 1, the image analysis module is a ship shore control system that identifies at least one event situation among fire, smoke, leakage, explosion, intrusion, intrusion into a restricted area, external attack, crew member collapse, safety accident, and failure to wear safety equipment within the ship through the recognition of the object. Claim 6 In claim 1, the data generation module generates lightweight text data by inputting objects and event situations identified in the surveillance images for each camera into a table list at regular intervals. Claim 7 In claim 1, the control module processes the text data into ship monitoring data including sending information at the time when the text data is accumulated for 1 minute and transmits it via the satellite communication, thereby forming a ship land control system. Claim 8 A ship land control system according to claim 1, wherein the land control server comprises: a database (DB) that stores basic images matched by camera IDs installed on ships under management; a communication unit that receives ship monitoring data from the ship monitoring server via satellite communication; a data analysis unit that performs data parsing based on the text data contained in the ship monitoring data to determine whether an object is detected and whether an event situation occurs for each camera ID installed on the ship; and a control unit that retrieves basic images matched to camera IDs from the DB, synthesizes object images corresponding to the identified event situations, and displays the described monitoring video through a display unit. Claim 9 In claim 8, the above DB is a ship shore control system that stores sample object images capable of depicting various objects and event situations on the above base image. Claim 10 In claim 8, the data analysis unit recognizes the described object image, coordinates, and size through syntactic analysis of text data recorded in the camera ID, and synthesizes the object image by adjusting it to the pixel-based coordinates and size of the corresponding base image. This is a ship land control system. Claim 11 In claim 8, the control unit is a ship land control system that updates the display unit by playing a surveillance image at the accumulated time interval of the text data through a GUI (Graphical User Interface). Claim 12 In claim 11, the control unit is a ship land control system that displays a ship CCTV control video by dividing and arranging the entire surveillance video corresponding to the camera ID installed on the ship into one screen, or displays an enlarged version of a surveillance video selected through the GUI among the ship CCTV control videos. Claim 13 In claim 11, the control unit is a ship shore control system that continuously displays a plurality of ship monitoring data received through the GUI at a interval of one minute. Claim 14 A ship land control method comprising: a step in which a ship monitoring server installed on a ship analyzes surveillance footage captured by a CCTV (Closed Circuit Television) camera to describe detected objects and event situations as text data and transmits it to land via satellite communication; and a step in which a land control server analyzes the text data received via satellite communication and displays the described surveillance footage by synthesizing an object image corresponding to the event situation onto a base image of the CCTV camera; wherein the step of transmitting to land comprises: a step of collecting surveillance footage from a plurality of CCTV cameras installed in each zone within the ship; a step of analyzing the surveillance footage to determine whether an object added to the base image or an event situation has occurred; and a step of generating text data describing the added object or event situation when it is determined that the object detection or event situation has occurred. Claim 15 delete Claim 16 A ship land control method according to claim 14, wherein the step of generating the text data comprises the step of generating the text data regarding a detected object or event situation by analyzing the surveillance image extracted once per second. Claim 17 A ship land control method according to claim 14, wherein the step of transmitting to land further comprises: a step of accumulating and storing the text data and checking whether it has been accumulated for a set time; a step of generating the ship monitoring data including sending information by bundling the accumulated text data into time-series data when the text data has been accumulated for the set time; and a step of transmitting the ship monitoring data to the land control server. Claim 18 A ship land control method according to claim 14, wherein the step of displaying the surveillance video comprises: a step of identifying a ship corresponding to the transmission information of the text data and a camera ID installed within the ship; a step of performing syntactic analysis based on the text data to determine whether object detection or an event situation has occurred for each camera ID installed on the ship; and a step of generating the described surveillance video by synthesizing an object image corresponding to the object detection and event situation with a base image corresponding to the camera ID where the camera ID where the object detection or event situation occurred exists. Claim 19 In claim 18, the step of generating the surveillance image described above comprises a method for ship land control that includes the step of synthesizing by adjusting the coordinates and size of an object image based on text data of the camera ID. Claim 20 A ship shore control method according to claim 18, further comprising the step of displaying a pre-stored default image corresponding to the camera ID as a surveillance image if, after the step of checking whether object detection or event situation occurs for each camera ID, the object detection and event situation do not occur.

Images