A ship's omnidirectional surveillance camera system for the prevention of safety accidents on ships

KR103018742B1Active Publication Date: 2026-09-11ILJIN CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
KR1020230146729
Authority / Receiving Office
KR · KR
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-10-30
Publication Date
2026-09-11
Estimated Expiration
2043-10-30

Smart Images

  • Figure 112023119266554-PAT00001_ABST
    Figure 112023119266554-PAT00001_ABST
Patent Text Reader

Abstract

The present invention relates to a ship omnidirectional surveillance camera system for preventing safety accidents on a ship, which can prevent collision accidents by displaying the surrounding 360° situation of the ship in real time. The omnidirectional surveillance camera system installed on the ship comprises: a camera unit installed in a plurality of units on the ship; an image input unit that receives images from the plurality of cameras; a coordinate storage unit that stores a plurality of lookup tables composed of records in which color expression information or coordinate information of the images is recorded in units of image output pixels; an image processing unit that synthesizes images by considering at least one of the stored lookup tables; a coordinate estimation unit that calculates a new lookup table by interpolating data from at least two of the plurality of lookup tables according to weights, wherein the interpolation calculation is performed by changing the interpolation value for each frame; and a radar unit installed in a plurality on the side of the ship and measuring the distance between the side of the ship and surrounding objects.
Need to check novelty before this filing date? Find Prior Art

Description

Technology Field

[0001] The present invention relates to a ship omnidirectional surveillance camera system for preventing safety accidents on a ship, and more specifically, to a ship omnidirectional surveillance camera system for preventing safety accidents on a ship that can prevent collision accidents in advance by displaying the 360° surrounding situation of the ship in real time. Background Technology

[0003] Generally, in situations where there is a risk of collision, such as when a ship passes through a canal or docks / undocking, an observer moves on the bridge and observes visually.

[0004] However, due to the ship's structural design, there are blind spots that are difficult for observers to monitor from the bridge. Since it is difficult to observe collision risks in these blind spots and for an observer to grasp the risk at a glance, there is a high risk of collision accidents.

[0005] In addition, although the surrounding environment is observed by cameras installed on the vessel, there are limitations in that the camera's shooting point is fixed, making it impossible to observe specific points far from the observation point in detail, difficult to identify large obstacles, and difficult to observe a wide area at a glance.

[0006] In addition, situations may arise where it is difficult to accurately predict collision risks because it is difficult to visually identify surrounding obstacles during nighttime or adverse weather conditions, it is difficult to match the obstacle information displayed on AIS and radar with the actual environment, and navigation information is scattered across multiple ICMS, AMS, electronic charts, GPS, and radar, making it difficult to grasp at a glance. Prior art literature

[0008] Republic of Korea Published Patent Application No. 10-2021-0054708 The problem to be solved

[0009] The present invention has been devised to solve the aforementioned problems, and the objective of the present invention is to provide a ship omnidirectional surveillance camera system for preventing safety accidents on a ship, which can freely adjust the viewpoint position, viewpoint direction, magnification ratio, and field of view in real time.

[0011] The objectives of the present invention are not limited to those mentioned above, and other unmentioned objectives will be clearly understood by those skilled in the art from the description below. means of solving the problem

[0013] To achieve the above objective, the present invention comprises an omnidirectional surveillance camera system installed on a ship, the system comprising: a camera unit installed in a plurality of units on the ship; an image input unit that receives images from the plurality of cameras; a coordinate storage unit that stores a plurality of lookup tables composed of records in which color expression information or coordinate information of the images is recorded in units of image output pixels; an image processing unit that synthesizes images by considering at least one of the stored lookup tables; a coordinate estimation unit that calculates a new lookup table by interpolating data from at least two of the plurality of lookup tables according to weights, wherein the interpolation calculation is performed by changing the interpolation value for each frame; and a radar unit installed in a plurality on the side of the ship and measuring the distance between the side of the ship and surrounding objects.

[0014] In addition, it is characterized by further including an analysis unit that analyzes images or photos measured by the camera unit to determine the type of obstacle around the vessel.

[0015] In addition, it is characterized by further including an integrated control unit that measures the inclination from the bow to the stern of the vessel through the distance to surrounding objects measured by a plurality of radar units, and corrects the magnification of the image measured according to the position of the plurality of camera units through the measured inclination. Effects of the invention

[0017] The present invention provides an effect that contributes to driving convenience by providing a seamless screen when switching between ship operation screens.

[0018] In addition, the coordinate estimation unit provides the effect of being able to use a new lookup table output by calculating interpolation with weights on multiple stored lookup tables for image synthesis. Brief explanation of the drawing

[0020] FIG. 1 is a configuration diagram showing a ship omnidirectional surveillance camera system for preventing safety accidents on a ship according to a preferred embodiment of the present invention. FIGS. 2 and FIGS. 3 are exemplary diagrams showing the state of applying a ship omnidirectional surveillance camera system for preventing safety accidents on a ship according to a preferred embodiment of the invention. Specific details for implementing the invention

[0021] The advantages and features of the present invention and the methods for achieving them will become clear by referring to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below but may be implemented in various different forms. These embodiments are provided merely to ensure that the disclosure of the present invention is complete and to fully inform those skilled in the art of the scope of the invention, and the present invention is defined only by the scope of the claims.

[0022] Specific details for implementing the present invention will be described in detail with reference to the drawings attached below. Regardless of the drawings, identical reference numerals refer to identical components, and "and / or" includes each of the mentioned items and all combinations of one or more.

[0023] Although terms such as "first," "second," etc., are used to describe various components, it goes without saying that these components are not limited by these terms. These terms are used merely to distinguish one component from another. Therefore, it goes without saying that the first component mentioned below may be the second component within the technical scope of the present invention.

[0024] The terms used herein are for describing the embodiments and are not intended to limit the invention. In this specification, the singular form includes the plural form unless specifically stated otherwise in the text. As used herein, "comprises" and / or "comprising" do not exclude the presence or addition of one or more other components in addition to the components mentioned.

[0025] Unless otherwise defined, all terms used in this specification (including technical and scientific terms) may be used in a meaning that is commonly understood by those skilled in the art to which the present invention pertains. Additionally, terms defined in commonly used dictionaries are not to be interpreted ideally or excessively unless explicitly and specifically defined otherwise.

[0026] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the attached drawings.

[0028] FIG. 1 is a configuration diagram showing a ship omnidirectional surveillance camera system for preventing safety accidents on a ship according to a preferred embodiment of the present invention, and FIG. 2 and FIG. 3 are example diagrams showing the state of applying a ship omnidirectional surveillance camera system for preventing safety accidents on a ship according to a preferred embodiment of the invention.

[0030] As illustrated in FIGS. 1 to 3, the ship omnidirectional surveillance camera system (1000) for preventing safety accidents of a ship according to the present invention comprises a camera unit (100), an image input unit (200), a coordinate storage unit (300), a coordinate estimation unit (400), an image processing unit (500), a radar unit (600), an analysis unit (700), a control unit (800), and a monitor unit (900).

[0031] First, the camera unit (100) outputs at least one of a ship's front image, a ship's rear image, and a ship's side image.

[0032] Next, the image input unit (200) receives images from a plurality of camera units (100). The image input unit (200) obtains color representation information or image coordinate information in units of image output pixels of the received images. The image input unit (200) outputs the coordinate information to the coordinate storage unit (300).

[0033] The above coordinate storage unit (300) stores a plurality of lookup tables composed of records in which color expression information or image coordinate information is recorded in units of image output pixels.

[0034] At this time, the coordinate storage unit (300) stores a lookup table (luta) composed of records in which coordinate information of the screen currently set by the driver is recorded, and a lookup table (lutb) composed of records in which coordinate information of the screen to be selected by the driver is recorded.

[0035] And the coordinate estimation unit (400) calculates a new lookup table (lutc) by calculating interpolation with weights for the data of at least two of the multiple lookup tables (luta, lutb).

[0036] That is, the coordinate estimation unit (400) gradually changes the weights of the current screen and the selected screen to prevent discontinuous switching from the current screen to the selected screen when the driver selects a screen switch.

[0037] In addition, the coordinate estimation unit (400) calculates interpolation by changing the value of interpolation for each frame.

[0038] Here, the coordinate estimation unit (400) calculates the coordinate information of the lookup table (lutc) of the intermediate transformed screen by giving a weight (α) to the coordinate information of the lookup table (luta) of the current screen in a preset algorithm and giving a weight (1-α) to the coordinate information of the lookup table (lutb) of the transformed selected screen.

[0039] And the coordinate estimation unit (400) changes the interpolation value by decreasing a constant value at set unit times.

[0040] According to one embodiment, the coordinate estimation unit (400) decreases the weight (α) by 0.1 at each unit time set from 1.

[0041] Furthermore, the weights set in the coordinate estimation unit (400) can be changed according to the settings and are not limited to any specific value.

[0042] Next, the image processing unit (500) synthesizes an image by considering at least one of the stored lookup tables.

[0043] Here, the image processing unit (500) synthesizes an image by considering at least one of the considered lookup tables (luta, lutb) and the new lookup table (lutc).

[0044] The image processing unit (500) synthesizes the image by considering a new lookup table (lutc) in the middle of the lookup tables (luta, lutb) used for the interpolation calculation when converting the synthesized image.

[0045] The image processing unit (500) outputs the image synthesized by the new lookup table (lutc) to the monitor unit (900).

[0046] The above-mentioned monitor unit (900) outputs the received video to the screen. The monitor unit (900) may be an AVM (Around-View Monitoring) system screen or a HUD (Head-Up Display).

[0047] The operation of the image generation method in the ship omnidirectional surveillance camera system for preventing safety accidents on a ship according to the present invention, configured as described above, is as follows.

[0048] Next, the radar unit (600) is installed in multiple units on the side of the vessel and is configured to measure the distance between the side of the vessel and surrounding objects.

[0049] Here, it is preferable that the radar unit (600) be installed at the bow, center, and stern of the ship, respectively.

[0050] At this time, the radar unit (600) calculates the distance between the side of the ship and the obstacle, and the distance can be measured through a preset algorithm.

[0051] And, the analysis unit (700) analyzes the image or photo measured by the camera unit (100) to determine the type of obstacle around the ship.

[0052] Accordingly, the analysis unit (700) determines the type of obstacle and provides an alarm to the navigator (pilot) to prevent the vessel from colliding with or coming into contact with a port or another vessel, thereby enabling the navigator (pilot) to make a safe choice regarding the risk of a vessel accident.

[0053] Next, the integrated control unit (800) measures the inclination from the bow to the stern of the ship through the distance to surrounding objects measured by the plurality of radar units (600), and corrects the magnification of the image measured according to the position of the plurality of camera units (100) through the measured inclination.

[0054] That is, as illustrated in FIG. 3, the tilt of the ship is measured according to the difference in distance between the ship and the terminal while the ship is approaching the terminal, and the image magnification of the camera unit (100) installed at the bow and stern respectively is adjusted according to the tilt of the ship so that no error occurs in the image displayed on the monitor unit (900).

[0055] Next, the operation sequence of the ship omnidirectional surveillance camera system for preventing safety accidents on a ship according to the present invention will be explained.

[0056] The camera unit (100) outputs at least one of a ship's front image, a ship's rear image, and a ship's side image. The image input unit (200) receives images from a plurality of cameras (S100).

[0057] The coordinate storage unit (300) stores a plurality of lookup tables composed of records in which color expression information or coordinate information of an image is recorded in units of image output pixels (S110).

[0058] The coordinate storage unit (300) stores a lookup table (luta) composed of records in which coordinate information of the screen currently set by the driver is recorded, and a lookup table (lutb) composed of records in which coordinate information of the screen to be selected by the driver is recorded.

[0059] The coordinate estimation unit (400) calculates a new lookup table (lutc) by applying weights to the data of at least two of the multiple lookup tables and performing interpolation calculations (S120). The coordinate estimation unit (400) performs interpolation calculations by changing the interpolation value for each frame. The coordinate estimation unit (400) changes the interpolation value by decreasing a constant value at set unit times.

[0060] The coordinate estimation unit (400) gradually changes the weights of the current screen and the selected screen to prevent discontinuous changes from the current screen to the selected screen when the driver selects a screen switch. The coordinate estimation unit (400) calculates interpolation by changing the interpolation value for each frame.

[0061] Then, the distance measured by the radar unit (600) is displayed on the monitor unit (900), and the magnification of the camera unit (100) at each position is adjusted according to the tilt of the ship so that the navigator can check an accurate image of the ship in all directions.

[0063] Although embodiments of the present invention have been described above with reference to the attached drawings, those skilled in the art will understand that the present invention may be implemented in other specific forms without changing its technical concept or essential features. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. Explanation of the symbols

[0065] 100 : Camera section 200 : Video input section 300 : Coordinate storage unit 400 : Coordinate Estimation Unit 500 : Image processing unit 600: Radar section 700 : Analysis Department 800: Integrated Control Unit 900 : Monitor section

Claims

Claim 1 In an all-around surveillance camera system installed on a vessel, the system comprises: a plurality of camera units installed on the vessel; an image input unit that receives images from the plurality of cameras; a coordinate storage unit that stores a plurality of lookup tables, each consisting of records in which color representation information or coordinate information of the image is recorded in units of image output pixels; an image processing unit that synthesizes an image by considering at least one of the stored lookup tables; a coordinate estimation unit that calculates a new lookup table by interpolating data from at least two of the plurality of lookup tables according to a weight (α), wherein the interpolation value is varied for each frame to prevent discontinuous switching from the current screen to the selected screen when an operator selects a screen switch; a radar unit that is installed in a plurality on the side of the vessel and measures the distance between the side of the vessel and surrounding objects; and an analysis unit that analyzes images or photos measured by the camera unit to determine the type of obstacle around the vessel. A ship omnidirectional surveillance camera system for preventing safety accidents on a ship, further comprising: an integrated control unit that measures the inclination from the bow to the stern of the ship through the distance to surrounding objects measured by a plurality of radar units, and corrects the magnification of the image measured according to the position of the plurality of camera units through the measured inclination. Claim 2 delete Claim 3 delete

Citation Information

Patent Citations

  • Ship context awareness system

    KR1020140118631A

  • Support system for vessel operation and ship having the same

    KR1020210136804A