METHOD AND DEVICE FOR CORRECTING IMAGE SENSOR MISLAISON USING SHIP IDENTIFICATION INFORMATION

Description

TECHNICAL FIELD

[0001] The present disclosure relates to a method and device for correcting image sensor misalignment that may support correction of mounting misalignment of an image sensor mounted on an artificial satellite based on ship identification information acquired from an automatic identification system (AIS).BACKGROUND ART

[0002] JINHAI CHEN ET AL, "Tracking a Vessel by Combining Video and AIS Reports", FUTURE GENERATION COMMUNICATION AND NETWORKING, 2008. FGCN '08. SECOND INTERNATIONAL CONFERENCE ON, IEEE, PISCATAWAY, NJ, USA, (20081213), ISBN 978-0-7695-3431-2, pages 374 - 378, relates to a tracking of a vessel using a video camera and AIS signals.

[0003] YAO LIBO ET AL, "A Novel Ship-Tracking Method for GF-4 Satellite Sequential Images", SENSORS, (20180622), vol. 18, no. 7, doi:10.3390 / s18072007, page 2007, relates to a dynamic correction using a RPC and AIS data of ships.

[0004] JP2015036832A relates to a data complementary device filtering abnormality and partial missing at manual inputting in AIS data by an operator, as assisting information for complementing abnormality or missing of AIS data. Then the data complementary device acquires AIS data at two points before and after imaging time of a satellite image, estimates position of a ship at the imaging time, decides maximum search distance, and calculates a score by using four references such as length, so that the ship on the satellite image and the AIS data are subjected to a mapping process. The data complementary device extracts correct data, and the AIS data having abnormality and partial missing and a ship image having no correspondence relation after the mapping process are subjected to mapping again, to complementing as abnormal data. By using attribute information of the ship image having no correspondence relation, complementing is performed as missing data.

[0005] CN104535066A concerns a marine target and electronic chart superposition method and a marine target and electronic chart superposition system in an on-board infrared video image. The method comprises the following steps: 1, acquiring and reading the on-board infrared video image; 2, segmenting a marine target in the on-board infrared video image, and positioning the marine target to acquire the position of the marine target relative to the ship; 3, calculating the corresponding geographical coordinates of the marine target according to the ship position of the ship, the real-time course of the ship, the orientation of an infrared thermal imager and the result of the step 2; 4, correcting the target position which corresponds to the marine target by utilizing corresponding AIS data; and 5, superposing the corrected marine target into an electronic chart so as to be displayed in a transparent mode.

[0006] An image sensor mounted on a satellite refers to equipment that generates an image by capturing a target on the ground.

[0007] Such an image sensor may deviate from a point and an angle at which the image sensor is initially installed due to its flow during a launch process of putting a satellite into an orbit or an orbital movement process in which the satellite moves along the orbit, which may lead to misalignment in a viewing direction.

[0008] In a related art, misalignment of an image sensor is corrected by capturing and recognizing a reference target on the ground.

[0009] FIG. 1 is a diagram illustrating a misalignment correction procedure for an image sensor according to a related art.

[0010] In the related art, an observation data calculation module of a satellite acquires an image representing a ground reference target through an image sensor 110 in operation 120. For example, an image sensor mounted on an optical artificial satellite may capture a plurality of ground control points (GCPs) as ground reference targets, and an image sensor mounted on an artificial satellite with an image radar (for example, a synthetic aperture radar (SAR)) may capture a plurality of radar reflectors as ground reference targets.

[0011] Also, the observation data calculation module calculates reference target coordinates from the acquired image in operation 130.

[0012] A reference data acquisition module of the satellite acquires precise geographic coordinates corresponding to the reference target coordinates from a database (DB) 140.

[0013] Subsequently, a mounting misalignment value of the image sensor is calculated by applying the reference target coordinates and the precise geographic coordinates to a filter algorithm in operation 160. Here, the filter algorithm may include, for example, a least-square algorithm, a TRIAD algorithm, a QUEST algorithm, a Kalman filter algorithm, a batch filter algorithm, and the like.

[0014] Also, the satellite corrects a mounting angle of the image sensor using the calculated mounting misalignment value in operation 170, thereby completing correction of misalignment of the image sensor.

[0015] The above correction of misalignment of the image sensor according to the related art has a limitation with respect to reference targets installed on the existing ground. For example, due to only about "400" optical artificial satellites in Korea, accessibility is limited. In addition, since there are about "50" artificial satellites with image radars in other countries, and since a vast installation area is required due to characteristics of a radar reflector that is to be captured, accessibility is also limited.

[0016] In other words, the correction of the misalignment according to the related art has an issue of extremely increasing the installation and maintenance cost to establish more reference targets on the ground.

[0017] Therefore, there is a demand to overcome a limitation of reference targets on the ground using an automatic identification system (AIS).DISCLOSURE OF INVENTIONTECHNICAL SUBJECT

[0018] Example embodiments of the present disclosure provide a method and device for correcting image sensor misalignment that may process correction of misalignment of an image sensor mounted on a satellite at relatively low cost using an automatic identification system (AIS) that continues to transmit a position of a ship.

[0019] Also, example embodiments of the present disclosure provide a method and device for correcting image sensor misalignment that may accurately calculate a mounting misalignment value of an image sensor using a position difference between image-based ship coordinates and AIS-based ship coordinates after performing time synchronization of the image-based ship coordinates and the AIS-based ship coordinates.TECHNICAL SOLUTION

[0020] According to an aspect of the present disclosure, there is provided a method of correcting image sensor misalignment according to claim 1. The dependent claims set out particular embodiments of the invention.

[0021] According to another aspect of the present disclosure, there is provided a device for correcting image sensor according to claim 4.. The dependent claims set out particular embodiments of the invention.EFFECT OF THE INVENTION

[0022] According to example embodiments of the present disclosure, a method and device for correcting image sensor misalignment that may process correction of misalignment of an image sensor mounted on a satellite at relatively low cost using an automatic identification system (AIS) that continues to transmit a position of a ship may be provided.

[0023] Also, according to example embodiments of the present disclosure, it is possible to accurately calculate a mounting misalignment value of an image sensor using a position difference between image-based ship coordinates and AIS-based ship coordinates after performing time synchronization of the image-based ship coordinates and the AIS-based ship coordinates.

[0024] Also, according to example embodiments of the present disclosure, it is possible to enhance a statistical precision of a mounting misalignment calculation algorithm because a sufficient number of reference targets may be secured.

[0025] Also, according to example embodiments of the present disclosure, it is possible to increase accessibility and reduce cost for installation and maintenance of reference targets by securing reference targets in a sea area.BRIEF DESCRIPTION OF DRAWINGS

[0026] FIG. 1 is a diagram illustrating a misalignment correction procedure for an image sensor according to a related art. FIG. 2 is a block diagram illustrating an internal configuration of a device for correcting image sensor misalignment according to an example embodiment of the present disclosure. FIGS. 3A and 3B are diagrams illustrating an example of calculating a difference angle θ based on calibration coordinates for a ship according to an example embodiment of the present disclosure. FIG. 4 is a diagram illustrating a misalignment correction procedure for an image sensor according to an example embodiment of the present disclosure. FIG. 5 is a flowchart illustrating a method of correcting image sensor misalignment according to an example embodiment of the present disclosure. BEST MODE FOR CARRYING OUT THE INVENTION

[0027] The terminology used herein is for the purpose of describing example embodiments only and is not to be limiting of the example embodiments. As used herein, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises / comprising" and / or "includes / including" when used herein, specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof.

[0028] Unless otherwise defined herein, all terms used herein including technical or scientific terms have the same meaning as commonly understood by one of ordinary skill in the art to which example embodiments belong. It will be further understood that terms, such as those defined in commonly-used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.

[0029] When describing the example embodiments with reference to the accompanying drawings, like reference numerals refer to like constituent elements and a repeated description related thereto will be omitted. In the description of example embodiments, detailed description of well-known related structures or functions will be omitted when it is deemed that such description will cause ambiguous interpretation of the present disclosure.

[0030] FIG. 2 is a block diagram illustrating an internal configuration of a device for correcting image sensor misalignment according to an example embodiment of the present disclosure.

[0031] Referring to FIG. 2, a device 200 for correcting image sensor misalignment according to an example embodiment may include an acquisition unit 210 and a correction unit 220. Depending on example embodiments, the device 200 may further include a calculation unit 230.

[0032] The acquisition unit 210 may acquire a ship image from an image sensor 205. In other words, the acquisition unit 210 may function to acquire a ship image that is generated by capturing a target ship in the image sensor 205 for capturing a target on the ground which is mounted on a satellite.

[0033] Also, the acquisition unit 210 may acquire ship identification information from an automatic identification system (AIS). The AIS may be a device for preventing a collision of a ship at sea by providing navigation information, such as a ship's position, course, and speed, in real time. The AIS may determine presence and progress of other ships even when it is impossible to recognize a nearby ship and may identify sharpness, course, and speed even when visibility is poor, to prevent a ship collision and to more effectively perform safety management such as avoidance of a ship collision, a control of a wide area, and search and rescue activities of ships in distress.

[0034] In other words, the acquisition unit 210 may specify a ship captured by the image sensor 205 and may acquire ship identification information transmitted by an AIS included in the ship.

[0035] The correction unit 220 may identify first coordinates of a ship calculated from the ship image and second coordinates of the ship calculated from the ship identification information. In other words, the correction unit 220 may check a position of a ship identified in the ship image and a position of a ship identified in the ship identification information, may identify the position of the ship identified in the ship image as the first coordinates and may identify the position of the ship identified in the ship identification information as the second coordinates.

[0036] The device 200 may perform time synchronization for the second coordinates based on the first coordinates. To this end, the device 200 may further include the calculation unit 230 to calculate an observation time involved in each of identification of the first coordinates and identification of the second coordinates.

[0037] The calculation unit 230 may calculate an observation time t and the first coordinates using the ship image, and may calculate an observation time τ and the second coordinates using the ship identification information. In other words, the calculation unit 230 may calculate the observation time t associated with a time in which the ship image is generated, and a ship position at the observation time t as the first coordinates, and may calculate the observation time τ associated with a time in which the ship identification information is generated, and a ship position at the observation time τ as the second coordinates.

[0038] Here, the time synchronization may refer to finely adjusting the first coordinates or the second coordinates on the premise that the ship image and the ship identification information are generated at the same time.

[0039] In the present disclosure, the second coordinates may be adjusted on the premise that the ship identification information is generated at a time in which the ship image is generated.

[0040] In other words, the calculation unit 230 may perform the time synchronization by moving the second coordinates by a time difference between the observation times t and τ. For example, the calculation unit 230 may calculate calibration coordinates by applying the time difference to the second coordinates. The calculation unit 230 may calculate a position of a ship based on the calibration coordinates on the premise that the ship identification information is generated at the time in which the ship image is generated.

[0041] Subsequently, the correction unit 220 may determine a difference angle θ formed by the calibration coordinates calculated according to the time synchronization and the first coordinates as a misalignment value of the image sensor.

[0042] Calculation of the difference angle θ will be described below with reference to FIGS. 3A and 3B.

[0043] FIGS. 3A and 3B are diagrams illustrating an example of calculating a difference angle θ based on calibration coordinates for a ship according to an example embodiment of the present disclosure.

[0044] In FIG. 3A, □ represents image-based ship coordinates (first coordinates), and ∘ represents AIS-based ship coordinates (second coordinates).

[0045] The calculation unit 230 may calculate image-based ship coordinates (first coordinates) and an observation time t in which the image-based ship coordinates (first coordinates) are observed, using a ship image associated with the image sensor. The calculated image-based ship coordinates (first coordinates) and the calculated observation time t are shown on a position-time plane of FIG. 3A.

[0046] Also, the calculation unit 230 may calculate AIS-based ship coordinates (second coordinates) and an observation time τ in which the AIS-based ship coordinates (second coordinates) are observed, using ship identification information associated with the AIS. The calculated ship coordinates (second coordinates) and the calculated observation time τ are also shown on the position-time plane.

[0047] In addition, the calculation unit 230 may perform time synchronization by moving the AIS-based ship coordinates (second coordinates) by a time difference Δτ between the observation times t and τ, to calculate calibration coordinates ●. The calculated calibration coordinates ● are shown on the position-time plane.

[0048] In a state in which the image-based ship coordinates (first coordinates) □, the AIS-based ship coordinates (second coordinates) ∘, and the calibration coordinates ● are shown on the position-time plane, the correction unit 220 may identify a line of sight from a satellite to the image-based ship coordinates (first coordinates) □.

[0049] Also, the correction unit 220 may identify a line of sight from the satellite to the calibration coordinates ●.

[0050] The correction unit 220 may determine a difference between the identified line of sight to the first coordinates and the identified line of sight to the calibration coordinates as the difference angle θ.

[0051] Referring back to FIG. 1, the correction unit 220 may correct a misalignment value of the image sensor 205. In other words, the correction unit 220 may adjust a viewing direction of the image sensor 205 based on calibration coordinates calculated according to the time synchronization and may correct the misalignment value of the image sensor 205.

[0052] Referring to FIG. 3B, the correction unit 220 may correct the misalignment value by rearranging the image sensor 205 by the difference angle θ. In other words, the correction unit 220 may rearrange a position α of the misaligned image sensor 205 by rotation by the calculated difference angle θ to a position β, so that the viewing direction of the image sensor 205 may accurately point at a target.

[0053] According to an example embodiment of the present disclosure, a method and device for correcting image sensor misalignment that may process correction of misalignment of an image sensor mounted on a satellite at relatively low cost using an AIS that continues to transmit a position of a ship may be provided.

[0054] Also, according to example embodiments of the present disclosure, it is possible to accurately calculate a mounting misalignment value of an image sensor using a position difference between image-based ship coordinates and AIS-based ship coordinates after performing time synchronization of the image-based ship coordinates and the AIS-based ship coordinates.

[0055] Also, according to example embodiments of the present disclosure, it is possible to enhance a statistical precision of a mounting misalignment calculation algorithm because a sufficient number of reference targets may be secured.

[0056] Also, according to example embodiments of the present disclosure, it is possible to increase accessibility and reduce cost for installation and maintenance of reference targets by securing reference targets in a sea area.

[0057] FIG. 4 is a diagram illustrating a misalignment correction procedure for an image sensor according to an example embodiment of the present disclosure.

[0058] In the misalignment correction procedure of the image sensor, the device 200 may acquire a ship image from an image sensor 410 in operation 420 as a step of calculating observation data. The device 200 may acquire a ship image typically once or several times.

[0059] Subsequently, the device 200 may calculate image-based ship coordinates {P i } N< i=1 from the acquired ship image in operation 422, and may also calculate an image-based observation time {t i } N< i=1 from the acquired ship image in operation 424. Here, N may indicate a number of ships, that is, a total number of ships observed at the same time by an image sensor and an AIS. Also, the image-based ship coordinates {Pi} N< i=1 may be defined as ship coordinates calculated using geometry information of an image pixel. Also, the image-based observation time {t i } N< i=1 may be defined as an observation time of a ship calculated using time information of an image pixel.

[0060] The device 200 may acquire ship identification information from an AIS 430 in operation 440 as a step of acquiring reference data. The device 200 may periodically acquire ship identification information.

[0061] Subsequently, the device 200 may acquire an AIS-based observation time {τ i } N< i=1 from the acquired ship identification information in operation 442, and may also acquire AIS-based ship coordinates {Q i } N< i=1 from the acquired ship identification information in operation 444. Here, the AIS-based ship coordinates {Q i } N< i=1 may be defined as ship coordinates acquired by the AIS, and the AIS-based observation time {τ i } N< i=1 may be defined as an observation time of a ship acquired by the AIS.

[0062] Next, as a step of calibrating reference data, the device 200 may calculate an observation time difference {Δτ i } N< i=1 based on a difference between the image-based observation time {t i } N< i=1 and the AIS-based observation time {τ i } N< i=1 in operation 450. Δτ = t i − τ i for i = 1, ..., N

[0063] Also, the device 200 may propagate the AIS-based ship coordinates {Q i } N< i=1 by the observation time difference {Δτ i } N< i=1 based on information, for example, information about a time, a position, a speed, and an orientation angle included in ship identification information, and may calculate AIS-based calibration coordinates {R i } N< i=1 in operation 452. Here, the AIS-based calibration coordinates {R i } N< i=1 may be calibration coordinates of a ship calculated through observation time difference calibration for AIS-based ship coordinates, and accordingly time synchronization of the AIS-based ship coordinates and image-based ship coordinates may be performed. In other words, the device 200 may perform time synchronization of the image-based ship coordinates {P i } N< i=1 and the image-based observation time {t i } N< i=1 .

[0064] Subsequently, the device 200 may calculate image sensor mounting misalignment Δθ using the image-based ship coordinates {P i } N< i=1 and the AIS-based calibration coordinates {R i } N< i=1 in operation 460.

[0065] In operation 470, the device 200 may correct a mounting angle of the image sensor using the calculated image sensor mounting misalignment Δθ.

[0066] Hereinafter, a flow of operations of the device 200 according to example embodiments of the present disclosure will be described in detail with reference to FIG. 5.

[0067] FIG. 5 is a flowchart illustrating a method of correcting image sensor misalignment according to an example embodiment of the present disclosure.

[0068] The method of correcting image sensor misalignment according to an example embodiment may be performed by the above-described device 200.

[0069] In operation 510, the device 200 may acquire a ship image from an image sensor. Operation 510 may be a process of acquiring a ship image that is generated by capturing a target ship in an image sensor for capturing a target on the ground which is mounted on a satellite.

[0070] In operation 520, the device 200 may acquire ship identification information from an AIS. The AIS may be a device for preventing a collision of a ship at sea by providing navigation information, such as a ship's position, course, and speed, in real time. The AIS may determine presence and progress of other ships even when it is impossible to recognize a nearby ship and may identify sharpness, course, and speed even when visibility is poor, to prevent a ship collision and to more effectively perform safety management such as avoidance of a ship collision, a control of a wide area, and search and rescue activities of ships in distress.

[0071] Operation 520 may be a process of specifying a ship captured by an image sensor and acquiring ship identification information transmitted by an AIS included in the ship.

[0072] In operation 530, the device 200 may calculate first coordinates of a ship from the ship image and calculate second coordinates of the ship from the ship identification information. Operation 530 may be a process of checking a position of a ship identified in the ship image and a position of a ship identified in the ship identification information, identifying the position of the ship identified in the ship image as the first coordinates and identifying the position of the ship identified in the ship identification information as the second coordinates.

[0073] In operation 540, the device 200 may correct a misalignment value of the image sensor using the first coordinates and the second coordinates. Operation 540 may be a process of performing time synchronization for the second coordinates based on the first coordinates.

[0074] In the time synchronization, the device 200 may calculate an observation time t and the first coordinates using the ship image, and may calculate an observation time τ and the second coordinates using the ship identification information. In other words, the device 200 may calculate the observation time t associated with a time in which the ship image is generated, and a ship position at the observation time t as the first coordinates, and may calculate the observation time τ associated with a time in which the ship identification information is generated, and a ship position at the observation time τ as the second coordinates.

[0075] Here, the time synchronization may refer to finely adjusting the first coordinates or the second coordinates on the premise that the ship image and the ship identification information are generated at the same time.

[0076] In the present disclosure, the second coordinates may be adjusted on the premise that the ship identification information is generated at a time in which the ship image is generated.

[0077] In other words, the device 200 may perform the time synchronization by moving the second coordinates by a time difference between the observation times t and τ. For example, the device 200 may calculate calibration coordinates by applying the time difference to the second coordinates. That is, the device 200 may calculate a position of a ship based on the calibration coordinates on the premise that the ship identification information is generated at the time in which the ship image is generated.

[0078] Subsequently, the device 200 may determine a difference angle θ formed by the calibration coordinates calculated according to the time synchronization and the first coordinates as a misalignment value of the image sensor.

[0079] For example, the device 200 may calculate image-based ship coordinates (first coordinates) and an observation time t in which the image-based ship coordinates (first coordinates) are observed, using a ship image associated with the image sensor. The calculated image-based ship coordinates (first coordinates) and the calculated observation time t are shown on the position-time plane of FIG. 3A.

[0080] Also, the device 200 may calculate AIS-based ship coordinates (second coordinates) and an observation time τ in which the AIS-based ship coordinates (second coordinates) are observed, using ship identification information associated with the AIS. The calculated ship coordinates (second coordinates) and the calculated observation time τ are also shown on the position-time plane.

[0081] In addition, the device 200 may perform time synchronization by moving the AIS-based ship coordinates (second coordinates) by a time difference Δτ between the observation times t and τ, to calculate calibration coordinates. The calculated calibration coordinates are shown on the position-time plane.

[0082] In a state in which the image-based ship coordinates (first coordinates) □, the AIS-based ship coordinates (second coordinates) ∘, and the calibration coordinates ● are shown on the position-time plane, the device 200 may identify a line of sight from a satellite to the image-based ship coordinates (first coordinates) □.

[0083] Also, the device 200 may identify a line of sight from the satellite to the calibration coordinates ●.

[0084] The device 200 may determine a difference between the identified line of sight to the first coordinates and the identified line of sight to the calibration coordinates as the difference angle θ.

[0085] Also, the device 200 may correct a misalignment value of the image sensor. In other words, the device 200 may adjust a viewing direction of the image sensor 205 based on calibration coordinates calculated according to the time synchronization and may correct the misalignment value of the image sensor.

[0086] Referring to FIG. 3B, the device 200 may correct the misalignment value by rearranging the image sensor by the difference angle θ. In other words, the device 200 may rearrange a position α of the misaligned image sensor by rotation by the calculated difference angle θ to a position β, so that the viewing direction of the image sensor may accurately point at a target.

[0087] According to example embodiments of the present disclosure, a method and device for correcting image sensor misalignment that may process correction of misalignment of an image sensor mounted on a satellite at relatively low cost using an AIS that continues to transmit a position of a ship may be provided.

[0088] Also, according to example embodiments of the present disclosure, it is possible to accurately calculate a mounting misalignment value of an image sensor using a position difference between image-based ship coordinates and AIS-based ship coordinates after performing time synchronization of the image-based ship coordinates and the AIS-based ship coordinates.

[0089] Also, according to example embodiments of the present disclosure, it is possible to enhance a statistical precision of a mounting misalignment calculation algorithm because a sufficient number of reference targets may be secured.

[0090] Also, according to example embodiments of the present disclosure, it is possible to increase accessibility and reduce cost for installation and maintenance of reference targets by securing reference targets in a sea area.

[0091] The method according to the above-described example embodiments may be recorded in non-transitory computer-readable media including program instructions to implement various operations which may be performed by a computer. The media may also include, alone or in combination with the program instructions, data files, data structures, and the like. The program instructions recorded on the media may be those specially designed and constructed for the purposes of the example embodiments, or they may be of the well-known kind and available to those having skill in the computer software arts. Examples of non-transitory computer-readable media include magnetic media such as hard disks, floppy disks, and magnetic tape; optical media such as CD ROM discs and DVDs; magneto-optical media such as optical discs; and hardware devices that are specially configured to store and perform program instructions, such as read-only memory (ROM), random access memory (RAM), flash memory, and the like. Examples of program instructions include both machine code, such as code produced by a compiler, and files containing higher level code that may be executed by the computer using an interpreter. The described hardware devices may be configured to act as one or more software modules in order to perform the operations of the above-described example embodiments, or vice versa.

[0092] The software may include a computer program, a piece of code, an instruction, or some combination thereof, to independently or collectively instruct or configure the processing device to operate as desired. Software and data may be embodied permanently or temporarily in any type of machine, component, physical or virtual equipment, computer storage medium or device, or in a propagated signal wave capable of providing instructions or data to or being interpreted by the processing device. The software also may be distributed over network coupled computer systems so that the software is stored and executed in a distributed fashion. The software and data may be stored by one or more non-transitory computer readable recording mediums.

Claims

1. A method of correcting image sensor misalignment, wherein the image sensor is mounted on a satellite, the method comprising: acquiring (420, 510) a ship image from an image sensor (205); calculating (422) first coordinates of the ship using the ship image; acquiring (440, 520) ship identification information from an automatic identification system, AIS; calculating (444) second coordinates of the ship using the ship identification information; performing time synchronization for the second coordinates based on the first coordinates; correcting (460, 540) a misalignment value of the image sensor (205) using the first coordinates of the ship calculated from the ship image and the second coordinates of the ship calculated from the ship identification information; and determining a difference angle θ formed by calibration coordinates calculated according to the time synchronization and the first coordinates as a misalignment value of the image sensor, wherein the determining comprises determining a difference between a line of sight to the first coordinates and a line of sight to the calibration coordinates as the difference angle θ.

2. The method of claim 1, further comprising: calculating (424) an observation time t using the ship image; and calculating (442) an observation time τ using the ship identification information, wherein the performing of the time synchronization comprises performing the time synchronization by moving the second coordinates by a time difference between the observation times t and τ.

3. The method of claim 1, wherein the correcting comprises: performing time synchronization for the second coordinates based on the first coordinates; and correcting the misalignment value of the image sensor (205) by adjusting a viewing direction of the image sensor based on the time synchronization.

4. A device for correcting image sensor misalignment, wherein the image sensor is mounted on a satellite, the device comprising: an acquisition unit (210) configured to acquire a ship image from an image sensor (205) and acquire ship identification information from an automatic identification system ,AIS; a calculation unit (230) configured to calculate first coordinates of the ship using the ship image and to calculate second coordinates of the ship using the ship identification information; and a correction unit (220) configured to correct a misalignment value of the image sensor using the first coordinates of the ship calculated from the ship image and the second coordinates of the ship calculated from the ship identification information, wherein the correction unit (220) is configured to perform time synchronization for the second coordinates based on the first coordinates and determine a difference angle θ formed by calibration coordinates calculated according to the time synchronization and the first coordinates as a misalignment value of the image sensor, wherein the correction unit (220) is configured to determine a difference between a line of sight to the first coordinates and a line of sight to the calibration coordinates as the difference angle θ.

5. The device of claim 4, further comprising: a calculation unit (230) configured to calculate an observation time t using the ship image and calculate an observation time τ using the ship identification information, wherein the correction unit (220) is configured to perform the time synchronization by moving the second coordinates by a time difference between the observation times t and τ.

6. The device of claim 4, wherein the correction unit (220) is configured to perform time synchronization for the second coordinates based on the first coordinates and correct the misalignment value of the image sensor (205) by adjusting a viewing direction of the image sensor based on the time synchronization.