Correction method, correction system and correction procedure aid for panoramic ship images

The method and system for correcting panoramic ship images by arranging and recognizing correction marks address stability and accuracy issues, ensuring precise panoramic views without collisions.

JP2026036645APending Publication Date: 2026-03-05WHETRON ELECTRONICS
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2025006510
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-08-20
Filing Date
2025-01-17
Publication Date
2026-03-05

AI Technical Summary

Technical Problem

Existing calibration methods for panoramic vehicle images are difficult to perform on boats due to stability issues and the inability to use car-based calibration patterns, leading to inaccurate panoramic views that may cause false alarms and collisions.

Method used

A method and system for correcting panoramic ship images by arranging external and internal correction marks around the ship before departure, capturing images, recognizing these marks, and recording their coordinates to enable accurate image splicing or fusion during operation.

Benefits of technology

Ensures accurate panoramic images are generated for ships, preventing false alarms and collisions by stabilizing the calibration process and using ship-specific correction parameters.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026036645000001_ABST
    Figure 2026036645000001_ABST
Patent Text Reader

Abstract

A correction method, correction system, and correction procedure assistance method for panoramic ship images are provided. A plurality of set positions of a plurality of external correction marks and a plurality of internal correction marks are acquired according to ship information and resolution information of a plurality of image capture devices. The external correction marks and the internal correction marks are arranged around the ship according to the set positions. A plurality of images are captured by the image capture devices. Two of the external correction marks and two of the internal correction marks are identified in each of the images. A plurality of position image coordinates of the external correction marks and the internal correction marks in the images are recorded. The position image coordinates are used to obtain a panoramic image.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates generally to image correction methods, correction systems, and methods to assist in correction procedures, and more particularly to methods, correction systems, and methods to assist in correction procedures for panoramic ship images. [Background technology]

[0002] To assist vehicle driving, panoramic images have been developed to allow drivers to quickly observe the environment around the vehicle. For example, Patent Document 1 discloses a method for generating a panoramic image. This panoramic image is synthesized from images from multiple directions. Before the vehicle leaves the factory, the panoramic image needs to be corrected to obtain correction parameters. Using these correction parameters, the panoramic image can be quickly synthesized while the vehicle is traveling. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Chinese Patent Application Publication No. 113223092 Summary of the Invention [Problem to be solved by the invention]

[0004] Existing calibration methods for panoramic vehicle images are performed on the ground, and the target object is a road marking line on the ground. However, because a boat floats on water, it is difficult to maintain stability during the calibration process. In addition, a boat is significantly larger than a car, so the calibration pattern for a car cannot be used.

[0005] If the images are not accurately calibrated, it will affect the accuracy of the panoramic view applied to the vessel, which may cause the vessel to generate false alarms in the panoramic image when docking, potentially causing the vessel to collide with shore objects or other vessels. [Means for solving the problem]

[0006] The present disclosure relates to a correction method, a correction system, and a method for assisting the correction procedure for panoramic images of a ship, in which position image coordinates are corrected before the ship leaves the factory. After the accurate position image coordinates are recorded, the ship can perform image splicing or fusion during operation to quickly obtain accurate panoramic images.

[0007] According to one embodiment, there is provided a correction method for a panoramic image of a ship. The correction method for a panoramic image of a ship includes the following steps: ship information of the ship is provided; resolution information of a plurality of image capture devices arranged around the ship is provided; a plurality of set positions of a plurality of external correction marks and a plurality of internal correction marks is obtained according to the ship information and the resolution information of the image capture devices; the external correction marks and the internal correction marks are arranged around the ship according to the set positions; a plurality of images are captured by the image capture devices; two of the external correction marks and two of the internal correction marks are recognized in each of the images; a plurality of position image coordinates of the external correction marks and the internal correction marks in the image are recorded; and the position image coordinates are used to obtain a panoramic image.

[0008] According to another embodiment, there is provided a correction system for panoramic images of a ship. The correction system includes a correction mark setting unit, a storage unit, a recognition unit, and a coordinate unit. The correction mark setting unit is configured to obtain a plurality of set positions of a plurality of external correction marks and a plurality of internal correction marks according to ship information and resolution information of a plurality of image capture devices. The external correction marks and the internal correction marks are arranged around the ship according to the set positions. The storage unit is configured to store a plurality of images captured by the image capture devices. The recognition unit is configured to recognize two of the external correction marks and two of the internal correction marks in each of the images. The coordinate unit is configured to record a plurality of position image coordinates of the external correction marks and the internal correction marks into the storage unit. The position image coordinates are used to obtain the panoramic image.

[0009] According to an alternative embodiment, an auxiliary method for a correction procedure of a panoramic image of a ship is provided. The auxiliary method for a correction procedure of a panoramic image of a ship includes the following steps: a user interface is provided for a user to input ship information of the ship; a plurality of set positions of a plurality of external correction marks and a plurality of internal corrections are displayed on the user interface; the set positions are obtained according to the ship information and resolution information of a plurality of image capture devices; the image capture devices are arranged around the ship; the external correction marks and the internal correction marks are arranged around the ship according to the set positions; a plurality of frames are provided for displaying a plurality of images captured by the image capture devices; two of the external correction marks and two of the internal correction marks are shown in each of the images; a plurality of position image coordinates of the external correction marks and the internal correction marks in the image are recorded; the position image coordinates are used to obtain a panoramic image. [Brief explanation of the drawings]

[0010] [Figure 1] 1 illustrates the process of forming a panoramic image of a ship. [Figure 2] FIG. 1 is a block diagram of a correction system for panoramic images of a ship, multiple image capture devices, and a panoramic imaging device according to one embodiment of the present disclosure. [Figure 3] 1 is a flowchart of a method for generating a panoramic image of a ship according to an embodiment of the present disclosure. [Figure 4] 1 is a flowchart of a correction method for panoramic ship images according to one embodiment of the present disclosure. [Figure 5] FIG. 1 illustrates the relationship between a vessel and multiple external and internal correction marks. [Figure 6] FIG. 10 is a diagram showing a plurality of set positions of an external correction mark and an internal correction mark. [Figure 7] FIG. 1 is a side view of a vessel and one of the external calibration marks according to an embodiment of the present disclosure. [Figure 8] FIG. 1 illustrates one of the external correction marks according to an embodiment of the present disclosure. [Figure 9] 1 is a flowchart of a method for assisting a correction process for panoramic images of a ship according to an embodiment of the present disclosure. [Figure 10] FIG. 2 illustrates one frame of a user interface according to one embodiment of the present disclosure. [Figure 11] FIG. 10 illustrates another frame of the user interface. [Figure 12] FIG. 10 illustrates another frame of the user interface. [Figure 13] FIG. 10 illustrates another frame of the user interface. DETAILED DESCRIPTION OF THE INVENTION

[0011] In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the disclosed embodiments. It will be apparent, however, that one or more embodiments may be practiced without these specific details. In other instances, well-known structures and devices are shown in schematic form to simplify the drawings.

[0012] The technical terms used in this specification refer to common terms in the technical field.If there are explanations or definitions for some terms in this specification, the explanations or definitions of these terms shall prevail.Each embodiment of the present disclosure has one or more technical features.To the extent possible, those skilled in the art can selectively implement some or all of the technical features in any embodiment, or selectively combine some or all of the technical features in these embodiments.

[0013] See Figure 1, which illustrates the process of forming a panoramic image IM1 of a ship 1000. For example, multiple image capture devices 210, 220, 230, 240 around the ship 1000 are used to capture multiple images IM11, IM12, IM13, IM14, and then multiple position image coordinates C1e1, C1i1, C1e2, C1i2, C2e3, C2i3, C2e4, C2i4, C3e2, C3i2, C3e3, C3i3, C4e1, C4i1, C4e4, C4i4 are used to perform splicing or fusion on the images IM11, IM12, IM13, IM14 to obtain the panoramic image IM1.

[0014] Because the installation conditions and image capture parameters of the image capture devices 210, 220, 230, 240 may be slightly different for each ship 1000, corrections must be performed on the position image coordinates C1e1, C1i1, C1e2, C1i2, C2e3, C2i3, C2e4, C2i4, C3e2, C3i2, C3e3, C3i3, C4e1, C4i1, C4e4, C4i4 before the ship 1000 leaves the factory. After the accurate position image coordinates C1e1, C1i1, C1e2, C1i2, C2e3, C2i3, C2e4, C2i4, C3e2, C3i2, C3e3, C3i3, C4e1, C4i1, C4e4, C4i4 are recorded, the vessel 1000 may perform stitching or fusion on the images IM11, IM12, IM13, IM14 to quickly obtain an accurate panoramic image IM1 during operation.

[0015] Please refer to FIG. 2 , which shows a block diagram of the correction system 100, image capture devices 210, 220, 230, 240, and panoramic imaging device 300 for a panoramic image IM1 of a ship 1000, according to one embodiment of the present disclosure. The correction system 100 includes a correction mark setting unit 130, a storage unit 140, a recognition unit 150, and a coordinate unit 160. The correction mark setting unit 130, the recognition unit 150, and the coordinate unit 160 are used to perform various analysis and calculation procedures. The storage unit 140 is used to store data.

[0016] The image capture devices 210, 220, 230, 240 are disposed around the vessel 1000, for example, but not limited to, at four locations: front, rear, left, and right.

[0017] The panoramic imaging device 300 includes an image processing unit 310 and a storage unit 320. The image processing unit 310 is used to perform various image processing procedures, such as image splicing, fusion, and resolution adjustment, etc. The storage unit 320 is used to store data.

[0018] The correction mark setting unit 130, the recognition unit 150, the coordinate unit 160, and / or the image processing unit 310 may be, for example, a circuit, a circuit board, a storage device for storing program code, or a chip, such as a central processing unit (CPU), a programmable general-purpose or special-purpose microcontroller unit (MCU), a microprocessor, a digital signal processor (DSP), a programmable controller, an application-specific integrated circuit (ASIC), a graphics processing unit (GPU), an image signal processor (ISP), an image processing unit (IPU), an arithmetic logic unit (ALU), a complex programmable logic device (CPLD), an embedded system, a field programmable gate array (FPGA), other similar elements, or a combination thereof.

[0019] The storage unit 140 and / or the storage unit 320 may be, for example, any type of fixed or movable random access memory (RAM), read-only memory (ROM), flash memory, a hard disk drive (HDD), a solid-state drive (SSD), or similar elements or combinations of the above elements.

[0020] In this embodiment, ship 1000 may be calibrated by image capture devices 210, 220, 230, 240 and correction system 100 before leaving the factory. After ship 1000 leaves the factory, image capture devices 210, 220, 230, 240 and panoramic imaging device 300 may be used to generate panoramic image IM1. In one embodiment, correction system 100 may be uninstalled after ship 1000 leaves the factory, and the correction parameters obtained by correction system 100 are stored in storage unit 320 of panoramic imaging device 300. Below is a flowchart that describes the operation of each of the above components in detail.

[0021] Please refer to Figure 3, which shows a flowchart of a method for generating a panoramic image IM1 of a ship 1000 according to one embodiment of the present disclosure. The method for generating a panoramic image IM1 of a ship 1000 includes steps S100, S200, and S300. In step S100, a correction procedure for the panoramic image IM1 is performed by the correction system 100. The details of the calibration procedure will be described later. After the calibration procedure is completed, the relevant calibration parameters are recorded.

[0022] Next, in step S200, a plurality of images IM11, IM12, IM13, and IM14 are captured by image capture devices 210, 220, 230, and 240. The number of images is not limited to the present disclosure.

[0023] Then, in step S300, images IM11, IM12, IM13, and IM14 are spliced ​​or fused according to the correction parameters described above to obtain panoramic image IM1.

[0024] The above step S100 is performed before shipping from the factory, while steps S200 and S300 are performed after shipping from the factory.

[0025] Please refer to Figure 4, which shows a flowchart of a correction method for a panoramic image IM1 of a ship 1000 according to one embodiment of the present disclosure. The correction method for a panoramic image IM1 of a ship 1000 is the above-mentioned step S100, which includes steps S110, S120, S130, S140, S150, and S160.

[0026] In step S110, ship information SZ of the ship 1000 is provided, as shown in Figure 2. The ship information SZ includes, for example, the width of the ship 1000, the length of the ship 1000, the height of the ship 1000, the type of the ship 1000, and the location of the image capture device.

[0027] Next, in step S120, resolution information RS of image capture devices 210, 220, 230, 240 is provided, as shown in Figure 2. For example, image capture devices 210, 220, 230, 240 may be the same or different.

[0028] 5, which illustrates the relationship between the vessel 1000 and the plurality of external correction marks MKe1, MKe2, MKe3, MKe4 and the plurality of internal correction marks MKi1, MKi2, MKi3, MKi4. The external correction marks MKe1, MKe2, MKe3, MKe4 and the internal correction marks MKi1, MKi2, MKi3, MKi4 are arranged around the vessel 1000 according to a plurality of set positions Le1, Le2, Le3, Le4, Li1, Li2, Li3, Li4.

[0029] 6, which shows the set positions Le1, Le2, Le3, Le4, Li1, Li2, Li3, Li4 of the external correction marks MKe1, MKe2, MKe3, MKe4 and the internal correction marks MKi1, MKi2, MKi3, MKi4. The set positions Le1, Le2, Le3, Le4 of the external correction marks MKe1, MKe2, MKe3, MKe4 are located at the outer corners CR1, CR2, CR3, CR4 of the visibility range RG.

[0030] Each of the external correction marks MKe1, MKe2, MKe3, and MKe4 and its corresponding internal correction marks MKi1, MKi2, MKi3, and MKi4 is located at a diagonal point of each of the rectangles RT1, RT2, RT3, and RT4. The rectangles RT1, RT2, RT3, and RT4 are, for example, squares or rectangles. The rectangles RT1, RT2, RT3, and RT4 are located at the corners of the visible range RG.

[0031] The distance D11 between the external correction mark MKe1 and the long side S2 of the ship 1000 is related to the maximum visibility range of the image capture device 240 disposed on the long side S2 and can be adjusted to 3 to 6 meters depending on the visual conditions. The distance D12 between the external correction mark MKe2 and the long side S1 of the ship 1000 is related to the maximum visibility range of the image capture device 230 disposed on the long side S1 and can be adjusted to 3 to 6 meters depending on the visual conditions. The distance D13 between the external correction mark MKe3 and the long side S1 of the ship 1000 is related to the maximum visibility range of the image capture device 230 disposed on the long side S1 and can be adjusted to 3 to 6 meters depending on the visual conditions. The distance D14 between the external correction mark MKe4 and the long side S2 of the ship 1000 is related to the maximum visibility range of the image capture device 240 disposed on the long side S2 and can be adjusted to 3 to 6 meters depending on the visual conditions.

[0032] The distance D21 between the internal correction mark MKi1 and the long side S2 of the ship 1000 is related to the maximum visibility range of the image capture device 240 disposed on the long side S2 and can be adjusted to 1.5 to 3 meters depending on the visual conditions. The distance D22 between the internal correction mark MKi2 and the long side S1 of the ship 1000 is related to the maximum visibility range of the image capture device 230 disposed on the long side S1 and can be adjusted to 1.5 to 3 meters depending on the visual conditions. The distance D23 between the external correction mark MKi3 and the long side S1 of the ship 1000 is related to the maximum visibility range of the image capture device 230 disposed on the long side S1 and can be adjusted to 1.5 to 3 meters depending on the visual conditions. The distance D24 between the internal correction mark MKi4 and the long side S2 of the ship 1000 is related to the maximum visibility range of the image capture devices 240 arranged on the long sides S1 and S2 and can be adjusted to 1.5 to 3 meters according to the visual conditions. Basically, the distances D21, D22, D23, and D24 between the internal correction marks MKi1, MKi2, MKi3, and MKi4 and the long side S1 of the ship 1000 are less than half of the distances D11, D12, D13, and D14 between the external correction marks MKe1, MKe2, MKe3, and MKe4 and the long sides S1 and S2 of the ship 1000.

[0033] Proper setting positions Le1, Le2, Le3, Le4, Li1, Li2, Li3, Li4 allow the image capture devices 210, 220, 230, 240 to accurately capture the external correction marks MKe1, MKe2, MKe3, MKe4 and the internal correction marks MKi1, MKi2, MKi3, MKi4 for easy subsequent identification and calibration.

[0034] See FIG. 7, which shows a side view of the vessel 1000 and an external correction mark MKe1 according to one embodiment of the present disclosure. During this calibration, the vessel 1000 is positioned on the trailer 9000, and the vessel 1000 is placed on land to maintain the vessel 1000 in a stable state. The external correction mark MKe1 is mounted, for example, on a tripod and disposed at a height position LV11. The height position LV11 is on the same horizontal plane as the water line WL of the vessel 1000. In FIG. 7, only the external correction mark MKe1 is shown. The external correction marks MKe2, MKe3, MKe4 and the internal correction marks MKi1, MKi2, MKi3, MKi4 are also mounted on tripods and disposed on the same horizontal plane as the water line WL of the vessel 1000.

[0035] 8 illustrates an external correction mark MKe1 according to one embodiment of the present disclosure. The external correction mark MKe1 includes a first color block CB1 and a second color block CB2, with the second color block CB2 surrounding the first color block CB1. The first color block CB1 and the second color block CB2 are contrasting colors. For example, the first color block CB1 is black, and the second color block CB2 is white.

[0036] The width of the second color block CB2 is, for example, 10 cm or more. The first color block CB1 is, for example, rectangular, and the edge of the second color block CB2 is, for example, octagonal.

[0037] Only the external correction mark MKe1 is shown in Figure 8. The external correction marks MKe1, MKe2, MKe3, MKe4 and the internal correction marks MKi1, MKi2, MKi3, MKi4 have substantially similar characteristics, and the similarities will not be repeated here.

[0038] Then, in step S140, as shown in FIG. 2, image capture devices 210, 220, 230, 240 capture images IM21, IM22, IM23, IM24. Since the external correction marks MKe1, MKe2, MKe3, MKe4 and the internal correction marks MKi1, MKi2, MKi3, MKi4 are arranged around the ship 1000 according to the set positions Le1, Le2, Le3, Le4, Li1, Li2, Li3, Li4, image IM21 should include the external correction marks MKe1, MKe2 and the internal correction marks MKi1, MKi2, image IM22 should include the external correction marks MKe3, MKe3 and the internal correction marks MKi3, MKi4, image IM23 should include the external correction marks MKe2, MKe3 and the internal correction marks MKi2, MKi3, and image IM24 should include the external correction marks MKe1, MKe4 and the internal correction marks MKi1, MKi4.

[0039] In one embodiment, the number of external correction marks may be only two, and the number of internal correction marks may be only two. In this embodiment, the image capture devices 210, 220, 230, 240 do not capture images simultaneously. Each time an image is captured, some of the two external correction marks and two internal correction marks are moved, and the two external correction marks and two internal correction marks are captured in one image.

[0040] Next, in step S150, as shown in FIG. 2, the recognition unit 150 recognizes two of the external correction marks MKe1, MKe2, MKe3, MKe4 and two of the internal correction marks MKi1, MKi2, MKi3, MKi4 in the images IM21, IM22, IM23, IM24.

[0041] Next, in step S160, as shown in FIG. 2, the coordinate unit 160 records the position image coordinates C1e1, C1i1, C1e2, C1i2, C2e3, C2i3, C2e4, C2i4, C3e2, C3i2, C3e3, C3i3, C4e1, C4i1, C4e4, C4i4 of the external correction marks MKe1, MKe2, MKe3, MKe4 and the internal correction marks MKi1, MKi2, MKi3, MKi4 in the images IM21, IM22, IM23, IM24 into the storage unit 140.

[0042] According to the above process, after the position image coordinates C1e1, C1i1, C1e2, C1i2, C2e3, C2i3, C2e4, C2i4, C3e2, C3i2, C3e3, C3i3, C4e1, C4i1, C4e4, C4i4 are recorded in the storage unit 140, they are transferred to the storage unit 320 of the panoramic imaging device 300 and can be used to obtain the panoramic image IM1 in the subsequent step S300.

[0043] Based on the above correction method for the panoramic image IM1, the present disclosure further provides an auxiliary method for the correction procedure for the panoramic image IM1. Please refer to FIG. 9 , which shows a flowchart of the auxiliary method for the correction process for the panoramic image IM1 of the ship 1000 according to one embodiment of the present disclosure. The auxiliary method for the calibration procedure mainly provides a user interface to guide the user in operation and assist the user in completing the calibration procedure. The auxiliary method for the calibration procedure includes steps S410, S420, S430, and S440.

[0044] Please refer to Figure 10, which shows one frame of the user interface UI according to one embodiment of the present disclosure. In step S410, the user interface UI is provided as shown in Figure 10. The user interface UI allows the user to input ship information SZ of the ship 1000.

[0045] Next, in step S420, the setting positions Le1, Le2, Le3, Le4, Li1, Li2, Li3, Li4 of the above-mentioned external correction marks MKe1, MKe2, MKe3, MKe4 and internal correction marks MKi1, MKi2, MKi3, MKi4 are displayed on the user interface UI, as shown in Figure 10. As mentioned above, the setting positions Le1, Le2, Le3, Le4, Li1, Li2, Li3, Li4 are obtained according to the ship information SZ and the resolution information RS of the image capture devices 210, 220, 230, 240.

[0046] In the example of FIG. 10 , the ship size is "Breadth: 2490, Length: 8270," the positions of the correction marks are "Distance between the ship's edge and the external correction mark: 6000, Distance between the ship's edge and the internal correction mark: 3000," the size of the correction marks is "Width: 3000, Length: 3000," the coordinates of the correction marks in the actual environment (the origin is the center of the ship) are "Outside: (±7245, ±10135), Inside: (±4245, ±7135)," the ship shape is "Sword-tipped ship," and the camera resolution is "1280 × 960." The distance between the ship's edge and the external correction mark is related to the maximum viewing range of the corresponding image capture device 210, 220, 230, or 240, for example, 4 to 6 meters. Under the ship information SZ and the resolution information RS, the set positions Le1, Le2, Le3, Le4, Li1, Li2, Li3, and Li4 in FIG. 10 are obtained.

[0047] See FIG. 11, which shows another frame of the user interface UI. In the example of FIG. 11, the ship size is "ship width: 2390, ship length: 6400," the position of the correction mark is "distance between the ship edge and the outer correction mark: 5000, distance between the ship edge and the inner correction mark: 3000," the size of the correction mark is "width: 2000, length: 2000," the coordinates of the correction mark in the actual environment (the origin is the center point of the ship) are "outside: (±6195, ±8200), inside: (±4195, ±6200)," the ship shape is "square ship," and the camera resolution is "1280 × 960." Based on the ship information SZ and the resolution information RS, the setting positions Le1, Le2, Le3, Le4, Li1, Li2, Li3, and Li4 shown in FIG. 11 can be obtained.

[0048] See FIG. 12, which shows another frame of the user interface UI. In the example of FIG. 12, the ship size is "ship width: 2600, ship length: 9100," the position of the correction mark is "distance between the ship edge and the outer correction mark: 4000, distance between the ship edge and the inner correction mark: 1500," the size of the correction mark is "width: 2500, length: 2500," the coordinates of the correction mark in the actual environment (the origin is the center point of the ship) are "outside: (±5300, ±8550), inside: (±2800, ±6050)," the ship shape is "square ship," and the camera resolution is "1280 × 960." Based on the ship information SZ and resolution information RS, the setting positions Le1, Le2, Le3, Le4, Li1, Li2, Li3, and Li4 of FIG. 12 are obtained.

[0049] 13, which shows another frame of the user interface UI. In step S430, as shown in FIG. 13, the user interface UI provides a plurality of frames FM1, FM2, FM3, FM4 for displaying images IM21, IM22, IM23, IM24 captured by the image capture devices 210, 220, 230, 240.

[0050] Next, in step S440, as shown in FIG. 13, two of the external correction marks MKe1, MKe2, MKe3, MKe4 and two of the internal correction marks MKi1, MKi2, MKi3, MKi4 are marked in each of the images IM21, IM22, IM23, IM24.

[0051] Next, in step S450, position image coordinates C1e1, C1i1, C1e2, C1i2, C2e3, C2i3, C2e4, C2i4, C3e2, C3i2, C3e3, C3i3, C4e1, C4i1, C4e4, C4i4 of the external correction marks MKe1, MKe2, MKe3, MKe4 and the internal correction marks MKi1, MKi2, MKi3, MKi4 in the images IM21, IM22, IM23, IM24 are recorded. For example, they are recorded directly in the storage unit 140. After the accurate position image coordinates C1e1, C1i1, C1e2, C1i2, C2e3, C2i3, C2e4, C2i4, C3e2, C3i2, C3e3, C3i3, C4e1, C4i1, C4e4, C4i4 are recorded, the vessel 1000 may perform stitching or fusion of images IM11, IM12, IM13, IM14 during operation to quickly obtain an accurate panoramic image IM1.

[0052] The above disclosure provides various features for implementing several embodiments or examples of the present disclosure. Specific examples of components and configurations (such as the numerical values ​​or names mentioned above) are described above to simplify and illustrate several embodiments of the present disclosure. In addition, several embodiments of the present disclosure may repeat reference signs and / or characters in various instances. This repetition is for simplicity and clarity and does not inherently indicate a relationship between the various embodiments and / or configurations described above.

[0053] It will be apparent to those skilled in the art that various modifications and variations can be made to the embodiments of the present disclosure. It is intended that the specification and examples be considered as exemplary only, with the true scope of the present disclosure being indicated by the following claims and their equivalents. [Explanation of symbols]

[0054] 100 Correction System 130 Mark Setting Unit 140 Memory Unit 150 recognition units 160 coordinate units 210 Image Capture Device 300 Panoramic Imaging Device 310 Image Processing Unit

Claims

1. 1. A correction method for a panoramic image of a ship, comprising: providing vessel information for said vessel; providing resolution information for a plurality of image capture devices disposed around the vessel; obtaining a plurality of set positions of a plurality of external correction marks and a plurality of internal correction marks according to the vessel information and the resolution information of the image capture device, wherein the external correction marks and the internal correction marks are arranged around the vessel according to the set positions; capturing a plurality of images with the image capture device and recognizing two of the external correction marks and two of the internal correction marks in each of the images; recording a plurality of position image coordinates of the external correction marks and the internal correction marks in the image, the position image coordinates being used to obtain the panoramic image; A correction method comprising:

2. 2. The correction method for the panoramic image of the ship of claim 1, wherein the set position of the external correction mark is located at an outer corner of the field of view.

3. 2. The correction method for the panoramic image of the ship of claim 1, wherein each of the external correction marks and each of the corresponding internal correction marks are located at diagonal points of a rectangle.

4. 4. The method of correction for the panoramic image of the ship of claim 3, wherein the rectangles are located at multiple corners of the field of view.

5. 2. The correction method for the panoramic image of the ship of claim 1, wherein a first distance between each of the external correction marks and a long side of the ship is related to a maximum viewing range of the image capture device disposed on the long side.

6. 6. The correction method for the panoramic image of the ship according to claim 5, wherein the first distance is between 4 and 6 meters.

7. 2. The correction method for the panoramic image of the ship according to claim 1, wherein the external correction mark and the internal correction mark are disposed at an elevation that is in the same horizontal plane as the waterline of the ship.

8. 2. The correction method for the panoramic image of the ship as described in claim 1, wherein each of the external correction marks and each of the internal correction marks includes a first color block and a second color block, the second color block surrounding the first color block.

9. 9. The method of correction for the panoramic image of the ship of claim 8, wherein the first color block and the second color block are contrasting colors.

10. 9. The method of correction for the panoramic image of the ship according to claim 8, wherein the width of the second color block is greater than 10 cm.

11. 9. The method of correction for the panoramic image of the ship of claim 8, wherein the first color block is rectangular and the edges of the second color block are octagonal.

12. 2. The method of correction for the panoramic image of the ship of claim 1, wherein the size of each of the external correction marks and each of the internal correction marks is substantially the same.

13. 1. A correction system for panoramic images of a ship, comprising: a correction mark setting unit configured to obtain a plurality of setting positions of a plurality of external correction marks and a plurality of internal correction marks according to ship information and resolution information of a plurality of image capture devices, wherein the external correction marks and the internal correction marks are arranged around the ship according to the setting positions; a storage unit configured to store a plurality of images captured by the image capture device; a recognition unit configured to recognize two of the external correction marks and two of the internal correction marks in each of the images; a coordinate unit configured to record a plurality of position image coordinates of the external correction marks and the internal correction marks in the image in a storage unit, the position image coordinates being used to obtain the panoramic image.

14. 14. A correction system for the panoramic images of the ship as described in claim 13, wherein the set positions of the external correction marks are located at the outer corners of the field of view.

15. 14. A correction system for said panoramic images of said ship as described in claim 13, wherein each of said external correction marks and each of said corresponding internal correction marks are located at diagonal points of a rectangle.

16. 16. A correction system for the panoramic image of the ship as described in claim 15, wherein the rectangles are located at multiple corners of the field of view.

17. 14. The correction system for the panoramic image of the ship described in claim 13, wherein a first distance between each of the external correction marks and a long side of the ship is related to a maximum viewing range of the image capture device disposed on the long side.

18. 18. A correction system for the panoramic images of the ship according to claim 17, wherein the first distance is between 4 and 6 meters.

19. 14. The correction system for the panoramic image of the ship of claim 13, wherein the external correction mark and the internal correction mark are disposed at an elevation that is in the same horizontal plane as the waterline of the ship.

20. 1. An auxiliary method for a correction procedure of a panoramic image of a ship, comprising: providing a user interface for a user to input vessel information for said vessel; displaying on the user interface a plurality of set positions of a plurality of external correction marks and a plurality of internal correction marks, the set positions being obtained according to the vessel information and resolution information of a plurality of image capture devices, the image capture devices being disposed around the vessel, and the external correction marks and the internal correction marks being placed around the vessel according to the set positions; providing a plurality of frames for displaying a plurality of images captured by the image capture device; indicating two of the external correction marks and two of the internal correction marks in each of the images; and recording a plurality of position image coordinates of the external correction mark and the internal correction mark in the image, the position image coordinates being used to obtain the panoramic image.

Citation Information

Patent Citations

  • Ship panoramic look-around image acquisition method and system, and medium

    CN117412175A

  • Ship imaging apparatus and calibration method of the same

    JP2019186869A

  • Ship imaging system and ship comprising the same, and calibration method for ship imaging system

    JP2020150459A

  • Image correction method for camera system

    US20110285856A1

  • Camera calibration device, camera calibration system, and camera calibration method

    WO2015029934A1