A multi-sensor module device for high-precision relative navigation

The multi-sensor module device synchronizes sensor positions and movements to achieve high-precision relative navigation by aligning information from multiple sensors, addressing the challenges of fixed deployment and obstacle avoidance in coastal vessel navigation systems.

KR103047051B1Active Publication Date: 2026-11-11KOREA INSTITUTE OF OCEAN SCIENCE & TECHNOLOGY
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
KR1020210162469
Authority / Receiving Office
KR · KR
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-11-23
Publication Date
2026-11-11
Estimated Expiration
2041-11-23

AI Technical Summary

Technical Problem

Existing navigation systems for coastal vessels lack the capability to implement high-precision relative navigation by aligning information from multiple sensors while ensuring sensor positions are fixed and synchronized to avoid obstacles, and facilitate easy deployment and fixation on the vessel.

Method used

A multi-sensor module device comprising a body part with sensor assemblies, a lift-type height adjustment part, and a control part that aligns and synchronizes information from omnidirectional camera, radar, lidar, thermal imaging camera, and short-wavelength infrared camera, allowing simultaneous adjustment of sensor positions and obstacle avoidance.

Benefits of technology

Enables high-precision relative navigation by accurately determining the position of coastal vessels and recognizing surrounding conditions, including topography and sea conditions, while ensuring sensors maintain fixed positions and synchronize movements to avoid obstacles.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 112021135132518-PAT00001_ABST
    Figure 112021135132518-PAT00001_ABST
Patent Text Reader

Abstract

A multi-sensor module device for high-precision relative navigation according to the present invention comprises: a body part; a plurality of sensor assembly parts provided in the body part; a sensor part mounted on the sensor assembly part; a lift-type height adjustment part for controlling the vertical height of the body part; and a control part for aligning information measured by the sensor part to implement relative position information; wherein the sensor assembly part is characterized by being positioned at different heights and horizontal directions considering the field of view between sensors so that multiple sensors do not cross each other.
Need to check novelty before this filing date? Find Prior Art

Description

Technology Field

[0001] The present invention relates to a multi-sensor module device for high-precision relative navigation, and more specifically, to a multi-sensor module device for high-precision relative navigation configured to implement high-precision relative navigation by utilizing a module composed of multiple sensors to determine the precise location of a coastal vessel and to recognize the surrounding conditions, topography, and sea conditions of a port. Background Technology

[0003] Generally, navigation can be defined as a method of guiding a moving object from one point to another. Depending on its control principles, navigation can be classified into chronological navigation, celestial navigation, dead reckoning, and radio navigation. Representative systems include the Inertial Navigation System (INS), Global Navigation Satellite System (GNSS), Radio Navigation System, and Celestial Navigation System.

[0004] The current navigation system is the GPS satellite navigation system, which consists of 24 satellites placed in Earth's orbit, control stations on the ground that control the satellites, and GPS receivers for users. Four satellites are placed in each of the six orbits, so GPS receivers can receive signals from five to eight satellites simultaneously at any point on Earth.

[0005] The GPS measures the distance from the satellite to the receiver based on the principle of triangulation, and calculates the time difference between the time of generation and the time of reception of the code signal generated by each satellite, and then multiplies it by the speed of light. It also uses orbital ejection transmitted from the satellite to determine the position of the GPS receiver based on the position of the satellite.

[0006] However, as this dependence on GPS intensifies, many countries are making efforts to develop their own independent satellite navigation systems due to concerns regarding sovereignty, security, and the subjugation of related technologies.

[0007] Most countries that have not secured their own independent satellite positioning systems are making multifaceted efforts to enhance the precision and stability of positioning services by locally reinforcing or correcting existing systems, while simultaneously securing their own independent navigation systems to reduce or eliminate their dependence on external systems.

[0008] Therefore, a module composed of multiple sensors is used to determine the precise location of coastal vessels and to recognize surrounding conditions, terrain, and sea conditions such as harbors. In this case, relative navigation can be implemented by aligning information captured by each sensor to create a single image, thereby determining the location and recognizing surrounding conditions.

[0009] At this time, each sensor must have its position set considering the field of view between sensors, and must be deployed on the vessel in a fixed state without being disturbed by surrounding changes; furthermore, if an obstacle appears in front while positioned, the entire module must rise or fall in unison to avoid the obstacle, thereby enabling precise position determination.

[0010] In addition, the module must be able to move to the vessel with each sensor deployed and be securely fixed at the measurement location.

[0011] Therefore, there is a need to develop a multi-sensor module device for relative navigation in which multiple sensors are deployed to implement relative navigation, sensor positions are determined considering the angle of view between sensors, and not only can all sensors rise or fall simultaneously while their positions are fixed, but movement and fixation to the ship's measurement position are also easy. Prior art literature

[0013] [Patent Document] KR 10-2011-0133404 (Publication Date: December 12, 2011) The problem to be solved

[0014] To solve the above-mentioned problems, the present invention aims to provide a multi-sensor module device for high-precision relative navigation, comprising a body part, a plurality of sensor assembly parts provided in the body part, a sensor part composed of an omnidirectional camera, radar, lidar imaging camera, thermal imaging camera, and short-wavelength infrared camera, a lift-type height adjustment part that controls the vertical height of the body part, and a control part that implements relative position information by matching information measured by the sensor part, wherein the control part is configured to implement high-precision relative navigation by utilizing the multi-sensor module of the sensor part to determine the precise position of a coastal vessel and recognize the surrounding conditions of the port, terrain, and sea conditions. means of solving the problem

[0016] A multi-sensor module device for high-precision relative navigation according to an embodiment of the present invention for achieving the above-mentioned purpose comprises: a body part; a plurality of sensor assembly parts provided in the body part; a sensor part mounted on the sensor assembly part; a lift-type height adjustment part for controlling the vertical height of the body part; and a control part for aligning information measured by the sensor part to implement relative position information; wherein the sensor assembly part is characterized by being positioned at different heights and horizontal positions considering the field of view between sensors so that multiple sensors do not cross each other.

[0017] In addition, the sensor unit according to the present invention is characterized by comprising: an omnidirectional camera that visualizes high-quality images with a wide field of view in front; a radar that projects radio waves onto a front structure and generates a raw radar image using the reflected radio waves; a lidar that emits laser pulses to measure the distance to the front structure and images the shape of the structure; an image camera that secures a field of view with a plurality of cameras to image the situation in front in real time; a thermal imaging camera that detects and visualizes thermal radiation emitted from the front structure; and a short-wavelength infrared camera that visualizes a clear image when there is low visibility at sea using short-wavelength infrared rays.

[0018] In addition, the control unit according to the present invention is characterized by implementing relative position information by performing extrinsic calibration on the radar, lidar, imaging camera, thermal imaging camera, and short-wavelength infrared camera.

[0019] In addition, the control unit according to the present invention is characterized by projecting the laser point of the lidar onto a pixel coordinate for alignment of the image camera, the thermal image camera, and the lidar.

[0020] In addition, the control unit according to the present invention is characterized by analyzing the shooting cycles of the radar, lidar, omnidirectional camera, image camera, thermal image camera, and short-wavelength infrared camera to control the radar, lidar, omnidirectional camera, image camera, thermal image camera, and short-wavelength infrared camera so that they can photograph the forward structure at the same time.

[0021] In addition, the body portion according to the present invention is characterized by comprising: a bottom frame; and a longitudinal upright frame that is mounted on the bottom frame.

[0022] In addition, the height adjustment unit according to the present invention is characterized by being composed of a scissor link disposed on the bottom surface of the floor frame and varying the height of the floor frame as it is folded or unfolded by a driving means.

[0023] In addition, the multi-sensor module device for high-precision relative navigation according to the present invention comprises a moving part that moves and fixes the body part; wherein the moving part comprises a wheel; and a fixing foot disposed on one side of the wheel to fix or release the wheel.

[0024] In addition, the sensor assembly according to the present invention is characterized by comprising: a mounting member coupled to the body part and on which the sensor is mounted; and an LM guide that supports the mounting member to move linearly. Effects of the invention

[0026] According to the multi-sensor module device for high-precision relative navigation according to the present invention as described above, by utilizing a multi-sensor module of a sensor unit composed of an omnidirectional camera, radar, lidar, imaging camera, thermal imaging camera, and short-wavelength infrared camera, it is possible to achieve high-precision relative navigation by accurately determining the position of a coastal vessel and recognizing the surrounding conditions, topography, and sea conditions of a port.

[0027] In addition, by providing a control unit, the shooting cycles of radar, lidar, omnidirectional camera, image camera, thermal image camera, and short-wavelength infrared camera, which have different shooting cycles, are analyzed, and the multi-sensor module is enabled to photograph the front structure at the same time.

[0028] In addition, by providing a height adjustment unit composed of scissor links that vary the height of the bottom frame of the body, when an obstacle appears in front, the entire module rises or falls in unison without the position of each sensor changing, thereby enabling precise position identification of the front structure.

[0029] In addition, it must be equipped with a moving part consisting of wheels and fixed feet so that the module can move on the vessel with each sensor positioned and be securely fixed at the measurement location.

[0030] In addition, the multi-sensor module device for high-precision relative navigation according to the present invention has the effect that each sensor is set to a position considering the angle of view between sensors, and the set position can be placed on a ship in a fixed state without being disturbed by surrounding changes. Brief explanation of the drawing

[0032] FIG. 1 is a configuration diagram showing the overall configuration of a multi-sensor module device for high-precision relative navigation according to the present invention. FIG. 2(a) is a plan view showing the configuration of a multi-sensor module device for high-precision relative navigation according to the present invention. FIG. 2(b) is a front view showing the configuration of a multi-sensor module device for high-precision relative navigation according to the present invention. FIG. 3 is a diagram showing the configuration of the sensor unit and the control unit according to the present invention. FIG. 4 is a diagram showing the configuration of the height adjustment unit and the moving unit according to the present invention. Figure 5 is a conceptual diagram of the alignment of a camera and a lidar according to the present invention. FIG. 6 is a figure showing a state in which a multi-sensor module device for high-precision relative navigation according to the present invention is arranged on a ship. Specific details for implementing the invention

[0033] Hereinafter, embodiments of the present invention will be described with reference to the attached drawings. First, it should be noted that identical components or parts in the drawings are indicated by the same reference numerals whenever possible. In describing the present invention, specific descriptions of related known functions or configurations are omitted to avoid obscuring the essence of the invention.

[0035] FIG. 1 is a configuration diagram showing the overall configuration of a multi-sensor module device for high-precision relative navigation according to the present invention, FIG. 2(a) is a plan view showing the configuration of a multi-sensor module device for high-precision relative navigation according to the present invention, FIG. 2(b) is a front view showing the configuration of a multi-sensor module device for high-precision relative navigation according to the present invention, and FIG. 6 is a diagram showing the state in which a multi-sensor module device for high-precision relative navigation according to the present invention is deployed on a ship.

[0037] A multi-sensor module device (1) for high-precision relative navigation according to the present invention may include a body part (100), a sensor assembly part (200), a sensor part (300), a height adjustment part (400), a control part (500), a movement part (600), and a power supply part (700), as shown in FIGS. 1 to 2(b) and FIG. 6.

[0039] The above body part (100) may be a frame constituting the exterior of a multi-sensor module device (1) for high-precision relative navigation according to the present invention.

[0040] Additionally, the body portion (100) may include a bottom frame (110) and a longitudinal upright frame (120) that is mounted on the bottom frame (110).

[0041] Additionally, the sensor assembly (200) can be connected to the upright frame (120), and a height adjustment part (400) can be placed on the bottom surface of the floor frame (110).

[0043] The sensor assembly part (200) is provided in multiple units on the body part (100) so that the sensors of the sensor part (300) are mounted thereon.

[0044] In addition, the sensor assembly (200) can be positioned at different heights and horizontal positions considering the angle of view between sensors so that multiple sensors do not cross.

[0045] Additionally, as illustrated, the sensor assembly (200) may have a radar (320) positioned at the top, and a lidar (330), an omnidirectional camera (310), and a thermal imaging camera (350) positioned on the upright frame (120), and an omnidirectional camera (310) positioned at the bottom of the lidar (330), and an image camera (340), a thermal imaging camera (350), and a short-wavelength infrared camera (360) positioned at the bottom of the omnidirectional camera (310).

[0046] Additionally, the sensor assembly (200) may be positioned differently from the location described above, although it is not illustrated.

[0047] Additionally, the sensor assembly (200) may include a mounting member (210) that is coupled to the body part (100) and on which the sensor is mounted, and an LM guide (220) that supports the mounting member (210) to move linearly.

[0049] The above LM guide (220) slides the mounting member (210) up and down or left and right, allowing the sensor assembly (200) to move precisely when considering the angle of view between sensors or when an obstacle appears in front.

[0050] In addition, the above LM guide (220) may be any known one without limitation.

[0052] FIG. 3 is a diagram showing the configuration of the sensor unit and the control unit according to the present invention.

[0054] The sensor unit (300) according to the present invention, as shown in FIG. 3, is a sensor placed in the sensor assembly unit (200) for high-precision relative navigation and may include an omnidirectional camera (310), a radar (320) that projects radio waves onto a forward structure and generates a raw radar image using the reflected radio waves, a lidar (330) that emits laser pulses to measure the distance to the forward structure and images the shape of the structure, an image camera (340) that secures a viewing angle with a plurality of cameras to image the situation in front in real time, a thermal image camera (350) that detects and visualizes thermal radiation emitted from the forward structure, and a short-wavelength infrared camera (360) that visualizes a clear image when there is low visibility at sea using short-wavelength infrared rays.

[0055] Accordingly, the sensor unit (300) is composed of the six sensors mentioned above, and the control unit (500) aligns images captured by the six sensors to generate a single image, thereby enabling high-precision relative navigation to be implemented.

[0057] FIG. 4 is a diagram showing the configuration of the height adjustment unit and the moving unit according to the present invention.

[0059] The height adjustment unit (400) according to the present invention is configured as a lift type that controls the upper and lower height of the body unit (100) as shown in FIG. 4.

[0060] Additionally, the height adjustment unit (400) may be configured as a scissor link (410) that is positioned on the bottom surface of the floor frame (110) and allows the height of the floor frame (110) to be varied as it is folded or unfolded by a driving means.

[0061] Accordingly, the height adjustment unit (400) allows the entire module to rise or fall in the same manner without variation, even if an obstacle appears at the position of the aligned sensor assembly unit (200), taking into account the viewing angle between sensors so that multiple sensors do not cross.

[0063] Figure 5 is a conceptual diagram of the alignment of a camera and a lidar according to the present invention.

[0065] The control unit (500) according to the present invention implements relative position information by matching the information measured by the sensor unit (300) as shown in FIG. 5.

[0066] In addition, the control unit (500) can implement high-density relative position information by performing extrinsic calibration on the radar (320), lidar (330), and thermal imaging camera (350).

[0067] In addition, the control unit (500) projects the laser point of the lidar (330) onto the pixel coordinate for alignment of the thermal imaging camera (350) and the lidar (330).

[0068] Additionally, the control unit (500) analyzes the shooting cycles of the radar (320), lidar (330), omnidirectional camera (310), image camera (340), thermal image camera (350), and short-wavelength infrared camera (360) to control the radar (320), lidar (330), omnidirectional camera (310), image camera (340), thermal image camera (350), and short-wavelength infrared camera (360) so that they can photograph the front structure at the same time.

[0069] Accordingly, the control unit (500) analyzes the shooting cycles of the radar (320), lidar (330), omnidirectional camera (310), image camera (340), thermal image camera (350), and short-wavelength infrared camera (360), which have different shooting cycles, and controls the shooting time so that the six sensors can shoot the front structure at the same time.

[0071] The above moving part (600) is a means of movement that moves and fixes the above body part (100).

[0072] Accordingly, the moving part (600) may include a wheel (610) and a fixing foot (620) disposed on one side of the wheel (610) to fix and release the wheel (610) after it has finished moving.

[0074] The fixed foot (620) is connected to one side of the wheel (610) and is positioned so as not to touch the ground while moving, and is connected to one side of the wheel and rotates so as to be able to touch the ground when fixed.

[0075] In addition, the fixed foot (620) is inserted into a fixed hole (11) through the ground of the ship (10) where the multi-sensor module device (1) is placed, as shown in FIG. 4, so that the module device can be safely fixed even during the operation of the ship (10) which has many positional variations.

[0077] The above power supply unit (700) is a power supply unit that supplies power to the multi-sensor module device (1) according to the present invention, and can be placed in the body unit (100) as illustrated.

[0079] According to the multi-sensor module device for high-precision relative navigation according to the present invention as described above, by utilizing a multi-sensor module of a sensor unit composed of an omnidirectional camera, radar, lidar, imaging camera, thermal imaging camera, and short-wavelength infrared camera, it is possible to achieve high-precision relative navigation by accurately determining the position of a coastal vessel and recognizing the surrounding conditions, topography, and sea conditions of a port.

[0080] In addition, by providing a control unit, the shooting cycles of radar, lidar, front camera, image camera, thermal image camera, and short-wavelength infrared camera, which have different shooting cycles, are analyzed, and the multi-sensor module is made to shoot the front structure at the same time.

[0081] In addition, by providing a height adjustment unit composed of scissor links that vary the height of the bottom frame of the body, when an obstacle appears in front, the entire module rises or falls in unison without the position of each sensor changing, thereby enabling precise position identification of the front structure.

[0082] In addition, it must be equipped with a moving part consisting of wheels and fixed feet so that the module can move on the vessel with each sensor positioned and be securely fixed at the measurement location.

[0083] In addition, the multi-sensor module device for high-precision relative navigation according to the present invention has the effect that each sensor is set to a position considering the angle of view between sensors, and the set position can be placed on a ship in a fixed state without being disturbed by surrounding changes.

[0085] The terms and words used in the specification and claims described herein should not be interpreted as being limited to their ordinary or dictionary meanings, and should be interpreted in a meaning and concept consistent with the technical spirit of the invention, based on the principle that the inventor can appropriately define the concept of the terms to best describe his invention.

[0087] Therefore, the configurations illustrated in the drawings and embodiments described in this specification are merely one preferred embodiment of the present invention and do not represent all technical ideas of the present invention; thus, it should be understood that various equivalents and modifications that can replace them may exist at the time of filing this application. Explanation of the symbols

[0089] 1: Multi-sensor module device for high-precision relative navigation 10 : Ship 11 : Fixed worker 100 : Body part 110 : Bottom frame 120 : Upright frame 200 : Sensor assembly part 210: Seating member 220: LM guide 300: Sensor unit 310: Omnidirectional camera 320 : Radar 330 : Lidar 340: Imaging camera 350: Thermal imaging camera 360: Short-wavelength infrared camera 400: Height adjustment unit 410 : Caesar link 500 : Control unit 600 : Moving part 610 : Wheel 620 : Fixed feet 700 : Power supply

Claims

Claim 1 It comprises: a body part; a plurality of sensor assembly parts provided in the body part; a sensor part mounted in the sensor assembly part; a lift-type height adjustment part for controlling the vertical height of the body part; and a control part for aligning information measured by the sensor part to implement relative position information; wherein the sensor assembly part is positioned at different heights and horizontal positions considering the field of view between sensors so that multiple sensors included in the sensor part do not cross each other, and the sensor part comprises, with the plurality of sensors, an omnidirectional camera that visualizes high-definition images with a wide field of view in front; a radar that projects radio waves onto a front structure and generates a raw radar image using the reflected radio waves; a lidar that emits laser pulses to measure the distance to the front structure and images the shape of the front structure; an image camera that secures a field of view with a plurality of cameras to image the situation in front in real time; and a thermal imaging camera that detects and visualizes thermal radiation emitted from the front structure. It includes a short-wavelength infrared camera that visualizes a clear image when there is low visibility at sea using short-wavelength infrared rays; wherein the control unit analyzes the shooting cycles of the radar, lidar, omnidirectional camera, image camera, thermal camera, and short-wavelength infrared camera, and controls the shooting time so that the radar, lidar, omnidirectional camera, image camera, thermal camera, and short-wavelength infrared camera, which have different shooting cycles, can photograph the forward structure at the same time; wherein the control unit implements relative position information by performing extrinsic calibration on the radar, lidar, image camera, thermal camera, and short-wavelength infrared camera, and projects the laser point of the lidar onto a pixel coordinate for alignment of the image camera, the thermal camera, and the lidar; and the body part comprises a bottom frame; and a longitudinal upright frame that rises on the bottom frame;A multi-sensor module device for high-precision relative navigation, comprising: a height adjustment unit comprising a scissor link disposed on the bottom surface of the bottom frame and varying the height of the bottom frame as it is folded or unfolded by a driving means; a moving unit for moving and fixing the body unit; wherein the moving unit comprises a wheel; and a fixing foot disposed on one side of the wheel for fixing or releasing the wheel; wherein the sensor assembly unit comprises a mounting member coupled to the body unit and on which the sensor is mounted; and an LM guide supporting the mounting member to move linearly; wherein the fixing foot rotates so as not to touch the ground when the wheel is moving and to touch the ground when the wheel is fixed, and is inserted into a fixing hole through the ship's ground where the multi-sensor module device is disposed, thereby enabling the multi-sensor module device to be safely fixed even during ship operation with frequent positional changes. Claim 2 delete Claim 3 delete Claim 4 delete Claim 5 delete Claim 6 delete Claim 7 delete Claim 8 delete Claim 9 delete

Citation Information

Patent Citations

  • Automatic matching method of digital aerial images using lidar data

    KR100973052B1

  • Movement type stage for music play

    KR101572230B1

  • Cell guide measuring apparatus

    KR1020170058560A

  • Mobile X-ray imaging apparatus

    KR1020180043716A

  • Method for context awareness of unmanned ship system and apparatus for the same

    KR1020200095888A