Direction estimation device, direction estimation system, direction estimation method, and direction estimation program

The direction estimation device uses multi-beam sonar to estimate the vertical incidence direction and calculate distances, addressing the inaccuracies in conventional sonar systems for positioning and shape monitoring of underwater structures.

WO2024242156A1PCT designated stage expired Publication Date: 2024-11-28THE UNIV OF TOKYO
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2024/018935
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-23
Filing Date
2024-05-23
Publication Date
2024-11-28

AI Technical Summary

Technical Problem

Conventional sonar systems struggle to accurately measure the angle of incidence of sound waves on target objects, leading to errors in positioning and shape monitoring of mooring lines and other underwater structures, particularly due to the difficulty in obtaining precise vertical incidence directions.

Method used

A direction estimation device and system that utilizes multi-beam sonar to emit sound waves in various directions, acquiring time-series listening results and estimating the vertical incidence direction based on listening result information, which includes zenith and declination angles, to determine the position of objects with reduced error by calculating the distance between the sonar and the target object.

Benefits of technology

This approach allows for accurate suppression of errors in measuring object positions and shapes, enabling precise monitoring of mooring lines and other underwater structures by determining the vertical incidence direction and calculating distances with high accuracy.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2024018935_28112024_PF_FP_ABST
    Figure JP2024018935_28112024_PF_FP_ABST
Patent Text Reader

Abstract

This direction estimation device comprises: an information acquisition unit that acquires listening result information indicating time-series listening results obtained through measurement using a sonar that emits a sound wave beam in a plurality of directions, the listening results being results of listening to sound waves from a plurality of listening directions including at least some of the plurality of directions; and a direction estimation unit that estimates a perpendicular incident direction in which the sound wave beam strikes an object of interest at a right angle on the basis of the listening result information.
Need to check novelty before this filing date? Find Prior Art

Description

Direction estimation device, direction estimation system, direction estimation method, and direction estimation program CROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This application is based on Japanese Patent Application No. 2023-84885, filed on May 23, 2023, the contents of which are incorporated herein by reference.

[0002] The present invention relates to a direction estimation device, a direction estimation system, a direction estimation method, and a direction estimation program.

[0003] There is a mooring line load monitoring system that remotely monitors failures and breakages of mooring lines of floating bodies such as ships (for example, Non-Patent Document 1).

[0004] LCM SYSTEMS., Mooring Line Load Monitoring (MLM). [Retrieved April 21, 2023], Internet <URL: https: / / www.lcmsystems.com / Applications / load-cells-load-pins-for-mooring-line-load-monitoring-mlm>

[0005] In the mooring line load monitoring system described in Non-Patent Document 1, sensors such as strain gauges are attached to the upper end or middle of the mooring line, and the sensor output values ​​are constantly monitored. This monitoring makes it possible to detect critical events such as mooring line breakage and predict the risk of breakage due to excessive tension. However, the strain and other information obtained from the sensor is merely fragmentary information at a certain point on the line, making it difficult to accurately monitor the overall shape and behavior of the mooring line, as well as the amount and distribution of biofouling.

[0006] To monitor these accurately, technology is required to measure the position of mooring lines with small error.

[0007] Therefore, an object of the present disclosure is to provide a direction estimation device, a direction estimation system, a direction estimation method, and a direction estimation program that are capable of suppressing errors when measuring the position of an object.

[0008] A direction estimation device according to one aspect of the present invention includes an information acquisition unit that acquires listening result information indicating time-series listening results measured by a sonar that emits sound beams in multiple directions, the listening results being sound waves from multiple listening directions including at least some of the multiple directions, and a direction estimation unit that estimates the normal incidence direction in which the sound beam is normal to an object based on the listening result information.

[0009] While conventional sonars can measure the direction of an object as seen from the sonar and the distance between the sonar and the object, it is difficult to accurately obtain the angle of incidence of the sound beam relative to the object, which can result in errors in measuring the object's position. In contrast, with a method that estimates the perpendicular incident direction in which the sound beam perpendicularly strikes the object, the position of the object, a distance measured by the sonar in the estimated perpendicular incident direction, can be determined as the position of the object with reduced errors. Therefore, errors in measuring the object's position can be reduced.

[0010] In the above aspect, the sound listening result information may indicate the sound listening results of the sound waves from the plurality of sound listening directions for each zenith angle and each deviation angle.

[0011] According to this aspect, since a plurality of sound listening directions can be expressed in polar coordinates based on the sonar, the process of estimating the normal incident direction can be simplified.

[0012] In the above aspect, the information acquisition unit acquires, as the listening result information, image information for each zenith angle, which indicates a fan-shaped image whose radius and central angle are the elapsed time from the time the sound beam was emitted and the deflection angle, respectively, and which includes an image corresponding to the reflection of the sound beam from the object, and the direction estimation unit may estimate the vertical incident direction based on the image information for each zenith angle.

[0013] According to this aspect, the change in the image relative to the zenith angle, i.e., the change in the image relative to the angle of incidence, can be easily obtained. This makes it easy to estimate the normal incidence direction by utilizing the property that the image length changes depending on the angle of incidence of the sound beam on the target.

[0014] In the above aspect, the direction estimation unit may estimate the direction of normal incidence based on a length of each of the images included in each of the images indicated by the image information for each of the zenith angles.

[0015] According to this aspect, for example, when the object is linear, the perpendicular incident direction can be accurately determined by utilizing the property that the image length becomes shorter the closer the angle at which the sound beam is incident on the object is to perpendicular.

[0016] In the above aspect, the direction estimation unit may further calculate the distance between the sonar and the object based on the image information when the estimated normal incident direction is included in the sound wave beam.

[0017] According to this aspect, in an image in which the perpendicular incident direction is included in the sound beam, the distance between the center of the fan and the image is the distance between the position where the sound beam is perpendicularly incident on the object and the sonar, and by utilizing this property, the distance between the position where the sound beam is perpendicularly incident on the object and the sonar can be accurately calculated.

[0018] In the above aspect, the object may appear to the sonar as a straight line.

[0019] If the object is planar, it is necessary to estimate its direction in advance and measure it from the appropriate direction. For example, if the object is a flat seabed, it is necessary to measure it from above, and if it is a vertical wall, it is necessary to measure it from the side. According to this aspect, the shape of the object can be treated as a straight line, so it can be measured without estimating the appropriate direction in advance. Furthermore, it is possible to easily derive the relationship between the angle at which the sound beam is incident on the object and the image length. This makes it easy to estimate the perpendicular incident direction.

[0020] In the above aspect, the distance between the sonar and a plane including the target object may be smaller than a value determined based on the distance between the sonar and the target object.

[0021] In this way, by positioning the sonar near a plane including the target object, it is possible to suppress deterioration in the accuracy of estimating the normal incident direction.

[0022] In the above aspect, the direction estimation device may further include a memory unit that stores pairs of the normal incident direction and the distance, and a shape estimation unit that estimates a shape of the object based on the plurality of pairs stored in the memory unit.

[0023] According to this aspect, for example, a curve that closely approximates the multiple positions represented by the multiple sets is calculated, and the shape of the entire object can be estimated by assuming that the curve represents the shape of the object. This makes it possible to estimate the shape of the entire object based on the measurement results of some positions on the object.

[0024] In the above aspect, the sonar may be a multi-beam sonar.

[0025] According to this aspect, it is possible to efficiently obtain the results of listening to sound waves from multiple listening directions, and it is possible to suppress variation in the listening directions, thereby suppressing deterioration in the estimation accuracy of the perpendicular incident direction.

[0026] In the above aspect, the sonar may be a scanning sonar.

[0027] According to this aspect, the results of listening to sound waves from a plurality of listening directions can be obtained at low cost.

[0028] A direction estimation system according to another aspect of the present invention comprises an underwater robot equipped with a sonar and the above-mentioned direction estimation unit, wherein the sonar emits sound beams in multiple directions and listens to sound waves from multiple listening directions including at least some of the multiple directions, and generates listening result information indicating the listening results over time.

[0029] Conventional sonars can measure the direction of an object as seen from the sonar and the distance between the sonar and the object, but it is difficult to accurately obtain the angle of incidence of the sound beam relative to the object, resulting in errors in measuring the object's position. In contrast, a sonar that estimates the perpendicular incident direction in which the sound beam is perpendicular to the object can determine the object's position with reduced error as a position that is a distance measured by the sonar from the estimated perpendicular incident direction. Therefore, errors in measuring the object's position can be reduced. Furthermore, since the sonar is installed on an underwater robot that can move freely underwater, it is possible to measure many positions of the object. This allows the overall shape of the object to be obtained.

[0030] In the above aspect, the sonar may be a multi-beam sonar that measures the sound waves from the listening directions for each declination angle among the plurality of listening directions, and the underwater robot may include a mechanism that points the sonar toward the listening directions for each zenith angle among the plurality of listening directions.

[0031] According to this aspect, it is possible to easily generate sound listening result information that indicates the results of listening to sound waves from a plurality of sound listening directions for each zenith angle and each deviation angle.

[0032] A direction estimation method according to another aspect of the present invention is a direction estimation method for a direction estimation device, which includes acquiring listening result information indicating a time series of listening results measured by a sonar that emits sound beams in a plurality of directions, the listening results being of sound waves from a plurality of listening directions including at least some of the plurality of directions, and estimating a normal incidence direction in which the sound beam is perpendicularly incident on an object based on the listening result information.

[0033] While conventional sonars can measure the direction of an object as seen from the sonar and the distance between the sonar and the object, it is difficult to accurately obtain the angle of incidence of the sound beam relative to the object, which can result in errors in measuring the object's position. In contrast, with a method that estimates the perpendicular incident direction in which the sound beam perpendicularly strikes the object, the position of the object, a distance measured by the sonar in the estimated perpendicular incident direction, can be determined as the position of the object with reduced errors. Therefore, errors in measuring the object's position can be reduced.

[0034] A direction estimation program according to another aspect of the present invention is a direction estimation program used in a direction estimation device, and is a program for causing a computer to function as an information acquisition unit that acquires listening result information that indicates the time-series listening results measured by a sonar that emits sound beams in multiple directions, the listening results of sound waves from multiple listening directions that include at least some of the multiple directions, and a direction estimation unit that estimates the perpendicular incident direction in which the sound beam is perpendicularly incident on an object based on the listening result information.

[0035] While conventional sonars can measure the direction of an object as seen from the sonar and the distance between the sonar and the object, it is difficult to accurately obtain the angle of incidence of the sound beam relative to the object, which can result in errors in measuring the object's position. In contrast, with a method that estimates the perpendicular incident direction in which the sound beam perpendicularly strikes the object, the position of the object, a distance measured by the sonar in the estimated perpendicular incident direction, can be determined as the position of the object with reduced errors. Therefore, errors in measuring the object's position can be reduced.

[0036] According to the present disclosure, it is possible to provide a direction estimation device, a direction estimation system, a direction estimation method, and a direction estimation program that are capable of suppressing errors when measuring the position of an object.

[0037] FIG. 1 is a diagram for explaining the position of an underwater robot relative to a mooring line according to an embodiment of the present disclosure; FIG. 2 is a diagram for explaining the configuration of a direction estimation system according to an embodiment of the present disclosure; FIG. 3 is a diagram for explaining the configuration of an underwater robot according to an embodiment of the present disclosure; FIG. 4 is a diagram for explaining the orientation of an MBS in an underwater robot according to an embodiment of the present disclosure; FIG. 5 is a diagram for explaining the orientation of an MBS in an underwater robot according to an embodiment of the present disclosure; FIG. 6 is a diagram for explaining the orientation of an MBS in an underwater robot according to an embodiment of the present disclosure; FIG. 7 is a diagram for explaining an example of an acoustic image according to an embodiment of the present disclosure; FIG. 8 is a diagram for explaining an example of a head swing mechanism according to an embodiment of the present disclosure; FIG. 9 is a diagram for explaining the principle of direction estimation performed by a direction estimation device according to an embodiment of the present disclosure; FIG. 10 is a diagram for explaining the principle of direction estimation performed by a direction estimation device according to an embodiment of the present disclosure; * image 1 is a diagram illustrating an example of a change in the theoretical solution of the equation (1) with respect to the swing angle α. FIG. 2 is a diagram illustrating a configuration of a direction estimation device according to an embodiment of the present disclosure. FIG. 3 is a diagram illustrating an example of a change in the theoretical solution of the equation (1) with respect to the swing angle α. * image1 is a diagram showing an example of a time change of . A diagram showing an example of a result of fitting by a fitting unit according to an embodiment of the present disclosure. A diagram showing an example of an object angle α0 calculated for each scan by a fitting unit according to an embodiment of the present disclosure. A diagram showing an example of a distance d calculated for each scan by a fitting unit according to an embodiment of the present disclosure. A diagram for explaining a method for calculating coordinates of a mooring line according to an embodiment of the present disclosure. A diagram showing an example of a measurement result of the absolute ... flowchart defining an operation procedure when a direction estimation device 11 according to an embodiment of the present disclosure performs a direction estimation process. A flowchart defining an operation procedure when a direction estimation device according to an embodiment of the present disclosure performs a measurement process. A flowchart defining an operation procedure when a direction estimation device according to an embodiment of the present disclosure performs an information acquisition process. A flowchart defining an operation procedure when a direction estimation device according to an embodiment of the present disclosure performs a calculation process of target position coordinates. A diagram showing an example of an object angle α0 calculated for each scan by a fitting unit in a first modified example of a direction estimation device according to an embodiment of the present disclosure.

[0038] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A preferred embodiment of the present invention will be described with reference to the accompanying drawings. In the drawings, components with the same reference numerals have the same or similar configurations.

[0039] First Embodiment FIG. 1 is a diagram illustrating the position of an underwater robot relative to a mooring line according to one embodiment of the present disclosure.

[0040] Each drawing may show an X-axis, a Y-axis, and a Z-axis. The X-axis, the Y-axis, and the Z-axis are coordinate axes fixed to the Earth and form a right-handed three-dimensional Cartesian coordinate system. The vertical downward direction is the positive direction of the Z-axis. In other words, the X-axis and the Y-axis point horizontally. Hereinafter, the direction of the X-axis arrow may be referred to as the X-axis + side, and the direction opposite to the arrow may be referred to as the X-axis - side, and the same applies to the other axes. The Z-axis + side and the Z-axis - side may be referred to as the "lower side" and "upper side," respectively. The Z-axis direction may also be referred to as the "depth direction." The planes perpendicular to the X-axis, Y-axis, or Z-axis, respectively, may be referred to as the YZ plane, ZX plane, or XY plane.

[0041] The mooring line 401 (object) is, for example, a chain that moored a float supporting a wind turbine from the seabed surface Pb in a floating wind power generation system. When one end of the mooring line 401 is fixed to the float and the other end of the mooring line 401 is fixed to the seabed surface Pb, the mooring line 401 hangs down under its own weight to form a catenary curve (a catenary curve). This mooring method, in which mooring force is obtained by the own weight of the hanging mooring line 401, is called catenary mooring. Hereinafter, the plane including the mooring line 401 may be referred to as the moving plane Pm. In this embodiment, the moving plane Pm is parallel to the ZX plane.

[0042] The underwater robot 111 is a remotely operated unmanned underwater robot (Remotely Operated Vehicle: ROV) that is remotely controlled by an operator from outside the underwater robot 111 (for example, on a ship or on land). The underwater robot 111 may be an underwater robot that is directly operated by a human, or an underwater robot that autonomously performs missions without assistance such as human operation.

[0043] The underwater robot 111 has, for example, five thrusters and is capable of controlling five degrees of freedom: surge, sway, heave, pitch, and yaw.

[0044] The underwater robot 111 is provided with a multibeam imaging sonar 114 (hereinafter sometimes referred to as MBS 114).

[0045] In response to remote control from outside, the underwater robot 111 moves to a position (hereinafter sometimes referred to as the preferred position) suitable for measuring the position (hereinafter sometimes referred to as the relative position) of the mooring line 401 when the underwater robot 111 is used as a reference.

[0046] The preferred position is, for example, a position that satisfies the condition that the distance between the movement plane Pm and the MBS 114 is smaller than the distance between the MBS 114 and the mooring line 401.

[0047] Preferably, the position satisfies the condition that the distance between the moving plane Pm and the MBS 114 is smaller than a value determined based on the distance between the MBS 114 and the mooring line 401. Specifically, the distance between the moving plane Pm and the MBS 114 is smaller than 100% (preferably, 20%) of the distance between the MBS 114 and the mooring line 401.

[0048] More preferably, the preferred position is, for example, a position that satisfies the condition that the MBS 114 intersects with the moving plane Pm. In this case, the distance between the moving plane Pm and the MBS 114 is smaller than, for example, 2% of the distance between the MBS 114 and the mooring line 401.

[0049] Specifically, five thrusters in the underwater robot 111 operate in response to remote control from outside, causing the underwater robot 111 to change depth and move horizontally within the movement plane Pm. When the underwater robot 111 is in a suitable position, the mooring line 401 appears straight when viewed from the MBS 114.

[0050] 2 is a diagram showing the configuration of a direction estimation system according to an embodiment of the present disclosure. As shown in FIG. 2, the direction estimation system 201 includes a computer 101 and an underwater robot 111.

[0051] The computer 101 is installed, for example, on land. The computer 101 may also be installed on a floating body, a ship, or an underwater robot 111.

[0052] The computer 101 includes a processor 21, a bus 22, a communication I / F (interface) 23, a memory 24 (storage unit), and a disk 25 (storage unit). The computer 101 is, for example, a personal computer.

[0053] In the computer 101, a processor 21, a communication unit 23, a memory 24, and a disk 25 are connected via a bus 22 so that they can exchange data with one another.

[0054] The memory 24 is a volatile storage device such as a dynamic random access memory (DRAM). The communication unit 23 and the underwater robot 111, which is provided outside the computer 101, are connected by, for example, a cable. The communication unit 23 communicates with the underwater robot 111 via the cable.

[0055] The communication unit 23 transmits various data to the underwater robot 111 in accordance with instructions from the processor 21. The communication unit 23 also receives various data transmitted from the underwater robot 111 and outputs the received data to the processor 21.

[0056] The disk 25 is a readable / writable nonvolatile storage device such as a hard disk drive (HDD) or a solid state drive (SSD), and stores a program (code). The disk 25 is not limited to an HDD or an SSD, but may also be a memory card, a read-only CD-ROM (Compact Disc Read Only Memory), or a DVD-ROM (Digital Versatile Disc Read Only Memory). The program can also be installed externally. The program is distributed in a state stored on a storage medium readable by the computer 101, such as the disk 25. The program may also be distributed over the Internet connected via a communication interface.

[0057] When executing a program, the processor 21 transfers the program stored on the disk 25 and data required to execute the program to the memory 24. The processor 21 reads processing instructions and data required to execute the program from the memory 24 and performs arithmetic processing in accordance with the contents of the processing instructions. At this time, the processor 21 may newly generate data required to execute the program and store it in the memory 24. Note that the processor 21 is not limited to a configuration in which it obtains the program and data from the disk 25, and may also be configured to obtain the program and data from a server or the like via the Internet.

[0058] 3 is a diagram showing the configuration of an underwater robot according to one embodiment of the present disclosure. As shown in Fig. 3, the underwater robot 111 includes a communication unit 112, a swing mechanism 113, an MBS 114, a thruster control unit 115, an absolute coordinate measurement unit 116, and a swing angle measurement unit 117.

[0059] A communication unit 112 in the underwater robot 111 communicates with the computer 101. A thruster control unit 115 controls five thrusters based on control information received from the computer 101 via the communication unit 112.

[0060] The absolute coordinate measuring unit 116 measures, for example, coordinates indicating the position of the underwater robot 111 relative to a reference point on the Earth (hereinafter sometimes referred to as absolute coordinates).

[0061] The absolute coordinate measurement unit 116 includes, for example, a one-axis fiber optic gyro (FOG) and a Doppler velocity log (DVL). The amount of movement of the underwater robot 111 is calculated, for example, by integrating the horizontal ground speed measured by the DVL along the azimuth angle obtained by integrating the angular velocity of the azimuth angle measured by the FOG. The absolute coordinate measurement unit 116 measures the absolute coordinates of the underwater robot 111 by adding the calculated amount of movement to the absolute coordinates of the initial position.

[0062] The absolute coordinate measuring unit 116 measures the absolute coordinates of the underwater robot 111 at a predetermined interval, and transmits absolute coordinate information indicating the measured absolute coordinates to the computer 101 via the communication unit 112, for example.

[0063] 4 to 6 are diagrams for explaining the orientation of the MBS 114 in the underwater robot according to one embodiment of the present disclosure.

[0064] 4 to 6, the x-axis, y-axis, and z-axis are defined as Cartesian coordinates fixed to the MBS 114. The x-axis, y-axis, and z-axis form a right-handed, three-dimensional Cartesian coordinate system. When the underwater robot 111 moves as designed and is in a suitable position, the x-axis is parallel to the y-axis, and the y-axis and z-axis are parallel to the plane of movement Pm.

[0065] Fig. 4 is a diagram of the MBS 114 viewed from the -y-axis side, Fig. 5 is a diagram of the MBS 114 viewed from the -x-axis side, and Fig. 6 is a diagram of the MBS 114 viewed from the +z-axis side.

[0066] The MBS 114 emits an acoustic beam 411 (sound wave beam) in multiple directions, listens to sound waves from multiple listening directions including at least some of the multiple directions, and generates listening result information that indicates the listening results in time series.

[0067] In detail, in one measurement, the MBS 114 emits an acoustic beam 411 in multiple directions in the zx plane and listens to sound waves from the multiple directions. The traveling direction of the acoustic beam 411 and the direction in which the sound waves are listened to (e.g., listening direction Da) are, for example, the same. The listening direction Da in the zx plane is defined by the deflection angle β when the z axis is used as the reference. Note that the traveling direction of the acoustic beam 411 and the direction in which the sound waves are listened to may be different.

[0068] That is, in one measurement, the MBS 114 emits the acoustic beam 411 in a plurality of listening directions Da determined by a plurality of deflection angles β, and listens to sound waves from the plurality of listening directions Da.

[0069] 7 is a diagram illustrating an example of an acoustic image according to an embodiment of the present disclosure. As shown in FIGS. 4 to 7, the MBS 114 generates a fan-shaped acoustic image 301 having a radius and a central angle that are the elapsed time since the acoustic beam 411 was emitted and the deflection angle β, respectively, and including an image 302 corresponding to the echo of the acoustic beam 411 from the mooring line 401. In this embodiment, the acoustic image 301 further includes an image 303 corresponding to the echo of the acoustic beam 411 from the sea surface.

[0070] An image can exist within the range of the fan-shaped acoustic image 301. The measurement origin of the MBS 114 is located at the intersection of two radii passing through both ends of the fan-shaped arc, that is, at the center of the fan.

[0071] As a coordinate representation within the acoustic image 301 (hereinafter sometimes referred to as acoustic image coordinates), the above intersection point is defined as the origin, and u-axis and v-axis that are orthogonal to each other are defined. The u-axis direction is, for example, a direction that bisects the central angle of the sector, and is taken so as to show time-series sound listening results based on the acoustic beam 411 emitted in the z-axis direction. The direction Dr defined by the deflection angle β when the u-axis is used as the reference shows time-series sound listening results based on the acoustic beam 411 emitted in the sound listening direction Da (see FIG. 5 ).

[0072] The radius of the sector is the maximum distance R (hereinafter, sometimes referred to as the measurement range R) that can be measured by the MBS 114. The measurement range R of the MBS 114 is set appropriately according to the size of the mooring line 401.

[0073] When the MBS 114 receives an echo based on the acoustic beam, the position of the image is determined by the direction of the echo and the time elapsed from the time the acoustic beam 411 is emitted until the echo is received. The shorter the time elapsed until the echo returns, the closer the image is to the origin (0,0) of the acoustic image coordinates, and the longer the time elapsed, the closer the image is to the arc of the fan shape.

[0074] Furthermore, the stronger the echo intensity, the whiter the image appears. The white rod-shaped image 302 appearing inside the sector-shaped area in the acoustic image 301 is the image of the mooring line 401. When the underwater robot 111 moves as designed and is positioned in a suitable position, the image 302 of the mooring line 401 appears as an image extending straight on the u-axis.

[0075] In this embodiment, the MBS 114 generates an acoustic image 301 for each measurement. The MBS 114 performs measurement, for example, at a predetermined interval, and transmits image information indicating the acoustic image 301 to the computer 101 via the communication unit 112.

[0076] 8 is a diagram illustrating an example of a swivel mechanism 113 according to an embodiment of the present disclosure. As shown in FIG. 8, the swivel mechanism 113 is fixed to an underwater robot 111 (not shown).

[0077] The oscillating mechanism 113 has a rotation shaft (not shown) that is rotated by, for example, a motor. The rotation shaft is parallel to the x-axis. The MBS 114 is attached to the rotation shaft of the oscillating mechanism 113. This allows the MBS 114 to rotate around the rotation shaft.

[0078] In this embodiment, the oscillating mechanism 113 rotates the rotation shaft back and forth within a predetermined angular range at a predetermined angular velocity, thereby causing the MBS 114 to perform a continuous oscillating motion.

[0079] 4 and 8 , the swing angle measurement unit 117 measures the swing angle (zenith angle) of the MBS 114. In this embodiment, the swing angle measurement unit 117 includes, for example, an angle sensor, and acquires the angle of the rotation axis of the swing mechanism 113 detected by the angle sensor, i.e., the swing angle, at a predetermined interval. The swing angle measurement unit 117 transmits swing angle information indicating the acquired angle to the computer 101 via the communication unit 112.

[0080] It is preferable that the measurement timing of the angle sensor and the measurement timing of the MBS 114 are substantially the same. However, the measurement timing of the angle sensor and the measurement timing of the MBS 114 may be different.

[0081] 9 and 10 are diagrams for explaining the principle of direction estimation performed by a direction estimation device according to an embodiment of the present disclosure. As shown in Fig. 9 and 10, the length L of the image 302 of the mooring line 401 is calculated based on the distance from the MBS 114 to the mooring line 401 and the incident angle of the acoustic beam with respect to the mooring line 401. * image (See Figure 7) How the length changes is theoretically derived.

[0082] As shown in FIG. 9, when the MBS 114 is located at point O, a situation is assumed in which the perpendicular line from point O to the mooring line 401 is not included in the acoustic beam 411.

[0083] When the MBS 114 is viewed from the front side (the +z-axis side), the angle between the axis of rotation TA of the swing and the direction in which the mooring line 401 extends is 90 degrees (see FIG. 6). The mooring line 401 is also positioned exactly in the center of the field of view of the MBS 114 (see FIG. 4).

[0084] Furthermore, to simplify the discussion, the following five assumptions are made: The first assumption is that the mooring line 401 is considered to be locally straight in the region of the mooring line 401 where the acoustic beam 411 hits when the MBS 114 performs a swiveling motion.

[0085] The second assumption is to ignore the thickness of the mooring line 401. This is equivalent to considering the acoustic beam 411 to reflect from the central axis of the mooring line 401.

[0086] The third assumption is that the MBS 114 is considered to be a point. The fourth assumption is that the acoustic beam 411 is uniformly distributed only within a certain symmetric angle range (e.g., 2δ) (see FIGS. 5, 9, and 10) as viewed from the body of the MBS 114.

[0087] The fifth assumption is that the pulse width of the acoustic beam 411 is ignored, and the acoustic beam 411 is assumed to spread out like a widthless arc.

[0088] Under these assumptions, consider the length of the image 302 of the mooring line 401 reflected in the acoustic image 301. 2δ is the distribution angle of the acoustic beam 411 in the yz plane. The distance d is the length of the perpendicular line OH drawn from point O to the mooring line 401.

[0089] α is the oscillation angle of the MBS 114, with the reference direction Ds from point O as the reference and the counterclockwise direction as viewed from the x-axis + side to the x-axis - side as the positive direction. The reference direction Ds is, for example, the horizontal direction. α is the oscillation angle α when the acoustic beam 411 is perpendicularly incident on the mooring line 401.

[0090] Point A is the intersection of the center line of the acoustic beam 411 and the mooring line 401. Points B and C are the upper and lower intersections, respectively, of the mooring line 401 and a line indicating the distribution range of the acoustic beam, which is measured δ above and below the center line of the acoustic beam 411.

[0091] First, for simplicity, consider the case where α = 0°. When the acoustic beam 411 is reflected by the mooring line 401 and returns to the MBS 114, the acoustic beam 411 is distributed in the area within the triangle OBC. The length L of the longest reflected path within this area is the longer of the line segments OB and OC. The length L is calculated using d = OH as follows: It is expressed as:

[0092] On the other hand, the shortest reflection path is classified into cases depending on whether point H is located between point B and point C. When point H is located between point B and point C (see FIG. 10), the length of the shortest path is equal to d=OH.

[0093] If point H is not located between points B and C (see FIG. 9), the shorter of the line segments OB and OC is the shortest path. Therefore, the length L2 of the shortest reflection path is given by Here, max(A, B) is a function that returns the larger of A and B.

[0094] From the above, the difference between the length of the shortest route and the length of the shortest route L diff teeth, It is expressed as:

[0095] The measurement range of the MBS 114 is R, and the length of the image 302 is L * image L diff If we express it as a ratio to R, This becomes:

[0096] Here, consider the case where α≠0°. When α≠0°, consider that the mooring line 401 is rotated by the target angle α around the point O, and finally, the length L of the image 302 is * image The theoretical solution is This becomes:

[0097] FIG. 11 illustrates the length L of the image 302 according to one embodiment of the present disclosure. * image 11 is a diagram showing an example of the change in the theoretical solution of L * image The horizontal axis indicates the swing angle α in degrees.

[0098] As shown in FIG. 11, for example, when d=2.0 m, R=7.5 m, α0=-45.0° and δ=10.0°, L * image When (α) is plotted, a downward convex curve is obtained that has a minimum value at α=α0 in the range of -90°≦α≦0°.

[0099] This means that when the oscillation angle is such that the acoustic beam 411 of the MBS 114 is incident perpendicularly to the mooring line 401, the image 302 of the mooring line 401 appears at its shortest in the acoustic image 301.

[0100] Even in the case of an actual mooring line 401 that is not necessarily straight, by regarding it as a local straight line, the length L of the image 302 of the mooring line 401 can be calculated. image is minimized, the acoustic beam 411 of the MBS 114 is incident perpendicularly to the mooring line 401.

[0101] Fig. 12 is a diagram illustrating a configuration of a direction estimation device according to an embodiment of the present disclosure. Fig. 12 illustrates a software configuration of the direction estimation device 11. The direction estimation device 11 is configured, for example, by causing a processor 21 in a computer 101 to execute a program.

[0102] As shown in FIG. 12 , the direction estimation device 11 includes, as functional blocks, a hearing result information acquisition unit 31, a head swing angle information acquisition unit 32, a control unit 33, an image processing unit 34, a data set generation unit 35, a direction estimation unit 36, an object coordinate calculation unit 37, an absolute coordinate information acquisition unit 38, and an overall shape estimation unit 39.

[0103] The control unit 33 in the direction estimation device 11 controls the underwater robot 111 via the bus 22 and the communication unit 23. Specifically, the control unit 33 controls the thrusters of the underwater robot 111, the swing mechanism 113, and the MBS 114, among other things.

[0104] The sound listening result information acquisition unit 31 acquires sound listening result information. In this embodiment, the sound listening result information indicates the sound listening results of sound waves from a plurality of sound listening directions for each swing angle α and each deflection angle β.

[0105] Specifically, the sound listening result information acquisition unit 31 receives image information showing an acoustic image 301 as sound listening result information from the underwater robot 111 at each measurement timing of the MBS 114.

[0106] Since the MBS 114 is oscillated at a predetermined angular velocity by the oscillating mechanism 113, the image information also includes information for each oscillating angle α. The hearing result information acquisition unit 31 outputs the acquired acoustic image 301 to the image processing unit 34.

[0107] When the image processing unit 34 receives the acoustic image 301 from the hearing result information acquisition unit 31, the image processing unit 34 calculates the length L of the image 302 based on the acoustic image 301. * image (See FIG. 7).

[0108] Specifically, the image processing unit 34 sets an area that includes the image 302, for example, and binarizes the area. The image processing unit 34 performs opening morphological transformation on the binarized area (hereinafter, may be referred to as the binarized area) to remove small noise points, and then performs closing morphological transformation to connect small gaps.

[0109] The image processing unit 34 selects the contour having the point closest to the measurement origin (u = 0, v = 0) from among the multiple contours in the binarized region. However, points that are too close to the measurement origin may be regarded as noise points and excluded.

[0110] The image processing unit 34 provides the smallest rectangle that circumscribes the selected contour and has each side parallel to the sides of the original image.

[0111] The image processing unit 34 calculates the position (u1, v1) that is the midpoint of the bottom side of the rectangle as the position of the bottom of the image 302 of the mooring line 401. The image processing unit 34 also calculates the height of the rectangle as the length L of the image 302 of the mooring line 401. * image It is calculated as follows.

[0112] The image processing unit 34 receives bottom position information indicating the calculated bottom position (u1, v1) of the image 302 and the length L of the image 302. * image The length information indicating the length is output to the data set generating unit 35.

[0113] The swing angle information acquisition unit 32 receives the swing angle information from the MBS 114 at each measurement timing of the swing angle measurement unit 117 in the MBS 114 , and outputs the swing angle information to the data set generation unit 35 .

[0114] FIG. 13 illustrates the length L of the image 302 according to one embodiment of the present disclosure. * image 13 is a diagram showing an example of a change over time in L. * image The horizontal axis indicates time.

[0115] The data set generating unit 35 receives the bottom position information and length information from the image processing unit 34, and calculates the bottom position (u1, v1) and the length L of the image 302. *image The position (u1, v1) of the bottom and the length L of the image 302 are stored in association with the measurement time. * image The first data set is generated in which the sets of the measurement times and the measurement positions are arranged in chronological order. * image The graph plots the change over time.

[0116] The data set generator 35 also receives the swing angle information from the swing angle information acquirer 32, and stores the swing angle α in association with the measurement time, thereby generating a second data set in which pairs of the swing angle α and the measurement time are arranged in chronological order.

[0117] The data set generation unit 35 calculates the position (u1, v1) of the bottom of the image 302 and the length L of the image 302 based on the relationship between the measurement time in the first data set and the measurement time in the second data set. * image 13 is converted from time to the oscillation angle α based on the third data set. The data set generator 35 outputs the third data set to the direction estimator 36.

[0118] 14 is a diagram illustrating an example of a result of fitting by a fitting unit according to an embodiment of the present disclosure. In FIG. 14, the vertical axis represents L * image The horizontal axis indicates the swing angle α in degrees.

[0119] The direction estimation unit 36 ​​calculates the length L of each image 302 indicated by the image information for each swing angle α. * image The normal incidence direction is estimated based on

[0120] In this embodiment, when the direction estimation unit 36 ​​receives the third data set from the data set generation unit 35, it estimates the normal incident direction based on the third data set.

[0121] Specifically, the direction estimation unit 36 ​​performs fitting based on the third data set and equation (5) to calculate the target angle α that provides the curve Cb when equation (5) best fits the third data set. The direction estimation unit 36 ​​calculates the target angle α for each one-way swing of the MBS 114.

[0122] In this embodiment, the shape of the mooring line 401 is approximated by a straight line, so that the point on the linear mooring line 401 that is the shortest distance from the MBS 114 is located in the direction of the target angle α0.

[0123] Furthermore, the direction estimation unit 36 ​​calculates the distance d between the MBS 114 and the mooring line 401 based on image information when the estimated normal incident direction is included in the acoustic beam 411 .

[0124] In this embodiment, the direction estimation unit 36 ​​acquires the position (u1, v1) of the bottom of the image 302 in the acoustic image 301 corresponding to the swing angle α closest to the target angle α0 in the third data set.

[0125] The direction estimation unit 36 ​​calculates the distance d from the acquired position (u1, v1) to the origin (0, 0) of the acoustic image coordinates in the acoustic image 301. image Calculate the distance d image The result of multiplying this by the measurement range R is calculated as the distance d from the MBS 114 to the mooring line 401.

[0126] 15 is a diagram illustrating an example of the target angle α calculated for each scan by the fitting unit according to an embodiment of the present disclosure. In FIG. 15, the vertical axis indicates the target angle α in units of degrees. The horizontal axis indicates the number of scans. For example, when the number of scans is odd or even, the results are obtained when the swing motion of the MBS 114 is forward or backward, respectively.

[0127] 16 is a diagram showing an example of the distance d calculated for each scan by the fitting unit according to an embodiment of the present disclosure. The vertical axis indicates the distance d in units of "m." The horizontal axis is interpreted in the same way as in FIG. 15. The direction estimation unit 36 ​​outputs the target angle α and the distance d to the target coordinate calculation unit 37 for each scan, i.e., for each one-way swing of the MBS 114.

[0128] When the absolute coordinate information acquisition unit 38 receives the absolute coordinate information from the underwater robot 111 via the bus 22 , it outputs the absolute coordinate information to the object coordinate calculation unit 37 .

[0129] The target coordinate calculation unit 37 calculates the absolute coordinates of the mooring line 401 based on the target angle α 0 and distance d received from the direction estimation unit 36 ​​and the absolute coordinate information received from the absolute coordinate information acquisition unit 38 .

[0130] 17 is a diagram for explaining a method for calculating the coordinates of the mooring line according to an embodiment of the present disclosure. As shown in FIGS. 12 and 17, the absolute coordinates of the position of the MBS 114 are (xs, zs), the pitch angle of the robot is θ, the swing angle at normal incidence is the target angle α0, and the absolute coordinates of the point where the center plane 411a of the acoustic beam 411 and the mooring line 401 intersect are (xt, zt). In addition, θ is positive in the counterclockwise direction when viewed from the +Y axis side, and α0 is positive in the clockwise direction when viewed from the +Y axis side. In this case, (xt, zt) T is calculated as follows:

[0131] If the absolute coordinates of the positioning center of the underwater robot 111 are (xb, zb) and the absolute coordinates of the relative mounting position of the MBS 114 as viewed from that point are (xsb, zsb), then (xs, zs) T is (xb, zb) T and (xsb, zsb) T It is expressed as follows using

[0132] From equations (6) and (7), (xs, zs) T By eliminating (xb, zb), the parameters can be easily extracted in the actual machine. T and (xsb, zsb) T Using (xt, zt) T can be expressed as follows:

[0133] The object coordinate calculation unit 37 calculates (xt, zt) as the absolute coordinates of the mooring line 401 and stores object coordinate information indicating the calculated absolute coordinates in the memory 24 or the disk 25 via the bus 22 .

[0134] 18 to 21 are diagrams showing an example of measurement results of absolute coordinates of a mooring rope according to an embodiment of the present disclosure. In Fig. 18 to 21, the vertical axis represents the Z coordinate in units of "m", and the horizontal axis represents the X coordinate in units of "m".

[0135] 18 to 21, a plurality of markers are attached to a mooring line 401. A symbol 401a is located at the absolute coordinates of the marker measured by, for example, underwater motion capture.

[0136] As shown in FIG. 18, the multiple symbols included in symbol group Sr1 are each located at the absolute coordinates at which the underwater robot 111 generated the sound listening result information.

[0137] The absolute coordinates of the mooring line 401 calculated based on the listening result information generated at the positions of the plurality of symbols included in the symbol group Sr1 are located at the positions of the plurality of symbols included in the symbol group St1.

[0138] The multiple symbols included in symbol group Sr2 are each located at the absolute coordinates at which the underwater robot 111 generated the sound listening result information.

[0139] The absolute coordinates of the mooring line 401 calculated based on the listening result information generated at the positions of the plurality of symbols included in the symbol group Sr2 are where the plurality of symbols included in the symbol group St2 are located.

[0140] The multiple symbols included in symbol group Sr3 are each located at the absolute coordinates at which the underwater robot 111 generated the sound listening result information.

[0141] The absolute coordinates of the mooring line 401 calculated based on the listening result information generated at the positions of the plurality of symbols included in the symbol group Sr3 are where the plurality of symbols included in the symbol group St3 are located.

[0142] As shown in FIG. 19, the multiple symbols included in symbol group Sr4 are each located at the absolute coordinates at which the underwater robot 111 generated the sound listening result information.

[0143] The absolute coordinates of the mooring line 401 calculated based on the listening result information generated at the positions of the plurality of symbols included in the symbol group Sr4 are where the plurality of symbols included in the symbol group St4 are located.

[0144] The multiple symbols included in symbol group Sr5 are each located at the absolute coordinates at which the underwater robot 111 generated the sound listening result information.

[0145] The absolute coordinates of the mooring line 401 calculated based on the listening result information generated at the positions of the plurality of symbols included in the symbol group Sr5 are located at the positions of the plurality of symbols included in the symbol group St5.

[0146] As shown in FIG. 20, the multiple symbols included in symbol group Sr6 are each located at the absolute coordinates at which the underwater robot 111 generated the sound listening result information.

[0147] The absolute coordinates of the mooring line 401 calculated based on the listening result information generated at the positions of the plurality of symbols included in the symbol group Sr6 are located at the positions of the plurality of symbols included in the symbol group St6.

[0148] As shown in FIG. 21, the multiple symbols included in symbol group Sr7 are each located at the absolute coordinates at which the underwater robot 111 generated the sound listening result information.

[0149] The absolute coordinates of the mooring line 401 calculated based on the listening result information generated at the positions of the plurality of symbols included in the symbol group Sr7 are located at the positions of the plurality of symbols included in the symbol group St7.

[0150] In this way, each symbol included in the symbol groups St1 to St7 accurately reproduces the curve (not shown) connecting each symbol 401 a. In other words, the direction estimation device 11 can accurately calculate the absolute coordinates of the mooring rope 401.

[0151] 12 , if the overall shape of the mooring line 401 is known, it would be useful for monitoring the mooring line 401, and therefore there is a need for a technique for estimating the shape of the mooring line 401. In this embodiment, the overall shape estimation unit 39 in the direction estimation device 11 estimates the shape of the mooring line 401 based on a plurality of pairs of the normal incidence direction and the distance d stored in the memory 24 or the disk 25.

[0152] In this embodiment, the overall shape estimation unit 39 acquires multiple object coordinate information stored in memory 24 or disk 25 via bus 22, and estimates the overall shape of the mooring line 401 based on the acquired multiple object coordinate information.

[0153] Specifically, the overall shape estimation unit 39 acquires multiple pieces of object coordinate information stored in the memory 24 or disk 25 after, for example, the control of the underwater robot 111 by the control unit 33 has ended.

[0154] The overall shape estimation unit 39, for example, assumes a curve that closely approximates the shape of the mooring rope 401. In this embodiment, the overall shape estimation unit 39 assumes a catenary curve whose shape is determined by parameters, and performs fitting based on the acquired plurality of object coordinate information and the assumed catenary curve, thereby calculating the parameters when the catenary curve best fits each absolute coordinate indicated by the plurality of object coordinates.

[0155] Based on the calculated parameters and catenary curve, the overall shape estimation unit 39 estimates the overall shape of the mooring rope 401. In other words, it is possible to estimate the overall shape of the mooring rope 401 based on fragmentary measurement results.

[0156] [Direction Estimation Process] FIG. 22 is a flowchart defining an operation procedure when the direction estimation device 11 according to an embodiment of the present disclosure performs direction estimation process.

[0157] 22, the underwater robot 111 moves, for example, along a predetermined movement path that includes, for example, a plurality of suitable positions in the vicinity of the mooring line 401.

[0158] First, the direction estimation device 11 moves, for example, the underwater robot 111 along a travel path (step S102).

[0159] Next, the direction estimation device 11 performs a measurement process (step S104). The measurement process is started when a predetermined condition is satisfied, such as when the underwater robot 111 reaches a predetermined measurement position or when a predetermined measurement timing arrives.

[0160] Next, the direction estimation device 11 determines whether the underwater robot 111 has reached the end point of the predetermined movement path (step S106).

[0161] If the direction estimation device 11 determines that the underwater robot 111 has not reached the end point (NO in step S106), it causes the underwater robot 111 to move further along the travel path (step S102).

[0162] On the other hand, when the direction estimation device 11 determines that the underwater robot 111 has reached the end point (YES in step S106), it outputs the shape of the mooring lines 401 based on the calculated absolute coordinates of the multiple mooring lines 401 (step S108).

[0163] 23 is a flowchart defining an operation procedure when a direction estimation device according to an embodiment of the present disclosure performs measurement processing. FIG. 23 shows details of the operation in step S104 in FIG.

[0164] 23, first, the direction estimation device 11 performs a measurement start process (step S202). Specifically, the direction estimation device 11 activates the swing mechanism 113, MBS 114, absolute coordinate measurement unit 116, and swing angle measurement unit 117 of the underwater robot 111. This causes the underwater robot 111 to transmit swing angle information, image information, and absolute coordinate information to the direction estimation device 11. The swing mechanism 113 causes the MBS 114 to perform a swing motion.

[0165] Next, the direction estimation device 11 performs information acquisition processing (step S204) until the swing angle α of the MBS 114 reaches the upper limit (NO in step S206).

[0166] Next, the direction estimation device 11 performs a process of calculating the target object position coordinates (step S208).

[0167] Next, the direction estimation device 11 performs the information acquisition process (step S210) until the swing angle α of the MBS 114 reaches the lower limit (NO in step S212).

[0168] Next, the direction estimation device 11 performs a process of calculating the target object position coordinates (step S214).

[0169] Next, if the direction estimation device 11 determines that the predetermined termination condition is not satisfied (NO in step S216), it performs information acquisition processing (step S204) until the swing angle α of the MBS 114 reaches its upper limit (NO in step S206).

[0170] The predetermined end condition is, for example, that a predetermined time has elapsed since the start of measurement, or that the swing mechanism 113 has caused the swing angle of the MBS 114 to reciprocate a predetermined number of times.

[0171] On the other hand, if the direction estimation device 11 determines that the predetermined termination condition is satisfied (YES in step S216), it terminates the measurement process.

[0172] 24 is a flowchart illustrating an operation procedure when the direction estimation device according to an embodiment of the present disclosure performs information acquisition processing. FIG. 24 illustrates details of the operations in steps S204 and S210 in FIG. 23.

[0173] As shown in Figure 24, first, the direction estimation device 11 waits until it receives image information, swing angle information, or absolute coordinate information from the underwater robot 111 (NO in step S302, NO in step S308, and NO in step S314).

[0174] When the direction estimation device 11 receives the image information from the underwater robot 111 (YES in step S302), it processes the acoustic image 301 indicated by the image information and obtains the position (u1, v1) of the bottom of the image 302 and the length L of the image 302. * image is acquired (step S304).

[0175] Next, the direction estimation device 11 calculates the position (u1, v1) of the bottom and the length L of the image 302. * image are stored in the first data set in association with the measurement time (step S306).

[0176] Furthermore, when the direction estimation device 11 receives the swing angle information from the underwater robot 111 (YES in step S308), it stores the swing angle α indicated by the swing angle information in the second data set in association with the measurement time (step S310).

[0177] Furthermore, when the direction estimation device 11 receives absolute coordinate information from the underwater robot 111 (YES in step S312), it stores the swing angle α indicated by the swing angle information in association with the measurement time (step S314).

[0178] 25 is a flowchart illustrating an operation procedure when a direction estimation device according to an embodiment of the present disclosure performs a process of calculating target object position coordinates. FIG. 25 illustrates details of the operations in steps S208 and S214 in FIG. 23 .

[0179] As shown in FIG. 25, first, the direction estimation device 11 calculates the position (u1, v1) of the bottom of the image 302 and the length L of the image 302 based on the relationship between the measurement time in the first data set and the measurement time in the second data set. * image and the swing angle α are associated with each other to generate a third data set (step S402).

[0180] Next, the direction estimation device 11 performs fitting based on the third data set and equation (5) to calculate the target angle α0 that gives the curve Cb when equation (5) best fits the third data set (step S404).

[0181] Next, the direction estimation device 11 acquires the position (u1, v1) of the bottom of the image 302 corresponding to the swing angle α closest to the target angle α in the third data set, and calculates the distance d from the origin (0, 0) of the acoustic image coordinates to the position (u1, v1). image The result of multiplying the distance d by the measurement range R is calculated as the distance d from the MBS 114 to the mooring line 401 (step S406).

[0182] Next, the direction estimation device 11 calculates the absolute coordinates of the mooring rope 401 based on the target angle α0, the distance d, and the absolute coordinates indicated by the absolute coordinate information (step S408).

[0183] 26 is a diagram illustrating an example of a target angle α calculated for each scan by a fitting unit in a direction estimation device according to a first modified example of an embodiment of the present disclosure. Note that the way to view FIG. 26 is the same as that of FIG. 15.

[0184] For example, there may be a mismatch between the timing at which the MBS 114 generates the acoustic image 301 and the timing at which the oscillation angle information acquisition unit 32 acquires the oscillation angle α. In this case, the target angle α0 during the forward movement of the oscillation motion (for example, when the number of scans is odd) will be larger or smaller than the target angle α0 during the backward movement of the oscillation motion (for example, when the number of scans is even).

[0185] In detail, for example, if on the outbound journey the swivel angle information acquisition unit 32 measures an angle greater than the swivel angle α at which the MBS 114 generated the acoustic image 301, on the return journey the swivel angle information acquisition unit 32 will measure an angle smaller than the swivel angle α at which the MBS 114 generated the acoustic image 301.

[0186] Furthermore, for example, if on the outbound journey the swivel angle information acquisition unit 32 measures an angle smaller than the swivel angle α at which the MBS 114 generated the acoustic image 301, on the return journey the swivel angle information acquisition unit 32 will measure an angle larger than the swivel angle α at which the MBS 114 generated the acoustic image 301.

[0187] In contrast, in the first modified example of the direction estimation device 11, the direction estimation unit 36 ​​calculates the average of two target angles α for two consecutive scan numbers as the target angle α for one of the two consecutive scan numbers.

[0188] Specifically, the direction estimation unit 36 ​​calculates the average of the two target angles α0 when the number of scans is 1 and 2, as the target angle α0 when the number of scans is 1, for example.

[0189] Then, the direction estimation unit 36 ​​calculates, for example, the average of the two target angles α0 when the number of scans is two and three, as the target angle α0 when the number of scans is two.

[0190] This allows the difference between the swing angle α at which the MBS 114 generates the acoustic image 301 and the swing angle α measured by the swing angle information acquisition unit 32 to be offset, thereby suppressing variation in the target angle α0.

[0191] In this embodiment, the object of shape measurement is the mooring rope 401, but the present invention is not limited to this. The object may be, for example, an object that appears linear when viewed from the edge, such as a ship's rudder.

[0192] Furthermore, in this embodiment, a configuration has been described in which image information is transmitted from the underwater robot 111 to the computer 101 each time the MBS 114 generates image information, but this is not limited to this. The image information generated by the MBS 114 may be sequentially stored in a storage device provided in the underwater robot 111. In this case, after measurement by the MBS 114 is completed, the direction estimation device 11 estimates the direction of normal incidence based on the image information stored in the storage device.

[0193] Furthermore, in this embodiment, a configuration in which the MBS 114 is provided on the underwater robot 111 has been described, but the present invention is not limited to this. A scanning sonar may be provided on the underwater robot 111 instead of the MBS 114. However, a configuration in which the MBS 114 with good accuracy in the direction of deflection angle is provided on the underwater robot 111 is preferable.

[0194] In addition, in this embodiment, a configuration has been described in which the orientation of the MBS 114 is changed by the swinging motion of the swing mechanism 113, but the present invention is not limited to this. For example, the MBS 114 may be fixed to the underwater robot 111, and the orientation of the MBS 114 may be changed by adjusting the pitch of the underwater robot 111.

[0195] In addition, in this embodiment, the MBS 114 is provided on the underwater robot 111, but the present invention is not limited to this. The MBS 114 may be provided on a ship or held by a diver.

[0196] In this embodiment, L *image In the above description, the target angle α0 at normal incidence is estimated by fitting the model function, i.e., equation (5), to the plot of the above equation, but the present invention is not limited to this. For example, two L * image Compared to the small L * image It is also possible to use an algorithm that determines that the sound beam is close to normal incidence when the oscillation angle α is . Since Equation (5) has a minimum value, it is possible to repeatedly execute this algorithm to obtain L * image The normal incidence direction at which is the smallest can be found.

[0197] In addition, although the present embodiment has been described as a configuration in which absolute coordinates are calculated from the coordinates of the relative position (target angle α and distance d), the present invention is not limited to this. For example, if a rider is on board the underwater robot 111, the rider can easily recognize the position of the target based on the target angle α and distance d.

[0198] The above-described embodiments are intended to facilitate understanding of the present invention and are not intended to limit the present invention. The elements of the embodiments, as well as their arrangement, materials, conditions, shapes, sizes, etc., are not limited to those illustrated and can be modified as appropriate. Furthermore, configurations shown in different embodiments can be partially substituted or combined with each other.

[0199] DESCRIPTION OF SYMBOLS 11: Direction estimation device 21: Processor 22: Bus 23: Communication unit 24: Memory 25: Disk 31: Listening result information acquisition unit 32: Swing angle information acquisition unit 33: Control unit 34: Image processing unit 35: Data set generation unit 36: Direction estimation unit 37: Object coordinate calculation unit 38: Absolute coordinate information acquisition unit 39: Overall shape estimation unit 101: Computer 111: Underwater robot 112: Communication unit 113: Swing mechanism 114: Multi-beam imaging sonar 115: Thruster control unit 116: Absolute coordinate measurement unit 117: Swing angle measurement unit 201: Direction estimation system 301: Acoustic image 302, 303: Images 401: Mooring line 411: Acoustic beam 411a: Center plane TA: Rotation axis Pm: Moving plane Pb: Seabed surface Da: Listening direction Ds...Reference direction R...Measurement range

Claims

1. A direction estimation device comprising: an information acquisition unit that acquires listening result information indicating a time series of listening results measured by a sonar that emits sound beams in multiple directions, the listening results being sound waves from multiple listening directions including at least some of the multiple directions; and a direction estimation unit that estimates a normal incidence direction in which the sound beam is normal to an object based on the listening result information.

2. The direction estimation device according to claim 1, wherein the listening result information indicates the listening results of the sound waves from the plurality of listening directions for each zenith angle and each declination angle.

3. The direction estimation device described in claim 2, wherein the information acquisition unit acquires, as the listening result information, image information for each zenith angle, which indicates an image that is a fan-shaped image with the elapsed time from the time the sound beam was emitted and the deflection angle as its radius and central angle, respectively, and which includes an image corresponding to the echo of the sound beam from the target object, and the direction estimation unit estimates the vertical incidence direction based on the image information for each zenith angle.

4. The direction estimation device according to claim 3, wherein the direction estimation unit estimates the normal incidence direction based on a length of each of the images included in each of the images indicated by the image information for each of the zenith angles.

5. The direction estimation device according to claim 3, wherein the direction estimation unit further calculates a distance between the sonar and the target object based on the image information when the estimated normal incidence direction is included in the sound beam.

6. The direction estimation device according to claim 1, wherein the object appears straight when viewed from the sonar.

7. The direction estimation device according to claim 6, wherein the distance between the sonar and a plane including the object is smaller than a value determined based on the distance between the sonar and the object.

8. The direction estimation device according to claim 5, further comprising: a memory unit that holds a set of the normal incidence direction and the distance; and a shape estimation unit that estimates a shape of the object based on the multiple sets held in the memory unit.

9. The direction estimation device according to claim 1, wherein the sonar is a multi-beam sonar.

10. The direction estimation device according to claim 1, wherein the sonar is a scanning sonar.

11. A direction estimation system comprising: an underwater robot equipped with a sonar; and a direction estimation device as described in any one of claims 1 to 10, wherein the sonar emits sound beams in multiple directions and listens to sound waves from multiple listening directions including at least some of the multiple directions, and generates listening result information indicating the listening results in a time series.

12. The direction estimation system described in claim 11, wherein the sonar is a multi-beam sonar that measures the sound waves from the multiple listening directions for each declination angle, and the underwater robot includes a mechanism that directs the sonar to the multiple listening directions for each zenith angle.

13. A direction estimation method for a direction estimation device, comprising: acquiring listening result information indicating a time series of listening results measured by a sonar that emits sound beams in multiple directions, the listening results being of sound waves from multiple listening directions including at least some of the multiple directions; and estimating a normal incidence direction in which the sound beam is normal to an object based on the listening result information.

14. A direction estimation program used in a direction estimation device, which causes a computer to function as: an information acquisition unit that acquires listening result information indicating a time series of listening results measured by a sonar that emits sound beams in multiple directions, the listening results being of sound waves from multiple listening directions including at least some of the multiple directions; and a direction estimation unit that estimates the perpendicular incidence direction in which the sound beam is perpendicularly incident on an object based on the listening result information.

Citation Information

Patent Citations

  • Fish finder

    JP1989227982A

  • Method for measuring distance and normal direction

    JP1996094753A

  • Systems and methods for measuring bladder wall thickness

    JP2005528950A

  • Bottom sediment detection system

    JP2006162294A

  • Systems and methods for real-time monitoring of a line

    US20180163532A1