Direction estimation device, direction estimation system, direction estimation method, and direction estimation program

The direction estimation device uses sonar to accurately measure mooring rope positions and shapes by estimating the vertical incidence direction, addressing errors in existing monitoring systems and improving the accuracy of mooring line load monitoring.

JP2024168324APending Publication Date: 2024-12-05THE UNIV OF TOKYO
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
JP2023084885
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-23
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

Existing mooring line load monitoring systems struggle to accurately monitor the overall shape and behavior of mooring ropes due to fragmentary sensor data, leading to errors in position measurement and difficulty in assessing biofouling distribution.

Method used

A direction estimation device utilizing a sonar that emits sound wave beams in multiple directions, acquiring time-series listening results to estimate the vertical incidence direction of the sound wave beam on the target object, allowing for accurate position measurement by suppressing errors through perpendicular incidence estimation.

Benefits of technology

The system effectively suppresses errors in position measurement by determining the vertical incidence direction, enabling precise monitoring of mooring rope positions and shapes, even in complex underwater environments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024168324000001_ABST
    Figure 2024168324000001_ABST
Patent Text Reader

Abstract

To provide a direction estimation device, direction estimation system, direction estimation method, and direction estimation program capable of suppressing an error when measuring a position of an object.SOLUTION: A direction estimation device includes: an information acquisition unit that acquires sound detection result information which represents the sound detection results of the sound waves from the multiple sound detection directions including at least a portion of the multiple directions being the time-series sound detection results measured by a sonar emitting sound wave beams in the multiple directions; and a direction estimation unit that estimates the perpendicular incidence direction where the sound wave beam is perpendicularly incident on an object on the basis of the sound detection result information.SELECTED DRAWING: Figure 12
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a direction estimation device, a direction estimation system, a direction estimation method, and a direction estimation program. [Background technology]

[0002] There is a mooring line load monitoring system that remotely monitors failures and breakages of mooring lines of floating bodies such as ships (for example, Non-Patent Document 1). [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] LCM SYSTEMS., Mooring Line Load Monitoring (MLM)., [Retrieved April 21, 2023], Internet <URL: https: / / www.lcmsystems.com / Applications / load-cells-load-pins-for-mooring-line-load-monitoring-mlm> Summary of the Invention [Problem to be solved by the invention]

[0004] In the mooring rope load monitoring system described in Non-Patent Document 1, sensors such as strain gauges are attached to the upper end or middle of the mooring rope, and the output value of the sensor is constantly monitored. This monitoring makes it possible to detect critical events such as the breakage of the mooring rope and to predict the risk of breakage due to excessive tension.

[0005] However, the strain and other information obtained from the sensors is merely fragmentary information at a certain point on the mooring line, making it difficult to accurately monitor the overall shape and behavior of the mooring line, as well as the amount and distribution of biological fouling.

[0006] In order to monitor these accurately, technology is required to measure the position of mooring lines with small error.

[0007] Therefore, an object of the present invention is to provide a direction estimation device, a direction estimation system, a direction estimation method, and a direction estimation program that are capable of suppressing errors when measuring the position of an object. [Means for solving the problem]

[0008] A direction estimation device according to one embodiment of the present invention includes an information acquisition unit that acquires listening result information indicating a time series of listening results measured by a sonar that emits sound beams in multiple directions, the listening results being sound waves from multiple listening directions including at least some of the multiple directions, and a direction estimation unit that estimates a perpendicular incidence direction in which the sound beam is perpendicularly incident on an object based on the listening result information.

[0009] Although conventional sonar can measure the direction of an object as seen from the sonar and the distance between the sonar and the object, it is difficult to accurately obtain the angle of incidence of the sound beam on the object, which causes errors in measuring the position of the object. In contrast, according to an aspect in which the perpendicular incidence direction in which the sound beam is perpendicularly incident on the object is estimated, a position that is a distance away from the estimated perpendicular incidence direction by the distance measured by the sonar can be obtained as the position of the object with reduced errors. Therefore, errors when measuring the position of the object can be reduced.

[0010] In the above aspect, the listening result information may indicate the listening results of the sound waves from the multiple listening directions for each zenith angle and each deviation angle.

[0011] According to this aspect, since a plurality of sound listening directions can be expressed by polar coordinates based on the sonar, the process of estimating the normal incidence direction can be simplified.

[0012] In the above aspect, the information acquisition unit acquires, as the listening result information, image information for each zenith angle, which indicates a fan-shaped image having a radius and central angle that are the elapsed time from the time the sound beam was emitted and the deflection angle, respectively, and which includes an image corresponding to the reflection of the sound beam from the target object, and the direction estimation unit may estimate the vertical incidence direction based on the image information for each zenith angle.

[0013] According to this aspect, the change in the image with respect to the zenith angle, i.e., the change in the image with respect to the incident angle, can be easily obtained. As a result, the property that the length of the image changes depending on the incident angle of the sound beam with respect to the target object can be utilized to easily estimate the vertical incident direction.

[0014] In the above aspect, the direction estimation unit may estimate the normal incidence direction based on a length of each of the images included in each of the images indicated by the image information for each of the zenith angles.

[0015] According to this aspect, for example, when the object is linear, the perpendicular incidence direction can be accurately determined by utilizing the property that the image length becomes shorter the closer the angle at which the sound beam is incident on the object is to perpendicular.

[0016] In the above aspect, the direction estimation unit may further calculate a distance between the sonar and the target object based on the image information when the estimated normal incidence direction is included in the sound beam.

[0017] According to this aspect, in an image where the perpendicular incidence direction is included in the sound beam, the property that the distance between the center of the fan and the image is the distance between the position where the sound beam is perpendicular to the object and the sonar can be utilized to accurately calculate the distance between the position where the sound beam is perpendicular to the object and the sonar.

[0018] In the above aspect, the object may appear to the sonar as a straight line.

[0019] When the object is planar, it is necessary to estimate the direction in advance and measure from an appropriate direction. For example, if the object is a flat seabed, it is necessary to measure from above, and if it is a vertical wall, it is necessary to measure from the side. According to this aspect, the shape of the object can be treated as linear, so that it can be measured without estimating the appropriate direction in advance. In addition, the relational expression between the angle at which the sound beam is incident on the object and the image length can be easily derived. This makes it easy to estimate the perpendicular incidence direction.

[0020] In the above aspect, the distance between the sonar and a plane including the target object may be smaller than a value defined based on the distance between the sonar and the target object.

[0021] In this manner, by positioning the sonar in the vicinity of a plane including the target object, it is possible to suppress deterioration in the accuracy of estimating the normal incidence direction.

[0022] In the above aspect, the direction estimation device may further include a memory unit that stores a pair of the normal incidence direction and the distance, and a shape estimation unit that estimates a shape of the object based on the multiple pairs stored in the memory unit.

[0023] According to this aspect, for example, a curve that closely approximates the multiple positions represented by the multiple sets is calculated, and the shape of the entire object can be estimated by assuming that the curve represents the shape of the object. This makes it possible to estimate the shape of the entire object based on the measurement results of some positions on the object.

[0024] In the above aspect, the sonar may be a multi-beam sonar.

[0025] According to this aspect, it is possible to efficiently obtain sound wave listening results from multiple listening directions and suppress variation in the listening directions, thereby suppressing deterioration in the estimation accuracy of the perpendicular incidence direction.

[0026] In the above aspect, the sonar may be a scanning sonar.

[0027] According to this aspect, the results of listening to sound waves from a plurality of listening directions can be obtained at low cost.

[0028] A direction estimation system according to another aspect of the present invention comprises an underwater robot equipped with a sonar and the above-mentioned direction estimation unit, wherein the sonar emits sound beams in multiple directions and listens to sound waves from multiple listening directions including at least some of the multiple directions, and generates listening result information indicating the listening results in a time series.

[0029] In conventional sonar, although the direction of an object as seen from the sonar and the distance between the sonar and the object can be measured, it is difficult to accurately obtain the angle of incidence of the sound beam with respect to the object, which causes errors in measuring the position of the object. In contrast, according to an aspect in which the perpendicular incidence direction in which the sound beam is perpendicularly incident on the object is estimated, a position away from the estimated perpendicular incidence direction by the distance measured by the sonar can be obtained as the position of the object with reduced errors. Therefore, errors when measuring the position of the object can be reduced. In addition, since the sonar is provided on an underwater robot that can move freely underwater, many positions of the object can be measured. This makes it possible to obtain the overall shape of the object.

[0030] In the above aspect, the sonar may be a multi-beam sonar that measures the sound waves from the listening directions for each declination angle among the multiple listening directions, and the underwater robot may include a mechanism that points the sonar to the listening directions for each zenith angle among the multiple listening directions.

[0031] According to this aspect, it is possible to easily generate listening result information that indicates the listening results of sound waves from a plurality of listening directions for each zenith angle and each deviation angle.

[0032] A direction estimation method according to another aspect of the present invention is a direction estimation method in a direction estimation device, which includes acquiring listening result information indicating a time series of listening results measured by a sonar that emits sound beams in a plurality of directions, the listening results being of sound waves from a plurality of listening directions including at least some of the plurality of directions, and estimating a perpendicular incidence direction in which the sound beam is perpendicularly incident on an object based on the listening result information.

[0033] Although conventional sonar can measure the direction of an object as seen from the sonar and the distance between the sonar and the object, it is difficult to accurately obtain the angle of incidence of the sound beam on the object, which causes errors in measuring the position of the object. In contrast, according to an aspect in which the perpendicular incidence direction in which the sound beam is perpendicularly incident on the object is estimated, a position that is a distance away from the estimated perpendicular incidence direction by the distance measured by the sonar can be obtained as the position of the object with reduced errors. Therefore, errors when measuring the position of the object can be reduced.

[0034] A direction estimation program according to another aspect of the present invention is a direction estimation program used in a direction estimation device, which causes a computer to function as an information acquisition unit that acquires listening result information indicating a time series of listening results measured by a sonar that emits sound beams in multiple directions, the listening results being sound waves from multiple listening directions including at least some of the multiple directions, and a direction estimation unit that estimates the perpendicular incidence direction in which the sound beam is perpendicularly incident on an object based on the listening result information.

[0035] Although conventional sonar can measure the direction of an object as seen from the sonar and the distance between the sonar and the object, it is difficult to accurately obtain the angle of incidence of the sound beam on the object, which causes errors in measuring the position of the object. In contrast, according to an aspect in which the perpendicular incidence direction in which the sound beam is perpendicularly incident on the object is estimated, a position that is a distance away from the estimated perpendicular incidence direction by the distance measured by the sonar can be obtained as the position of the object with reduced errors. Therefore, errors when measuring the position of the object can be reduced. Effect of the Invention

[0036] According to the present invention, it is possible to provide a direction estimation device, a direction estimation system, a direction estimation method, and a direction estimation program that are capable of suppressing errors when measuring the position of an object. [Brief description of the drawings]

[0037] [Figure 1] 1 is a diagram for explaining the position of an underwater robot relative to a mooring line according to an embodiment of the present disclosure. FIG. [Diagram 2] FIG. 1 is a diagram illustrating a configuration of a direction estimation system according to an embodiment of the present disclosure. [Diagram 3] FIG. 1 is a diagram showing a configuration of an underwater robot according to an embodiment of the present disclosure. [Figure 4] 1A and 1B are diagrams for explaining the orientation of the MBS in an underwater robot according to an embodiment of the present disclosure. [Diagram 5] 1A and 1B are diagrams for explaining the orientation of the MBS in an underwater robot according to an embodiment of the present disclosure. [Figure 6] 1A and 1B are diagrams for explaining the orientation of the MBS in an underwater robot according to an embodiment of the present disclosure. [Figure 7] FIG. 2 is a diagram illustrating an example of an acoustic image according to an embodiment of the present disclosure. [Figure 8] FIG. 13 illustrates an example of a swivel mechanism according to an embodiment of the present disclosure. [Figure 9]1 is a diagram for explaining the principle of direction estimation performed by a direction estimation device according to an embodiment of the present disclosure. FIG. [Figure 10] 1 is a diagram for explaining the principle of direction estimation performed by a direction estimation device according to an embodiment of the present disclosure. FIG. [Figure 11] FIG. 13 is a diagram showing an example of a change in the theoretical solution of the image length L* image with respect to the head swing angle α according to an embodiment of the present disclosure. [Figure 12] FIG. 1 is a diagram illustrating a configuration of a direction estimation device according to an embodiment of the present disclosure. [Figure 13] FIG. 13 is a diagram showing an example of a change in image length L* image over time according to an embodiment of the present disclosure. [Figure 14] FIG. 13 is a diagram showing an example of a result of fitting by a fitting unit according to an embodiment of the present disclosure. [Figure 15] FIG. 13 is a diagram showing an example of a target angle α0 calculated for each scan by a fitting unit according to an embodiment of the present disclosure. [Figure 16] FIG. 13 is a diagram showing an example of a distance d calculated for each scan by a fitting unit according to an embodiment of the present disclosure. [Figure 17] FIG. 13 is a diagram for explaining a method for calculating coordinates of a mooring line according to an embodiment of the present disclosure. [Figure 18] FIG. 13 is a diagram showing an example of measurement results of absolute coordinates of a mooring line according to an embodiment of the present disclosure. [Figure 19] FIG. 13 is a diagram showing an example of measurement results of absolute coordinates of a mooring line according to an embodiment of the present disclosure. [Figure 20] FIG. 13 is a diagram showing an example of measurement results of absolute coordinates of a mooring line according to an embodiment of the present disclosure. [Figure 21] FIG. 13 is a diagram showing an example of measurement results of absolute coordinates of a mooring line according to an embodiment of the present disclosure. [Figure 22] 1 is a flowchart defining an operation procedure when a direction estimation device 11 according to an embodiment of the present disclosure performs a direction estimation process. [Figure 23]1 is a flowchart defining an operation procedure when a direction estimation device according to an embodiment of the present disclosure performs a measurement process. [Figure 24] 1 is a flowchart defining an operation procedure when a direction estimation device according to an embodiment of the present disclosure performs information acquisition processing. [Diagram 25] 1 is a flowchart defining an operation procedure when a direction estimation device according to an embodiment of the present disclosure performs a process of calculating object position coordinates. [Figure 26] FIG. 11 is a diagram showing an example of a target angle α0 calculated for each scan by a fitting unit in a direction estimation device according to a first modified example of an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0038] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will now be described with reference to the accompanying drawings, in which like reference numerals denote like or similar structures.

[0039] [First embodiment] FIG. 1 is a diagram for explaining the position of an underwater robot relative to a mooring line according to one embodiment of the present disclosure.

[0040] Each drawing may show an X-axis, a Y-axis, and a Z-axis. The X-axis, the Y-axis, and the Z-axis are coordinate axes fixed to the Earth and form a right-handed three-dimensional Cartesian coordinate system. The vertical downward direction is the positive direction of the Z-axis. In other words, the X-axis and the Y-axis are oriented horizontally. Hereinafter, the direction of the X-axis arrow may be referred to as the X-axis + side, and the direction opposite to the arrow may be referred to as the X-axis - side, and the same applies to the other axes. The Z-axis + side and the Z-axis - side may be referred to as the "lower side" and "upper side", respectively. The Z-axis direction may also be referred to as the "depth direction". The planes perpendicular to the X-axis, Y-axis, and Z-axis, respectively, may be referred to as the YZ plane, the ZX plane, and the XY plane.

[0041] The mooring line 401 (object) is, for example, a chain that moor a float supporting a wind turbine from the seabed surface Pb in a floating wind power generation system. When one end of the mooring line 401 is fixed to the float and the other end of the mooring line 401 is fixed to the seabed surface Pb, the mooring line 401 hangs down by its own weight to form a catenary curve (suspended curve). This mooring method in which mooring force is obtained by the own weight of the hanging mooring line 401 is called catenary mooring. Hereinafter, the plane including the mooring line 401 may be referred to as the moving plane Pm. In this embodiment, the moving plane Pm is parallel to the ZX plane.

[0042] The underwater robot 111 is a remotely operated unmanned underwater robot (Remotely Operated Vehicle: ROV) that is remotely operated by an operator from outside (for example, on a ship or on land) of the underwater robot 111. The underwater robot 111 may be an underwater robot that is directly operated by a human being, or an underwater robot that autonomously performs missions without assistance such as human operation.

[0043] The underwater robot 111 has, for example, five thrusters and is capable of controlling five degrees of freedom: surge, sway, heave, pitch, and yaw.

[0044] The underwater robot 111 is provided with a multibeam imaging sonar 114 (hereinafter sometimes referred to as MBS 114).

[0045] In response to remote control from outside, the underwater robot 111 moves to a position (hereinafter sometimes referred to as a suitable position) suitable for measuring the position (hereinafter sometimes referred to as a relative position) of the mooring line 401 when the underwater robot 111 is used as a reference.

[0046] The preferred position is, for example, a position that satisfies the condition that the distance between the movement plane Pm and the MBS 114 is smaller than the distance between the MBS 114 and the mooring line 401.

[0047] Preferably, the position satisfies the condition that the distance between the moving plane Pm and the MBS 114 is smaller than a value determined based on the distance between the MBS 114 and the mooring rope 401. Specifically, the distance between the moving plane Pm and the MBS 114 is smaller than 100% (preferably, 20%) of the distance between the MBS 114 and the mooring rope 401.

[0048] More preferably, the preferred position is, for example, a position that satisfies the condition that the MBS 114 intersects with the moving plane Pm. In this case, the distance between the moving plane Pm and the MBS 114 is, for example, less than 2% of the distance between the MBS 114 and the mooring line 401.

[0049] Specifically, five thrusters in the underwater robot 111 operate in response to external remote control, causing the underwater robot 111 to change depth and move horizontally within the moving plane Pm. When the underwater robot 111 is in a suitable position, the mooring line 401 appears straight when viewed from the MBS 114.

[0050] 2 is a diagram showing a configuration of a direction estimation system according to an embodiment of the present disclosure. As shown in FIG. 2, the direction estimation system 201 includes a computer 101 and an underwater robot 111.

[0051] The computer 101 is installed, for example, on land. The computer 101 may be installed on a floating body, a ship, or an underwater robot 111.

[0052] The computer 101 includes a processor 21, a bus 22, a communication I / F (interface) 23, a memory 24 (storage unit), and a disk (storage unit) 25. The computer 101 is, for example, a personal computer.

[0053] In the computer 101, a processor 21, a communication unit 23, a memory 24, and a disk 25 are connected via a bus 22 so as to be able to exchange data with one another.

[0054] Memory 24 is a volatile storage device such as a dynamic random access memory (DRAM). Communication unit 23 and underwater robot 111 provided outside computer 101 are connected by, for example, a cable. Communication unit 23 communicates with underwater robot 111 through the cable.

[0055] The communication unit 23 transmits various data to the underwater robot 111 in accordance with instructions from the processor 21. The communication unit 23 also receives various data transmitted from the underwater robot 111, and outputs the received data to the processor 21.

[0056] The disk 25 is a readable / writable non-volatile storage device such as a hard disk drive (HDD) or a solid state drive (SSD), and stores a program (code). The disk 25 is not limited to an HDD or an SSD, and may be a memory card, a read-only compact disc read-only memory (CD-ROM) or a digital versatile disc-read-only memory (DVD-ROM). The program can be installed from an external device. The program is distributed in a state stored in a storage medium such as the disk 25 that can be read by the computer 101. The program may be distributed over the Internet connected via a communication interface.

[0057] When executing a program, the processor 21 transfers the program stored on the disk 25 and data necessary for executing the program to the memory 24. The processor 21 reads out processing instructions and data necessary for executing the program from the memory 24, and executes arithmetic processing according to the contents of the processing instructions. At this time, the processor 21 may newly generate data necessary for executing the program and store it in the memory 24. The processor 21 is not limited to a configuration in which the processor 21 obtains the program and data from the disk 25, and may also be configured to obtain the program and data from a server via the Internet.

[0058] Fig. 3 is a diagram showing the configuration of an underwater robot according to an embodiment of the present disclosure. As shown in Fig. 3, the underwater robot 111 includes a communication unit 112, a swing mechanism 113, an MBS 114, a thruster control unit 115, an absolute coordinate measurement unit 116, and a swing angle measurement unit 117.

[0059] A communication unit 112 in the underwater robot 111 communicates with the computer 101. A thruster control unit 115 controls five thrusters based on control information received from the computer 101 via the communication unit 112.

[0060] The absolute coordinate measuring unit 116 measures, for example, coordinates indicating the position of the underwater robot 111 relative to a reference point on the earth (hereinafter sometimes referred to as absolute coordinates).

[0061] The absolute coordinate measurement unit 116 includes, for example, a one-axis fiber optic gyro (FOG) and a Doppler velocity log (DVL). The amount of movement of the underwater robot 111 is calculated, for example, by integrating the horizontal ground speed measured by the DVL along an azimuth angle obtained by integrating the angular velocity of the azimuth angle measured by the FOG. The absolute coordinate measurement unit 116 measures the absolute coordinates of the underwater robot 111 by adding the calculated amount of movement to the absolute coordinates of the initial position.

[0062] The absolute coordinate measuring unit 116 measures, for example, the absolute coordinates of the underwater robot 111 at a predetermined period and transmits absolute coordinate information indicating the measured absolute coordinates to the computer 101 via the communication unit 112 .

[0063] 4 to 6 are diagrams for explaining the orientation of the MBS 114 in the underwater robot according to an embodiment of the present disclosure.

[0064] 4 to 6, the x-axis, y-axis, and z-axis are defined as Cartesian coordinates fixed to the MBS 114. The x-axis, y-axis, and z-axis form a right-handed three-dimensional Cartesian coordinate system. When the underwater robot 111 moves as designed and is in a suitable position, the x-axis is parallel to the Y-axis, and the y-axis and z-axis are parallel to the movement plane Pm.

[0065] Fig. 4 is a diagram of the MBS 114 as viewed from the negative side of the y axis, Fig. 5 is a diagram of the MBS 114 as viewed from the negative side of the x axis, and Fig. 6 is a diagram of the MBS 114 as viewed from the positive side of the z axis.

[0066] The MBS 114 emits an acoustic beam 411 (sound wave beam) in a plurality of directions, listens to sound waves from a plurality of listening directions including at least a portion of the plurality of directions, and generates listening result information indicating the listening results in time series.

[0067] In detail, in one measurement, the MBS 114 emits an acoustic beam 411 in multiple directions in the zx plane and listens to sound waves from the multiple directions. The traveling direction of the acoustic beam 411 and the direction in which the sound waves are listened to (e.g., listening direction Da) are, for example, the same. The listening direction Da in the zx plane is defined by a deflection angle β when the z axis is used as a reference. Note that the traveling direction of the acoustic beam 411 and the direction in which the sound waves are listened to may be different.

[0068] That is, in one measurement, the MBS 114 emits the acoustic beam 411 in a plurality of listening directions Da determined by a plurality of deflection angles β, and listens to sound waves from the plurality of listening directions Da.

[0069] 7 is a diagram showing an example of an acoustic image according to an embodiment of the present disclosure. As shown in Figs. 4 to 7, the MBS 114 generates a sector-shaped acoustic image 301 having a radius and a central angle that are the elapsed time from the time when the acoustic beam 411 is emitted and a deflection angle β, respectively, and including an image 302 corresponding to the echo of the acoustic beam 411 from the mooring line 401. In this embodiment, the acoustic image 301 further includes an image 303 corresponding to the echo of the acoustic beam 411 from the sea surface.

[0070] An image may exist within the range of the sector-shaped acoustic image 301. The measurement origin of the MBS 114 is located at the intersection of two radii passing through both ends of the sector arc, that is, at the center of the sector.

[0071] As a coordinate representation in the acoustic image 301 (hereinafter sometimes referred to as acoustic image coordinates), the above intersection point is set as the origin, and u-axis and v-axis that are orthogonal to each other are defined. The u-axis direction is, for example, a direction that bisects the central angle of the sector, and is taken so as to show a time series of sound listening results based on the acoustic beam 411 emitted in the z-axis direction. The direction Dr defined by the deflection angle β with respect to the u-axis shows a time series of sound listening results based on the acoustic beam 411 emitted in the sound listening direction Da (see FIG. 5).

[0072] The radius of the sector is the maximum distance R (hereinafter, sometimes referred to as the measurement range R) that can be measured by the MBS 114. The measurement range R of the MBS 114 is appropriately set in accordance with the size of the mooring rope 401.

[0073] When the MBS 114 receives an echo based on the acoustic beam, the position of the image is determined by the direction and the time elapsed from the time the acoustic beam 411 is emitted until the echo is received. The shorter the time that elapses until the echo returns, the closer the image is to the origin (0,0) of the acoustic image coordinates, and the longer the time that elapses, the closer the image is to the sector arc.

[0074] Furthermore, the stronger the echo, the whiter the image appears. The white rod-shaped image 302 appearing inside the sector-shaped area in the acoustic image 301 is the image of the mooring line 401. When the underwater robot 111 moves as designed and is positioned in a suitable position, the image 302 of the mooring line 401 appears as an image extending straight on the u-axis.

[0075] In this embodiment, the MBS 114 generates an acoustic image 301 for each measurement. The MBS 114 performs measurement at a predetermined period, for example, and transmits image information indicating the acoustic image 301 to the computer 101 via the communication unit 112.

[0076] Fig. 8 is a diagram showing an example of a swivel mechanism 113 according to an embodiment of the present disclosure. As shown in Fig. 8, the swivel mechanism 113 is fixed to an underwater robot 111 (not shown).

[0077] The oscillating mechanism 113 has a rotation shaft (not shown) that is rotated by, for example, a motor. The rotation shaft is parallel to the x-axis. The MBS 114 is attached to the rotation shaft of the oscillating mechanism 113. This allows the MBS 114 to rotate around the rotation shaft.

[0078] In this embodiment, the oscillating mechanism 113 rotates the rotation shaft back and forth at a predetermined angular velocity within a predetermined angular range, thereby causing the MBS 114 to perform a continuous oscillating motion.

[0079] 4 and 8, the swing angle measurement unit 117 measures the swing angle (zenith angle) of the MBS 114. In this embodiment, the swing angle measurement unit 117 includes, for example, an angle sensor, and acquires the angle of the rotation axis of the swing mechanism 113 detected by the angle sensor, i.e., the swing angle, at a predetermined period. The swing angle measurement unit 117 transmits swing angle information indicating the acquired angle to the computer 101 via the communication unit 112.

[0080] It is preferable that the measurement timing of the angle sensor and the measurement timing of the MBS 114 are substantially the same. Note that the measurement timing of the angle sensor and the measurement timing of the MBS 114 may be different.

[0081] [Measurement principle] 9 and 10 are diagrams for explaining the principle of direction estimation performed by a direction estimation device according to an embodiment of the present disclosure. As shown in FIG. 9 and FIG. 10, the length L of the image 302 of the mooring line 401 varies depending on the distance from the MBS 114 to the mooring line 401 and the incident angle of the acoustic beam to the mooring line 401. * image (See Figure 7) Theoretically derive how the length changes.

[0082] As shown in FIG. 9, when the MBS 114 is located at point O, a situation is assumed in which the perpendicular line from point O to the mooring line 401 is not included in the acoustic beam 411.

[0083] When the MBS 114 is viewed from the front side (z-axis + side), the angle between the rotation axis TA of the swing and the extension direction of the mooring line 401 is 90 degrees (see FIG. 6). Also, the mooring line 401 is positioned exactly in the center of the viewing angle of the MBS 114 (see FIG. 4).

[0084] Furthermore, to simplify the discussion, the following five assumptions are made: The first assumption is that the mooring line 401 is considered to be locally straight in the region of the mooring line 401 where the acoustic beam 411 hits when the MBS 114 performs a swiveling motion.

[0085] The second assumption is to ignore the thickness of the mooring line 401. This is equivalent to considering the acoustic beam 411 to reflect from the central axis of the mooring line 401.

[0086] The third assumption is to consider the MBS 114 as a point. The fourth assumption is that the acoustic beam 411 is uniformly distributed only within a certain symmetric angle range (e.g., 2δ) from the body of the MBS 114 (see FIGS. 5, 9, and 10).

[0087] The fifth assumption is that the pulse width of the acoustic beam 411 is ignored and that the acoustic beam 411 spreads out like a widthless arc.

[0088] With these assumptions, consider the length of the image 302 of the mooring line 401 reflected in the acoustic image 301. 2δ is the distribution angle of the acoustic beam 411 in the yz plane. The distance d is the length of the perpendicular line OH drawn from the point O to the mooring line 401.

[0089] α is the swivel angle of the MBS 114, with the reference direction Ds from the point O as the reference and the counterclockwise direction as viewed from the x-axis + side to the x-axis - side as the positive direction. The reference direction Ds is, for example, the horizontal direction. α0 is the swivel angle α when the acoustic beam 411 is perpendicularly incident on the mooring line 401.

[0090] Point A is the intersection point between the center line of the acoustic beam 411 and the mooring line 401. Points B and C are the upper and lower intersection points, respectively, between the mooring line 401 and a line indicating the distribution range of the acoustic beam, which is taken up and down by δ from the center line of the acoustic beam 411.

[0091] First, for simplicity, consider the case where α0=0°. When the acoustic beam 411 is reflected by the mooring line 401 and returns to the MBS 114, the acoustic beam 411 is distributed in the area inside the triangle OBC. The length L1 of the longest reflection path in this area is the longer of the line segments OB and OC. The length L1 is calculated by using d=OH as follows:

number

[0092] On the other hand, the shortest reflection path is classified according to whether or not point H is located between point B and point C. When point H is located between point B and point C (see FIG. 10), the length of the shortest path is equal to d=OH.

[0093] If point H is not located between points B and C (see FIG. 9), the shorter of the line segments OB and OC is the shortest path. Therefore, the length L2 of the shortest reflection path is given by

number

[0094] From the above, the difference between the length of the shortest route and the length of the shortest route L diff teeth,

number

[0095] The measurement range of the MBS114 is R, and the length of the image 302 is L * image L diff If we express it as a ratio to R,

number

[0096] Here, let us consider the case where α0 ≠ 0°. When α0 ≠ 0°, if we consider that the mooring line 401 is rotated around the point O by the symmetric angle α0, the length L of the image 302 will be * image The theoretical solution is,

number

[0097] FIG. 11 illustrates the length L of the image 302 according to one embodiment of the present disclosure. * image 11 is a diagram showing an example of the change in the theoretical solution of L * image The horizontal axis indicates the swing angle α in degrees.

[0098] As shown in FIG. 11, for example, d=2.0m, R=7.5m, α0=-45.0°, and δ=10.0°, and L * image When (α) is plotted, a downward convex curve is obtained that has a minimum value at α=α0 in the range of -90°≦α≦0°.

[0099] This means that when the oscillation angle is such that the acoustic beam 411 of the MBS 114 is perpendicularly incident on the mooring line 401, the image 302 of the mooring line 401 appears at its shortest in the acoustic image 301.

[0100] Even in the case of an actual mooring line 401, which is not necessarily a straight line, by regarding it as a straight line locally, the length L of the image 302 of the mooring line 401 can be calculated. image is minimized, the acoustic beam 411 of the MBS 114 is perpendicularly incident on the mooring line 401.

[0101] Fig. 12 is a diagram showing a configuration of a direction estimation device according to an embodiment of the present disclosure. Fig. 12 shows a software configuration of the direction estimation device 11. The direction estimation device 11 is configured, for example, by causing a processor 21 in a computer 101 to execute a program.

[0102] As shown in FIG. 12, the direction estimation device 11 includes, as functional blocks, a hearing result information acquisition unit 31, a head swing angle information acquisition unit 32, a control unit 33, an image processing unit 34, a data set generation unit 35, a direction estimation unit 36, an object coordinate calculation unit 37, an absolute coordinate information acquisition unit 38, and an overall shape estimation unit 39.

[0103] The control unit 33 in the direction estimation device 11 controls the underwater robot 111 via the bus 22 and the communication unit 23. Specifically, the control unit 33 controls the thrusters of the underwater robot 111, the swing mechanism 113, the MBS 114, and the like.

[0104] The sound listening result information acquisition unit 31 acquires sound listening result information. In this embodiment, the sound listening result information indicates the sound listening results of sound waves from a plurality of sound listening directions for each swing angle α and each deflection angle β.

[0105] Specifically, the sound hearing result information acquisition unit 31 receives, as the sound hearing result information, image information indicative of an acoustic image 301 from the underwater robot 111 at each measurement timing of the MBS 114.

[0106] Since the MBS 114 is caused to oscillate at a predetermined angular velocity by the oscillating mechanism 113, the image information is also information for each oscillating angle α. The sound hearing result information acquisition unit 31 outputs the acquired acoustic image 301 to the image processing unit .

[0107] When the image processing unit 34 receives the acoustic image 301 from the hearing result information acquisition unit 31, the image processing unit 34 calculates the length L of the image 302 based on the acoustic image 301. * image (See Figure 7.)

[0108] Specifically, the image processing unit 34 sets an area including the image 302, for example, and binarizes the area. The image processing unit 34 performs opening morphological transformation on the binarized area (hereinafter, may be referred to as the binarized area) to remove small noise points, and then performs closing morphological transformation to connect small gaps.

[0109] The image processing unit 34 selects the contour having a point closest to the measurement origin (u=0, v=0) from among multiple contours in the binarized region. However, points that are too close to the measurement origin may be regarded as noise points and excluded.

[0110] The image processor 34 gives the smallest rectangle that circumscribes the selected contour and has each side parallel to the sides of the original image.

[0111] The image processing unit 34 calculates the position (u1, v1) that is the midpoint of the bottom side of the rectangle as the position of the bottommost part of the image 302 of the mooring rope 401. In addition, the image processing unit 34 calculates the height of the rectangle as the length L of the image 302 of the mooring rope 401. * image It is calculated as follows.

[0112] The image processing unit 34 receives bottom position information indicating the calculated bottom position (u1, v1) of the image 302 and the length L * image The length information indicating this is output to the data set generating unit 35.

[0113] The swing angle information acquisition unit 32 receives the swing angle information from the MBS 114 at each measurement timing of the swing angle measurement unit 117 in the MBS 114, and outputs the swing angle information to the data set generation unit .

[0114] FIG. 13 illustrates the length L of the image 302 according to one embodiment of the present disclosure. * image 13 is a diagram showing an example of a time change of L * image The horizontal axis indicates time.

[0115] The data set generating unit 35 receives the bottom position information and length information from the image processing unit 34, and calculates the bottom position (u1, v1) and the length L of the image 302. * image The position (u1, v1) of the bottom and the length L of the image 302 are stored in correspondence with each other. * image A first data set is generated in which the set of the measurement time and the measurement time are arranged in chronological order. The graph shown in FIG. 13 shows the L * image This is a plot of the change over time.

[0116] Furthermore, the data set generating unit 35 receives the swing angle information from the swing angle information acquiring unit 32, and stores the swing angle α in association with the measurement time. This generates a second data set in which pairs of the swing angle α and the measurement time are arranged in chronological order.

[0117] The data set generator 35 calculates the position (u1, v1) of the bottom of the image 302 and the length L of the image 302 based on the relationship between the measurement time in the first data set and the measurement time in the second data set. * image 13 is converted from time to the swing angle α based on the third data set. The data set generator 35 outputs the third data set to the direction estimator 36.

[0118] 14 is a diagram showing an example of a result of fitting by a fitting unit according to an embodiment of the present disclosure. In FIG. 14, the vertical axis represents L * image The horizontal axis indicates the swing angle α in degrees.

[0119] The direction estimation unit 36 ​​estimates the length L of each image 302 indicated by the image information for each swing angle α. * image The normal incidence direction is estimated based on

[0120] In this embodiment, upon receiving the third data set from the data set generator 35, the direction estimator 36 estimates the normal incidence direction based on the third data set.

[0121] Specifically, the direction estimation unit 36 ​​performs fitting based on the third data set and formula (5) to calculate the target angle α0 that gives the curve Cb when formula (5) best fits the third data set. The direction estimation unit 36 ​​calculates the target angle α0 for each one-way swing of the MBS 114.

[0122] In this embodiment, the shape of the mooring rope 401 is approximated by a straight line, so that a point on the linear mooring rope 401 that is the shortest distance from the MBS 114 is located in the direction of the target angle α0.

[0123] Furthermore, the direction estimation unit 36 ​​calculates the distance d between the MBS 114 and the mooring rope 401 based on image information when the estimated normal incidence direction is included in the acoustic beam 411 .

[0124] In this embodiment, the direction estimation unit 36 ​​acquires the position (u1, v1) of the bottom of the image 302 in the acoustic image 301 that corresponds to the swing angle α that is closest to the target angle α0 in the third data set.

[0125] The direction estimation unit 36 ​​estimates the distance d from the acquired position (u1, v1) to the origin (0, 0) of the acoustic image coordinates in the acoustic image 301. image Calculate the distance dimage The result of multiplying this by the measurement range R is calculated as the distance d from the MBS 114 to the mooring line 401.

[0126] Fig. 15 is a diagram showing an example of a target angle α0 calculated for each scan by a fitting unit according to an embodiment of the present disclosure. In Fig. 15, the vertical axis indicates the target angle α0 in units of "°". The horizontal axis indicates the number of scans. For example, when the number of scans is an odd number and an even number, the results are the forward and backward swing motions of the MBS 114, respectively.

[0127] 16 is a diagram showing an example of a distance d calculated for each scan by a fitting unit according to an embodiment of the present disclosure. The vertical axis indicates the distance d in units of "m". The horizontal axis can be read in the same way as in FIG. 15. The direction estimation unit 36 ​​outputs the target angle α0 and the distance d to the target coordinate calculation unit 37 for each scan, i.e., for each one-way swing of the MBS 114.

[0128] When the absolute coordinate information acquisition unit 38 receives the absolute coordinate information from the underwater robot 111 via the bus 22 , it outputs the absolute coordinate information to the object coordinate calculation unit 37 .

[0129] The target coordinate calculation unit 37 calculates the absolute coordinates of the mooring rope 401 based on the target angle α0 and distance d received from the direction estimation unit 36 ​​and the absolute coordinate information received from the absolute coordinate information acquisition unit 38.

[0130] Fig. 17 is a diagram for explaining a method for calculating coordinates of a mooring line according to an embodiment of the present disclosure. As shown in Figs. 12 and 17, the absolute coordinates of the position of the MBS 114 are (xs, zs), the pitch angle of the robot is θ, the swing angle at normal incidence is the target angle α0, and the absolute coordinates of the point where the center plane 411a of the acoustic beam 411 and the mooring line 401 intersect are (xt, zt). In addition, θ is positive in the counterclockwise direction as viewed from the Y-axis + side, and α0 is positive in the clockwise direction as viewed from the Y-axis + side. In this case, (xt, zt) T is calculated as follows:

number

[0131] If the absolute coordinates of the positioning center of the underwater robot 111 are (xb, zb) and the absolute coordinates of the relative mounting position of the MBS 114 as viewed from that point are (xsb, zsb), then (xs, zs) T is (xb,zb) T and (xsb,zsb) T It is expressed as follows using

number

[0132] From equations (6) and (7), (xs, zs) T By eliminating (xb, zb), the parameters can be easily extracted in the actual machine. T and (xsb,zsb) T Using (xt,zt) T can be expressed as follows:

number

[0133] The object coordinate calculation unit 37 calculates (xt, zt) as the absolute coordinates of the mooring rope 401, and stores object coordinate information indicating the calculated absolute coordinates in the memory 24 or disk 25 via the bus 22.

[0134] 18 to 21 are diagrams showing an example of measurement results of absolute coordinates of a mooring rope according to an embodiment of the present disclosure. In Fig. 18 to Fig. 21, the vertical axis indicates the Z coordinate in units of "m", and the horizontal axis indicates the X coordinate in units of "m".

[0135] 18 to 21, a plurality of markers are attached to a mooring line 401. A symbol 401a is located at the absolute coordinates of the markers measured, for example, by underwater motion capture.

[0136] As shown in FIG. 18, the multiple symbols included in symbol group Sr1 are each located at the absolute coordinates at the time when underwater robot 111 generated the sound listening result information.

[0137] A plurality of symbols included in the symbol group St1 are located at the absolute coordinates of the mooring rope 401 calculated based on the sound listening result information generated at the positions of the plurality of symbols included in the symbol group Sr1.

[0138] The multiple symbols included in symbol group Sr2 are each located at the absolute coordinates at the time when underwater robot 111 generated the sound listening result information.

[0139] A plurality of symbols included in the symbol group St2 are located at the absolute coordinates of the mooring rope 401 calculated based on the sound listening result information generated at the positions of the plurality of symbols included in the symbol group Sr2.

[0140] The multiple symbols included in symbol group Sr3 are each located at the absolute coordinates at the time when underwater robot 111 generated the sound listening result information.

[0141] A plurality of symbols included in symbol group St3 are located at the absolute coordinates of the mooring rope 401 calculated based on the sound listening result information generated at the positions of a plurality of symbols included in symbol group Sr3.

[0142] As shown in FIG. 19, the multiple symbols included in symbol group Sr4 are each located at the absolute coordinates at the time when underwater robot 111 generated the sound listening result information.

[0143] A plurality of symbols included in symbol group St4 are located at the absolute coordinates of the mooring rope 401 calculated based on the sound listening result information generated at the positions of the plurality of symbols included in symbol group Sr4.

[0144] The multiple symbols included in symbol group Sr5 are each located at the absolute coordinates at the time when underwater robot 111 generated the sound listening result information.

[0145] A plurality of symbols included in symbol group St5 are located at the absolute coordinates of the mooring rope 401 calculated based on the sound listening result information generated at the positions of a plurality of symbols included in symbol group Sr5.

[0146] As shown in FIG. 20, the multiple symbols included in symbol group Sr6 are each located at the absolute coordinates at the time when underwater robot 111 generated the sound listening result information.

[0147] A plurality of symbols included in symbol group St6 are located at the absolute coordinates of the mooring rope 401 calculated based on the sound listening result information generated at the positions of the plurality of symbols included in symbol group Sr6.

[0148] As shown in FIG. 21, the multiple symbols included in symbol group Sr7 are each located at the absolute coordinates at the time when underwater robot 111 generated the sound listening result information.

[0149] A plurality of symbols included in symbol group St7 are located at the absolute coordinates of the mooring rope 401 calculated based on the listening result information generated at the positions of the plurality of symbols included in symbol group Sr7.

[0150] In this way, each symbol included in the symbol groups St1 to St7 well reproduces the curve (not shown) connecting each symbol 401a. That is, the direction estimation device 11 can calculate the absolute coordinates of the mooring rope 401 with high accuracy.

[0151] 12 , if the overall shape of the mooring line 401 is known, it is useful for monitoring the mooring line 401, so there is a demand for a technique for estimating the shape of the mooring line 401. In this embodiment, the overall shape estimation unit 39 in the direction estimation device 11 estimates the shape of the mooring line 401 based on a plurality of pairs of the normal incidence direction and the distance d stored in the memory 24 or the disk 25.

[0152] In this embodiment, the overall shape estimation unit 39 acquires multiple pieces of object coordinate information stored in the memory 24 or the disk 25 via the bus 22, and estimates the overall shape of the mooring rope 401 based on the acquired multiple pieces of object coordinate information.

[0153] Specifically, the overall shape estimation unit 39 acquires multiple pieces of target coordinate information stored in the memory 24 or disk 25 after, for example, the control of the underwater robot 111 by the control unit 33 has ended.

[0154] The overall shape estimation unit 39 assumes, for example, a curve that closely approximates the shape of the mooring rope 401. In this embodiment, the overall shape estimation unit 39 assumes a catenary curve whose shape is determined by parameters, and performs fitting based on the acquired multiple object coordinate information and the assumed catenary curve, thereby calculating parameters when the catenary curve best fits each absolute coordinate indicated by the multiple object coordinates.

[0155] Based on the calculated parameters and the catenary curve, the overall shape estimation unit 39 estimates the overall shape of the mooring rope 401. In other words, it is possible to estimate the overall shape of the mooring rope 401 based on fragmentary measurement results.

[0156] [Direction estimation process] FIG. 22 is a flowchart that defines an operation procedure when the direction estimation device 11 according to an embodiment of the present disclosure performs the direction estimation process.

[0157] 22, the underwater robot 111 moves, for example, along a predetermined path of movement. The path of movement includes, for example, a plurality of suitable positions in the vicinity of the mooring line 401.

[0158] First, the direction estimation device 11 moves, for example, the underwater robot 111 along a movement path (step S102).

[0159] Next, the direction estimation device 11 performs a measurement process (step S104). The measurement process is started when a predetermined condition is satisfied, for example, when the underwater robot 111 reaches a predetermined measurement position or when a predetermined measurement timing arrives.

[0160] Next, the direction estimation device 11 determines whether or not the underwater robot 111 has reached the end point of the predetermined movement path (step S106).

[0161] If the direction estimation device 11 determines that the underwater robot 111 has not reached the end point (NO in step S106), it causes the underwater robot 111 to move further along the movement path (step S102).

[0162] On the other hand, when the direction estimation device 11 determines that the underwater robot 111 has reached the end point (YES in step S106), it outputs the shape of the mooring ropes 401 based on the calculated absolute coordinates of the multiple mooring ropes 401 (step S108).

[0163] 23 is a flowchart that defines an operation procedure when the direction estimation device according to an embodiment of the present disclosure performs a measurement process. FIG 23 shows details of the operation in step S104 in FIG 22.

[0164] 23, first, the direction estimation device 11 performs a measurement start process (step S202). Specifically, the direction estimation device 11 activates the swing mechanism 113, MBS 114, absolute coordinate measurement unit 116, and swing angle measurement unit 117 in the underwater robot 111. This causes the underwater robot 111 to transmit swing angle information, image information, and absolute coordinate information to the direction estimation device 11. The swing mechanism 113 causes the MBS 114 to perform a swing motion.

[0165] Next, the direction estimation device 11 performs information acquisition processing (step S204) until the swing angle α of the MBS 114 reaches the upper limit (NO in step S206).

[0166] Next, the direction estimation device 11 performs a process of calculating the target object position coordinates (step S208).

[0167] Next, the direction estimation device 11 performs the information acquisition process (step S210) until the swing angle α of the MBS 114 reaches the lower limit (NO in step S212).

[0168] Next, the direction estimation device 11 performs a process of calculating the target object position coordinates (step S214).

[0169] Next, when the direction estimation device 11 determines that the predetermined end condition is not satisfied (NO in step S216), it performs information acquisition processing (step S204) until the swing angle α of the MBS 114 reaches the upper limit (NO in step S206).

[0170] The predetermined end condition is, for example, that a predetermined time has elapsed since the start of measurement, or that the oscillating mechanism 113 has caused the oscillating angle of the MBS 114 to reciprocate a predetermined number of times.

[0171] On the other hand, if direction estimation device 11 determines that the predetermined end condition is satisfied (YES in step S216), it ends the measurement process.

[0172] 24 is a flowchart that defines an operation procedure when the direction estimation device according to an embodiment of the present disclosure performs information acquisition processing. FIG 24 shows details of the operations in steps S204 and S210 in FIG 23.

[0173] As shown in FIG. 24, first, the direction estimation device 11 waits until image information, swing angle information or absolute coordinate information is received from the underwater robot 111 (NO in step S302, NO in step S308 and NO in step S314).

[0174] When the direction estimation device 11 receives the image information from the underwater robot 111 (YES in step S302), it processes the acoustic image 301 indicated by the image information and obtains the position (u1, v1) of the bottom of the image 302 and the length L of the image 302. *image (Step S304).

[0175] Next, the direction estimation device 11 calculates the position (u1, v1) of the bottom and the length L of the image 302. * image are stored in the first data set in association with the measurement time (step S306).

[0176] Furthermore, when the direction estimation device 11 receives the swing angle information from the underwater robot 111 (YES in step S308), it stores the swing angle α indicated by the swing angle information in a second data set in association with the measurement time (step S310).

[0177] Furthermore, when the direction estimation device 11 receives absolute coordinate information from the underwater robot 111 (YES in step S312), it stores the swing angle α indicated by the swing angle information in association with the measurement time (step S314).

[0178] Fig. 25 is a flowchart that defines an operation procedure when the direction estimation device according to an embodiment of the present disclosure performs a calculation process of the target object position coordinates. Fig. 25 shows details of the operations in steps S208 and S214 in Fig. 23.

[0179] As shown in FIG. 25, first, the direction estimation device 11 calculates the position (u1, v1) of the bottom of the image 302 and the length L of the image 302 based on the relationship between the measurement time in the first data set and the measurement time in the second data set. * image A third data set is generated in which the position of the head is associated with the swing angle α (step S402).

[0180] Next, the direction estimation device 11 performs fitting based on the third data set and equation (5) to calculate the target angle α0 that gives the curve Cb when equation (5) best fits the third data set (step S404).

[0181] Next, the direction estimation device 11 acquires the position (u1, v1) of the bottom of the image 302 corresponding to the swivel angle α closest to the target angle α0 in the third data set, and calculates the distance d from the origin (0, 0) of the acoustic image coordinates to the position (u1, v1). image The result of multiplying this by the measurement range R is calculated as the distance d from the MBS 114 to the mooring rope 401 (step S406).

[0182] Next, the direction estimation device 11 calculates the absolute coordinates of the mooring rope 401 based on the target angle α0, the distance d, and the absolute coordinates indicated by the absolute coordinate information (step S408).

[0183] (First Modification) 26 is a diagram showing an example of a target angle α0 calculated for each scan by a fitting unit in a first modified example of a direction estimation device according to an embodiment of the present disclosure. Note that the way to view FIG. 26 is the same as that of FIG. 15.

[0184] For example, the timing at which the MBS 114 generates the acoustic image 301 may differ from the timing at which the swing angle information acquisition unit 32 acquires the swing angle α. In this case, the target angle α0 during the forward swing motion (e.g., when the number of scans is an odd number) becomes larger or smaller than the target angle α0 during the backward swing motion (e.g., when the number of scans is an even number).

[0185] In detail, for example, when, on the outbound journey, the swing angle information acquisition unit 32 measures an angle larger than the swing angle α at which the MBS 114 generated the acoustic image 301, on the return journey, the swing angle information acquisition unit 32 measures an angle smaller than the swing angle α at which the MBS 114 generated the acoustic image 301.

[0186] Also, for example, if, on the outbound journey, the swing angle information acquisition unit 32 measures an angle smaller than the swing angle α at which the MBS 114 generated the acoustic image 301, on the return journey, the swing angle information acquisition unit 32 measures an angle larger than the swing angle α at which the MBS 114 generated the acoustic image 301.

[0187] In contrast, in the first variant of the direction estimation device 11, the direction estimation unit 36 ​​calculates the average of two target angles α0 for two consecutive scan numbers as the target angle α0 for one of the two consecutive scan numbers.

[0188] Specifically, the direction estimation unit 36 ​​calculates, for example, the average of two target angles α0 when the number of scans is 1 and 2, as the target angle α0 when the number of scans is 1.

[0189] Then, the direction estimation unit 36 ​​calculates, for example, the average of the two target angles α0 when the number of scans is two and three, as the target angle α0 when the number of scans is two.

[0190] This makes it possible to cancel out the difference between the swing angle α at which the MBS 114 generates the acoustic image 301 and the swing angle α measured by the swing angle information acquisition unit 32, thereby suppressing the variation in the target angle α0.

[0191] In this embodiment, the object of shape measurement is the mooring rope 401, but the present invention is not limited to this. The object may be, for example, an object that appears linear when viewed from the edge, such as a ship's rudder.

[0192] Furthermore, in this embodiment, a configuration has been described in which image information is transmitted from the underwater robot 111 to the computer 101 each time the MBS 114 generates image information, but the present invention is not limited to this. A configuration in which the image information generated by the MBS 114 is sequentially stored in a storage device provided in the underwater robot 111 may also be used. In this case, after measurement by the MBS 114 is completed, the direction estimation device 11 estimates the normal incidence direction based on the image information stored in the storage device.

[0193] In addition, in this embodiment, a configuration in which the MBS 114 is provided on the underwater robot 111 has been described, but the present invention is not limited to this. A scanning sonar may be provided on the underwater robot 111 instead of the MBS 114. However, a configuration in which the MBS 114, which has good accuracy in the declination direction, is provided on the underwater robot 111 is preferable.

[0194] In addition, in this embodiment, a configuration has been described in which the orientation of MBS 114 is changed by the oscillating motion of oscillating mechanism 113, but the present invention is not limited to this. For example, a configuration in which MBS 114 is fixed to underwater robot 111 and the orientation of MBS 114 is changed by adjusting the pitch of underwater robot 111 may also be used.

[0195] In addition, in this embodiment, the MBS 114 is provided on the underwater robot 111, but the present invention is not limited to this. The MBS 114 may be provided on a ship or held by a diver.

[0196] In this embodiment, L * image In the above, the target angle α0 at normal incidence is estimated by fitting the model function, i.e., equation (5), to the plot of the above, but the present invention is not limited to this. For example, two L * image Compared to the smaller L * image Alternatively, an algorithm may be used to determine that the sound beam is close to normal incidence when the oscillation angle α is set to 0. Since equation (5) has a minimum value, L can be calculated by repeatedly executing this algorithm. * image The normal incidence direction for which is minimum can be found.

[0197] In this embodiment, the configuration for determining absolute coordinates from the coordinates of the relative position (target angle α0 and distance d) has been described, but the present invention is not limited to this. For example, when a rider is on board the underwater robot 111, the rider can easily recognize the position of the target object based on the target angle α0 and distance d.

[0198] The above-described embodiments are intended to facilitate understanding of the present invention, and are not intended to limit the present invention. The elements of the embodiments, as well as their arrangements, materials, conditions, shapes, sizes, etc., are not limited to those shown as examples and can be changed as appropriate. In addition, configurations shown in different embodiments can be partially substituted or combined with each other. [Explanation of symbols]

[0199] 11...Direction estimation device 21…Processor 22…Bus 23…Communications Department 24…Memory 25…Disc 31…Hearing result information acquisition unit 32... Swing angle information acquisition unit 33...Control section 34...Image processing unit 35…Dataset generation section 36…Direction estimation unit 37... Object coordinate calculation unit 38...Absolute coordinate information acquisition section 39...Overall shape estimation section 101…Computer 111... Underwater robot 112…Communications Department 113... Swing mechanism 114…Multibeam imaging sonar 115...Thruster control unit 116...Absolute coordinate measuring unit 117... Swing angle measurement part 201...Direction Estimation System 301... Acoustic image 302, 303...statue 401...Mooring rope 411…Acoustic beam 411a...Central plane TA…Rotation axis Pm…moving surface Pb…bottom surface Da…Listening direction Ds…Reference direction R: Measurement range

Claims

1. An information acquisition unit that acquires sound-hearing result information indicating a time series of sound-hearing results measured by a sonar that emits sound beams in multiple directions, the sound-hearing result being from multiple sound-hearing directions including at least a portion of the multiple directions; and a direction estimating unit that estimates a normal incidence direction in which the sound wave beam is normal to the object based on the hearing result information. Direction estimation device.

2. The sound listening result information indicates the sound listening results of the sound waves from the multiple sound listening directions for each zenith angle and each deviation angle. The direction estimation device according to claim 1 .

3. The information acquisition unit acquires, as the hearing result information, image information showing a sector-shaped image having a radius and a central angle that are the elapsed time from the time when the sound beam was emitted and the deflection angle, respectively, for each zenith angle, the image including an image corresponding to the echo of the sound beam from the object; The direction estimation unit estimates the vertical incidence direction based on the image information for each zenith angle. The direction estimation device according to claim 2 .

4. The direction estimation unit estimates the normal incidence direction based on a length of each of the images included in each of the images indicated by the image information for each of the zenith angles. The direction estimation device according to claim 3 .

5. The direction estimation unit further calculates a distance between the sonar and the object based on the image information when the estimated normal incidence direction is included in the sound wave beam. The direction estimation device according to claim 3 .

6. The object appears to the sonar as a straight line. The direction estimation device according to claim 1 .

7. The distance between the plane including the object and the sonar is smaller than a value determined based on the distance between the sonar and the object. The direction estimation device according to claim 6 .

8. The direction estimation device comprises: A storage unit that stores a pair of the normal incidence direction and the distance; A shape estimation unit that estimates a shape of the object based on the plurality of sets stored in the storage unit, The direction estimation device according to claim 5 .

9. The sonar is a multi-beam sonar. The direction estimation device according to claim 1 .

10. The sonar is a scanning sonar. The direction estimation device according to claim 1 .

11. An underwater robot equipped with sonar, A direction estimation device according to any one of claims 1 to 10, The sonar emits sound beams in a plurality of directions, listens to sound waves from a plurality of listening directions including at least a part of the plurality of directions, and generates listening result information indicating the listening results in a time series. Orientation Estimation System.

12. The sonar is a multi-beam sonar that measures the sound waves from the plurality of listening directions for each declination angle, The underwater robot comprises: A mechanism for directing the sonar to a listening direction for each zenith angle among the plurality of listening directions, The direction estimation system of claim 11.

13. A direction estimation method for a direction estimation device, comprising: Acquiring sound-sensing result information indicating a time series of sound-sensing results measured by a sonar that emits sound beams in a plurality of directions, the sound-sensing result being from a plurality of sound-sensing directions including at least a portion of the plurality of directions; and estimating a normal incidence direction in which the sound beam is normal to the object based on the hearing result information. Direction estimation method.

14. A direction estimation program for use in a direction estimation device, Computer, An information acquisition unit that acquires sound-hearing result information indicating a time series of sound-hearing results measured by a sonar that emits sound beams in multiple directions, the sound-hearing result being from multiple sound-hearing directions including at least a portion of the multiple directions; a direction estimation unit that estimates a perpendicular incidence direction in which the sound wave beam is perpendicularly incident on an object based on the hearing result information, Direction estimation program.