Display device, program, and display method

Abstract

To provide a display device, a program, and a display method with which it is made possible to display much more information at a time than before, even when displaying detection results by a plurality of detection methods.SOLUTION: Provided is a display device for displaying detection results of non-steady sounds included in sound waves on the basis of the output of a wave receiver array for receiving sound waves. The display device comprises: an arithmetic unit including a plurality of output units for calculating a detection value which is the detection result of a non-steady sound on the basis of the output of the wave receiver array, calculating a grayscale value on the basis of the detection value by using a detection method, and outputting the grayscale value and a data point having the colors set by the detection method; and a display unit for displaying a data point deriving by adding the colors of the plurality of data points outputted by the plurality of output units and the grayscale value together, as the detection result of the non-steady sound calculated by the plurality of output units. The plurality of output units calculate the detection value which is the detection result of a non-steady sound by using a detection method that detects a non-steady sound on the basis of respectively different physical amounts.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present disclosure relates to a display device, a program, and a display method for displaying the results of a non-stationary sound detection process performed on an acoustic signal received by, for example, a sonar. [Background technology]

[0002] Conventionally, display devices that display the detection results of non-stationary sounds in sound waves are installed, for example, on ships equipped with a receiver array and used to detect objects (hereinafter sometimes referred to as targets) such as other ships. Here, non-stationary sounds refer to non-stationary acoustic components emitted by targets, such as sounding sounds. The receiver array is installed at a distance from the hull and is composed of multiple receivers so that the direction of the target can be determined. Among display devices that display the detection results of non-stationary sounds, there are those that display the detection results using multiple detection methods, such as distortion detection, color detection, and energy detection (see, for example, Non-Patent Document 1).

[0003] Fig. 1 shows a flow diagram of the conventional display device disclosed in Non-Patent Document 1. The conventional display device disclosed in Non-Patent Document 1 is configured to perform the following phasing processing, non-stationary component extraction processing, non-stationary sound detection processing using each detection method, and detection display processing that displays the detection results. In phasing processing, when the output waveform from the receiver array is input, weights and time delays are assigned to each receiver to adjust the phase, and the results are added for multiple receivers to form directivity and output waveform data for each horizontal direction. When the output of the phasing process is input, the non-stationary component extraction process predicts stationary components from the most recent observation data for one direction selected externally, and outputs a signal with an improved SNR (Signal to Noise power Ratio) by subtracting the predicted value from the current observation data to three non-stationary sound detection processes. When the output of the non-stationary component extraction process is input, each of the three non-stationary sound detection processes performs the following non-stationary sound detection process and outputs a detection value as the detection result to the detection display process. (a) The non-stationary sound detection process that performs distortion detection detects non-stationary sounds by utilizing the fact that there is distortion in the sound pressure distribution during the time period when non-stationary sounds are occurring. (b) The non-stationary sound detection process for detecting colored sounds detects non-stationary sounds by utilizing the fact that the level of frequency components is not constant during the time period when non-stationary sounds are occurring. (c) The non-stationary sound detection process that performs energy detection detects non-stationary sounds by utilizing the fact that energy is high during the time periods when non-stationary sounds are occurring. When the outputs from the three non-stationary sound detection processes are input, the detection display process compares the input detection values ​​with a set threshold, and displays the time period when the detection value exceeds the threshold as the time when non-stationary sound was detected by that detection method, distinguishing it from the time when it was not detected. Figure 2 shows the display screen of the detection results in the conventional display device disclosed in Non-Patent Document 1. [Prior art documents] [Non-patent literature]

[0004] [Non-Patent Document 1] Melvin J. Hinich, “Testing for Dependence in the Input to A Linear Time Series Model”, Journal of Nonparametric Statistics Volume 6 1996, pp.205-221 Summary of the Invention [Problem to be solved by the invention]

[0005] However, in conventional display devices such as that disclosed in Non-Patent Document 1, the detection results of unsteady sounds are displayed on the screen for each detection method for signals in only one specified direction, so the operator cannot see the detection results for multiple signals at the same time. Therefore, when displaying detection results using multiple detection methods, conventional display devices have a problem in that the amount of information that can be displayed at one time is limited.

[0006] The present disclosure has been made to solve the above-mentioned problems, and aims to provide a display device, a program, and a display method that are capable of displaying more information at one time than conventional methods, even when displaying detection results obtained using multiple detection methods. [Means for solving the problem]

[0007] The display device of the present invention is a display device that displays the detection results of non-stationary sound contained in sound waves based on the output of a receiver array that receives the sound waves, and is equipped with: a calculation unit that uses a certain detection method to calculate a detection value that is the detection result of the non-stationary sound based on the output of the receiver array, calculates a gradation value based on the detection value, and outputs a data point having the gradation value and a color set for the detection method; and a display unit that displays a data point that is the sum of the color and the gradation value of the multiple data points output by the multiple output units, as the detection result of the non-stationary sound calculated by the multiple output units, and the multiple output units each calculates the detection value that is the detection result of the non-stationary sound using the detection method that detects non-stationary sound based on a different physical quantity. The program disclosed herein is a program for causing a computer to function as a display device that displays the detection results of non-stationary sound contained in sound waves based on the output of a receiver array that receives the sound waves, and causes the computer to function as: a calculation unit that calculates detection values ​​that are the detection results of non-stationary sound based on the output of the receiver array using a certain detection method, calculates gradation values ​​based on the detection values, and has a plurality of output units that output data points that have the gradation values ​​and a color set for the detection method; and a display unit that displays a data point that is the sum of the colors and gradation values ​​of the plurality of data points output by the plurality of output units, as the detection result of non-stationary sound calculated by the plurality of output units, and the plurality of output units calculate the detection values ​​that are the detection results of the non-stationary sound using the detection methods that detect non-stationary sound based on different physical quantities, respectively. The display method of the present disclosure is a display method executed by a computer that displays the detection results of non-stationary sounds contained in sound waves based on the output of a receiver array that receives the sound waves, and includes: a first step of calculating detection values ​​that are the detection results of the non-stationary sounds based on the output of the receiver array using a plurality of detection methods, calculating gradation values ​​based on the detection values, and outputting data points that have the gradation values ​​and colors set for each of the detection methods; and a second step of displaying data points that are the sum of the colors and gradation values ​​of the plurality of data points output in the first step as the detection results of the non-stationary sounds calculated in the first step, wherein the first step calculates the detection values ​​that are the detection results of the non-stationary sounds using the detection methods that detect non-stationary sounds based on different physical quantities. [Effects of the Invention]

[0008] According to the present disclosure, multiple output units of a calculation unit use a certain detection method to calculate detection values ​​that are the detection results of unsteady sounds based on the output of a receiver array, calculate gradation values ​​based on the detection values, and output data points that have the gradation values ​​and a color set for the detection method. Here, the multiple output units calculate the detection values ​​that are the detection results of unsteady sounds using detection methods that detect unsteady sounds based on different physical quantities. The display unit then displays a data point that sums the colors and gradation values ​​of the multiple data points output by the multiple output units as the detection results of unsteady sounds calculated by the multiple output units. Therefore, multiple data points detected by different detection methods can be displayed simultaneously on a single data point, making it possible to display more information at one time than before, even when displaying detection results using multiple detection methods. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 10 is a flowchart showing an operation procedure of a conventional display device. [Figure 2] FIG. 1 is a diagram showing a display screen of a conventional display device. [Figure 3]1 is a block diagram showing an example of the configuration of a display system to which a display device according to a first embodiment is applied. [Figure 4] 4 is a diagram showing an example of a BTR display on the display unit of the display device of FIG. 3. FIG. [Figure 5] 4 is a flowchart showing the operation procedure of the display device of FIG. 3. [Figure 6] 10 is a flowchart showing the operation procedure of a calculation unit in the display device according to the second embodiment. FIG. [Figure 7] FIG. 7 is a flow chart of each output process in FIG. 6. [Figure 8] 7 is a diagram showing an example of ELAZ display on the display unit of the display device of FIG. 6. FIG. [Figure 9] FIG. 11 is a flowchart showing an operation procedure of the display device according to the third embodiment. [Figure 10] FIG. 11 is a diagram showing an example of a display screen of a display device according to the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] An embodiment of the display device 20 will be described with reference to the drawings. The display device 20 receives a plurality of signals, analyzes the signals, and displays the results. In the following first and second embodiments, the display device 20 constitutes part of a sonar device, and the sonar device including the display device 20 will be described as a passive sonar device that receives and analyzes acoustic signals from a target. Note that the display device 20 may also be applied to an active sonar device or radar device that emits its own sound. In the following third embodiment, the display device 20 receives and analyzes noise signals.

[0011] Embodiment 1 3 is a block diagram showing an example of the configuration of a display system 1 to which the display device 20 according to Embodiment 1 is applied. The configuration of the display device 20 will be described with reference to FIG.

[0012] The display device 20 displays the detection results of non-stationary sounds in sound waves, and is configured, for example, by an information processing device including a personal computer. As shown in Fig. 3, the display device 20 has a calculation unit 40 that performs calculation processing, a display unit 60 that displays the detection results, and a storage unit 50 that stores various data. The display device 20 is communicatively connected to the receiver array 10 via a signal line (not shown). Note that the communication connection between the display device 20 and the receiver array 10 may be wireless. The display device 20 and the receiver array 10 constitute a display system 1.

[0013] The receiver array 10 receives sound waves and outputs waveforms, and has a plurality of receivers 10a. For example, a microphone such as a hydrophone that converts an acoustic signal into an electrical signal is used as the receiver 10a. The receiver array 10 receives sound waves from all directions in the horizontal direction (0° to 360°), converts the acoustic signals into electrical signals, and inputs them to the display device 20. For example, the receiver array 10 is configured by arranging a plurality of receivers 10a in a row in the horizontal direction.

[0014] The calculation unit 40 can be configured by a calculation device such as a CPU (Central Processing Unit) and software that cooperates with the calculation device to realize the above functions. The storage unit 50 can be configured by a storage device such as a RAM (Random Access Memory), a ROM (Read Only Memory), a PROM (Programmable ROM), or an HDD (Hard Disk Drive). The display unit 60 is configured by a display, for example.

[0015] The calculation unit 40 has a phasing processing unit 41, an output unit 100, and a display processing unit 46. When an electrical signal is input from the receiver array 10 having a plurality of receivers 10a, the phasing processing unit 41 of the calculation unit 40 performs phase adjustment by assigning a weight and a time delay to each receiver 10a. The phasing processing unit 41 also forms directivity in the sound waves by adding the phase-adjusted results for each receiver 10a, and outputs the result as a signal (i.e., waveform data) for each horizontal direction. Each horizontal direction has a fixed angular width. The phasing processing unit 41 receives the electrical signal from the receiver array 10 at fixed time intervals and repeatedly performs the above phasing processing.

[0016] The output unit 100 of the calculation unit 40 detects and calculates non-stationary sounds for each horizontal direction, and outputs the results. The output unit 100 has a non-stationary component extraction unit 42 that performs non-stationary component extraction processing, a non-stationary sound detection unit 43 that performs non-stationary sound detection processing, a gradation processing unit 44 that performs gradation processing, and a pixel conversion unit 45 that performs pixel conversion processing. The non-stationary component extraction unit 42, the non-stationary sound detection unit 43, the gradation processing unit 44, and the pixel conversion unit 45 perform output processing, which will be described later, for each direction.

[0017] The non-stationary component extractor 42 extracts non-stationary components by subtracting stationary components from the signal for each azimuth direction from the phasing processor 41. Here, the stationary components are predicted from the immediately preceding signal. By subtracting the predicted value from the current signal in that azimuth direction, the non-stationary component extractor 42 can output a signal with an improved SNR (Signal to Noise power Ratio).

[0018] The non-stationary sound detection unit 43 detects non-stationary sounds from the signals extracted by the non-stationary component extraction unit 42. There are three types of detection methods: distortion detection, which detects non-stationary sounds based on the distortion of the extracted signal; color detection, which detects non-stationary sounds based on the color of the extracted signal; and energy detection, which detects non-stationary sounds based on the energy of the extracted signal. The non-stationary sound detection unit 43 performs each detection for each direction. Specifically, a first non-stationary sound detection process, a second non-stationary sound detection process, and a third non-stationary sound detection process are performed for each direction. The first non-stationary sound detection process detects non-stationary sounds by utilizing the distortion of the sound pressure distribution during times when non-stationary sounds are occurring. The second non-stationary sound detection process detects non-stationary sounds by utilizing the fact that the level of frequency components is not constant during times when non-stationary sounds are occurring. The third non-stationary sound detection process detects non-stationary sounds by utilizing the fact that energy is high during times when non-stationary sounds are occurring. The non-stationary sound detection unit 43 performs first non-stationary sound detection processing, second non-stationary sound detection processing, and third non-stationary sound detection processing on the signals in each direction, and outputs the detection results of these detection processes to the gradation processing unit 44.

[0019] The gradation processing unit 44 performs gradation processing on the detection results from each detection method to convert the detection values, which are the detection results from the non-stationary sound detection unit 43, into gradation values, and outputs multiple gradation values ​​for each direction to the pixel conversion unit 45.

[0020] The pixel conversion unit 45 performs pixel conversion processing for each direction, converting the multiple gradation values ​​from the gradation processing unit 44 into the RGB values ​​of one data point, and outputs the converted data for all directions to the display processing unit 46. Specifically, different colors are assigned to the multiple detection methods used by the unsteady sound detection unit 43. The detection results are then assumed to have a gradation corresponding to the detection value and a color corresponding to the detection method, and multiple detection results obtained for the same signal are converted into the same data point having a color obtained by adding together these gradated colors. For example, if the unsteady sound detection unit 43 uses three types of detection methods, such as skewness detection, coloredness detection, and energy detection, the three primary colors of light, red, green, and blue, are assigned to the three detection methods, respectively, and the RGB values ​​of the pixels displaying the same data point are determined.

[0021] The display processing unit 46 of the calculation unit 40 converts the outputs of the multiple output processes performed in parallel into image data in a predetermined format and displays it on the screen of the display unit 60. Specifically, data for all directions in the horizontal direction is input to the display processing unit 46 at regular time intervals from the output unit 100, and the display processing unit 46 performs BTR display processing, which displays these inputs on the display unit 60 in BTR (Bearing Time Recording) format, as one display process.

[0022] Fig. 4 is a diagram showing an example of a BTR display on the display unit 60 of the display device 20 of Fig. 3. As shown in Fig. 4, the display unit 60 displays data for all horizontal directions at multiple times in color at once, with the horizontal axis representing horizontal direction and the vertical axis representing time. Hereinafter, the horizontal axis and the vertical axis may be referred to as the first axis and the second axis, respectively.

[0023] For example, data point P1 representing a non-stationary sound arriving at time t1 from a horizontal azimuth angle θ1 is displayed in color with RGB values ​​(R1, G1, B1) determined by the pixel conversion process. Data point P1 representing a non-stationary sound arriving at time t1 from a horizontal azimuth angle θ1 is displayed in color with RGB values ​​(R1, G1, B1) determined by the pixel conversion process. Furthermore, data point P2 representing a non-stationary sound arriving at time t2 from a horizontal azimuth angle θ2 is displayed in color with RGB values ​​(R2, G2, B2) determined by the pixel conversion process.

[0024] In addition, in the case where the input of the display device 20 is the receiver array 10, the indicator for distinguishing between multiple signals is the direction of arrival of the sound waves, and this direction is made to correspond to the first axis, but it is sufficient to make the indicator corresponding to the input of the display device 20 correspond to the first axis.

[0025] FIG. 5 is a flow diagram showing the operation procedure of the display device 20 of FIG. 3. As shown in FIG. 5, the phasing process (step S1) is connected to N output processes (steps S100-1 to S100-N). Here, N is the number of horizontal azimuths and is an integer equal to or greater than 2. Each output process includes one non-stationary component extraction process, as many non-stationary sound detection processes and gradation processes as there are detection methods, and one pixel conversion process. The output process is performed on the waveform data for each azimuth obtained in the phasing process (step S1). That is, for each of the multiple azimuth angles θ1 to θN, non-stationary sounds are detected, and the detection results are calculated and output.

[0026] The output process performed for each azimuth angle θn is similar, so below, the output process (step S100-1) performed for the azimuth angle θ1 will be described in detail as a representative example with reference to FIGS.

[0027] In the non-stationary component extraction process (step S2-1), non-stationary components are extracted from the waveform data for the azimuth angle θ1 out of the output of the phasing process (step S100-1). The non-stationary component extraction process for the azimuth angle θ1 (step S2-1) outputs the extracted signals to each of the first to third non-stationary sound detection processes (steps S3-1-1 to S3-3-1), which use different detection methods.

[0028] Each of the first to third non-stationary sound detection processes (steps S3-1-1 to S3-3-1) detects non-stationary sounds from the input signal using a predetermined detection method, and outputs the detection results to the gradation process (steps S4-1-1 to S4-3-1).

[0029] Each of the three gradation processes (steps S4-1-1 to S4-3-1) uses a predetermined conversion formula to convert the detection value, which is the detection result, into a gradation value. Conversion formulas and the like corresponding to the detection method are stored in the storage unit 50. The gradation process (step S4-k-1) (k=1 to 3) refers to the storage unit 50, gradates the detection value using the conversion formula corresponding to the corresponding detection method, and connects to the pixel conversion process (step S5-1).

[0030] In the output process of the azimuth angle θ1 (step S100-1), the three gradation processes (steps S4-1-1 to S4-3-1) are connected to one pixel conversion process (step S5-1). When gradation values ​​are input from each of the three gradation processes (steps S4-1-1 to S4-3-1), the pixel conversion process (step S5-1) converts the three gradation values ​​into RGB values ​​of one data point.

[0031] The RGB values ​​for a plurality of azimuths that are repeatedly output at regular time intervals from a plurality of pixel conversion processes (steps S5-1 to S5-N) are sequentially output to the BTR display process (step S6) and stored in the storage unit 50. The N output processes (steps S100-1 to S100-N) are connected to one BTR display process (step S6), and information on data points obtained for a plurality of azimuth angles θ1 to θN is input to the BTR display process (step S6).

[0032] In the BTR display process (step S6), the outputs from the N output processes (steps S100-1 to S100-N), i.e., the detection results of non-stationary sounds by multiple detection methods for multiple horizontal directions, are displayed on the display unit 60 for each of multiple times.

[0033] Next, we will explain an example of the method of converting the detection results into gradation values, which is performed in each gradation process (step S4-kn) (k=1 to 3, n=1 to N). First, we will explain the gradation process (step S4-1-n) (n=1 to N) performed on the output from the first non-stationary sound detection process (step S3-1-n) (n=1 to N).

[0034] The input to the gradation process (step S4-1-n) (n=1 to N) is x 1_n , the output from the gradation process (step S4-1-n) (n=1 to N) is expressed as y 1_n , and the number of gradations is S, the gradation is performed for the skewness by the following equation (1).

[0035]

number

[0036] where X 1_L and X 1_U are the lower limit and upper limit of the preset gradation, respectively. For example, when the number of gradations S is set to 256, the detection result of the first non-stationary sound detection process (step S3-1-n) (n=1 to N), that is, the input x 1_n is the lower limit X 1_L If it is less than , the output y obtained by equation (1) 1_n That is, the gradation value is 0. On the other hand, the input x 1_n is the upper limit X 1_U If the input x is larger than 255, the gradation value obtained by equation (1) is 255. 1_n is the lower limit X 1_L Above and upper limit X 1_UIf it is within the range below, the gradation value obtained by equation (1) will be a value between 0 and 255.

[0037] More specifically, for example, input x 1_n is the lower limit X 1_L Above and upper limit X 1_U When the detected value is relatively small in the following range, that is, when the sound is non-steady and the difference from the steady sound is small, the gradation value is a lower value between 1 and (S-1). Therefore, in the BTR display shown in FIG. 4, the brightness of the color (e.g., red) associated with the skewness detection becomes darker in the color of the data point for that azimuth angle θn. Also, for example, when the input x 1_n is the lower limit X 1_L Above and upper limit X 1_U When the detected value is relatively large in the following range, that is, when the sound is a non-steady sound that is significantly different from the steady sound, the gradation value will be a higher value between 1 and (S-1). Therefore, in the BTR display shown in Figure 4, the brightness of the color (e.g., red) associated with the distortion detection will be brighter in the color of the data point for that azimuth angle θn.

[0038] Thus, the input x 1_n Lower limit X of gradation 1_L and upper limit X 1_U By providing the above, it is possible to subdivide the gradation for a range of particularly noteworthy detection values ​​and display them with different brightness levels.

[0039] Furthermore, in the gradation process (step S4-2-n) (n=1 to N) performed on the output from the second non-stationary sound detection process (step S3-2-n) (n=1 to N), and the gradation process (step S4-3-n) (n=1 to N) performed on the output from the third non-stationary sound detection process (step S3-3-n) (n=1 to N), similar to the gradation process (step S4-1-n) (n=1 to N) described above, gradation is performed on a range of detection values ​​that are particularly noteworthy in that detection method.

[0040] The configuration of the display device 20 and the processing performed by the display device 20 are not limited to those described above. For example, while FIG. 5 shows a case in which non-stationary sound is detected using three types of detection methods, the number of detection methods may be two or four or more. When four or more types of detection methods are used, colors may be set according to the number of detection methods. Furthermore, when four or more types of detection methods are used, only the detection results of the selected three types of detection methods may be displayed in correspondence with the three primary colors of light.

[0041] 4, the data points are displayed in color using RGB values ​​obtained using all of the detection results from the three types of detection methods, but the display device 20 may be configured so that the non-stationary sound detection processing corresponding to the detection results from a detection method that the operator does not want to display is not performed. In this case, the display device 20 may be configured to include an operation unit so that the operator can select whether or not to display the detection results for each detection method, or the number of types of detection methods to display.

[0042] Although the above description has been given of a case in which phasing processing is performed in the horizontal direction, output processing is performed for each horizontal azimuth, and detection results for multiple horizontal azimuths are displayed, the targets of these processes are not particularly limited to this. For example, the display device 20 may be configured to perform phasing processing in the elevation direction, perform output processing for each elevation angle, and display detection results for multiple elevation angles.

[0043] As explained with reference to FIG. 5, in the display device 20 of the present disclosure, compared to the conventional display device shown in FIG. 1, output processing after phasing processing (step S1) is provided for each of a plurality of azimuths and is performed in parallel. Furthermore, the display device 20 of the present disclosure is configured to perform gradation processing (step S4-kn) (k = 1 to 3, n = 1 to N) and pixel conversion processing (step S5-n) (n = 1 to N), which were not performed in conventional display devices, after the unsteady sound detection processing (step S3-kn) (k = 1 to 3, n = 1 to N) for each azimuth. Furthermore, in the conventional display device, as shown in FIG. 2, detection results for each detection method are simultaneously displayed for a specified azimuth, but in the display device 20 of the present disclosure, detection results for a plurality of azimuths are simultaneously displayed in a BTR, with the detection results by a plurality of detection methods treated as the same data point, as shown in FIG. 4.

[0044] An example of displaying data points for non-stationary sounds received from a certain direction at a certain time will be described below. Here, it is assumed that non-stationary sounds are detected only by distortion detection and energy detection out of the three detection methods, and the detection results from distortion detection are defined as being gradated to 128 through gradation processing, the detection results from colored sounds detection to 0 through gradation processing, and the detection results from energy detection to 128 through gradation processing. In this case, if the pixel conversion processing assigns red to distortion detection, green to colored sounds detection, and blue to energy detection, the detection results for non-stationary sounds in this direction at this time will be displayed as a data point with RGB values ​​of (128, 0, 128), i.e., purple. In other words, this data point is displayed in a color obtained by adding together the colors of the detection results from multiple different detection methods, each with a different color and gradated according to the detection value.

[0045] As described above, the display device 20 according to the first embodiment includes a calculation unit 40 and a display unit 60, and displays the detection results of unsteady sounds in sound waves on the display unit 60. The calculation unit 40 converts the detection results of the multiple signals obtained by the multiple detection methods into gradations corresponding to the detection results. The calculation unit 40 also assigns different colors to the multiple detection methods, and the detection results have gradations corresponding to the detection results (i.e., detection values) and colors corresponding to the detection methods. The calculation unit 40 then converts the multiple detection results obtained for the same signal into the same data point having a color obtained by adding up the gradated colors of the multiple detection results. The display unit 60 associates an index (e.g., orientation) that identifies the multiple signals with a first axis (e.g., horizontal axis), and displays the multiple data points obtained from the multiple signals in a display format having a first axis and a second axis.

[0046] This allows multiple detection results from different detection methods to be represented by a single data point, making it possible to display multiple detection results for multiple signals simultaneously by assigning an index that identifies the multiple signals to the first axis, and to represent other information on the remaining second axis.As a result, even when displaying detection results from multiple detection methods, it is possible to display more information at one time than before.

[0047] Furthermore, the display unit 60 displays a plurality of data points obtained from a plurality of signals in a display format in which the index is the first axis (for example, the horizontal axis) and the time is the second axis (the vertical axis).

[0048] This allows the detection results for multiple signals using multiple detection methods at multiple times to be displayed simultaneously, allowing the operator to see changes over time in the detection results for multiple signals using multiple detection methods.

[0049] Furthermore, the calculation unit 40 associates the three primary colors of light with the three detection methods. As a result, the detection results from the three detection methods are assigned to the three primary colors of light and displayed. Therefore, even if the three detection results are displayed simultaneously at the same data point, the operator can easily distinguish the detection results from each detection method by the color of the data point. This makes it possible to reduce overlooking of targets due to differences in detection methods.

[0050] The multiple detection methods include distortion detection, which detects unsteady sounds based on the distortion of sound pressure distribution, color detection, which detects unsteady sounds based on the level of frequency components, and energy detection, which detects unsteady sounds based on energy. This allows unsteady sounds to be detected from multiple angles and these detection results to be displayed simultaneously, further reducing the chance of missing targets due to differences in detection methods.

[0051] Furthermore, the calculation unit 40 extracts components related to non-stationary sounds from each of the multiple signals by subtracting components related to stationary sounds from the signal, and then detects non-stationary sounds from the extracted signals using multiple detection methods individually, thereby enabling more accurate detection of non-stationary sounds.

[0052] The display system 1 according to the first embodiment includes the display device 20 and a group of receivers (receiver array 10) that receive sound waves from a plurality of directions and output waveforms, and the calculation unit 40 phases the waveforms from the group of receivers to generate signals for each of the plurality of directions. This allows phase adjustment according to the arrangement of each receiver 10a, and more accurate arrival directions and detection results of unsteady sounds can be obtained.

[0053] The group of receivers (receiver array 10) receives sound waves from multiple horizontal directions. The calculation unit 40 phases the waveforms from the group of receivers in the horizontal direction and obtains data points in parallel for the signals in each horizontal direction. The display unit 60 displays the multiple data points obtained from the multiple signals in BTR format, with the horizontal direction as the first axis (e.g., the horizontal axis) and time as the second axis (the vertical axis).

[0054] This allows the detection results from multiple detection methods for multiple horizontal directions at multiple times to be displayed simultaneously, allowing the operator to see changes over time in the detection results from multiple detection methods for multiple directions.This allows the operator to grasp the presence and movement of targets that are sources of unsteady sound over a wider area than before, allowing for wide-area search and tracking of targets.

[0055] Also, a display method for displaying the detection results of non-stationary sounds in sound waves includes a gradation process, a pixel conversion process, and a display process. The gradation process converts the detection results obtained by a plurality of detection methods for a plurality of signals into gradations corresponding to the respective detection results. The pixel conversion process assigns different colors to the plurality of detection methods. The pixel conversion process also treats the detection results as having gradations corresponding to the detection results and colors corresponding to the detection methods, and converts a plurality of detection results obtained for the same signal into a single data point having a color obtained by adding up the gradated colors of the plurality of detection results. The display process associates an index identifying the plurality of signals with a first axis (e.g., a horizontal axis), and displays a plurality of data points obtained from the plurality of signals in a display format having a first axis and a second axis.

[0056] As a result, the display system 1 has the same effect as the display device 20 described above, that is, it can display more information at one time than conventionally possible, even when displaying detection results obtained by a plurality of detection methods.

[0057] Embodiment 2 Fig. 6 is a flowchart showing the operation procedure of the calculation unit 40 in the display device 20 according to embodiment 2. Fig. 7 is a flowchart showing each output process in Fig. 6. The display device 20 according to embodiment 2 will be described with reference to Figs. 6 and 7.

[0058] In the above-described first embodiment, an example was described in which phasing is performed in the horizontal direction by phasing processing (step S1) to perform wide-area search and tracking of a target, and detection results for all horizontal directions or for multiple horizontal directions are displayed on a BTR. In the second embodiment, as shown in Fig. 6, phasing is performed in both the horizontal and elevation directions in the phasing processing (step S1), and BTR display processing (steps S6-1 to S6-M) for multiple elevation angles φ1 to φM is performed in parallel. The receiver array 10 connected to the display device 20 in the second embodiment is configured, for example, by arranging multiple receivers 10a in a horizontal row at multiple elevation angles.

[0059] The phasing process (step S1) outputs waveform data for each combination of elevation direction and horizontal direction. Here, the number of elevation direction directions is M, and the number of horizontal direction directions is N, where M and N are each integers equal to or greater than 2. In other words, M×N pieces of waveform data are output from the phasing process (step S1). The phasing process (step S1) is connected to M×N output processes (steps S100-mn) (m=1 to M, n=1 to N), and output processing is performed for each of the M×N pieces of waveform data obtained in the phasing process (step S1).

[0060] As shown in FIG. 7, each output process includes, as in the first embodiment, one non-stationary component extraction process (step S2-mn), as many non-stationary sound detection processes as there are detection methods (steps S3-1-mn to S3-3-mn), gradation processes (steps S4-1-mn to S4-3-mn), and one pixel conversion process (step S5-mn).

[0061] As shown in FIG. 6, N output processes (steps S100-m-1 to S100-mN) for the same elevation / elevation angle φm are connected to one BTR display process (step S6-m). BTR display processes (steps S6-1 to S6-M) for M elevation / elevation angles φ1 to φM are performed in parallel, and the BTR displays shown in FIG. 4 are displayed on the screen of the display unit 60 as many times as the number of azimuths in the elevation direction. Specifically, M BTR displays are displayed simultaneously at different positions on the screen of the display unit 60. Note that the screen of the display unit 60 may be configured to display detection results for only a predetermined number of elevation / elevation angles out of the M elevation / elevation angles φ1 to φM.

[0062] By configuring the BTR to be displayed simultaneously for multiple elevation directions, it is possible to simultaneously search for and track targets in multiple horizontal directions and multiple elevation directions, thereby expanding the target search and tracking range.

[0063] Furthermore, the display processing unit 46 of the second embodiment is configured to perform ELAZ display processing (step S7) as shown in Fig. 6. M x N output processes are connected to one ELAZ display process (step S7).

[0064] Fig. 8 is a diagram showing an example of an ELAZ display on the display unit 60 of the display device 20 of Fig. 6. In the ELAZ display process (step S7) shown in Fig. 6, the outputs from the pixel conversion process (step S5-mn) (m = 1 to M, n = 1 to N) for M × N pixels at a certain time are displayed in an ELAZ (Elevation-Azimuth) format, with the horizontal axis representing the horizontal azimuth and the vertical axis representing the elevation azimuth, as shown in Fig. 8. In the ELAZ display, as in the BTR display, the data points for each azimuth mn represent the detection results obtained by multiple detection methods by their colors.

[0065] For example, data point P3, which represents a non-stationary sound arriving at a horizontal azimuth angle θ1 and an elevation angle φ1 at a certain time, is displayed in color with RGB values ​​(R3, G3, B3) determined in the pixel conversion process (step S5-1-1). Also, data point P4, which represents a non-stationary sound arriving at the same time from a horizontal azimuth angle θ2 and an elevation angle φ2, is displayed in color with RGB values ​​(R4, G4, B4) determined in the pixel conversion process (step S5-2-2).

[0066] In this way, by the display processing unit 46 performing the BTR display processing (steps S6-1 to S6-M) and the ELAZ display processing (step S7), it is possible to simultaneously or alternately display the BTR display for a plurality of elevation angles φm and the ELAZ display at a certain time on the screen of the display unit 60. The ELAZ display displayed on the display unit 60 allows the operator to visually confirm the arrival direction of the unsteady sound and the detection results by a plurality of detection methods for a plurality of horizontal and elevation directions by the positions and colors of the data points.

[0067] The display processing unit 46 may be configured to switch between the ELAZ display and the BTR display in response to an operator's operation, or to perform BTR display processing only for the elevation direction specified by the operator.

[0068] As described above, in the display system 1 according to the second embodiment, the group of receivers (receiver array 10) receives sound waves from multiple horizontal directions at multiple elevation angles, and the calculation unit 40 phases the waveforms from the group of receivers in both the elevation and horizontal directions, and obtains data points in parallel for signals at each elevation angle φm and each horizontal direction. This allows the display system 1 to detect unsteady sounds in both the elevation and horizontal directions, thereby expanding the search and tracking ranges of targets.

[0069] Furthermore, the display unit 60 displays, for each of two or more elevation angles, multiple data points determined for multiple horizontal azimuths at the same elevation angle in a BTR format with the horizontal azimuth as the first axis (for example, the horizontal axis) and time as the second axis (the vertical axis). This allows BTR display for multiple elevation azimuths simultaneously, making it possible to simultaneously search for and track an object in multiple horizontal azimuths and multiple elevation azimuths, thereby widening the target search and tracking range.

[0070] The display unit 60 also displays the data points found in parallel for the signals of each elevation angle and each horizontal azimuth in the ELAZ format of the horizontal azimuth and elevation angle. This allows the display of detection results from multiple detection methods in two directions, allowing the operator to grasp a wider range of targets at the same time.

[0071] Embodiment 3 9 is a flow chart showing the operation procedure of the display device 20 according to embodiment 3. The display device 20 according to embodiment 3 will be described with reference to FIG.

[0072] In the above-described first embodiment, the display device 20 includes a phasing processor 41, and an electrical signal from the receiver array 10 is input to the display device 20. The display device 20 of the third embodiment does not include the phasing processor 41, and signals from a plurality of noise measuring sensors 8_1 to 8_N provided externally are input to the display device 20. The plurality of noise measuring sensors 8_1 to 8_N are attached to equipment inside a ship, for example. The plurality of noise measuring sensors 8_1 to 8_N measure noise, convert the measured noise waveform into a signal, and output it.

[0073] Fig. 10 is a diagram showing an example of a display screen of the display device 20 according to the third embodiment. In the first embodiment described above, a plurality of data points are displayed on the display unit 60 with the horizontal axis representing the direction, that is, the direction from which the sound waves arrive. However, in the third embodiment, as shown in Fig. 10, a plurality of data points are displayed on the display unit 60 with the horizontal axis representing the sensor number n (n = 1 to N). That is, the display unit 60 displays, in the same graph, the results of detecting non-stationary sounds by a plurality of detection methods for noise measured at a plurality of times by a plurality of noise measuring sensors 8_1 to 8_N.

[0074] For example, a data point P1 corresponding to noise measured at time t1 by the noise measuring sensor 8_3 whose sensor number n is n1 (e.g., n=3) is displayed in color with RGB values ​​(R1, G1, B1) determined by the pixel conversion process. Also, on the same graph, a data point P2 corresponding to noise measured at time t2 by the noise measuring sensor 8_9 whose sensor number n is n2 (e.g., n=9) is displayed in color with RGB values ​​(R2, G2, B2) determined by the pixel conversion process.

[0075] As described above, the display system 1 of the third embodiment includes the display device 20 and a noise measurement sensor group having a plurality of noise measurement sensors that measure noise. The noise measurement sensor group converts the measured noise into a signal and outputs it to the display device 20. As a result, even when a noise signal is input, as in the first embodiment, it is possible to display more information at one time than conventionally possible.

[0076] Furthermore, the display unit 60 displays the multiple data points obtained from the multiple signals in a display format in which the sensor number n of the multiple noise measuring sensors is the first axis (for example, the horizontal axis) and time is the second axis (the vertical axis). This allows the operator to know which noise measuring sensor measured the noise that corresponds to a specific data point, and therefore allows the operator to identify the location where the unsteady sound was measured and take the necessary measures. [Explanation of symbols]

[0077] 1 display system, 8_1, 8_n noise measurement sensor, 10 receiver array, 10a receiver, 20 display device, 40 calculation unit, 41 phasing processing unit, 42 non-stationary component extraction unit, 43 non-stationary sound detection unit, 44 gradation processing unit, 45 pixel conversion unit, 46 display processing unit, 50 memory unit, 60 display unit, 100 output unit, P1 data point, P2 data point, P3 data point, P4 data point, S number of gradations, X 1_L Lower limit, X 1_U Upper limit value, n sensor number, θ1, θ2, θn azimuth angles, φ1, φ2, φm elevation angles.

Claims

1. A display device that displays a detection result of a non-stationary sound contained in a sound wave based on an output of a receiver array that receives the sound wave, a calculation unit including a plurality of output units that calculates a detection value, which is a detection result of the unsteady sound based on the output of the receiver array, using a certain detection method, calculates a gradation value based on the detection value, and outputs a data point having the gradation value and a color set for the detection method; a display unit that displays a data point obtained by adding up the colors and gradation values ​​of the plurality of data points output by the plurality of output units as the detection result of the non-stationary sound calculated by the plurality of output units; Equipped with The display device wherein the plurality of output units calculate detection values ​​that are detection results of the non-stationary sound using the detection method that detects the non-stationary sound based on different physical quantities.

2. The display device according to claim 1 , wherein the calculation unit calculates the gradation value from the detection value obtained by the detection method based on a lower limit value and an upper limit value of the detection result set for each of the detection methods.

3. 3. The display device according to claim 2, wherein the calculation unit sets the gradation value to the lowest value when the detected value is equal to or less than the lower limit value, and sets the gradation value to the highest value when the detected value is equal to or greater than the upper limit value.

4. The calculation unit further includes a phasing processing unit that performs phasing processing to form directivity in a specific direction of the output of the receiver array, 2. The display device according to claim 1, wherein the display unit corresponds an index that identifies the output of the phasing processing unit to a first axis, and displays the detection results of the non-stationary sound calculated by the plurality of output units in a display form having the first axis and a second axis.

5. 5. The display device according to claim 4, wherein the display unit displays, as a detection result of the non-stationary sound calculated by the plurality of output units, a data point obtained by adding up the colors and the gradation values ​​of the plurality of data points output by the calculation unit based on an output in which directivity is formed in the specific direction by the phasing processing unit at a certain time.

6. further comprising an operation unit for receiving an input from an operator as to whether or not to display each of the detection methods; The display device according to claim 1 , wherein the calculation unit does not output the data points using the detection methods that are not displayed on the operation unit.

7. The detection method includes: Distortion detection to detect the non-stationary sound based on the distortion of the sound pressure distribution; coloredness detection, which detects the non-stationary sound based on the level of frequency components; energy detection, detecting the non-stationary sound based on its energy; 7. The display device according to claim 1, wherein the display device is any one of the following:

8. A program for causing a computer to function as a display device that displays a detection result of a non-stationary sound contained in a sound wave based on an output of a receiver array that receives the sound wave, Computer, a calculation unit including a plurality of output units that calculates a detection value, which is a detection result of the unsteady sound based on the output of the receiver array, using a certain detection method, calculates a gradation value based on the detection value, and outputs a data point having the gradation value and a color set for the detection method; a display unit that displays a data point obtained by adding up the colors and gradation values ​​of the plurality of data points output by the plurality of output units as the detection result of the non-stationary sound calculated by the plurality of output units; It functions as The plurality of output units calculate detection values ​​that are detection results of the unsteady sound using the detection method that detects the unsteady sound based on different physical quantities.

9. A display method executed by a computer for displaying a detection result of a non-stationary sound contained in a sound wave based on an output of a receiver array that receives the sound wave, comprising: a first step of calculating detection values ​​that are the detection results of the unsteady sound based on the output of the receiver array using a plurality of detection methods, calculating gradation values ​​based on the detection values, and outputting data points that have the gradation values ​​and colors that are set for each of the detection methods; a second step of displaying a data point obtained by adding up the colors and gradation values ​​of the plurality of data points output in the first step as the detection result of the non-stationary sound calculated in the first step; Including, The first step calculates a detection value that is a detection result of the non-stationary sound using the detection method that detects the non-stationary sound based on different physical quantities.

Images