Display device, program, and display method

Abstract

To provide a display device, a program, and a display method with which it is made possible to display much more information at a time than before, even when displaying detection results by a plurality of detection methods.SOLUTION: Provided is a display device for displaying detection results of non-steady sounds included in sound waves on the basis of the output of a wave receiver array for receiving sound waves. The display device comprises: an arithmetic unit including a plurality of output units for calculating a detection value which is the detection result of a non-steady sound on the basis of the output of the wave receiver array, calculating a grayscale value on the basis of the detection value by using a detection method, and outputting the grayscale value and a data point having the colors set by the detection method; and a display unit for displaying a data point deriving by adding the colors of the plurality of data points outputted by the plurality of output units and the grayscale value together, as the detection result of the non-steady sound calculated by the plurality of output units. The plurality of output units calculate the detection value which is the detection result of a non-steady sound by using a detection method that detects a non-steady sound on the basis of respectively different physical amounts.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] This disclosure relates to a display device, program, and display method for displaying the results of detecting non-stationary sounds in acoustic signals received by, for example, a sonar. [Background technology]

[0002] Conventionally, display devices that show the detection results of non-stationary sounds in sound waves are installed, for example, on ships equipped with receiver arrays and used to detect other ships or other objects (hereinafter sometimes referred to as "targets"). Here, non-stationary sound refers to non-stationary acoustic components emitted by the target, such as sonar tones. The receiver array is installed at a distance from the hull and consists of multiple receivers so that the direction of the target can be determined. Some display devices that show the detection results of non-stationary sounds display the detection results using multiple detection methods such as distortion detection, color detection, and energy detection (see, for example, Non-Patent Document 1).

[0003] Figure 1 shows a flowchart of a conventional display device disclosed in Non-Patent Document 1. The conventional display device disclosed in Non-Patent Document 1 is configured to perform the following: a phase adjustment process, an unsteady component extraction process, an unsteady sound detection process using various detection methods, and a detection display process for displaying the detection results. Phase adjustment processing, upon receiving the output waveform from the receiver array, adjusts the phase by assigning weights and time delays to each receiver, and then sums the results for multiple receivers to form directivity, outputting waveform data for each horizontal direction. The transient component extraction process, upon receiving the output of the phase correction process, predicts a steady component for one direction selected externally from the immediately preceding observation data, and outputs a signal with an improved SNR (Signal to Noise power Ratio) by subtracting the predicted value from the current observation data to three transient sound detection processes. Each of the three non-stationary sound detection processes, upon receiving the output of the non-stationary component extraction process, performs the following non-stationary sound detection process and outputs the detected value as the detection result to the detection display process. (a) The non-stationary sound detection process that performs distortion detection detects non-stationary sounds by utilizing the fact that there is distortion in the sound pressure distribution during the time period when non-stationary sounds are occurring. (b) The non-stationary sound detection process that performs color detection detects non-stationary sounds by utilizing the fact that the level of frequency components is not constant during the time period in which non-stationary sounds are occurring. (c) The non-stationary sound detection process, which performs energy detection, detects non-stationary sounds by utilizing the fact that their energy is high during the time period in which they are occurring. The detection display process, upon receiving the output from the three non-stationary sound detection processes, compares the input detection value with a set threshold. The time period during which the detection value exceeds the threshold is displayed as the detection time for non-stationary sound according to that detection method, distinguishing it from the non-detection time. Figure 2 shows the display screen of the detection result in a conventional display device disclosed in Non-Patent Document 1. [Prior art documents] [Non-patent literature]

[0004] [Non-Patent Document 1] Melvin J. Hinich, “Testing for Dependence in the Input to A Linear Time Series Model”, Journal of Nonparametric Statistics Volume 6 1996, pp.205-221 [Overview of the Initiative] [Problems that the invention aims to solve]

[0005] However, in conventional display devices such as those disclosed in Non-Patent Document 1, the detection results for non-stationary sounds are displayed on the screen only for signals in a specified direction, for each detection method. Therefore, the operator cannot simultaneously know the detection results for multiple signals. Consequently, conventional display devices have the problem that the amount of information that can be displayed at once is limited when displaying detection results from multiple detection methods.

[0006] This disclosure was made to solve the above-mentioned problems, and aims to provide a display device, program, and display method that can display more information at once than conventional methods, even when displaying detection results from multiple detection methods. [Means for solving the problem]

[0007] The display device according to the present invention is a display device that displays the detection result of non-stationary sound contained in sound waves based on the output of a receiver array that receives sound waves, and comprises a calculation unit which has a plurality of output units that calculate a detection value which is the detection result of non-stationary sound based on the output of the receiver array using a certain detection method, calculate a grayscale value based on the detection value, and output a data point having the grayscale value and a color set in the detection method, and a display unit which displays a data point obtained by adding the color and grayscale value of a plurality of data points output by the plurality of output units as the detection result of non-stationary sound calculated by the plurality of output units, and each of the plurality of output units calculates a detection value which is the detection result of non-stationary sound using the detection method which detects non-stationary sound based on different physical quantities. Furthermore, the program of this disclosure is a program for causing a computer to function as a display device that displays the detection result of non-stationary sound contained in sound waves based on the output of a receiver array that receives sound waves, and the computer functions as a calculation unit having a plurality of output units that calculate a detection value which is the detection result of non-stationary sound based on the output of the receiver array using a certain detection method, calculate a gradation value based on the detection value, and output a data point having the gradation value and a color set in the detection method, and a display unit that displays a data point obtained by adding the color and the gradation value of the plurality of data points output by the plurality of output units as the detection result of non-stationary sound calculated by the plurality of output units, and each of the plurality of output units calculates a detection value which is the detection result of non-stationary sound using the detection method which detects non-stationary sound based on different physical quantities. Furthermore, the display method of the present disclosure is a display method performed by a computer that displays the detection result of non-stationary sound contained in sound waves based on the output of a receiver array that receives sound waves, and includes a first step of using a plurality of detection methods to calculate a detection value which is the detection result of non-stationary sound based on the output of the receiver array, calculate a gradation value based on the detection value, and output a data point having the gradation value and a color set for each of the detection methods, and a second step of displaying a data point obtained by adding the color and gradation value of the plurality of data points output in the first step as the detection result of non-stationary sound calculated in the first step, wherein the first step calculates the detection value which is the detection result of non-stationary sound using the detection method which detects non-stationary sound based on different physical quantities. [Effects of the Invention]

[0008] According to this disclosure, multiple output units of the arithmetic unit calculate a detection value, which is the detection result of a non-stationary sound, based on the output of a receiver array using a certain detection method, calculate a gradation value based on the detection value, and output a data point having the gradation value and a color set in the detection method. Here, each of the multiple output units calculates a detection value, which is the detection result of a non-stationary sound, using a detection method that detects non-stationary sound based on different physical quantities. The display unit then displays a data point obtained by adding the color and gradation values ​​of multiple data points output by the multiple output units as the detection result of a non-stationary sound calculated by the multiple output units. Therefore, since multiple data points with different detection methods can be displayed simultaneously as a single data point, more information can be displayed at once than in conventional methods, even when displaying detection results from multiple detection methods. [Brief explanation of the drawing]

[0009] [Figure 1] This is a flowchart illustrating the operation procedure of a conventional display device. [Figure 2] This figure shows the display screen of a conventional display device. [Figure 3]It is a block diagram showing a configuration example of a display system to which the display device according to Embodiment 1 is applied. [Figure 4] It is a diagram showing an example of BTR display in the display unit of the display device in FIG. 3. [Figure 5] It is a flowchart showing the operation procedure of the display device in FIG. 3. [Figure 6] It is a flowchart showing the operation procedure of the arithmetic unit in the display device according to Embodiment 2. [Figure 7] It is a flowchart of each output process in FIG. 6. [Figure 8] It is a diagram showing an example of ELAZ display in the display unit of the display device in FIG. 6. [Figure 9] It is a flowchart showing the operation procedure of the display device according to Embodiment 3. [Figure 10] It is a diagram showing an example of the display screen of the display device according to Embodiment 3.

Embodiments for Carrying Out the Invention

[0010] Embodiments of the display device 20 will be described with reference to the drawings. The display device 20 receives a plurality of signals, analyzes those signals, and displays the results. In Embodiments 1 and 2 described below, the display device 20 constitutes a part of the sonar device, and the sonar device including the display device 20 will be described as a passive sonar device that receives and analyzes acoustic signals from a target. Note that the display device 20 may be applied to an active sonar device that emits its own detection sound, a radar device, or the like. Further, in Embodiment 3 described below, the display device 20 receives and analyzes noise signals.

[0011] Embodiment 1. FIG. 3 is a block diagram showing a configuration example of a display system 1 to which the display device 20 according to Embodiment 1 is applied. The configuration of the display device 20 will be described while referring to FIG. 3.

[0012] The display device 20 displays the detection results of non-stationary sounds in sound waves and is composed of an information processing device, for example, a personal computer. As shown in Figure 3, the display device 20 has a calculation unit 40 that performs calculation processing, a display unit 60 that displays the detection results, and a storage unit 50 that stores various data. The display device 20 is communicated with the receiver array 10 via signal lines (not shown). The communication connection between the display device 20 and the receiver array 10 may be wireless. The display system 1 is composed of the display device 20 and the receiver array 10.

[0013] The receiver array 10 receives sound waves and outputs waveforms, and has multiple receivers 10a. A microphone, such as a hydrophone, which converts acoustic signals into electrical signals, is used as a receiver 10a. The receiver array 10 receives sound waves from all directions horizontally (0° to 360°), converts them from acoustic signals to electrical signals, and inputs them to the display device 20. For example, the receiver array 10 is configured by arranging multiple receivers 10a in a horizontal line.

[0014] The arithmetic unit 40 can be composed of, for example, an arithmetic device such as a CPU (Central Processing Unit) and software that works in cooperation with such an arithmetic device to realize the above functions. The storage unit 50 can be composed of, for example, RAM (Random Access Memory), ROM (Read Only Memory), PROM (Programmable ROM), or HDD (Hard Disk Drive) or other storage devices. The display unit 60 can be composed of, for example, a display.

[0015] The calculation unit 40 includes a phase adjustment processing unit 41, an output unit 100, and a display processing unit 46. When an electrical signal is input from a receiver array 10 having multiple receivers 10a, the phase adjustment processing unit 41 of the calculation unit 40 performs phase adjustment by assigning a weight and a time delay to each receiver 10a. The phase adjustment processing unit 41 also forms directivity in the sound wave by adding the results of the phase adjustments for each receiver 10a, and outputs it as a signal (i.e., waveform data) for each direction in the horizontal direction. Each direction in the horizontal direction has a certain angular width. The phase adjustment processing unit 41 receives electrical signals from the receiver array 10 at regular time intervals and repeatedly performs the above phase adjustment processing.

[0016] The output unit 100 of the calculation unit 40 detects and calculates transient sounds for each horizontal direction and outputs the result. The output unit 100 includes a transient component extraction unit 42 that performs transient component extraction processing, a transient sound detection unit 43 that performs transient sound detection processing, a gradation processing unit 44 that performs gradation processing, and a pixel conversion unit 45 that performs pixel conversion processing. The transient component extraction unit 42, transient sound detection unit 43, gradation processing unit 44, and pixel conversion unit 45 perform the output processing described later for each direction.

[0017] The transient component extraction unit 42 extracts transient components by subtracting steady components from the signals for each direction from the phase adjustment processing unit 41. Here, the steady components are predicted from the previous signal. By subtracting the predicted value from the current signal for that direction, the transient component extraction unit 42 can output a signal with improved SNR (Signal to Noise power Ratio).

[0018] The non-stationary sound detection unit 43 detects non-stationary sounds from the signal extracted by the non-stationary component extraction unit 42. There are three types of detection methods, for example: distortion detection, which detects non-stationary sounds based on the distortion of the extracted signal; color detection, which detects non-stationary sounds based on the color of the extracted signal; and energy detection, which detects non-stationary sounds based on the energy of the extracted signal. The non-stationary sound detection unit 43 performs each detection for each direction. Specifically, a first non-stationary sound detection process, a second non-stationary sound detection process, and a third non-stationary sound detection process are performed for each direction. The first non-stationary sound detection process is a process that detects non-stationary sounds by utilizing the fact that there is distortion in the sound pressure distribution during the time when non-stationary sounds are occurring. The second non-stationary sound detection process is a process that detects non-stationary sounds by utilizing the fact that the level of frequency components is not constant during the time when non-stationary sounds are occurring. The third non-stationary sound detection process is a process that detects non-stationary sounds by utilizing the fact that the energy is high during the time when non-stationary sounds are occurring. The non-stationary sound detection unit 43 performs a first non-stationary sound detection process, a second non-stationary sound detection process, and a third non-stationary sound detection process for signals in each direction, and outputs the detection results of these detection processes to the gradation processing unit 44.

[0019] The gradation processing unit 44 performs gradation processing on the detection results from each detection method, converting the detected values, which are the detection results from the non-stationary sound detection unit 43, into gradation values, and outputs multiple gradation values ​​for each direction to the pixel conversion unit 45.

[0020] The pixel conversion unit 45 performs pixel conversion processing for each direction, converting multiple gradation values ​​from the gradation processing unit 44 into the RGB values ​​of a single data point, and outputs the converted data for all directions to the display processing unit 46. Specifically, it assigns different colors to the multiple detection methods used in the non-stationary sound detection unit 43. The detection results are then made to have gradation according to the detected value and color according to the detection method, and multiple detection results obtained for the same signal are converted into the same data point having a color that is the sum of those gradation colors. For example, if three types of detection methods such as distortion detection, color detection, and energy detection are used in the non-stationary sound detection unit 43, the three primary colors of light, red, green, and blue, are assigned to the three detection methods, respectively, and the RGB values ​​of the pixels that display the same data point are determined.

[0021] The display processing unit 46 of the calculation unit 40 converts the outputs of multiple output processes performed in parallel into image data in a predetermined format and displays it on the screen of the display unit 60. Specifically, the display processing unit 46 receives data for all directions in the horizontal direction from the output unit 100 at regular time intervals, and as one display process, the display processing unit 46 performs BTR display processing to display these inputs on the display unit 60 in BTR (Bearing Time Recording) format.

[0022] Figure 4 shows an example of BTR display in the display unit 60 of the display device 20 shown in Figure 3. As shown in Figure 4, the display unit 60 displays data for all horizontal directions at multiple time points simultaneously in color, with the horizontal axis representing the horizontal direction and the vertical axis representing time. Hereinafter, the horizontal axis and vertical axis may be referred to as the first axis and the second axis, respectively.

[0023] For example, data point P1 representing a non-stationary sound arriving at time t1 from a horizontal azimuth angle θ1 is displayed in color using the RGB values ​​(R1, G1, B1) determined by the pixel conversion process. Data point P1 representing a non-stationary sound arriving at time t1 from a horizontal azimuth angle θ1 is displayed in color using the RGB values ​​(R1, G1, B1) determined by the pixel conversion process. Similarly, data point P2 representing a non-stationary sound arriving at time t2 from a horizontal azimuth angle θ2 is displayed in color using the RGB values ​​(R2, G2, B2) determined by the pixel conversion process.

[0024] In the case where the input to the display device 20 is the receiver array 10, the indicator used to distinguish between multiple signals is the direction of arrival of the sound wave, and this direction is associated with the first axis. However, it is sufficient to associate the indicator corresponding to the input of the display device 20 with the first axis.

[0025] Figure 5 is a flowchart showing the operation procedure of the display device 20 in Figure 3. As shown in Figure 5, the phase adjustment process (step S1) is connected to N output processes (steps S100-1 to S100-N). Here, N is the number of horizontal orientations and is an integer of 2 or more. Each output process includes one transient component extraction process, transient sound detection processes and gradation processes for the number of detection methods, and one pixel conversion process. Output processing is performed on the waveform data for each orientation obtained in the phase adjustment process (step S1). In other words, transient sounds are detected for each of the multiple azimuth angles θ1 to θN, and the detection results are calculated and output.

[0026] Since the output processing performed for each azimuth angle θn is similar, the output processing performed for azimuth angle θ1 (step S100-1) will be explained in detail below using Figures 3 and 5.

[0027] In the transient component extraction process (step S2-1), transient components are extracted from the waveform data for the azimuth angle θ1 of the output of the phase adjustment process (step S100-1). The transient component extraction process for the azimuth angle θ1 (step S2-1) outputs the extracted signal to the first transient sound detection process to the third transient sound detection process (steps S3-1-1 to S3-3-1), which use different detection methods.

[0028] Each of the first to third non-stationary sound detection processes (steps S3-1-1 to S3-3-1) detects non-stationary sounds from the input signal using a predetermined detection method and outputs the detection result to the grayscale processing (steps S4-1-1 to S4-3-1).

[0029] Each of the three gradation processes (steps S4-1-1 to S4-3-1) converts the detected value, which is the detection result, into a gradation value using a predetermined conversion formula. The memory unit 50 stores the conversion formula and other information corresponding to the detection method. The gradation process (step S4-k-1) (k=1 to 3) refers to the memory unit 50, grades the detected value using the corresponding conversion formula for the detection method, and connects to the pixel conversion process (step S5-1).

[0030] In the output processing of the azimuth angle θ1 (step S100-1), the three gradation processes (steps S4-1-1 to S4-3-1) are connected to one pixel conversion process (step S5-1). When the pixel conversion process (step S5-1) receives gradation values ​​from each of the three gradation processes (steps S4-1-1 to S4-3-1), it converts the three gradation values ​​into the RGB value of a single data point.

[0031] Multiple RGB values ​​for each direction, repeatedly output at regular time intervals from multiple pixel conversion processes (steps S5-1 to S5-N), are sequentially output to the BTR display process (step S6) and stored in the storage unit 50. N output processes (steps S100-1 to S100-N) are connected to one BTR display process (step S6), and information on data points obtained for multiple azimuth angles θ1 to θN is input to the BTR display process (step S6).

[0032] In the BTR representation process (step S6), the outputs from the N output processes (steps S100-1 to S100-N), that is, the detection results of unsteady sounds by a plurality of detection methods for a plurality of horizontal directions, are displayed on the display unit 60 for each of the plurality of times.

[0033] Next, an example of the conversion method from the detection result to the gradation value performed in each gradation processing (step S4-k-n) (k = 1 to 3, n = 1 to N) will be described. First, the gradation processing (step S4-1-n) (n = 1 to N) performed on the output from the first unsteady sound detection processing (step S3-?1-n) (n = 1 to N) will be described.

[0034] Let the input to the gradation processing (step S4-1-n) (n = 1 to N) be x 1_n and the output from the gradation processing (step S4-1-n) (n = 1 to N) be y 1_n and assuming the number of gradations is S, gradation is performed according to the following equation (1) with respect to skewness.

[0035]

Equation

[0036] Here, X 1_L and X 1_U are respectively the preset lower limit value and upper limit value of gradation. For example, when the number of gradations S is 256, if the detection result of the first unsteady sound detection processing (step S3-1-n) (n = 1 to N), that is, the input x 1_n is less than the lower limit value X 1_L the output y 1_n obtained by equation (1), that is, the gradation value, is 0. On the other hand, if the input x 1_n is greater than the upper limit value X 1_U the gradation value obtained by equation (1) is 255. Note that when the input x 1_n is greater than or equal to the lower limit value X 1_L and less than or equal to the upper limit value X 1_UIf the value is within the following range, the gradation value obtained by formula (1) will be between 0 and 255.

[0037] More specifically, for example, input x 1_n However, the lower limit X 1_L The above and the upper limit X 1_U In the following range, if the detected value is relatively small, i.e., for non-stationary sounds with a small difference from stationary sounds, the gradation value will be a lower value within the range of 1 to (S-1). Therefore, in the BTR display shown in Figure 4, the brightness of the color associated with distortion detection (e.g., red) for the data point with respect to the azimuth angle θn will be darker. Also, for example, input x 1_n However, the lower limit X 1_L The above and the upper limit X 1_U In the range below, if the detected value is relatively large, i.e., in the case of non-stationary sounds with a large difference from stationary sounds, the gradation value will be a higher value within the range of 1 to (S-1). Therefore, in the BTR display shown in Figure 4, the brightness of the color associated with distortion detection (e.g., red) in the color of the data point for that azimuth angle θn will be brighter.

[0038] Thus, input x 1_n The lower limit of grayscale X 1_L and upper limit X 1_U By providing this feature, the grayscale can be subdivided for a range of particularly noteworthy detected values, allowing them to be displayed at different brightness levels.

[0039] Furthermore, in the gradation processing (step S4-2-n) (n=1~N) performed on the output from the second non-stationary sound detection process (step S3-2-n) (n=1~N), and the gradation processing (step S4-3-n) (n=1~N) performed on the output from the third non-stationary sound detection process (step S3-3-n) (n=1~N), the configuration is such that gradation is performed on a range of detection values ​​that are particularly noteworthy in the detection method, similar to the gradation processing (step S4-1-n) (n=1~N) described above.

[0040] The configuration of the display device 20 and the processing performed by the display device 20 are not limited to those described above. For example, Figure 5 shows a case where non-stationary sound is detected using three types of detection methods, but the number of detection methods may be two or four or more. When four or more detection methods are used, the colors should be set according to the number of detection methods. Also, when four or more detection methods are used, only the detection results from the three selected detection methods may be displayed in correspondence with the three primary colors of light.

[0041] Furthermore, in Figure 4, the data points are displayed in color using RGB values ​​obtained from all three detection methods. However, for detection results from methods that are not desired, the system may be configured not to perform the non-stationary sound detection processing corresponding to that method. In this case, the display device 20 may be configured to include an operation unit so that the operator can select whether or not to display the detection results for each detection method, or the number of detection methods to display.

[0042] Furthermore, while we have described a case in which phase alignment processing is performed in the horizontal direction, output processing is performed for each direction in the horizontal direction, and detection results for multiple directions in the horizontal direction are displayed, the scope of these processes is not particularly limited. For example, the display device 20 may be configured to perform phase alignment processing in the elevation direction, perform output processing for each elevation angle, and display detection results for multiple elevation angles.

[0043] As explained with reference to Figure 5, the display device 20 of this disclosure, compared to the conventional display device shown in Figure 1, provides output processing after phase adjustment (step S1) for each of multiple directions and performs it in parallel. Furthermore, the display device 20 of this disclosure is configured to perform gradation processing (step S4-kn) (k=1-3, n=1-N) and pixel conversion processing (step S5-n) (n=1-N) after the non-stationary sound detection processing (step S3-kn) (k=1-3, n=1-N) for each direction, which were not performed in conventional display devices. In addition, while conventional display devices simultaneously display detection results for each detection method for the indicated direction as shown in Figure 2, the display device 20 of this disclosure simultaneously displays detection results for multiple directions as the same data point in the BTR, as shown in Figure 4.

[0044] This section describes an example of displaying data points for non-stationary sound received at a certain time from a certain direction. Here, we assume that non-stationary sound was detected only by distortion detection and energy detection out of the three detection methods. The detection result from distortion detection is graded to 128 by gradation processing, the detection result from chromaticity detection is graded to 0 by gradation processing, and the detection result from energy detection is graded to 128 by gradation processing. In this case, if red is assigned to distortion detection, green to chromaticity detection, and blue to energy detection by pixel conversion processing, the detection result of non-stationary sound for this direction at this time will be displayed as an RGB value (128, 0, 128), i.e., a purple data point. In other words, this data point is displayed as a color that is the sum of the colors of multiple detection results from different detection methods, each having a different color, and each color being graded according to the detected value.

[0045] As described above, the display device 20 according to Embodiment 1 has a calculation unit 40 and a display unit 60, and is a display device 20 that displays the detection results of non-stationary sounds in sound waves on the display unit 60. The calculation unit 40 converts the detection results from multiple detection methods for multiple signals into gradations corresponding to the detection results. The calculation unit 40 also assigns different colors to the multiple detection methods, so that the detection results have gradations corresponding to the detection results (i.e., detected values) and colors corresponding to the detection methods. The calculation unit 40 then converts the multiple detection results obtained for the same signal into the same data point having a color obtained by adding the graded colors of the multiple detection results, and the display unit 60 associates an index that identifies the multiple signals (e.g., direction) with a first axis (e.g., horizontal axis), and displays the multiple data points obtained from the multiple signals in a display format having a first axis and a second axis.

[0046] This allows multiple detection results from different detection methods to be represented by a single data point. This enables the simultaneous display of multiple detection results for multiple signals by assigning an index to identify multiple signals to the first axis, while the remaining second axis can represent other information. Therefore, even when displaying detection results from multiple detection methods, more information can be displayed at once than before.

[0047] Furthermore, the display unit 60 displays multiple data points obtained from multiple signals in a display format where the index is the first axis (for example, the horizontal axis) and time is the second axis (vertical axis).

[0048] This allows for the simultaneous display of detection results from multiple detection methods for multiple signals at multiple time points, enabling the operator to understand the temporal changes in detection results from multiple detection methods for multiple signals.

[0049] Furthermore, the calculation unit 40 associates the three detection methods with the three primary colors of light. As a result, the detection results from the three different detection methods are assigned to the three primary colors of light and displayed, so even if the three types of detection results are displayed simultaneously at the same data point, the operator can easily distinguish the detection results from each detection method by the color of that data point. Therefore, it is possible to reduce the chances of missing an object due to differences in detection methods.

[0050] Furthermore, the multiple detection methods include distortion detection, which detects non-stationary sounds based on the distortion of the sound pressure distribution; color detection, which detects non-stationary sounds based on the level of frequency components; and energy detection, which detects non-stationary sounds based on energy. This allows for multifaceted detection of non-stationary sounds, and these detection results can be displayed simultaneously, further reducing the chance of missing a target due to differences in detection methods.

[0051] Furthermore, the calculation unit 40 extracts the component related to transient sound by subtracting the component related to steady sound from each of the multiple signals, and then detects transient sound from the extracted signal using multiple detection methods individually. This makes it possible to detect transient sound more accurately.

[0052] Furthermore, the display system 1 according to Embodiment 1 includes the above-mentioned display device 20 and a group of receivers (receiver array 10) that receive sound waves from multiple directions and output waveforms. The calculation unit 40 processes the waveforms from the receiver group into phase-aligned signals for each of the multiple directions. This allows for phase adjustment according to the arrangement of each receiver 10a, resulting in more accurate determination of the direction of arrival of non-stationary sound and detection results.

[0053] Furthermore, the receiver group (receiver array 10) receives sound waves from multiple horizontal directions. The calculation unit 40 phase-aligns the waveforms from the receiver group in the horizontal direction and obtains data points in parallel for the signals in each horizontal direction. The display unit 60 displays the multiple data points obtained from the multiple signals in BTR format, with the horizontal direction as the first axis (e.g., horizontal axis) and time as the second axis (vertical axis).

[0054] This allows for the simultaneous display of detection results from multiple detection methods for multiple horizontal directions at multiple time points, enabling the operator to understand the temporal changes in detection results from multiple detection methods for multiple directions. Therefore, the operator can grasp the presence and movement of objects that are sources of non-stationary sound over a wider area than before, enabling wide-area searches and tracking of targets.

[0055] Furthermore, the display method is a display method for displaying the detection results of non-stationary sounds in sound waves, and comprises a gradation processing process, a pixel conversion processing process, and a display processing process. The gradation processing process converts the detection results from multiple detection methods for multiple signals into gradations corresponding to the detection results. The pixel conversion processing assigns different colors to the multiple detection methods. The pixel conversion processing also makes the detection results have gradations corresponding to the detection results and colors corresponding to the detection methods, and converts multiple detection results obtained for the same signal into the same data point having a color that is the sum of the graded colors of the multiple detection results. The display processing associates an index for identifying multiple signals with a first axis (for example, the horizontal axis), and displays multiple data points obtained from multiple signals in a display format having a first axis and a second axis.

[0056] As a result, the display system 1 has the same effect as the display device 20 described above, which is that it can display more information at once than before, even when displaying detection results from multiple detection methods.

[0057] Embodiment 2. Figure 6 is a flowchart showing the operation procedure of the calculation unit 40 in the display device 20 according to Embodiment 2. Figure 7 is a flowchart of each output process in Figure 6. The display device 20 according to Embodiment 2 will be described with reference to Figures 6 and 7.

[0058] In Embodiment 1 described above, in order to perform wide-area search and tracking of a target, a phase adjustment process (step S1) is performed to adjust the phase in the horizontal direction, and an example was described in which the detection results for all directions in the horizontal direction or for multiple directions in the horizontal direction are displayed as BTR. In Embodiment 2, as shown in Figure 6, the phase adjustment process (step S1) adjusts the phase in both the horizontal and elevation directions, and the BTR display process (steps S6-1 to S6-M) for multiple elevation angles φ1 to φM is performed in parallel. The receiver array 10 that is communicated with the display device 20 in Embodiment 2 is configured, for example, by arranging multiple receivers 10a in a line in the horizontal direction and placing them at positions for multiple elevation angles.

[0059] The phase shaping process (step S1) outputs waveform data for each combination of elevation direction and horizontal direction. Here, there are M elevation directions and N horizontal directions, and M and N are integers greater than or equal to 2. In other words, M × N waveform data are output from the phase shaping process (step S1). The phase shaping process (step S1) is connected to M × N output processes (step S100-mn) (m=1 to M, n=1 to N), and output processing is performed for each of the M × N waveform data obtained from the phase shaping process (step S1).

[0060] As shown in Figure 7, each output process includes, similar to Embodiment 1, one transient component extraction process (step S2-mn), transient sound detection processes of a number of detection methods (steps S3-1-mn to S3-3-mn), gradation processing (steps S4-1-mn to S4-3-mn), and one pixel conversion process (step S5-mn).

[0061] As shown in Figure 6, N output processes (steps S100-m-1 to S100-mN) for the same elevation angle φm are connected to one BTR display process (step S6-m). The M BTR display processes (steps S6-1 to S6-M) for elevation angles φ1 to φM are performed in parallel, and the BTR displays shown in Figure 4 are displayed on the screen of the display unit 60, corresponding to the number of elevation directions. Specifically, the M BTR displays are displayed simultaneously at different positions on the screen of the display unit 60. Alternatively, the screen of the display unit 60 may be configured to display detection results only for a predetermined number of elevation angles out of the M elevation angles φ1 to φM.

[0062] By simultaneously displaying BTR (Body Tracking Range) for multiple directions in the elevation direction, it is possible to simultaneously search for and track a target in multiple directions in the horizontal and elevation directions, thereby widening the search and tracking range of the target.

[0063] Furthermore, the display processing unit 46 of Embodiment 2 is configured to perform ELAZ display processing (step S7), as shown in Figure 6. M × N output processing units are connected to one ELAZ display processing unit (step S7).

[0064] Figure 8 shows an example of ELAZ display in the display unit 60 of the display device 20 shown in Figure 6. In the ELAZ display process (step S7) shown in Figure 6, the output from the M×N pixel conversion process (step S5-mn) (m=1~M, n=1~N) at a certain time is displayed in ELAZ (Elevation-Azimuth) format, where the horizontal axis is the horizontal direction and the vertical axis is the elevation direction, as shown in Figure 8. In ELAZ display as well, as in BTR display, the data points for each direction mn represent the detection results from multiple detection methods by their color.

[0065] For example, a data point P3 representing a non-stationary sound arriving at a certain time from a horizontal azimuth angle θ1 and an elevation angle φ1 is displayed in color using the RGB values ​​(R3, G3, B3) determined in the pixel conversion process (step S5-1-1). Similarly, a data point P4 representing a non-stationary sound arriving at the same time from a horizontal azimuth angle θ2 and an elevation angle φ2 is displayed in color using the RGB values ​​(R4, G4, B4) determined in the pixel conversion process (step S5-2-2).

[0066] In this way, the display processing unit 46 performs BTR display processing (steps S6-1 to S6-M) and ELAZ display processing (step S7), so that the display unit 60 can simultaneously or switch between displaying BTR information for multiple elevation angles φm and ELAZ information for a given time. The ELAZ information displayed on the display unit 60 allows the operator to visually confirm the direction of arrival of non-stationary sound and the detection results from multiple detection methods for multiple horizontal and elevation directions by the position and color of the data points.

[0067] The display processing unit 46 may be configured to switch between displaying ELAZ and BTR based on the operator's input. Alternatively, it may be configured to perform BTR display processing only for elevation directions specified by the operator.

[0068] As described above, in the display system 1 according to Embodiment 2, the receiver group (receiver array 10) receives sound waves from multiple directions in the horizontal direction at multiple elevation angles, and the calculation unit 40 phase-aligns the waveforms from the receiver group in both the elevation and horizontal directions, and simultaneously obtains data points for the signals at each elevation angle φm and each direction in the horizontal direction. As a result, the display system 1 can detect non-stationary sounds in both the elevation and horizontal directions, thereby widening the search and tracking range of the target.

[0069] Furthermore, the display unit 60 displays multiple data points obtained for multiple horizontal bearings at the same elevation angle in BTR format, with the horizontal bearing as the first axis (e.g., horizontal axis) and time as the second axis (vertical axis), for each of two or more elevation angles. This allows for simultaneous BTR display for multiple elevation bearings, enabling simultaneous searching and tracking of the target in multiple horizontal and multiple elevation bearings, thereby widening the search and tracking range of the target.

[0070] Furthermore, the display unit 60 displays data points obtained in parallel for each elevation angle and each horizontal direction in ELAZ format, showing the horizontal direction and elevation angle. This allows detection results from multiple detection methods to be displayed for two directions, enabling the operator to simultaneously grasp a wider range of targets.

[0071] Embodiment 3. Figure 9 is a flowchart showing the operation procedure of the display device 20 according to Embodiment 3. The display device 20 according to Embodiment 3 will be described with reference to Figure 9.

[0072] In Embodiment 1 described above, the display device 20 is equipped with a phase-correction processing unit 41, and the electrical signal from the receiver array 10 is input to the display device 20. The display device 20 of Embodiment 3 is not equipped with a phase-correction processing unit 41, and the display device 20 receives signals from a plurality of externally installed noise measurement sensors 8_1 to 8_N. The plurality of noise measurement sensors 8_1 to 8_N are, for example, attached to equipment inside the ship. The plurality of noise measurement sensors 8_1 to 8_N measure noise and output the measured noise waveform as a signal.

[0073] Figure 10 shows an example of the display screen of the display device 20 according to Embodiment 3. In Embodiment 1 described above, multiple data points were displayed on the display unit 60 with the horizontal axis representing direction, i.e., the direction of arrival of the sound wave. However, in Embodiment 3, as shown in Figure 10, multiple data points are displayed on the display unit 60 with the horizontal axis representing sensor number n (n=1 to N). That is, the display unit 60 displays the results of detecting non-stationary sounds using multiple detection methods for noise measured at multiple times by multiple noise measurement sensors 8_1 to 8_N in the same graph.

[0074] For example, data point P1, corresponding to noise measured at time t1 by noise measurement sensor 8_3 with sensor number n1 (e.g., n=3), is displayed in color using the RGB values ​​(R1, G1, B1) determined by the pixel conversion process. Similarly, data point P2, corresponding to noise measured at time t2 by noise measurement sensor 8_9 with sensor number n2 (e.g., n=9), is also displayed in color using the RGB values ​​(R2, G2, B2) determined by the pixel conversion process.

[0075] As described above, the display system 1 of Embodiment 3 comprises a display device 20 and a noise measurement sensor group having multiple noise measurement sensors for measuring noise. The noise measurement sensor group outputs the measured noise as a signal to the display device 20. As a result, even when a noise signal is used as input, more information can be displayed at once than in the conventional case, similar to the case of Embodiment 1.

[0076] Furthermore, the display unit 60 displays multiple data points obtained from multiple signals in a display format where the sensor number n of the multiple noise measurement sensors is the first axis (for example, the horizontal axis) and time is the second axis (vertical axis). This allows the operator to know which noise measurement sensor a particular data point corresponds to, so that they can identify the location where the non-stationary sound was measured and take the necessary action. [Explanation of Symbols]

[0077] 1 Display system, 8_1, 8_n Noise measurement sensor, 10 Receiver array, 10a Receiver, 20 Display device, 40 Calculation unit, 41 Phase adjustment processing unit, 42 Non-stationary component extraction unit, 43 Non-stationary sound detection unit, 44 Grayscale processing unit, 45 Pixel conversion unit, 46 Display processing unit, 50 Storage unit, 60 Display unit, 100 Output unit, P1 Data point, P2 Data point, P3 Data point, P4 Data point, S Number of grayscale levels, X 1_L Lower limit, X 1_U Upper limit, n; Sensor number, θ1, θ2, θn; Azimuth angle, φ1, φ2, φm; Elevation angle.

Claims

1. A display device that displays the detection result of non-stationary sounds contained in sound waves based on the output of a receiver array that receives sound waves, A calculation unit comprising a plurality of output units that calculate a detection value which is the result of detecting non-stationary sound based on the output of the receiver array using a certain detection method, calculate a gradation value based on the detection value, and output data points having the gradation value and a color set in the detection method, A display unit that displays a data point obtained by summing the color and gradation values ​​of the multiple data points output by the multiple output units as the detection result of a non-stationary sound calculated by the multiple output units. Equipped with, A display device in which the plurality of output units each calculate a detected value, which is the detection result of the non-stationary sound, using the detection method for detecting non-stationary sound based on different physical quantities.

2. The display device according to claim 1, wherein the calculation unit calculates the grayscale value from the detected value by the detection method based on the lower limit and upper limit of the detection result set for each detection method.

3. The display device according to claim 2, wherein the calculation unit sets the grayscale value to the lowest value when the detected value is less than or equal to the lower limit value, and sets the grayscale value to the highest value when the detected value is greater than or equal to the upper limit value.

4. The calculation unit further includes a phase correction processing unit that performs phase correction processing to form directivity in a specific direction of the output of the receiver array, The display device according to claim 1, wherein the display unit corresponds an index for identifying the output of the phase adjustment processing unit to a first axis, and displays the detection results of non-stationary sounds calculated by the plurality of output units in a display form having the first axis and a second axis.

5. The display device according to claim 4, wherein the display unit displays a data point obtained by summing the color and gradation values ​​of a plurality of data points output by the calculation unit based on the output formed in the phase adjustment processing unit with directionality in a specific direction at a certain time, as the detection result of non-stationary sound calculated by the plurality of output units.

6. It further includes an operating unit that accepts input from the operator regarding whether or not to display each detection method, The display device according to claim 1, wherein the calculation unit does not output the data points using the detection method which is not displayed by the operation unit.

7. The aforementioned detection method is Distortion detection for detecting the non-stationary sound based on the distortion of the sound pressure distribution, Color detection for detecting the non-stationary sound based on the level of frequency components, Energy detection for detecting the non-stationary sound based on energy, The display device according to any one of claims 1 to 6, wherein the display device is any one of the above.

8. A program for causing a computer to function as a display device that displays the detection result of non-stationary sounds contained in sound waves based on the output of a receiver array that receives sound waves, Computers, A calculation unit comprising a plurality of output units that calculate a detection value which is the result of detecting non-stationary sound based on the output of the receiver array using a certain detection method, calculate a gradation value based on the detection value, and output data points having the gradation value and a color set in the detection method, A display unit that displays a data point obtained by summing the color and gradation values ​​of the multiple data points output by the multiple output units as the detection result of a non-stationary sound calculated by the multiple output units. To make it function as, The program calculates a detected value, which is the detection result of the non-stationary sound, using the detection method described above, which detects non-stationary sound based on different physical quantities, for each of the multiple output units.

9. A display method performed by a computer that displays the detection results of non-stationary sounds contained in sound waves based on the output of a receiver array that receives sound waves, A first step involves using multiple detection methods to calculate a detection value, which is the result of detecting non-stationary sound, based on the output of the receiver array; calculating a gradation value based on the detection value; and outputting a data point having the gradation value and a color set for each detection method. A second step in which a data point obtained by summing the color and gradation values ​​of the plurality of data points output in the first step is displayed as the detection result of a non-stationary sound calculated in the first step. Includes, The first step is a display method that calculates a detected value, which is the detection result of the non-stationary sound, using the detection method that detects non-stationary sounds based on different physical quantities.

Images