Three-dimensional visual interaction method and system for hydrothermal plume sonar data

Abstract

The invention discloses a hydrothermal plume sonar data three-dimensional visual interaction method and system, and belongs to the technical field of marine geological image processing. Comprising the following steps: obtaining hydrothermal plume sonar data, segmenting the hydrothermal plume sonar data by adopting a four-dimensional region growing algorithm, and extracting a plume region; based on the plume region, in response to user operation, screening a feature region; and in response to a user instruction, performing multi-feature extraction on the feature region, and drawing the hydrothermal plume structure by adopting a mixture rendering method to generate a hydrothermal plume three-dimensional visual image. The efficiency of hydrothermal plume sonar data processing and analysis can be improved, and a user is helped to observe the relation among various characteristics; the problem that fusion drawing of various plume features cannot be achieved in the prior art is solved.

Description

Technical Field

[0001] The present invention relates to the technical field of marine geological image processing, and particularly to a three-dimensional visual interaction method and system for hydrothermal plume sonar data. Background Art

[0002] The statements in this section only mention the background art related to the present invention and do not necessarily constitute prior art.

[0003] Hydrothermal plumes are an important part of the global mid-ocean ridge hydrothermal fields. By observing hydrothermal plumes through acoustic imaging technology, three-dimensional sonar data of hydrothermal plumes can be collected. However, there are still some comprehensive methods for visualizing the three-dimensional sonar data of hydrothermal plumes lacking.

[0004] Currently, in order to facilitate the research and application of three-dimensional sonar data, researchers often use existing software such as Matlab to draw the three-dimensional sonar data of hydrothermal plumes to achieve their visualization. However, some visualization methods still have the following problems:

[0005] (1) It can only display features such as plume morphology, centerline, etc., and cannot show features such as plume flow, dilution and diffusion, etc., and cannot achieve the fusion drawing of multiple plume features.

[0006] (2) A large amount of code needs to be written, the interactivity is poor, and it is not friendly to marine science researchers who are not familiar with computer programming. Summary of the Invention

[0007] To solve the deficiencies of the prior art, the present invention provides a three-dimensional visual interaction method, system, electronic device, computer-readable storage medium and computer program product for hydrothermal plume sonar data, which generates three-dimensional visualization images in combination with the characteristics of hydrothermal plume data, and can improve the efficiency of hydrothermal plume sonar data processing and analysis.

[0008] In the first aspect, the present invention provides a three-dimensional visual interaction method for hydrothermal plume sonar data;

[0009] A three-dimensional visual interaction method for hydrothermal plume sonar data includes:

[0010] Obtain hydrothermal plume sonar data, segment the hydrothermal plume sonar data using a four-dimensional region growing algorithm, and extract the plume region;

[0011] Based on the plume region, in response to user operations, screen the feature regions;

[0012] In response to a user instruction, perform multiple feature extractions on the feature regions, and use a hybrid volume rendering method to draw the hydrothermal plume structure to generate a three-dimensional visualization image of the hydrothermal plume.

[0013] In some embodiments, the segmentation of the hydrothermal plume sonar data using the four-dimensional region growing algorithm is specifically as follows: Seed points are selected from the hydrothermal plume sonar data based on a preset time interval and threshold, and the seed points are updated and diffused based on a preset diffusion threshold.

[0014] In some embodiments, the screening of the feature region based on the plume region in response to a user operation includes:

[0015] In response to the user's operation of dragging the slider, the data range is obtained, and the plume region is cropped based on the data range;

[0016] In response to the user's click operation, the feature region is determined in the cropped plume region.

[0017] In some embodiments, the multiple feature extraction of the feature region in response to a user instruction includes:

[0018] In response to the user's centerline drawing instruction, the centerline of the hydrothermal plume is extracted and drawn;

[0019] In response to the user's gradient field drawing instruction, the gradient field of the plume data is calculated using the central difference method, and streamline drawing is performed by the fourth-order Runge-Kutta method;

[0020] In response to the user's velocity field drawing instruction, the velocity field of the hydrothermal plume is calculated by combining the line-of-sight velocity of the hydrothermal plume along the sonar direction and the centerline of the hydrothermal plume;

[0021] In response to the user's heat flux drawing instruction, the heat flux of the hydrothermal plume is calculated using the velocity field of the hydrothermal plume, and direct volume rendering of the heat flux is performed using the ray casting method.

[0022] In some embodiments, the calculation of the heat flux of the hydrothermal plume using the velocity field of the hydrothermal plume includes:

[0023] According to the vertical velocity of the hydrothermal plume, combined with the density of the hydrothermal plume, the density of seawater, and the reference density, the buoyancy flux of the hydrothermal plume is calculated;

[0024] According to the buoyancy flux, combined with the specific heat capacity and thermal expansion coefficient of the hydrothermal plume, the heat flux of the hydrothermal plume is calculated.

[0025] In some embodiments, the rendering of the hydrothermal plume structure using the hybrid volume rendering method includes:

[0026] Statistical analysis is performed on the data distribution in the feature region to determine the boundary region and the internal region of the hydrothermal plume;

[0027] Direct volume rendering is used to perform structural rendering on the internal region to visualize the hydrothermal plume structure; indirect volume rendering is used to extract grid surfaces from the boundary region to form a plume boundary.

[0028] In a second aspect, the present invention provides a three-dimensional visual interaction system for hydrothermal plume sonar data;

[0029] A three-dimensional visual interaction system for hydrothermal plume sonar data includes:

[0030] A preprocessing module, configured to: obtain hydrothermal plume sonar data, segment the hydrothermal plume sonar data using a four-dimensional region growing algorithm, and extract a plume region;

[0031] A feature region selection module, configured to: based on the plume region, in response to a user operation, screen for feature regions;

[0032] A plume visualization module, configured to: in response to a user instruction, perform multiple feature extractions on the feature regions, draw the hydrothermal plume structure using a hybrid volume rendering method, and generate a three-dimensional visualization image of the hydrothermal plume.

[0033] In a third aspect, the present invention provides an electronic device;

[0034] An electronic device includes a memory, a processor, and a computer program stored on the memory, and the processor executes the computer program to implement the steps of the above-mentioned three-dimensional visual interaction method for hydrothermal plume sonar data.

[0035] In a fourth aspect, the present invention provides a computer-readable storage medium;

[0036] A computer-readable storage medium has a computer program / instructions stored thereon, and when the computer program / instructions are executed by a processor, the steps of the above-mentioned three-dimensional visual interaction method for hydrothermal plume sonar data are implemented.

[0037] In a fifth aspect, the present invention provides a computer program product;

[0038] A computer program product includes a computer program / instructions, and when the computer program / instructions are executed by a processor, the steps of the above-mentioned three-dimensional visual interaction method for hydrothermal plume sonar data are implemented.

[0039] Compared with the prior art, the beneficial effects of the present invention are:

[0040] 1. The technical solution provided by the present invention optimizes the extraction steps of the hydrothermal plume feature region, extends the traditional three-dimensional region growing algorithm to four dimensions, and sets a special region screening method according to the characteristics of the hydrothermal plume data, so as to realize the extraction of the hydrothermal plume region from the background and track the same region in different time segments.

[0041] 2. The technical solution provided by the present invention proposes a combination of automatic screening and user initiative selection to help users determine the areas of interest; automatically performs region segmentation according to the characteristics of hydrothermal plume data and filters out noise regions, and allows users to determine the data boundaries by dragging the slider and select the plume regions of interest by clicking on the corresponding markers in the small map.

[0042] 3. The technical solution provided by the present invention, aiming at the characteristics of hydrothermal plume sonar data, adopts the method of hybrid rendering to draw the structure of the plume, and scales the data according to the distribution of the plume sonar data, so as to optimize the rendering effect; allows users to visualize the sonar data of the hydrothermal plume through the graphical interface interaction, and allows users to freely modify the parameters through the graphical interface to modify the visualization effect in real time.

[0043] 4. The technical solution provided by the present invention integrates and improves a variety of plume feature extraction methods, including plume centerlines, gradient fields, velocity fields, heat fluxes, etc., and supports the simultaneous drawing of multiple plume features to help users observe the relationships between multiple features. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] The accompanying drawings forming a part of this specification are used to provide a further understanding of the present invention. The schematic embodiments and descriptions thereof of the present invention are used to explain the present invention and do not constitute an improper limitation to the present invention.

[0045] Figure 1 It is a schematic flow chart of the three-dimensional visual interaction method for hydrothermal plume sonar data provided by the embodiment of the present invention;

[0046] Figure 2 It is a display example diagram of the hydrothermal plume visualization interface provided by the embodiment of the present invention;

[0047] Figure 3 It is an example diagram of the centerline of the hydrothermal plume provided by the embodiment of the present invention;

[0048] Figure 4 It is an example diagram of the gradient field streamline of the hydrothermal plume provided by the embodiment of the present invention;

[0049] Figure 5 It is an example diagram of the gradient field vector marker of the hydrothermal plume provided by the embodiment of the present invention;

[0050] Figure 6 It is an example diagram of the velocity field streamline of the hydrothermal plume provided by the embodiment of the present invention;

[0051] Figure 7 It is an example diagram of the heat flux of the hydrothermal plume provided by the embodiment of the present invention;

[0052] Figure 8 Structural example diagram of a hydrothermal plume provided by an embodiment of the present invention;

[0053] Figure 9 Example diagram of data boundary adjustment provided by an embodiment of the present invention;

[0054] Figure 10 Example diagram of selection of a plume region of interest provided by an embodiment of the present invention;

[0055] Figure 11 Example diagram of extraction of grid surfaces of a cubic grid provided by an embodiment of the present invention. Detailed implementation manners

[0056] It should be noted that the following detailed description is exemplary and is intended to provide further illustration of the present invention. Unless otherwise specified, all technical and scientific terms used in the present invention have the same meaning as commonly understood by those of ordinary skill in the technical field to which the present invention belongs.

[0057] It should be noted that the terms used herein are only for describing specific implementation manners and are not intended to limit the exemplary embodiments according to the present invention. As used herein, unless the context clearly indicates otherwise, the singular form is also intended to include the plural form. In addition, it should be understood that the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0058] In the case of no conflict, the embodiments in the present invention and the features in the embodiments may be combined with each other.

[0059] Embodiment 1

[0060] The visualization of existing hydrothermal plume sonar data cannot comprehensively and systematically display the characteristics of hydrothermal plumes; therefore, the present invention provides a three-dimensional visual interaction method for hydrothermal plume sonar data, which considers the temporal characteristics of hydrothermal plume data and performs multiple feature extractions and visualizations.

[0061] Next, in combination with Figures 1-11 , a three-dimensional visual interaction method for hydrothermal plume sonar data disclosed in this embodiment will be described in detail. The three-dimensional visual interaction method for hydrothermal plume sonar data includes:

[0062] S1. Obtain hydrothermal plume sonar data and perform preprocessing.

[0063] In this embodiment, the hydrothermal plume sonar data is collected by a sonar device. The preprocessed hydrothermal plume sonar data contains four dimensions, three dimensions representing the X, Y, and Z axes in space, and one dimension representing time.

[0064] To address the problem of long time intervals in the collection of hydrothermal plume sonar data, in this embodiment, a linear interpolation method is used to preprocess the hydrothermal plume sonar data, linearly interpolating the hydrothermal plume sonar data in time series to enable a smooth data transition effect between data frames with long time intervals.

[0065] S2. Use a four-dimensional region growing algorithm to segment the preprocessed hydrothermal plume sonar data and extract the plume region.

[0066] Specifically, first, select points with values greater than a given threshold at a fixed time interval as seed points; then, for each seed point, determine whether the values of adjacent points in the eight surrounding directions are greater than the above-mentioned given threshold. If so, consider the point as part of the region corresponding to the seed point and update the point as a seed point, and continue to perform the above determination operation for diffusion. After the above steps, multiple plume regions that are continuous in both time and space are extracted from the hydrothermal plume sonar data.

[0067] Here, the eight directions include up, down, left, right, front, back in space, and the front and back frames in time.

[0068] Since the data transition after linear interpolation is relatively smooth, therefore, the same region can be tracked well at different time segments through the above method, and the algorithm is accelerated by selecting points at intervals.

[0069] The plume region has the following characteristics:

[0070] (1) The plume region has a certain number of voxels. A region that is too small is more likely to be noise.

[0071] (2) The plume region should exist throughout the entire time series. A region that exists only in individual time segments is more likely to be noise captured during data collection by the sonar device.

[0072] Considering the above characteristics of the plume region, further, filter out smaller plume regions with the number of voxels as the threshold, and remove plume regions that exist only in some time segments. The remaining plume regions are the alternative regions for the feature regions.

[0073] S3. Based on the plume region, in response to user operations, screen the feature regions. Specifically, it includes:

[0074] S301. In response to the user's operation of dragging the slider, obtain the data range and crop the sonar data based on the data range.

[0075] Considering that the data collected by sonar equipment exists in a huge area, while the sonar data of hydrothermal plumes only accounts for a small part of the area, in order to enable users to focus on important plume areas and ignore other unimportant areas, in this embodiment, an interactive area cropping method is adopted.

[0076] Specifically, the user specifies the data range by dragging the sliders corresponding to the X, Y, and Z axes, and crops the sonar data according to the data range, thereby cropping out large empty areas in the sonar data that do not contain plumes.

[0077] S302. In response to the user's click operation, determine the feature area in the cropped sonar data.

[0078] Considering that there may be multiple plume areas in the sonar data, in order to enable users to better observe the plume areas they are interested in, in this embodiment, a small map interaction method is provided for users to select the target plume area. There is a small map provided in the user interface, and all the alternative areas obtained in S2 are marked on the small map, allowing users to select the plume area they want to observe as the feature area by clicking on the alternative areas on the small map.

[0079] Exemplarily, in combination with Figure 8 By adjusting the slider within the red circle on the right, the specified data boundary can be real-time feedback in the main interface, and clicking the cut button can complete the data cropping; in combination with Figure 9 , by clicking on the marker of the specified area (red circle) in the small map on the left, the plume area that the user is interested in can be specified.

[0080] S4. In response to the user's instruction, perform multiple feature extractions on the feature area, and use the hybrid rendering method to render the hydrothermal plume structure to generate a three-dimensional visualization image of the hydrothermal plume. Specifically, it includes:

[0081] S401. In response to the user's data rendering instruction, use the hybrid rendering method to render the hydrothermal plume structure.

[0082] Considering that the value range of the plume sonar data is large and a large number of points are concentrated in the lower value interval, directly rendering the original data will cause a large number of lower value data to not be displayed, resulting in a poor visualization effect; therefore, in this embodiment, different rendering methods are used to render the structure of the hydrothermal plume sonar data in different areas to improve the visualization effect.

[0083] As an implementation manner, the specific process of S401 is as follows:

[0084] S4011. Statistically analyze the data distribution of hydrothermal plume sonar data in the feature region using a histogram, and perform scaling processing on the hydrothermal plume sonar data in the feature region according to the data distribution characteristics.

[0085] Here, the data distribution characteristics refer to that the values are small at most points, and the value gap between the small points and the large points is several orders of magnitude.

[0086] Specifically, scale the hydrothermal plume sonar data in the feature region through a scaling function, expressed as:

[0087] scale(x) = log 10 (x) - log 10 (min(x));

[0088] In the formula, scale(x) represents the scaling function, and x represents the sonar data value at a certain spatial position.

[0089] S4012. Use direct volume rendering (ray casting method) to perform structure rendering on the internal region to visualize the hydrothermal plume structure; collect indirect volume rendering (Matching Cube algorithm) to extract the mesh surface of the boundary region to form a plume boundary.

[0090] In view of the characteristics that the values are higher near the plume centerline inside the plume data and lower near the plume boundary, a hybrid volume rendering method combining direct volume rendering and indirect volume rendering is proposed in this embodiment.

[0091] Specifically, for the structure of the internal region, use direct volume rendering. For each pixel on the imaging plane, cast a ray into the space; for each incident ray, accumulate opacity and color along its path according to the following formula:

[0092] α i = α i-1 +(1 - α i )f(x i );

[0093] c i = c i-1 +(1 - α i )f(x i )g(x i );

[0094] In the formula, α i represents the opacity value accumulated in the i-th step, α i-1 represents the opacity value accumulated in the (i - 1)-th step, c i represents the color value accumulated in the i-th step, c i-1 represents the color value accumulated in the (i - 1)-th step, x irepresents the plume density value at the sampling point, f(x i ) represents the opacity transfer function value at x i ; g(x i ) represents the color mapping function value at x i .

[0095] f(x) is the opacity transfer function. In this embodiment, it is set as a linear function to highlight the area with a greater plume density; g(x) is the color mapping function, and a linear mapping is used to establish the correspondence between the plume density value and the color, allowing the user to select from a set of preset color tables, thereby achieving different plume visualization effects. Different drawing effects can be obtained by adjusting different color mapping methods.

[0096] For the boundary region, the indirect volume rendering method (Matching Cube method) is used to extract the mesh surface and set it to be semi-transparent, so that the user can clearly see the clear plume boundary composed of the mesh surface and can also see the internal plume density distribution through the boundary.

[0097] As an implementation manner, the specific process of extracting the mesh surface by using the indirect volume rendering method (Matching Cube method) is as follows:

[0098] First, the hydrothermal plume sonar data in the boundary region is evenly divided into cubic meshes.

[0099] For each cubic mesh, there are eight vertices, and each vertex has two states: 1 indicates that the data value corresponding to the vertex is greater than the plume boundary value (this value is set to 1×10 -6 ) according to the characteristics of the plume data, and the vertex is inside the plume; 0 indicates that the value is less than the plume boundary value, and the vertex is outside the plume.

[0100] According to characteristics such as rotation and mapping invariance, the states of each cubic mesh can be summarized into 16 basic configurations, and each basic configuration has a corresponding face extraction method; combined with Figure 11 , where the red vertices represent the state of 1 and the green vertices represent the state of 0, and the faces extracted for each configuration are as shown in the yellow part of Figure 11 .

[0101] Perform the above steps of extraction on each cubic mesh, and finally obtain the mesh surface.

[0102] S402. In response to the user's centerline drawing instruction, extract and draw the centerline of the hydrothermal plume.

[0103] Specifically, first, slice the hydrothermal plume sonar data in the feature region along the Z-axis, and calculate the maximum value points in each slice; then, use the least squares method to fit the above series of maximum value points to the quadratic polynomial function n(x) = ax 2 + bx + c:

[0104]

[0105] where P(a, b, c) represents the least squares error, y i represents the observed value (true value), that is, the maximum value point in each slice, a, b, and c respectively represent the weight parameters, and m represents the number of points.

[0106] After the above process, a smooth plume centerline is finally obtained.

[0107] S403. In response to the user's gradient field drawing instruction, use the central difference method to calculate the gradient field of the plume data, take a slender cylindrical surface area along the plume centerline, uniformly select seed points in this cylindrical surface area, and perform gradient field streamline drawing on the selected seed points through the fourth-order Runge-Kutta method.

[0108] Specifically, the gradient field is expressed as:

[0109]

[0110] where h represents the interval (step size) between two points.

[0111] The streamline drawing of the selected seed points using the fourth-order Runge-Kutta method is expressed as:

[0112]

[0113] p(t 0 ) = p 0 ;

[0114] t 0 ≤ t ≤ t n ;

[0115] k 1 = f(t i , p i );

[0116]

[0117] k 4 = f(t i + h, p i + k 3 h);

[0118] where p 0Denotes the initial value point (seed point), which is a three-dimensional vector; p i Denotes the i-th point on the streamline, which is a three-dimensional vector; t 0 Denotes the parameter of the initial value point, t n Denotes the parameter of the last point, h represents the interval (step size) between two points; f(t, p) represents the gradient field, which is a three-dimensional vector-valued function, that is where t i is the parameter corresponding to the point p i p(t i ) = p i ; k 1 ~k 4 are all three-dimensional vectors.

[0119] Based on the above formula, the next point y i on the streamline is obtained from the point y i+1 . Starting from the initial value point y 0 , the above formula is used multiple times for calculation to sequentially obtain each point on the streamline, and connecting these points in sequence can obtain the streamline.

[0120] S404. In response to the user's velocity field drawing instruction, combine the line-of-sight velocity of the hydrothermal plume along the sonar direction and the centerline of the hydrothermal plume to calculate the velocity field of the hydrothermal plume.

[0121] Specifically, first, sonar data is collected by the sonar device in Doppler mode. At this time, the sonar data is a three-dimensional matrix, representing the line-of-sight velocity of the hydrothermal plume along the sonar direction. The line-of-sight velocity at a point represents the component of the velocity at that point in the world coordinate system along the direction of the line connecting the point and the position of the sonar device.

[0122] Then, geometric correction is performed on the line-of-sight velocity using the plume centerline to obtain the velocity field of the plume relative to the world coordinate system. The specific process of geometric correction is as follows:

[0123] First, calculate the velocities of any point on the plume centerline and any point on the plume that is not on the plume centerline in the world coordinate system.

[0124] For any point on the plume centerline, the velocity in the world coordinate system is expressed as:

[0125]

[0126] where, v c represents the velocity of any point on the plume centerline in the world coordinate system, v rc is the line-of-sight velocity corresponding to this point, and θ 1 is the angle between the tangent of the centerline at this point and the line-of-sight direction (the direction of the line connecting the sonar device position and this point).

[0127] For any point on the plume and not on the plume centerline, the velocity in the world coordinate system is expressed as:

[0128] v p = w p 2 + v h 2 ;

[0129]

[0130] where, v p represents the velocity of any point on the plume and not on the plume centerline in the world coordinate system, v rp represents the line-of-sight velocity at this point, v h represents the horizontal component of the velocity in the world coordinate system calculated at the point on the centerline of the cross-section on the same vertical centerline as this point, θ 2 represents the angle between the line-of-sight velocity and the horizontal direction at this point.

[0131] Then, the fourth-order Runge-Kutta method is used to process the velocity field data and draw the velocity field streamlines. The method here is the same as that in S403 and will not be elaborated here.

[0132] S405. In response to the user's heat flux drawing instruction, using the velocity field of the hydrothermal plume, calculate the heat flux of the hydrothermal plume and perform direct volume rendering on the heat flux using the ray casting method. Specifically, it includes:

[0133] S4051. According to the vertical velocity of the hydrothermal plume, combined with the density of the hydrothermal plume, the density of seawater, and the reference density, calculate the buoyancy flux of the hydrothermal plume; expressed as:

[0134]

[0135] In the formula, W x represents the vertical velocity of the plume (the component of the plume velocity along the Z-axis), ρ x represents the density of the plume, ρ w represents the density of seawater, ρ ref represents the reference density (1.04×10 3 kg / m 3 ).

[0136] S4052. According to the buoyancy flux, combined with the specific heat capacity and thermal expansion coefficient of the hydrothermal plume, calculate the heat flux of the hydrothermal plume; expressed as:

[0137]

[0138] In the formula, g represents the acceleration due to gravity, with a value of 9.8m / s 2 ; c prepresents the specific heat capacity of the plume, with a value of 3.92×10 3 J / kg / ℃; α T represents the coefficient of thermal expansion, with a value of 1.32×10 -4 ℃ -1 。

[0139] S4053. Select the rainbow color table, establish the mapping relationship between the heat flux values and colors, and use the ray casting method to perform direct volume rendering on the plume heat flux.

[0140] Specifically, for each heat flux data, according to the rainbow color table, map each heat flux value to a preset (R, G, B) color tuple.

[0141] Here, the method of using the ray casting method to perform direct volume rendering on the plume heat flux is the same as the method in S4012, and will not be elaborated here.

[0142] Embodiment 2

[0143] This embodiment discloses a three-dimensional visual interaction system for hydrothermal plume sonar data, including:

[0144] A preprocessing module, configured to: obtain hydrothermal plume sonar data, segment the hydrothermal plume sonar data by using a four-dimensional region growing algorithm, and extract the plume region;

[0145] A feature region selection module, configured to: based on the plume region, in response to a user operation, screen the feature region;

[0146] A plume visualization module, configured to: in response to a user instruction, perform multiple feature extractions on the feature region, use a hybrid volume rendering method to draw the hydrothermal plume structure, and generate a three-dimensional visualization image of the hydrothermal plume.

[0147] It should be noted here that the above preprocessing module, feature region selection module, and plume visualization module correspond to the steps in Embodiment 1. The examples and application scenarios implemented by the above modules and the corresponding steps are the same, but are not limited to the content disclosed in Embodiment 1 above. It should be noted that the above modules, as part of the system, can be executed in a computer system such as a set of computer executable instructions.

[0148] Embodiment 3

[0149] Embodiment 3 of the present invention provides an electronic device, including a memory and a processor, and computer instructions stored on the memory and running on the processor. When the computer instructions are run by the processor, the steps of the above three-dimensional visual interaction method for hydrothermal plume sonar data are completed.

[0150] Embodiment 4

[0151] Embodiment 4 of the present invention provides a computer-readable storage medium for storing computer instructions. When the computer instructions are executed by a processor, the steps of the above-mentioned three-dimensional visual interaction method for hydrothermal plume sonar data are completed.

[0152] Embodiment 5

[0153] Embodiment 5 of the present invention provides a computer program product, including a computer program / instructions. When the computer program / instructions are executed by a processor, the steps of the above-mentioned three-dimensional visual interaction method for hydrothermal plume sonar data are implemented.

[0154] The present invention is described with reference to the flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, and the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing devices generate a device for implementing the functions specified in one process Figure 1 one process or multiple processes and / or blocks Figure 1 one block or multiple blocks.

[0155] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory generate a manufactured article including an instruction device, and the instruction device implements the functions specified in one process Figure 1 one process or multiple processes and / or blocks Figure 1 one block or multiple blocks.

[0156] These computer program instructions can also be loaded onto a computer or other programmable data processing device, and a series of operation steps are executed on the computer or other programmable device to generate a computer-implemented process. Thus, the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one process Figure 1 one process or multiple processes and / or blocks Figure 1 one block or multiple blocks.

[0157] In the above embodiments, the descriptions of each embodiment have their own emphases. For parts not detailed in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0158] The above are only the preferred embodiments of the present invention and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included within the protection scope of the present invention.

Claims

1. A three-dimensional visual interaction method for hydrothermal plume sonar data, characterized in that: include: Acquiring hydrothermal plume sonar data, segmenting the hydrothermal plume sonar data using a four-dimensional region growing algorithm, and extracting plume regions; Based on the plume area, in response to a user operation, filtering a characteristic area; In response to user instructions, multiple features are extracted from the feature area, and the hydrothermal plume structure is rendered using a hybrid volume rendering method to generate a three-dimensional visualization image of the hydrothermal plume.

2. The three-dimensional visual interaction method of hydrothermal plume sonar data according to claim 1, characterized in that: The method of segmenting the hydrothermal plume sonar data using the four-dimensional region growing algorithm specifically includes: selecting seed points from the hydrothermal plume sonar data based on a preset time interval and threshold, and updating and diffusing the seed points based on a preset diffusion threshold.

3. The three-dimensional visual interaction method of hydrothermal plume sonar data according to claim 1, characterized in that: The filtering of the characteristic area based on the plume area in response to a user operation includes: In response to a user's operation of dragging the slider, a data range is acquired, and the plume area is clipped based on the data range; In response to a click operation by the user, a characteristic region is determined in the cropped plume region.

4. The three-dimensional visual interaction method of hydrothermal plume sonar data according to claim 1, characterized in that: In response to the user instruction, extracting multiple features from the feature area comprises: Responsive to a user's centerline drawing instruction, extracting and drawing a centerline of a hydrothermal plume; In response to the user's gradient field drawing command, the gradient field of the plume data is calculated using the central difference method, and streamlines are drawn using the fourth-order Runge-Kutta method; In response to the user's velocity field drawing command, the velocity field of the hydrothermal plume is calculated by combining the line-of-sight velocity of the hydrothermal plume along the sonar direction and the centerline of the hydrothermal plume; In response to the user's heat flux rendering command, the velocity field of the hydrothermal plume is used to calculate the heat flux of the hydrothermal plume, and the heat flux is directly rendered using the ray transmission method.

5. The three-dimensional visual interaction method of hydrothermal plume sonar data according to claim 4, characterized in that: The method of calculating the heat flux of the hydrothermal plume by using the velocity field of the hydrothermal plume comprises: The buoyancy flux of the hydrothermal plume is calculated based on the vertical velocity of the hydrothermal plume, combined with the hydrothermal plume density, seawater density and reference density; The heat flux of the hydrothermal plume is calculated based on the buoyancy flux in combination with the specific heat capacity and thermal expansion coefficient of the hydrothermal plume.

6. The three-dimensional visual interaction method of hydrothermal plume sonar data according to claim 1, characterized in that: The method of drawing the hydrothermal plume structure by using a mixed body drawing method comprises: Performing statistical analysis on the data distribution in the characteristic area to determine the boundary area and the internal area of ​​the hydrothermal plume; Direct volume rendering is used to perform structural rendering of the internal area to visualize the hydrothermal plume structure; indirect volume rendering is used to extract mesh surfaces from the boundary area to form the plume boundary.

7. A three-dimensional visual interactive system for hydrothermal plume sonar data, characterized in that: include: The preprocessing module is configured to: obtain hydrothermal plume sonar data, segment the hydrothermal plume sonar data using a four-dimensional region growing algorithm, and extract the plume region; The feature region selection module is configured to: based on the plume region, in response to a user operation, filter the feature region; The plume visualization module is configured to: in response to a user instruction, perform multiple feature extraction on the feature area, draw the hydrothermal plume structure using a hybrid volume rendering method, and generate a three-dimensional visualization image of the hydrothermal plume.

8. An electronic device comprising a memory, a processor and a computer program stored in the memory, characterized in that: The processor executes the computer program to implement the steps of the three-dimensional visual interaction method for hydrothermal plume sonar data according to any one of claims 1 to 6.

9. A computer-readable storage medium having a computer program / instruction stored thereon, characterized in that: When the computer program / instructions are executed by a processor, the steps of the three-dimensional visual interaction method for hydrothermal plume sonar data described in any one of claims 1 to 6 are implemented.

10. A computer program product comprising a computer program / instructions, characterized in that When the computer program / instructions are executed by a processor, the steps of the three-dimensional visual interaction method for hydrothermal plume sonar data described in any one of claims 1 to 6 are implemented.

Images