Center line editing method and device, electronic equipment and storage medium

Abstract

A center line editing method and device, electronic equipment and storage medium are disclosed. The method comprises: displaying a curved surface reconstruction image to be processed, wherein the curved surface reconstruction image to be processed comprises a center line to be edited; receiving center line editing information corresponding to the center line to be edited; determining an edited center line according to the center line editing information, and generating and displaying a target curved surface reconstruction image according to the edited center line. The technical scheme of the embodiment of the present application realizes the effect of personalized editing of the center line in the curved surface reconstruction image, improves the editing flexibility of the center line, and improves the user experience.

Description

Technical Field

[0001] This invention relates to the field of image processing technology, and in particular to a centerline editing method, apparatus, electronic device, and storage medium. Background Technology

[0002] In the field of medical imaging, the centerline typically refers to the central axis of a blood vessel or tubular structure. The centerline provides a description of the shape, bifurcation, and curvature of the blood vessel or tubular structure, which is extremely useful for surgical planning and disease research. Generally, the centerline is determined using image processing algorithms; however, it cannot be guaranteed to be 100% accurate, so modifications to the determined centerline are necessary.

[0003] In related technologies, since the length of the center line is equal to the image height, when editing control points on the center line in an image, the control points being edited cannot extend beyond the image area, thus making it impossible to extend the center line and consequently, impossible to edit the center line in the image. Summary of the Invention

[0004] This invention provides a centerline editing method, apparatus, electronic device, and storage medium to achieve personalized editing of centerlines in reconstructed surface images, thereby improving the flexibility of centerline editing and enhancing the user experience.

[0005] According to one aspect of the present invention, a centerline editing method is provided, the method comprising:

[0006] Display the surface reconstruction image to be processed, wherein the surface reconstruction image to be processed includes the centerline to be edited;

[0007] Receive centerline editing information corresponding to the centerline to be edited;

[0008] The edited centerline is determined based on the centerline editing information, and a target surface reconstruction image is generated and displayed based on the edited centerline.

[0009] Optionally, before displaying the reconstructed image of the surface to be processed, the method further includes:

[0010] Obtain the original surface reconstruction image;

[0011] Generate the original centerline corresponding to the original surface reconstruction image.

[0012] Optional, also includes:

[0013] The original centerline is extended to obtain the extended centerline.

[0014] The surface reconstruction image to be processed is determined based on the extended centerline.

[0015] Optionally, determining the surface reconstruction image to be processed based on the extended centerline includes:

[0016] The original surface reconstruction image is extended based on the extended centerline to obtain the extended surface reconstruction image;

[0017] The extended centerline is length restored so that the restored centerline has the same length as the original centerline.

[0018] Set the restored centerline to an editable state to obtain the centerline to be edited;

[0019] The centerline to be edited is added to the extended surface reconstruction image to obtain the surface reconstruction image to be processed.

[0020] Optionally, the number of editable points included in the editable centerline is consistent with the number of control points included in the original centerline, wherein the control points are key feature points used to generate the original centerline.

[0021] Optionally, receiving centerline editing information corresponding to the centerline to be edited includes:

[0022] Upon detecting an editing operation on the centerline to be edited, centerline editing information corresponding to the editing operation is obtained, wherein the centerline editing information is generated based on the touch point trajectory and / or determined based on input parameters; the editing operation includes at least one of an editable point addition operation, an editable point deletion operation, and an editable point drag operation.

[0023] Optionally, after determining the edited centerline based on the centerline editing information, the method further includes:

[0024] The centerline editing information is synchronized to the original centerline to update the centerline data corresponding to the original centerline, resulting in updated centerline data.

[0025] Optionally, synchronizing the centerline editing information to the original centerline includes:

[0026] Determine the target edit point in the edited centerline that corresponds to the centerline editing information;

[0027] Based on the index of the target edit point and the index of each control point in the original centerline, the centerline editing information is synchronized to the original centerline.

[0028] Optionally, generating and displaying the target surface reconstruction image based on the edited centerline includes:

[0029] The surface reconstruction image to be processed is updated based on the edited centerline, and the updated surface reconstruction image is used as the target surface reconstruction image and displayed.

[0030] According to another aspect of the present invention, a centerline editing device is provided, the device comprising:

[0031] An image display module is used to display the surface reconstruction image to be processed, wherein the surface reconstruction image to be processed includes the centerline to be edited;

[0032] An editing information receiving module is used to receive centerline editing information corresponding to the centerline to be edited;

[0033] The target surface reconstruction image generation module is used to determine the edited centerline based on the centerline editing information, and generate and display the target surface reconstruction image based on the edited centerline.

[0034] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:

[0035] At least one processor; and

[0036] A memory communicatively connected to the at least one processor; wherein,

[0037] The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the centerline editing method according to any embodiment of the present invention.

[0038] According to another aspect of the present invention, a computer-readable storage medium is provided, the computer-readable storage medium storing computer instructions for causing a processor to execute and implement the centerline editing method according to any embodiment of the present invention.

[0039] The technical solution of this invention, by displaying a surface reconstruction image to be processed, wherein the surface reconstruction image to be processed includes a centerline to be edited, further receiving centerline editing information corresponding to the centerline to be edited, and finally determining the edited centerline based on the centerline editing information, and generating and displaying a target surface reconstruction image based on the edited centerline, solves the problem in related technologies that the centerline in the surface reconstruction image cannot be edited, realizes the effect of personalized editing of the centerline in the surface reconstruction image, improves the editing flexibility of the centerline, and enhances the user experience.

[0040] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description

[0041] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0042] Figure 1 This is a flowchart of a centerline editing method provided in Embodiment 1 of the present invention;

[0043] Figure 2 This is a schematic diagram of a surface reconstruction image to be processed according to Embodiment 1 of the present invention;

[0044] Figure 3 This is a schematic diagram of a surface reconstruction image including a non-extendable centerline according to Embodiment 1 of the present invention;

[0045] Figure 4 This is a flowchart of a centerline editing method provided in Embodiment 2 of the present invention;

[0046] Figure 5 This is a schematic diagram of a centerline extension process according to Embodiment 2 of the present invention;

[0047] Figure 6 This is a schematic diagram of a centerline editing information synchronization process according to Embodiment 2 of the present invention;

[0048] Figure 7 This is a scene flowchart of a centerline editing method provided according to Embodiment 2 of the present invention;

[0049] Figure 8This is a schematic diagram of the structure of a centerline editing device according to Embodiment 3 of the present invention;

[0050] Figure 9 This is a schematic diagram of the structure of an electronic device that implements the centerline editing method of this invention. Detailed Implementation

[0051] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0052] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0053] Example 1

[0054] Figure 1 This is a flowchart of a centerline editing method provided in Embodiment 1 of the present invention. This embodiment is applicable to editing the centerlines in a surface reconstruction image. The method can be executed by a centerline editing device, which can be implemented in hardware and / or software, and can be configured in a terminal and / or server. Figure 1 As shown, the method includes:

[0055] S110. Display the surface reconstruction image to be processed, wherein the surface reconstruction image to be processed includes the centerline to be edited.

[0056] In this embodiment, the centerline to be edited can be either the centerline to be edited or a centerline that has already been set to an editable state. Those skilled in the art will understand that in the field of medical imaging, the centerline typically refers to the central axis of a blood vessel or duct structure. The centerline is obtained by connecting several points in a preset direction. The surface reconstruction image to be processed can be the surface reconstruction image to be processed. The surface reconstruction image to be processed can be an image that has been processed from a stored original surface reconstruction image and then displayed on the display interface. For example, such as... Figure 2 As shown, this is the surface reconstruction image to be processed displayed on the screen. Figure 2 The line segment indicated by the middle arrow is the centerline to be edited. Those skilled in the art will understand that in the field of medical imaging, Curved Projection Reformation (CPR) is an extension and development of Multi Plane Reconstruction (MPR). Based on MPR, a curve is drawn along the organ of interest, and the volumetric information along the curve is reconstructed to obtain a CPR image. This image can straighten and display distorted, shortened, and overlapping structures such as blood vessels and colons on the same plane, and can show the entire course of blood vessels along the coronary arteries. CPR is a medical image post-processing technique that selects a specific curve path in one dimension and displays all voxels along that path on the same plane. This technique can evaluate structures with large curvatures in a single operation, such as bones, trachea, nerves, blood vessels, pancreas, and ureters.

[0057] In this embodiment, the surface reconstruction image to be processed can be a stored image retrieved from a relevant database by the server or client, or it can be an image generated in real time. Meanwhile, the surface reconstruction image to be processed includes one or more center lines. It can be understood that the center line in the surface reconstruction image to be processed is the center line to be edited.

[0058] It should be noted that in related technologies, when obtaining a surface reconstruction image including a centerline, the length of the centerline is generally consistent with the size of the surface reconstruction image. Furthermore, the user cannot extend the centerline based on the input device so that the extended centerline extends beyond the area corresponding to the surface reconstruction image. For example, as shown... Figure 3 As shown, this is a surface reconstruction image including the center line. The length of the center line is generally consistent with the size of the surface reconstruction image. Figure 3The line segment indicated by the middle arrow is the centerline, which cannot be extended. Therefore, to enable users to extend and edit the centerline, the original surface reconstruction image and the centerline it contains can be processed before displaying the centerline that can be extended and edited on the display interface. Specifically, the original surface reconstruction image can be obtained first, and a centerline corresponding to the surface reconstruction image can be generated. Then, the centerline can be extended according to the algorithm program to obtain the extended centerline. Next, the original surface reconstruction image can be updated based on the extended centerline to obtain the extended surface reconstruction image, which does not include the extended centerline. Further, the extended centerline can be restored to its original length according to the algorithm program to ensure that the restored length matches the original centerline length. Then, the restored centerline can be drawn on the extended surface reconstruction image, and the completed image can be displayed as the surface reconstruction image to be processed on the display interface. The centerline drawn on the extended surface reconstruction image can be used as the centerline to be edited. It should be noted that the process of determining the surface reconstruction image to be processed is implemented in the background processing stage of the application. In the actual application stage, the image directly displayed on the display interface, which the user can observe, is the surface reconstruction image to be processed after processing the original surface reconstruction image.

[0059] In practical applications, a surface reconstruction image, including the centerline to be edited, can be acquired. This reconstructed image can then be displayed on a screen, allowing users to edit the centerline within it.

[0060] It should be noted that when the centerline to be edited is displayed in the reconstructed surface image, the control points that make up the centerline will also be displayed. In other words, the centerline to be edited is displayed in the reconstructed surface image as a line formed by connecting points, and several control points of preset shapes will be displayed on the centerline to be edited. The preset shapes can be any shape, selectable, such as circles, squares, or rhombuses.

[0061] S120: Receive centerline editing information corresponding to the centerline to be edited.

[0062] In this embodiment, the centerline editing information can be information determined during the editing process based on editing operations performed on the centerline to be edited. In practical applications, the centerline to be edited consists of several points, each of which has been pre-set to be editable. Therefore, when editing the centerline, editing operations can be input at any point on the centerline. Thus, the centerline editing information can be determined based on the input editing operations.

[0063] In practical applications, centerline editing information can be determined in at least two ways: either based on touch point trajectory generation or based on input parameters.

[0064] The touch trajectory can be a path formed by swiping touch points on the display interface using an input device or a user's finger. Optionally, the input device can be a mouse or keyboard, etc. In practical applications, all points on the center line to be edited can be set to editable. The user can use any control point on the center line as a starting point to control the movement of that point on the display interface, thus achieving the editing operation of the center line. Furthermore, if the input device stops input in any area of ​​the display interface, the position of that point at that moment can be taken as the endpoint. Therefore, based on the starting point on the center line to be edited and the endpoint obtained after editing, the touch trajectory can be obtained. Thus, the center line editing information can be determined based on the touch trajectory.

[0065] In this embodiment, after determining the centerline to be edited, at least one centerline attribute parameter corresponding to the centerline to be edited can be determined. These centerline attribute parameters can all be parameters used to characterize the basic features of the centerline to be edited. Optionally, the centerline attribute parameters may include the number of points included on the centerline, the spatial coordinates corresponding to each point (the spatial coordinates can characterize the position of the corresponding point in the surface reconstruction image to be processed), and the centerline length, etc. In practical applications, after determining the centerline to be edited, upon detecting a user's trigger operation on the centerline editing control, a centerline parameter adjustment page can be displayed on the display interface. Furthermore, at least one centerline attribute parameter included on this page can be edited. Then, the final input parameters can be determined based on the edited centerline attribute parameters. Thus, centerline editing information can be determined based on the input parameters.

[0066] In practical applications, after displaying the reconstructed surface image to be processed, including the centerline to be edited, the user can input an edit trigger operation on the centerline to be edited, thereby editing the centerline. Thus, upon detecting the end of the editing process, the centerline editing information corresponding to the edit trigger operation can be determined.

[0067] Optionally, receiving centerline editing information corresponding to the centerline to be edited includes: when an editing operation is detected on the centerline to be edited, obtaining centerline editing information corresponding to the editing operation.

[0068] In this embodiment, the editing operation can be an operation that modifies a series of changes to the characteristic attributes of the centerline displayed on the display interface. Optionally, the editing operation can include at least one of the following: adding an editable point, deleting an editable point, and dragging an editable point. The adding an editable point operation can be understood as a trigger operation that adds an editable point to the centerline to be edited. The deleting an editable point operation can be understood as a trigger operation that deletes an editable point included on the centerline to be edited. The dragging an editable point operation can be understood as a trigger operation that drags an editable point included on the centerline to be edited to change the length of the centerline. The dragging an editable point operation can be an operation that starts from any editable point on the centerline to be edited and moves that editable point on the display interface based on the input device or the user's finger. An editable point can be a point that constitutes the centerline to be edited and can be edited. Optionally, an editable point can be all points on the centerline to be edited, or it can be a portion of the points on the centerline to be edited.

[0069] In practical applications, editing operations on the center line to be edited can be performed by directly applying the input device or touch point to the corresponding trigger operation on the center line to be edited displayed on the screen; or they can be performed by inputting an editing operation on the parameter configuration page corresponding to the center line to be edited. The following will explain the working methods of these two trigger operations respectively.

[0070] One approach is to pre-set the centerline to be edited to an editable state, i.e., make some or all of the points included on the centerline editable as editable. For adding editable points, the location of the new editable point on the centerline to be edited can be determined first. Then, a click operation can be performed at this location using an input device (e.g., mouse or keyboard) or touch point. Based on this click operation, the centerline editing information corresponding to the centerline to be edited can be determined. The click operation can be a single click or multiple clicks (e.g., double-click). Alternatively, for user convenience, adding editable points can be done by adding an editable point when the user's pause time at the determined location based on an input device or touch point reaches a preset duration. For deleting editable points, the editable point to be deleted can be determined from the editable points included on the centerline to be edited. Then, a delete operation can be performed on this editable point. Furthermore, upon detecting an editable point deletion operation targeting an editable point to be deleted, a response can be initiated to determine the centerline editing information corresponding to the centerline to be edited. For editable point drag operations, upon detecting a drag operation input targeting an editable point included on the centerline to be edited, a touchpoint trajectory can be generated based on the input drag operation. Then, the centerline editing information corresponding to the centerline to be edited can be determined based on the generated touchpoint trajectory.

[0071] Another approach is to pre-develop a centerline editing control. When determining the centerline to be edited, at least one centerline attribute parameter corresponding to the centerline to be edited can be obtained based on the centerline data. Upon detecting a trigger operation on the centerline editing control, a parameter editing page can be displayed on the interface, showing the parameter values ​​of each centerline attribute parameter corresponding to the centerline to be edited. Then, the user can input corresponding change parameters in the edit boxes corresponding to at least one centerline editing parameter displayed on the parameter editing page, based on the centerline editing requirements. Thus, the centerline editing information corresponding to the centerline to be edited can be determined based on the user-input change parameters.

[0072] It should be noted that the advantage of determining centerline editing information by detecting the editing operation on the centerline to be edited is that it allows for customized editing of the centerline to be edited based on user needs, simplifies the centerline editing process, meets users' personalized needs, and improves the user experience.

[0073] In practical implementation, after detecting that a user directly acts on the center point to be edited using an input device, obtaining the touch trajectory or trigger operation, it can be determined that an editing operation has been detected on the center line to be edited. Then, corresponding center line editing information can be generated based on the detected editing operation. Alternatively, after detecting that the user is editing the edit box corresponding to the center line attribute parameters, and obtaining the changed parameters based on the edited parameters, the center line editing information corresponding to the center line to be edited can be determined based on the changed parameters. Furthermore, after obtaining the center line editing information, it can be uploaded to the corresponding server or client, so that the server or client can process the center line to be edited based on the center line editing information.

[0074] S130. Determine the edited centerline based on the centerline editing information, and generate and display the target surface reconstruction image based on the edited centerline.

[0075] In this embodiment, the edited centerline can be the centerline obtained after editing the centerline to be edited. The target surface reconstruction image can be the updated image obtained by editing the centerline of the surface reconstruction image to be processed. The centerline included in the target surface reconstruction image can be the edited centerline.

[0076] In practical applications, upon receiving centerline editing information for the centerline to be edited in a reconstructed surface image, the centerline can be adjusted based on this information. The adjusted centerline can then be used as the edited centerline. Specifically, when the centerline editing information is generated based on touch point trajectories, the centerline to be edited can be adjusted based on the changing parameters corresponding to at least one of the trigger operations included in the centerline editing information: adding, deleting, or dragging editable points. When the centerline editing information is determined based on input parameters, the centerline to be edited can be adjusted based on at least one changing parameter included in the centerline editing information.

[0077] Furthermore, after obtaining the edited centerline, the surface reconstruction image to be processed can be processed based on the edited centerline. Then, the processed image can be used as the target surface reconstruction image and displayed in the display interface.

[0078] Optionally, generating and displaying a target surface reconstruction image based on the edited centerline includes: updating the surface reconstruction image to be processed based on the edited centerline, and displaying the updated surface reconstruction image as the target surface reconstruction image.

[0079] In practical applications, after obtaining the edited centerline, the surface reconstruction image to be processed can be updated according to the edited centerline based on a pre-deployed surface reconstruction image generation algorithm. Thus, the updated surface reconstruction image can be used as the target surface reconstruction image and displayed on the interface.

[0080] The technical solution of this invention, by displaying a surface reconstruction image to be processed, wherein the surface reconstruction image to be processed includes a centerline to be edited, further receiving centerline editing information corresponding to the centerline to be edited, and finally determining the edited centerline based on the centerline editing information, and generating and displaying a target surface reconstruction image based on the edited centerline, solves the problem in related technologies that the centerline in the surface reconstruction image cannot be edited, realizes the effect of personalized editing of the centerline in the surface reconstruction image, improves the editing flexibility of the centerline, and enhances the user experience.

[0081] Example 2

[0082] Figure 4 This is a flowchart of a centerline editing method provided in Embodiment 2 of the present invention. Based on the foregoing embodiments, before displaying the surface reconstruction image to be processed, the surface reconstruction image to be processed can be determined first, so that the determined surface reconstruction image to be processed can be displayed on the display interface. Technical terms that are the same as or corresponding to those in the above embodiments will not be repeated here.

[0083] like Figure 4 As shown, the method includes:

[0084] S210. Obtain the original surface reconstruction image.

[0085] In this embodiment, the original surface reconstruction image can be a surface reconstruction image that requires image processing so that the processed image can be displayed on the display interface. It should be noted that the original centerline can be obtained from an image database or generated in real time based on pre-acquired scan data; this embodiment does not specifically limit this.

[0086] In practical applications, the original surface reconstruction image can be obtained first. Then, the obtained original surface reconstruction image can be processed to obtain the surface reconstruction image to be processed.

[0087] S220. Generate the original centerline corresponding to the original surface reconstruction image.

[0088] In this embodiment, the original centerline can be a directly generated, unprocessed centerline from the surface reconstruction image. The length of the original centerline corresponds to the image height of the original surface reconstruction image.

[0089] In practical applications, after acquiring the original reconstructed surface image, it can be processed according to a pre-deployed centerline generation algorithm. This allows the generation of the original centerline corresponding to the original reconstructed surface image.

[0090] It should be noted that, in addition to obtaining the original surface reconstruction image, the original surface reconstruction image can also be processed according to other centerline generation methods. This will generate the original centerline corresponding to the original surface reconstruction image.

[0091] S230. Extend the original centerline to obtain the extended centerline.

[0092] In this embodiment, the extended centerline can be the centerline obtained by extending the length of the original centerline.

[0093] In practical applications, after obtaining the original centerline, it can be extended at both ends to obtain the extended centerline. Specifically, the centerline is formed by connecting multiple points in a preset order. The original centerline is also formed by connecting multiple points. Therefore, to extend the original centerline, several points can be determined at the beginning of the original centerline in a direction opposite to the preset connection order. These points are designated as the first points to be extended; none of these points are on the original centerline. Simultaneously, several points are determined at the end of the original centerline in a preset connection order; these points are designated as the second points to be extended, also not on the original centerline. Then, the intervals between each of the first and second points to be extended can be determined. Further, based on the intervals between each of the first points to be extended, each point can be deployed in a direction opposite to the preset connection order, with the beginning of the original centerline as the end point and the point furthest from the beginning as the starting point, connecting them from the starting point to the end point. Then, each second point to be extended can be deployed according to a preset connection order based on the interval between each second point to be extended, taking the end point of the original centerline as the starting point and the point farthest from the end point among the second points to be extended as the ending point, and connecting them in the direction from the starting point to the ending point. Furthermore, the centerline after the beginning and end points are extended can be used as the extended centerline. For example, as shown... Figure 5 As shown, Figure 5 'a' represents the original centerline. Figure 5 b is the extended centerline. (After obtaining...) Figure 5 Given the original centerline shown in diagram a, extending the beginning and end of the original centerline by several control points will yield the desired result. Figure 5 The extended centerline shown in b.

[0094] It should be noted that the original centerline can be extended using a pre-deployed centerline extension algorithm or other centerline extension methods. This embodiment does not impose any specific limitations on this.

[0095] S240. Determine the surface reconstruction image to be processed based on the extended centerline.

[0096] In this embodiment, after obtaining the extended centerline, the surface reconstruction image to be processed can be determined based on the extended centerline.

[0097] Optionally, the surface reconstruction image to be processed is determined based on the extended centerline, including: extending the original surface reconstruction image based on the extended centerline to obtain the extended surface reconstruction image; performing length restoration processing on the extended centerline to make the restored centerline consistent with the length of the original centerline; setting the restored centerline to an editable state to obtain the centerline to be edited; and adding the centerline to be edited to the extended surface reconstruction image to obtain the surface reconstruction image to be processed.

[0098] In this embodiment, the extended surface reconstruction image can be obtained by extending the original surface reconstruction image. The image height of the extended surface reconstruction image is consistent with the length of the extended centerline. It should be noted that the extended surface reconstruction image does not include the centerline. The restored centerline can be a centerline with the same length as the original centerline. Generally, the extended centerline is obtained by extending the beginning and end of the original centerline by several points. Therefore, the number of points included in the restored centerline obtained after length restoration processing of the extended centerline is consistent with the number of points included in the original centerline.

[0099] In this embodiment, the editable state is the state that can be edited. It should be noted that the difference between the restored centerline and the centerline to be edited is that the restored centerline corresponds to a non-editable state in its state parameters, while the centerline to be edited corresponds to an editable state in its state parameters. Apart from this, all centerline parameters of the restored centerline and the centerline to be edited are identical.

[0100] It should be noted that when every point included in the centerline to be edited is an editable point, the number of editable points in the centerline to be edited is consistent with the number of control points included in the original centerline. Control points are key feature points used to generate the original centerline. Connecting each control point in a preset order yields the original centerline. However, after extending the original centerline, the coordinate values ​​of each control point in the original centerline will change. That is, if the coordinate value of the first endpoint of the original centerline is a first preset coordinate value, after extending the original centerline, the coordinate value of the first endpoint of the extended centerline will be the first preset coordinate value, and the coordinate values ​​of the endpoints following the first endpoint in the preset connection order will be updated sequentially. At this time, the coordinate value of the first endpoint of the original centerline will be updated to a second preset coordinate value based on the extension result. Afterwards, after length restoration processing of the extended coordinate values, the resulting restored centerline, or the centerline to be edited after adjusting the state parameters, will also have the coordinate value of the first endpoint of the centerline as the second preset coordinate value, while the coordinate values ​​of the other endpoints remain unchanged. Therefore, the coordinate values ​​of each editable point included in the centerline to be edited are different from the coordinate values ​​of each control point included in the original centerline.

[0101] In practical applications, after obtaining the extended centerline, the original surface reconstruction image can be extended according to the extended centerline using a pre-deployed surface reconstruction image generation algorithm. This results in an extended surface reconstruction image. Next, the extended centerline can be length-restored by deleting multiple first-to-extend points, multiple second-to-extend points, and the connections between these points. This yields a restored centerline. The state parameters of the restored centerline can then be set to an editable state, making it the centerline to be edited. The centerline to be edited can then be added to the extended surface reconstruction image based on its centerline data. This results in an editable surface reconstruction image. The centerline data for the centerline to be edited can include the number of editable points, the coordinates of each editable point in the image, the interval between adjacent editable points, and the connection order of the editable points.

[0102] S250. Display the surface reconstruction image to be processed, wherein the surface reconstruction image to be processed includes the centerline to be edited.

[0103] S260, Receive centerline editing information corresponding to the centerline to be edited.

[0104] S270. Determine the edited centerline based on the centerline editing information, and generate and display the target surface reconstruction image based on the edited centerline.

[0105] In practical applications, since the centerline data corresponding to the centerline to be edited is different from the centerline data corresponding to the original centerline, after editing the centerline to be edited and obtaining the centerline editing information, the centerline editing information can be synchronized to the original centerline so that the original centerline can be adjusted according to the centerline editing information.

[0106] Based on this, in addition to the above technical solutions, the method also includes: synchronizing the centerline editing information to the original centerline to update the centerline data corresponding to the original centerline, thereby obtaining the updated centerline data.

[0107] In this embodiment, the centerline data can be data characterizing the centerline attribute features. The centerline data may include multiple centerline attribute feature parameters, optionally including the number of points included on the centerline, the spatial coordinates corresponding to each point (the spatial coordinates can characterize the position of the corresponding point in the surface reconstruction image to be processed), the centerline length, and the editing status, etc.

[0108] In practical applications, after determining the edited centerline based on the centerline editing information, the original centerline can also be adjusted synchronously based on the centerline editing information to ensure that the editing operation corresponding to the adjusted centerline is consistent with the editing operation corresponding to the edited centerline.

[0109] Optionally, the centerline editing information is synchronized to the original centerline, including: determining the target editing point in the edited centerline that corresponds to the centerline editing information; and synchronizing the centerline editing information to the original centerline based on the index of the target editing point and the index of each control point in the original centerline.

[0110] In this embodiment, the target edit point can be an editable point corresponding to the centerline editing information. In practical applications, editing the centerline to be edited is usually achieved by editing the editable points included in the centerline. Therefore, the point in the centerline to be edited that is adjusted according to the centerline editing information can be used as the target edit point, and similarly, the editable point in the edited centerline obtained by executing the centerline editing information can also be used as the target edit point. The index of the target edit point can be understood as information representing the arrangement order of the target edit point among all the editable points included in the edited centerline. The index can be any form of information; optionally, it can be numbers, letters, or other characters that can represent order.

[0111] In practical applications, after obtaining the centerline to be edited, the target editing point in the edited centerline can be determined based on the centerline editing information. Then, the index of the target editing point and the index of each control point in the original centerline can be determined. Furthermore, based on the index of the target editing point and the index of each control point, the control point corresponding to the target editing point can be located within each control point. Thus, the centerline editing information can be synchronized to the original centerline. For example, as shown... Figure 6 As shown, Figure 6 'a' represents the center line to be edited. Figure 6 b represents the edited center line. Figure 6 c is the original centerline. Figure 6 d represents the updated centerline. The centerline to be edited can include four editable points, with indices P1, P2, P3, and P4. Centerline editing information can be obtained by extending editable point P1. Figure 6 The edited centerline is shown in b. P1 can be used as the index of the target edit point. The centerline to be edited is determined based on the original centerline; therefore, the index of each control point in the original centerline corresponds to the index of each editable point in the centerline to be edited. For example... Figure 6 As shown in c, the original centerline can include four control points, with indices P1, P2, P3, and P4. Synchronizing the centerline editing information to the original centerline—that is, extending P1 in the original centerline—results in the desired centerline. Figure 6 The centerline shown in d.

[0112] Furthermore, by synchronizing the centerline editing information to the original centerline, the center data corresponding to the original centerline can be updated based on the centerline editing information. Thus, updated centerline data can be obtained.

[0113] For example, Figure 7 This is a flowchart illustrating a centerline editing method provided in an embodiment of the present invention. Figure 7 As shown, this method may include the following steps: 1. Obtain the original centerline (i.e., the original centerline). Figure 3 1. The process involves: 1) retrieving the center line from the original center line; 2) extending the original center line to obtain the extended center line; 3) generating a CPR image using the extended center line; and 4) removing the extended points from the extended center line to obtain the center line to be edited (i.e., the center line itself). Figure 3 5. Draw the center line and editable points on the CPR image; 6. Move the editable points; 7. Modify the original center line synchronously; 8. Refresh the image and center line.

[0114] The technical solution of this invention, by displaying a surface reconstruction image to be processed, wherein the surface reconstruction image to be processed includes a centerline to be edited, further receiving centerline editing information corresponding to the centerline to be edited, and finally determining the edited centerline based on the centerline editing information, and generating and displaying a target surface reconstruction image based on the edited centerline, solves the problem in related technologies that the centerline in the surface reconstruction image cannot be edited, realizes the effect of personalized editing of the centerline in the surface reconstruction image, improves the editing flexibility of the centerline, and enhances the user experience.

[0115] Example 3

[0116] Figure 8 This is a schematic diagram of the structure of a centerline editing device provided in Embodiment 3 of the present invention. Figure 8 As shown, the device includes: an image display module 310, an editing information receiving module 320, and a target surface reconstruction image generation module 330.

[0117] The image display module 310 is used to display the surface reconstruction image to be processed, wherein the surface reconstruction image to be processed includes the centerline to be edited;

[0118] The editing information receiving module 320 is used to receive centerline editing information corresponding to the centerline to be edited;

[0119] The target surface reconstruction image generation module 330 is used to determine the edited centerline based on the centerline editing information, and generate and display the target surface reconstruction image based on the edited centerline.

[0120] The technical solution of this invention, by displaying a surface reconstruction image to be processed, wherein the surface reconstruction image to be processed includes a centerline to be edited, further receiving centerline editing information corresponding to the centerline to be edited, and finally determining the edited centerline based on the centerline editing information, and generating and displaying a target surface reconstruction image based on the edited centerline, solves the problem in related technologies that the centerline in the surface reconstruction image cannot be edited, realizes the effect of personalized editing of the centerline in the surface reconstruction image, improves the editing flexibility of the centerline, and enhances the user experience.

[0121] Optionally, the device further includes an image acquisition module and a centerline generation module.

[0122] An image acquisition module is used to acquire the original surface reconstruction image before displaying the surface reconstruction image to be processed;

[0123] The centerline generation module is used to generate the original centerline corresponding to the original surface reconstruction image.

[0124] Optionally, the device may further include a centerline extension module and an image determination module.

[0125] The centerline extension module is used to extend the original centerline to obtain the extended centerline;

[0126] An image determination module is used to determine the surface reconstruction image to be processed based on the extended centerline.

[0127] Optionally, the image determination module includes: an image extension unit, a centerline length restoration unit, a centerline state setting unit, and an image determination unit.

[0128] An image extension unit is used to extend the original surface reconstruction image according to the extended centerline to obtain an extended surface reconstruction image;

[0129] The centerline length restoration unit is used to restore the length of the extended centerline so that the restored centerline is consistent with the length of the original centerline.

[0130] A centerline state setting unit is used to set the restored centerline to an editable state to obtain the centerline to be edited;

[0131] An image determination unit is used to add the center line to be edited to the extended surface reconstruction image to obtain the surface reconstruction image to be processed.

[0132] Optionally, the number of editable points included in the editable centerline is consistent with the number of control points included in the original centerline, wherein the control points are key feature points used to generate the original centerline.

[0133] Optionally, the editing information receiving module 320 is specifically used to obtain centerline editing information corresponding to the editing operation when an editing operation is detected for the centerline to be edited, wherein the centerline editing information is generated based on the touch point trajectory and / or determined based on input parameters; the editing operation includes at least one of the following: an editable point addition operation, an editable point deletion operation, an editable point drag operation, and a parameter change operation.

[0134] Optionally, the device further includes: an original centerline update module.

[0135] The original centerline update module is used to synchronize the centerline editing information to the original centerline after the centerline is determined according to the centerline editing information, so as to update the centerline data corresponding to the original centerline and obtain the updated centerline data.

[0136] Optionally, the original centerline update module includes: a target edit point determination unit and a centerline editing information synchronization unit.

[0137] The target edit point determination unit is used to determine the target edit point in the edited center line that corresponds to the center line editing information.

[0138] The centerline editing information synchronization unit is used to synchronize the centerline editing information to the original centerline based on the index of the target editing point and the index of each control point in the original centerline.

[0139] Optionally, the target surface reconstruction image generation module 330 is specifically used to update the surface reconstruction image to be processed according to the edited centerline, and to display the updated surface reconstruction image as the target surface reconstruction image.

[0140] The centerline editing device provided in the embodiments of the present invention can execute the centerline editing method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the method.

[0141] Example 4

[0142] Figure 9 A schematic diagram of an electronic device 10 that can be used to implement embodiments of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0143] like Figure 9As shown, the electronic device 10 includes at least one processor 11 and a memory, such as a read-only memory (ROM) 12 or a random access memory (RAM) 13, communicatively connected to the at least one processor 11. The memory stores computer programs executable by the at least one processor. The processor 11 can perform various appropriate actions and processes based on the computer program stored in the ROM 12 or loaded from storage unit 18 into the RAM 13. The RAM 13 may also store various programs and data required for the operation of the electronic device 10. The processor 11, ROM 12, and RAM 13 are interconnected via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0144] Multiple components in electronic device 10 are connected to I / O interface 15, including: input unit 16, such as keyboard, mouse, etc.; output unit 17, such as various types of displays, speakers, etc.; storage unit 18, such as disk, optical disk, etc.; and communication unit 19, such as network card, modem, wireless transceiver, etc. Communication unit 19 allows electronic device 10 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0145] Processor 11 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 11 performs the various methods and processes described above, such as the centerline editing method.

[0146] In some embodiments, the centerline editing method may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or mounted on electronic device 10 via ROM 12 and / or communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the centerline editing method described above may be performed. Alternatively, in other embodiments, processor 11 may be configured to perform the centerline editing method by any other suitable means (e.g., by means of firmware).

[0147] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0148] Computer programs used to implement the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0149] In the context of this invention, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination thereof. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0150] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0151] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or computing systems that include middleware components (e.g., application servers), or computing systems that include frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0152] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system to address the shortcomings of traditional physical hosts and VPS services, such as high management difficulty and weak business scalability.

[0153] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.

[0154] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A centerline editing method, characterized in that, include: Display the surface reconstruction image to be processed, wherein the surface reconstruction image to be processed includes the centerline to be edited; Receive centerline editing information corresponding to the centerline to be edited; The edited centerline is determined based on the centerline editing information, and a target surface reconstruction image is generated and displayed based on the edited centerline. Before displaying the reconstructed image of the surface to be processed, the following is also included: Obtain the original surface reconstruction image; Generate the original centerline corresponding to the original surface reconstruction image; The original centerline is extended to obtain the extended centerline. The original surface reconstruction image is extended based on the extended centerline to obtain an extended surface reconstruction image, wherein the extended surface reconstruction image does not include the extended centerline. The extended centerline is length restored so that the restored centerline has the same length as the original centerline. Set the restored centerline to an editable state to obtain the centerline to be edited; The centerline to be edited is added to the extended surface reconstruction image to obtain the surface reconstruction image to be processed.

2. The method according to claim 1, characterized in that, The number of editable points included in the editable centerline is consistent with the number of control points included in the original centerline, wherein the control points are key feature points used to generate the original centerline.

3. The method according to claim 1, characterized in that, The receiving of centerline editing information corresponding to the centerline to be edited includes: Upon detecting an editing operation on the centerline to be edited, centerline editing information corresponding to the editing operation is obtained, wherein the centerline editing information is generated based on the touch point trajectory and / or determined based on input parameters; the editing operation includes at least one of an editable point addition operation, an editable point deletion operation, and an editable point drag operation.

4. The method according to claim 1, characterized in that, After determining the edited centerline based on the centerline editing information, the method further includes: The centerline editing information is synchronized to the original centerline to update the centerline data corresponding to the original centerline, resulting in updated centerline data.

5. The method according to claim 4, characterized in that, The step of synchronizing the centerline editing information to the original centerline includes: Determine the target edit point in the edited centerline that corresponds to the centerline editing information; Based on the index of the target edit point and the index of each control point in the original centerline, the centerline editing information is synchronized to the original centerline.

6. The method according to claim 1, characterized in that, The step of generating and displaying a target surface reconstruction image based on the edited centerline includes: The surface reconstruction image to be processed is updated based on the edited centerline, and the updated surface reconstruction image is used as the target surface reconstruction image and displayed.

7. A centerline editing device, characterized in that, include: An image display module is used to display the surface reconstruction image to be processed, wherein the surface reconstruction image to be processed includes the centerline to be edited; An editing information receiving module is used to receive centerline editing information corresponding to the centerline to be edited; The target surface reconstruction image generation module is used to determine the edited centerline based on the centerline editing information, and generate and display the target surface reconstruction image based on the edited centerline; The device further includes: an image acquisition module and a centerline generation module; The image acquisition module is used to acquire the original surface reconstruction image before displaying the surface reconstruction image to be processed; The centerline generation module is used to generate the original centerline corresponding to the original surface reconstruction image; The device also includes: a centerline extension module and an image determination module; The centerline extension module is used to extend the original centerline to obtain the extended centerline; The image determination module is used to determine the surface reconstruction image to be processed based on the extended centerline; The image determination module includes: an image extension unit, a centerline length restoration unit, a centerline state setting unit, and an image determination unit; The image extension unit is used to extend the original surface reconstruction image according to the extended center line to obtain an extended surface reconstruction image, wherein the extended surface reconstruction image does not include the extended center line. The centerline length restoration unit is used to perform length restoration processing on the extended centerline so that the restored centerline is consistent with the length of the original centerline. The centerline state setting unit is used to set the restored centerline to an editable state to obtain the centerline to be edited; The image determination unit is used to add the center line to be edited to the extended surface reconstruction image to obtain the surface reconstruction image to be processed.

Images