Image sketching method and device and storage medium

Abstract

The invention provides an image sketching method and device and a storage medium, and the method comprises the steps: carrying out the contour editing of a first image obtained from a server according to a preset sketching contour, and enabling the first image to comprise the preset sketching contour and an associated target region; obtaining a second image associated with the first image from the server, wherein the second image comprises a target area; and generating target sketching contour data based on contour editing of the user on the second image. By adopting the method, the response speed of the server can be improved when contour sketching is carried out on the medical image acquired from the server.

Description

Technical Field

[0001] This application belongs to the field of image processing technology, and in particular relates to an image delineation method, apparatus and storage medium. Background Technology

[0002] In the field of image processing, there is a need to delineate images and then make further plans based on those delineations.

[0003] As a non-limiting specific example, typically during radiotherapy, it is necessary to obtain and delineate the contour data of organs from the patient's medical records. This is then used to develop a subsequent radiotherapy plan for administration.

[0004] Currently, when acquiring and outlining organ contour data, electronic devices need to retrieve medical images and contour data from a server via a browser-server (B / S) architecture, which is then used by medical personnel to outline the organs in the browser. Specifically, for data security reasons, organ contour data is typically stored on an internal server. Therefore, when the browser retrieves all the medical images and contour data corresponding to an organ from the server, a single medical image frame may contain multiple contours to be outlined, and multiple frames are required during radiotherapy. Consequently, the browser needs to retrieve a large number of medical images and their corresponding contour data from the server.

[0005] However, when dealing with large volumes of medical images and contour data, the above methods are susceptible to network communication latency. Furthermore, network fluctuations or insufficient bandwidth can slow down response times, significantly impacting real-time drawing operations. Summary of the Invention

[0006] This application provides an image delineation method, apparatus, and storage medium, which can solve the problem of slow server response speed when delineating the outline of medical images obtained from the server in the prior art.

[0007] In a first aspect, embodiments of this application provide an image delineation method, the method comprising:

[0008] Based on the preset outline, the first image obtained from the server is subjected to outline editing. The first image includes the preset outline and the associated target area.

[0009] Retrieve a second image associated with the first image from the server; the second image includes the target region.

[0010] Based on the user's contour editing of the second image, target outline data is generated.

[0011] Secondly, embodiments of this application provide an image outlining device, the device comprising:

[0012] The first determining module is used to determine the contour editing of the first image obtained from the server according to the preset outline, the first image including the preset outline and the associated target area;

[0013] The first acquisition module is used to acquire a second image associated with the first image from the server, the second image including the target region;

[0014] The editing module is used to generate target outline data based on the user's outline editing operations on the second image.

[0015] Thirdly, embodiments of this application provide an image delineation method, the method comprising:

[0016] The first image is sent to an electronic device; the first image includes a preset outline and an associated target area; the electronic device is used to determine the outline editing of the first image obtained from the server based on the preset outline;

[0017] Send a second image associated with the first image, the second image including the target region; the second image is used by the user to perform contour editing operations and generate target outline data.

[0018] Fourthly, embodiments of this application provide an image outlining device, the device comprising:

[0019] A first sending module is used to send a first image to an electronic device; the first image includes a preset outline and an associated target area; the electronic device is used to determine the outline editing of the first image obtained from the server according to the preset outline;

[0020] The second sending module is used to send a second image associated with the first image, the second image including the target region; the second image is used by the user to perform contour editing operations and generate target outline data.

[0021] Fifthly, embodiments of this application provide an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the method as described in the first aspect above.

[0022] In a sixth aspect, embodiments of this application provide a server, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the method described in the third aspect above.

[0023] In a seventh aspect, embodiments of this application provide a computer-readable storage medium having instructions stored thereon, which, when executed by a processor, implement the methods described in the first or third aspect above.

[0024] Eighthly, embodiments of this application provide a computer program product that, when run on an electronic device, causes the electronic device to perform the method described in the first aspect.

[0025] Ninthly, embodiments of this application provide a computer program product that, when run on a server, causes the server to execute the method described in the third aspect.

[0026] The beneficial effects of this application embodiment compared to the prior art are as follows: When the first image is obtained from the server, it is possible to determine whether to perform contour editing and the corresponding target area when performing contour editing based on the preset outline associated with the target area in the first image. Then, when performing contour editing, a second image associated with the first image can be obtained from the server again. At this time, the second image may only include the target area. That is, it is not necessary to include the preset outline associated with the target area. Finally, target outline data can be generated based on the user's contour editing operation on the second image. Based on this, using the above method, during the data interaction between the electronic device and the server, only the corresponding first and second images need to be transmitted, not the three-dimensional contour data corresponding to all preset outlines. Furthermore, during the generation of target outline data, the electronic device does not need to acquire a large amount of contour data, thereby reducing the amount of data exchanged between the electronic device and the server. Thus, even in the event of network fluctuations or insufficient bandwidth, the server's response speed can be improved and the impact on contour operations with high real-time requirements can be reduced because the amount of data transmitted each time is small. Attached Figure Description

[0027] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0028] Figure 1 This is a flowchart illustrating the implementation of an image delineation method according to an embodiment of this application;

[0029] Figure 2 This is a schematic diagram illustrating an application scenario of the first image in an image delineation method provided in an embodiment of this application;

[0030] Figure 3This is a schematic diagram illustrating one implementation method of determining the outline to be edited in an image outlining method provided in an embodiment of this application;

[0031] Figure 4 This is a schematic diagram illustrating an application scenario of the second image in an image delineation method provided in an embodiment of this application;

[0032] Figure 5 This is a flowchart illustrating the implementation of an image delineation method according to another embodiment of this application;

[0033] Figure 6 This is a schematic diagram illustrating an application scenario of two-dimensional contour data in an image delineation method provided in an embodiment of this application;

[0034] Figure 7 This is a schematic diagram of the structure of an image outlining device provided in an embodiment of this application;

[0035] Figure 8 This is a schematic diagram of the structure of an electronic device provided in one embodiment of this application;

[0036] Figure 9 This is a flowchart illustrating the implementation of an image delineation method according to an embodiment of this application;

[0037] Figure 10 This illustration shows an interaction flowchart between an electronic device and a server in an image delineation method provided in an embodiment of this application;

[0038] Figure 11 This is a schematic diagram of the structure of an image outlining device provided in another embodiment of this application;

[0039] Figure 12 This is a schematic diagram of the structure of a server provided in one embodiment of this application;

[0040] Figure 13 This is a flowchart illustrating the implementation of a data transmission method according to an embodiment of this application;

[0041] Figure 14 This is a schematic diagram of the structure of a data transmission device according to an embodiment of this application;

[0042] Figure 15 This is a flowchart illustrating the implementation of a data transmission method according to another embodiment of this application;

[0043] Figure 16 This is a schematic diagram of a data transmission device provided in another embodiment of this application. Detailed Implementation

[0044] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limitation, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application may also be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods have been omitted so as not to obscure the description of this application with unnecessary detail.

[0045] It should be understood that, when used in this application specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or a collection thereof.

[0046] It should be noted that the information collection process (such as the facial image collection process, fingerprint information collection process, etc.) / feature extraction process involved in this application is carried out with the user's knowledge and permission. That is, the information collection process / feature extraction process complies with the requirements of laws and regulations and does not constitute an act that harms the public interest.

[0047] Furthermore, in the description of this application and the appended claims, the terms "first," "second," "third," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0048] The image delineation method provided in this application can be applied to electronic devices. For example, it can be used on electronic devices such as CT (Computed Tomography) devices, MR (Magnetic Resonance) devices, radiotherapy devices, tablet computers, laptop computers, ultra-mobile personal computers (UMPCs), and netbooks. This application does not limit the specific type of electronic device.

[0049] This application primarily illustrates the application of this image delineation method in the medical field; however, it is not limited thereto, and the image delineation method can also be applied to other fields such as industry. As an example, the image delineation method of this application can yield a delineated image for developing a plan for radiation delivery, which includes, but is not limited to, radiotherapy, radiation processing, etc.

[0050] It should be noted that, to facilitate contour editing by users, the aforementioned electronic device can be a device with a browser installed. This allows the electronic device to interact with the server via internet connectivity to complete contour editing. In another embodiment, the electronic device can also be a device with a pre-installed contour editing program. Thus, when running the contour editing program, the electronic device can also interact with the server to complete contour editing.

[0051] However, if the electronic device has a pre-installed outline editing program, the diverse operating systems available (e.g., Windows, Linux, iOS, etc.) mean that the developed outline editing program must also be adapted to each of these operating systems. This increases the difficulty of development, maintenance, and management.

[0052] Furthermore, installing the aforementioned contour editing program on electronic devices typically requires a significant amount of installation space. Therefore, for some low-performance or long-used electronic devices, this increases the workload and consequently reduces the efficiency of contour editing.

[0053] Therefore, this embodiment provides an image outlining method. This image outlining method can be based on a browser or a compatible browser and can be used on various network-connected electronic devices (e.g., devices with a browser installed), without requiring the additional development of outline editing programs adapted to multiple operating systems, thus reducing the difficulty of development, maintenance, and management. Furthermore, since at least some of the data storage and processing involved in the image outlining method of this embodiment can be completed via a server over a network, the browser does not require a large installation space, thus not increasing the workload of the electronic device and ensuring the efficiency of outline editing.

[0054] Please see Figure 1 , Figure 1 The following is a flowchart illustrating the implementation of an image delineation method according to an embodiment of this application. The method includes the following steps:

[0055] S101. Based on the preset outline, the first image obtained from the server is subjected to outline editing. The first image includes the preset outline and the associated target area.

[0056] In one embodiment, the server can be a device that stores image and contour data of the target area. The image can be the first image described above, or other images, such as images that do not include the preset outline; this is not limited. The preset outline can cover or surround part or all of the target area; however, it is not limited thereto, and the preset outline can also be associated with the target area in other ways. The target area can be determined based on the shooting field of view, user-defined criteria, automatic device segmentation, etc., without limitation. As an example, the target area can be a lesion, the area near the lesion, or part or all of another human body part. Furthermore, the target area can be the entire area of ​​the photographed human body part or organ, or a portion of the entire area; this is not limited. The preset outline can be automatically drawn by the device on the image, or it can be manually drawn; this is not limited.

[0057] In one embodiment, the first image can be a CT image, MR image, infrared image, ultraviolet image, ultrasound image, etc., and is not limited thereto. The first image can be obtained by cropping a delineated 3D image, by cropping the original 3D image and then delineating it, by selecting from a delineated image sequence, by selecting from the original image sequence for delineation, or by capturing an image separately and then delineating it; there are no limitations on this. The first image can include the entire area of ​​the captured human body part, and it can be pre-marked with one or more preset delineated outlines. A preset delineated outline can correspond to a part of the human body part or the entire area.

[0058] For example, refer to Figure 2 , Figure 2 This is a schematic diagram illustrating the application scenario of the first image in an image delineation method provided in an embodiment of this application. Figure 2 The first image in the image only includes a preset outline (see details). Figure 2 The gray outline in the image can be considered as a partial area of ​​a human body part. However, it is not limited to this; it is conceivable that the first image may also include multiple pre-defined outlines.

[0059] In this application, the term "editing" may include, but is not limited to, modification, adjustment, movement, redrawing, deletion, color adjustment, brightness adjustment, line thickness adjustment, etc.; the term "outline editing" may include, but is not limited to, modification, adjustment, movement, redrawing, deletion, etc., which are editing of the size, quantity and / or position of the outline, and may also include, but is not limited to, editing of the outline's appearance, such as color, brightness, line thickness, etc., without limitation.

[0060] In one embodiment, in the first image, the electronic device can first determine the outline to be edited based on a preset outline, and then determine to edit the outline of the outline to be edited.

[0061] The outline to be edited can be one or more preset outlines. For example, when the first image includes only one preset outline, the electronic device can directly determine that preset outline as the outline to be edited.

[0062] However, when the first image includes multiple preset outlines, the electronic device can determine the outline to be edited based on the user's selection operation on the corresponding preset outline among one or more preset outlines.

[0063] The selection operations include, but are not limited to, clicking, selecting by box, and checking, and are not limited in this regard. It should be noted that when selecting multiple corresponding preset outlines, all of the selected corresponding preset outlines can be considered as outlines to be edited.

[0064] It should be added that after determining the outline to be edited, the electronic device can consider the outline to be the one that the user needs to redraw. Therefore, the electronic device can enter outline editing mode to determine the outline to be edited.

[0065] For example, when a user's outline editing command is detected, the electronic device can determine to edit the outline. As an example, the user's outline editing command can be generated automatically or manually by the user. As a non-limiting example, for instance, the outline editing command might be issued automatically immediately after the user selects one or more preset outlines as the outline to be edited using a mouse or touch, or it might be issued only after the user selects the outline and manually clicks the "Edit" button on the user interface or presses a specific key.

[0066] However, in real-world scenarios, the outlines of the preset outlines included in the first image may not be clear, or the outlines of multiple preset outlines may intersect, making it difficult for users to intuitively understand the preset outlines and the target areas they cover. Consequently, users may find it difficult to determine whether they need to edit the selected outline.

[0067] Therefore, in order to enable users to intuitively understand the preset outline and the corresponding target area it covers, and to determine whether the outline to be edited needs to be edited, the electronic device can also, in the first image, after determining the outline to be edited based on the preset outline, perform the following... Figure 3Steps S301-S303, as shown, assist the user in determining the outline to be drawn that ultimately requires contour editing. Details are as follows:

[0068] S301. Send a first data request to the server. The first data request includes the identifier corresponding to the outline to be edited.

[0069] In one embodiment, the aforementioned identifier can be a number, a letter, or a combination of both, and there is no limitation thereto. It should be noted that the aforementioned identifier should be unique so that the server can distinguish the selected outline to be edited.

[0070] Understandably, after receiving the first data request, the server should respond to the first data request in order to send the third image to the electronic device.

[0071] S302. Obtain a third image sent by the server, the third image including a highlighted outline to be edited.

[0072] In one embodiment, as described in S301 above, the server can distinguish the selected outline to be edited. Therefore, when sending the third image, the server can highlight the selected outline to be edited in the third image (e.g., highlight, flash, invert, overlay shadow, etc.) to help the user observe the outline to be edited.

[0073] In one embodiment, when the above-mentioned highlighting is a high-brightness display, the server can adjust the outline to be edited using a preset hue brightness to make it stand out in the electronic device. The preset hue brightness can be set according to actual conditions and is not limited thereto. It should be noted that the preset hue brightness is at least greater than the hue brightness of the preset outline that was not selected in the third image.

[0074] In another embodiment, when there are multiple outlines to be edited, the third image sent by the server can include not only the highlighted outlines, but also different colors used to display the multiple outlines. Furthermore, even when the outlines of multiple outlines intersect extensively, it can help the user visually observe each outline and its associated target area.

[0075] S303. Determine the final outline to be edited based on the third image.

[0076] In one embodiment, because the user-selected outlines to be drawn are highlighted in the third image, the user can carefully observe the target area covered by each outline to be edited. At this time, the electronic device can again determine the final outline to be edited based on the user's selection or cancellation operation.

[0077] For example, when a user cancels any outline to be drawn, it can be assumed that the outline does not need to be edited. Therefore, the canceled outline can be redefined as a preset outline that was not selected. Conversely, when no user cancel is detected, the outline to be drawn can be considered the final outline to be edited.

[0078] Based on this, when the electronic device detects a user's outline editing command for the outline to be edited, it can determine that the final outline to be edited is the outline that needs to be edited. Then, the electronic device can enter outline editing mode.

[0079] S102. Obtain a second image associated with the first image from the server. The second image includes the target region.

[0080] In one embodiment, the server is a server that stores the second image. The number of servers can be one or more. When there is only one server, it can be assumed that the server stores not only the first image but also the second image associated with the first image.

[0081] The association between the first image and the second image can be pre-configured on the server, and there are no restrictions on this.

[0082] In one embodiment, the second image can also be an image that includes the target region. However, the difference from the first image is that the second image may not include the outline corresponding to the outline to be edited. For example, refer to... Figure 4 , Figure 4 This is a schematic diagram illustrating an application scenario of a second image in an image delineation method provided in an embodiment of this application. Wherein, Figure 4 and Figure 2 The comparison shows that, Figure 2 The first image includes an image of the organ and its surrounding area covered by the field of view corresponding to the target region, as well as a preset outline associated with the target region (which can be considered as the outline to be edited). However, Figure 4 The second image only includes the organ image corresponding to the target region, but does not include the outline to be edited associated with the target region. At this point, the electronic device can subsequently perform outline editing on the second image to generate the corresponding target outline data.

[0083] In the second image, since the outline to be edited is not displayed, the user can avoid confusing the outline corresponding to the target outline data with the outline of the outline to be edited. This allows the user to draw a target outline data that better meets their needs.

[0084] In another embodiment, the second image may also be a first image or a processed first image (e.g., a highlighted first image, an image obtained by cropping a portion of the first image containing the target region, etc.), that is, it contains the outline to be edited. In this case, the electronic device can subsequently perform outline drawing operations directly on the first image or the processed first image to generate corresponding target outline data. When performing outline drawing operations on the first image or the processed first image, the user can use the original outline to be edited as a reference to quickly determine the required outline during outline editing, thereby improving the efficiency of generating target outline data. Alternatively, the user can directly modify and adjust the original outline to be edited, which also improves the efficiency of generating target outline data.

[0085] In another embodiment, when the second image is the processed first image described above, it can also be an image containing the original preset outlines or outlines to be edited. In this case, the preset outlines or outlines to be edited in the second image can be displayed in one or more ways, such as preset line segment type, preset display brightness, or preset color, without limitation.

[0086] The aforementioned preset line segment categories can be dashed lines or discontinuous lines drawn with dots. The preset display brightness and preset color can be set according to actual conditions and are not limited thereto. However, it should be noted that in the second image, the preset line segment category, preset display brightness, or preset color corresponding to each preset outline or the outline to be edited should be different from the line segment category, display brightness, and display color of the outline corresponding to the target outline data, so that users can intuitively determine the outline corresponding to the target outline data. In this embodiment, the preset line segment category, preset display brightness, or preset color is not limited.

[0087] For example, when the factor line segment category is dashed, the outline corresponding to the target outline data can be a solid line; and when the preset display brightness is low, the outline corresponding to the target outline data can be high brightness. Also, when the preset color can be blue, the outline corresponding to the target outline data is red.

[0088] Based on this, when a user performs contour drawing operations in the second image, the user can not only use the original outline to be edited as a reference, but also the target outline data generated by contour editing in the second image can be distinguished from the original preset outlines or outlines to be edited, without interfering with the contour editing process.

[0089] Furthermore, in another embodiment, when the second image is an image that does not include the outlines corresponding to the preset outlines or the outlines to be edited, the electronic device can also perform a split-screen operation on the display window, dividing it into a first window and a second window. At this time, the first image can be displayed in the first window, and the second image can be displayed in the second window. Based on this, when the user edits the outline of the second image in the second window, they can not only use the original outline to be edited as a reference, but will also not be confused by the original preset outlines or the outlines to be edited. Therefore, it will not interfere with the outline editing process.

[0090] Based on the above explanation, it can be considered that the preset outline is not only used by the user to determine the outline to be edited from the first image, but also as a reference for the user when editing the outline of the second image, so that the user can quickly determine the outline that meets the requirements when editing the outline.

[0091] S103. Based on the user's contour editing of the second image, generate target outline data.

[0092] In one embodiment, based on the explanation of the second image in S102 above, it can be understood that the electronic device can generate corresponding target outline data based on the user's outline editing of the second image.

[0093] For example, the target area corresponding to the outline to be edited must contain at least a portion that is of interest to the user. Therefore, the selected outline to be edited can be considered an object that the user intends to edit. Based on this, it can be assumed that the generated target outline data usually corresponds to the outline to be edited.

[0094] For example, in the second image, the area enclosed or covered by the contour line corresponding to the target outline data must have at least a portion that is identical to the target area corresponding to the outline to be edited. Alternatively, the area enclosed or covered by the contour line corresponding to the target outline data in the second image may completely include the target area corresponding to the outline to be edited. Or, the target area corresponding to the outline to be edited may completely enclose or cover the area covered by the contour line corresponding to the target outline data in the second image; there is no limitation on this.

[0095] In one embodiment, when the electronic device is a computer, the target outline data can be determined based on the mouse's operating state. For example, the electronic device can monitor the mouse's movement position and direction, and when a mouse click is detected, use the coordinates of the clicked position as a coordinate point on the outline. Then, when another mouse click is detected, the corresponding coordinate point is determined, and the previous coordinate point is connected to this current coordinate point. This process is repeated until the coordinates of the last mouse click are the same as the coordinates of the first mouse click. Finally, the outline formed by connecting these coordinates sequentially is determined as the target outline. At this point, the position coordinates of the outline corresponding to the target outline in the second image are the aforementioned target outline data.

[0096] During outline editing, the mouse can be used to perform one or more auxiliary editing functions such as deletion and modification, which will not be described in detail.

[0097] In the field of radiation delivery, once the target outline data is determined, it can be used to determine the radiation delivery plan for the outlined area and / or its vicinity, thereby achieving precise and effective radiation delivery and avoiding excessive radiation dose.

[0098] It should be noted that the above contour editing is only one example. When the electronic device is another device, such as a tablet or mobile phone, the electronic device can generate target outline data by detecting the user's touch position. In this embodiment, the method of contour editing performed by the user and the method of generating target outline data are not limited.

[0099] In this embodiment, when the first image is obtained from the server, it can be determined whether to perform contour editing and the corresponding target area when performing contour editing based on the preset outline associated with the target area in the first image. Then, when performing contour editing, a second image associated with the first image can be obtained from the server again. This second image may only include the target area. That is, it may not need to include the preset outline associated with the target area. The second image can be obtained by cropping a 3D image, by selecting and outlining from an original image sequence, or by taking a separate photograph; there are no limitations on this. Finally, target outline data can be generated based on the user's contour editing operation on the second image. Optionally, the electronic device can send the second image and the target outline data to the server together. In this case, the second image and the target outline data can be combined and sent to the server, or they can be sent independently; there are no limitations here.

[0100] Based on this, using the above method, during the data interaction between the electronic device and the server, only the corresponding first and second images need to be transmitted, rather than all the contour data corresponding to the preset contours (e.g., 3D contour data, such as closed surfaces or geometric shapes enclosing the 3D volume of interest) and related image data (e.g., 3D image data, such as 3D images covering the 3D volume corresponding to the target region). Furthermore, during the generation of the target contour data, the electronic device does not need to acquire a large amount of contour data and / or data related to the contouring process and communicate with the server, thus reducing the amount of data exchanged between the electronic device and the server. Therefore, even in the event of network fluctuations or insufficient bandwidth, the smaller amount of data transmitted each time can improve the server's response speed and reduce the impact on contouring operations with high real-time requirements.

[0101] In another embodiment, after obtaining the target outline data, the electronic device can also send the target outline data to the server, so that the server can convert the target outline data into second three-dimensional outline data for storage.

[0102] The server can pre-store a preset mapping relationship between the window coordinate system corresponding to the display window of the electronic device and the three-dimensional coordinate system corresponding to the target area, so as to convert the target outline data.

[0103] In one embodiment, the aforementioned window coordinate system can be preset according to the pixel size of the window display screen, and the three-dimensional coordinate system corresponding to the target area can be preset by the staff when acquiring the first image, and the preset mapping relationship between the window coordinate system and the three-dimensional coordinate system can be determined. This will not be described in detail.

[0104] It should be noted that, based on the above explanation of the first and second images, when the user directly edits the outline of the second image, the outline corresponding to the final generated target outline data will be located on the second image.

[0105] However, as an example, in some cases, when a user edits a contour, only the coordinates of the mouse click position can be recorded; the specific coordinates of the contour line between the two coordinates in the second image cannot be directly obtained. For instance, when the contour line between the two coordinates is an irregular arc, its specific coordinates cannot be directly determined. Therefore, electronic devices cannot send detailed target contour data to the server. Consequently, this results in certain defects in the server's conversion of the target contour data into two-dimensional contour data.

[0106] Furthermore, if the second image after contour editing is directly sent to the server, it will not only increase the amount of data exchanged, but the server will also need to sequentially identify, extract, and convert the contour lines corresponding to the target outline data in the second image to obtain the corresponding second 3D contour data. Therefore, it can also be considered that generating target outline data based on the user's direct contour editing of the second image has certain flaws.

[0107] Therefore, in order to better generate the aforementioned target outline data, the electronic device can, according to, such as Figure 5 Steps S501-S503, as shown, generate the target outline data. Details are as follows:

[0108] S501. Send a second data request to the server. The second data request is used to request the server to send back the first three-dimensional outline data corresponding to the outline to be edited.

[0109] In one embodiment, after the server receives the second data request, it can send the first three-dimensional outline data corresponding to the outline to be edited back to the electronic device.

[0110] It should be noted that the second data retrieval request may also include the corresponding identifier of the outline to be edited, so that the server can make a determination.

[0111] In another embodiment, after the electronic device has completed the above steps S301-S303, the electronic device can send a second data request containing the identifier corresponding to the final outline to be edited to the server in order to obtain the first three-dimensional outline data.

[0112] S502. Based on the preset mapping relationship between the window coordinate system corresponding to the display window and the three-dimensional coordinate system corresponding to the target area, the first three-dimensional outline data is converted into two-dimensional outline data and displayed in the display window.

[0113] S503. Generate target outline data based on the user's outline editing of the displayed two-dimensional outline data.

[0114] In one embodiment, the aforementioned preset mapping relationship has already been explained above and will not be repeated here. It should be noted that although the converted 2D outline data can be displayed in the display window, it will be independent of the second image. That is, although the converted 2D outline data and the second image will be displayed simultaneously in the display window, the 2D outline data and the second image will be displayed on different layers.

[0115] For example, an electronic device can generate a transparent interface to shield the second image and display the converted two-dimensional contour data on the transparent interface.

[0116] Based on this, when a user edits the displayed 2D outline data, the generated target outline data can be located on a transparent interface, independent of the second image. Furthermore, since the interface is transparent, the user can intuitively understand how the final target outline data will be displayed in the second image while editing the 2D outline data, achieving a WYSIWYG (What You See Is What You Get) effect. That is, the display of the target outline data in the second image during outline editing is consistent with its display after the outline editing is completed.

[0117] For example, refer to Figure 6 , Figure 6 This is a schematic diagram illustrating an application scenario of two-dimensional contour data in an image delineation method provided in an embodiment of this application. Based on Figure 6 It can be seen that the shape size corresponding to the converted 2D outline data is... Figure 2 The first image contains preset outlines (i.e., the selected outlines to be edited) with the same shape and size.

[0118] In another embodiment, after performing step S101 above—determining to edit the contour of the first image obtained from the server based on the preset outline—the electronic device may first send a second data request to the server. Then, the server simultaneously sends the second image and the corresponding first three-dimensional outline data to the electronic device. That is, after performing the step of determining to edit the outline when a user's outline editing instruction is detected, the electronic device can execute step S501 above. At this time, the second data request can be used not only to request the server to send back the first three-dimensional outline data corresponding to the outline to be edited to the electronic device, but also to request the server to send the second image to the electronic device; there is no limitation on this.

[0119] Please see Figure 7 , Figure 7 This is a structural block diagram of an image outlining device provided in an embodiment of this application. The modules included in the image outlining device in this embodiment are used to perform... Figure 1 , Figure 3 as well as Figure 5 The steps in the corresponding embodiments. Please refer to the details. Figure 1 , Figure 3 as well as Figure 5 as well as Figure 1 , Figure 3 as well as Figure 5 The relevant descriptions in the corresponding embodiments are shown below. For ease of explanation, only the parts relevant to this embodiment are shown. See also... Figure 7The image outlining device 700 may include: a first determining module 710, a first acquiring module 720, and an editing module 730, wherein:

[0120] The first determining module 710 is used to determine the contour editing of the first image obtained from the server according to the preset outline, the first image including the preset outline and the associated target area.

[0121] The first acquisition module 720 is used to acquire a second image associated with the first image from the server, the second image including the target area.

[0122] The editing module 730 is used to generate target outline data based on the user's outline editing operations on the second image.

[0123] In one embodiment, the first determining module 710 is further configured to:

[0124] In the first image, the outline to be edited is determined based on the preset outline; the outline to be edited is then determined to be edited.

[0125] In one embodiment, the first determining module 710 is further configured to:

[0126] The outline to be edited is determined based on the user's selection of the corresponding preset outline from one or more preset outlines.

[0127] In one embodiment, the image outlining device 700 further includes:

[0128] The third sending module is used to send a first data request to the server. The first data request includes the identifier corresponding to the outline to be edited.

[0129] The second acquisition module is used to acquire a third image sent by the server, the third image including a highlighted outline to be edited.

[0130] The second determining module is used to determine the final outline to be edited based on the third image.

[0131] In one embodiment, the first determining module 710 is further configured to:

[0132] When a user's outline editing instruction is detected, it is determined that the outline to be edited will be edited.

[0133] In one embodiment, the image outlining device 700 further includes:

[0134] The fourth sending module is used to send a second data request to the server. The second data request is used to request the server to send back the first three-dimensional outline data corresponding to the outline to be edited.

[0135] The conversion module is used to convert the first three-dimensional outline data into two-dimensional outline data according to the preset mapping relationship between the window coordinate system corresponding to the display window and the three-dimensional coordinate system corresponding to the target area, and then display it in the display window.

[0136] Editing module 730 is also used for:

[0137] Based on the user's editing of the displayed two-dimensional outline data, the target outline data is generated.

[0138] When it is understood that, Figure 7 The structural block diagram of the image drawing device shown illustrates how each module performs [the necessary operations]. Figure 1 , Figure 3 as well as Figure 5 The steps in the corresponding embodiments, and for Figure 1 , Figure 3 as well as Figure 5 The steps in the corresponding embodiments have been explained in detail in the above embodiments. Please refer to them for details. Figure 1 , Figure 3 as well as Figure 5 as well as Figure 1 , Figure 3 as well as Figure 5 The relevant descriptions in the corresponding embodiments will not be repeated here.

[0139] Figure 8 This is a structural block diagram of an electronic device provided in one embodiment of this application. Figure 8 As shown, the electronic device 800 of this embodiment includes: a processor 810, a memory 820, and a computer program 830 stored in the memory 820 and executable on the processor 810, such as a program for an image outlining method. When the processor 810 executes the computer program 830, it implements the steps of each embodiment of the above-described image outlining method, for example... Figure 1 S101 to S103 are shown. Alternatively, the processor 810 implements the above when executing the computer program 830. Figure 7 The functions of each module in the corresponding embodiments, for example, Figure 7 For details on the functions of each module shown, please refer to [link / reference]. Figure 7 The relevant descriptions in the corresponding embodiments.

[0140] For example, the computer program 830 can be divided into one or more modules, one or more of which are stored in the memory 820 and executed by the processor 810 to implement the image outlining method provided in the embodiments of this application. One or more modules can be a series of computer program instruction segments capable of performing specific functions, which describe the execution process of the computer program 830 in the electronic device 800. For example, the computer program 830 can implement the image outlining method provided in the embodiments of this application.

[0141] Electronic device 800 may include, but is not limited to, processor 810 and memory 820. Those skilled in the art will understand that... Figure 8 This is merely an example of electronic device 800 and does not constitute a limitation on electronic device 800. It may include more or fewer components than shown, or combine certain components, or different components. For example, electronic device may also include input / output devices, network access devices, buses, etc.

[0142] The processor 810 may be a central processing unit, or it may be other general-purpose processors, digital signal processors, application-specific integrated circuits, off-the-shelf programmable gate arrays or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc.

[0143] In another embodiment, the image delineation method described above can also be applied to a server. The server is a specific IT device that provides computing power and runs software applications in a network environment, and can provide computing or application services to the aforementioned electronic devices within the network. For example, it can provide services that respond to a first data request, a second data request, and send a first image, a second image, a third image, and first three-dimensional delineation contour data; this is not limited.

[0144] Specifically, refer to Figure 9 , Figure 9 The following is a flowchart illustrating an image delineation method according to another embodiment of this application. The method includes the following steps:

[0145] S901, The first image is sent to the electronic device; the first image includes a preset outline and an associated target area; the electronic device is used to determine the outline editing of the first image obtained from the server according to the preset outline.

[0146] S902, Send a second image associated with the first image, the second image including the target area; the second image is used by the user to perform contour editing operations and generate target outline data.

[0147] In one embodiment, the first image, the preset outline, the target area, the second image, and the target outline data have already been explained in the above steps S101-S103, and will not be described again.

[0148] It should be noted that the server can not only execute steps S901-S902 as described above, but also steps S101-S103 and other steps in the embodiments of steps S501-S503. For example, sending the third image and the first three-dimensional outline data corresponding to the outline to be edited to the electronic device, etc. For details, please refer to the examples in each step S101-S103 and S501-S503, etc., and will not be described again.

[0149] It should be noted that in this embodiment, after the server sends the first image to the electronic device, the user can operate on the first image through the first electronic device to determine whether to perform contour editing and the corresponding target area when performing contour editing. Then, when performing contour editing, the server can send a second image associated with the first image again. At this time, the second image may only include the target area. That is, it may not need to include the preset outline associated with the target area, allowing the electronic device to generate target outline data based on the user's contour editing operation on the second image. Based on this, using the above method, during the data interaction between the electronic device and the server, only the corresponding first and second images need to be transmitted, not the three-dimensional contour data corresponding to all preset outlines. Furthermore, during the generation of target outline data, the server does not need to send a large amount of contour data, reducing the amount of data exchanged between the electronic device and the server. Therefore, even in the event of network fluctuations or insufficient bandwidth, the server's response speed can be improved and the impact on contour operations with high real-time requirements can be reduced because the amount of data transmitted each time is small.

[0150] Reference Figure 10 , Figure 10 This illustration shows an interaction flowchart between an electronic device and a server in an image outlining method according to an embodiment of this application. After the server sends a first image to the electronic device, the electronic device can determine the outline to be edited based on the user's selection operation on one or more preset outlines. Then, it sends a first data request containing an identifier of the outline to be edited to the server.

[0151] The server can determine the outline to be edited based on the first data request, and send a third image containing the highlighted outline to the electronic device to assist the user in determining the final outline to be edited.

[0152] The electronic device can display a third image and determine the final outline to be edited based on the user's cancellation operation. Then, when a user's outline editing instruction is detected, it is determined that outline editing is required. At this point, the electronic device can enter outline editing mode and send a second data request to the server.

[0153] Upon receiving the second data request, the server can send the first 3D outline data corresponding to the outline to be edited, as well as the second image, to the electronic device.

[0154] The electronic device can convert the first three-dimensional outline data into two-dimensional outline data based on a preset mapping relationship between the window coordinate system corresponding to the electronic device's display window and the three-dimensional coordinate system corresponding to the target area, and then display it in the display window. Finally, based on the user's outline editing of the displayed two-dimensional outline data, the target outline data is generated and sent to the server.

[0155] The server can convert the target outline data back into second-dimensional outline data for storage.

[0156] Please see Figure 11 , Figure 11 This is a structural block diagram of an image outlining device according to another embodiment of this application. In this embodiment, the image outlining device includes modules for performing... Figure 9 and Figure 10 The steps in the corresponding embodiments. Please refer to the details. Figure 9 and Figure 10 ,as well as Figure 9 and Figure 10 The relevant descriptions in the corresponding embodiments are shown below. For ease of explanation, only the parts relevant to this embodiment are shown. See also... Figure 11 The image outlining device 1100 may include: a first transmitting module 1110 and a second transmitting module 1120, wherein:

[0157] The first sending module 1110 is used to send a first image to an electronic device; the first image includes a preset outline and an associated target area; the electronic device is used to determine the outline editing of the first image obtained from the server according to the preset outline.

[0158] The second sending module 1120 is used to send a second image associated with the first image, the second image including the target area; the second image is used by the user to perform contour editing operations to generate target outline data.

[0159] When it is understood that, Figure 11 The structural block diagram of the image drawing device shown illustrates how each module performs [the necessary operations]. Figure 9 and Figure 10The steps in the corresponding embodiments, and for Figure 9 and Figure 10 The steps in the corresponding embodiments have been explained in detail in the above embodiments. Please refer to them for details. Figure 9 and Figure 10 as well as Figure 9 and Figure 10 The relevant descriptions in the corresponding embodiments will not be repeated here.

[0160] Figure 12 This is a structural block diagram of a server provided in one embodiment of this application. For example... Figure 12 As shown, the server 1200 of this embodiment includes: a processor 1210, a memory 1220, and a computer program 1230 stored in the memory 1220 and executable on the processor 1210, such as a program for an image outlining method. When the processor 1210 executes the computer program 1230, it implements the steps of each embodiment of the image outlining method described above, for example... Figure 9 S901 to S902 are shown. Alternatively, the processor 1210 implements the above when executing computer program 1230. Figure 11 The functions of each module in the corresponding embodiments, for example, Figure 11 For details on the functions of each module shown, please refer to [link / reference]. Figure 11 The relevant descriptions in the corresponding embodiments.

[0161] For example, the computer program 1230 can be divided into one or more modules, one or more of which are stored in the memory 1220 and executed by the processor 1210 to implement the image outlining method provided in the embodiments of this application. One or more modules can be a series of computer program instruction segments capable of performing specific functions, which describe the execution process of the computer program 1230 in the server 1200. For example, the computer program 1230 can implement the image outlining method provided in the embodiments of this application.

[0162] Server 1200 may include, but is not limited to, processor 1210 and memory 1220. Those skilled in the art will understand that... Figure 12 This is merely an example of server 1200 and does not constitute a limitation on server 1200. It may include more or fewer components than shown, or combine certain components, or different components. For example, the server may also include input / output devices, network access devices, buses, etc.

[0163] The processor 1210 may be a central processing unit, or it may be other general-purpose processors, digital signal processors, application-specific integrated circuits, off-the-shelf programmable gate arrays or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc.

[0164] The memory 1220 can be an internal storage unit of the server 1200, such as the hard disk or memory of the server 1200. The memory 1220 can also be an external storage device of the server 1200, such as a plug-in hard disk, smart memory card, flash memory card, etc. equipped on the server 1200. Furthermore, the memory 1220 can include both internal storage units and external storage devices of the server 1200.

[0165] This application provides a computer-readable storage medium storing instructions that, when executed by a processor, implement the image drawing methods described in the various embodiments above.

[0166] The above examples illustrate multiple embodiments of a method for users to complete image drawing by transmitting data between an electronic device and a server. However, it's important to note that while these methods can ensure a stable server response even under network fluctuations or insufficient bandwidth, reducing the impact on real-time drawing operations, further stability in data transmission between the electronic device and the server can be achieved by controlling the data transmission method. Specifically, the data transmission methods described in the following embodiments can be used to control the data transmission between the electronic device and the server, increasing the rate at which the server transmits data to or retrieves data from the electronic device (i.e., increasing the rate at which the electronic device retrieves data from or sends data to the server). This further reduces the impact on real-time drawing operations.

[0167] Please see Figure 13 , Figure 13 The following is a flowchart illustrating the implementation of a data transmission method according to an embodiment of this application. The method includes the following steps:

[0168] S1301. After the communication connection with the server is established, determine the target compression strategy when the server sends the data to be transmitted; the target compression strategy is used by the server to compress the data to be transmitted next time.

[0169] In one embodiment, the above method can be applied to Figure 1 The electronic devices and servers in the corresponding embodiments have been described above. Figure 1The corresponding embodiments will be explained, and will not be described further.

[0170] It is understood that when data to be transmitted needs to be obtained from the server, a communication connection should first be established with the server. The data to be transmitted includes, but is not limited to, image data such as the first image, second image, and third image described in the above embodiments, and may also include non-image data such as first three-dimensional outline data, without limitation. Furthermore, the next data to be transmitted by the server can be determined by the server based on the transmission request received from the electronic device.

[0171] In one embodiment, the method of establishing a communication connection includes, but is not limited to, HTTP (Hypertext Transfer Protocol), TCP (Transmission Control Protocol), and WebRTC (Web Real-Time Communication), etc., and there is no limitation thereto.

[0172] For example, a WebRTC service can be deployed on the server, and relevant parameters can be configured. These parameters include, for instance, the port number and encryption protocol. Based on these server-configured parameters, electronic devices can establish a WebRTC peer-to-peer connection between the browser and the server. Furthermore, this allows electronic devices to communicate with the server only for data purposes without going through intermediate nodes, reducing data transmission latency.

[0173] For example, a server can be configured with multiple ports and corresponding encryption protocols for each port. Browsers on electronic devices can directly transmit data with the server based on the port number and encryption protocol, without the need for network node forwarding. WebRTC also provides a wealth of network optimization techniques, such as adaptive bit rate control and packet loss mitigation algorithms, which can effectively ensure the stability of data transmission in weak network environments.

[0174] In one embodiment, the target compression strategy can be either a lossless compression strategy or a lossy compression strategy. A lossless compression strategy ensures that the data obtained after decompression of the compressed data to be transmitted is completely identical to the data before compression. Conversely, a lossy compression strategy ensures that the data obtained after decompression of the compressed data to be transmitted will be missing some information compared to the data before compression.

[0175] For example, lossless compression strategies include, but are not limited to, using compression strategies such as WinRAR and WinZip. Lossy compression strategies can be mp3, divX, Xvid, jpeg, rm, rmvb, wma, wmv, etc., and are not limited thereto.

[0176] Understandably, because lossy compression reduces the amount of information in the data to be transmitted, although the data quality sent to the electronic device will decrease, the transmission rate can be increased. Conversely, because lossless compression keeps the amount of information in the data to be transmitted unchanged, although the transmission rate is lower, the data quality sent to the electronic device can be guaranteed to be higher.

[0177] As an example, an electronic device can determine a target compression strategy from multiple preset compression strategies based on the user's selected operation.

[0178] In one embodiment, the aforementioned plurality of preset strategies may include one or more strategies corresponding to the lossless strategies, and also include one or more strategies corresponding to the lossy strategies. The selection operation includes, but is not limited to, clicking, checking, etc.

[0179] Understandably, since the target compression strategy is determined based on the user's selection, it can be considered that the target compression strategy reflects the user's choice regarding the real-time nature or accuracy (data quality) of the transmitted data. Therefore, when the server compresses the data to be transmitted based on the target compression strategy before sending it, it can meet the user's needs and improve the user experience.

[0180] In another embodiment, the server itself can also determine the target compression strategy based on the second network quality at the current moment. For example, when the server detects that the second network quality at the current moment is a first preset quality (e.g., low quality), it can be considered that the network transmission quality is poor. Therefore, a lossy compression strategy can be used as the target compression strategy. This ensures the real-time performance of the data to be transmitted. Conversely, when the second network quality is a second preset quality (e.g., high quality), it can be considered that the network transmission quality is good. Therefore, a lossless compression strategy can be used as the target compression strategy. This improves the data quality of the data to be transmitted while ensuring its real-time performance.

[0181] The determination of the second network quality includes, but is not limited to, methods by which the server determines the quality based on one or more indicators such as the bandwidth between the server and the electronic device, the latency at the current moment, and the data transmission rate within a historical preset time period.

[0182] For example, latency is the time it takes for data to travel from one end of the network to the other. Therefore, when the latency is greater than a preset latency, the second network quality can be determined to be the first preset quality. Otherwise, when the latency is less than or equal to the preset latency, the second network quality can be determined to be the second preset quality. The latency can be set according to actual conditions and is not limited thereto. For example, the aforementioned latency can be 100ms.

[0183] S1302, Send target data to the server; the target data includes the target compression strategy and a transmission request for requesting the server to send the data to be transmitted to the electronic device.

[0184] In one embodiment, the target data includes a target compression strategy and a transmission request. The transmission request is used to request the server to send the data to be transmitted. At this time, the server can compress the data to be transmitted according to the target compression strategy.

[0185] As an example, taking lossy compression as the target compression strategy, when the transmitted data is medical image data (e.g., the first image, second image, and third image described in the above embodiments), lossy compression can be achieved by deleting certain color parts of the image edges in the medical image data.

[0186] It is understandable that in the medical field, the main information in medical image data lies in the central region of the image. Therefore, deleting certain colored portions at the edges of medical image data will not affect image quality. Thus, the aforementioned method can be used to achieve lossy compression.

[0187] The aforementioned transmission requests include, but are not limited to, the first data request and the second data request described in the above embodiments, and are not limited thereto.

[0188] In another embodiment, the target data may only include the data that the electronic device needs to transmit to the server. For example, it may be the target outline contour data obtained by the electronic device after contour editing is completed. In this case, the electronic device can send the target outline contour data to the server as the target data.

[0189] In one embodiment, the electronic device can send target data to the server according to a preset transmission rate. The preset transmission rate can be set according to actual conditions and is not limited thereto.

[0190] However, in actual data transmission, network congestion may occur when electronic devices send target data at a fixed preset transmission rate due to network fluctuations or insufficient bandwidth, resulting in the target data failing to be transmitted to the server.

[0191] Therefore, in order to reduce network congestion, electronic devices can first obtain the current network quality. Then, based on the first network quality, they determine the first target transmission rate for the target data and send the target data to the server according to the first target transmission rate.

[0192] In one embodiment, the electronic device determines the first network quality in a manner similar to that described above regarding the server's determination of the second network quality, and will not be further described therein.

[0193] As an example, an electronic device can determine a first preset transmission rate as a first target transmission rate when the first network quality is a first preset quality. And, when the first network quality is a second preset quality, it can determine a second preset transmission rate as the first target transmission rate. The second preset quality can be higher than the first preset quality, and the second preset transmission rate can be higher than the first preset transmission rate.

[0194] Understandably, when the first network quality is at the first preset quality, the network transmission quality can be considered poor. In this case, sending the target data at a lower first preset transmission rate will reduce the transmission rate of the target data at this time, but it can reduce the degree of network congestion, thus laying the foundation for improving the rate of subsequent data transmission.

[0195] Furthermore, when the first network quality is the second preset quality, the network transmission quality can be considered relatively good. In this case, sending the target data using a higher second preset transmission rate can not only increase the transmission rate of the target data but also avoid increasing the degree of network congestion.

[0196] Based on this, electronic devices can flexibly adjust the transmission rate of target data in real time according to the current network quality to adapt to changes in the network environment. Thus, while reducing network congestion, the transmission rate of target data is guaranteed as much as possible.

[0197] In another embodiment, the electronic device may also adjust the historical transmission rate of the previous moment in real time according to the first network quality, and determine the adjusted historical transmission rate as the first target transmission rate at the current moment.

[0198] For example, when the first network quality is a first preset quality, it can be assumed that sending the target data at the historical transmission rate is likely to cause network congestion. Therefore, in order to reduce the degree of network congestion, a third preset transmission rate can be reduced based on the historical transmission rate to obtain the first target transmission rate.

[0199] Furthermore, when the first network quality is the second preset quality, it can be assumed that sending target data at the historical transmission rate still results in relatively high network transmission quality and will not cause network congestion. Therefore, to further improve the transmission rate, a third preset transmission rate can be added based on the historical transmission rate to obtain the first target transmission rate.

[0200] The third preset transmission rate can be set according to actual conditions and is not limited thereto.

[0201] In another embodiment, to ensure the security and privacy of the target data transmission, the target data can also be encrypted during transmission. The encryption method includes, but is not limited to, key hash encryption, asymmetric encryption, and symmetric encryption.

[0202] Furthermore, to further ensure that the target data is not decrypted and accessed by intermediate node devices during transmission, the data interaction between electronic devices and servers (including electronic devices sending target data to servers, and servers sending data to be transmitted to electronic devices) can be encrypted end-to-end.

[0203] In this end-to-end encryption method, the data sender encrypts the data to be sent, and only the data receiver can decrypt it. None of the intermediate node devices along the transmission route between the sender and receiver can decrypt the data. Therefore, the security and privacy of the data are guaranteed not to be compromised by the unreliability of intermediate node devices.

[0204] In this embodiment of the application, the data sending end and the data receiving end can be considered as the electronic devices and servers described above, and the data to be sent includes, but is not limited to, the target data and the data to be transmitted described above.

[0205] S1303, Obtain the data to be transmitted.

[0206] In one embodiment, when the server sends the data to be transmitted, it may also use the above-mentioned end-to-end encryption method to encrypt the data to be transmitted, so as to ensure the security and privacy of the data to be transmitted.

[0207] In another embodiment, the server can send the data to be transmitted at a fourth preset transmission rate. However, similar to the scenario of the electronic device sending target data, in actual data transmission, network congestion may occur when the server sends the data to be transmitted at a fixed preset transmission rate (fourth preset transmission rate) due to network fluctuations or insufficient bandwidth, resulting in the target data failing to be transmitted to the server.

[0208] Based on this, the server can also determine the second target transmission rate according to the second network quality at the current moment. The method for determining the second target transmission rate is similar to the method for determining the first target transmission rate described above, and will not be explained further.

[0209] Understandably, based on the current network quality, the server can flexibly adjust the transmission rate of the data to be transmitted in real time to adapt to changes in the network environment.

[0210] It's important to note that the server's second target transmission rate is typically related to the bandwidth allocated when the electronic device and server establish a communication connection. Bandwidth is the "maximum data rate" that can travel from one end of the network to another per unit of time. In other words, the bandwidth between the electronic device and the server limits the rate at which the server can send data to the electronic device, or conversely, limits the rate at which the electronic device can send target data to the electronic device.

[0211] Therefore, when a server sends data to be transmitted, it can also be assumed that the transmission requirements of the data to be transmitted are usually related to the bandwidth between the electronic device and the server.

[0212] For example, taking medical image data as the data to be transmitted, the electronic device can determine the transmission parameters based on the bandwidth between itself and the server. The transmission parameters characterize the parameter requirements of the server each time it sends medical image data. Then, the transmission parameters are sent to the server to instruct the server to send the medical image data according to the transmission parameters.

[0213] In one embodiment, the above transmission parameters include, but are not limited to, one or more of the target resolution, frame rate, and bit rate for each transmission of medical image data, and are not limited thereto.

[0214] The target resolution mentioned above refers to the amount of information stored in the medical image data, which can characterize the number of pixels stored per inch of image. The frame rate mentioned above is the frequency (rate) at which bitmap images appear continuously on the display, in units of frames. That is, when the data to be transmitted includes medical image data (e.g., including the first image, second image, and third image data in the above embodiments), the frame rate can be considered as the transmission rate of the data to be transmitted. And, the bit rate mentioned above is the number of bits of data transmitted per unit time during data transmission.

[0215] As an example, an electronic device can determine one or more of the target resolution, target frame rate, and target bit rate for each transmission of medical image data based on a preset mapping relationship between bandwidth range and one or more of image resolution, frame rate, and bit rate. The electronic device can accordingly determine one or more of the target resolution, target frame rate, and target bit rate as the aforementioned transmission parameters.

[0216] For example, an electronic device can determine the target bandwidth range in which the bandwidth is located, and then determine one or more of the image resolution, frame rate, and bit rate corresponding to the target bandwidth range as the aforementioned transmission parameters.

[0217] Based on this, electronic devices can reasonably determine the target resolution, target frame rate, and target bit rate when sending medical image data according to the bandwidth between them and the server, which can ensure the transmission quality of medical image data in the media stream when it is sent to the electronic device for display.

[0218] The mapping relationship can be set in advance in the electronic device, and there are no restrictions on this.

[0219] It should be noted that the target resolution, frame rate, and bit rate are transmission requirements for medical image data that is a media stream. It is understood that when the data to be transmitted is non-media stream medical image data such as first-dimensional contour data, the server can determine the second target transmission rate based solely on the above embodiments and send the data to be transmitted according to the second target transmission rate.

[0220] In this embodiment, after establishing a communication connection with the server, the electronic device can determine the target compression strategy when the server sends data to be transmitted, and send target data containing the target compression strategy and transmission request to the server to request the server to compress the data to be transmitted next time, thereby reducing the amount of data to be transmitted. This improves the response speed of the data to be transmitted. Furthermore, by using the above method, the compression strategy for the data to be transmitted is determined by the electronic device as the data requesting end, rather than by the server as the data sending end. This ensures that the data to be transmitted, compressed by the target compression strategy, better meets the needs of the electronic device. Therefore, based on the acquired data to be transmitted, the user can reasonably select the real-time or accuracy (data quality) requirements that the data to be transmitted must meet, thereby improving the user experience on the electronic device.

[0221] Based on the above description, in another embodiment, see [reference] Figure 14 This application also provides a structural block diagram of a data transmission device. The data transmission device includes modules for performing... Figure 13 The steps in the corresponding embodiments. Please refer to the details. Figure 13 The relevant descriptions in the corresponding embodiments are shown below. For ease of explanation, only the parts relevant to this embodiment are shown. See also... Figure 14 The data transmission device 1400 may include: a compression strategy determination module 1410, a target data transmission module 1420, and a data acquisition module 1430, wherein:

[0222] The compression strategy determination module 1410 is used to determine the target compression strategy when the server sends data to be transmitted after the communication connection with the server is established; the target compression strategy is used by the server to compress the data to be transmitted next time.

[0223] The target data sending module 1420 is used to send target data to the server; the target data includes a target compression strategy and a transmission request for requesting the server to send the data to be transmitted to the electronic device.

[0224] The data acquisition module 1430 is used to acquire the data to be transmitted.

[0225] When it is understood that, Figure 14 The structural block diagram of the image drawing device shown illustrates how each module performs [the necessary operations]. Figure 13 The steps in the corresponding embodiments, and for Figure 13 The steps in the corresponding embodiments have been explained in detail in the above embodiments. Please refer to them for details. Figure 13 The relevant descriptions in the corresponding embodiments will not be repeated here.

[0226] In another embodiment, this application also provides an electronic device, which may also include: a processor, a memory, and a computer program stored in the memory and executable on the processor, such as a program for a data transmission method. When the processor executes the computer program, it implements the steps described in the various embodiments of the data transmission method above, for example... Figure 13 S1301 to S1303 are shown. Alternatively, the processor implements the above when executing a computer program. Figure 14 The functions of each module in the corresponding embodiments, for example, Figure 14 For details on the functions of each module shown, please refer to [link / reference]. Figure 14 The relevant descriptions in the corresponding embodiments.

[0227] Among them, the processor, memory, and computer program are related to the above. Figure 8 The corresponding processor, memory, and computer program are similar, except that when the processor executes the computer program, it implements the steps in the above-described data transmission method embodiments, rather than the steps in the image drawing method embodiments. This will not be described further.

[0228] In another embodiment, the above-described data transmission method can also be applied to a server. The server has already been explained in the embodiments of the image outlining method described above, and will not be described again thereafter. For details, please refer to... Figure 15 , Figure 15 The following is a flowchart illustrating the implementation of a data transmission method according to an embodiment of this application. The method includes the following steps:

[0229] S1501. After establishing a communication connection with the electronic device, acquire the target data sent by the electronic device; the target data includes the target compression strategy.

[0230] S1502. According to the target compression strategy, compress the data to be transmitted corresponding to the target data.

[0231] S1503, Send the data to be transmitted to the electronic device.

[0232] In one embodiment, the above-mentioned communication connection establishment method, target data, target compression strategy, data to be transmitted, and strategy for sending the data to be transmitted (e.g., the above-mentioned...) Figure 13 The second transmission rate and transmission parameters described in the corresponding embodiments have all been included. Figure 13 The corresponding embodiments will be explained, and will not be described further.

[0233] It should be added that if packet loss is detected during the transmission of data sent by the server, automatic retransmission can be performed to ensure the integrity of the data received by the electronic device.

[0234] Packet loss can be caused by a variety of reasons, such as network congestion, corrupted data packets being rejected, or electronic device driver malfunctions. These are not limited to a single cause.

[0235] As an example, due to the limitation on the number of bytes a data packet can carry, the data to be transmitted usually needs to be carried by multiple data packets and sent to the electronic device. In this case, the header field of each data packet typically includes an identification field to store unique information about the data packet. The first data packet sent usually includes a start identifier and the data information of the data to be transmitted (e.g., the number of data packets, the size of the data to be transmitted, etc.), while the last data packet sent usually includes an end identifier so that the electronic device can determine that the data to be transmitted has been completed. Then, the electronic device can determine whether there is packet loss based on the identification field and the data information. Furthermore, when packet loss is determined, the target data packet corresponding to the target identification field that needs to be retransmitted by the server is determined based on the data information and the identification field. Then, a retransmission request containing the target identification field is sent to the server, so that the server only needs to send the target data packet corresponding to the target identification field. Thus, while ensuring that the electronic device can receive the complete data to be transmitted, the number of data packets that the server needs to retransmit is reduced.

[0236] In this embodiment, after establishing a communication connection with the electronic device, the server can compress the data to be transmitted corresponding to the transmission request according to the target compression strategy sent by the data receiving end (electronic device), and then send it to the electronic device. Based on this, by adopting the above method, it can be considered that compressing the data to be transmitted according to the target compression strategy determined by the electronic device as the data requesting end can make the data to be transmitted, after being compressed by the target compression strategy, better meet the needs of the electronic device. Furthermore, based on obtaining the data to be transmitted, the electronic device can reasonably select the real-time or accuracy (data quality) requirements that the data to be transmitted needs to meet based on its own needs, thereby improving the user experience on the electronic device.

[0237] Based on the above description, in another embodiment, see [reference] Figure 16 This application also provides a structural block diagram of a data transmission device. The data transmission device includes modules for performing... Figure 16 The steps in the corresponding embodiments. Please refer to the details. Figure 16 The relevant descriptions in the corresponding embodiments are shown below. For ease of explanation, only the parts relevant to this embodiment are shown. See also... Figure 16 The data transmission device 1600 may include: a target data acquisition module 1610, a compression module 1620, and a data transmission module 1630, wherein:

[0238] The target data acquisition module 1610 is used to acquire target data sent by the electronic device after a communication connection with the electronic device is established; the target data includes a target compression strategy.

[0239] Compression module 1620 is used to compress the data to be transmitted corresponding to the target data according to the target compression strategy.

[0240] The data transmission module 1630 is used to send data to be transmitted to an electronic device.

[0241] When it is understood that, Figure 16 The structural block diagram of the image drawing device shown illustrates how each module performs [the necessary operations]. Figure 15 The steps in the corresponding embodiments, and for Figure 15 The steps in the corresponding embodiments have been explained in detail in the above embodiments. Please refer to them for details. Figure 15 The relevant descriptions in the corresponding embodiments will not be repeated here.

[0242] In another embodiment, this application also provides a server, which may also include a processor, a memory, and a computer program stored in the memory and executable on the processor, such as a program for a data transmission method. When the processor executes the computer program, it implements the steps in the various embodiments of the data transmission method described above, for example... Figure 15 S1501 to S1503 are shown. Alternatively, the processor implements the above when executing a computer program. Figure 16 The functions of each module in the corresponding embodiments, for example, Figure 16 For details on the functions of each module shown, please refer to [link / reference]. Figure 16 The relevant descriptions in the corresponding embodiments.

[0243] Among them, the processor, memory, and computer program are related to the above. Figure 12 The corresponding processor, memory, and computer program are similar, except that when the processor executes the computer program, it implements the steps in the above-described data transmission method embodiments, rather than the steps in the image drawing method embodiments. This will not be described further.

[0244] This application provides a computer-readable storage medium storing instructions that, when executed by a processor, implement the data transmission methods described in the various embodiments above.

[0245] The above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. An image delineation method characterized by, The image sketching method comprises: determining, according to a preset sketch contour, contour editing of a first image obtained from a server, the first image comprising the preset sketch contour and an associated target region; obtaining, from the server, a second image associated with the first image, the second image comprising the target region; generating target sketch contour data based on contour editing of the second image by a user.

2. The image delineation method of claim 1, wherein, The determining, according to a preset sketch contour, contour editing of a first image obtained from a server comprises: determining, in the first image, a to-be-edited sketch contour based on the preset sketch contour; determining contour editing of the to-be-edited sketch contour.

3. The image delineation method of claim 2, wherein, The determining, in the first image, a to-be-edited sketch contour based on the preset sketch contour comprises: determining the to-be-edited sketch contour according to a selection operation of the user on a corresponding preset sketch contour in one or more preset sketch contours.

4. The image delineation method of claim 2, wherein, After the determining, in the first image, a to-be-edited sketch contour based on the preset sketch contour, the method further comprises: sending a first data request to the server, the first data request comprising an identifier corresponding to the to-be-edited sketch contour; obtaining a third image sent by the server, the third image comprising the to-be-edited sketch contour highlighted; determining a final to-be-edited sketch contour according to the third image.

5. The method of claim 2, wherein, The determining contour editing of the to-be-edited sketch contour comprises: when a contour editing instruction of the user for the to-be-edited sketch contour is detected, determining the contour editing of the to-be-edited sketch contour.

6. The image delineation method of any one of claims 2-5, wherein, After the determining contour editing of the to-be-edited sketch contour, the method further comprises: sending a second data request to the server, the second data request being used to request the server to send back first three-dimensional sketch contour data corresponding to the to-be-edited sketch contour; converting the first three-dimensional sketch contour data into two-dimensional sketch contour data according to a preset mapping relationship between a window coordinate system corresponding to a display window and a three-dimensional coordinate system corresponding to the target region, and displaying the two-dimensional sketch contour data in the display window; The generating target sketch contour data based on contour editing of the second image by a user comprises: generating the target sketch contour data based on contour editing of the displayed two-dimensional sketch contour data by the user.

7. An image delineation method characterized by comprising: The image sketching method comprises: sending a first image to an electronic device; the first image comprising a preset sketch contour and an associated target region; the electronic device being configured to determine, according to a preset sketch contour, contour editing of a first image obtained from a server; sending a second image associated with the first image, the second image comprising the target region; the second image being used for a user to perform contour editing operations to generate target sketch contour data.

8. An image outlining apparatus characterized by comprising: The method comprises: a first determining module configured to determine, according to a preset sketch contour, contour editing of a first image obtained from a server, the first image comprising the preset sketch contour and an associated target region; The first obtaining module is configured to obtain a second image associated with the first image from the server, the second image comprising the target region; The editing module is configured to generate target sketching contour data based on a contour editing operation of a user on the second image.

9. An image delineation apparatus characterized by comprising: The method comprises the following steps: The first sending module is configured to send a first image to an electronic device, the first image comprising a preset sketching contour and an associated target region; The electronic device is configured to determine a contour editing operation on the first image obtained from the server according to the preset sketching contour; The second sending module is configured to send a second image associated with the first image, the second image comprising the target region; the second image is used for a contour editing operation of a user to generate target sketching contour data.

10. A computer-readable storage medium having stored thereon instructions, When the instructions are executed by the processor, the image sketching method according to any one of claims 1 to 7 is implemented.

Images