Three-dimensional data display method and device, electronic device and storage medium

By providing a three-dimensional data display method in medical scenarios, obtaining and rendering three-dimensional scanning data of human body parts, the problem of inconvenient and non-intuitive slice image display in the existing technology is solved, and slice images of different dimensions and positions can be viewed conveniently and intuitively in the three-dimensional slice model.

CN114612639BActive Publication Date: 2025-10-03GUIZHOU WUJIANG HYDROPOWER DEV CO LTD WUJIANGDU POWER PLANT
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202210294997.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-03-23
Publication Date
2025-10-03
Estimated Expiration
2042-03-23

AI Technical Summary

Technical Problem

In existing medical scenarios, multiple slice images of human body parts obtained through CT scanning technology are usually displayed in a flat format, which lacks convenience and intuitiveness.

Method used

A 3D data display method is provided to obtain 3D scanning data of human body parts. By specifying the target slice position in three dimensions, a 3D slice model is rendered. The method also supports operations such as adjusting the slice position, showing and hiding the organ outline, and switching the viewing angle.

Benefits of technology

It enables convenient and intuitive viewing of slice images of different dimensions and positions in a three-dimensional slice model, improving the viewing efficiency and intuitiveness of the slice images.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114612639B_ABST
    Figure CN114612639B_ABST
Patent Text Reader

Abstract

The present disclosure relates to a three-dimensional data display method and apparatus, electronic device, and storage medium. The method comprises: obtaining three-dimensional scan data of a human body part, the three-dimensional scan data including slice data of the human body part in three dimensions and slice position information corresponding to the three-dimensional slice data of the human body part; determining slice data at the target slice position based on target slice positions and slice position information specified in the three dimensions; and displaying a three-dimensional slice model of the human body part based on the slice data at the target slice position, the three-dimensional slice model including a slice image of the human body part at the target slice position, rendered based on the slice data. Embodiments of the present disclosure enable more convenient and intuitive viewing of slice images at different target slice positions in different dimensions.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a three-dimensional data method and device, an electronic device, and a storage medium. Background Art

[0002] In current medical scenarios, CT (Computed Tomography) technology can be used to scan multiple slices of human body parts. Usually, the scanner selects some slices and presents them to the doctor in a flat display format to view the lesions, for example Figure 1 A schematic diagram showing a slice diagram in related art is shown, which is not convenient and intuitive enough. Summary of the Invention

[0003] The present disclosure proposes a three-dimensional data display technology solution.

[0004] According to one aspect of the present disclosure, a three-dimensional data display method is provided, comprising: acquiring three-dimensional scanning data of a human body part, the three-dimensional scanning data including slice data of the human body part in three dimensions and slice position information corresponding to the slice data in the three dimensions of the human body part; determining slice data at the target slice position based on target slice positions specified respectively in the three dimensions and the slice position information; and displaying a three-dimensional slice model of the human body part based on the slice data at the target slice position, the three-dimensional slice model including a slice image of the human body part at the target slice position rendered according to the slice data.

[0005] In one possible implementation, determining the slice data at the target slice position based on the target slice positions and the slice position information specified respectively in the three dimensions includes: in response to receiving a slice position adjustment instruction for the target dimension, determining the slice data at the target slice position under the target dimension indicated by the slice position adjustment instruction; wherein, displaying the three-dimensional slice model of the human body part based on the slice data at the target slice position includes: rendering a slice diagram of the human body part at the target slice position under the target dimension based on the slice data at the target slice position under the target dimension indicated by the slice position adjustment instruction.

[0006] In one possible implementation, the three-dimensional scanning data also includes organ contour information and organ position information of at least one organ in the human body part, and the method further includes: rendering a three-dimensional image block corresponding to the at least one organ in the three-dimensional slice model based on the organ contour information and organ position information of the at least one organ; wherein each three-dimensional image block has an outer contour similar to that of each organ, and the display position of each three-dimensional image block in the three-dimensional slice model corresponds to the actual position of each organ in the human body part.

[0007] In one possible implementation, the method further includes: in response to receiving a hide instruction for a displayed three-dimensional tile, hiding the three-dimensional tile indicated by the hide instruction in the three-dimensional slice model; and / or, in response to receiving a show instruction for the hidden three-dimensional tile, rendering the three-dimensional tile indicated by the show instruction in the three-dimensional slice model.

[0008] In one possible implementation, the three-dimensional image blocks corresponding to different organs in the human body part have different display effects, and the display effects include at least one of color and transparency. The method further includes: in response to receiving a color adjustment instruction for the three-dimensional image block, converting the color of the three-dimensional image block indicated by the color adjustment instruction to a target color indicated by the color adjustment instruction; and / or, in response to receiving a transparency adjustment instruction for the three-dimensional image block, converting the transparency of the three-dimensional image block indicated by the transparency adjustment instruction to the target transparency indicated by the transparency adjustment instruction.

[0009] In one possible implementation, the three-dimensional slice model has at least one perspective mode selected from a three-dimensional perspective, a transverse perspective, a longitudinal perspective, and a vertical perspective, wherein the three-dimensional perspective is used to simultaneously display slice images in three dimensions, the transverse perspective is used to display transverse slice images on the X-axis dimension, the longitudinal perspective is used to display longitudinal slice images on the Y-axis dimension, and the vertical perspective is used to display vertical slice images on the Z-axis dimension; wherein the three-dimensional slice model is currently displayed in any perspective mode, and the method further includes: in response to receiving a perspective switching instruction for the three-dimensional slice model, controlling the three-dimensional slice model to transform into a target perspective mode indicated by the perspective switching instruction; and / or, in response to receiving a posture adjustment instruction for the three-dimensional slice model, transforming the three-dimensional slice model into a target posture indicated by the posture adjustment instruction.

[0010] In one possible implementation, the method further includes: in response to receiving a brightness adjustment instruction for a slice image in the three-dimensional slice model, adjusting the brightness and darkness contrast effects of different slice tissues in the slice image according to at least one of the brightness and contrast indicated by the brightness adjustment instruction.

[0011] In one possible implementation, obtaining three-dimensional scanning data of a human body part includes: obtaining original three-dimensional scanning data in an original data format sent by a back-end server; converting the original three-dimensional scanning data into three-dimensional scanning data in a preset data format; and extracting at least one of the following information from the three-dimensional scanning data in the preset data format: slice data of the human body part in three dimensions, slice position information of the slice data in three dimensions, and organ contour information and organ position information of at least one organ in the human body part.

[0012] According to one aspect of the present disclosure, a three-dimensional data display device is provided, comprising: an acquisition module for acquiring three-dimensional scanning data of a human body part, the three-dimensional scanning data including slice data of the human body part in three dimensions and slice position information corresponding to the slice data of the three dimensions of the human body part; a determination module for determining slice data at a target slice position based on target slice positions respectively specified in the three dimensions and the slice position information; and a display module for displaying a three-dimensional slice model of the human body part based on the slice data at the target slice position, the three-dimensional slice model including a slice diagram of the human body part at the target slice position rendered according to the slice data.

[0013] In one possible implementation, the determination module includes: a slice data determination submodule for determining, in response to receiving a slice position adjustment instruction for a target dimension, slice data at the target slice position under the target dimension indicated by the slice position adjustment instruction; wherein, the display module includes: a slice image rendering submodule for rendering a slice image of the human body part at the target slice position under the target dimension based on the slice data at the target slice position under the target dimension indicated by the slice position adjustment instruction.

[0014] In one possible implementation, the three-dimensional scanning data also includes organ contour information and organ position information of at least one organ in the human body part, and the device further includes: a block rendering module, configured to render a three-dimensional block corresponding to the at least one organ in the three-dimensional slice model based on the organ contour information and organ position information of the at least one organ; wherein each three-dimensional block has an outer contour similar to that of each organ, and a display position of each three-dimensional block in the three-dimensional slice model corresponds to an actual position of each organ in the human body part.

[0015] In one possible implementation, the device further includes: a tile hiding module for, in response to receiving a hiding instruction for a displayed three-dimensional tile, hiding the three-dimensional tile indicated by the hiding instruction in the three-dimensional slice model; and / or, a tile display module for, in response to receiving a display instruction for a hidden three-dimensional tile, rendering the three-dimensional tile indicated by the display instruction in the three-dimensional slice model.

[0016] In one possible implementation, the three-dimensional image blocks corresponding to different organs in the human body part have different display effects, and the display effects include at least one of color and transparency. The device further includes: a block color conversion module for, in response to receiving a color adjustment instruction for the three-dimensional image block, converting the color of the three-dimensional image block indicated by the color adjustment instruction to a target color indicated by the color adjustment instruction; and / or, a block transparency conversion module for, in response to receiving a transparency adjustment instruction for the three-dimensional image block, converting the transparency of the three-dimensional image block indicated by the transparency adjustment instruction to a target transparency indicated by the transparency adjustment instruction.

[0017] In one possible implementation, the three-dimensional slice model has at least one perspective mode selected from the group consisting of a three-dimensional perspective, a transverse perspective, a longitudinal perspective, and a vertical perspective, wherein the three-dimensional perspective is used to simultaneously display slice images in three dimensions, the transverse perspective is used to display transverse slice images in the X-axis dimension, the longitudinal perspective is used to display longitudinal slice images in the Y-axis dimension, and the vertical perspective is used to display vertical slice images in the Z-axis dimension; wherein the three-dimensional slice model is currently displayed in any perspective mode, and the device further includes: a perspective switching module for, in response to receiving a perspective switching instruction for the three-dimensional slice model, controlling the three-dimensional slice model to transform into a target perspective mode indicated by the perspective switching instruction; and / or, a posture transformation module for, in response to receiving a posture adjustment instruction for the three-dimensional slice model, transforming the three-dimensional slice model into a target posture indicated by the posture adjustment instruction.

[0018] In one possible implementation, the device further includes: a brightness and darkness adjustment module for, in response to receiving a brightness and darkness adjustment instruction for a slice image in the three-dimensional slice model, adjusting the brightness and darkness contrast effects of different slice tissues in the slice image according to at least one of the brightness and contrast indicated by the brightness and darkness adjustment instruction.

[0019] In one possible implementation, the acquisition module includes: an original data acquisition submodule, used to acquire original three-dimensional scanning data in an original data format sent by a back-end server; a data conversion module, used to convert the original three-dimensional scanning data into three-dimensional scanning data in a preset data format; and an information extraction module, used to extract at least one of the following information from the three-dimensional scanning data in a preset data format: slice data of the human body part in three dimensions, slice position information of the slice data in three dimensions, and organ contour information and organ position information of at least one organ in the human body part.

[0020] According to one aspect of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to call the instructions stored in the memory to execute the above method.

[0021] According to one aspect of the present disclosure, a computer-readable storage medium is provided, on which computer program instructions are stored. When the computer program instructions are executed by a processor, the above method is implemented.

[0022] In the embodiment of the present disclosure, by specifying the target slice position and slice position information respectively in three dimensions, the slice data at the target slice position is determined, and a three-dimensional slice model of the human body part is displayed based on the slice data at the target slice position. The slice images at the three target slice positions specified by the user in three dimensions can be displayed simultaneously in the three-dimensional slice model. In this way, the user can more conveniently and intuitively view the slice images at different target slice positions in different dimensions, thereby improving the viewing efficiency of the slice images.

[0023] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, rather than limiting the present disclosure. Other features and aspects of the present disclosure will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] The accompanying drawings herein are incorporated into and constitute a part of the specification. These drawings illustrate embodiments consistent with the present disclosure and, together with the specification, are used to explain the technical solutions of the present disclosure.

[0025] Figure 1 A schematic diagram showing a slice diagram in the related art.

[0026] Figure 2 A flowchart of a three-dimensional data display method according to an embodiment of the present disclosure is shown.

[0027] Figure 3 A schematic diagram showing a position adjustment control according to an embodiment of the present disclosure is shown.

[0028] Figure 4 A schematic diagram of a three-dimensional slice model according to an embodiment of the present disclosure is shown.

[0029] Figure 5 A schematic diagram of a three-dimensional slice model according to an embodiment of the present disclosure is shown.

[0030] Figure 6 A schematic diagram of a three-dimensional slice model according to an embodiment of the present disclosure is shown.

[0031] Figure 7 A schematic diagram of a three-dimensional slice model according to an embodiment of the present disclosure is shown.

[0032] Figure 8 A schematic diagram showing a control panel according to an embodiment of the present disclosure is shown.

[0033] Figure 9 A block diagram of a three-dimensional data display device according to an embodiment of the present disclosure is shown.

[0034] Figure 10 A block diagram of an electronic device 800 according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0035] Various exemplary embodiments, features, and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numerals in the accompanying drawings represent elements with the same or similar functions. Although various aspects of the embodiments are shown in the accompanying drawings, the drawings are not necessarily drawn to scale unless otherwise indicated.

[0036] The word “exemplary” is used exclusively herein to mean “serving as an example, example, or illustration.” Any embodiment described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other embodiments.

[0037] The term "and / or" herein simply describes an association relationship between associated objects, indicating that three relationships can exist. For example, "A and / or B" can represent the existence of three situations: A alone, A and B simultaneously, and B alone. Furthermore, the term "at least one" herein refers to any combination of at least two of any one or more of a plurality of items. For example, "at least one of A, B, and C" can represent any one or more elements selected from the set consisting of A, B, and C.

[0038] In addition, numerous specific details are provided in the following detailed description to better illustrate the present disclosure. Those skilled in the art will appreciate that the present disclosure can be practiced without certain specific details. In some instances, methods, means, components, and circuits well known to those skilled in the art are not described in detail in order to highlight the main points of the present disclosure.

[0039] Figure 2 A flowchart of a three-dimensional data display method according to an embodiment of the present disclosure is shown. The three-dimensional data display method can be executed by a terminal device, which can be a user equipment (UE), a mobile device, a user terminal, a terminal, a cellular phone, a cordless phone, a personal digital assistant (PDA), a handheld device, a computing device, a vehicle-mounted device, a wearable device, or other electronic device. The method can be implemented by a processor of the electronic device calling computer-readable instructions stored in a memory. Figure 2 As shown, the three-dimensional data display method includes:

[0040] In step S11 , three-dimensional scanning data of a human body part is acquired.

[0041] In one possible implementation, the three-dimensional scanning data may be three-dimensional data obtained by scanning a human body part using a CT device. The CT device may transmit the scanned three-dimensional scanning data directly to the above-mentioned electronic device, or may also transmit it to a back-end server, which in turn sends the data to an electronic device that needs to view a slice image of a human body part, etc. This is not limited to the embodiments of the present disclosure.

[0042] The three-dimensional scanning data includes slice data of a human body part in three dimensions and slice position information corresponding to the three-dimensional slice data of the human body part. The human body part may include, for example, the abdomen, chest, head, etc., which is not limited in the embodiments of the present disclosure; the slice data can be understood as the three-dimensional data required to render a slice image of the human body part. The slice data can be three-dimensional data in a preset data format (such as vis3D format) to facilitate electronic devices to render the slice image. The slice position information includes the slice positions of all slice data within the human body part.

[0043] Among them, the three dimensions defined by the three-dimensional coordinate system can include: X-axis dimension, Y-axis dimension and Z-axis dimension. It should be understood that the dimensions and slice positions of the slice data of each dimension can be based on the three-dimensional coordinate system defined by the CT device itself. Of course, it can also be projected into other three-dimensional coordinate systems (such as the three-dimensional coordinate system constructed when displaying the three-dimensional slice model) according to actual needs, so as to render the slice image in the display interface of the electronic device. This is not limited to this embodiment of the present disclosure.

[0044] In step S12 , slice data at the target slice position is determined according to the target slice position and slice position information respectively specified in three dimensions.

[0045] The target slice position can be understood as the slice position of the human body part where the user desires to display the slice image. In one possible implementation, the user can pre-specify the target slice position in the 3D coordinate system of the 3D slice model. For example, the user can set the coordinate position on each of the three coordinate axes of the 3D coordinate system, and use the set coordinate position as the target slice position.

[0046] In one possible implementation, in order to enable users to more conveniently view slice images at different target slice positions, a position adjustment control for adjusting the target slice position can be provided in the display interface. Users can use the position adjustment control to specify different target slice positions in different dimensions, thereby making it easier for users to view slice images at different target slice positions in different dimensions. Figure 3 A schematic diagram of a position adjustment control according to an embodiment of the present disclosure is shown. Figure 3 As shown, the user can specify the target slice position in three dimensions by adjusting the position of the "hollow circle" in each dimension on the line segment.

[0047] As mentioned above, the slice position information includes the slice positions of all slice data within the human body part. Then, based on the target slice positions and slice position information specified in three dimensions, the slice data at the target slice positions specified in three dimensions can be obtained, which is convenient for displaying the three-dimensional slice model of the human body part using the target slice positions specified in three dimensions.

[0048] In step S13, a three-dimensional slice model of the human body part is displayed according to the slice data at the target slice position. The three-dimensional slice model includes a slice image of the human body part at the target slice position rendered according to the slice data.

[0049] As described above, the slice data can be understood as the three-dimensional data required for rendering the slice image. Displaying a three-dimensional slice model of a human body part based on the slice data at the target slice position can be understood as rendering a slice image of the human body part at the target slice position on the display interface of an electronic device based on the slice data at the three target slice positions in three dimensions. It should be understood that those skilled in the art can use rendering technologies known in the art, such as the open source three.js technology, to render the slice image based on the slice data, and this is not limited to the embodiments of the present disclosure. Figure 4 A schematic diagram of a three-dimensional slice model according to an embodiment of the present disclosure is shown as follows: Figure 4 As shown, the three-dimensional slice model includes three slice images in three dimensions.

[0050] It should be understood that at least one three-dimensional scanning data of a human body part can be obtained through the above-mentioned step S11, such as three-dimensional scanning data of the same human body part of the same person at different times, or three-dimensional scanning data of the same human body part of different people. In this way, according to steps S12-S13, at least one three-dimensional slice model can be displayed in the display interface, which can facilitate the user to compare different three-dimensional slice models of the human body part at the same time.

[0051] In an embodiment of the present disclosure, by specifying the target slice position and slice position information in three dimensions, the slice data at the target slice position is determined, and a three-dimensional slice model of the human body part is displayed based on the slice data at the target slice position. The slice images at the three target slice positions specified by the user in three dimensions can be displayed simultaneously in the three-dimensional slice model, so that the user can view the slice images at different target slice positions more conveniently and intuitively.

[0052] As described above, the user can use the position adjustment control to specify different target slice positions in different dimensions, so that the user can view the slice images at different target slice positions in different dimensions. In one possible implementation, the slice data at the target slice position is determined based on the target slice positions and slice position information specified in three dimensions, including: in response to receiving a slice position adjustment instruction for the target dimension, determining the slice data at the target slice position under the target dimension indicated by the slice position adjustment instruction.

[0053] Among them, the target dimension can be understood as the dimension of the target slice position adjusted by the user. The target dimension can be any dimension of the three dimensions. For example, the user uses the above-mentioned position adjustment control to adjust the target slice position in the X-axis dimension, then the X-axis dimension can be the target dimension, and the operation of moving the "hollow circle" corresponding to the X-axis dimension in the above-mentioned position adjustment control can be understood as issuing a slice position adjustment instruction on the X-axis dimension. The position of the "hollow circle" on the line segment corresponds to the target slice position indicated by the slice position adjustment instruction in the X-axis dimension.

[0054] Among them, the slice position adjustment instruction can indicate the target slice position under the target dimension, that is, obtain the target slice position specified under the target dimension. According to the target slice position under the target dimension indicated by the slice position adjustment instruction and the above-mentioned slice position information, the slice data at the target slice position under the target dimension indicated by the slice position adjustment instruction can be determined.

[0055] It should be understood that the above-mentioned method of issuing slice position adjustment instructions using the position adjustment control is an implementation method provided by the embodiment of the present disclosure. In fact, those skilled in the art can design and implement various implementation methods of slice position adjustment instructions. For example, they can also directly set the coordinate position, etc., and the embodiment of the present disclosure does not limit this.

[0056] After determining the slice data at the target slice position within the target dimension indicated by the slice position adjustment instruction, in one possible implementation, displaying a three-dimensional slice model of the human body part based on the slice data at the target slice position includes rendering a slice image of the human body part at the target slice position within the target dimension based on the slice data at the target slice position within the target dimension indicated by the slice position adjustment instruction. In this manner, slice images at different target slice positions within different dimensions can be conveniently displayed.

[0057] As described above, those skilled in the art can adopt rendering techniques known in the art to render slice images based on slice data; the target dimension can be any of the three dimensions. It should be understood that when the three-dimensional slice model is displayed in the display interface for the first time, the three-dimensional slice image can be rendered according to the preset default slice positions in the three dimensions. When the user adjusts the target slice position in the target dimension, the slice image in the target dimension can be re-rendered in the three-dimensional slice model, and the slice images in other dimensions do not need to be re-rendered.

[0058] Figure 5 A schematic diagram of a three-dimensional slice model according to an embodiment of the present disclosure is shown as follows: Figure 5 and Figure 4 The slice diagrams at different target slice positions in three dimensions are shown in FIG. It should be understood that the slice diagrams can be obtained by Figure 5 Adjust to Figure 4 , or it can be Figure 4 Adjust to Figure 5 , this disclosure does not limit the embodiments thereof.

[0059] In the embodiment of the present disclosure, the user can adjust the target slice position to display slice images at different target slice positions in three dimensions in the three-dimensional slice model, allowing the user to more conveniently view slice images in different dimensions at the same time.

[0060] Considering that displaying three-dimensional slice images in the form of a three-dimensional slice model may still not intuitively reflect the relative positions of the slice images in each dimension relative to the human body part, in one possible implementation, the three-dimensional scan data also includes organ contour information and organ position information of at least one organ in the human body part, and the method further includes:

[0061] Based on the organ contour information and organ position information of at least one organ, a 3D image block corresponding to the at least one organ is rendered in the 3D slice model. Each 3D image block has a similar outline to the respective organ, and the display position of each 3D image block in the 3D slice model corresponds to the actual position of the respective organ within the human body. This method allows users to intuitively view the relative position of the slice images at different target slice positions relative to the human body part, and also facilitates the user to understand the slice content displayed by the slice images at different target slice positions.

[0062] The organ contour information may represent the outer contour of an organ within a human body part, and the organ position information may represent the actual position of the organ within the human body part. It should be understood that the user may pre-set the organ type (e.g., the liver or pancreas within the human abdomen) for which the 3D image blocks are to be displayed in the 3D slice model. The organ contour information and organ position information may be information extracted from the 3D scan data based on the user-set organ type, respectively, and this is not limited in the present embodiment.

[0063] It should be understood that after the organ contour information and organ position information of at least one organ are known, the rendering technology known in the art can be used to render the three-dimensional blocks corresponding to at least one organ in the three-dimensional slice model. The three-dimensional blocks are fixed relative to the slice images in the three-dimensional slice model. The slice images of different target slice positions can be displayed in the three-dimensional slice model, which makes it easy for users to intuitively view the relative positions of the slice images at different target slice positions relative to the organs in the human body.

[0064] Considering that users may need to hide certain displayed 3D tiles and / or display certain hidden 3D tiles, in one possible implementation, the method further includes: in response to receiving a hide instruction for a displayed 3D tile, hiding the 3D tile indicated by the hide instruction in the 3D slice model; and / or, in response to receiving a show instruction for a hidden 3D tile, rendering the 3D tile indicated by the show instruction in the 3D slice model. In this way, users can easily randomly display or hide 3D tiles of organs.

[0065] Among them, the hiding instruction can indicate the three-dimensional block to be hidden, and when the hiding instruction is received, the three-dimensional block indicated by the hiding instruction can be hidden; the display instruction can indicate the three-dimensional block to be displayed, and when the display instruction is received, the three-dimensional block indicated by the display instruction can be redisplayed.

[0066] It should be understood that those skilled in the art can design and develop triggering methods for hiding instructions and display instructions according to actual needs. For example, by providing a hiding button and / or a display button in the display interface, it is convenient for users to use the hiding button and / or the display button to issue hiding instructions and / or display instructions. This is not limited to the embodiments of the present disclosure.

[0067] In one possible implementation, to facilitate differentiation between 3D image blocks of different organs, the 3D image blocks of different organs may use different colors and / or different transparencies. That is, the 3D image blocks corresponding to different organs within a human body region may have different display effects, where the display effects include at least one of color and transparency. The method further includes:

[0068] In response to receiving a color adjustment instruction for a 3D tile, the color of the 3D tile indicated by the color adjustment instruction is converted to the target color indicated by the color adjustment instruction; and / or in response to receiving a transparency adjustment instruction for the 3D tile, the transparency of the 3D tile indicated by the transparency adjustment instruction is converted to the target transparency indicated by the transparency adjustment instruction. In this way, users can easily customize the display effect of the 3D tile.

[0069] It should be understood that those skilled in the art can design and develop triggering methods for color adjustment instructions and transparency adjustment instructions according to actual needs. For example, an input box control can be provided after the user selects any three-dimensional block to receive the color value of the target color, the numerical value of the target transparency, etc. entered by the user through the input box control. This is not limited to the embodiments of the present disclosure.

[0070] Considering that the 3D slice model can display slice images in three dimensions simultaneously, users may need to only view slice images in a certain dimension. In one possible implementation, the 3D slice model has at least one viewing angle mode among a 3D perspective, a horizontal perspective, a vertical perspective, and a vertical perspective. The 3D perspective is used to display slice images in three dimensions simultaneously, the horizontal perspective is used to display horizontal slice images in the X-axis dimension, the vertical perspective is used to display vertical slice images in the Y-axis dimension, and the vertical perspective is used to display vertical slice images in the Z-axis dimension.

[0071] The 3D slice model is currently displayed in any viewing mode. In one possible implementation, the method further includes: in response to receiving a viewing angle switching instruction for the 3D slice model, controlling the 3D slice model to transform to a target viewing angle indicated by the viewing angle switching instruction. In this manner, it is convenient for a user to view slice images in different viewing angles.

[0072] The target perspective mode can be understood as a perspective mode indicated by the perspective switching instruction, which is different from the currently displayed perspective mode. It should be understood that those skilled in the art can design and develop a triggering method for the perspective switching instruction according to actual needs. For example, a perspective switching button can be provided in the display interface to facilitate the user to issue the perspective switching instruction through the perspective switching button, and this embodiment of the present disclosure is not limited to this.

[0073] Figure 6 A schematic diagram of a three-dimensional slice model according to an embodiment of the present disclosure is shown as follows: Figure 6 What is shown is a three-dimensional slice model under a vertical cutting perspective, which can display a vertical slice image on the Z axis. It should be understood that Figure 6 The three-dimensional slice model shown may also be a transverse perspective or a longitudinal perspective, which may be specifically determined according to the directions of the three coordinate axes in the three-dimensional coordinate system corresponding to the three-dimensional slice model, and this embodiment of the present disclosure does not limit this.

[0074] Among them, each perspective model can be preset to have a default posture. When the three-dimensional slice model switches from the current perspective mode to the target perspective mode, the current posture of the three-dimensional slice model is adjusted to the default posture corresponding to the target perspective mode, thereby controlling the three-dimensional slice model to transform into the target perspective mode indicated by the perspective switching instruction.

[0075] Considering that, in addition to the default poses for the four viewing modes described above, users may also need to view the 3D slice model in a custom pose. In one possible implementation, the method further includes: in response to receiving a pose adjustment instruction for the 3D slice model, transforming the 3D slice model to a target pose indicated by the pose adjustment instruction. This method facilitates the user's ability to adjust the 3D slice model to a custom target pose, allowing the user to view the 3D slice model in different poses.

[0076] Considering that users may also need to adjust the brightness and darkness contrast of different slice tissues in the slice image to highlight certain slice tissues, in one possible implementation, the method further includes: in response to receiving a brightness and darkness adjustment instruction for the slice image in the three-dimensional slice model, adjusting the brightness and darkness contrast of the different slice tissues in the slice image according to at least one of brightness and contrast indicated by the brightness and darkness adjustment instruction. In this way, users can easily customize the brightness and darkness contrast of different slice tissues in the slice image.

[0077] Among them, adjusting the light and dark contrast effects of different slice tissues in the slice image according to at least one of the brightness and contrast indicated by the light and dark adjustment instruction can be understood as re-rendering each slice image in the three-dimensional slice model according to at least one of the brightness and contrast indicated by the light and dark adjustment instruction, so that the light and dark contrast effects of different slice tissues in each re-rendered slice image match the brightness and / or contrast indicated by the light and dark adjustment instruction.

[0078] It should be understood that those skilled in the art can design and develop a triggering method for brightness adjustment instructions according to actual needs. For example, a brightness adjustment control can be provided in the display interface in the manner of the above-mentioned position adjustment control to facilitate users to issue brightness adjustment instructions through the brightness adjustment control. This is not limited to the embodiments of the present disclosure.

[0079] Figure 7 A schematic diagram showing a three-dimensional slice model according to an embodiment of the present disclosure is shown. Figure 7 The three-dimensional slice model in can be a three-dimensional slice model under a cross-sectional perspective. Figure 7 The slice diagram is the same as above Figure 4-6 The light and dark contrast effects of the slices in the middle are different. Figure 7 The slice images shown show higher brightness and contrast of the slice tissue.

[0080] Figure 8 A schematic diagram of a control panel according to an embodiment of the present disclosure is shown. Figure 8The control panel shown provides relevant controls for implementing the above-mentioned various instructions, so that the user can use the control panel to issue the above-mentioned various instructions to the three-dimensional slice model. Among them, the user can click the buttons corresponding to different perspective modes at the "Perspective Mode" to switch the perspective model, and the selected perspective mode can be indicated by highlighting, bolding, changing color, etc.; the "Show All" button can be set at the "Block Mode" to display all three-dimensional blocks, and the "Hide All" button can be set to hide all three-dimensional blocks. The three-dimensional block can also be set to "3D Mode" or "Slice Mode". "3D Mode" can be understood as displaying the complete three-dimensional block of the organ, and "Slice Mode" can be understood as displaying part of the three-dimensional block at the target slice position, and some three-dimensional blocks can have a preset thickness; the "X-axis Dimension", "Y-axis Dimension" and "Z-axis Dimension" can be moved by moving the "hollow circle" on the line segment The target slice position can be adjusted by adjusting the "hollow circles" at both ends of the line segment in the "light and dark contrast" section; the brightness and contrast can be adjusted by adjusting the "hollow circles" at both ends of the line segment, where the two "hollow circles" at both ends can represent the brightness and contrast respectively; the names and colors of the three-dimensional blocks corresponding to different organs can be viewed in the "block list", and a certain three-dimensional block can be hidden by clicking the "hide" button. The input box control for setting color and transparency can also be expanded by clicking the "+" expansion button in front of any three-dimensional block. The user can enter the color value "FF0000" of the target color and the transparency "1.0" in the input box and click the "Update" button to adjust at least one of the color and transparency of the three-dimensional block 2. It should be understood that after clicking the "+" expansion button to expand the input box, the "+" expansion button can be changed to a "-" collapse button, and the user can collapse the above-mentioned input box control after clicking the "-" collapse button.

[0081] It should be understood that the above Figure 8 The control panel shown is an implementation method provided by the embodiment of the present disclosure. Those skilled in the art can customize the design of the control panel and the functional controls contained in the control panel according to actual needs. For example, a control for modifying the name of a three-dimensional block can also be designed, and this embodiment of the present disclosure does not limit this.

[0082] Considering that the 3D data visualization method in related technologies usually downloads the 3D data to a local computer and loads the 3D data using locally installed 3D software, this method is not convenient for viewing 3D slice models. The process of opening 3D slice models is relatively complicated and resource-intensive. The disclosed embodiment provides a method for viewing 3D slice models through a front-end browser. That is, 3D scan data can be loaded from a back-end server and the 3D slice model can be rendered through the front-end browser. In this way, the 3D slice model can be viewed online through the browser without the need for local installation of 3D software, which improves the convenience of viewing 3D slice models.

[0083] In a possible implementation, the three-dimensional data display method is applied to a front-end browser. In step S11, three-dimensional scanning data of a human body part is obtained, including:

[0084] Obtaining original three-dimensional scanning data in an original data format sent by a back-end server; converting the original three-dimensional scanning data into three-dimensional scanning data in a preset data format; and extracting at least one of the following information from the three-dimensional scanning data in the preset data format: slice data of a human body part in three dimensions, slice position information of the slice data in three dimensions, and organ contour information and organ position information of at least one organ in the human body part.

[0085] In one possible implementation, the original data format may adopt the Protobuf format (a data description language that can serialize structured data); wherein, the user can use the Protobuf technology to customize the data format, and the data format constructed using the Protobuf technology can be called the Protobuf format, so as to facilitate data interaction between the front-end browser and the back-end database.

[0086] It is known that when using Protobuf to customize the data format, a Protobuf definition file proto file is usually generated. The proto file contains the interaction data agreed upon by the front-end and back-end for data interaction and the parsing method of the interaction data. Generally, the front-end browser can pre-acquire the Protobuf definition file proto file. After the front-end browser receives the .proto file, it can, for example, use the local open source library grpc-tools and @grpc / grpc-js to convert the .proto file into a specific data access class file (such as a .js file), and add the data access class file to the local program. In this way, the method in the data access class file is used to parse the interaction data in the Protobuf format (such as the original three-dimensional scanning data with the original data format mentioned above). For example, the deserialization binary method in the data access class file is used to deserialize the original three-dimensional scanning data into three-dimensional scanning data with a preset data format, and then the object data acquisition method in the data access class file is used to extract at least one of the above information from the three-dimensional scanning data.

[0087] As described above, the preset data format can be a data format that can be recognized by the browser when rendering the slice image. The preset data format can be, for example, the Vis3D format, which is not limited to this embodiment of the present disclosure. That is, the slice data extracted from the three-dimensional scanning data has the above-mentioned Vis3D format, which is convenient for rendering the slice image based on the slice data.

[0088] As mentioned above, the three-dimensional scanning data can be the data obtained by the CT device scanning the human body part. In order to facilitate the online viewing of the three-dimensional slice model of the human body part through the browser, the CT device can upload the three-dimensional scanning data obtained by the scan to the back-end server. This makes it convenient to obtain the three-dimensional scanning data online from the back-end server through the front-end browser, and display the three-dimensional slice model based on the three-dimensional scanning data.

[0089] In the disclosed embodiment, online visualization of three-dimensional scanning data is realized, and Vis3D format files can be viewed directly in the browser; it supports uploading three-dimensional scanning data to the back-end server, and after uploading, the three-dimensional slice model can be viewed directly online in the browser, which improves the convenience of users viewing the three-dimensional slice model.

[0090] According to the embodiments of the present disclosure, online viewing of three-dimensional scanning data can be realized. Compared with the related art of downloading the three-dimensional scanning data to the local and viewing it using three-dimensional software, the environmental configuration cost required for viewing the three-dimensional scanning data is reduced, and at least two three-dimensional slice models can be rendered simultaneously on a display interface for users to compare and view.

[0091] According to the embodiments of the present disclosure, it can also be applied to a network model training system, which can view the training effect of the network model during network model training. The network model can be used to generate a three-dimensional slice model, thereby improving the development efficiency of the network model.

[0092] It is understood that the above-mentioned various method embodiments mentioned in this disclosure can be combined with each other to form combined embodiments without violating the principle logic. Due to space limitations, this disclosure will not go into details. It is understood by those skilled in the art that in the above-mentioned methods of specific implementation, the specific execution order of each step should be determined by its function and possible internal logic.

[0093] In addition, the present disclosure also provides a three-dimensional data display device, an electronic device, a computer-readable storage medium, and a program, all of which can be used to implement any three-dimensional data display method provided by the present disclosure. The corresponding technical solutions and descriptions are referred to the corresponding records in the method section and will not be repeated here.

[0094] Figure 9 A block diagram of a three-dimensional data display device according to an embodiment of the present disclosure is shown. Figure 9 As shown, the device includes:

[0095] An acquisition module 101 is configured to acquire three-dimensional scanning data of a human body part, wherein the three-dimensional scanning data includes slice data of the human body part in three dimensions and slice position information corresponding to the slice data of the human body part in the three dimensions;

[0096] A determination module 102 is configured to determine slice data at the target slice position according to the target slice position and the slice position information respectively specified in the three dimensions;

[0097] The display module 103 is configured to display a three-dimensional slice model of the human body part according to the slice data at the target slice position, wherein the three-dimensional slice model includes a slice image of the human body part at the target slice position rendered according to the slice data.

[0098] In one possible implementation, the determination module 102 includes: a slice data determination submodule, for determining, in response to receiving a slice position adjustment instruction for a target dimension, slice data at the target slice position under the target dimension indicated by the slice position adjustment instruction; wherein, the display module 103 includes: a slice image rendering submodule, for rendering a slice image of the human body part at the target slice position under the target dimension according to the slice data at the target slice position under the target dimension indicated by the slice position adjustment instruction.

[0099] In one possible implementation, the three-dimensional scanning data also includes organ contour information and organ position information of at least one organ in the human body part, and the device further includes: a block rendering module, configured to render a three-dimensional block corresponding to the at least one organ in the three-dimensional slice model based on the organ contour information and organ position information of the at least one organ; wherein each three-dimensional block has an outer contour similar to that of each organ, and a display position of each three-dimensional block in the three-dimensional slice model corresponds to an actual position of each organ in the human body part.

[0100] In one possible implementation, the device further includes: a tile hiding module for, in response to receiving a hiding instruction for a displayed three-dimensional tile, hiding the three-dimensional tile indicated by the hiding instruction in the three-dimensional slice model; and / or, a tile display module for, in response to receiving a display instruction for a hidden three-dimensional tile, rendering the three-dimensional tile indicated by the display instruction in the three-dimensional slice model.

[0101] In one possible implementation, the three-dimensional image blocks corresponding to different organs in the human body part have different display effects, and the display effects include at least one of color and transparency. The device further includes: a block color conversion module for, in response to receiving a color adjustment instruction for the three-dimensional image block, converting the color of the three-dimensional image block indicated by the color adjustment instruction to a target color indicated by the color adjustment instruction; and / or, a block transparency conversion module for, in response to receiving a transparency adjustment instruction for the three-dimensional image block, converting the transparency of the three-dimensional image block indicated by the transparency adjustment instruction to a target transparency indicated by the transparency adjustment instruction.

[0102] In one possible implementation, the three-dimensional slice model has at least one perspective mode selected from the group consisting of a three-dimensional perspective, a transverse perspective, a longitudinal perspective, and a vertical perspective, wherein the three-dimensional perspective is used to simultaneously display slice images in three dimensions, the transverse perspective is used to display transverse slice images in the X-axis dimension, the longitudinal perspective is used to display longitudinal slice images in the Y-axis dimension, and the vertical perspective is used to display vertical slice images in the Z-axis dimension; wherein the three-dimensional slice model is currently displayed in any perspective mode, and the device further includes: a perspective switching module for, in response to receiving a perspective switching instruction for the three-dimensional slice model, controlling the three-dimensional slice model to transform into a target perspective mode indicated by the perspective switching instruction; and / or, a posture transformation module for, in response to receiving a posture adjustment instruction for the three-dimensional slice model, transforming the three-dimensional slice model into a target posture indicated by the posture adjustment instruction.

[0103] In one possible implementation, the device further includes: a brightness and darkness adjustment module for, in response to receiving a brightness and darkness adjustment instruction for a slice image in the three-dimensional slice model, adjusting the brightness and darkness contrast effects of different slice tissues in the slice image according to at least one of the brightness and contrast indicated by the brightness and darkness adjustment instruction.

[0104] In one possible implementation, the acquisition module 101 includes: an original data acquisition submodule, used to acquire original three-dimensional scanning data in an original data format sent by a back-end server; a data conversion module, used to convert the original three-dimensional scanning data into three-dimensional scanning data in a preset data format; and an information extraction module, used to extract at least one of the following information from the three-dimensional scanning data in a preset data format: slice data of the human body part in three dimensions, slice position information of the slice data in three dimensions, and organ contour information and organ position information of at least one organ in the human body part.

[0105] In the embodiment of the present disclosure, by specifying the target slice position and slice position information respectively in three dimensions, the slice data at the target slice position is determined, and a three-dimensional slice model of the human body part is displayed based on the slice data at the target slice position. The slice images at the three target slice positions specified by the user in three dimensions can be displayed simultaneously in the three-dimensional slice model. In this way, the user can more conveniently and intuitively view the slice images at different target slice positions in different dimensions, thereby improving the viewing efficiency of the slice images.

[0106] In some embodiments, the functions or modules included in the device provided by the embodiments of the present disclosure can be used to execute the method described in the above method embodiments. The specific implementation can refer to the description of the above method embodiments. For the sake of brevity, it will not be repeated here.

[0107] The present disclosure also provides a computer-readable storage medium having computer program instructions stored thereon, wherein the computer program instructions implement the above method when executed by a processor. The computer-readable storage medium may be a volatile or non-volatile computer-readable storage medium.

[0108] An embodiment of the present disclosure further proposes an electronic device, comprising: a processor; and a memory for storing instructions executable by the processor; wherein the processor is configured to call the instructions stored in the memory to execute the above method.

[0109] An embodiment of the present disclosure also provides a computer program product, including computer-readable code, or a non-volatile computer-readable storage medium carrying computer-readable code. When the computer-readable code runs in a processor of an electronic device, the processor in the electronic device executes the above method.

[0110] The electronic device may be provided as a terminal or a device in other forms.

[0111] Figure 10 A block diagram of an electronic device 800 according to an embodiment of the present disclosure is shown. For example, the electronic device 800 may be a user equipment (UE), a mobile device, a user terminal, a terminal, a cellular phone, a cordless phone, a personal digital assistant (PDA), a handheld device, a computing device, an in-vehicle device, a wearable device, or other terminal device.

[0112] Reference Figure 10 , the electronic device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input / output (I / O) interface 812 , a sensor component 814 , and a communication component 816 .

[0113] The processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operation, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 802 may include one or more modules to facilitate interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.

[0114] The memory 804 is configured to store various types of data to support operations on the electronic device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.

[0115] The power supply component 806 provides power to the various components of the electronic device 800. The power supply component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 800.

[0116] The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor can not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the electronic device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have a focal length and optical zoom capability.

[0117] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), which is configured to receive external audio signals when the electronic device 800 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in the memory 804 or transmitted via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0118] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as a keyboard, click wheel, buttons, etc. These buttons may include but are not limited to: a home button, volume buttons, a start button, and a lock button.

[0119] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the electronic device 800. For example, the sensor assembly 814 can detect the open / closed state of the electronic device 800, the relative positioning of components, such as the display and keypad of the electronic device 800. The sensor assembly 814 can also detect changes in the position of the electronic device 800 or a component of the electronic device 800, the presence or absence of user contact with the electronic device 800, the orientation or acceleration / deceleration of the electronic device 800, and the temperature change of the electronic device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include a light sensor, such as a complementary metal oxide semiconductor (CMOS) or charge coupled device (CCD) image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0120] The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 can access a wireless network based on a communication standard, such as wireless network (Wi-Fi), second generation mobile communication technology (2G), third generation mobile communication technology (3G), fourth generation mobile communication technology (4G), long term evolution (LTE) of universal mobile communication technology, fifth generation mobile communication technology (5G), or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0121] In an exemplary embodiment, the electronic device 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0122] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 804 including computer program instructions. The computer program instructions can be executed by the processor 820 of the electronic device 800 to perform the above method.

[0123] The present disclosure may be a system, method and / or computer program product. The computer program product may include a computer-readable storage medium carrying computer-readable program instructions for causing a processor to implement various aspects of the present disclosure.

[0124] Computer-readable storage media can be a tangible device that can hold and store the instructions used by the instruction execution device. Computer-readable storage media can be, for example, (but not limited to) an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination thereof. More specific examples (non-exhaustive list) of computer-readable storage media include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanical encoding device, for example, a punch card or a convex structure in a groove on which instructions are stored, and any suitable combination thereof. Computer-readable storage media used herein is not interpreted as a transient signal itself, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagated by waveguides or other transmission media (for example, light pulses by fiber optic cables), or electrical signals transmitted by wires.

[0125] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. The network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions to be stored in the computer-readable storage medium in each computing / processing device.

[0126] The computer program instructions for performing the operations of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, and conventional procedural programming languages ​​such as "C" language or similar programming languages. Computer-readable program instructions may be executed entirely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., utilizing an Internet service provider to connect via the Internet). In some embodiments, an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), may be personalized by utilizing the state information of the computer-readable program instructions. The electronic circuit may execute the computer-readable program instructions, thereby realizing various aspects of the present disclosure.

[0127] Various aspects of the present disclosure are described herein with reference to flowcharts and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0128] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processor of the computer or other programmable data processing device, a device is generated that implements the functions / actions specified in one or more blocks in the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, where these instructions cause the computer, programmable data processing device, and / or other device to operate in a specific manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing various aspects of the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0129] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0130] The flow charts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple embodiments of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and the part of the module, program segment or instruction contains one or more executable instructions for realizing the prescribed logical function. In some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented by a dedicated hardware-based system that performs the prescribed function or action, or can be implemented by a combination of dedicated hardware and computer instructions.

[0131] The computer program product may be implemented in hardware, software, or a combination thereof. In one embodiment, the computer program product is implemented as a computer storage medium. In another embodiment, the computer program product is implemented as a software product, such as a software development kit (SDK).

[0132] The above description of the various embodiments tends to emphasize the differences between the various embodiments. The same or similar aspects can be referenced with each other and will not be repeated herein for the sake of brevity.

[0133] Those skilled in the art will understand that in the above-mentioned method of the specific implementation method, the writing order of each step does not mean a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be determined by its function and possible internal logic.

[0134] If the technical solution of this application involves personal information, the product that applies the technical solution of this application has clearly informed the personal information processing rules and obtained the individual's voluntary consent before processing personal information. If the technical solution of this application involves sensitive personal information, the product that applies the technical solution of this application has obtained the individual's separate consent before processing sensitive personal information, and at the same time meets the "explicit consent" requirement. For example, on personal information collection devices such as cameras, a clear and prominent sign is set to inform that the personal information collection scope has been entered and personal information will be collected. If the individual voluntarily enters the collection scope, it is deemed that they agree to the collection of their personal information; or on the personal information processing device, when the personal information processing rules are notified by obvious signs / information, the individual's authorization is obtained through pop-up information or by asking the individual to upload their personal information; among which, the personal information processing rules may include information such as the personal information processor, the purpose of personal information processing, the processing method, and the type of personal information processed.

[0135] While various embodiments of the present disclosure have been described above, the above descriptions are illustrative, non-exhaustive, and not intended to be limiting of the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is selected to best explain the principles of the embodiments, their practical applications, or improvements to existing technologies, or to enable others skilled in the art to understand the embodiments disclosed herein.

Claims

1. A three-dimensional data display method, characterized in that: include: Acquire three-dimensional scanning data of a human body part, wherein the three-dimensional scanning data includes slice data of the human body part in three dimensions and slice position information corresponding to the slice data of the human body part in the three dimensions; determining slice data at the target slice position according to the target slice positions respectively specified in the three dimensions and the slice position information; A three-dimensional slice model of the human body part is displayed based on the slice data at the target slice position, wherein the three-dimensional slice model includes: three slice images of the human body part in three dimensions at the target slice position, which are rendered based on the slice data. The three-dimensional slice model has a three-dimensional viewing angle, and the three-dimensional viewing angle is used to simultaneously display the three slice images in the three dimensions, wherein the three slice images are a horizontal slice image in the X-axis dimension, a longitudinal slice image in the Y-axis dimension, and a vertical slice image in the Z-axis dimension.

2. The method according to claim 1, characterized in that The determining of the slice data at the target slice position according to the target slice positions and the slice position information respectively specified in the three dimensions includes: In response to receiving a slice position adjustment instruction for a target dimension, determining slice data at a target slice position under the target dimension indicated by the slice position adjustment instruction; The step of displaying the three-dimensional slice model of the human body part according to the slice data at the target slice position includes: A slice image of the human body part at the target slice position in the target dimension is rendered according to the slice data at the target slice position in the target dimension indicated by the slice position adjustment instruction.

3. The method according to claim 1, characterized in that The three-dimensional scanning data also includes organ contour information and organ position information of at least one organ in the human body part, and the method further includes: Rendering a three-dimensional image block corresponding to the at least one organ in the three-dimensional slice model according to the organ contour information and the organ position information of the at least one organ; Each three-dimensional image block has an outline similar to that of each organ, and the display position of each three-dimensional image block in the three-dimensional slice model corresponds to the actual position of each organ in the human body part.

4. The method according to claim 3, characterized in that The method further comprises: In response to receiving a hiding instruction for a displayed 3D image block, hiding the 3D image block indicated by the hiding instruction in the 3D slice model; and / or, In response to receiving a display instruction for a hidden 3D image block, rendering the 3D image block indicated by the display instruction in the 3D slice model.

5. The method according to claim 3 or 4, characterized in that The three-dimensional image blocks corresponding to different organs in the human body have different display effects, and the display effects include at least one of color and transparency. The method further includes: In response to receiving a color adjustment instruction for a three-dimensional image block, changing the color of the three-dimensional image block indicated by the color adjustment instruction to a target color indicated by the color adjustment instruction; and / or, In response to receiving a transparency adjustment instruction for a three-dimensional image block, the transparency of the three-dimensional image block indicated by the transparency adjustment instruction is transformed into a target transparency indicated by the transparency adjustment instruction.

6. The method according to any one of claims 1 to 4, characterized in that The three-dimensional slice model further has at least one perspective mode of a transverse perspective, a longitudinal perspective, and a vertical perspective, wherein the transverse perspective is used to display a transverse slice image along the X-axis dimension, the longitudinal perspective is used to display a longitudinal slice image along the Y-axis dimension, and the vertical perspective is used to display a vertical slice image along the Z-axis dimension; Wherein, the three-dimensional slice model is currently displayed in any viewing angle mode, and the method further includes: In response to receiving a perspective switching instruction for the three-dimensional slice model, controlling the three-dimensional slice model to transform into a target perspective mode indicated by the perspective switching instruction; and / or, In response to receiving a posture adjustment instruction for the three-dimensional slice model, the three-dimensional slice model is transformed into a target posture indicated by the posture adjustment instruction.

7. The method according to any one of claims 1 to 4, characterized in that The method further comprises: In response to receiving a brightness adjustment instruction for a slice image in the three-dimensional slice model, the brightness and darkness contrast effects of different slice tissues in the slice image are adjusted according to at least one of brightness and contrast indicated by the brightness adjustment instruction.

8. The method according to any one of claims 1 to 4, characterized in that The obtaining of three-dimensional scanning data of a human body part includes: Obtaining original 3D scanning data in original data format sent by the backend server; Converting the original three-dimensional scanning data into three-dimensional scanning data having a preset data format; At least one of the following information is extracted from the three-dimensional scanning data having a preset data format: slice data of the human body part in three dimensions, slice position information of the slice data in three dimensions, and organ contour information and organ position information of at least one organ in the human body part.

9. A three-dimensional data display device, characterized in that: include: An acquisition module is configured to acquire three-dimensional scanning data of a human body part, wherein the three-dimensional scanning data includes slice data of the human body part in three dimensions and slice position information corresponding to the slice data of the human body part in the three dimensions; a determination module, configured to determine slice data at the target slice position according to the target slice positions respectively specified in the three dimensions and the slice position information; A display module is used to display a three-dimensional slice model of the human body part based on the slice data at the target slice position, wherein the three-dimensional slice model includes: three slice images of the human body part in three dimensions at the target slice position, which are rendered according to the slice data. The three-dimensional slice model has a three-dimensional viewing angle, and the three-dimensional viewing angle is used to simultaneously display the three slice images in the three dimensions, wherein the three slice images are a horizontal slice image in the X-axis dimension, a longitudinal slice image in the Y-axis dimension, and a vertical slice image in the Z-axis dimension.

10. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to call the instructions stored in the memory to execute the method according to any one of claims 1 to 8.

11. A computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the computer program instructions are executed by a processor, the method according to any one of claims 1 to 8 is implemented.

Citation Information

Patent Citations

  • Method and device for displaying ultrasonic image, and storage medium

    WO2018195946A1