Method and device for loading medical image and electronic equipment

Abstract

The embodiment of the invention discloses a method and device for loading a medical image and electronic equipment. According to one specific embodiment, the method comprises the steps that target metadata of three-dimensional medical image data are obtained, and the target metadata comprise the resolution ratio and the number of layers; according to the resolution and the number of layers, placeholder data is constructed, and the placeholder data is consistent with volume data indicated by the three-dimensional medical image data in the server in data length and inconsistent with the volume data indicated by the three-dimensional medical image data in the server in pixel value; in response to a viewing instruction of a user, determining a coordinate set of a to-be-reconstructed plane indicated by the viewing instruction based on the placeholder data; sending an acquisition request including the coordinate set; wherein the server obtains a pixel value set corresponding to the coordinate set from the volume data, and returns the pixel value set; and receiving and loading the pixel value set, and displaying a medical image corresponding to a to-be-reconstructed plane. Therefore, a new medical image loading mode is provided.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a method, device and electronic device for loading medical images. Background Art

[0002] In the field of medical imaging, multi-planar reconstruction (MPR) technology is a commonly used 3D image processing technology. It can convert 3D medical image data into 2D images displayed on different planes (such as coronal, sagittal and axial planes). The traditional client MPR loading process is usually based on sequential loading of axial planes layer by layer (such as Figure 2 ) In a normal network environment, it takes >20 milliseconds to load a layer of CT / MR images. Common patient images generally have between 80 and 1000 layers, and the loading time is greatly affected by the number of image layers. For example, when browsing whole-body CT images (nearly 1000 layers), even parallel requests will cause the loading waiting time to reach more than 20 seconds. This method cannot read the images normally when all images are not loaded, thus affecting the doctor's reading efficiency. Especially in emergency medical situations, quickly and accurately obtaining MPR images is crucial for timely diagnosis and treatment.

[0003] Although the existing MPR processing software on the market can realize the reconstruction of multi-plane images, there is still room for improvement in loading speed and user experience. In particular, the loading delay problem is particularly prominent when processing large-scale data. Summary of the invention

[0004] This disclosure section is provided to introduce concepts in a brief form, which will be described in detail in the detailed description section below. This disclosure section is not intended to identify key features or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.

[0005] In a first aspect, an embodiment of the present disclosure provides a method for loading medical images, the method comprising: obtaining target metadata of three-dimensional medical image data, wherein the target metadata comprises resolution and number of layers; constructing placeholder data according to the resolution and number of layers, wherein the placeholder data has the same data length as the volume data indicated by the three-dimensional medical image data in the server, but the pixel values ​​are inconsistent; in response to a user's viewing instruction, determining a coordinate set of a plane to be reconstructed indicated by the viewing instruction based on the placeholder data; sending an acquisition request including the coordinate set; wherein the server obtains a pixel value set corresponding to the coordinate set from the volume data, and returns the pixel value set; receiving and loading the pixel value set, and displaying the medical image corresponding to the plane to be reconstructed.

[0006] In a second aspect, an embodiment of the present disclosure provides a device for loading medical images, comprising: an acquisition unit, used to acquire target metadata of three-dimensional medical image data, wherein the target metadata includes resolution and number of layers; a construction unit, used to construct placeholder data according to the resolution and number of layers, wherein the placeholder data is consistent with the data length of the volume data indicated by the three-dimensional medical image data in the server, but inconsistent with the pixel value; a determination unit, used to determine, in response to a user's viewing instruction, a coordinate set of a plane to be reconstructed indicated by the viewing instruction based on the placeholder data; a sending unit, used to send an acquisition request including the coordinate set; wherein the server obtains a pixel value set corresponding to the coordinate set from the volume data, and returns the pixel value set; a display unit, used to receive and load the pixel value set, and display the medical image corresponding to the plane to be reconstructed.

[0007] In a third aspect, an embodiment of the present disclosure provides an electronic device, comprising: one or more processors; a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the method for loading medical images as described in the first aspect.

[0008] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the method for loading medical images as described in the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale.

[0010] Figure 1 is a flow chart of an embodiment of a method for loading medical images according to the present disclosure;

[0011] Figure 2 is a schematic diagram of a method for loading medical images in the related art;

[0012] Figure 3 is a schematic diagram of one or more embodiments of a method for loading medical images according to the present disclosure;

[0013] Figure 4 is a schematic diagram of a scenario of one or more embodiments of a method for loading medical images according to the present disclosure;

[0014] Figure 5 is a structural schematic diagram of an embodiment of a device for loading medical images according to the present disclosure;

[0015] Figure 6 is an exemplary system architecture in which the method for loading medical images according to an embodiment of the present disclosure may be applied;

[0016] Figure 7 It is a schematic diagram of the basic structure of an electronic device provided according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0017] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0018] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0019] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.

[0020] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0021] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0022] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0023] One or more embodiments of the present application optimize the medical imaging MPR process by adding server-side data preprocessing and caching strategies, while improving the client-side data processing method, so that users can interact immediately in the form of placeholder data, obtain the cross-section of the current interactive plane and placeholder data, and quickly obtain the real pixel data required for all coordinate points on the cross-section (for example, the HU value of each pixel point in CT / MR, which reflects the attenuation of X-rays when passing through human tissue, and thus indirectly reflects the density of the tissue), without waiting for all pixel data to be acquired. Then, the rapid loading and display of the MPR three-view (coronal plane, sagittal plane, axial plane) is realized, thereby significantly improving the efficiency of film reading, reducing the time cost of diagnosis, and providing more timely and accurate support for clinical diagnosis and treatment.

[0024] Please refer to Figure 1 , which shows the process of an embodiment of the method for loading medical images according to the present disclosure. Figure 1 The method for loading medical images shown comprises the following steps:

[0025] Step 101: Acquire target metadata of three-dimensional medical imaging data.

[0026] Here, the target metadata includes the resolution and the number of layers.

[0027] Step 102: constructing placeholder data according to the resolution and the number of layers.

[0028] Here, the placeholder volume data and the volume data indicated by the three-dimensional medical imaging data in the server have the same data length but different pixel values.

[0029] Step 103 : In response to a viewing instruction from the user, determine a coordinate set of a to-be-reconstructed plane indicated by the viewing instruction based on the placeholder data.

[0030] Step 104: Send an acquisition request including the coordinate set.

[0031] Here, the server obtains the pixel value set corresponding to the coordinate set from the volume data, and returns the pixel value set.

[0032] Step 105 , receiving and loading the pixel value set, and displaying the medical image corresponding to the plane to be reconstructed.

[0033] In some embodiments, the client or terminal device may execute Figure 1 The flow of the method is shown.

[0034] Here, target metadata refers to descriptive information related to 3D medical imaging data, such as resolution and number of layers. Resolution determines the clarity of the image, while the number of layers refers to the depth of the image data, that is, the number of slices in 3D space.

[0035] Here, placeholder data is a pre-built data structure that simulates the size and shape of real 3D medical imaging data, but does not contain actual pixel information. The construction of placeholder data helps to allocate memory space and layout in advance before the actual imaging data is loaded, thereby speeding up the loading process.

[0036] Here, the coordinate set of the plane to be reconstructed may refer to the corresponding position of a specific two-dimensional plane that the user wishes to view in the three-dimensional image data. These coordinates may be quickly determined through the placeholder data without waiting for all the image data to be loaded.

[0037] Here, when the user issues a viewing instruction, the system will send a request to the server to provide a set of pixel values ​​corresponding to a specific set of coordinates. This on-demand loading method can reduce the amount of data transmitted over the network and increase the loading speed.

[0038] Here, the pixel value set is the actual image data, which contains the value of each pixel on the plane that the user requests to view. After the server processes the acquisition request, it returns this data to the client.

[0039] Here, the received pixel value set is loaded into the client and the corresponding medical image is displayed

[0040] Here, in the field of medical imaging, volume data usually refers to three-dimensional medical imaging data, such as data generated by CT (computed tomography) and MRI (magnetic resonance imaging) scans. These data can provide detailed three-dimensional views of the internal structure of the human body.

[0041] It should be noted that the method for loading medical images provided in this embodiment obtains target metadata of three-dimensional medical image data, wherein the target metadata includes resolution and number of layers; constructs placeholder data according to the resolution and number of layers, wherein the placeholder data is consistent with the data length of the volume data indicated by the three-dimensional medical image data in the server, but the pixel value is inconsistent; in response to the user's viewing instruction, determines the coordinate set of the plane to be reconstructed indicated by the viewing instruction based on the placeholder data; sends an acquisition request including the coordinate set; wherein the server obtains the pixel value set corresponding to the coordinate set from the volume data and returns the pixel value set; receives and loads the pixel value set, and displays the medical image corresponding to the plane to be reconstructed; can realize the rapid loading and display of MPR three views (coronal plane, sagittal plane, axial plane), thereby significantly improving the efficiency of film reading, reducing the time cost of diagnosis, and providing more timely and accurate support for clinical diagnosis and treatment.

[0042] In contrast, in the reconstruction method in the related art, the total pixel data of the volume data to be constructed cannot be accurately known before the image is pulled, resulting in the inability to perform operations such as reconstruction, scaling, and cropping of the volume data, so it is necessary to wait until all axial surface data are pulled.

[0043] As an example, assuming a CT image with a resolution of 512*512 and 512 layers, for constructing the volume data, the traditional process needs to acquire 512*512*512 pixel data at one time. The process of the present invention only requires the user to acquire 512*512*1 (axial plane, sagittal plane, or coronal plane) pixel data each time, which greatly reduces the time the user waits for data acquisition.

[0044] In some embodiments, responding to a user's viewing instruction and determining a coordinate set of a plane to be reconstructed indicated by the viewing instruction based on the placeholder data includes: determining a cutting plane according to the user's viewing instruction; and determining an intersection of the cutting plane and the placeholder data as the coordinate set of the plane to be reconstructed.

[0045] Here, the cutting plane may be a virtual plane defined in the three-dimensional space according to the user's interactive operation (such as clicking, dragging, etc.). Determining the cutting plane can enable the user to view the three-dimensional medical image from a specified viewing angle.

[0046] Here, the placeholder data is a data structure that is the same size as the actual 3D medical image data but has different pixel values. By determining the intersection of the clipping plane and the placeholder data, the coordinate set of the plane to be reconstructed can be obtained. This process is actually a geometric operation in a virtual 3D space to determine the correspondence between the 2D plane that the user wants to view and the 3D data.

[0047] Therefore, through the pre-built placeholder data, the system can quickly determine the coordinate set of the plane to be reconstructed without waiting for all the image data to be loaded, thereby speeding up the response to user operations. Users can more intuitively and quickly select and view the image planes they are interested in, improving the interactive experience. Since only the data of the user-specified plane needs to be transmitted, rather than the entire three-dimensional data set, this method can reduce the amount of data transmitted over the network, which is particularly important in telemedicine or cloud-based medical imaging services.

[0048] In some embodiments, the user viewing instructions include image rotation instructions and / or image scaling instructions; and determining the intersection of the cutting plane and the placeholder data includes: calculating the intersection of the cutting plane and the placeholder data based on a transformation matrix; wherein the transformation matrix includes one or more of the following: a scaling matrix and a rotation matrix.

[0049] The image rotation command is used to rotate the image around a certain center point by a certain angle. This operation allows users to view the image from different angles to obtain more diagnostic information.

[0050] Image zoom commands are used to enlarge or reduce the display size of an image. Zooming can help users observe a specific part of an image in more detail.

[0051] A transformation matrix is ​​a matrix used to describe and implement geometric transformations such as rotation, scaling, shearing, and translation. A transformation matrix can be applied to each point in an image, changing its position and orientation.

[0052] The Scale Matrix is ​​used to scale an image. The Scale Matrix changes the size of the image but does not change its shape or orientation.

[0053] A rotation matrix is ​​used to rotate an image. A rotation matrix changes the orientation of an image but does not change its size or shape. In two dimensions, a rotation matrix usually has the following form:

[0054] As a result, users can explore 3D medical images more intuitively through rotation and scaling commands, enhancing the interactivity between users and image data. Through the transformation matrix, images can be rotated and scaled in real time without reloading the entire data set, providing smooth visual effects. Using the transformation matrix can reduce direct operations on the original 3D data, thereby improving the efficiency of data processing, especially when processing large-scale data sets.

[0055] In some embodiments, the target metadata includes pixel spacing and slice thickness; and the method further includes: determining a scaling matrix of the volume data according to the pixel spacing and slice thickness.

[0056] Pixel Spacing**: Pixel spacing refers to the physical distance between adjacent pixels on an image.

[0057] Slice thickness refers to the distance between adjacent slices in 3D imaging data. This parameter is very important for understanding the 3D structure of the image and performing volume reconstruction.

[0058] Therefore, by considering the pixel pitch and layer thickness to determine the scaling matrix, it is possible to ensure that the correct proportions and sizes are maintained when processing and analyzing 3D medical images, thereby improving the accuracy of diagnosis and analysis. Using the scaling matrix can effectively adjust the data to optimize transmission efficiency and display effects. The scaling matrix can quickly respond to the user's scaling instructions and provide a smooth user experience.

[0059] In some embodiments, the target metadata includes an image orientation; and the method further comprises: determining a rotation matrix of the volume data based on the image orientation.

[0060] In medical imaging, image orientation refers to the orientation of image slices. For example, in CT or MRI scans, slices can be axial, sagittal, or coronal.

[0061] A rotation matrix can be used to describe a rotation about one or more axes. A rotation matrix can change the position and orientation of a point in an image without changing its size or shape.

[0062] Therefore, by determining the rotation matrix according to the image direction, it is possible to ensure that the image data acquired in different directions can be accurately aligned and fused, so that the three-dimensional reconstructed images can be viewed and analyzed from different angles, which helps to more accurately identify and diagnose lesions.

[0063] In some embodiments, the method further comprises: loading pixel data in the placeholder volume data that has not been loaded, until the placeholder volume data is consistent with the pixel value in the volume data.

[0064] When the client completes the network request for the pixel data of the clipping plane and renders the requested data on the interface, the current interaction has been processed. During and / or after the current request is processed, continue to load the pixel data that has not been loaded in the placeholder data until the placeholder data on the client is completely consistent with the pixel data of the volume data stored on the server. In the client, the current volume data is stored in the client cache to reduce the subsequent repeated loading time and improve the user experience.

[0065] In some embodiments, the server processes the three-dimensional medical image data to generate volume data.

[0066] By adding server-side data preprocessing and caching strategies and improving client-side data processing methods, users can interact immediately in the form of placeholder data, obtain the cross-section of the current interaction plane and placeholder data, and quickly obtain the real pixel data required for all coordinate points on the cross-section without waiting for all pixel data to be obtained.

[0067] As an example, see Figure 3 , Figure 3 The flowchart shows the process of one or more scenarios corresponding to the embodiments of the present application.

[0068] exist Figure 3 In the process shown, the scaling matrix of the volume data is calculated by pre-obtaining the pixel spacing and layer thickness. The number of points on the XYZ axis is determined by pre-obtaining the resolution and number of layers, and the virtual volume data is constructed. The rotation matrix of the virtual volume data is determined by pre-obtaining the image direction. Finally, the user's interaction can be responded to based on the existing virtual volume data, scaling matrix, and rotation matrix. The user determines the reconstructed plane to be displayed through interaction, and the coordinates of all intersection points with the virtual volume data are calculated through the plane equation, and the set of coordinates is sent to the server through a request. The server then returns the real pixel data of the set of coordinates to the client for rendering to the user.

[0069] Step 1: Server-side data processing:

[0070] Input raw 3D medical image data (such as CT or MRI scan data).

[0071] Perform preliminary key information extraction and format conversion on the data to ensure that the following data required for multi-planar reconstruction are obtained: pixel data, pixel spacing, resolution, layer thickness, number of layers, image direction, etc.

[0072] The original data is preprocessed by server-side reconstruction to generate volume data, which is then stored.

[0073] Step 2: Client data initialization:

[0074] Obtain pixel spacing, resolution, layer thickness, number of layers, and image direction from the server, and use these data to calculate the total number of pixels, scaling matrix, and rotation matrix, and then initialize a volume with all pixel data set to 0. The volume data has the same data length as the volume data generated by the same image on the server, but the pixel data is inconsistent. The volume data initialized by the client can be called placeholder volume data.

[0075] Step 3: Client interaction:

[0076] The interaction of the client's coronal, sagittal and axial views is actually to cut the volume data through a plane (for example, please refer to Figure 4 ), so the interaction can be completed by relying on the number of pixels on the XYZ axis in the placeholder data, and the coordinates of all pixel points on the cutting plane can be obtained by calculation.

[0077] A network request is initiated with the coordinates of all the pixels of the clipping plane. The server returns the pixel data of the corresponding coordinates in the stored volume data. The client replaces the received pixel data with the appropriate position in the placeholder volume data.

[0078] Step 4: Data loading optimization:

[0079] When the client completes the network request for the pixel data of the clipping plane and renders the requested data on the interface, it indicates that the current interaction has been processed. The unloaded pixel data in the placeholder data will continue to be loaded until the placeholder data on the client is completely consistent with the pixel data of the volume data stored on the server.

[0080] In the client, the current volume data is stored in the client cache to reduce the subsequent repeated loading time and improve the user experience.

[0081] Further references Figure 5 As an implementation of the methods shown in the above figures, the present disclosure provides an embodiment of a device for loading medical images. Figure 1 Corresponding to the method embodiment shown, the device can be specifically applied to various electronic devices.

[0082] like Figure 5 As shown, the device for loading medical images in this embodiment includes: an acquisition unit 501, a construction unit 502, a determination unit 503, a sending unit 504 and a display unit 505. The acquisition unit 501 is used to acquire target metadata of three-dimensional medical image data, wherein the target metadata includes resolution and number of layers; the construction unit 502 is used to construct placeholder data according to the resolution and number of layers, wherein the placeholder data has the same data length as the volume data indicated by the three-dimensional medical image data in the server, but the pixel value is inconsistent; the determination unit 503 is used to determine the coordinate set of the plane to be reconstructed indicated by the viewing instruction based on the placeholder data in response to the user's viewing instruction; the sending unit 504 is used to send an acquisition request including the coordinate set; wherein the server obtains the pixel value set corresponding to the coordinate set from the volume data and returns the pixel value set; the display unit 505 is used to receive and load the pixel value set, and display the medical image corresponding to the plane to be reconstructed.

[0083] In this embodiment, the specific processing of the acquisition unit 501, the construction unit 502, the determination unit 503, the sending unit 504 and the display unit 505 of the device for loading medical images and the technical effects thereof can be referred to respectively. Figure 1 The relevant descriptions of step 101, step 102, step 103, step 104 and step 105 in the corresponding embodiments are not repeated here.

[0084] In some embodiments, responding to a user's viewing instruction and determining a coordinate set of a plane to be reconstructed indicated by the viewing instruction based on the placeholder data includes: determining a cutting plane according to the user's viewing instruction; and determining an intersection of the cutting plane and the placeholder data as the coordinate set of the plane to be reconstructed.

[0085] In some embodiments, the user viewing instructions include image rotation instructions and / or image scaling instructions; and determining the intersection of the cutting plane and the placeholder data includes: calculating the intersection of the cutting plane and the placeholder data based on a transformation matrix; wherein the transformation matrix includes one or more of the following: a scaling matrix and a rotation matrix.

[0086] In some embodiments, the target metadata includes pixel spacing and slice thickness; and the apparatus is further configured to: determine a scaling matrix of the volume data according to the pixel spacing and slice thickness.

[0087] In some embodiments, the target metadata includes an image direction; and the apparatus is further configured to: determine a rotation matrix of the volume data based on the image direction.

[0088] In some embodiments, the apparatus is further configured to: load pixel data in the placeholder volume data that has not been loaded, until the placeholder volume data is consistent with pixel values ​​in the volume data.

[0089] In some embodiments, the server processes the three-dimensional medical image data to generate volume data.

[0090] Please refer to Figure 6 , Figure 6 An exemplary system architecture is shown in which the method for loading medical images according to an embodiment of the present disclosure can be applied.

[0091] like Figure 6 As shown, the system architecture may include terminal devices 601, 602, 603, a network 604, and a server 605. The network 604 is used to provide a medium for communication links between the terminal devices 601, 602, 603 and the server 605. The network 604 may include various connection types, such as wired, wireless communication links or optical fiber cables, etc.

[0092] The terminal devices 601, 602, and 603 can interact with the server 605 through the network 604 to receive or send messages, etc. Various client applications, such as web browser applications, search applications, and news information applications, can be installed on the terminal devices 601, 602, and 603. The client applications in the terminal devices 601, 602, and 603 can receive user instructions and perform corresponding functions according to the user instructions, such as adding corresponding information to the information according to the user instructions.

[0093] Terminal devices 601, 602, and 603 can be hardware or software. When terminal devices 601, 602, and 603 are hardware, they can be various electronic devices with display screens and supporting web browsing, including but not limited to smart phones, tablet computers, e-book readers, MP3 players (Moving Picture Experts Group Audio Layer III, Moving Picture Experts Group Audio Layer 3), MP4 (Moving Picture Experts Group Audio Layer IV, Moving Picture Experts Group Audio Layer 4) players, laptop computers, and desktop computers, etc. When terminal devices 601, 602, and 603 are software, they can be installed in the electronic devices listed above. It can be implemented as multiple software or software modules (for example, software or software modules used to provide distributed services), or it can be implemented as a single software or software module. No specific limitation is made here.

[0094] The server 605 may be a server that provides various services, such as receiving information acquisition requests sent by the terminal devices 601, 602, and 603, acquiring display information corresponding to the information acquisition requests in various ways according to the information acquisition requests, and sending the relevant data of the display information to the terminal devices 601, 602, and 603.

[0095] It should be noted that the method for loading medical images provided in the embodiment of the present disclosure can be executed by a terminal device, and accordingly, the device for loading medical images can be set in the terminal devices 601, 602, and 603. In addition, the method for loading medical images provided in the embodiment of the present disclosure can also be executed by a server 605, and accordingly, the device for loading medical images can be set in the server 605.

[0096] It should be understood that Figure 6 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

[0097] Reference below Figure 7 , which shows an electronic device (eg, Figure 6 The terminal device in the embodiment of the present disclosure may include but is not limited to mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 7 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0098] like Figure 7 As shown, the electronic device may include a processing device (e.g., a central processing unit, a graphics processor, etc.) 701, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 702 or a program loaded from a storage device 708 into a random access memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the electronic device 700 are also stored. The processing device 701, the ROM 702, and the RAM 703 are connected to each other via a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0099] Typically, the following devices may be connected to the I / O interface 705: input devices 706 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 707 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 708 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 709. The communication devices 709 may allow the electronic device to communicate with other devices wirelessly or by wire to exchange data. Although Figure 7 An electronic device having various devices is shown, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0100] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 709, or installed from a storage device 708, or installed from a ROM 702. When the computer program is executed by the processing device 701, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0101] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0102] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0103] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0104] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device: obtains target metadata of three-dimensional medical imaging data, wherein the target metadata includes resolution and number of layers; constructs placeholder data according to the resolution and number of layers, wherein the placeholder data has the same data length as the volume data indicated by the three-dimensional medical imaging data in the server, but has different pixel values; in response to a user's viewing instruction, determines a coordinate set of a plane to be reconstructed indicated by the viewing instruction based on the placeholder data; sends an acquisition request including the coordinate set; wherein the server obtains a pixel value set corresponding to the coordinate set from the volume data and returns the pixel value set; receives and loads the pixel value set, and displays the medical image corresponding to the plane to be reconstructed.

[0105] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0106] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0107] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware. The name of a unit does not limit the unit itself in some cases. For example, a selection unit may also be described as a "unit for selecting a first type of pixel".

[0108] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0109] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0110] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.

[0111] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0112] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims

1. A method for loading medical images, characterized in that: The method comprises: Acquire target metadata of the three-dimensional medical imaging data, wherein the target metadata includes resolution and number of layers; Constructing placeholder volume data according to the resolution and the number of layers, wherein the placeholder volume data has the same data length as the volume data indicated by the three-dimensional medical imaging data in the server, but has different pixel values; In response to a viewing instruction of a user, determining a coordinate set of a to-be-reconstructed plane indicated by the viewing instruction based on the placeholder data; Sending an acquisition request including the coordinate set; wherein the server obtains a pixel value set corresponding to the coordinate set from the volume data and returns the pixel value set; The pixel value set is received and loaded, and the medical image corresponding to the plane to be reconstructed is displayed.

2. The method according to claim 1, characterized in that The step of responding to a viewing instruction of a user and determining, based on the placeholder data, a coordinate set of a plane to be reconstructed indicated by the viewing instruction includes: Determine the cutting plane according to the user's viewing instructions; The intersection of the clipping plane and the placeholder data is determined as the coordinate set of the plane to be reconstructed.

3. The method according to claim 2, characterized in that The user viewing instruction includes an image rotation instruction and / or an image zoom instruction; as well as The determining the intersection of the clipping plane and the placeholder data includes: According to the transformation matrix, calculate the intersection of the clipping plane and the placeholder data; The transformation matrix includes one or more of the following: a scaling matrix and a rotation matrix.

4. The method according to claim 3, characterized in that The target metadata includes pixel spacing and layer thickness; as well as The method further comprises: A scaling matrix of the volume data is determined according to the pixel spacing and the slice thickness.

5. The method according to claim 3, characterized in that: The target metadata includes image orientation; and The method further comprises: A rotation matrix of the volume data is determined according to the image direction.

6. The method according to claim 1, characterized in that The method further comprises: The pixel data that has not been loaded in the placeholder volume data is loaded until the pixel values ​​in the placeholder volume data are consistent with those in the volume data.

7. The method according to claim 1, characterized in that The server processes the three-dimensional medical image data to generate volume data.

8. A device for loading medical images, characterized in that: The device comprises: An acquisition unit, used for acquiring target metadata of the three-dimensional medical imaging data, wherein the target metadata includes resolution and number of layers; A construction unit, used to construct placeholder data according to the resolution and the number of layers, wherein the placeholder data has the same data length as the volume data indicated by the three-dimensional medical imaging data in the server, but has different pixel values; a determining unit, configured to determine, in response to a viewing instruction of a user, a coordinate set of a to-be-reconstructed plane indicated by the viewing instruction based on the placeholder data; A sending unit, configured to send an acquisition request including the coordinate set; wherein the server obtains a pixel value set corresponding to the coordinate set from the volume data and returns the pixel value set; The display unit is used to receive and load the pixel value set, and to display the medical image corresponding to the plane to be reconstructed.

9. An electronic device, characterized in that: include: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 7.

10. A computer readable medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method described in any one of claims 1 to 7 is implemented.

Images