Method and device for displaying three-dimensional digital model of organ

Abstract

The present disclosure relates to a method and apparatus for displaying a three-dimensional digital model of an organ. The method includes displaying a first user interface, the first user interface including a first three-dimensional digital model of the organ associated with a normal organ. The method also includes displaying a second user interface, the second user interface including a second three-dimensional digital model of the organ associated with a pathological organ, the first three-dimensional digital model of the organ and the second three-dimensional digital model of the organ being at least partially based on the same organ data. The method also includes switching between the first user interface and the second user interface in response to receiving a first interface switching command.

Description

Technical Field

[0001] The present disclosure generally relates to computer graphics technology, and more particularly to a method and apparatus for displaying a three-dimensional digital model of an organ using computer graphics technology. Background Art

[0002] With the development of economy and society and the improvement of people's living standards, health issues have received more and more attention and importance. However, ordinary people who do not have medical knowledge often lack sufficient understanding of the physiological structure and pathological characteristics of various organs (including tissues) of the human body. Traditional means of popularizing medical knowledge, such as physical models, animated videos, etc., cannot observe three-dimensional anatomical structures and dynamic characteristics, or lack interactivity and individual differences.

[0003] The use of three-dimensional computer graphics technology to generate organ models can overcome the shortcomings of these traditional popularization methods to a certain extent. However, the existing three-dimensional digital models of organs generated by computer graphics technology can generally only show one of the normal organs or pathological organs, and cannot reflect the estimated changes from normal to pathological in the same specific organ, or trace the morphological structure and physiological parameters of the specific organ that has already developed pathology back to its previous normal state. Taking the heart as an example, the user may be interested in understanding the appearance of a three-dimensional heart model that appears normal if coronary artery blockage occurs in various locations in the future, so as to form an intuitive understanding of the disease of coronary artery blockage. Or conversely, when a user observes a three-dimensional heart model that shows partial myocardial infarction, he or she may want to trace back to the shape of the heart when it previously appeared normal. The three-dimensional heart model formed according to the existing technology cannot meet these needs. Summary of the invention

[0004] A brief overview of one or more embodiments is given below to facilitate a basic understanding of one or more aspects of the present disclosure. This section does not expand on the embodiments, is not intended to record the key content or key elements of the embodiments, and does not indicate any scope of the embodiments or claims. The sole purpose of this section is to give some concepts of the embodiments to facilitate a more detailed description of the embodiments. It should be understood that the more detailed description below includes further or other optional embodiments beyond the embodiments described in this section.

[0005] The embodiments described herein include display methods, systems, and computer-readable media for three-dimensional digital models of organs to display the evolution and transformation between normal and pathological states of the same organ, helping people gain understanding of organ diseases in an intuitive and convenient manner.

[0006] In one embodiment, a method for displaying a three-dimensional digital model of an organ is provided. The method includes displaying a first user interface, the first user interface including a first three-dimensional digital model of the organ associated with a normal organ. The method also includes displaying a second user interface, the second user interface including a second three-dimensional digital model of the organ associated with a pathological organ, the first three-dimensional digital model of the organ and the second three-dimensional digital model of the organ being at least partially based on the same organ data. The method also includes switching between the first user interface and the second user interface in response to receiving a first interface switching command.

[0007] In some embodiments, the method further includes switching from the second user interface to a third user interface in response to receiving a second interface switching command, wherein the third user interface includes a demonstration of a treatment plan corresponding to the pathological organ.

[0008] In some embodiments, the presentation of the treatment plan includes a third three-dimensional digital model of the organ associated with the treated organ, the third three-dimensional digital model of the organ being based at least in part on the same organ data.

[0009] In some embodiments, at least one of the first user interface or the second user interface also includes a real-time image of the real environment, and at least one of the first organ three-dimensional digital model or the second organ three-dimensional digital model is superimposed on the real-time image of the real environment.

[0010] In some embodiments, the method further includes superimposing a corresponding organ pathological effect onto the second organ three-dimensional digital model based on a position selected by a user on the second organ three-dimensional digital model.

[0011] In some embodiments, the method further includes preloading data of a corresponding three-dimensional digital model of an organ included in the other of the first user interface and the second user interface while displaying one of the first user interface and the second user interface.

[0012] In some embodiments, the method also includes activating a switch button in one of the first user interface and the second user interface to switch to the other user interface in response to data of the corresponding organ three-dimensional digital model included in the other user interface of the first user interface and the second user interface being preloaded.

[0013] In some embodiments, the organ data includes or is based on image data of the organ obtained via at least one of: MRI, X-ray, ultrasound, fluoroscopy, electrocardiogram, electroanatomical mapping, and CT scan.

[0014] In some embodiments, data of at least one of the first three-dimensional digital model of the organ or the second three-dimensional digital model of the organ is acquired from a remote electronic device via a network.

[0015] In some embodiments, at least one of the first three-dimensional digital model of the organ or the second three-dimensional digital model of the organ is dynamic.

[0016] In another embodiment, a computer system is provided. The computer system includes a processor and a storage medium. The storage medium is coupled to the processor and has instructions stored thereon. When the instructions are executed by the processor, the computer system performs the following operations, including: displaying a first user interface, the first user interface including a first organ three-dimensional digital model associated with a normal organ; displaying a second user interface, the second user interface including a second organ three-dimensional digital model associated with a pathological organ; and switching between the first user interface and the second user interface in response to receiving a first interface switching command, wherein the first organ three-dimensional digital model and the second organ three-dimensional digital model are at least partially based on the same organ data.

[0017] In another embodiment, a non-transitory computer-readable medium is provided. The non-transitory computer-readable medium has instructions stored thereon. When the instructions are executed by a processor, the processor: displays a first user interface, the first user interface includes a first organ three-dimensional digital model associated with a normal organ; displays a second user interface, the second user interface includes a second organ three-dimensional digital model associated with a pathological organ; and in response to receiving a first interface switching command, switches between the first user interface and the second user interface, wherein the first organ three-dimensional digital model and the second organ three-dimensional digital model are at least partially based on the same organ data.

[0018] Other embodiments and various non-limiting examples, scenarios and implementations will be described in more detail below. The following description and accompanying drawings set forth certain illustrative embodiments of the present disclosure. However, these embodiments represent only a few of the various ways in which the principles of the present disclosure may be employed. Other advantages and novel features of the embodiments described in the present disclosure will be clearly understood through the following detailed description of the present disclosure, in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The accompanying drawings describe one or more embodiments of the present disclosure, constitute a part of the specification and are used together with the specification to explain the principles of the present disclosure. For ease of description, the sizes of the various parts shown in the accompanying drawings are not drawn according to the actual proportional relationship. At the same time, in the accompanying drawings, the same or similar reference numerals and letters represent the same or similar items in the embodiments of the present disclosure. Therefore, once an item is defined in one accompanying drawing, it does not need to be further discussed in subsequent drawings.

[0020] The present disclosure may be more clearly understood from the following detailed description with reference to the accompanying drawings, in which:

[0021] Figure 1 A block diagram of an example non-limiting environment including a computer operable to implement display of a three-dimensional digital model of an organ according to one or more embodiments of the present disclosure is shown.

[0022] Figure 2 A flow chart of a method for displaying a three-dimensional digital model of an organ according to one or more embodiments of the present disclosure is shown.

[0023] Figure 3 An exemplary user interface for display of a three-dimensional digital model of a normal heart is shown.

[0024] Figure 4 An exemplary user interface for displaying a three-dimensional digital model of a pathological heart is shown.

[0025] Figure 5 An exemplary user interface for displaying a three-dimensional digital model of a treatment plan for a pathological heart is shown. DETAILED DESCRIPTION

[0026] Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that the following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the present disclosure and its applications. Unless otherwise specifically stated, the relative arrangement of components and steps, numerical expressions, and numerical values ​​described in these embodiments should also be interpreted as merely exemplary and not limiting the scope of the present disclosure.

[0027] Technologies, methods, and apparatus known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, these technologies, methods, and apparatus should be considered part of the specification.

[0028] As mentioned above, the three-dimensional digital model of an organ obtained by computer graphics technology in the prior art cannot enable people to gain an intuitive understanding of the evolution and transformation between the normal state and the pathological state of the organ. Therefore, a new method for displaying a three-dimensional digital model of an organ is needed to at least partially solve the above problems of the prior art.

[0029] The present disclosure relates to a display method, system and computer-readable medium for a three-dimensional digital model of an organ. A three-dimensional digital model of a normal organ and a three-dimensional digital model of a pathological organ that at least partially shares the same organ data with the three-dimensional digital model of the normal organ are displayed on a first user interface and a second user interface, respectively, and the first user interface and the second user interface can be switched in response to an interface switching command. The method can provide a display of the evolution and transformation between the normal state and the pathological state of the same organ, helping people to gain an understanding of organ diseases in an intuitive and convenient way.

[0030] In the present disclosure, the terms "including", "comprising" and similar words should be openly understood to mean "including but not limited to". The term "based on" should be interpreted as "based at least in part on". The term "embodiment" or "one embodiment" should be interpreted as "at least one embodiment". The term "another embodiment" should be interpreted as "at least one other embodiment".

[0031] Figure 1 A block diagram of an exemplary electronic device operable to implement display of a three-dimensional digital model of an organ according to one or more embodiments of the present disclosure is shown. The following discussion is intended to provide a general and simple description of suitable electronic devices. The electronic device 100 can be implemented as various computer systems, including mobile phones, digital media players, electronic watches, portable computing devices, and any other mobile or non-mobile devices (including wearable devices, virtual reality devices, etc.) that include a display device or provide data and commands to a display device. The electronic device 100 may include a processor 102, a memory 104, a display device 106, and an input device 108. In some embodiments, the electronic device 100 may include only a processor 102 and a memory 104, and have the ability to provide display data to an external display device and receive control commands from an external input device.

[0032] Processor 102 may be any of a variety of commercially available processors. Dual microprocessors and other multi-processor architectures may also be used as processor 102. In some embodiments, processor 102 may include an integrated image processor. In other embodiments, a separate image processor may be included outside of processor 102 to increase the speed of image data processing and rendering.

[0033] The memory 104 may be a volatile or non-volatile memory. As an illustration and not limitation, the non-volatile memory may include a ROM, a programmable ROM (PROM), an electrically programmable ROM (EPROM), an electrically erasable PROM (EEPROM), a flash memory, or an internal hard drive. The volatile memory may include a RAM, which acts as an external cache memory. As an illustration and not limitation, the RAM may have many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), etc. The memory 104 may store various data (including image data to be processed by the processor 102 and provided to the display device 106). In some embodiments, the memory 104 may include a storage display management module (not shown) for transmitting display data between the processor 102 and the display device 106. By way of example and not limitation, the memory 104 may also store a program product having at least one program module and an operating system, one or more application programs, other program modules, and program data (or executable instructions). Each of the operating system, one or more application programs, other program modules, and program data, or some combination thereof, may include an implementation of a network / cloud computing environment, where at least a portion of the tasks are performed by a remote electronic device connected to the electronic device 100 via a communication network. The program modules generally perform the functions and / or methods of the embodiments as described herein.

[0034] The display device 106 may be any display monitor suitable for use by the electronic device 100 to display image data such as a user interface, including but not limited to a cathode ray tube (CRT), a liquid crystal display (LCD), or a light emitting diode display (LED).

[0035] The input device 108 may be any electronic device suitable for receiving control command input by the electronic device 100, such as a button or key, a mouse, a trackball, a joystick, a touch sensor panel, a touch screen, etc. In some embodiments, the display device 106 and the input device 108 may be implemented in combination in a touch screen. The touch screen may allow a user of the electronic device to perform various functions, such as a user interface switching function, by touching at a location indicated in a displayed user interface using a finger, a stylus, or other object.

[0036] Memory 104, display device 106, and input device 108 may be communicatively coupled to processor 102 via a bus (not shown). The bus may include a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus architectures.

[0037] In some embodiments, the electronic device 100 may also optionally include an image capture device 110. The image capture device 110 may use an optical / infrared sensor or the like to capture images of a real environment, wherein the generated three-dimensional digital model of the organ may be superimposed on the captured image to achieve an augmented reality effect.

[0038] In some embodiments, the electronic device 100 may also optionally connect to a cloud / remote server via a wired or wireless network through the included communication device 112 to obtain part or all of the program modules described above or the image data for display by the display device.

[0039] Figure 2 FIG. 2 shows a flow chart of a method 200 for displaying a three-dimensional digital model of an organ according to one or more embodiments of the present disclosure. The method may be performed by Figure 1 The components in the system shown perform.

[0040] In step S202, a first user interface is displayed, wherein the first user interface includes a three-dimensional digital model of a first organ associated with a normal organ. In this article, the user interface has the broadest meaning commonly used in the art, generally referring to image data provided by a processor and displayed on a display device. In some embodiments, the user interface is interactive, and the user can provide input data or commands by operating elements in the user interface (e.g., clicking a button, selecting a label, or a drop-down menu). Displaying a user interface generally refers to presenting a user interface via a display device. In some cases, such as when the electronic device does not directly include a display device but is coupled to an external display device, it may also include a situation where user interface data is only provided to an external display device.

[0041] Normal organs are defined in comparison with pathological organs, which refer to healthy and diseased organs in terms of medical diagnosis, respectively. Organs can be any tissue of a living organism whose structure and morphology can be three-dimensionally modeled using computer graphics technology, including but not limited to the brain, five sense organs, internal organs (including heart, lungs, liver, kidneys, etc.), bones and muscles of humans or various other animals.

[0042] Displaying the first user interface may include acquiring normal organ data, generating a first organ three-dimensional digital model based on the normal organ data, and displaying the first organ three-dimensional digital model in the first user interface. In some embodiments, the normal organ data may be acquired from various public organ databases and optimized and adjusted. For example, the structural morphological parameter data of a normal heart may be first acquired from a public database, and then the parameter data may be optimized based on the modeler's experience to make the model data of the normal heart closer to the real heart. In other embodiments, the normal organ data may include or be based on image data of the organ obtained via at least one of the following: magnetic resonance imaging (MRI), X-ray, ultrasound, fluoroscopy, electrocardiogram, electroanatomical mapping, and computed tomography (CT) scanning. Similarly, taking the heart as an example, the structural morphological parameter data of a normal heart may be obtained from a large number of heart detection data (generally in DICOM format) acquired by magnetic resonance imaging, ultrasound, CT, and X-ray equipment from a large number of people diagnosed as healthy through statistical methods. After acquiring the normal organ data, various known 3D graphics technologies (such as graphics programming interfaces such as OpenGL and Direct3D) may be used to render the data to generate a first organ three-dimensional digital model and display it in the first user interface under the control of a processor.

[0043] In some embodiments, the normal organ data may be stored in a local memory of the electronic device executing the method 200, and the processor of the electronic device may access and process the data locally and render the data. Since the amount of medical data related to the organ is often very large, if the data is stored and processed locally, a large amount of storage and computing resources will be consumed, which is extremely disadvantageous for implementing the method as an application on an electronic device and the storage and computing resources of the application are limited. Therefore, in other embodiments, the normal organ data may be stored in a remote electronic device, and the electronic device executing the method 200 may receive the normal organ data from the remote electronic device via a wired or wireless network connection. The electronic device may render while receiving at least a portion of the normal organ data to generate a first organ three-dimensional model. This real-time method of "rendering while transmitting" can avoid the user having to wait for a long time to complete the complete transmission of the data before rendering, and is therefore particularly suitable for situations where the transmission bandwidth is small and the local graphics storage and computing resources of the electronic device are very limited.

[0044] In some embodiments, the first user interface may further include a real-time image of the real environment, and the first organ three-dimensional digital model is superimposed on the real-time image of the real environment. The image capture device of the electronic device may be called to collect the real-time image of the real environment while or before displaying the first user interface. The collected real-time image of the real environment may be displayed as a part of the first user interface, and the first organ three-dimensional digital model is superimposed on the part.

[0045] In some embodiments, the first organ three-dimensional digital model can be resized, positioned and oriented based on a command received via an input device. The adjustment may include undergoing rotation, flipping, scaling, translation, etc. Thus, the first organ three-dimensional digital model can be better integrated with the real environment. For example, the size, position and orientation of the heart three-dimensional model in the first user interface can be adjusted to match the heart of a person standing in the real environment. In a further embodiment, the first organ three-dimensional digital model can be resized, positioned and oriented accordingly based on the movement of an object in the real environment captured via an image capture device. For example, when it is detected that a person standing in the real environment rotates his body position, the size, position and orientation of the heart three-dimensional model in the first user interface can be adjusted accordingly.

[0046] In some embodiments, the first organ three-dimensional digital model may be dynamic. "Dynamic" means that the first organ three-dimensional digital model changes over time. For example, when the organ is a heart, the heart model may simulate a real heart beating at a preset or detected heart rate. The size and shape parameters of the heart model that change over time during the beating may also be preset or detected.

[0047] In step S204, a second user interface is displayed, wherein the second user interface includes a second organ three-dimensional digital model associated with the pathological organ, wherein the second organ three-dimensional digital model and the first organ three-dimensional digital model are at least partially based on the same organ data.

[0048] Displaying the second user interface may include acquiring pathological organ data, generating a second organ three-dimensional digital model based on the pathological organ data, and displaying the second organ three-dimensional digital model in the second user interface, wherein the pathological organ data and the normal organ data are at least partially based on the same organ data. The pathological organ data may be pathological parameter data applied on the basis of all or part of the normal organ data. Applying the pathological parameter data may include superimposing the pathological parameter data on the normal organ data at the corresponding position, or modifying the normal organ data at the corresponding position with the pathological parameter data. The pathological parameter data may be an empirical parameter or a statistical parameter of a disease at a certain organ position that is preset or specified via input.

[0049] In turn, the normal organ data may be based on all or part of the pathological organ data to eliminate the pathological parameter data. Eliminating the pathological parameter data may include subtracting the pathological parameter data from the pathological organ data at the corresponding position. Similar to the normal organ data, in some embodiments, the pathological organ data may be obtained from various public organ databases and optimized and adjusted. In other embodiments, the pathological organ data may include or be based on image data of the organ obtained via at least one of the following: magnetic resonance imaging (MRI), X-ray, ultrasound, fluoroscopy, electrocardiogram, electroanatomical mapping, and computed tomography (CT) scanning. After acquiring the pathological organ data, various known 3D graphics technologies (such as graphics programming interfaces such as OpenGL and Direct3D) may be used to render the data to generate a second organ three-dimensional digital model and display it in a second user interface under the control of the processor.

[0050] Similarly, similar to the description of step S202, the pathological organ data can be stored locally in the electronic device or received from a remote electronic device; the second user interface can also include a real-time image of the real environment, and the second organ three-dimensional digital model is superimposed on the real-time image of the real environment; the second organ three-dimensional digital model can also be adjusted in size, position and orientation; the second organ three-dimensional digital model can also be dynamic. The above content about normal organ data and the first user interface is also applicable to pathological organ data and the second user interface, and will not be repeated here.

[0051] In one or more embodiments, based on the position selected by the user on the three-dimensional digital model of the second organ, the corresponding organ pathological effect can be superimposed on the three-dimensional digital model of the second organ. For example, a "hotspot" can be displayed on the three-dimensional digital model of the second organ, where the "hotspot" is a mark for the user to operate (e.g., click) to indicate the selection of the corresponding position. Different positions can correspond to different organ pathological effects. Superimposing the organ pathological effect on the three-dimensional digital model of the second organ refers to adjusting the three-dimensional properties (including position, shape, color, appearance, etc.) of the corresponding data object of the three-dimensional digital model. For example, for a three-dimensional model of a pathological heart with coronary artery obstruction, the "hotspot" can be clicked to display the myocardial infarction effect at the corresponding position, such as the myocardium in an area turning black due to ischemia. Based on the different selected hotspot positions and the relationship between the position and myocardial infarction statistically obtained from a large amount of actual myocardial infarction detection image data, the size of the myocardial necrosis area can be determined.

[0052] In one or more embodiments, if the user selects the second position after selecting the first position, the organ pathological effect corresponding to the first position may be restored, and only the organ pathological effect corresponding to the second position may be displayed.

[0053] In step S206, in response to receiving the first interface switching command, switching is performed between the first user interface and the second user interface. The first interface switching command may be provided by the user through an input device. For example, the user may click a switching button in the first user interface to transition to the second user interface, or vice versa.

[0054] In one or more embodiments, the data of the corresponding organ three-dimensional digital model included in the other user interface of the first user interface and the second user interface can be preloaded while displaying one of the first user interface and the second user interface. For example, the data of the second organ three-dimensional digital model can be preloaded in the background while displaying the first user interface. Preloading can include establishing a new thread to write the data of the second organ three-dimensional digital model into a memory or receiving the data of the second organ three-dimensional digital model from a remote electronic device for the processor to process immediately later. Before the preloading is completed, the switch button in the first user interface can be disabled or not displayed, and it will not be activated or displayed until the preloading is completed. Thus, the completion of the preloading can be indicated. After that, the user clicks the switch button to quickly view the second organ three-dimensional digital model without waiting for a long time to complete the loading of the second organ three-dimensional digital model, thereby obtaining a smooth and pleasant user experience. The disable-activate or do not display-display setting of the switch button is also applicable to switching from the second user interface to the first user interface, and no repeated description is made here.

[0055] In a further aspect, the display method of the three-dimensional digital model of an organ may also involve a treatment plan corresponding to a pathological organ. In one or more embodiments, in response to receiving a second interface switching command, a switch may be made from the second user interface to a third user interface, wherein the third user interface includes a demonstration of a treatment plan corresponding to a pathological organ. The demonstration of the treatment plan may include a third organ three-dimensional digital model associated with the treated organ. The third organ three-dimensional digital model may also be based at least in part on the organ data shared by the second organ three-dimensional digital model and the first organ three-dimensional digital model, so that the user can obtain a full understanding of the process from normal to pathological to treatment for the same specific organ. Similar to the previous description of the first user interface, a real-time image of a real environment may also be included in the third user interface, and the third organ three-dimensional digital model may be superimposed on the real-time image of the real environment.

[0056] The following is an example of the heart organ. Figure 3-5 1 to describe the features of the exemplary first user interface, the second user interface, and the third user interface. It should be appreciated that the following description of the heart is also applicable to various other organs. Moreover, Figure 3-5 The layout and arrangement of elements in the depicted user interface are merely exemplary, and the user interface according to the embodiments of the present application may adopt other layouts and arrangements.

[0057] exist Figure 3 In the embodiment, the first user interface 300 may include a three-dimensional model 302 of a normal heart. The size, position and orientation of the model 302 may be adjusted by the user through various operations such as translation, rotation, flipping and scaling. The three-dimensional model 302 of a normal heart may beat by simulating the heart rate of a real heart. The first user interface 300 may include a "Show Pathology" button 304. While displaying the first user interface 300, a three-dimensional model of a heart with pathology (e.g., coronary artery obstruction) is preloaded in the background. Before preloading is completed, the "Show Pathology" button 304 is gray and cannot be clicked. When preloading is completed, the "Show Pathology" button 304 is activated. The user can click this button to switch to the following display: Figure 4 The second user interface shown in FIG. 300 may include an area 306 in which a real-time image of a real environment captured by an image capture device is displayed. The real environment may be, for example, an operating table. The normal heart three-dimensional model 302 may be placed on the operating table.

[0058] The first user interface 300 may further include a button 308 for selecting different heart morphologies and a button 310 for selecting different body positions. By clicking a "show label" button 312, different labels for different heart morphologies and different body positions may be displayed on the model 302. The labels may change with the translation, rotation, flipping, and scaling of the heart.

[0059] exist Figure 4 In the second user interface 300, the second user interface 300 may include a pathological heart three-dimensional model 402. The model 402 may be based at least in part on the same heart data as the model 302. For example, the model 402 may be obtained by superimposing the pathological parameters of coronary artery obstruction on the model 302. The model 402 may be adjusted in size, position and orientation by the user through various operations such as translation, rotation, flipping, and scaling. The pathological heart three-dimensional model 402 may beat by simulating the heart rate of a real heart. One or more "hot spot" marks 403 may be displayed on the pathological heart three-dimensional model 402. When the user clicks on the "hot spot" 403, the corresponding pathological effect (e.g., myocardial infarction) is displayed at the corresponding position. The pathological effect varies depending on the position change. When the user clicks on the next "hot spot", the pathological effect corresponding to the previous hot spot is restored, and only the pathological effect corresponding to the next "hot spot" appears. The second user interface 400 may include a "treatment plan" button 404. While the second user interface 400 is displayed, a three-dimensional model of a treatment plan (e.g., coronary angioplasty for coronary artery obstruction) is preloaded in the background. Before the preloading is completed, the "treatment plan" button 404 is gray and cannot be clicked. When the preloading is completed, the "treatment plan" button 404 is activated. The user can click this button to switch to the treatment plan. Figure 5The third user interface shown in . The second user interface 400 may include an area 406 in which a real-time image of a real environment collected by an image capture device is displayed.

[0060] Figure 5 Shows the Figure 4 A 3D digital model of an exemplary treatment option for a pathological heart. Figure 5 (a) and 5(b) show the three-dimensional model of the coronary artery before and after coronary angioplasty, respectively. The data of the three-dimensional model 502 of the coronary artery can be based at least in part on the same heart data shared by the model 402 and the model 302. In particular, the three-dimensional model 502 of the coronary artery can be used as or based on a part of the pathological heart three-dimensional model 402. The user can manipulate the catheter 507 through the three-dimensional model 502 of the coronary artery with the coronary artery blockage site 505. After the balloon on the catheter 507 is inflated, it compresses the arterial wall, thereby expanding the arterial caliber. It can be seen Figure 5 (b) shows that the degree of coronary artery obstruction has been reduced. In other examples, the process of catheter 507 placement can be demonstrated through video or animation, while the process before and after placement can be presented through a three-dimensional model.

[0061] Those skilled in the art will recognize that the method and system of the present disclosure may be implemented in many ways. For example, the method and system of the present disclosure may be implemented by software, hardware, firmware, or any combination of software, hardware, and firmware. The above order of steps for the method is for illustration only, and the steps of the method of the present disclosure are not limited to the order specifically described above, unless otherwise specifically stated. In addition, in some embodiments, the present disclosure may also be implemented as a program recorded in a memory, which includes machine-readable instructions for implementing the method according to the present disclosure when executed by a processor. Thus, the present disclosure also covers a tangible and / or non-transient computer-readable storage medium storing a program for executing the method according to the present disclosure.

[0062] Computer-readable storage media can be any available storage media accessible to a computer, and include volatile and non-volatile media, removable and non-removable media. As an example and not limitation, computer-readable storage media can be implemented in conjunction with any method or technology for storing information, such as computer-readable instructions, program modules, structured data, or unstructured data. Tangible and / or non-temporary computer-readable storage media can include, but are not limited to, random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical disk storage, cassettes, magnetic tapes, magnetic disk storage, other magnetic storage devices, and / or other media that can be used to store the desired information.

[0063] Although some specific embodiments of the present disclosure have been described in detail by way of example, it should be understood by those skilled in the art that the above examples are for illustration only and are not intended to limit the scope of the present disclosure. It should be understood by those skilled in the art that the above embodiments may be modified without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.

Claims

1. A method for displaying a three-dimensional digital model of an organ, comprising: Displaying a first user interface on a display device of an electronic device, wherein the first user interface includes a three-dimensional digital model of a first organ associated with a normal organ, wherein displaying the first user interface includes: Acquire normal organ data, generate a first organ three-dimensional digital model based on the normal organ data, and display the first organ three-dimensional digital model in a first user interface; Displaying a second user interface on the display device of the electronic device, the second user interface including a three-dimensional digital model of a second organ associated with a pathological organ, wherein displaying the second user interface includes: Acquiring pathological organ data, generating a second organ three-dimensional digital model based on the pathological organ data, and displaying the second organ three-dimensional digital model in a second user interface; and In response to receiving the first interface switching command, switching between the first user interface and the second user interface, While displaying one of the first user interface and the second user interface, preloading data of the corresponding organ three-dimensional digital model included in the other of the first user interface and the second user interface, The first organ three-dimensional digital model and the second organ three-dimensional digital model are at least partially based on the same organ data. Among them, at least one of the first user interface or the second user interface also includes a real-time image of the real environment captured by the image capture device of the electronic device, and at least one of the first organ three-dimensional digital model or the second organ three-dimensional digital model is superimposed on the real-time image of the real environment.

2. The method according to claim 1, further comprising: In response to receiving the second interface switching command, the second user interface is switched to a third user interface, wherein the third user interface includes a demonstration of a treatment plan corresponding to the pathological organ.

3. The method according to claim 2, wherein the demonstration of the treatment plan includes a third organ three-dimensional digital model associated with the treated organ, and the third organ three-dimensional digital model is at least partially based on the same organ data.

4. The method according to claim 1, further comprising: detecting movement of an object in the real environment; as well as The size, position and orientation of at least one of the first organ three-dimensional digital model or the second organ three-dimensional digital model is adjusted based on the detected movement of the object in the real environment.

5. The method according to claim 1, further comprising: Based on the position selected by the user on the second organ three-dimensional digital model, the corresponding organ pathological effect is superimposed on the second organ three-dimensional digital model.

6. The method according to claim 1, further comprising: In response to the data of the corresponding organ three-dimensional digital model included in the other user interface among the first user interface and the second user interface being preloaded, a switch button is activated in the one user interface among the first user interface and the second user interface to switch to the other user interface.

7. The method of claim 1, wherein the organ data comprises or is based on image data of the organ obtained via at least one of: MRI, X-ray, ultrasound, fluoroscopy, electrocardiogram, electroanatomical mapping, and CT scan. 8 . The method according to claim 1 , wherein data of at least one of the first organ three-dimensional digital model or the second organ three-dimensional digital model is acquired from a remote electronic device via a network. 9 . The method according to claim 1 , wherein at least one of the first organ three-dimensional digital model or the second organ three-dimensional digital model is dynamic.

10. A computer system comprising: processor; and A storage medium coupled to the processor and having instructions stored thereon, the instructions, when executed by the processor, causing the computer system to perform the following operations: Displaying a first user interface on a display device of an electronic device, wherein the first user interface includes a three-dimensional digital model of a first organ associated with a normal organ, wherein displaying the first user interface includes: Acquire normal organ data, generate a first organ three-dimensional digital model based on the normal organ data, and display the first organ three-dimensional digital model in a first user interface; Displaying a second user interface on the display device of the electronic device, the second user interface including a three-dimensional digital model of a second organ associated with a pathological organ, wherein displaying the second user interface includes: Acquiring pathological organ data, generating a second organ three-dimensional digital model based on the pathological organ data, and displaying the second organ three-dimensional digital model in a second user interface; and In response to receiving the first interface switching command, switching between the first user interface and the second user interface, While displaying one of the first user interface and the second user interface, preloading data of the corresponding organ three-dimensional digital model included in the other of the first user interface and the second user interface, The first organ three-dimensional digital model and the second organ three-dimensional digital model are at least partially based on the same organ data. Among them, at least one of the first user interface or the second user interface also includes a real-time image of the real environment captured by the image capture device of the electronic device, and at least one of the first organ three-dimensional digital model or the second organ three-dimensional digital model is superimposed on the real-time image of the real environment.

11. The computer system of claim 10, wherein the instructions further cause the computer system to perform the following operations: In response to receiving the second interface switching command, the second user interface is switched to a third user interface, wherein the third user interface includes a demonstration of a treatment plan corresponding to the pathological organ.

12. The computer system of claim 11, wherein the presentation of the treatment plan includes a third three-dimensional digital model of an organ associated with the treated organ, the third three-dimensional digital model of an organ being based at least in part on the same organ data.

13. The computer system of claim 11, wherein the instructions further cause the computer system to perform the following operations: Based on the position selected by the user on the second organ three-dimensional digital model, the corresponding organ pathological effect is superimposed on the second organ three-dimensional digital model.

14. The computer system of claim 11, wherein the instructions further cause the computer system to perform the following operations: detecting movement of objects in the real environment; and The size, position and orientation of at least one of the first organ three-dimensional digital model or the second organ three-dimensional digital model is adjusted based on the detected movement of the object in the real environment.

15. A non-transitory computer-readable medium having instructions stored thereon, which, when executed by a processor, cause the processor to: Displaying a first user interface on a display device of an electronic device, wherein the first user interface includes a three-dimensional digital model of a first organ associated with a normal organ, wherein displaying the first user interface includes: Acquire normal organ data, generate a first organ three-dimensional digital model based on the normal organ data, and display the first organ three-dimensional digital model in a first user interface; Displaying a second user interface on the display device of the electronic device, the second user interface including a three-dimensional digital model of a second organ associated with a pathological organ, wherein displaying the second user interface includes: Acquiring pathological organ data, generating a second organ three-dimensional digital model based on the pathological organ data, and displaying the second organ three-dimensional digital model in a second user interface; and In response to receiving the first interface switching command, switching between the first user interface and the second user interface, While displaying one of the first user interface and the second user interface, preloading data of the corresponding organ three-dimensional digital model included in the other of the first user interface and the second user interface, The first organ three-dimensional digital model and the second organ three-dimensional digital model are at least partially based on the same organ data. Among them, at least one of the first user interface or the second user interface also includes a real-time image of the real environment captured by the image capture device of the electronic device, and at least one of the first organ three-dimensional digital model or the second organ three-dimensional digital model is superimposed on the real-time image of the real environment.

16. The computer-readable medium of claim 15, wherein the instructions further cause the processor to: In response to receiving the second interface switching command, the second user interface is switched to a third user interface, wherein the third user interface includes a demonstration of a treatment plan corresponding to the pathological organ.

17. The computer-readable medium of claim 16, wherein the presentation of the treatment plan includes a third three-dimensional digital model of an organ associated with the treated organ, the third three-dimensional digital model of an organ being based at least in part on the same organ data.

18. The computer-readable medium of claim 15, wherein the instructions further cause the processor to: detecting movement of objects in the real environment; and The size, position and orientation of at least one of the first organ three-dimensional digital model or the second organ three-dimensional digital model is adjusted based on the detected movement of the object in the real environment.

Images