Method for analysing medical image data in a virtual multi-user collaboration, a computer program, a user interface and a system

IN605821BActive Publication Date: 2026-10-13KONINKLIJKE PHILIPS NV
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
IN202247015446
Authority / Receiving Office
IN · IN
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-09-03
Filing Date
2022-03-21
Publication Date
2026-10-13
Estimated Expiration
2040-08-28

AI Technical Summary

Technical Problem

Current multi-user VR solutions for medical image analysis lack efficiency in collaboration, as users must actively share analysis results and undergo repetitive steps to provide information, leading to reduced collaboration efficiency and potential misinterpretation of spatial relationships in 3D medical data.

Method used

A method for analyzing medical image data in a virtual multi-user collaboration environment where each user has full control over their visualization, allowing independent changes and real-time synchronization of results across workspaces, utilizing XR technologies for immersive and interactive 3D visualization.

Benefits of technology

Enhances collaboration efficiency by allowing each user to maintain control over their visualization while sharing results in real-time, reducing the need for repetitive interactions and improving the accuracy of spatial understanding in 3D medical data analysis.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

There is provided a method for analysing medical image data (34) in a virtual multi-user collaboration, wherein the medical image data (34) is analysed by at least two users (A, N,C, S), each user having his / her own workspace (30), wherein the workspace is a VR- and / or AR- and / or MR-workspace, the method including the steps of providing medical image data (34) including 3D or 4D image information, loading the medical image data (34) into the workspace (30) of each user so as to simultaneously display a visualization of the medical image data (34) to each user, allowing each user to individually and independently from each other change the visualization of the medical image data (34), so as to obtain an individual visualization of the medical image data (34) in each workspace (30) pertaining to each user, allowing at least one user to execute an analysing process of the medical image data (34) in his / her workspace, displaying the result of the analysing process in the workspace (30) in which the analysing process was carried out, and synchronizing the result of the analysing process in real-time with the at least one other workspace (30) such that each workspace (30) displays the result of the analysing process in the respective individual visualization of the medical image data (34). Further, there is provided a computer program relating to the above method. In addition, a user interface and a system used during execution of the above method are provided.
Need to check novelty before this filing date? Find Prior Art

Description

FIELD OF THE INVENTIONThe present invention relates to a method for analysing medical image data ina virtual multi-user collaboration, a computer program related to the method, a user interfaceused in the method and a system configured to perform the method.BACKGROUND OF THE INVENTIONMedical imaging techniques provide three-dimension (3D) - or even fourdimensional(4D) - medical image data of the human or animal body. However, the imagedata is usually viewed and analyzed on two-dimensional (2D) screens. Therefore, there is anomnipresent risk to misinterpret the relative spatial relationships between anatomicalstructures represented on medical image data provided in 3D or 4D, when the medical imagedata is analyzed and interpreted on 2D screens. Specifically, when a team of specialistsconsisting of different persons are simultaneously analyzing the same medical image data,the risk of misunderstanding and misinterpretation of spatial relationships, resulting in wrongclinical decisions, is high.Latest developments in the field of microprocessors, cameras and sensorsallow for affordable consumer ready VR headsets which are widely accepted by the massmarket.Virtual Reality (VR)technology provides users with a complete immersion in avirtual environment and a stereoscopic 3D representation of 3D content.Driven mostly by the gaming and entertainment industry, the highly-intuitive control viatracked headset and hand controllers (combined 18 degree of freedom) allows a very naturalinteraction with virtual objects, which in turn leads to a greater ease of use and accessibility.Existing multi-user VR applications are avatar-based in which several users can be in thesame scene at the same time to, e.g., manipulate a model of an object. Unfortunately, theseavatar-based multiuser solutions are not well matched to more demanding requirements ofprofessional medical VR collaboration, in which a meaningful and time-efficient assessmentof virtual 3D datasets, objects (e.g., cut planes) and measurements is required. In addition, theknown techniques seem to be inappropriate for professional users (e.g. clinicians) requiringto individually analyze and evaluate the 3D content. Therefore, it would be desirable to havea multiuser VR collaboration solution capable of exploiting the full potential of VR andenabling several clinicians to efficiently and simultaneously work on a same 3D dataset withall the advantages that the VR environment offers. Further, it would be desirable, in order toenhance the collaboration efficiency of a team of professional users, to interactively andautomatically share the result of analysis and evaluation made by each user.David W. Shattuck discloses in "VR-framework for multiuser virtual realityenvironment for visualizing neuroimaging data" in Healthcare Technology Letters; Receivedon 13th August 2018; accepted on 20th August 2018, that a VR framework can supportmultiple simultaneous users operating in the same virtual space using a client-server model,where one user operates as the server and has control over the system display. The VRenvironment for each user is driven by an individual network computer connected to theuser's headset. Each client computer has access to a copy of the data to be displayed, whichcan be either on a local drive or a shared network drive. The server listens for clients on aTCP / IP port and then establishes a network connection with each client. Once a client isconnected, the server will routinely transmit a small data object that contains viewing stateinformation, which each client uses to update its display. This object includes data necessaryto synchronize the view, such as rotation, scale, volume position, and cutting plane. Eachclient transmits pose information for its headsets and controllers to the server, whichbroadcasts these to the other clients for display. Models of the headsets and controllers for theother users in the system are rendered in each individual client view. This enables users tointeract directly with each other and also helps to avoid real-world collisions between usersoperating in a shared physical space.Klaus Engel discloses in "Texture-based Volume Visualization for MultipleUsers on the World Wide Web" a texture-based volume visualization tool, which permitsremote access to radiological data and supports multi-user environments. The tool allows theshared viewing and manipulation of three-dimensional medical volume datasets in aheterogeneous network. Volume datasets are transferred from a server to different clientmachines and locally visualized using a JAVA-enabled web-browser. In order to reducenetwork traffic, a data reduction and compression scheme is proposed. The application allowsview dependent and orthogonal clipping planes, which can be moved interactively. On theclient side, the users are able to join a visualization session and to get the same view onto thevolume dataset by synchronizing the viewpoint and any other visualization parameter.Interesting parts of the dataset are marked for other users by placing a tag into thevisualization. In order to support collaborative work, users communicate with a chat applet,or by using any existing video conferencing tool.Dieter Schmalstieg discloses in "Bridging Multiple User Interface Dimensionswith Augmented Reality" an experimental user interface system, which uses collaborativeaugmented reality to incorporate true 3D interaction into a productivity environment. Thisconcept is extended to bridge multiple user interface dimensions by including multiple users,multiple host platforms, multiple display types, multiple concurrent applications, and a multicontext(i.e., 3D document) interface into a heterogeneous distributed environment. Contextsencapsulate a live application together with 3D (visual) and other data, while locales are usedto organize geometric reference systems. By separating geometric relationships (locales)from semantic relationships (contexts), one achieves a great amount of flexibility in theconfiguration of displays. Multiple users are working on separate hosts. They can sharecontexts, but can layout the context representations (3D-windows) arbitrarily according toscreen format and personal preferences. This is made possible by defining separate locales, asthe position of 3D-windows is not shared across locale boundaries. In other words, oneshared object can be viewed by multiple users from different perspectives.EP 3496046 A1 concerns a method for displaying medical image data on atleast one display medium for a group of at least two interactive viewers, having the steps ofproviding medical image data which contain at least one 3D or 4D image data set of aspecific examination area of a patient; and providing a possibility for displaying the medicalimage data in an interactive, virtual environment, wherein each interactive viewer has its ownvirtual position. Further, each interactive viewer can change his / her virtual position andoptionally his / her viewing angle independently of the other viewers.US 2014 / 0033052 A1discloses methods and systems for displayingholograms. One exemplary embodiment provides a system comprising: a light source; animage producing unit, which produces an image upon interaction with light approaching theimage producing unit from the light source; an eyepiece; and a mirror, directing light fromthe image to a surface of the eyepiece, wherein the surface has a shape of a solid ofrevolution formed by revolving a planar curve at least 180° around an axis of revolution. As aresult, the hologram is generated that can be viewed from different sides. Further, thehologram may be manipulated by a user.However, the problems mentioned above remain, in other words, acollaboration efficiency is not significantly enhanced because analyzing results of the usershave to be actively shared among the users based on a command of one or more users. As aresult, repetitive working steps are necessary to provide users with relevant informationobtained by other users.OBJECT OF THE INVENTIONIt is therefore an object of the invention to provide a method for analysingmedical image data in a virtual multi-user collaboration in which each user has full controlover the visualization of the medical image data in his / her workspace while at the same timethe collaboration efficiency is kept high, that is, a team of professional users are able to worksimultaneously on the same medical image data. According to a further object of theinvention, a selectable part of the individual work can be automatically shared among theusers. It is also an object of the present invention to provide a respective computer program, auser interface configured to be used in executing the method and a system for virtualcollaboration for interaction with 3D medical image data allowing the user to still maintainfull control over the visualization of the medical image data.SUMMARY OF THE INVENTIONTo better address one or more of the above-identified concerns, in a firstaspect of the invention a method for analysing medical image data is presented in claim 1.Useful embodiments are set out in the dependent claims.In accordance with this first aspect, the invention is directed to a method foranalysing medical image data in a virtual multi-user collaboration, whereinthe medical image data is analysed by at least two users,each user having his / her own workspace, wherein the workspace is a XRworkspace.the method including the steps of:providing medical image data including 3D or 4D image information,loading the medical image data into the workspace of each user so asto simultaneously display a visualization of the medical image data to each user,allowing each user to individually and independently from each otherchange the visualization of the medical image data, so as to obtain an individual visualizationof the medical image data in each workspace pertaining to each user,allowing at least one user to execute an analysing process of themedical image data in his / her workspace,displaying the result of the analysing process in the workspace inwhich the analysing process was carried out, andsynchronizing the result of the analysing process in real-time with theat least one other workspace such that each workspace displays the result of the analysingprocess in the respective individual visualization of the medical image data.In the context of this invention, the term XR stands for X reality or CrossReality, which is a generic term comprising at least Virtual Reality (VR), Augmented Reality(AR), Mixed Reality (MR), and Cinematic Reality (CR). XR may be defined as atechnology-implemented experience of a virtual environment, often combined with realworld objects, or a combination of a real world environment combined with virtualenvironments or objects. X Reality encompasses a wide spectrum of hardware and software,including sensory int erfaces, applications, and infrastructures, that enable content creation forvirtual reality (VR), mixed reality (MR), augmented reality (AR), cinematic reality (CR).With these tools, users generate new forms of reality by bringing digital objects into thephysical world and bringing physical world objects into the digital world. XR is used here torefer to various technologies including VR, AR or MR. In many cases, in order to provide anX Reality, a computer-generated visualisation providing a truly three-dimensional experienceof the depicted structures is implemented, in particular by using screens or glasses showing aslightly different image to each eye. Further, the user may often interact with the XR bygestures and other movements, e.g. walk around in the XR and grab virtual objects. The XRof the invention may provide in particular visual feedback, but may also allow other types ofsensory feedback, such as auditory or haptic feedback to a user. Preferably, the XR of thepresent invention does only use gestures (e.g. of fingers, arms, legs and / or head of a user) ormovements of a user as an input in order to provide the user with sensory feedback. Inparticular, the present invention may not need an eye tracker in order to provide the user withsaid feedback. That is, the visualization of the present invention may be shown to the userfrom different viewing positions without the need of providing such eye tracker.In VR, the real environment is usually not visible to the user, it is completelyoverlaid with a virtual world. This effect is commonly created by VR headsets consisting of ahead-mounted display with a small screen in front of the eyes, but can also be createdthrough specially designed rooms with multiple large screens. A person using virtual realityequipment is able to look around the artificial world, move around in it, and interact withvirtual features or items.Generally, Mixed reality (MR) is the merging of real and virtual worlds toproduce new environments and visualizations where physical and digital objects co-exist andinteract in real time. More specifically, MR may be defined as an experience of the realenvironment combined with virtual objects which however is created by technology, forexample a VR headset using its cameras to create a virtual reality which corresponds at leastin parts to the real environment. Thus, virtual objects can be overlaid on the real environmentat their correct position, they may even hide real objects and vice versa.In AR, the real world is still visible, and virtual objects are superposed (i.e. overlaid) over thereal environment. This effect may be created by special glasses such as Microsoft HoloLenswhich allows the user to see the real environment, but which also uses cameras to form a 3Dmodel of such real environment so that virtual objects can be overlaid over the realenvironment via the glasses.Thus MR or AR may include the real environment as a background in front ofwhich the visualization is displayed. For example, two users present in the same room andeach wearing AR glasses may interact with each other in the real world and in the AR, whileboth users have their own individual view of the medical image data (i.e. each user hashis / her own visualisation of the medical image data).The visualisation may be an effigy (i.e. an image) of a real object (e.g. ahuman or animal heart). That is, the visualisation may be a model representing the realobject, wherein parameters of the visualisation may be changed with respect to the real object(e.g. the size, contrast, colour, partly enlarged regions etc.). In order to visualize the medicalimage data, the technique of volume ray casting may be used. In this technique, a ray isgenerated for each desired image pixel. Using a simple camera model, the ray starts at thecentre of protection of the camera (usually the viewing position or eye point) and passesthrough the image pixel on an imaginary image plane floating between the camera and thevolume to be rendered. Then the ray is sampled at regular or adapted intervals throughout thevolume. The data is interpolated at each sample point, a transfer function applied to form anRGBA sample, the result added onto the accumulated RGBA of the ray, and the processrepeated until the ray exits the volume. The process is repeated for every pixel on the screento form the completed visualization.For example, the medical image data may be visualized using volumerendering. The volume rendering of the visualisation may be performed by techniquesdescribed in "The Visualization Handbook", edited by Charles H. Hansen and Christopher R.Johnson, Elsevier Butterworth Heinemann 2005, especially in the Chapter "Overview ofVolume Rendering" by Arie Kaufmann starting on p. 127, and which is incorporated hereinby reference.Technically, the XR may be realised by presenting stereo images to the user,i.e. each eye sees a different image, so that the brain will put together the two differentimages to a true three-dimensional scene. Such binocular images may be presented on anyXR display, such as a VR headset, AR glasses or a multi-projected environment, or a screenshowing the two images intermittently, in connection with shutter glasses. In the XR, thevisualization may be displayed by stereoscopic rendering: Therein, the visualisation iscalculated twice, for two viewing positions having a slight spatial offset, i.e. one viewingposition for the left eye and one for the right eye. When the two thus calculated visualisationsare shown to the user one on each eye, e.g. on a VR headset, the user gains a truly three-dimensional (VR) impression. Thereby, the visualization can be converted, viewed andanalysed in XR. The XR enables the user using the XR to "look around" the artificial world,move around in it, and interact with virtual objects, features or items. The effect is commonlycreated by XR headsets comprising a head-mounted display with a small screen in front ofeach eye, but can also be created through specially designed rooms with multiple largescreens. In order for the user to move around in the XR, position and orientation informationhave to be transmitted by the headset to the electronic device (e. g. computer) generating theXR, so that the visualisation is moving in coherence with head movements of the user.The medical image data may be dynamically rendered (e.g. volume renderedor surface rendered) so as to be visualized in each XR-workspace as the visualization. Inmore detail, volume rendering may be based on spatial intensity data (i.e. voxel data).Depending on the resolution of the medical image data there may be an intensity data foreach point in space or for a region in space. In other words, in volume rendering eachavailable image data information is rendered, which results in a considerable high computingcapacity that is needed. On the other hand, in surface rendering, only one "layer" (i.e. thevisible surface) is rendered, wherein the image data existing behind the layer is not rendered.The surface rendered medical image data may be a computer graphical model consisting of aplurality of triangular shaped surfaces. As a result, for surface rendering less computingcapacity is needed. In order to attain an increased efficiency during the rendering processwhile still providing a sufficient visualized data density, both techniques may be combinedsuch that a region of interest may be rendered using the method of volume rendering andperipheral regions may be rendered using the method of surface rendering.In a preferred embodiment, the medical image data may be visualized using avolume rendered object which has the advantage that it is suitable for more complexanatomies or highly individual structures like valve leaflet cusps, stenosis, calcifications, bio30protheses, ruptured chordae etc. Alternatively or additionally, the medical image data may bevisualized using a dynamic, computer-generated model of at least a part of an anatomicalstructure. Such models have the advantages that they show a simpler version / abstraction ofthe anatomy, make it easier to navigate and interpret the anatomy, and are not very muchdependent on the medical image data quality. The model (i.e. the simplification of theanatomical structure) may be a triangulated surface model of a particular interface within theanatomical structure, for example the blood-tissue interface of a blood vessel or a heartchamber. The model may comprise a number of points spanning a line or a surface for eachframe. It may also be a mathematical model, for example a parametrised model, such as asurface or volume spanned by spline curves. The model is dynamic, i.e. it follows themovement of the anatomical structure across the time period. The purpose of the dynamicmodel is to visualise at least a part of the anatomical structure, for example one or severalchambers of the moving heart, without obstructing the view of the user with too much detail.Therefore, such simplified models are useful in providing an orientation to the user, forexample when planning an intervention or making measurements on a particular part of theanatomy. The 3D visualization of the dynamic 3D model is typically a rendering of adynamic shape or surface model, wherein the rendering may be done by techniques availablefrom computer graphics, including shading, ray casting, ambient occlusion etc.. The volumerendering may be performed by any volume rendering technique known in the art forexample as described in US 2005 / 0253841 A1, incorporated herein by reference.Further, the medical image data may include information of an anatomicalstructure which may be an organ or part of an organ of the human or animal body such asheart, but may be also a blood vessel or a bone structure. In more detail, the medical imagedata may include a 3D scatter plot including points within a 3D coordinate system, whereineach point has its own x, y and z component within the 3D coordinate system. In addition tothe above-outlined, the medical image data may include digital image data e.g. in DICOMstandard i.e. containing a three-dimensional array of voxels, each voxel containing a greyscale value. Such medical data (3D medical images) may be obtained from a field of viewcontaining the dynamic anatomical structure using a medical imaging modality such as MR,computed tomography (CT), position emission tomography (PET), or ultrasound (US). Incase the anatomical structure is the heart, ultrasound and in particular three-dimensionalechocardiography may be advantageously used. That is, the different medical image data maybe derived from ultrasound images having different frequencies, computed tomographyhaving different acceleration voltages or images including contrast medium or not. Inaddition, the medical image data may include 4D medical image data, wherein the fourthdimension is time. One 3D image from the time sequence of 3D images forming a 4Dmedical image may also be called a "frame" in the following. That is, 4D medical image dataincludes the visualization of 3D images across time which means that a sequence ofvisualizations is shown dynamically, at a frame rate of e.g. 60-100 visualizations per second.That is, 4D medical image data may be visualized as animated movie (i.e. in a cine-mode) soas to visualize the operation of a thorax of a patient, for example. If, 4D medical image dataare visualized, the sequence may be rendered in a movie-like manner. The 3D images may beacquired with a frame rate of e.g. 5 - 100, preferably more than30 images per second, so as toallow a smooth representation of the dynamically moving anatomical structure. Medicalimage data may include further medical and / or administrative information e.g. information ofthe patient, the currently executed therapy etc.. Medical image data may include severalimage data which are preferably registered to each other in space, so they can be overlaidwith each other, each user may select which one should be displayed in his / her workspace.Accordingly, the medical image data may be considered as a shared content that may beshared by all users. The shared content may include raw data such as the digital image dataand / or the 3D scatter plot including points within a 3D coordinate system. In addition oralternatively, the shared content may include pre-processed data like slices, segmentations orsurface models based on the medical image data. Such pre-processed data may be consideredas model data. Accordingly, the visualization in each workspace may include a visualizationof raw data (i.e. 3D data) and of model data (i.e. pre-processed data). By combining modeldata and raw data as the shared content, each workspace has less of the usually more complexraw data to process so that the collaboration can be conducted using normal personalcomputers without the need for massive computation capabilities. In other words, theintensive computations necessary to produce pre-processed data may be performedcentralized, and the result may be provided for each user as the shared content. By providingthe shared content in each workspace, the user may be provided with an overall view of theissues to be discussed during the collaboration. For example, the raw data may be used tovisualize the most important organ or part of an organ (i.e. a region of interest) and the modeldata may be used to visualize the surroundings of the region of interest. For example, the rawdata may be used to visualize a heart valve and the model data may be used to visualize therest of the heart. As a result, an optimal efficiency of the visualization may be obtained.Further, the model data may be individually switched off or on by each user so as to only seethe visualization of the raw data. As a result, each user may individually decide whetherhe / she needs both visualizations for analysing the medical image data.The medical imaging modality may be capable of attaining up to 30 volumesper second (i.e. medical image data representing a region under inspection), therefore, therendered 3D object may be updated each time new medical image data are available. In otherwords, the rendered 3D object may be dynamically updated. This is particularly useful, if apatient is simultaneously examined while the collaboration takes place, in cases in which thepatient is in an emergency, for example.It is to be noted that each user shares the same medical image data with allother users. In addition, the result of the analysing process is also shared by all other usersbecause the result is coupled to the medical image data shared by all users. On the otherhand, the visualization displayed in each workspace may be individually changed by a userso as to attain an individual view of the medical image data. In other words, according to thepresent invention, the medical image data and the result of the analysing process are identicaland shared by all users, wherein the display of this content (i.e. the visualization of themedical image data and the result) is subjected to the user himself / herself. As a result,according to the present invention each user has the maximally freedom to inspect themedical image data as he / she wants, while at the same time the result of the analysingprocess of other users is displayed in his / her personalized visualization (i.e. in his / herindividual view of the medical image data) in real-time. Hence, the medical image data andthe result of the analysing process are decoupled from the visualisation of the medical imagedata in each workspace. In other words, each user has his / her individual view of the medicalimage data, while at the same time the medical image data and the result are the same for allusers.The user may be a participant in the collaboration session, specifically adoctor, for example, an interdisciplinary heart team (IHT) may use the present invention,wherein the teams may consist of an interventional cardiologist, cardiovascular surgeon,care / nurse coordinator, OR / Cath lab nurse, imaging specialist, cardiac anaesthesiologist.Each user uses his / her own XR workspace. Alternately, at least two users may share the sameworkspace, for instance in a scenario in which one user is the teacher and another user is astudent.Each of the XR-workspace may be physically connected to another XRworkspacevia cable or wireless. Each workspace may have an own personal computerincluding a processor. Each computer may work as a client-computer. Alternatively, at leastsome of the workspaces may be part of one client-computer. That is, XR workspaces may belocated at different locations or may be in the same room, for example.The step of allowing each user to individually and independently from eachother change the visualization in a user's own XR workspace is executed in such a way thatnone of the other users notices how the visualization (i.e. the individual view of the medicalimage data) is changed in another XR workspace. Specifically, a viewing position and aviewing direction in space may be changed. Further, the position or orientation of a planecutting through the 3D medical image data (herein referred to as "cutplane") may beindividually adjusted, as well as the mode of displaying such plane in the visualization. Forexample, the user may select one of several so-called "cutplane" modes: In one mode, nocutplane is displayed, in another, the cutplane cuts through a 3D image volume and isoverlaid over the image content. In another mode, the cutplane displays a correspondingmulti planar reconstruction (MPR) of the 3D image data. Further, the opacity and colour ofthe visualisation may be changed. Generally, visualization parameters of the visualizationmay be changed, e.g. volume rendering parameters. Specifically, the visualization parametersmay include thresholds, opacity, contrast etc. Further, the visualization may be adjusted"live", that is, with an immediate effect while watching the visualization.According to an aspect of the present invention the result of the analysingprocess is synchronized in real-time with the at least one other workspace such that eachworkspace displays the result of the analysing process in the respective individualvisualization of the medical image data. Since the result of the analysing process belongs tothe medical image data which are shared by all users (refer also to the above outlined), thesynchronization in this case means the transmission of data attained in the analysing processfrom the respective workspace to the shared medical image data. That is, the results of theanalysing process are visible to all other users at the same time as they are made. In otherwords, immediately after the analysing process is executed, each of the other users may seethe results in their own individual visualization of the medical image data. For example, eachuser sees the annotations of the other users live in his own visualisation of the medical imagedata. This makes "handing over" the medical image data between multiple users obsolete andtherefore results in fewer interactions between users and a faster sharing of measurementresults and annotations.According to an embodiment, there is no indication displayed within theworkspace in addition to the visualization that indicates a position of other users and / or aviewing direction thereof e.g. by displaying an "avatar" of each user. Therefore, there is norisk that a part of the visualization is covered and / or hindered by such indication.For example, the execution of the analysing process may include the selectionof a plane in the visualization. The process then preferably comprises a step of displaying amulti planar reconstruction (MPR) of the selected plane of the visualization, in particular atthe position in the three-dimensional visualisation environment corresponding to the selectedplane. A multi planar reconstruction is an image reconstructed from several original imageplanes. In CT for example, a stack of usually transversal images is acquired. Further, in theanalysing process, the user may measure the diameter of the mitral valve and accordinglyselect the best fitting valve from a library. Thus, if a sectional plane intersecting the stack ofimages at a different orientation than transverse is to be viewed, the user may select thedesired orientation, and an MPR is created by e.g. interpolating from the respective nearestpixels in the various transverse slices. Displaying an MPR in addition to the visualizationallows the user to view the anatomical structure in more detail. In the virtual realityenvironment, thanks to the 18 degrees of freedom (XR headset and two controllers), thecorrect positioning of a grippable MPR plane in the 3D volume is very fast and verifiable,and measurements on the MPR plane or within the visualization become more precise andreliable. Further, the analysing process may be individually performed by each user in his / herown workspace. That is, the execution of the analysing process is not shared among the otherusers. For example, a movement or trajectory of a real tool (e.g. controller or another realobject held by the user) or of a virtual tool (e.g. virtual measuring tape or a visualization of anobject used to perform the analyzation process) within a workspace during the analysingprocess may be only visualized within the workspace in which the analysing process isperformed. Accordingly, only the measurement result may be shared among all users. That is,during the analysing process no user is distracted or hindered in performing his / her ownindividual analysing process by other users also performing the analysing process. Further,the analysing process may be executed by at least two users simultaneously. Since theoperations performed during the analysing process (i.e. sub-steps) are not shared among theusers, the users do not hinder each other in performing the analysing process. For example,two or more users may be simultaneously measuring the diameter of the mitral valve of ahuman's heart without bothering each other.It is to be noted that only the result of the analysing process is shared andvisualized in each workspace so as to inform each user that the result of the analysing processis available, for example. In addition, each user can perform his / her own analysing process inhis / her own speed and accuracy without immediately showing all other users his / her ownapproach to analyse a feature of the visualization. For example, a user may test somedifferent ways to analyse his individual visualization before his / her analysation result isshared among all users. Therefore, each user has the freedom to perform the analysingprocess in his / her own individual way without being observed by anyone of the other users.As a result, the working atmosphere for each user may be improved and the result of theanalysing process may have an improved accuracy. For example, if a user performs theanalysing process and is not satisfied with his / her own performance, he / she can perform itagain without providing the other users with excessive information (i.e. an invalidmeasurement result). Preferably, a user may signalize if he / she is finished with his / heranalysing process so as to initiate the synchronization of the result of the analysing processwith all other users (i.e. workspaces). The signalization may be performed by hitting a virtualbutton or by ending the analysing process. For example, the user may signalize that theanalysation process is finished by disabling a virtual tool used during the analysing process.For example, the result of the analysing process may be at least onemeasurement result of features of the visualization of the medical image data such asdistances, diameters, thicknesses etc. In more detail, the measurement result may bedisplayed by a first dot at a first location from which a distance is to be measured (startingpoint) and a second dot at a second location to which the distance is to be measured (endpoint) and a line connecting the first dot and the second dot. Specifically, the result of theanalysing process may be three-dimensional notes such as a 3D freehand line that may bedrawn by a user within his / her workspace. In other words, the result of the analysing processmay be no planar objects but 3D objects that extends in any one of the three dimensionswithin the 3D coordinate system. For example, the user may retrace the flow of bloodthrough a heart or follow the course of the coronary arteries.The first aspect of the present invention provides the advantage that each usercan generate his / her own preferred visualization of the medical image data, in other words,each user has his / her own individual view of the medical image data. Further, each user mayanalyse and view the visualization of the medical image data in his own way (e.g. individualviewing directions, cutplane positions, thresholds and speed), that is, some users may needmore time for specific procedures as compared to other users. Since there is no avatar in thevisualization, there is no occurrence of hiding parts of the medical image data behind suchavatars. In addition, unexperienced user may follow results made by another user in real-timein order to better understand a subject matter they won't understand by themselves.Moreover, the XR provides the advantage that the user may view and analysethe visualization with great confidence, since he obtains a truly three-dimensional view of theanatomical structure represented by the medical image data. Further, since he can walkaround it and possibly even into it, he can have the visualised object (e.g. the visualisation ofthe human heart) displayed in huge magnification, so as to completely fill the space in frontof the user. Therefore, the user has a particularly good overview and may take measurementswith great accuracy. Further, the handling of user input events is particularly easy andintuitive in XR. Actions such as rotating the objects and / or adjusting the settings of thevisualization, which may be quite tricky on a two-dimensional screen, are very intuitive andfast in a XR preferably using XR controllers.In an embodiment, the medical image data include images, preferably 4Dimages, of a human heart.The invention may find particular use in planning minimally invasive heartsurgery, such as surgery on a heart valve or a heart valve replacement. New minimallyinvasive methods like transcatheter valve replacement can be used for patients who wereformerly considered inoperable and / or not suited for open-heart surgery. Some transcathetervalve replacements (e.g. TAVR) use a fully collapsible bioprosthetic valve. However, it iscrucial for the success of these interventions that the existing pathology / geometry is analysedand understood completely and that the new valve is carefully selected, sized and positionedto ensure that it is working properly and not obstructing the left ventricular outflow tract(LVOT) or coronary arteries. This is particularly true for valve-in-valve (ViV) interventions.Thereby, a dysfunctional valve - sometimes a bioprosthetic mitral valve - is replaced by anew valve in a minimally invasive ViV procedure. Thereby, the new valve is positionedinside the old valve, replacing the old valve while it unfolds. Therefore, it is crucial that thevalve should be positioned correctly and have the correct size. In particular, it is importantthat the new mitral valve does not obstruct the LVOT. Therefore, for valve in valveintervention planning, the medical image data contains the mitral valve, the LVOT and theleft ventricle.In a preferred embodiment of the present invention, the displaying of the resultof the analysing process may be selectively and individually enabled and disabled by a userin his / her workspace.Each result of the analysing process may be positioned at a specific positionwithin the 3D coordinate system (i.e. the position may be defined by x, y and z coordinates)in which the medical image data is defined. That is, the result may be located at a specificposition in relation to the medical image data. Because the medical image data and the resultare shared by all users, the result is displayed within each workspace regardless in which waythe user has individually changed the visualization (i.e. his / her individual view of the medicalimage data). The result may be visualized by relatively thin lines such that it is less likely thatthe result covers other objects displayed in the workspace. Nevertheless, there may be asituation in which the result covers a part of the visualization and / or other results. Therefore,according to the embodiment of the present invention, the result may be disabled so as tovanish and provide a free view onto objects positioned behind the result.Since each of the user may have a different focus with respect to a region ofinterest, it is important that each user may individually decide which result hinders asufficient view onto the region of interest and thus shall be disabled. That is, each user mayselectively disable results made by himself / herself or other users. Further, enabling ordisabling the result may have no influence on the other at least one workspace such that theenabling and disabling of the result may be executed independently in each workspace. Inaddition, the method may allow a user to adjust the transparency of the result so as to seeobjects placed behind the result through the result. Particularly, once the result is disabled, auser may enable the result again so as to again see the result within his / her workspace. Forthis reason, the result, in a disabled state, may be indicated by a small arrow or similar toprovide the user with the information where the result was originally placed. As a result, theuser may easily regain the result for enabling the same again.According to this embodiment, the visualization in each workspace may befurther individualized in that each user may individually adjust both the visualization (i.e. theindividual view of the medical image data) and the result exactly in a way that satisfieshis / her requirements with respect to workability.In a further preferred embodiment of the present invention, the at least oneworkspace may be an AR-workspace. That is, both the visualization and the result aredisplayed in the workspace while the real environment is still visible as a background of theworkspace. For example, the real environment may be the surrounding area of the user (e.g.an operating room or a doctor's office). Further according to an embodiment, at least onevisualisation parameter within the AR-workspace, in particular a transparency and / or a colourof the visualization of the medical image data and / or the result of the analysing process maybe adjusted automatically, so as to allow the user to view the visualization of the medicalimage data and / or the result of the analysing process superposed on the real environment withtarget contrast.In more detail, visualisation parameters may be values defining the way inwhich the medical image data and / or the result is / are visualized. Therefore, by changingthese values the visualization also changes accordingly. For example, the visualisationparameters may include the transparency value, that is, the value of lucency of an object. Forexample, if an object has a low transparency the region covered by the object is not visible.On the other hand, if the object has high transparency the region covered by the object mightbe at least slightly visible. Further, visualisation parameters may include the colour of thevisualization, that is, the hue or tone of the visualization. In more detail, hue is one of themain properties (also called colour appearance parameter) of a colour. Hue can typically berepresented quantitatively by a single number, often corresponding to an angular positionaround a cen tral or neutral point or axis on a colour space coordinate diagram (such as achromaticity diagram) or colour wheel, or by its dominant wavelength or that of itscomplementary colour. The other colour appearance parameters are colourfulness, saturation(also known as intensity or chroma), lightness, and brightness. In the present embodimentinter alia these parameters may be automatically adjusted in order to attain the target contrastwithin the workspace. The target contrast may be also referred to as an optimal contrast. Thecontrast within the workspace may be defined as the difference between the brightest pointand the darkest point within the workspace, wherein within the AR-workspace the realenvironment is considered, too. In addition, the contrast within the workspace may be alsodefined as the contrast ratio or dynamic range. The visualization of the medical image dataand / or the result may be adjusted in such a way that the contrast within the AR-workspaceamounts to the target contrast. In other words, if the real environment (background) isrelatively bright, the brightness of the visualization and / or of the result is / are also increasedso as to reduce the whole contrast to the target contrast. The target contrast may be apredefined value which is defined as being most appropriate with respect to detectability andconspicuousness of the visualisation. Alternatively, the target contrast may be individuallyadjusted and / or set by the user so as to satisfy his / her personal predilection.According to an embodiment, each workspace may have its own virtualenvironment in which the visualization of the medical image data and the result of theanalysing process are displayed. The virtual environment may be the background in whichthe visualization is displayed. Further, according the embodiment the method may furtherinclude the step of allowing each user to individually and independently adjust a visualizationparameter of the virtual environment so as to adjust a contrast within the workspace,preferably by setting a transparency and / or a colour of the virtual environment. The virtualenvironment may be the background in front of which the visualization is positioned. In otherwords, the virtual environment may be the surrounding which surrounds the visualization.For example, in case the VR-workspace is used, the virtual environment may include acoloured surface that has a defined colour and brightness so as to provide a pleasant workingenvironment for the user. That is, the virtual environment may be adjusted so as to provide acontrast within the workspace that amounts to the target contrast. In addition, the user mayindividually adjust the virtual environment. Further, in case the AR-workspace is used thereal environment is also visible as a background within the workspace. However, even theAR-workspace may have a virtual environment that has a specific transparency so as toprovide the possibility for the user to see the real environment, too. However, the value oftransparency of the virtual environment may b e adjustable so as to shadow a very bright realenvironment such that the contrast within the workspace amounts to the target contrast. Thisis particularly useful when the AR-workspace is used in a relatively bright environment suchas an operating room. In other words, the virtual environment of an AR-workspace allows theuser to automatically adapt the AR-workspace to conditions of the real environment whilestill offering the possibility to recognize the real environment. Moreover, the AR-workspacemay be easily adapted to varying light conditions of the real environment. As a result, theAR-workspace is appropriately usable regardless of the light conditions of the realenvironment.Advantageously, the virtual environment may include at least one virtualcontrol element. For example, the virtual control element may be a slide bar and / or a button.The control element may be used to execute steps of the method e.g. changing thevisualisation and / or to implement further administrative processes like saving an image,loading medical image data, communicate with other users etc. Further, the control elementmay provide a drop-down menu in which several predefined control commands may belisted.In a further preferred embodiment, the step of allowing each user toindividually and independently change the visualization of the medical image data mayinclude the use of a VR controller in order for the user to interact with virtual features in theworkspace. Specifically, in order to execute the change of the visualization using handgestures, preferably by grabbing an object in the workspace. In the XR workspace, a userwearing a XR headset and holding at least one controller in one hand (preferably a controllerin each hand) sees in the controller together with the visualisation. The controller may be ahand held device including further operating elements e.g. buttons, track ball, touchpad, etc..In case a VR-workspace is used, an indication (e.g. a virtual controller) of the controllerwithin the VR-workspace may be depicted so as to inform the user where the controller ispositioned within the VR-workspace. Preferably, he can also see the virtual controllers at thepositions and orientations corresponding to the current hand positions and orientations. Thus,the XR workspace provides the possibility for the user to move the controllers towards thevisualisation, grab it by pressing a particular button, and move and / or rotate the visualisedobject with the movement of his hands, like he would with a real-world object. Thereby, theusers have 18 degrees of freedom (six degrees of freedom, namely three rotational and threetranslational degrees of freedom for each of the XR headset and the two controllers) tocorrectly and intuitively view and analyse the visualised object. This closely resembles thenatural way of interacting with objects. A movement of the controller may be tracked and acorrespondent movement of the indication is visualized within the VR-workspace. On theother hand, in case the AR-workspace is used, the real controller may be still visible.However, even in the AR-workspace a virtual controller may be visualized in order toimprove the conspicuity of the controller.The position information may be attained by at least one sensor e.g. anacceleration sensor located within the controller. More commonly, the position(s) and / ororientation(s) of the controller(s) is / are tracked by the cameras on the VR headset. The dataoutputted by the sensor or camera may be inputted to a processor that processes the data so asto control the commands executed by operations of the controller and the visualization of thevirtual controller. Further, dependent on the output of the sensor the processor may determinewhether a gesture is performed slow or fast. Further, a rotation movement may be detected.As a result, the processor may perform processes accordingly.Operations executed by the controller may include zoom in / zoom out thevisualisation, scale down / scale up the visualisations within the workspace, adjustvisualisation parameters and rendering settings / parameters, and / or grab the displayed objects,in particular the visualisation of the medical image data.Additionally, the controller may receive hand gestures made by the user, forexample, a grabbing gesture, a zoom-in gesture (approaching of two fingers), zoom-outgesture (departing of two fingers) a wipe gesture etc.. Further, the visualization may bevirtually grabbed using the controller and rotated or moved, for example. In a XR workspacethe real controller may be visualized as a virtual controller allowing a user at least to grab andmove an object within the workspace by hand gestures. "Move" in this context may alsomean rotate. The controller may also allow a user the change the size and / or shape of objectswithin the workspace, specifically, of the visualization. According to a useful embodiment,the controller as described above allows a user to change any one or several of the position,size, shape and / or orientation of the visualization. In particular, the position and / ororientation of the visualization may be adjusted (i.e. the individual view of the medical imagedata). However, in a useful embodiment also the size of the visualization may be changed tobetter analyse the visualization. Preferably, such adjustments are made by using the controllerby grabbing the visualization, and changing its position, size and / or orientation by handgestures, as one would a real-world object. According to a useful embodiment, a controllerallows a user to adjust parameters by means of gesture control. For example, the user selectsa certain parameter by touching it using hand movement in the XR workspace. He / she maythen use gestures to e.g. actuate a virtual slider, or simply move the controller horizontally (orvertically) to adjust the parameter without reference to any slider. Suitable parameters arerelated to the visualisation and may be selected from a volume rendering threshold,smoothing, lighting intensity, size, opacity of a visualised object, starting and holding thecine-mode etc.As a result, the user may intuitively operate within the AR / VR-workspace likemoving objects or operate operation elements such that the efficiency of such collaborationsis increased.Further, in useful embodiments the workspace may comprise a lamp which theuser may grab and move within the workspace, so as to influence the lighting of thevisualization. In useful embodiments, also the brightness of the scene, in particular thebrightness of a movable lamp, may be adjusted. Further, by adjusting the position of thelamp, the directon in which the visualization is illuminated may be changed. This isparticularly useful in order to illuminate cavities of the visualized anatomy.Preferably, the step of allowing each user to individually and independentlychange the visualization of the medical image data includes manipulating the visualization soas to rotate the visualization, cut away a part of the visualization, change renderingparameters of the visualization, change image settings of the visualization, change a contrastof the visualization, change voxel intensity thresholds of the visualization and / or change asize of the visualization. In other words, the visualisation is manipulated e.g. is rotated if theuser wants to see another part or region of the visualization. That is, each user has his / herown individual view of the medical image data. In the same way each user may individuallycut away a part of the visualisation in order to attain a visualisation in which only the parts ofthe visualization are displayed that are of interest for the specific user. The renderingparameters of the visualization may include the kind of rendering (i.e. volume renderingand / or surface rendering) and the image settings may include a colour of surfaces andshading options (i.e. the position of a light source in the space). Further, a user may setsettings of his individual visualization such that the medical image data is visualized in slicesor in other forms. Further, there may be presets of different visualizations in which themedical image data are displayed such as, a plan view, a right front view, a left front view arear view, button view and a perspective view. The presets may be set in advance or may bepredefined by each user.Advantageously, at least one user may adopt the change(s) of the visualizationof the medical image data made by another user. That is, by adopting the visualization ofanother user (i.e. the individual view of the medical image data), the visualization istransferred to at least one other user's workspace such that at least two users have the sameindividual view of the medical image data. This procedure may be particularly useful, if thereis an experienced user (e.g. teacher) who currently explains something to other users (e.g. tostudents). As a result, the other user may be in a position to learn from the more experienceduser. In other words, the other user(s) is / are provided with the same individual view of themedical image data as the experienced user. The switch from one individual view to anotherone may be continuously executed so as to show the user in which way the individual view ischanged. Alternatively, the switch between the individual views may be illustrated byvisualizing the switch in a bird's-eye view, that is, the change between the both individualviews is illustrated in a top view.Alternatively, one user may force at least one other user to adopt his / herchange(s) of the visualization of the medical image data. That is, the user may force otherusers to see exactly that what he / she sees (i.e. having the same individual view), this may bespecifically appropriate in courses in which one user wants to show other users a specific partof the workflow. Therefore, the efficiency of the collaboration is improved. In a furtherpreferred embodiment only one user is allowed to decide which change(s) of the visualizationof the medical image data may be shared with other users (i.e. the user may be the presenterand / or teacher), whereas the other users have restricted functionalities and may not beallowed to share any change(s) of the visualization of the medical image data (e.g. the usersmay be participants and / or students).In a further preferred embodiment, the step of allowing at least one user toexecute an analysing process of the medical image data in his / her workspace may furtherinclude taking 3D measurements, executing MPR-mode and / or inserting annotation. That is,the result of the analysing process may be one or more annotation(s) related to specificaspects of the visualisation such as background information of previously executed therapies,comments of users related to an abnormality etc.. Each result may be visualized by thin lineswithin each of the workspaces in real time because the result belongs to the medical imagedata that is shared by all users. That is, immediately after the results have been obtained, eachuser sees the result in his individual view. The 3D measurements may be a measurement inthe 3D dimensional space, that is, a distance between two points which differ from each otherin each of the x-coordinate, y-coordinate and the z-coordinate. Further, a 3D measurementmay involve tracing a non-planar, irregularly shaped object, for example by measuring thedistance spanned by several points in space, for example points along an irregularly shapedobject such as the mitral annulus. Such non-planar measurements cannot be performed on a2D screen, but can easily be done in the XR workspace of the invention. MPR-mode may bea multi-planar reconstruction which is a method of two-dimensional image reconstruction. InMPR, frontal, sagittal, oblique or curved sections are calculated from transversal sections anddisplayed to help the user with anatomical orientation. Oblique sections, for example, arehelpful in heart imaging (four-chamber view, short axis sections), curved reconstructionsalong structures that are themselves curved several times for the representation of vessels(such as the coronary arteries) or ureters. In order to obtain high-quality MPRreconstructions, the medical image data (e.g. obtained by CT) should be acquired overlappingwith a small layer thickness. In addition, a small layer thickness should be selected to avoidstep artifacts during image reconstruction. The image noise may be reduced by summing upseveral layers. Thresholding may be an adaption of the threshold boundaries of each voxel inorder to better visualize the region of interest.Preferably, the step of allowing at least one user to execute the analysingprocess of the medical image data in his / her workspace may further include positioning atleast one model of a medical device, specifically an implant, within the visualization of themedical image data so as to determine its operational position. The model of a medical devicemay be a computer graphical object. That is, the model of a medical device may beadditionally displayed within the XR-workspace. The medical device may be an implant orany other device that is to be placed within the human or animal body. The computergraphical object is for example a representation of geometric data, e.g. a 3D structure definedby vertices, such as a polyhedron. The computer graphical object is preferably locked to themovement of the anatomical structure, i.e. it is once placed in a particular position andorientation with regard to the visualisation in any one frame. When the user starts the cinemode,the processor controlling the visualisation remembers the relative position andorientation of the medical device with regard to the visualisation and will keep this relativeposition and orientation. In the case that the medical device represents a new valve, such newvalve can be locked to the movement of the valve annulus, e.g. the mitral annulus. Preferably,this may be done using 3D speckle. Thereby, important dynamic information over the entireheart cycle is delivered, and the valve may be optimally positioned in its operational position(i.e. in its optimal position), thereby avoiding or limiting any obstruction of an outflow.Further, the user may use the controllers to move and tilt the computer graphical object inrelation to the visualisation. Thereby, the user can not only measure, but also "try out" aselected implant or implant size, for example a replacement valve, to see if it fits theanatomical feature, e.g. the mitral valve. For example, the user may select the best fittingvalve from a library and place the valve - or rather the computer graphical objectcorresponding the valve - inside the visualisation for an initial inspection. In a usefulembodiment, the computer graphical object corresponds to a CAD model of the medicaldevice, e.g. the CAD model used in the design and / or production of the medical device, ormore preferably to a simplified model thereof, for example a simplified model a heart valve.In another embodiment, the computer graphical object looks similar to whatthe medical device will look like on interventional X-ray images (fluoroscopy images),because minimally invasive interventions are almost always done under fluoroscopy control.Thus, the user may visualise a scene in three dimensions and yet gain an idea on what theimplant will look like on the fluoroscopy image. The computer graphical object is preferablythree-dimensional, it may be e.g. be a simplified model of an implant, for example in theform of a wire mesh or an object defined by a set of simple surfaces.According to a preferred embodiment of the present invention the operationalposition of the model of the medical device is be determined by visualizing the medicaldevice dynamically in operation, preferably in combination with the 4D image information.In other words, the 4D medical image data (i.e. a sequence of 3D medical image date e.g. inthe cine-mode) are used to visualize the object that is to be investigated e.g. the heart inoperation while the model of the medical device (e.g. the artificial mitral valve) is positionedat its intended position. The dynamic movement of the medical device, e.g. during the heartbeat, may be based on tracked 4D image data. For example, specific landmarks interactingwith the medical device are tracked over the sequence of 3D image data, and the virtualposition of the medical device is adjusted accordingly. Subsequently, the user mayinvestigate how the specific model of the medical device works in combination with thespecific anatomical structures under inspection.In summary, the present invention according to the first aspect provides alocation-independent XR collaboration tool that provides an interconnected communicationconcept in which the medical image data and results of an analysing process are shared by allusers whereas each user still has his / her own individual view of the medical image data (i.e.his / her own duplicate / visualization of the medical image data) within his / her own workspace.According to a second aspect of the present invention, there is provided acomputer program including the features of claim 12. The computer program comprisingprogram code instructions, which, when executed by a processor, enables the processor tocarry out the above method. The computer program may be in any code, in particular a codesuited for computer graphic applications, in particular for XR programming.Further, a computer-readable medium comprising the above-defined computerprogram may be provided. The computer-readable medium may be any digital storagedevice, such as a USB-stick, hard disk, CD-ROM, SD card or SSD card. Naturally, thecomputer program need not be stored on such a computer-readable medium to be supplied tocostumer, bit may be downloadable via the internet.Preferably, the method according to the invention is executed by a processorwhich may be incorporated in any electronic device able to control a display, in particular aXR display such as a XR headset or projection display. Such digital device may be acomputer, PC, server, television set, tablet computer, smartphone, laptop, hand-held device orthe like. The processor may also be part of a cloud computer, workstation, or the controlconsole of a medical image device, in particular an ultrasound scanner.According to a third aspect of the present invention, there is provided a userinterface configured to be used in executing an above-defined method, wherein the userinterface includes:a XR display device, in particular a VR headset, for displaying a visualizationof medical image data and a result of an analysing process in real-time within a workspace toa user,wherein the workspace is a XR-workspace, andwherein the workspace includes a virtual environment so as to displaythe visualization of medical image data and the result of the analysing within the virtualenvironment, anda tracked controller configured to be used during execution of the method inorder to input commands by gestures of the user, wherein the commands include:selectively and individually enable and disable the display of the result of theanalyzing process.Any features of useful embodiments described in connection with theinventive method also apply to the user interface.A user interface is for example a system comprising at least a screen or displayand usually input elements, e.g. a XR controller, and / or buttons or sliders, allowing a user tointeract with the content of the display e.g. by adjusting visualisation parameters / settings,zooming, annotating and / or moving or tilting the visualisation.Preferably, the commands may further include individually and independentlyadjusting a contrast within the workspace of the user, preferably by setting a transparencyand / or a colour of the virtual environment.According to a fourth aspect of the present invention, there is provided asystem for analysing medical image data in a virtual multi-user collaboration including: aprocessor configured to carry out the above-defined method, and at least two above-defineduser interfaces that are connected to the processor.Any features of useful embodiments described in connection with theinventive method also apply to the system.The virtual reality environment may be realized using commercially availableVR equipment, such as the HTC VIVE Pro Virtual Reality System, which includes a VRheadset, two VR controllers, two position trackers and (made by HTC Corporation, TaoyuanCity 330, Taiwan) or the Oculus Rift S (Oculus, Facebook Technologies, LLC). This headsetdoes not require separate position trackers in the room, since the position tracking function isprovided by the headset itself.SHORT DESCRIPTION OF THE FIGURESUseful embodiments of the invention shall now be described with reference tothe attached figures. Similar elements or features are designated with the same referencesigns in the figures. In the figures:Fig. 1 shows schematic cross-section through a human heart (4-chamberview);Fig 2 shows a schematic representation of a sequence of medical images;Fig. 3 is a diagram schematically illustrating the principle of a virtual multiusercollaboration according to an embodiment of the present inventionFig. 4 shows a user interface according to an embodiment of the presentinventionFig. 5 shows a flow diagram illustrating the method according to anembodiment of the present invention.DESCRIPTION OF EMBODIMENTSIn order to better visualise the preferred application of the inventive methodfor analysing medical image data in a virtual multi-user collaboration, FIG. 1 illustrates thestructure of the human heart 1. The blood coming from the lungs flows into the left atrium 2and from there through the mitral valve 3 into the left ventricle 4. From there, it is pumpedthrough the aortic valve 5 into the aorta 6. This part is also termed left ventricular outflowtract (LVOT). The blood coming from the body flows into the right atrium 7 and is pumpedthrough the tricuspid valve 8 into the right ventricle 9. From there, it is pumped through thepulmonary valve 10 into the pulmonary artery 11. Heart wall 12 is made of muscular tissuesurrounding the heart chambers 2, 4, 7 and 9. The left and right ventricles are separated bythe septum 13. It is evident from FIG. 1 that the heart has a complex shape, and in addition isconstantly moving with the heartbeat, i.e. it is a dynamic anatomical structure. Thus,analysing such complex structures such as the mitral valve 3 in order to plan a valvereplacement is difficult and prone to errors. That is, the heart 1 in Fig. 1 represents anexample of 3D medical image data achieved by MR, computed tomography (CT), positionemission tomography (PET), ultrasound (US), or transoesophageal echocardiography (TEE).In order to achieve 4D medical image data, the time is used as the fourth dimension.FIG. 2 shows a schematic representation of a sequence of ultrasound imagesM1, M2, M3, … MZ of the heart 1 based on medical image data. Z is the number of imagesacquired during one heart cycle, i.e. in time T, wherein T is about 0.5 to 1.5 seconds. Forsimplification, the figure shows two-dimensional images, however, according to the presentinvention a three-dimensional image and is acquired at each point in time ti. A threedimensionalmedical image may be formed by a stack of two-dimensional images. A fourdimensionalmedical image may be formed by a plurality of three-dimensional medicalimages that are consecutive displayed in a sequence. Such sequence of images M1, M2, M3,… MZ may be acquired for example by echocardiography of the moving heart, for examplewith a TEE probe. The sequence of medical images M1, M2, M3, … MZ represent the 4Dmedical image data.In one embodiment of the present invention an interdisciplinary heart team(IHT) plans a heart surgery and is supposed to discuss a complex aspect previous to theactual surgery. In order to make sure all participants of the IHT have the same understandingof the patient anatomy and the planned procedure the team scheduled a virtual multi-usercollaboration. During the collaboration each member of the team is at a different location.The IHT consists of: an interventional cardiologist C, a cardiac anesthesiologist A, a OR / cathlab nurse N and a cardiac surgeon S. Fig. 3 schematically shows the principle of the virtualmulti-user collaboration according to the embodiment of the present invention.As shown in Fig. 3, each participant / user has his / her own workspace WS. The3D or 4D medical image data 34 is provided and loaded so as to be visualized in eachworkspace 30. As a result, an individual visualization 32 of the medical image data 34 isgenerated and provided for each workspace. In other words, each user has his / her ownindividual view 32 of the medical image data 34. Subsequently each of the users starts towork with the visualization. First each user changes the visualization so as to satisfy his / herrequirements for analysing the visualisation of the medical image data 34.There are significant individual differences in the way different users view andanalyse data sets (zoom levels, threshold / contrast / brightness settings, preferred viewingangles, etc.). Therefore, each user has his / her own isolated copy 32 of the visualization of themedical image data 34 and can resize, rotate, translate and set image settings using acontroller 36. Nothing of this handling / view settings part is transferred to any other user. Forexample, the interventional cardiologist C prefers to show the visualization approximately40 cm sized and 50 cm away from his head, a high threshold set so that leaflets of the mitralvalve 4 disappear and a viewing direction from left atrium 2 through mitral valve 4 into leftventricle 4. On the other hand, the cardiac anesthesiologist A prefers to show thevisualization as large as possible (100-120 cm) such that he / she can move his / her head intothe visualization, a lower threshold set so that the leaflets are easily visible and a viewingdirection from the side and in two-chamber view. Further, the OR / cath lab nurse N and thecardiac surgeon S prefers further individual views onto the visualisation. This changing of thevisualisation 32 is carried out individually and independently by each user so as to obtain anindividual visualization (i.e. an individual view of the medical image data). It is to be noted,that none of the users sees the changes of the individual view of the medical image dataexecuted by the other users.In addition, in case the medical image data changes due to new measurementsthat are available, the visualization which is based on the medical image data, isautomatically updated. That is, in each workspace 30 the visualization is updated based onthe medical image data that are shared by all users. Another reason why new medical imagedata are available is because a patient's organ is simultaneously analysed while at the sametime the collaboration takes place and the acquired data are directly provided, in case thepatient is an emergency, for example. Further, each user sees in his / her workspace 30 onwhich version of the medical image data the visualization is based. In addition, each usermay individually change between different versions of visualizations.Then the analysing process starts and each user executes the analysing processin his / her workspace 30 while having the individual view of the medical image data. That is,each user makes his / her own measurements / annotations which are results of the analysingprocess within his / her own workspace 30 using the controller. In other words, each usercontrols the medical image data in that he / she adds the result of the analysing process viahis / her own workspace 30 directly into the medical image data. At the same time, themeasurements / annotations inputted via the controller are transmitted to the medical imagedata shared by all users. Consequently, each user sees the measurements / annotations of theother users live within his / her own visualization of the medical image data. As a result, eachuser may immediately see and receive measurements / annotations of the other users apotentially use them for his / her own approach.For example, the same image dataset appears for all 4 users simultaneously.Each user (C, A, N amd S) makes his own measurements and annotations. Each user sees theannotations of the other users live at his own visualisation of the image dataset. As anexample, the cardiologist C and the surgeon S may have different ideas about whichprocedure is right, but the anaesthesiologist A, after seeing both approaches, has another ideathat combines the approaches of S and N in a meaningful way. When using the method of thepresent invention, S and N will make different measurements and annotations, both of whichcan be seen by A. A may thus annotate his improved proposal on his own visualisation of theimage dataset. Every user sees his new annotation live on his own model / visualisation andagrees. Thereby, a more efficient meeting of an interdisciplinary heart is possible.Since the measurements / annotations are directly transferred (i.e. synchronisedwith) to the medical image data 34 shared by all users, the measurements / annotations mayhide or cover a part of the visualization in a workspace 30 of another user. Therefore, if inone user's workspace 30 a part of the visualization is hided and / or covers, the user maydisable the respective measurement / annotation. Alternatively, the user may adjust themeasurement / annotation so as to be transparent.That is, according to the present invention, during a collaboration fewerunnecessary interactions, the sharing of measurements / annotations is faster and each user hasan unrestricted view on the region of interest regardless of how many participants are in theVR session. Further, since individual understanding of anatomy differs, differently perceivedreference points and structures in the medical 3D datasets inevitably lead to interobservervariability, different measurement (procedures), different assumptions and differentinterpretations of anatomical correlations. However, according to the present invention thesephenomena is avoided because each user may individually change the visualization in thatway, he / she prefers to work. In addition, the user now sees his and the changes of the otherusers live in his individual view, which he can handle and adjust according to his personalviewing preferences.In another embodiment of the present invention, at least one workspace 30 isan AR workspace. In other words, the procedure is the same as that of the previousembodiment with the exception that the user sees both the visualization and the realenvironment, wherein the real environment forms a background for the visualization. In orderto enable the user to sufficiently see and analyse the visualization, the AR-workspace, in thisembodiment, has a virtual environment that is interposed between the visualization and thereal environment. As a result, the real environment may be shadowed by increasing theopacity of the virtual environment. As a result, the AR-workspace 30 may automatically setthe opacity / transparency of the virtual background so as to provide the target contrast withinthe workspace 30. The AR workplace is particularly useful when the user interacts with aperson (e.g. a patient) in the real environment at the same time. Further, the virtualenvironment is automatically adapted to varying light conditions. Alternatively, in anotherembodiment each user may individually adjust the virtual environment in order so satisfyhis / her own requirements and / or perforations.According to a further embodiment, users can synchronize their individualview with another user, for example a teacher showing a critical measurement or positioningof a medical device to a classroom of students. That is, the individual view 32 towards thevisualization is shared with another one or multiple participant of the collaboration. A usercan put himself in the optimal viewing position and watch other (e.g., more experienced)users live and in real 3D while they make certain measurements, annotations or positiondevice like artificial heart valves within the visualization to determine their optimal position.For example the "Teacher" can first observe (from the student´s view) how the student woulddo a certain annotation / measurement and then synchronize the individual view of one ormultiple students with his own individual view, e.g. if he wants to demonstrate a specific partof the intervention or measurement from his exact point of view. For this scenario one userwould take over the moderation part, similar to a GoToMeeting ("Presenter / Teacher"),whereas all other participants ("Particiants / Students") have a more limited functionality.In a preferred embodiment, the user interface is a VR interface, as shown inFIG. 4. Such interface is realised by a virtual reality headset 82 worn by a user 80. Theheadset 82 is connected to a computer 72, either through a cable or through wirelessconnection. Such virtual reality headset 82 includes internal displays, separate for each eye,as well as position sensors 84 which track the movement of the head. Such headset may alsoinclude cameras, in case an augmented reality environment is to be presented. Further, theuser 80 is holding VR controllers 86 in his hands, wherein the controllers 86 also includeposition sensors (not shown) as well as buttons or other input elements. Such virtual realitycontroller 86 allows a user to grab and move an object displayed in the virtual realityenvironment 50. The VR headset may for example be an HTC VIVE headset andcorresponding VR controllers.FIG. 5 shows a flow diagram illustrating the method according to anembodiment of the invention. In step 90, medical image data including 3D or 4D imageinformation showing e. g. the moving heart are provided. In case the 4D medical image dataare provided the sequence spanning a time period corresponding to one heartbeat. In step 92,the medical image data is loaded into the workspace 30 of each user so as to simultaneouslydisplay a visualization of the medical image data to each user, for example by generating avolume rendered or a surface rendered visualization. In step 94, each user is allowed toindividually and independently from each other change the visualization of the medicalimage data, so as to obtain an individual visualization (i.e. his / her individual view of themedical image data) of the medical image data in each workspace 30 pertaining to each user.In step 96, at least one user is allowed to execute an analysing process of the medical imagedata in his / her workspace 30. Such analysing process includes making measurements andannotations which are positioned within the 3D coordinate system. In step 98 the result of theanalysing process is displayed in the workspace 30 in which the analysing process wascarried out. In step 100 the result of the analysing process is synchronized in real-time withthe at least one other workspace 30 such that each workspace 30 displays the result of theanalysing process in the respective individual visualization of the medical image data.The steps 96 to 100 are executed simultaneously, that is, the measurements and annotationsmade in step 96 are directly visibly in each of the workspaces because the measurements andannotations are directly implemented in the medical image data 34 shared by each user.While the invention has been illustrated and described in detail in the drawingsand foregoing description, such illustration and description are to be considered illustrative orexemplary and not descriptive; the invention is not limited to the disclosed embodiments.

Claims

1. Method for analysing medical image data (34) in a virtual multi-user collaboration, wherein the medical image data (34) is analysed by at least two users (A, N,C, S), each user having his / her own workspace (30), wherein the workspace (30) is a XR-Workspace, the method including the steps of: providing medical image data (34) including 3D or 4D image information, loading the medical image data (34) into the workspace (30) of each user (A, N,C, S) so as to simultaneously display a visualization (32) of the medical image data (34) to each user, allowing each user (A, N,C, S) to individually and independently from each other change the visualization (32) of the medical image data (34), so as to obtain an individual visualization (32) of the medical image data (34) in each workspace pertaining to each user, allowing at least one user (A, N,C, S) to execute an analysing process of the medical image data (34) in his / her workspace (30), displaying the result of the analysing process in the workspace (30) in which the analysing process was carried out, and synchronizing the result of the analysing process in real-time with the at least one other workspace (30) such that each workspace (30) displays the result of the analysing process in the respective individual visualization (32) of the medical image data (34).

2. Method for analysing medical image data (34) in a virtual multi-user collaboration according to claim 1, wherein the step of allowing at least one user (A, N,C, S) to execute an analysing process of the medical image data (34) in his / her workspace (30) is executed simultaneously by at least by two users.

3. Method for analysing medical image data (34) in a virtual multi-user collaboration according to claim 1 or 2, wherein the displaying of the result of the analysing process may be selectively and individually enabled and disabled by a user (A, N,C, S) in his / her workspace.

4. Method for analysing medical image data (34) in a virtual multi-user in particular a transparency and / or a colour of the visualization (32) of the medical image data (34) and / or the result of the analysing process is / are adjusted automatically, so as to allow the user (A, N,C, S) to view the visualization (32) of the medical image data (34) and / or the result of the analysing process superposed on the real environment with target contrast.

5. Method for analysing medical image data (34) in a virtual multi-user collaboration according to any one of the preceding claims, wherein each workspace (30) has its own virtual environment in which the visualization (32) of the medical image data (34) and the result of the analysing process are displayed, and wherein the method further includes the step of: allowing each user (A, N,C, S) to individually and independently adjust a visualization (32) parameter of the virtual environment so as to adjust a contrast within the workspace (30), preferably by setting a transparency and / or a colour of the virtual environment.

6. Method for analysing medical image data (34) in a virtual multi-user collaboration according to claim 5, wherein the virtual environment includes at least one virtual control element.

7. Method for analysing medical image data (34) in a virtual multi-user collaboration according to any one of claims 1 to 6, wherein the step of allowing each user (A, N,C, S) individually and independently change the visualization (32) of the medical image data (34) includes the use of a controller (36) in order to execute the change of the visualization (32) using hand gestures, preferably by grabbing an object in the workspace (30).

8. Method for analysing medical image data (34) in a virtual multi-user collaboration according to any one of claims 1 to 7, wherein the step of allowing each user (A, N,C, S) to individually and independently change the visualization (32) of the medical image data (34) includes manipulating the visualization (32) so as to rotate the visualization (32), cut away a part of the visualization (32), change rendering parameters of the visualization (32), change image settings of the visualization, change a contrast of the visualization, change voxel intensity thresholds of the visualization (32) and / or change a size of the visualization (32).

9. Method for analysing medical image data (34) in a virtual multi-user collaboration according to any one of claims 1 to 8, wherein at least one user (A, N,C, S) may adopt the change(s) of the visualization (32) of the medical image data (34) made by another user, or wherein one user may force at least one other user to adopt his / her change(s) of the visualization (32) of the medical image data (34).

10. Method for analysing medical image data (34) in a virtual multi-user collaboration according to any one of claims 1 to 9, wherein the step of allowing at least one user (A, N,C, S) to execute an analysing process of the medical image data (34) in his / her workspace (30) further includes taking 3D measurements, executing MPR-Mode and / or inserting annotation.

11. Method for analysing medical image data (34) in a virtual multi-user collaboration according to any one of claims 1 to 10, wherein the step of allowing at least one user (A, N,C, S) to execute the analysing process of the medical image data (34) in his / her workspace (30) further includes positioning at least one model of a medical device, specifically an implant, within the visualization (32) of the medical image data (34) so as to determine its operational position wherein the operational position of the model of the medical device is be determined by visualizing the medical device dynamically in operation, preferably in combination with the 4D image information.

12. Computer program comprising program code instructions, which, when executed by a processor, enables the processor to carry out the method according to any one of claims 1 to 11.

13. User interface configured to be used in executing a method according to any one of claims 1 to 11, wherein the user interface includes: a XR display device, in particular a VR headset (80), for displaying a visualization (32) of medical image data (34) and a result of an analysing process in real-time within a workspace (30) to a user (A, N,C, S), wherein the workspace (30) is a XR- workspace, and wherein the workspace (30) includes a virtual environment so as to display the visualization (32) of medical image data (34) and the result of the analysing process within the virtual environment, and a tracked controller (36) configured to be used during execution of the method in order to input commands by gestures of the user, wherein the commands include: selectively and individually enable and disable the display of the result of the analyzing process.

14. User interface according to claim 13, wherein the commands further include: individually and independently adjust a contrast within the workspace (30) of the user, preferably by setting a transparency and / or a colour of the virtual environment.

15. System for analysing medical image data (34) in a virtual multi-user collaboration including: a processor (72) configured to carry out the method according to any one of claims 1 to 11, and at least two user interfaces according to claim 13 or 14 that are connected to the processor.