Maintaining teleconference connections with minimum resolution and / or frame rate

Abstract

Disclosed herein is a medical system (100, 300) comprising a camera system (104) configured to provide at least one subject video stream (144), a medical video source (106) configured to provide at least one medical video stream (142), and a network interface (122). Execution of the machine executable instructions (140) causes the computing system (120) to: form (200) a teleconference connection (130) configured to provide a plurality of video streams (148) to one or more remote communication devices (114) via a network connection; determining (202) a bandwidth (150) of the network connection; receiving (204) a minimum resolution and / or a minimum frame rate (152) for one of the plurality of video streams; and reducing (206) a frame rate and / or resolution of another of the one or more video streams, and / or stopping transmission of another of the one or more video streams to ensure that transmission of the plurality of video streams does not exceed the bandwidth.

Description

Technical Field

[0001] The present invention relates to medical remote conferences. Background Art

[0002] Remote conferences are cost-effective means that allow remote personnel to participate in medical examinations, training exercises, or discussions.

[0003] U.S. Patent Application Publication US2010318380A1 discloses a controller configured to allow flexible control of the distribution of information for remote medical assistance provided via a telemedicine workplace for a procedure performed in a treatment room. The controller is configured to receive medical information from a medical modality or a medical information storage system, forward the received medical information to a display in the treatment room, control the forwarding of the information to the treatment room, forward the received medical information to a display in the telemedicine workplace, and control the forwarding of the received medical information to the telemedicine workplace.

[0004] U.S. Patent Application Publication US20140357993A1 discloses generating a live video stream of medical images at a local site having a medical image scanner. The live video stream is transmitted via a network to at least one remote site, which may include a wired or wireless Internet connection. The network condition is monitored during a network session, and a predicted bit rate for transmission is predicted. Compression parameters for the live video stream are selected based on the predicted bit rate.

[0005] The journal publication by Yoo et al., "Design of a PC-based multimedia telemedicine system for brain function telemeticology," (International Journal of Medical Informatics, Volume 61, Issues 2-3, 2001, Pages 217-227, ISSN 1386-5056, http: / / doi.org / 10.1016 / S1386-5056(01)00143-5 ) discloses that during a time-critical brain surgery, the detection of developing cerebral ischemia is particularly important because early treatment intervention can reduce the patient's mortality rate. The aim of the system is to provide an effective means for remote consultation for early ischemia detection, especially when no subspecialist is available. The hardware and software design architecture of a multimedia brain function remote consultation system including a dedicated brain function monitoring system is described. To fully support remote consultation, multimedia resources required for ischemia interpretation are included: EEG signals, CSA, CD-CSA, radiographic images, surgical microscope video images, and video conferencing. Summary of the Invention

[0006] The present invention provides a medical system, a computer program, and a method as defined in the independent claims. Embodiments are given in the dependent claims.

[0007] In a medical teleconference, it may be difficult to provide an appropriate amount of information to remote users. If there are multiple video streams, limited bandwidth may cause degradation or corruption of useful information. Embodiments may provide improved teleconferencing means by using a medical system configured to set a minimum resolution and / or a minimum frame rate for one of the multiple video streams. To maintain its minimum resolution and / or frame rate, other video streams (selected from the multiple video streams and excluding the said one video stream of the multiple video streams) have their frame rate reduced and / or their resolution reduced, and / or the other video streams are stopped or paused to provide sufficient network bandwidth.

[0008] In one aspect, the present invention provides a medical system that includes a memory storing machine-executable instructions. The medical system also includes a camera system configured to provide at least one object video stream. Thus, the camera system may include one or more cameras. In some examples, there may be one or more cameras for imaging an object. In other examples, alternatively or additionally, there may be one or more cameras for imaging a presenter.

[0009] The medical system also includes a medical video source configured to provide at least one medical video stream. In different examples, the medical video source may take different forms. In one example, the medical video source is a medical imaging system, such as an ultrasound system or a magnetic resonance imaging system. Then, the at least one medical video stream will include medical images acquired by the medical imaging system. In other examples, the medical video source may be a user interface where a presenter is viewing or discussing medical images (such as radiological or tomographic medical images). In other examples, the medical video source may stream from a repository or storage space storing medical images or videos. In other examples, the medical video source may be an external video feed of a remote presenter.

[0010] The medical system also includes a network interface configured to form a network connection with one or more remote communication devices. As used herein, a remote communication device is a device configured to display video information received via the network connection. The medical system also includes a computing system. Execution of the machine-executable instructions causes the computing system to form a teleconference connection with one or more remote communication devices via the network connection. As used herein, a teleconference connection includes a two-way connection via the network connection that enables two or more people to maintain a virtual discussion or meeting.

[0011] The remote conferencing connection includes or is configured to provide multiple video streams. The multiple video streams include at least one object video stream and at least one medical video stream. The execution of the machine-executable instructions also causes the computing system to determine the bandwidth of the network connection. Bandwidth is a measure of how much information or video data can be sent and / or received via the network connection. The execution of the machine-executable instructions also causes the computing system to receive the minimum resolution and / or minimum frame rate of one of the multiple video streams. It may be advantageous to specify the minimum resolution and / or minimum frame rate based on the content of one of the multiple video streams. For example, if certain data is being viewed in a radiological image, or the medical video source shows an image of an object, the minimum resolution and / or minimum frame rate may be necessary for what can be observed in one of the multiple video streams.

[0012] The execution of the machine-executable instructions also causes the computing system to reduce the frame rate and / or resolution of another video stream among the one or more video streams and / or stop the transmission of another video stream among the one or more video streams when enforcing the minimum resolution and / or minimum frame rate of one of the multiple video streams, and / or to ensure that the transmission of the multiple video streams does not exceed the bandwidth. In this feature, another video stream among the multiple video streams can be stopped and / or its data transmission can be reduced in the form of a reduced resolution and / or frame rate in order to ensure that one of the multiple video streams meets the specified conditions. This can be beneficial because it can enable complex medical data to be transmitted and disseminated to multiple users when the available bandwidth is limited. Such a situation can be particularly advantageous because there may be a large number of remote communication devices connected via the network interface. This can be a way to ensure that the minimum resolution and / or minimum frame rate of one of the multiple video streams is maintained.

[0013] It should also be noted that the minimum resolution and minimum frame rate of one of the multiple video streams can change over time, depending on the various actions being performed.

[0014] In an embodiment, the medical system further includes a medical imaging system. The medical video source includes the medical imaging system. Execution of the machine-executable instructions also causes the computing system to control the medical imaging system to acquire measurement data. As used herein, measurement data encompasses the raw data acquired by the medical imaging system, which is then used to reconstruct an image. Examples of these will include acoustic measurements made by an ultrasound system, k-space data in a magnetic resonance imaging system, or sectional data acquired by a computed tomography system. Execution of the machine-executable instructions also causes the computing system to reconstruct medical image data based on the measurement data. This embodiment may be beneficial because live medical image data can be provided by the medical system to multiple individuals. For example, the medical image data can provide video for a video stream that should have a minimum resolution and / or minimum frame rate among multiple video streams. This may be advantageous because it can ensure that the quality of the medical image data presented in its original form or via a user interface may be useful to remote users.

[0015] In another embodiment, at least one medical video stream includes a rendering of a control user interface of the medical imaging system. This embodiment may be advantageous because it can provide a way to present information from the user interface in a manner understandable or comprehensible to remote users. For example, this may be useful when discussing the repair of a medical imaging system, and it may also be useful in various other situations, such as when a group of individuals is discussing the operation of the medical system, viewing live medical image data being acquired by the medical imaging system, or viewing the data and discussing it.

[0016] In another embodiment, the medical imaging system is a magnetic resonance imaging system.

[0017] In another embodiment, the medical imaging system is a computed tomography system.

[0018] In another embodiment, the medical imaging system is an ultrasound imaging system.

[0019] In another embodiment, the medical imaging system is a positron emission tomography system.

[0020] In another embodiment, the medical imaging system is a single photon emission computed tomography system.

[0021] In another embodiment, the medical imaging system is a digital X-ray system.

[0022] In another embodiment, the medical imaging system is a digital fluoroscopy system.

[0023] In another embodiment, the medical imaging system is an image-guided therapy device. Examples of image-guided therapy devices can include, for example, an image-guided gamma knife guided by magnetic resonance imaging or computed tomography systems. Another example would be a LINAC guided by a magnetic resonance imaging system.

[0024] In another embodiment, the medical imaging system is a magnetic resonance imaging-guided high-intensity focused ultrasound device.

[0025] In another embodiment, the medical imaging system is a magnetic resonance imaging-guided radiotherapy device.

[0026] In another embodiment, the medical imaging system is a functional near-infrared spectroscopy system.

[0027] In another embodiment, the medical imaging system is a computed tomography-guided radiotherapy device.

[0028] In an embodiment, the execution of the machine-executable instructions also causes the computing system to determine the machine state of the medical imaging system during the acquisition of measurement data. The execution of the machine-executable instructions also causes the computing system to modify the minimum resolution and / or minimum frame rate based on the machine state. This embodiment may be beneficial because when using the medical imaging system, it is possible to modify the minimum resolution and / or minimum frame rate such that information about the medical imaging system can be accurately transmitted.

[0029] In another embodiment, the medical video source includes the presentation of a DICOM viewer user interface. This embodiment may be beneficial because it can effectively enable the sharing of data on a DICOM viewer user interface shared with more individuals during a remote conference. The medical video source also includes the presentation of a user interface.

[0030] In another embodiment, the medical video source also includes a medical image database. For example, a video stream can be provided by retrieving historical or archived data from the medical image database.

[0031] In another embodiment, the camera system is configured to image an object. The memory also stores a body tracking module that is configured to provide body motion data describing the body motion of the object in at least one object video stream. The execution of the machine-executable instructions also causes the computing system to determine the body motion data by inputting at least one object video stream into the body tracking module. The execution of the machine-executable instructions also causes the computing system to modify the minimum resolution and / or minimum frame rate of one of the plurality of video streams by applying a predetermined criterion to the body motion data. As used herein, the body tracking module is a software module that can be used to identify anatomical landmarks from an image or video of an object. Various analytical techniques and neural network-based techniques are known for providing body motion data.

[0032] In another embodiment, the body movement data includes hand movement data. The minimum resolution and / or the minimum frame rate are modified by applying a predetermined criterion to the hand movement. For example, the minimum frame rate resolution of the area around the hand of the object can be used. Additionally, by modifying the hand movement, specific actions or activities of the object can be recorded. This can provide, for example, a means to automatically adjust the minimum resolution and / or the minimum frame rate when a physician or other healthcare provider is performing a specific task.

[0033] In another embodiment, the body movement data includes eye gaze position data. For example, by looking at an object in an image, the body movement data can record where the object is looking. Similarly, the object can also wear special glasses that measure the eye gaze position data. The minimum resolution and / or the minimum frame rate are modified by applying a predetermined criterion to the eye gaze position data. For example, if a person is presenting data in a remote meeting, the minimum resolution and / or the minimum frame rate can be set such that the information the object is viewing is also presented to the participants at a remote location with a higher resolution or more smoothly at a higher frame rate.

[0034] In another embodiment, the execution of the machine-executable instructions also causes the computing system to receive device-specific configuration data from one or more remote communication devices. The execution of the machine-executable instructions also causes the computing system to use the device-specific configuration data to adjust the minimum resolution and / or the minimum frame rate. This can be useful because it can provide a means for remote users to adjust the video feed being sent to that remote location. For example, this can be useful in ensuring better video standards or quality and in reducing bandwidth when the remote user does not expect the bandwidth.

[0035] In another embodiment, the device-specific configuration data is received by applying configuration rules to device-specific user metadata. For example, there may be data specifying the position of the user in the organization or containing specific data regarding the user's video requirements. This can provide a means to better customize the minimum resolution and / or the minimum frame rate for a specific user.

[0036] In another embodiment, one or more of the remote communication devices are computers.

[0037] In another embodiment, one or more of the remote communication devices are smart phones.

[0038] In another embodiment, one or more of the remote communication devices are mobile telecommunications devices.

[0039] In another embodiment, one or more of the remote communication devices are DICOM user interfaces.

[0040] In another embodiment, one or more of the remote communication devices are tablet computers.

[0041] In another embodiment, the device-specific configuration data is user-generated configuration data received from the user interface of one or more remote communication devices. For example, the user may manually input the user-generated configuration data.

[0042] In another embodiment, the execution of the machine-executable instructions also causes the computing system to apply an object data filter to remote object data from multiple video streams. For example, this may be useful for reducing the bandwidth of multiple video streams. For example, if there is text data or other information about a particular object included in at least one medical video stream, a software module can be used to blur or obscure or blot out the information. Removing the data can result in a reduction in the size of the multiple video streams.

[0043] The object data filter can, for example, have an optical character recognition (OCR) module capable of identifying or discerning text data in multiple video streams. The filter can be used to specify which information can be removed. In this case, a software module can then be used to blot out or block the detected object data. The encoding requirements for the blocked or blotted-out area will be less compared to the case where more complex text data is presented.

[0044] In another aspect, the present invention provides a computer program that includes machine-executable instructions for execution by a computing system configured to control a medical system. For example, the machine-executable instructions can be stored or embodied on a non-transitory storage medium. The medical system includes a camera system configured to provide at least one object video stream. The medical system also includes a medical video source configured to provide at least one medical video stream. The medical video system further includes a network interface configured to form a network connection with one or more remote communication devices.

[0045] The execution of the machine-executable instructions causes the computing system to form a remote conference connection with one or more remote communication devices via the network connection. The remote conference connection includes or is configured to provide multiple video streams. The multiple video streams include at least one object video stream and at least one medical video stream. The execution of the machine-executable instructions also causes the computing system to determine the bandwidth of the network connection. The execution of the machine-executable instructions also causes the computing system to receive the minimum resolution and / or minimum frame rate of one of the multiple video streams.

[0046] The execution of the machine-executable instructions also causes the computing system to reduce the frame rate and / or resolution of another video stream or at least one video stream among one or more other video streams when implementing the minimum resolution and / or minimum frame rate of one of the multiple video streams, and / or stop the transmission of another video stream or at least one video stream among one or more other video streams to ensure that the transmission of the multiple video streams does not exceed the bandwidth.

[0047] In another aspect, the present invention provides a method of operating a medical system. The medical system includes a camera system configured to provide at least one object video stream. The medical system also includes a medical video source configured to provide at least one medical video stream. The medical system further includes a network interface configured to form a network connection with one or more remote communication devices.

[0048] The method includes forming a remote conference connection with one or more remote communication devices via the network connection. The remote conference connection is configured to provide multiple video streams. The multiple video streams include at least one object video stream and at least one medical video stream. The method also includes determining the bandwidth of the network connection. The method also includes reducing the frame rate and / or resolution of another video stream among one or more video streams, and / or stopping the transmission of another video stream among one or more video streams when implementing the minimum resolution and / or minimum frame rate of one of the multiple video streams to ensure that the transmission of the multiple video streams does not exceed the bandwidth.

[0049] It should be understood that one or more of the foregoing embodiments of the present invention may be combined as long as the combined embodiments are not mutually exclusive.

[0050] As will be appreciated by those skilled in the art, aspects of the present invention may be embodied as an apparatus, a method, or a computer program product. Accordingly, aspects of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, microcode, etc.), or an embodiment combining software and hardware aspects (which may be collectively referred to herein as "circuitry", "module", or "system"). Furthermore, aspects of the present invention may take the form of a computer program product embodied in one or more computer-readable media having computer-executable code embodied thereon.

[0051] Any combination of one or more computer-readable media can be utilized. A computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. As used herein, a computer-readable storage medium encompasses any tangible storage medium that can store instructions executable by a processor of a computing device or a computing system. A computer-readable storage medium can be referred to as a computer-readable non-transitory storage medium. A computer-readable storage medium can also be referred to as a tangible computer-readable medium. In some embodiments, a computer-readable storage medium can also be capable of storing data accessible by a computing system of a computing device. Examples of computer-readable storage media include, but are not limited to: floppy disks, magnetic hard disk drives, solid state drives, flash memory, USB thumb drives, random access memory (RAM), read-only memory (ROM), optical disks, magneto-optical disks, and register files of a computing system. Examples of optical disks include compact disks (CDs) and digital versatile disks (DVDs), such as CD-ROM, CD-RW, CD-R, DVD-ROM, DVD-RW, or DVD-R disks. The term computer-readable storage medium also refers to various types of recording media that can be accessed by a computer device via a network or a communication link. For example, data can be retrieved via a modem, via the Internet, or via a local area network. Computer-executable code embodied on a computer-readable medium can be transmitted using any suitable medium, including but not limited to wireless, wired, fiber optic cable, RF, etc., or any suitable combination of the foregoing media.

[0052] A computer-readable signal medium can include a propagated data signal having computer-executable code embodied therein, for example, in a baseband or as part of a carrier wave. Such a propagated signal can take any of a variety of forms, including but not limited to electromagnetic, optical, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium that is not a computer-readable storage medium and that can convey, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.

[0053] Computer memory or memory is an example of a computer-readable storage medium. Computer memory is any memory directly accessible by a computing system. A computer storage device or storage device is another example of a computer-readable storage medium. A computer storage device is any non-volatile computer-readable storage medium. In some embodiments, a computer storage device can also be a computer memory, and vice versa.

[0054] As used herein, "computing system" encompasses electronic components capable of executing programs or machine-executable instructions or computer-executable code. References to a computing system that include examples of "computing system" should be construed as possibly including more than one computing system or processing core. A computing system can be, for example, a multi-core processor. A computing system can also refer to a collection of computing systems within a single computer system or distributed among multiple computer systems. The term computing system should also be construed as possibly referring to a collection or network of computing devices each including a processor or computing system. Machine-executable code or instructions can be executed by multiple computing systems or processors, which can be within the same computing device or even distributed across multiple computing devices.

[0055] Machine-executable instructions or computer-executable code can include instructions or programs that cause a processor or other computing system to perform an aspect of the present invention. The computer-executable code for performing the operations of the various aspects of the present invention can be written in any combination of one or more programming languages, including object-oriented programming languages (such as Java, Smalltalk, C++, etc.) and conventional procedural programming languages (such as the "C" programming language or similar programming languages), and can be compiled into machine-executable instructions. In some cases, the computer-executable code can be in the form of a high-level language or a pre-compiled form and used in conjunction with an interpreter that generates machine-executable instructions on the fly. In other cases, the machine-executable instructions or computer-executable code can be in the form of programming for a programmable logic gate array.

[0056] The computer-executable code can execute entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the latter case, the remote computer can be connected to the user's computer through any type of network connection, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (e.g., using an Internet service provider via the Internet).

[0057] Aspects of the present invention are described with reference to the flowchart illustrations and / or block diagrams of methods, apparatuses (systems), and computer program products according to embodiments of the present invention. It should be understood that each block or a portion of the blocks in the flowchart illustrations and / or block diagrams can be implemented by computer program instructions in the form of computer-executable code when applicable. It should also be understood that, when not mutually exclusive, combinations of blocks from different flowchart illustrations and / or block diagrams can be combined. These computer program instructions can be provided to a computing system of a general-purpose computer, a special-purpose computer, or other programmable data processing devices to produce a machine, such that the instructions executed via the computing system of the computer or other programmable data processing devices create a module for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0058] These machine-executable instructions or computer program instructions can also be stored in a computer-readable medium, which can direct a computer, other programmable data processing devices, or other devices to operate in a specific manner, such that the instructions stored in the computer-readable medium produce an article of manufacture including instructions for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0059] The machine-executable instructions or computer program instructions can also be loaded onto a computer, other programmable data processing devices, or other devices, so that a series of operation steps are executed on the computer, other programmable devices, or other devices to produce a computer-implemented process, such that the instructions executed on the computer or other programmable devices provide a process for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0060] The user interface used herein is an interface that allows a user or an operator to interact with a computer or a computer system. The user interface can also be referred to as a human-machine interface device. The user interface can provide information or data to the operator and / or receive information or data from the operator. The user interface can enable the input from the operator to be received by the computer and can provide output from the computer to the user. In other words, the user interface can allow the operator to control or manipulate the computer, and the interface can allow the computer to indicate the effects of the control or manipulation by the operator. Displaying data or information on a display or a graphical user interface is an example of providing information to the operator. Receiving data through a keyboard, a mouse, a trackball, a touchpad, a pointing stick, a graphics tablet, a joystick, a gamepad, a webcam, headphones, pedals, a wired glove, a remote control, and an accelerometer are all examples of user interface components for receiving information or data from the operator.

[0061] As used herein, a hardware interface includes an interface that enables a computing system of a computer system to interact with and / or control an external computing device and / or apparatus. The hardware interface may allow the computing system to send control signals or instructions to the external computing device and / or apparatus. The hardware interface may also enable the computing system to exchange data with the external computing device and / or apparatus. Examples of the hardware interface include, but are not limited to: Universal Serial Bus, IEEE 1394 port, parallel port, IEEE 1284 port, serial port, RS-232 port, IEEE-488 port, Bluetooth connection, wireless local area network connection, TCP / IP connection, Ethernet connection, control voltage interface, MIDI interface, analog input interface, and digital input interface.

[0062] As used herein, a display or display device encompasses an output device or user interface suitable for displaying images or data. The display may output visual, audio, and / or tactile data. Examples of the display include, but are not limited to: computer monitor, television screen, touch screen, tactile electronic display, Braille screen, cathode ray tube (CRT), storage tube, bistable display, electronic paper, vector display, flat panel display, vacuum fluorescent display (VF), light emitting diode (LED) display, electroluminescent display (ELD), plasma display panel (PDP), liquid crystal display (LCD), organic light emitting diode display (OLED), projector, and head-mounted display.

[0063] Measurement data is defined herein as the recorded measurements made by a medical imaging system that describes an object. The measurement data may be reconstructed into medical image data. BRIEF DESCRIPTION OF THE DRAWINGS

[0064] Preferred embodiments of the present invention will be described below only by way of example and with reference to the accompanying drawings, wherein:

[0065] Figure 1 An example of a medical system is shown;

[0066] Figure 2 An example of a method of using a Figure 1 medical system is shown in a flowchart;

[0067] Figure 3 An example of a medical system is shown;

[0068] Figure 4 An example of a method of using a Figure 2 medical system is shown in a flowchart; and

[0069] Figure 5 An example of configuring multiple video streams is shown.

[0070] LIST OF REFERENCE NUMERALS

[0071] 100 Medical system

[0072] 102 Computer

[0073] 104 Camera system

[0074] 106 Medical video source

[0075] 108 Smart phone

[0076] 110 Tablet computer

[0077] 112 Remote computer

[0078] 114 Remote communication device

[0079] 120 Computing system

[0080] 122 Hardware / network interface

[0081] 124 User interface

[0082] 126 Memory

[0083] 130 Remote conference connection

[0084] 140 Machine-executable instructions

[0085] 142 Medical video stream

[0086] 144 Object video stream

[0087] 146 Object

[0088] 148 Multiple video streams

[0089] 150 Bandwidth measurement

[0090] 152 Minimum resolution and / or minimum frame rate

[0091] 154 One video stream among multiple video streams

[0092] 156 Video stream control command

[0093] 158 Body tracking module

[0094] 160 Body movement data

[0095] 162 Object data filter

[0096] 200 Form a remote conference connection with one or more remote communication devices via a network connection

[0097] 202 Determine the bandwidth of the network connection

[0098] 204 Receive the minimum resolution and / or minimum frame rate of one video stream among multiple video streams

[0099] When implementing the minimum resolution and / or minimum frame rate of one video stream among multiple video streams, reduce the frame rate and / or resolution of another video stream among one or more video streams, and / or stop the transmission of another video stream among one or more video streams to ensure that the transmission of multiple video streams does not exceed the bandwidth.

[0100] 300 Medical system

[0101] 302 Medical imaging system

[0102] 304 Measurement data

[0103] 306 Medical image data

[0104] 308 Machine state of medical imaging system

[0105] 400 Control a medical imaging system to acquire measurement data

[0106] 402 Reconstruct medical image data based on measurement data

[0107] 404 Determine the machine state of a medical imaging system during the acquisition of measurement data

[0108] 406 Modify the minimum resolution and / or minimum frame rate based on the machine state

[0109] 500 Program information / objectives

[0110] 502 Context factors

[0111] 504 Set calculator

[0112] 506 Issue settings and recommendations

[0113] 508 Feedback loop Detailed implementation

[0114] Elements with similar numbers in these figures are equivalent elements or perform the same functions. If the functions are equivalent, the elements previously discussed will not necessarily be discussed in the subsequent figures.

[0115] Figure 1An example of a medical system 100 is illustrated. The medical system is shown as including a computer 102. The medical system 100 is also shown as including a camera system 104 and a medical video source 106. Also shown are a smart phone 108, a tablet computer 110, and a remote computer 112. These are examples of remote communication devices 114 that can form a teleconference connection 130 with the computer 102. The computer 102 is shown as including a computing system 120. The computing system 120 can represent one or more computing or calculation cores at one or more locations. The computing system 120 is shown as communicating with a hardware or network interface 122. The hardware or network interface 122 is used to form a teleconference connection 130 with the remote communication devices 114. In this example, the hardware interface 122 is also used to form connections with the medical video source 106 and the camera system 104.

[0116] The computing system 120 is also shown as optionally connected to a user interface 124. The user interface 124 can provide, for example, a means for an operator to interact with and control the medical system 100. The computing system 120 is also shown as connected to a memory 126. The memory 126 is intended to represent various types of memory that the computing system 120 can access. In some examples, the memory 126 is a non-transitory storage medium.

[0117] The memory 126 is shown as containing machine-executable instructions 140. The machine-executable instructions 140 enable the computing system 120 to perform various tasks, such as controlling other components of the medical system 100. The machine-executable instructions 140 also enable the computing system 120 to perform various computing and video processing tasks. The memory 126 is also shown as containing a medical video stream 142 that has been received from the medical video source 106 and an object video stream 144 that has been received from the camera system 104. In this example, the camera system 104 images an object 146. The object video stream 144 will then contain a video stream depicting the object 146.

[0118] The medical video stream 142 and the object video stream 144 are then combined into multiple video streams 148. The multiple video streams 148 are then transmitted as part of the teleconference connection 130. The memory 126 is also shown as including a bandwidth measurement 150. This can be the bandwidth or the optimal bandwidth measurement of the teleconference connection 130 to each remote communication device 114. The memory 126 is also shown as including a minimum resolution and / or a minimum frame rate 152. The memory 126 is then shown as including a selection of one video stream 154 out of the multiple video streams that requires the minimum resolution and / or the minimum frame rate 152. The memory 126 also shows a video stream control command 156, which is used to adjust the content of the medical video stream 142 and / or the object video stream 144 such that when one video stream 154 out of the multiple video streams has the minimum resolution and / or the minimum frame rate 152, the bandwidth 150 is satisfied.

[0119] The execution of the video stream control command 156 can, for example, cause the computing system 120 to reduce the frame rate and / or the resolution of the streams in the multiple video streams 148 that are not one video stream 154 out of the multiple video streams.

[0120] The memory 126 is also shown as including an optional body tracking module 158. The body tracking module 158 takes an image of the object 146 as input and outputs body movement data 160. This can be used to optionally adjust the minimum resolution and / or the minimum frame rate 152, and to change the selection of which video stream out of the multiple video streams is one video stream 154. For example, the movement of the object 146 or the observation of the location that the object 146 is touching or pointing at or looking at can be used to provide this modification.

[0121] The memory 126 is further shown as including an optional object data filter 162. The optional object data filter 162 is capable of removing object data from the medical video stream 142 and / or the object video stream 144. For example, the object data filter 162 can have an OCR filter, which is used to identify specific object data and then can erase or block that specific object data in the multiple video streams 148. For example, this can be useful for reducing the bandwidth of the individual video streams in the multiple video streams 148.

[0122] Figure 2 The illustrated operations are shown Figure 1Diagram of the method of medical system 100. First, in step 200, a remote conference connection 130 is formed with one or more remote communication devices using the network interface 122. Next, in step 202, the bandwidth 150 of the remote conference connection 130 is determined. Then, in step 204, the minimum resolution and / or minimum frame rate 152 of a plurality of video streams 148 are received. Then, in step 206, when implementing the minimum resolution and / or minimum frame rate of one of the plurality of video streams, the frame rate of another one of the plurality of video streams is reduced and / or the resolution is reduced, and / or the transmission of another one of the plurality of video streams is stopped to ensure that the transmission of the plurality of video streams does not exceed the bandwidth. Steps 208, 210, and 212 are optionally executed. In step 208, body movement data 160 is determined by inputting at least one object video stream into the body tracking module 158.

[0123] Next, in step 210, the minimum resolution and / or minimum frame rate of one of the plurality of video streams is modified by applying a predetermined criterion to the body movement data 160. Finally, in step 212, the object data filter 162 is applied to the plurality of video streams 148 to remove object data from the plurality of video streams, thereby reducing the bandwidth of the plurality of video streams.

[0124] Figure 3 Illustrates another example of medical system 300. Figure 3 The medical system 300 in Figure 1 is similar to the medical system 100 in

[0125] The memory 126 is also shown as containing measurement data 304. The measurement data 304 is acquired by the medical imaging system 302. The memory 126 is also shown as containing medical image data 306 reconstructed from the measurement data 304. The medical imaging system 302 is intended to represent a typical medical imaging system. The medical imaging system can be, for example, a magnetic resonance imaging system, a computed tomography system, an ultrasound imaging system, a positron emission tomography system, a single photon emission computed tomography system, a digital X-ray system, a digital fluoroscopy system, an image-guided therapy device, a magnetic resonance imaging-guided high-intensity focused ultrasound device, a magnetic resonance imaging-guided radiotherapy device, a functional near-infrared spectroscopy system, or a computed tomography-guided radiotherapy device.

[0126] In Figure 3In the example shown, the medical imaging system 302 can have various internal machine states, such as when operating various controls or foot pedals, or when the X-ray tube is activated, or if the radio frequency system is in the process of acquiring k-space data for magnetic resonance imaging. The memory 126 is shown as containing the machine state of the medical imaging system 308. This is used, for example, in conjunction with a set of predetermined conditions or criteria to provide commands or instructions to modify the minimum resolution and / or minimum frame rate 152. In this case, when the medical imaging system 302 goes through various operational phases or states, the requirements for the multiple video streams 148 change accordingly.

[0127] Figure 4 A flowchart of means of a medical system 300 illustrating the operation Figure 3 is shown. In this flowchart, steps 200, 202, 204, and 206 are as Figure 2 illustrated and explained. After step 206 is executed, step 400 is executed. In step 400, the medical imaging system 302 is controlled to acquire measurement data 304. Next, in step 402, medical image data 306 is reconstructed based on the measurement data 304. Then, in step 404, the machine state 308 of the medical imaging system 302 is determined during the acquisition of the measurement data 304. Finally, in step 406, the minimum resolution and / or minimum frame rate is modified based on the machine state 308. It should be noted that step 404 can also be executed during steps 400 and 402.

[0128] It should also be noted that Figure 3 and 4 the embodiments depicted in Figure 1 and 2 can be combined with the examples illustrated in

[0129] Doctors, clinicians, and technicians have complex jobs that include many tasks. When preparing for or using image-guided therapy (IGT), magnetic resonance imaging (MRI), or ultrasound (US) techniques, they may need to look back to guide, distinguish peers, or may be teaching simultaneously.

[0130] It may be important that the teleconferencing software supports specific program goals (e.g., it precisely and timely shows what the remote party needs to see). However, the environment for transmitting visual, audio, video, and possibly tactile information to an external audience is not always optimal. For example, the connection may be slow due to insufficient bandwidth. Then, it may be beneficial not to overload the medical system with unnecessary information or features.

[0131] It may be beneficial if a medical system with a teleconferencing tool provides the correct information to both parties. Too little information may lead to clinical problems (e.g., inaccuracy); too much information may lead to connection problems.

[0132] Examples can have the benefit of optimizing communication requirements and finding the best configuration that gives context.

[0133] Examples can provide a medical system with a teleconference setting that will suit a particular situation (e.g., based on bandwidth, image quality (resolution) requirements, clinician characteristics, patient characteristics, privacy):

[0134] - Determine the goal / requirements of the session (next part)

[0135] - Determine context factors

[0136] - Determine the optimal settings to achieve the goal(s) in this context

[0137] - Issue the settings

[0138] - Feedback loop

[0139] Examples can also include algorithms for combining hospital / medical / device information, the parties involved, and session goals to form recommendations on what information needs to be transmitted and what information can be ignored.

[0140] Figure 5 An example of a configuration for setting multiple video streams 148 is illustrated. Box 500 represents the various programs and information goals that can be used during a particular teleconference. Box 502 indicates the various context factors. These context factors 502 can be various details about the programs or operations being performed near the teleconference or medical system 100, 300, for example. Both of these information sources 500, 502 are input into a settings calculator 504, which provides various settings 506 for configuring the teleconference connection 130 to maintain bandwidth. Various local operators can have certain requests or can emphasize various video streams among the multiple video streams 148. The feedback loop 508 provides a means for modifying it.

[0141] In some examples, this can include determining process information to determine the goal / requirements of the session. In this step, determine what the goal(s) of the session are. The main question is: What is the clinical task of this session? More specific questions are, for example, who is working together? What are their requirements? How important is quality? For example, is resolution or latency more important?

[0142] To collect this information as unobtrusively as possible, it may be derived from hospital information. This includes but is not limited to the following information:

[0143] - Patient diagnosis, planned procedure(s); details of the procedure, such as duration, complexity, required instruments, etc. This is obtained from the patient's medical record as well as the room and instrument plan.

[0144] - For example, for IGT, this can be done according to a "program card" if it has been previously used / selected: certain combinations of applications will become important to display together, and the program card can provide this information in advance.

[0145] - The interaction tasks / goals of the session. This involves sub - questions: Who is working together? And what are their goals? For example, is this a peer - to - peer session, a professor - student session, or something else? Is it for guidance, teaching, proctoring, or consulting, etc.?

[0146] For example, staff registration is used to determine the job title, which notifies the qualifications of the people involved (and their potential learning needs).

[0147] Calendar information about the program and attendance

[0148] What sends the requirements from User 1 and receives the requirements from User 2 (3, 4, etc.)? It is necessary to know their current knowledge and skill levels. Look at their roles, export information according to the staff records in the planning system, etc.

[0149] In addition, for remote users (i.e., staff in training), they fill in / select their information requirements before the session. Usually, in contrast to staff, remote users do have some time / motivation to interact with the system.

[0150] Understand where the actions / relevant information occur, such as information from the doctor's hand, movement from a video or catheter input (real - time input).

[0151] Context factors can also be used in some examples to determine the possibilities and limitations of interaction:

[0152] In this step, information is automatically collected, aiming to understand the context(s) in which the system must operate.

[0153] - Information can be collected on both the sender and receiver sides

[0154] - Static system information, such as monitor size

[0155] - Variable system information, such as connection information, including speed, consistency, reliability, bandwidth; continuously feedback / keep updating this information. This can be evaluated continuously or very frequently.

[0156] - Information about what is happening in the room of interest, for example

[0157] - Input from remote viewers or the system:

[0158] - Hand movements

[0159] - Eye Gaze: What the doctor is looking at and what might be most relevant (except when a remote supervisor / student / sales representative wants to check other sources such as settings / vital signs / historical images while the doctor is doing his / her thing).

[0160] - Moving image / last updated image / source (e.g., anglio runs).

[0161] - Foot pedal input (when taking an x-ray, usually regarding the live image at that time).

[0162] - Certain actions require magnification (e.g., measuring a lesion or a blood vessel), so a higher resolution is needed.

[0163] Examples can also include setting up a calculator (which can be implemented using machine-executable instructions 140 for example): determining the best settings to achieve the goal(s) in that context.

[0164] The system may work in 2 steps: information prioritization followed by context analysis.

[0165] Step 1: Prioritization of information. Based on the session goal (and transient goals), the system determines which information needs to be prioritized.

[0166] - This includes the priorities of users 1 and 2 (etc.). It determines what needs to be sent and received from each based on information from the first element (determining the goal).

[0167] - Patient safety is always at the top of the priority list.

[0168] - When the correct information fails to be provided at the right moment, it can consider the severity of the consequences. This can include using scientific information and hospital data to gather this information.

[0169] Step 2: Weight these goals against context factors and normative (experience and / or group) data. This can include determining what the technical possibilities are in that context. For equal priorities, equal weighting factors are given.

[0170] - A system that weights these goals against the context; can be rule-based, given a priority list

[0171] - Some basic requirements:

[0172] - When the application / image linked to the device (e.g., IVUS image) changes, we know that the device is being moved, and it may be useful to show two views. If there are multiple cameras, it would be helpful to provide the remote user with a synthetic view / contour from the operator's perspective.

[0173] - When anything happens to the device (e.g., catheter, stent placement, etc.), it is important to show the combination of hand movement + device. For example, for IGT, when there are specific problems or novelties in the use of the device (e.g., support / supervision of a specific technology by a device sales representative).

[0174] - For certain procedural steps (e.g., access, stent placement), hand movement with the device is always relevant in combination with live images (if available). (Although this view may be much smaller than the clinical image).

[0175] - When showing the general OR view: This view is not necessary, but gives good context and is very welcome in the remote training or guidance of support staff. Clinicians are also positive, but it is good to be able to provide it for remote support / second opinion. If you want to broadcast it as a (live) example in a lecture or conference, this is also standard. It is about: the layout of the laboratory, who is involved in which position, but also only gives the human factor to it. Some key moments:

[0176] - During the introduction of the example (before sharing specific information)

[0177] - Changes in settings (e.g., C-arm movement)

[0178] - Between moments, it is a good fallback view.

[0179] - Clinical staff on the operating side should be disturbed as little as possible. For remote users, it is quite acceptable for the remote user to scale / click / select different views as long as it avoids the need for clinical staff to intervene. Thus, the system can decide based on its input, for example, simply to increase / decrease the resolution or frame rate; the remote user can then zoom in, so they can increase the resolution; if needed. Or select their own camera source.

[0180] - Then decide which information is broadcast to which receiver.

[0181] Output: Issue the remote conference settings

[0182] In this phase, the system updates the settings that determine which information is relayed at what speed and quality (and which is not).

[0183] - This includes settings for different information sources: text, video, audio (e.g., detection phase; interpretation vs modeling).

[0184] - Based on the clinical tasks and modalities used, it is also possible to recommend the use of settings. For example, the settings for an MR procedure will be different from those for an IGT procedure.

[0185] - Each modality (CT, MR, US) has different settings for different tasks (clinical condition of the patient). For example: different views in terms of x-ray, lateral tilt, etc. Based on the clinical condition to be imaged and the specified modality, settings can be recommended.

[0186] - The look-up table is used to adapt what the recipient does / sees / requests.

[0187] - Can we mention a few examples of IGT settings here?

[0188] - The call settings can be changed in the current design: for example, what camera input is shared, who is muted, etc.

[0189] - Call settings in potential future designs, for example, what viewport is shared / what grid or layout is presented, what is the shared resolution

[0190] In some examples, a feedback loop can be used to increase the success rate. To improve user satisfaction and the success rate of the system, there are various ways to understand the performance of the system.

[0191] - At any time, the user (both sender and receiver) can override the output settings.

[0192] - If the user asks for additional information, that additional information is also stored (for example, turning on the whole-house camera while the system chooses not to display it). If a particular piece of additional information is requested regularly, the system can automatically add it to the default values of these processes.

[0193] - The user can manually change the weights of the priorities and feed this information back to the system for future use.

[0194] - A post-event survey that evaluates the satisfaction of (all) users; and specifically, dissatisfaction with the streamed data, for example, what was lost?

[0195] - For complex processes when one or more of the active participants are working remotely, it may be beneficial to clearly read out the steps from a checklist among the participants (similar to the SOP of an airplane pilot). The system will use speech recognition and NLP to verify the integrity.

[0196] The medical system can consider this feedback, relate it to the specific goals and context of the setting, and improve the rules / algorithms for these instances. The setting recommender can be multi-class classification, where a convolutional neural network is used for classification. Process information and context factors will be the two inputs to the network, and a set of settings will be the various classes for classification. In the scenario where the user modifies / changes the recommended settings, the modified settings are added to the list as feedback for further training.

[0197] The basic medical system can be augmented by one or more of the following embodiments:

[0198] - When determining the goal: As the relevance of sounds, videos, or medical images may change over time, continuously update the interaction goal. This includes setting (subsequent in time) sub-goals based on the main goal determined in the first step.

[0199] - Technical metrics / aspects measured in real-time / live, such as monitor size, etc.

[0200] - The user depicts adding, removing, and adapting basic rules in the calculator, for example, which views are preferably together, which clinician is being monitored, setting an alarm when the connection quality drops below a certain threshold, etc.

[0201] Examples of medical systems can be applied to many settings:

[0202] - For remote conferencing, education, consultation, supervision, guidance, teaching, etc.

[0203] - For clinical support (as described herein), but also for, for example, technical support, systems like ROCC, and users like biomedical, RSE, etc.

[0204] For multiple clinical modalities: Precise diagnosis (PD), computed tomography (CT), image-guided therapy (IGT), magnetic resonance (MR), etc.

[0205] - The above examples are typically specific to IGT. Similar systems can also have similar benefits for MR / CT, but are generally less complex.

[0206] - For example, the PD modality (CT / DXR / MR) generally does not perform procedures, so if you were to do so, there would be no point in broadcasting a live instance. For example, when technicians want a radiologist to view the image quality, they can also share the screen quite directly. There is a trade-off here between speed / IQ, but it is less urgent.

[0207] - And potentially also in regular meetings between colleagues.

[0208] Although the invention has been illustrated and described in detail in the drawings and the foregoing description, such illustration and description are to be considered illustrative or exemplary and not restrictive; the invention is not limited to the disclosed embodiments.

[0209] By studying the drawings, the disclosure and the claims, those skilled in the art will be able to understand and implement other variations of the disclosed embodiments when practicing the claimed invention. In the claims, the word "comprising" does not exclude other elements or steps, and the words "a" or "an" do not exclude a plurality. A single processor or other unit may implement the functions of several items recited in the claims. The fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used advantageously. A computer program may be stored / distributed on a suitable medium, such as an optical storage medium or a solid-state medium provided together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems. Any reference signs in the claims should not be construed as limiting the scope.

Claims

1. A medical system (100, 300), comprising: a memory (126) that stores machine-executable instructions (140); a camera system (104) configured to provide at least one object video stream (144); a medical video source (106) configured to provide at least one medical video stream (142); a medical imaging system (302), wherein the medical video source includes the medical imaging system; a network interface (122) configured to form a network connection with one or more remote communication devices; a computing system (120), wherein execution of the machine-executable instructions causes the computing system to: form (200) a remote conference connection (130) with the one or more remote communication devices via the network connection, wherein the remote conference connection is configured to provide a plurality of video streams (148), wherein the plurality of video streams includes the at least one object video stream and the at least one medical video stream; determine (202) the bandwidth (150) of the network connection; receive (204) the minimum resolution and / or minimum frame rate (152) of one of the plurality of video streams; when implementing the minimum resolution and / or the minimum frame rate of the one of the plurality of video streams, reduce (206) the frame rate and / or resolution of another one of the plurality of video streams, and / or stop transmission of another one of the plurality of video streams to ensure that transmission of the plurality of video streams does not exceed the bandwidth; control (400) the medical imaging system to acquire measurement data (304); reconstruct (402) medical image data based on the measurement data; determine (404) the machine state (308) of the medical imaging system during acquisition of the measurement data; and modify (406) the minimum resolution and / or minimum frame rate based on the machine state.

2. The medical system according to claim 1, wherein, the at least one medical video stream includes a presentation of a control user interface of the medical imaging system.

3. The medical system according to claim 1 or 2, wherein, the medical imaging system is any one of the following: a magnetic resonance imaging system, a computed tomography system, an ultrasonic imaging system, a positron emission tomography system, a single photon emission computed tomography system, a digital X-ray system, a digital fluoroscopy system, an image-guided therapy device, a magnetic resonance imaging-guided high-intensity focused ultrasound device, a magnetic resonance imaging-guided radiotherapy device, a functional near-infrared spectroscopy system, and a computed tomography-guided radiotherapy device.

4. The medical system according to any one of the preceding claims, wherein, the medical video source includes any one of the following: a presentation of a DICOM viewer user interface, a presentation of a user interface, a medical image database, and combinations thereof.

5. The medical system according to any one of the preceding claims, wherein, The camera system is configured to image an object (146), wherein the memory also stores a body tracking (158) module configured to provide body motion data (160) describing the body motion of the object in the at least one object video stream, and wherein the execution of the machine-executable instructions further causes the computing system to: determine (208) the body motion data by inputting the at least one object video stream into the body tracking module; and modify (210) the minimum resolution and / or the minimum frame rate of one of the plurality of video streams by applying a predetermined criterion to the body motion data.

6. The medical system according to claim 5, wherein any of the following: the body motion data includes hand motion data, and the minimum resolution and / or the minimum frame rate is modified by applying the predetermined criterion to the hand motion; the body motion data includes eye gaze position data, and the minimum resolution and / or the minimum frame rate is modified by applying the predetermined criterion to the eye gaze position data; and a combination thereof.

7. The medical system according to any of the preceding claims, wherein the execution of the machine-executable instructions further causes the computing system to: receive device-specific configuration data from the one or more remote communication devices; and use the device-specific configuration data to adjust the minimum resolution and / or the minimum frame rate.

8. The medical system according to claim 7, wherein the device-specific configuration data is received by applying a configuration rule to device-specific user metadata.

9. The medical system according to any of the preceding claims, wherein the one or more remote communication devices are any of the following: a computer, a smart phone, a mobile telecommunications device, a DICOM user interface, and a tablet computer.

10. The medical system according to claim 7, 8, or 9, wherein the device-specific configuration data is user-generated configuration data received from a user interface of the one or more remote communication devices.

11. The medical system according to any of the preceding claims, wherein the execution of the machine-executable instructions further causes the computing system to apply (212) an object data filter (162).

12. The medical system according to any of the preceding claims, wherein the machine state is an operating state.

13. The medical system according to any of the preceding claims, wherein the machine state is any of the following: operation of controls of the medical imaging system; operation of a foot pedal of the medical imaging system; activation of an X-ray tube, the medical system including an X-ray system; and activation of a radio frequency system for acquiring k-space data, the medical system including a magnetic resonance imaging system.

14. A computer program comprising machine-executable instructions (140) for execution by a computing system (120) configured to control a medical system (100, 300), wherein The medical system includes a camera system (104) configured to provide at least one object video stream (142), wherein the medical system further includes a medical video source (106) configured to provide at least one medical video stream (142), wherein the medical system further includes a medical imaging system (302), wherein the medical video source includes the medical imaging system, wherein the medical system further includes a network interface (122) configured to form a network connection with one or more remote communication devices, wherein the execution of the machine-executable instructions causes the computing system to: Form (200) a remote conference connection (130) with the one or more remote communication devices via the network connection, wherein the remote conference connection is configured to provide a plurality of video streams (148), wherein the plurality of video streams includes the at least one object video stream and the at least one medical video stream; Determine (202) the bandwidth (150) of the network connection; Receive (204) the minimum resolution and / or minimum frame rate of one of the plurality of video streams; When implementing the minimum resolution and / or the minimum frame rate of one of the plurality of video streams, reduce (206) the frame rate and / or resolution of another video stream of the plurality of video streams, and / or stop the transmission of another video stream of the plurality of video streams to ensure that the transmission of the plurality of video streams does not exceed the bandwidth; Control (400) the medical imaging system to acquire measurement data (304); Reconstruct (402) medical image data based on the measurement data; Determine (404) the machine state (308) of the medical imaging system during the acquisition of the measurement data; and Modify (406) the minimum resolution and / or minimum frame rate based on the machine state.

15. A method of operating a medical system (100, 300), wherein, The medical system includes a camera system (104) configured to provide at least one object video stream (144), wherein the medical system further includes a medical video source (106) configured to provide at least one medical video stream (142), wherein the medical system further includes a medical imaging system (302), wherein the medical video source includes the medical imaging system, wherein the medical system further includes a network interface (122) configured to form a network connection with one or more remote communication devices, wherein the method includes Form (200) a remote conference connection (130) with the one or more remote communication devices via the network connection, wherein the remote conference connection is configured to provide a plurality of video streams (148), wherein the plurality of video streams includes the at least one object video stream and the at least one medical video stream; Determine (202) the bandwidth (150) of the network connection; Receive (204) the minimum resolution and / or minimum frame rate (152) of one of the plurality of video streams; When implementing the minimum resolution and / or the minimum frame rate of the one video stream among the multiple video streams, reduce (206) the frame rate and / or the resolution of another video stream among the multiple video streams, and / or stop the transmission of another video stream among the multiple video streams to ensure that the transmission of the multiple video streams does not exceed the bandwidth; Control (400) the medical imaging system to acquire measurement data (304); Reconstruct (402) medical image data based on the measurement data; Determine (404) the machine state (308) of the medical imaging system during the acquisition of the measurement data; and Modify (406) the minimum resolution and / or the minimum frame rate based on the machine state.

Images