One-dimensional position indicator

Abstract

Disclosed herein is a medical system (100, 300, 500) comprising: a memory (110) storing machine executable instructions, at least one set of predetermined coordinates (124), and a position recognition algorithm (122). The position recognition algorithm is configured to output, in response to receiving a current image depicting an object (306, 310), a set of current coordinates (128) for each set of predetermined coordinates of the at least one set of predetermined coordinates. Execution of the machine executable instructions (120) causes a computing system (104) to repeatedly receive (200) a current image (126) from a camera system (304). Execution of the machine executable instructions (120) causes the computing system (104) to perform the following operations on the current image: receive (202), in response to inputting the current image into the position recognition algorithm, the set of current coordinates for each set of predetermined coordinates of the at least one set of predetermined coordinates; calculate (204) a position difference (130) between the at least one set of predetermined coordinates and its set of current coordinates; calculate (206) a one-dimensional value (134) from the position difference using an objective function; and provide (208), in real-time, using a user interface (108, 308, 416, 418), a one-dimensional position indicator (136, 314, 600, 602, 608, 800, 900, 1002) for and controlled by each one-dimensional value.

Description

Technical Field

[0001] This invention relates to medical imaging, and more particularly to the positioning of objects used in medical imaging. Background Technology

[0002] Various medical imaging modalities, such as X-ray, fluoroscopy, magnetic resonance imaging (MRI), computed tomography, positron emission tomography (PET), and single-photon emission tomography (SPECT), enable detailed visualization of the anatomical structures of objects. A common feature of all these imaging modalities is that they involve the proper placement of objects. These objects can be, for example, ultrasound transducers or the objects being imaged.

[0003] US Patent Application Publication US20140004488 A1 discloses a system for training practitioners when using an ultrasound system, comprising: a unit for managing the workflow of an ultrasound training session; a user interface for providing ultrasound training session instructions to the practitioner operating the ultrasound machine and for receiving input from the trainee; a unit for communicating with the ultrasound machine and for collecting one or more ultrasound images generated during the training session from the ultrasound machine; a unit for image processing of the ultrasound images; and a unit for evaluating the quality of the ultrasound images. A method for monitoring practitioner proficiency when using an ultrasound system includes: providing the practitioner with an ultrasound task definition; collecting one or more ultrasound images generated by the practitioner during the execution of the ultrasound task from the ultrasound machine; performing image processing on the ultrasound images; and evaluating the quality of the ultrasound images. Related apparatus and methods are also described.

[0004] US2015 / 020898A1 discloses a camera-based patient positioning system that provides a one-dimensional location indicator in real time.

[0005] US6937696B1 discloses the detection and predictable estimation of regular cycles of physiological activity or movement. Prospective or retrospective physiological gating of radiation treatment may be based on phases of physiological activity. Summary of the Invention

[0006] The present invention provides, in one aspect, medical systems, methods, and computer programs. In another aspect, embodiments are given.

[0007] The difficulty in performing medical imaging lies in the fact that it may require precise placement of equipment and / or objects. This typically necessitates extensive training and practice for the operator. Embodiments may provide a medical system that enables precise placement of objects for medical imaging with minimal training.

[0008] This can be achieved by repeatedly receiving the current image from the camera system. The current image is then input into a position recognition algorithm, which provides the current coordinates of the object. The current coordinates are then compared with predetermined coordinates, resulting in the calculation of a position difference. This position difference is the difference in the coordinates. This position difference can be multi-dimensional coordinates. The position difference is then input into an objective function that outputs a one-dimensional value. This one-dimensional value is then used to control a one-dimensional position indicator.

[0009] The one-dimensional position indicator can then be provided to the operator of the medical system or the object being imaged. The complex alignment or position of the object is reduced to a one-dimensional value controlling the one-dimensional position indicator. The value of the one-dimensional position indicator changes as the object or operator moves to a worse position. Experiments conducted by the operator or the object with small movements quickly determine how the object should be moved.

[0010] The objective function can be any type of objective function that can transform multidimensional location differences into one-dimensional values. The objective function can take different forms similar to those used in optimization problems employed by numerical methods.

[0011] In one aspect, the present invention provides a medical system. The medical system includes a memory storing machine-executable instructions, at least one set of predetermined coordinates, and a location recognition algorithm. The location recognition algorithm is configured to output a set of current coordinates for each of the at least one set of predetermined coordinates in response to receiving a current image describing an object. The location recognition algorithm may be, for example, an image segmentation algorithm. Various ways exist to implement segmentation algorithms or location recognition algorithms. For example, the image may be registered to an anatomical atlas. In other examples, the location recognition algorithm may be a template or a model-based matching system. In yet another example, the location recognition algorithm may be implemented, for example, as a trained neural network.

[0012] The medical system also includes a computing system configured to control the medical system. The execution of the machine-executable instructions causes the computing system to repeatedly receive current images from the camera system. For example, the current images may be received in the form of a video stream or a sequence of current images. The execution of the machine-executable instructions also causes the computing system to perform the following operations on the current images: this is to receive a set of current coordinates for each of the at least one set of predetermined coordinates in response to inputting the current image into the position recognition algorithm. The execution of the machine-executable instructions further causes the computing system to perform the following operations on the current images: this is to calculate the positional difference between the at least one set of predetermined coordinates and its set of current coordinates.

[0013] In other words, for each of the at least one set of predetermined coordinates, there exists a calculated positional difference. For the current image, the execution of the machine-executable instructions further causes the computing system to calculate a one-dimensional value for each of the at least one set of predetermined coordinates by inputting the positional difference for each set of predetermined coordinates into an objective function. In numerical optimization, multiple values ​​are typically input into the objective function, and the objective function is then either maximized or minimized. In numerical methods, the objective function is then used to search for the optimal value. In this case, the objective function is used to provide a simple means of understanding how to properly position the object. For the current image, the execution of the machine-executable instructions further causes the computing system to provide, in real-time, a one-dimensional position indicator for each one-dimensional value and controlled by each one-dimensional value using a user interface.

[0014] Instead of complex diagrams showing the proper positioning of an object, one-dimensional position indicators are used. Highly trained individuals or those with a very good sense of spatial reasoning may be able to interpret complex diagrams or instructions and understand how to move the object or themselves to properly position it. However, in many cases, training people to do this is not possible. If positioning involves complex body movements, people may lack the bodily awareness required to reproduce the spatial instructions with their own bodies, making it impossible for them to follow them.

[0015] If the object is in the appropriate position, the one-dimensional position indicator provides feedback. A person attempting to locate the object can receive stimuli from the one-dimensional position indicator through the user interface and understand from its one-dimensional changes whether the object is getting closer or further away from the appropriate position, without any training.

[0016] In some instances, the at least one set of predetermined coordinates may be only a single set of predetermined coordinates. This can be useful, for example, when positioning a rigid object. In other cases, such as when the object is a patient or a medical device, the coordinates may be connected by elastic or movable parts or components. A specific example, which will be discussed later, is the positioning of two shoulder joints. The object can move these independently. To provide the proper position of both, two one-dimensional position indicators are provided in this case. For more complex objects and positioning, any number of one-dimensional position indicators can be provided.

[0017] In different examples, the computing system can take different forms. For example, it can be a stereo camera. In other examples, it can be multiple cameras. These can be useful, for example, for generating three-dimensional images. In yet another example, the camera can be a three-dimensional camera, such as a time-of-flight camera.

[0018] In another embodiment, a one-dimensional position indicator for each of the at least one set of predetermined coordinates is adapted to provide real-time feedback on the alignment of the object with the at least one set of predetermined object coordinates. As mentioned above, the use of the one-dimensional position indicator can provide a method for achieving this with minimal or zero training.

[0019] In another embodiment, the at least one set of predetermined coordinates is a single set of predetermined coordinates. The object is an ultrasonic transducer. The single set of predetermined coordinates refers to the orientation and placement of the ultrasonic transducer on the object.

[0020] For example, the location recognition algorithm can also be used to identify the location of the object. The at least one set of predetermined coordinates can be used to reference the location on the object. The one-dimensional location indicator can then be used to guide the operator of the ultrasound transducer to the appropriate location. This could be useful for training ultrasound transducer operators and for providing a system available to physicians or medical technicians with minimal training in using diagnostic ultrasound systems.

[0021] In another embodiment, the at least one set of predetermined coordinates is an anatomical location. In this case, the object is a patient or a medical subject. This embodiment may be particularly advantageous because the various parts of the patient or object are flexible and can move relatively independently. To perform complex medical examinations or diagnostic imaging procedures, it is often necessary to position multiple parts or areas of the object's body in appropriate locations. The one-dimensional location indicator can be displayed to the object to provide a method to help it correctly orient itself.

[0022] In another embodiment, the medical system further includes the camera system and the display.

[0023] In another embodiment, the medical system further includes a medical imaging system. Each of the at least one set of predetermined coordinates defines the three-dimensional position and orientation of a body portion of the object relative to the imaging area of ​​the medical imaging system. The medical imaging area can be a spatial region in which medical imaging data describing the body of the object can be acquired. This can be, for example, within the imaging area of ​​a magnetic resonance imaging system or within the path of an X-ray beam used in a digital X-ray or fluoroscopy system. In some instances, the display is configured to provide feedback to the object. The display can be used to provide the object with a one-dimensional position indicator for each of the one-dimensional values ​​in real time.

[0024] In another embodiment, the medical imaging system is a magnetic resonance imaging system.

[0025] In another embodiment, the medical imaging system is a diagnostic ultrasound system.

[0026] In another embodiment, the medical imaging system is a computed tomography (CT) system.

[0027] In another embodiment, the medical imaging system is a positron emission tomography (PET) system.

[0028] In another embodiment, the medical imaging system is a single-photon emission computed tomography (SPECT) system.

[0029] In another embodiment, the execution of the machine-executable instructions also causes the computing system to receive an imaging protocol selection. For example, a physician may command the execution of a specific diagnostic radiological procedure. This could be, for example, a specific type of X-ray or magnetic resonance imaging protocol on a specific anatomical region of the object. The imaging protocol selection can identify the positioning of the object for a specific imaging procedure.

[0030] The execution of the machine-executable instructions also causes the computing system to retrieve a set of positioning instruction steps for locating the object by querying a database with the imaging protocol selection. The set of positioning instruction steps describes a sequence of positioning instructions. At least one positioning instruction in the sequence includes the at least one set of predetermined coordinates. In this step, the positioning instruction steps are a set of steps that can be used to place the object in an appropriate location for a specific medical imaging protocol.

[0031] At least one of these steps uses the one-dimensional position indicator. The execution of the machine-executable instructions also enables the computing system to provide a predefined sequence of positioning instructions using the user interface. Typically, the user interface will have a display, which is then optically presented to the object. However, other alternatives exist. For example, the user interface can provide auditory or tactile instructions for a visually impaired object. This could, for example, include a description of how the object should position its body, and then use the one-dimensional position indicator, enabling the object to position itself or itself without feedback.

[0032] The execution of the machine-executable instructions also enables the computing system to monitor object movement during the display of a predetermined sequence of positioning instructions. The position indicator is provided in real time for at least one positioning instruction in the predefined sequence of positioning instructions. This embodiment may be advantageous because it can provide a complete system that enables objects to position themselves into difficult or complex postures for medical imaging. As mentioned above, some embodiments may also provide a means for visually impaired objects to perform this operation.

[0033] In another embodiment, the execution of the machine-executable instructions is configured such that the computing system provides the one-dimensional position indicator in real time after the object motion description fails to successfully complete at least one positioning instruction in a predefined sequence of positioning instructions. When the predefined sequence of positioning instructions is provided, the object motion can be monitored to check whether the object is properly positioned. If the system detects that the object is not properly positioned or cannot acquire the correct position or posture within a predetermined time limit, the system can then automatically display one or more one-dimensional position indicators to assist the object.

[0034] In another embodiment, if a set of current conditions meets predefined criteria, the execution of the machine-executable instructions also causes the computing system to provide a success indicator indicating the positioning following each positioning instruction in a predefined sequence of positioning instructions. For example, if the current coordinates are within a predetermined distance or within the positional difference from the predetermined coordinates, the system can accept that the object has been correctly positioned. The success indicator can be, for example, a specific sound or auditory indicator, or it can also be an object or symbol displayed on a display, so that the object knows that the specific positioning has been achieved. If a set of current coordinates no longer meets the predetermined criteria, the execution of the machine-executable instructions also causes the computing system to remove the success indicator. In positioning for some radiological procedures, the object may need to be positioned sequentially in multiple different locations to obtain a final posture for the medical imaging procedure. Maintaining the position achieved by the object in a previous movement can be difficult. The success indicator can be used to provide feedback to the object to indicate whether a new movement has unintentionally caused the object to lose the positioning achieved by the previous movement.

[0035] In another embodiment, each of the at least one set of predetermined coordinates defines the three-dimensional position and orientation of the body parts of the object. As mentioned above, the various body parts of the object can be connected elastically or in a flexible or movable manner. A good example is positioning two shoulders in front of an X-ray plate. The object is able to move each shoulder relatively independently. In this case, two one-dimensional position indicators would be provided, one for each shoulder.

[0036] In another embodiment, the user interface is configured to provide at least one of the one-dimensional position indicators for each of the at least one set of predetermined coordinates as a tactile signal. The type of stimulus or feedback provided to the object can take different forms. It can be provided, for example, via audio information or also visually as a tactile signal. If multiple one-dimensional position indicators are present, different types of stimuli can be mixed.

[0037] In another embodiment, the user interface is configured to provide at least one of the one-dimensional position indicators for each of the at least one set of predetermined coordinates as an audio signal. This embodiment may be particularly beneficial to visually impaired individuals. The one-dimensional position indicator can be provided in various different ways. For example, an individual one-dimensional position indicator can be used to change the pitch of a tone, it can be used to change the timbre of a tone, it can be used to change the loudness of a tone, and it can also be used to modify the stereo position of a sound. The stereo position of the sound can be changed, for example, by shifting the relative volume to the left or right ear of the subject. Subjects also have a fairly highly developed sense of the spatial position of sounds from various psychoacoustic effects.

[0038] For example, in addition to altering the relative loudness of a sound or pitch, a slight delay may be introduced to create a very accurate spatial stereoscopic image in the subject's mind. These different audio signals can also be combined to convey more than one one-dimensional position indicator to the subject. For instance, if two one-dimensional position indicators exist, one can be used to alter the pitch or timbre of the sound, and the other can be used to alter the stereoscopic position of the sound, as described above, using the psychoacoustic effects or the relative volume. This means that even visually impaired individuals will then be able to orient themselves into highly complex locations with minimal assistance for medical imaging procedures.

[0039] In another embodiment, the audio signal includes amplitude variations.

[0040] In another embodiment, the audio signal includes pitch variations.

[0041] In another embodiment, the audio signal includes timbre variations.

[0042] In another embodiment, the audio signal includes a change in stereo audio position or position in a stereo audio field, as sometimes described.

[0043] In another embodiment, the user interface is configured to provide at least one of the one-dimensional position indicators for each of the at least one set of predetermined coordinates as a visual position indicator on the display. This can be advantageous because the display can be used to show a large number of one-dimensional position indicators. The display can also be used to provide other information, such as written instructions or graphics that provide additional guidance to the object.

[0044] In another embodiment, the visual position indicator is the position of an object along a predetermined path. For example, the object can be moved along a path away from a stationary point. When the stationary point is reached, the predetermined coordinates and the current coordinates can then be aligned within a predetermined range.

[0045] In another embodiment, the visual position indicator is provided as a rotation position on the display. Similar to the predetermined path, a specific rotation position may correspond to predetermined coordinates, and the current coordinates are aligned within a predetermined amount.

[0046] In another embodiment, the visual position indicator is provided as an object size. For example, the object size may increase or decrease, and a particular size may correspond to the predetermined coordinates, with the current coordinates aligned within the predetermined amount.

[0047] In another embodiment, the visual position indicator is provided as a color change of the displayed object or area. For example, the color may change or distort when the predetermined coordinates and the current coordinates become aligned within the predetermined amount. A specific example would be a color change from red to green, which indicates proper positioning.

[0048] In another embodiment, the location recognition algorithm is configured to output a set of current coordinates using a template-based matching algorithm. This can also be referred to as a model-based matching algorithm.

[0049] In another embodiment, the location recognition algorithm is configured to use a graphical structure model with a joint likelihood maximization algorithm to output a set of current coordinates.

[0050] In another embodiment, the location recognition algorithm is configured to output a set of current coordinates using a trained neural network.

[0051] In another embodiment, the location recognition algorithm is configured to output a set of current coordinates using a probability boosting tree algorithm.

[0052] In another embodiment, the location recognition algorithm is configured to output a set of current coordinates using a deformable model.

[0053] In another embodiment, the objective function is a linear combination of the coordinates that make up the positional difference.

[0054] In another embodiment, the objective function is the root mean square (RMS) value of the coordinates that make up the positional difference.

[0055] In another embodiment, the objective function is a linear combination of the absolute values ​​of the coordinates that make up the positional difference.

[0056] In another embodiment, the objective function is a weighted linear combination of the absolute values ​​of the coordinates that make up the positional difference.

[0057] In another embodiment, the objective function is the norm of the coordinates that make up the positional difference.

[0058] In another embodiment, the objective function is the L2 norm of the coordinates that make up the positional difference.

[0059] In another aspect, the present invention provides a method for operating a medical system. The method includes repeatedly receiving images from a camera system. The method further includes receiving a set of current coordinates for the current image for each of at least one set of predetermined coordinates in response to inputting the current image into a position recognition algorithm. The position recognition algorithm is configured to output a set of current coordinates for each of the at least one set of predetermined coordinates in response to receiving a current image describing an object. The method further includes calculating a positional difference between the at least one set of predetermined coordinates and its set of current coordinates for the current image. The method further includes calculating a one-dimensional value for each of the at least one set of predetermined coordinates for the current image by inputting the positional difference for each of the at least one set of predetermined coordinates into an objective function. The method further includes providing a one-dimensional position indicator for the current image in real time for each one-dimensional value and controlled by each one-dimensional value using a user interface. The advantages of this embodiment have been previously discussed.

[0060] In another aspect, the present invention provides a computer program including machine-executable instructions for execution by a computing system controlling a medical system. The computer program also includes a location recognition algorithm or an implementation thereof. The location recognition algorithm is configured to output a set of current coordinates for each of the at least one set of predetermined coordinates in response to receiving a current image describing an object. The execution of the machine-executable instructions causes the computing system to repeatedly receive the current image from a camera system.

[0061] The execution of the machine-executable instructions also causes the computing system to receive a set of current coordinates for each of at least one set of predetermined coordinates in response to inputting the current image into the location recognition algorithm. The execution of the machine-executable instructions also causes the computing system to calculate the positional difference between the at least one set of predetermined coordinates and its set of current coordinates for the current image.

[0062] The execution of the machine-executable instructions further enables the computing system to calculate a one-dimensional value for each of the at least one set of predetermined coordinates for the current image by inputting the positional difference for each set of predetermined coordinates into an objective function. The execution of the machine-executable instructions also enables the computing system to provide the current image with a one-dimensional position indicator for each one-dimensional value and controlled by each one-dimensional value in real time using a user interface. The advantages of this system have been previously discussed.

[0063] It should be understood that one or more of the foregoing embodiments of the present invention may be combined, as long as the combined embodiments are not mutually exclusive.

[0064] As those skilled in the art will recognize, various aspects of the present invention can be implemented as apparatus, method, or computer program product. Accordingly, various aspects of the present invention can take the form of a completely hardware embodiment, a completely software embodiment (including firmware, resident software, microcode, etc.), or an embodiment combining software and hardware aspects (all of which may be referred to herein as "circuit," "module," or "system" in general). Furthermore, various aspects of the present invention can take the form of a computer program product implemented in one or more computer-readable media having computer-executable code implemented thereon.

[0065] Any combination of one or more computer-readable media can be used. The computer-readable media can be a computer-readable signal medium or a computer-readable storage medium. As used herein, "computer-readable storage medium" encompasses any tangible storage medium capable of storing instructions executable by a processor or computing system of a computing device. A computer-readable storage medium may be referred to as a computer-readable non-transitory storage medium. A computer-readable storage medium may also be referred to as a tangible computer-readable medium. In some embodiments, a computer-readable storage medium may also be capable of storing data accessible by a computing system of a computing device. Examples of computer-readable storage media include, but are not limited to: floppy disks, magnetic hard disk drives, solid-state drives, flash memory, USB thumb drives, random access memory (RAM), read-only memory (ROM), optical discs, magneto-optical discs, and register files of computing systems. Examples of optical discs include compact discs (CDs) and digital universal discs (DVDs), such as CD-ROMs, CD-RWs, CD-Rs, DVD-ROMs, DVD-RWs, or DVD-R discs. The term computer-readable storage medium also refers to various types of recording media accessible by a computer device via a network or communication link. For example, data can be retrieved on a modem, the Internet, or a local area network. Computer-executable code implemented on a computer-readable medium may be transmitted using any suitable medium, including but not limited to wireless, wired, fiber optic cable, RF, or any suitable combination thereof.

[0066] Computer-readable signal media may include propagated data signals having computer-executable code implemented therein, for example, in baseband or as a carrier wave. Such propagated signals may take any variety of forms, including but not limited to electromagnetic, optical, or any suitable combination thereof. A computer-readable signal medium may be any computer-readable medium that is not a computer-readable storage medium and is capable of conveying, propagating, or transmitting a program used by or in conjunction with an instruction execution system, apparatus, or device.

[0067] "Computer memory" or "memory" is an example of a computer-readable storage medium. Computer memory is any memory that can be directly accessed by a computing system. "Computer storage device" or "storage device" is another example of a computer-readable storage medium. A computer storage device is any non-volatile computer-readable storage medium. In some embodiments, a computer storage device may also be computer memory, or vice versa.

[0068] As used herein, "computing system" encompasses electronic components capable of executing programs or machine-executable instructions or computer-executable code. References to computing systems, including examples of "computing systems," should be interpreted as encompassing more than one computing system or processing core. A computing system can, for example, be a multi-core processor. A computing system can also refer to a collection of computing systems within a single computer system or distributed among multiple computer systems. The term computing system should also be interpreted as a collection or network of computing devices, each comprising a processor or computing system. Machine-executable code or instructions can be executed by multiple computing systems or processors that may be within the same computing device or even distributed among multiple computing devices.

[0069] Machine-executable instructions or computer-executable code may include instructions or programs that instruct a processor or other computing system to perform aspects of the present invention. Computer-executable code for performing operations related to aspects of the present invention may be written in any combination of one or more programming languages ​​and compiled into machine-executable instructions, including object-oriented programming languages ​​such as Java, Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" programming language or similar programming languages. In some instances, the computer-executable code may be in the form of a high-level language or in a pre-compiled form and used in conjunction with an interpreter that generates machine-executable instructions at runtime. In other instances, machine-executable instructions or computer-executable code may be in the form of programming for executable logic gate arrays.

[0070] The computer-executable code may be executed entirely on the user's computer, partially on the user's computer (as a standalone software package), partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the latter case, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet provided by an Internet service provider).

[0071] Aspects of the invention are described with reference to flowchart illustrations, diagrams, and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It should be understood that, when applicable, each block or portion of a flowchart illustration, diagram, and / or block diagram can be implemented by computer program instructions in the form of computer-executable code. It should also be understood that combinations of blocks from different flowchart illustrations, diagrams, and / or block diagrams can be combined when not mutually exclusive. These computer program instructions can be provided to a computing system of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus that produces the machine, such that the instructions, executable via the computer or other programmable data processing apparatus, create units for implementing the functions / actions specified in the flowchart illustrations and / or one or more block diagram blocks.

[0072] These machine-executable instructions or computer program instructions may also be stored in a computer-readable medium that can instruct a computer, other programmable data processing apparatus or other device to operate in a particular manner, such that the instructions stored in the computer-readable medium produce an article of writing including instructions that implement the functions / actions specified in flowcharts and / or one or more block diagrams.

[0073] Machine-executable instructions or computer program instructions may also be loaded onto a computer, other programmable data processing apparatus or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device, thereby producing a computer-implemented process, such that the instructions, which execute on the computer or other programmable apparatus, provide for the process of the function / action specified in the flowchart and / or one or more block diagram boxes.

[0074] As used herein, a "user interface" is an interface that allows a user or operator to interact with a computer or computer system. A "user interface" can also be referred to as a "human-machine interface device." A user interface can provide or receive information or data from an operator. A user interface enables input from an operator to be received by the computer and output from the computer to the user. In other words, the user interface allows an operator to control or manipulate the computer, and the interface allows the computer to indicate the effects of the operator's control or manipulation. The display of data or information on a monitor or graphical user interface is an example of providing information to an operator. The reception of data via a keyboard, mouse, trackball, touchpad, pointing stick, graphics tablet, joystick, game controller, webcam, headset, pedal, wired gloves, remote control, and accelerometer are all examples of user interface components that implement the reception of information or data from an operator. A user interface can also provide audio or tactile information to a user or operator.

[0075] As used herein, "hardware interface" encompasses the interfaces that enable a computer system to interact with and / or control external computing devices and / or devices. A hardware interface allows the computing system to send control signals or instructions to external computing devices and / or devices. It also enables the computing system to exchange data with external computing devices and / or devices. Examples of hardware interfaces include, but are not limited to: Universal Serial Bus (USB), IEEE 1394 port, parallel port, IEEE 1284 port, serial port, RS-232 port, IEEE-488 port, Bluetooth connectivity, wireless LAN connectivity, TCP / IP connectivity, Ethernet connectivity, control voltage interfaces, MIDI interfaces, analog input interfaces, and digital input interfaces.

[0076] As used herein, “display” or “display device” encompasses an output device or user interface suitable for displaying images or data. Displays can output visual, audio, and / or tactile data. Examples of displays include, but are not limited to: computer monitors, television screens, touchscreens, tactile electronic displays, Braille screens, cathode ray tubes (CRTs), memory tubes, bistable displays, electronic paper, vector displays, flat panel displays, vacuum fluorescent displays (VFs), light-emitting diode (LED) displays, electroluminescent displays (ELDs), plasma display panels (PDPs), liquid crystal displays (LCDs), organic light-emitting diode (OLED) displays, projectors, and head-mounted displays.

[0077] Medical imaging data is defined herein as the recorded measurement results of a computed tomography medical imaging system describing an object. This medical imaging data can be reconstructed into a medical image. The medical image ID defined herein is a reconstructed two-dimensional or three-dimensional visualization of the anatomical data contained within the medical imaging data. This visualization can be performed using a computer. Attached Figure Description

[0078] In the following preferred embodiments, the invention will be described by way of example only and with reference to the accompanying drawings, wherein:

[0079] Figure 1 An example of a medical system is illustrated;

[0080] Figure 2 The illustration shows the use of Figure 1 A flowchart of the methods used in medical systems;

[0081] Figure 3 This illustration shows another example of a medical system;

[0082] Figure 4 This illustration shows another example of a medical system;

[0083] Figure 5 The illustration shows the use of Figure 1 , Figure 4 or Figure 5 A flowchart of the methods used in medical systems;

[0084] Figure 6 A view of a display with multiple one-dimensional position indicators is shown;

[0085] Figure 7 Another view of the display with multiple one-dimensional position indicators is shown;

[0086] Figure 8 Another view of the display with multiple one-dimensional position indicators is shown;

[0087] Figure 9 A view of a display with a one-dimensional position indicator is shown;

[0088] Figure 10 The illustration shows multiple one-dimensional position indicators provided by the stereo field;

[0089] Figure 11 A depiction of the desired object location for X-ray examination is shown;

[0090] Figure 12 Three images are shown to represent a set of sequential positioning steps; and

[0091] Figure 13 The diagram illustrates the use of the success indicator; and

[0092] Figure 14 The diagram shows... Figures 6 to 8 The one-dimensional position indicator is used to locate the two shoulders of an object.

[0093] List of reference numerals

[0094] 100 Medical Systems

[0095] 102 Computer System

[0096] 104 Computing System

[0097] 106 Hardware Interfaces

[0098] 108 User Interface

[0099] 110 Memory

[0100] 120 Machine-executable instructions

[0101] 122 Location Recognition Algorithm

[0102] 124 At least one set of predetermined coordinates

[0103] 126 Current Image

[0104] 128. For each of at least one set of predetermined coordinates, a set of current coordinates.

[0105] 130 Location Difference

[0106] 132 Objective Function

[0107] 134 One-dimensional value

[0108] 136 One-dimensional position indicator

[0109] 200 Repeatedly receive the current image from the camera system

[0110] 202 receives a set of current coordinates for each of at least one set of predetermined coordinates in response to inputting the current image into the location recognition algorithm.

[0111] 204 Calculate the positional difference between at least one set of predetermined coordinates and its current set of coordinates.

[0112] 206. The one-dimensional value for each set of predetermined coordinates is calculated by inputting the positional difference for each set of predetermined coordinates in at least one set of predetermined coordinates into the objective function.

[0113] 208 uses a user interface to provide in real-time one-dimensional position indicators for each one-dimensional value and controlled by each one-dimensional value.

[0114] 300 Medical Instruments

[0115] 302 Diagnostic Ultrasound System

[0116] 304 Camera System

[0117] 306 Ultrasonic Transducer

[0118] 308 monitor

[0119] 310 Object

[0120] 312 Object Support

[0121] 136 One-dimensional position indicator

[0122] 316 One-dimensional displacement

[0123] 318 objects

[0124] 320 Position of the object when the transducers are aligned

[0125] 400 Medical System

[0126] 402 Digital X-ray System

[0127] 404 X-ray generator

[0128] 406 X-ray detector

[0129] Path of 408 X-rays

[0130] 410 Imaging Protocol Selection

[0131] 412 Database

[0132] 414 A set of positioning instructions 416 Headphones

[0133] 418 Haptic Feedback System

[0134] 500 Receiver Imaging Protocol Selection

[0135] 502 Retrieve a set of positioning instructions for locating the object by querying a database with imaging protocol selection. 504 Provide a predefined sequence of positioning instructions using the user interface.

[0136] 506 Monitor object movement during a predefined sequence of positioning commands.

[0137] 600 First Rotation One-Dimensional Position Indicator

[0138] 600 First displacement one-dimensional position indicator

[0139] 604 First displacement

[0140] 606 Alignment Position

[0141] 608 Second displacement one-dimensional position indicator

[0142] 610 Second displacement

[0143] 700 degrees

[0144] 600 Second Rotation One-Dimensional Position Indicator

[0145] 802 angle

[0146] 804 Alignment Position

[0147] 900 Size One-Dimensional Position Indicator

[0148] 902 Alignment Size

[0149] 1000 Acoustic User Interface

[0150] 1002 Stereoscopic Images

[0151] 1004 Distance from the object's one-dimensional position indicator

[0152] 1006 Left / Right One-Dimensional Position Indicator

[0153] 1100 Expected object location

[0154] 1200 Positioning Command

[0155] 1202 Positioning Command

[0156] 1204 Positioning Command

[0157] 1300 Success Indicator

[0158] 1302 Misaligned indicator

[0159] First view of the 1400 monitor (object alignment)

[0160] Second view of monitor 1402 (one shoulder is misaligned)

[0161] Third view of monitor 1404 (two shoulders misaligned)

[0162] The back view of object 1406

[0163] Top view of object 1408

[0164] 1410 Misaligned shoulders Detailed Implementation

[0165] Components with similar numbers in these figures are either equivalent or perform the same function. If the functions are equivalent, then components that have already been discussed need not be discussed in later figures.

[0166] Figure 1 An example of a medical system 100 is illustrated. Figure 1 The medical system 100 is shown as including a computer system 102. Computer system 102 may represent one or more computer systems in a specific location, or may be distributed, for example, across the Internet or as a network service. Computer system 102 is shown as including a computing system 104. Computing system 104 may, for example, be one or more processing cores located in one or more different locations. Computing system 104 is shown connected to an optional hardware interface 106. Hardware interface 106 may be used, for example, to control other components of the medical system 100 (if they are present). Computing system 104 is also shown as including an optional user interface 108. User interface 108 may be useful, for example, for providing optical, audio, or tactile feedback to an operator or object. Computing system 100 is also shown connected to memory 110. Memory 110 is intended to represent any combination of memory or storage accessible to computing system 104. This may include things such as hard disk drives, SSDs, or even external storage on optical media or networks.

[0167] Memory 110 is shown to contain machine-executable instructions 120. The machine-executable instructions 120 enable the computing system 104 to perform various data processing and image processing tasks, as well as control other components of the medical system 100. Memory 110 is also shown to contain a position recognition algorithm 122. The position recognition algorithm 122 is configured to receive a current image 126 and output at least one set of current coordinates 128. Memory 110 is also shown to contain at least one set of predetermined coordinates 124. Memory 110 is shown to contain the current image 126. Memory 110 is also shown to contain a set of current coordinates from each of the at least one set of predetermined coordinates received by inputting the current image 126 into the position recognition algorithm 122.

[0168] The memory is also shown as containing positional differences 130 for each of at least one set of predetermined coordinates 124. This is calculated by computing the coordinate differences between each of the at least one set of predetermined coordinates 124 and its corresponding set of current coordinates 128. The memory 110 is also shown as containing an objective function 132. The objective function 132 takes the positional differences 130 as input and then outputs a one-dimensional value 134. In different examples, the objective function 132 may take different forms; however, for example, it may simply be the mean square of the differences between coordinates, and in other examples, the various coordinates may have different weighting functions, such that particular coordinates are more important when locating an object.

[0169] Memory 110 is also shown as containing a copy of one-dimensional value 134. One-dimensional value 134 is then used to control one-dimensional position indicator 136. One-dimensional position indicator 136 may be rendered or provided, for example, using user interface 108, or provided to different computers or computing systems to provide these.

[0170] Figure 2 The illustrated operation is shown. Figure 1 The flowchart illustrates a method for a medical system 100. First, in step 200, a current image 126 is received from a camera system. Next, in step 202, a set of current coordinates 128 is received by inputting the current image 126 into a position recognition algorithm 122. Next, in step 204, the positional difference 130 between the set of current coordinates 128 and a set of predetermined coordinates 124 is calculated.

[0171] The method then proceeds to an optional decision box 206. In box 206, the question "Is the object in place?" is asked. For example, a predetermined criterion can be used to determine whether the positional difference 130 is small enough to indicate that the object has been correctly positioned. If the answer to the question in box 206 is yes, the method optionally proceeds to step 208, which is the end of the method. If the answer to the question in box 206 is no, meaning that the object has not been correctly positioned, the method proceeds to step 210. In step 210, a one-dimensional value 134 is calculated by inputting the positional difference 130 into the objective function 132.

[0172] After performing step 210, the method proceeds to step 212. In step 212, a one-dimensional position indicator 136 is provided. A one-dimensional value 134 is used to control the one-dimensional position indicator 136. As mentioned, various one-dimensional position indicators can be provided using a combination of tactile, visual, or audio signals. After step 212, the method returns to step 200. In this example, the method provides a closed-loop control loop.

[0173] Figure 3Another example of medical device 300 is illustrated. Medical device 300 is similar to... Figure 1 The medical instrument 100, in addition to including it, further includes a diagnostic ultrasound system 302. The diagnostic ultrasound system 302 is also shown as including a camera system 304 for acquiring current images. The diagnostic ultrasound system 302 is also shown as including an ultrasound transducer 306 and a display 308. A computer system 102, such as... Figure 1 As illustrated, it is also shown as being integrated into a diagnostic ultrasound system 302. An object 310 rests on an object support 312. An ultrasound transducer 306 can be manually moved to the object 310 to perform an examination. A camera system 304 repeatedly acquires current images. A position recognition algorithm may be able to, for example, identify the position of the ultrasound transducer 306 relative to the anatomical structures of the object 310.

[0174] This is shown as a single one-dimensional position indicator 314 on display 308. The ultrasonic transducer 306 can be aligned relative to the object 310 in terms of rotation, pressure, and angle. However, in this example, only a single one-dimensional position indicator 314 exists. Objective function 132 is used to reduce the alignment to a one-dimensional displacement 316 between the object 318 displayed on display 308 and the position of the object when the transducer is aligned 320. As the ultrasonic transducer 306 is poorly aligned, the one-dimensional displacement 316 decreases. By viewing the single one-dimensional position indicator 314, the operator can ultimately correctly position the ultrasonic transducer 306 to perform the examination. This allows even those with minimal training to correctly operate the diagnostic ultrasound system 302.

[0175] Examples can also be used for positioning ultrasound transducers. Ultrasound is not a button technology. It requires expert operators (it can take up to two years to acquire the correct manipulative skills and perform a good cardiac examination) to obtain good ultrasound images, meaning that the repeatability and reproducibility of a given image is limited by its complexity. This complexity arises from the positioning step, which requires the sonographer to move the probe across the patient's body to achieve a target position with the correct probe orientation, while mentally integrating multiple images from the real-time ultrasound stream to reconstruct the patient's anatomy.

[0176] The primary goal of ultrasound examination is to obtain accurate images of the region of interest within the patient. This requires precise probe movement to achieve a correct view of the internal organs. Such movements include:

[0177] Using a probe to apply precise pressure to the skin,

[0178] Rotate to X°,

[0179] Rolling probe.

[0180] The quality of the achieved images is highly sensitive to probe position and orientation, as well as external object-related factors, including, for example, the object's location and respiratory phase. Therefore, the overall quality of an ultrasound examination depends heavily on the expertise and experience of the sonographer performing the examination. An inexperienced sonographer may take considerable time to move the probe across the subject's body to obtain the desired image plane. This reliance on the sonographer is one of the major sources of variation in establishing accurate quantitative ultrasound diagnoses. This reliance is particularly detrimental to the reproducibility of subsequent ultrasound examinations (examinations performed after the initial examination), making comparisons difficult.

[0181] Examples can provide guidance for the ultrasound probe or transducer, thus enabling less experienced users to perform high-quality and rapid ultrasound examinations. This can be a disruptive factor, such as in emergency care and general remote care.

[0182] Figure 4 The illustration shows another example of a medical system 400. Medical system 400 is similar to... Figure 1 and Figure 3 The illustrated medical systems 100 and 300. In this example, medical system 400 is shown as including a digital X-ray system 402. The digital X-ray system 402 is an example of a medical imaging system. The digital X-ray system 402 can also be replaced, for example, by a digital fluorescence fluoroscopy system, a magnetic resonance imaging system, a computed tomography system, a positron emission tomography system, or a single-photon emission tomography system.

[0183] Digital X-ray system 402 includes an X-ray generator 404 and an X-ray detector 406. Dashed line 408 indicates the path of the X-rays. Object 310 is shown standing between X-ray detector 406 and X-ray generator 404. Object 310 is attempting to properly position herself or herself for inspection. Camera system 304 is again shown as visible.

[0184] In this example, there are three examples of three different types of user interfaces that can be used to provide one or more one-dimensional position indicators. A display 308 is present to provide visual feedback to object 310. Object 310 is also shown as a wearable headset 416 capable of providing audio signals to object 310, which can be used as one or more one-dimensional position indicators. The headset 416 is intended as an example of one type of user interface that can provide audio signals to an object. Other types of audio transducers, such as speakers, can replace the headset 416. The use of the headset 416 has the advantage that the position of the object's head does not affect how the object perceives the audio signal. With an external speaker, the object's perception of the audio signal can change as the object moves.

[0185] Object 310 is also shown as a wearable haptic feedback system 418. The haptic feedback system 418 can vibrate at different amplitudes, for example, based on a one-dimensional value.

[0186] Various objects may have different impairments. For example, if object 310 has a visual impairment, then headphones 416 can be used, and haptic feedback system 418 may also be used. However, if object 310 has hearing difficulties, then display 308 or haptic feedback system 418 may be more suitable. Therefore, the configuration of the user interface can be very flexible and tailored to the needs of individual object 310.

[0187] Memory 110 is shown to optionally include an additional image protocol selection 410. Memory 110 is also shown to include an optional database 412. The image protocol selection 410 can be used to query database 412 to retrieve a set of positioning instruction steps 414. This set of positioning instruction steps 414 can be used, for example, to provide instructions using display 308, headphones 416, and / or haptic feedback system 418.

[0188] Figure 5 A flowchart illustrating another example of the illustrated method is shown. The method begins at step 500. In step 500, an imaging protocol selection 410 is received. Next, in step 502, the imaging protocol selection 410 is used to query a database 412. In response to this query, the database is retrieved and a set of positioning instructions is provided, step 414. This set of positioning instructions, step 414, describes a predetermined sequence of positioning instructions. These predetermined positioning instructions can be provided, for example, using a display 308, headphones 416, or a haptic feedback system 418.

[0189] At least one positioning instruction step in the positioning instruction step sequence 414 includes at least one set of predetermined coordinates 124. Next, in step 504, the predetermined positioning instruction sequence is provided using user interfaces 108, 308, 416, and 418. Finally, in step 506, the movement of object 310 is monitored during the provision of the predetermined positioning instruction sequence. A one-dimensional position indicator is provided or modified in real time for at least one positioning instruction in the predetermined positioning instruction sequence.

[0190] In places where people do not utilize, for example, Figure 5 In the case of the features described in the flowchart above, when providing positioning guidance to an object, the instructions may only apply to simple movements - such as (i) standing against the middle of the wall frame, (ii) placing your hands behind your back - but fail to allow for more complex movements involving abnormal body positions - such as (iii) bending your shoulders against the wall frame.

[0191] For example, guiding a patient into the appropriate position for a chest X-ray is quite complex because there are many degrees of freedom for shoulder / spine positioning alone:

[0192] Shoulders level (left and right sides at the same height), i.e., aligned along the x-axis.

[0193] Rotate your shoulders forward (as close to the detector plate as possible to the left and right), i.e., align them along the z-axis.

[0194] The spine is vertically aligned, that is, aligned along the y-axis.

[0195] Guiding patients visually in three degrees of freedom is very challenging. First, the visualization will be 3D, which is cognitively complex for most patients who are not accustomed to navigating in such a representation. Second, guiding patients along these three separate axes implies that they have sufficient bodily awareness in terms of spatial representation to mentally decouple their body movements along these axes. Finally, when breaking down movement into three steps, adjustments made by the patient in the next step may again violate the requirements obtained in the previous step. For example, spinal alignment may lead to a slight backward movement of the shoulders, thus violating the forward rotation requirement obtained in the previous step.

[0196] Therefore, some examples can provide one-dimensional position indicators, such as visualizations combining several degrees of freedom (2D->1D), giving patients intuitive visual feedback to follow, and providing simultaneous rather than stepwise body posture alignment. Combining multiple angles into a single one-dimensional position indicator can be implemented in several different ways. In one example, multidimensional movement (such as two-dimensional or 2D movement) is combined simultaneously.

[0197] In other examples, one-dimensional position indicators are configured to sequentially add additional degrees of freedom. For instance, complex motion might require an object to position body parts using movement, stretching, twisting, and / or rotation in multiple directions. As the object reaches an intermediate position or pose, the objective function is modified to include additional terms representing the extra constraints.

[0198] The use of multiple one-dimensional position indicators can be implemented in different ways. For example, multiple one-dimensional position indicators can be provided. In one example, multiple one-dimensional position indicators are used to provide feedback on multiple positioning movements simultaneously. For example, an object can move his or her shoulders with a high degree of independence. A one-dimensional position indicator can be provided for each shoulder. This is also true for the positioning of many different body parts.

[0199] In other examples, multiple one-dimensional position indicators can be provided sequentially. Additional one-dimensional position indicators can be provided when parts of the object are properly positioned.

[0200] In some of these examples, step-by-step instructions are provided first. If the patient or object cannot reach the correct position, a one-dimensional position indicator can be provided to help the object achieve the correct position or posture.

[0201] An example may include one or more of the following elements:

[0202] 1. A target posture (desired object posture 1100) which involves a set of movements (a set of positioning instruction steps 414) to reach it from the patient's natural posture.

[0203] 2. Identification of a movement within a set of movements that is not obvious to the patient. "Not obvious" means that the patient cannot perform one of the movements using simple instructions when performing other movements simultaneously. This identification can be achieved, for example, through a pre-test guidance concept for the patient.

[0204] 3. A joint representation of an instruction that reaches an obscure movement only when two (or more) obscure movements have been correctly executed, i.e., a target (visual, audio, tactile) in the instruction.

[0205] Figure 6 An example of a display containing several different one-dimensional position indicators 600, 602, and 608 is illustrated. The first position indicator is a first rotational one-dimensional position indicator 500 showing the aligned position. The display 308 also shows two separate displacement one-dimensional position indicators 602 and 608.

[0206] A first displacement one-dimensional position indicator 602 exists, which indicates the displacement of object 602 from alignment position 606. It can be seen that the first displacement one-dimensional position indicator 602 is a first displacement 604 away from the one-dimensional alignment position 606. A second displacement one-dimensional position indicator 608 also exists, which is a second displacement 610 away from the alignment position 606. The display 308 can be particularly useful when an object is attempting to position multiple body parts. For example, the first displacement one-dimensional position indicator 602 could indicate the position of a first shoulder. The second displacement one-dimensional position indicator 608 could represent a second shoulder. When the two shoulders are properly aligned, they overlap at alignment position 606. As each shoulder becomes less aligned, the first displacement 604 and the second displacement 610 increase.

[0207] Figure 6 The example in the image resembles a level or spirit level. In this way, it potentially:

[0208] Prove the correct posture / position.

[0209] Provides feedback on the current posture / position and the correct posture / position: There is a direct feedback loop that uses each movement to show whether the movement brings the posture closer or moves it further away from the correct posture.

[0210] Figure 7 It shows Figure 6 Another view of the one-dimensional position indicator. In this example, both the first displacement one-dimensional position indicator 602 and the second displacement one-dimensional position indicator 608 are shown in the aligned position 606. However, the first rotation one-dimensional position indicator 600 has been rotated by an angle 700. The value of angle 700 can be determined by a one-dimensional value. Figure 6 and Figure 7 The illustration shows how three separate one-dimensional position indicators 600, 608, and 602 can be displayed on the same monitor 308. Angle 700 can, for example, be used to provide feedback to the user about the alignment of their spine.

[0211] Figure 8 It shows how it can be modified. Figure 6 and Figure 7 The display 308 is used to add a fourth one-dimensional position indicator 800. In this example, there is a line 800 representing the second rotational one-dimensional position indicator 800. This indicator 800 is rotated from the alignment position 804 by an angle 802. Figure 8 The illustration shows one way to increase the amount of information provided to an object.

[0212] Spinal alignment is a direct axis alignment representation and can be used... Figure 7 and Figure 8 Examples of the one-dimensional rotation indicators illustrated are represented in various ways.

[0213] Figures 6 to 8 This demonstrates how to use a level visualization to provide guidance on three dimensions of body movement:

[0214] 1. Shoulder alignment, i.e., alignment along the x-axis.

[0215] 2. The shoulders rotate forward, i.e., aligned along the z-axis.

[0216] 3. Vertical alignment of the spine, i.e., alignment along the y-axis.

[0217] By providing feedback about two dimensions in the xy-plane representation:

[0218] The black dot moves to the left or right of the center of the bar.

[0219] The horizontal bar is tilted (70°) on the vertical axis.

[0220] The movement of the shoulders (horizontal alignment and forward rotation) is combined into one dimension, leaving a very simple feedback visualization with a black dot on the left or right side of the center indicating shoulder misalignment; or a slanted bar indicating spine misalignment.

[0221] By moving the shoulder, the patient will see the point move toward or away from the center, and thus find the correct position of the shoulder without having to rely on knowledge of how to isolate the shoulder to move forward, backward, or horizontally.

[0222] For other movements involving only one body part (e.g., a shoulder, a knee), the level has only one black dot.

[0223] In this representation, the system can measure the degree of forward and horizontal rotation and map it onto the length of the bar to determine where the black dot should be relative to the center of the bar. For the spine, the system can measure how far the farthest point is from the line projected onto the spine and then map it onto the degree of rotation of the bar.

[0224] Other visualizations besides levels can be implemented. As an example, in the case of chest X-ray localization:

[0225] Each shoulder is represented by a shape, the size of which depends on the proper positioning. The closer to the ideal position, the smaller the shape.

[0226] When the shoulder reaches the target position, tactile feedback (such as vibration) decreases.

[0227] When the shoulder reaches the target position, the light signal changes from red to green.

[0228] When the shoulder reaches the target position, the sound transitions from a high-pitched, high-frequency tone to a harmonious low-pitched bell sound.

[0229] etc.

[0230] Other embodiments for body positioning for scanning purposes include poses that can have three degrees of freedom. These are particularly useful for poses that are difficult to achieve without physical training. Examples include:

[0231] Postures that require hip rotation, as this will typically also result in movement of the spine and legs.

[0232] You need to extend your arms to the side or in front, but keep your shoulders down and your back straight.

[0233] Ankle movement without moving the leg. Because the ankle can rotate quite a bit, finding the correct position can be difficult.

[0234] Wrist joint movement without moving the arm

[0235] Position the fingers in a certain location, for example, so that if the hand is kept in a relaxed position, the fingers are X-rayed in the area covered by other fingers, while keeping the hand stable in the correct position.

[0236] In another embodiment, the invention can help patients perform physical therapy exercises at home when they are not guided by a physical therapist.

[0237] There are two types of exercises:

[0238] Maintaining a certain posture, such as stretching or training muscles,

[0239] Repeat a certain movement.

[0240] For both of these, the present invention can support patients in performing exercises:

[0241] For maintaining a posture, visualization can provide continuous feedback on whether the patient is still maintaining the correct posture. For example, when maintaining a plank position, it is important that:

[0242] It has hands positioned below the shoulders; the shoulders can move backward or forward.

[0243] With an upright back,

[0244] Lower your hips so that your back and legs form a straight line.

[0245] For repeating a certain movement, visualization can provide feedback on the limits / endpoint of the movement to ensure that the movement is as efficient as possible.

[0246] For example, rehabilitation exercises for the ankle involve bending the ankle while lying down, keeping the knee straight. This movement should be performed until you feel discomfort. However, what would be described as discomfort can vary greatly between individuals. Using this invention, the physical therapist can set goals together with the patient that push the patient a little beyond their level of discomfort, or that can constrain the patient a little more than they would themselves. The correct degree of flexion can be set where the black dot in the visualization is exactly in the middle. In this way, when the patient is at home, he / she can receive visual feedback to let them know when to stop moving and return to the neutral position, while ensuring they maintain the correct movement posture.

[0247] Maintaining proper posture is a major issue in many jobs today: office workers sit in chairs all day and develop back, neck, and shoulder discomfort; movers, construction workers, and other occupations involving heavy lifting can develop back problems.

[0248] Maintaining proper posture is difficult because your attention tends to wander during the day. The simple visualization presented here can serve as a trigger to refocus your attention on your posture.

[0249] Furthermore, ensuring you have correct posture can be very difficult. For many people, correcting their posture involves multiple degrees of freedom, including:

[0250] Legs: Knees bent at a 90-degree angle, or stand with both legs straight.

[0251] Hips: Rotate forward while sitting and standing.

[0252] Back: Keep your lower and upper back straight.

[0253] Shoulders: Twist your shoulders down and back.

[0254] Neck: This usually involves moving the head backward and the chin downward.

[0255] When correcting posture, people often focus on one of these movements, such as straightening the lower back, but this can cause discomfort to shift to different parts of the body if other movements are not considered.

[0256] Figure 9 Another example is shown of a display 308 illustrating a size-based one-dimensional position indicator 900. The size of the one-dimensional position indicator 902 can change depending on the value of the one-dimensional value. When the one-dimensional position indicator 900 indicates position alignment, it can have an alignment size 902 indicated by a dashed circle. The previous examples have illustrated how one-dimensional position indicators can be constructed for visual feedback.

[0257] Figure 10 An example of an acoustic user interface 1000 is illustrated. An object 310 wearing headphones 416 is present. A stereoscopic image 1002 can be constructed by providing different sounds to different ears. This stereoscopic image 1002 may have a distance 1004 from the object and a left / right position 1006. The distance 1004 and position 1006 provide two distinct one-dimensional position indicators. Among other things, this could, for example, provide a means for a visually impaired person to align two different body parts. The exact position of the stereoscopic image 1002 can be controlled in various ways.

[0258] For example, changing the amplitude can give it a more accurate representation of object 310. Changing the volume balance between the left and right can also be used to adjust the left and right positions 1006. However, various psychoacoustic models can also be used to better control this situation. For example, a slight delay can be introduced between the sound delivered to the left and right ears to better create a stereoscopic image 1002.

[0259] Providing a stereoscopic image 1002 is not the only way to provide a one-dimensional position indicator on an audio basis. Pitch, timbre, volume, and other properties can also vary as functions of one-dimensional values.

[0260] For many medical examinations, patients must assume a specific position and posture. For example, for an MRI scan, a patient may need to place her hands above her head. For a knee examination, they may need to bend their knees. For a chest X-ray, a patient needs to place her hands on her back and flex her shoulder blades forward. Currently, experienced technicians explain what to do to patients and may gently guide them into the correct position and posture.

[0261] However, due to rising healthcare costs and the trend toward introducing diagnostic imaging in remote health centers with fewer specialized staff, there is a push toward using less trained staff who may lack the knowledge, skills, and experience to help patients adopt the correct posture. However, adopting the correct posture is crucial for good image quality and limiting the number of retakes. Within Philips, several research projects are preparing for the future where medical imaging occurs autonomously, and where there are no nurses or flesh-and-blood technicians present during the examination (autonomous imaging).

[0262] Typically, even in the presence of technicians, there is a desire to expedite examinations. This is particularly true for chest X-ray imaging, which sees a surge in demand attributed to lung-related diseases. In China, up to 600 chest X-rays are performed daily on a single machine. Therefore, any means to facilitate faster patient localization are highly desirable.

[0263] Therefore, it is beneficial to provide patients with correct positioning instructions through a system that enables faster, more accurate, and more stable positioning. Such instructions can be visual (e.g., 2D visual, 3D visual, animated visual, video) and / or auditory (e.g., verbal or abstract, compared to audible warnings when parking).

[0264] As an example of the guiding concept, a system for short loops of chest X-rays based on 3D animation can be implemented. In such loops, an animated human character (e.g., an avatar or "virtual twin") demonstrates the movement required in moving from the patient's current posture to the desired posture, along with auditory instructions. Body parts and their movements can be emphasized using various visual means (e.g., arrows, colors, and lighting). The required overall posture change is broken down into manageable, understandable sub-movements (e.g., a frontal chest X-ray is broken down into (i) standing in the middle against a wall frame, (ii) placing your hands behind your back, and (iii) bending your shoulders against the wall frame). Each of these sub-movements is explained through looping 3D animation. The loop continues until the patient adopts the correct posture, which is detected using computer vision (e.g., a depth camera).

[0265] Figure 11 The desired object location 1100 is shown, for example, when imaging protocol selection 410 is performed, this location can be shown to the object.

[0266] Figure 12 A set of positioning instruction steps 414 is illustrated. This set of positioning instruction steps 414 is shown as including machine instructions 1200, 1202, and 1204. In this example, the complex movement to achieve position 1100 can be broken down into understandable blocks. Each of these images 1200, 1201, and 1202 can be an animation loop. This can be done using real-life video or animation. For example, an animated 3D character can adapt to the actual position of an object in real time. In addition to things like... Figure 6 , 7 In addition to the position indicators shown in Figure 8, images 1200, 1201, and 1202 can be displayed, for example.

[0267] Figure 11 and Figure 12 The illustration shows how complex movements can be "broken down" into understandable chunks. Each of the three images is actually an animated loop. Although this is real-life video, we consider the person to be a 3D animated character whose movements can be adjusted in real time.

[0268] When an object is positioning itself, it can be difficult for the object to maintain the position of its already positioned body parts. Figure 13 An additional display that can be added to display 308 is shown, illustrating an idealized representation of an object with multiple success indicators 1300 and misalignment indicators 1302. Success indicators 1300 can be displayed when the object successfully completes one of the positioning commands 1200, 1202, or 1204. If misalignment occurs in a body part or portion while the camera continuously monitors the object, this can be indicated to the object by providing misalignment indicators 1302 or removing success indicators 1300.

[0269] Figure 13 The display shown in the figure can be enhanced using one-dimensional position indicators, such as... Figures 6 to 9 As illustrated in the diagram. In one example, the misaligned indicator 1302 changes its size, as shown... Figure 9 The illustration is intended to indicate improved positioning. The misaligned indicator 1302 may begin with an increasing size, then shrink as the current coordinates become aligned with the predetermined coordinates. Once the current coordinates are aligned with the predetermined coordinates, the misaligned indicator then changes to a success indicator 130.

[0270] exist Figure 14 There are three different views of display 308. The first 1400 shows a first view of the display, in which object 310 has its two shoulders properly aligned. The second display 308 shows a second view 1402 in which one of the shoulders is misaligned. There is a third view of display 308, labeled 1404, which shows the two misaligned shoulders. The first column 1406 shows a rear view of object 310 in front of X-ray detector 406, as... Figure 4 As illustrated, column 1408 shows a top view of object 310 in front of the same X-ray detector 406. In the first view 1400, the two shoulders are properly aligned, and display 308 shows the alignment of the two shoulders.

[0271] The second view 1402 of display 308 shows that the left shoulder 1410 is misaligned. There are actually two possibilities that could cause this misalignment in display 1402. The shoulder 1410 could be too low, as illustrated in the two top images, or the shoulder could be at an incorrect distance from the X-ray detector 406. These two possibilities are illustrated on the left side of the second view 1402.

[0272] The third view 1404 of display 308 shows two shoulders misaligned. Various different possibilities can lead to the same display. At the top, the left shoulder is too low, and the right shoulder is at the wrong distance from X-ray detector 406. The lower part illustrates another possibility where both shoulders 1410 are at the wrong distance from X-ray detector 406. When the object sees display 1402 or 1404, she or he gradually moves the shoulders in different positions and notices that when the shoulders move in a particular direction, indicators 602 or 608 move closer to the alignment position 606. The object 310 can then position herself or him with minimal or no training.

[0273] Although the invention has been described and illustrated in detail in the accompanying drawings and the foregoing description, such description and illustration are to be regarded as illustrative or exemplary rather than restrictive; the invention is not limited to the disclosed embodiments.

[0274] Those skilled in the art, through studying the accompanying drawings, description, and claims, will be able to understand and implement other variations of the disclosed embodiments in practicing the claimed invention. In the claims, the word "comprising" does not exclude other elements or steps, and the words "a" or "an" do not exclude a plurality. A single processor or other unit may fulfill the functions of several items recited in the claims. Although specific elements are recited in dissimilar dependent claims, this does not indicate that combinations of these elements cannot be advantageously used. Computer programs may be stored and / or distributed on suitable media, such as optical storage media or solid-state media provided with or as part of other hardware, but computer programs may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunications systems. No reference numerals in the claims shall be construed as limiting the scope.

Claims

1. A medical system comprising: A memory storing machine-executable instructions, at least one set of predetermined coordinates, and a position recognition algorithm, wherein the position recognition algorithm is configured to output a set of current coordinates for each of the at least one set of predetermined coordinates in response to receiving a current image describing an object, wherein the at least one set of predetermined coordinates is an anatomical location, and wherein the object is a subject. Camera system; User interface, which includes a display; A medical imaging system, wherein the medical imaging system is any one of the following: an X-ray system, a digital fluorescence microscope, a magnetic resonance imaging system, a diagnostic ultrasound system, a computed tomography system, a positron emission tomography system, and a single-photon emission tomography system, wherein each of the at least one set of predetermined coordinates defines the three-dimensional position and orientation of the body portion of the object relative to the imaging area of ​​the medical imaging system; and A computing system configured to control the medical system, wherein the execution of machine-executable instructions causes the computing system to repeatedly receive the current image from the camera system, and wherein the execution of the machine-executable instructions also causes the computing system to perform the following operations on the current image: In response to inputting the current image into the location recognition algorithm, the current set of coordinates is received for each of the at least one set of predetermined coordinates; Calculate the positional difference between the at least one set of predetermined coordinates and a set of current coordinates of the at least one set of predetermined coordinates; A one-dimensional value for each set of predetermined coordinates is calculated by inputting the positional difference for each set of predetermined coordinates into an objective function; and The user interface is used to provide a one-dimensional position indicator in real time for each one-dimensional value and controlled by each one-dimensional value.

2. The medical system according to claim 1, wherein, The one-dimensional position indicator for each of the at least one set of predetermined coordinates is adapted to provide real-time feedback on the alignment of the object with the at least one set of predetermined object coordinates.

3. The medical system according to claim 1 or 2, wherein, The execution of the machine-executable instructions also enables the computing system to: Select the receiving imaging protocol; A set of positioning instruction steps for locating the object is retrieved by querying a database with the imaging protocol selection, wherein the set of positioning instruction steps describes a predetermined sequence of positioning instructions, and wherein at least one positioning instruction step in the sequence of positioning instruction steps includes the at least one set of predetermined coordinates; The user interface is used to provide a predefined sequence of location commands; and The object's motion is monitored during the provision of the predefined positioning command sequence, wherein the one-dimensional position indicator is provided in real time for at least one positioning command in the predefined positioning command sequence.

4. The medical system according to claim 3, wherein, The one-dimensional position indicator is provided in real time after the object motion description fails to successfully complete at least one positioning instruction in the predefined positioning instruction sequence.

5. The medical system according to claim 3, wherein, The execution of the machine-executable instructions also enables the computing system to: provide a positioning success indicator following each positioning instruction in the predefined positioning instruction sequence if the set of current coordinates meets predefined criteria; and If the current set of coordinates no longer meets the predefined criteria, the success indicator is removed.

6. The medical system according to claim 1 or 2, wherein, The user interface is configured to provide at least one one-dimensional position indicator as a tactile signal for each of the at least one set of predetermined coordinates.

7. The medical system according to claim 1 or 2, wherein, The user interface is configured to provide at least one one-dimensional position indicator as an audio signal for each of the at least one set of predetermined coordinates.

8. The medical system according to claim 7, wherein, The audio signal includes any of the following: amplitude variation, pitch variation, timbre variation, stereo audio position variation, and combinations thereof.

9. The medical system according to claim 1 or 2, wherein, The user interface is configured to provide at least one one-dimensional position indicator for each of the at least one set of predetermined coordinates as a visual position indicator on the display, wherein the visual position indicator is any one of the following: object position along a predetermined path, rotational position, object size, color change, and combinations thereof.

10. The medical system according to claim 1 or 2, wherein, The location recognition algorithm is configured to output the set of current coordinates using any one of the following: Template-based matching algorithms; Image structure model with joint likelihood maximization algorithm; Probability boosting tree algorithm; A trained neural network; as well as Parametric deformable model.

11. A method for operating a medical system, wherein, The method includes repeatedly receiving a current image from a camera system, wherein the method further includes performing the following operations on the current image: In response to inputting the current image into a location recognition algorithm, a set of current coordinates is received for each of at least one set of predetermined coordinates, wherein the location recognition algorithm is configured to output the set of current coordinates for each of the at least one set of predetermined coordinates in response to receiving a current image describing an object. Calculate the positional difference between the at least one set of predetermined coordinates and a set of current coordinates of the at least one set of predetermined coordinates; A one-dimensional value for each set of predetermined coordinates is calculated by inputting the positional difference for each set of predetermined coordinates into an objective function; and A one-dimensional position indicator is provided in real time for each one-dimensional value and controlled by each one-dimensional value using a user interface that includes a display. Images are acquired using a medical imaging system, wherein the medical imaging system is any one of the following: an X-ray system, a digital fluorescence microscope, a magnetic resonance imaging system, a diagnostic ultrasound system, a computed tomography system, a positron emission tomography system, and a single-photon emission tomography system, wherein each of the at least one set of predetermined coordinates defines the three-dimensional position and orientation of a body part of an object relative to the imaging area of ​​the medical imaging system.

12. The method of claim 11, further comprising: Select the receiving imaging protocol; A set of positioning instruction steps for locating the object is retrieved by querying a database with the imaging protocol selection, wherein the set of positioning instruction steps describes a predetermined sequence of positioning instructions, and wherein at least one positioning instruction step in the sequence of positioning instruction steps includes the at least one set of predetermined coordinates; The user interface is used to provide a predefined sequence of location commands; and The object's motion is monitored during the provision of the predefined positioning command sequence, wherein the one-dimensional position indicator is provided in real time for at least one positioning command in the predefined positioning command sequence.

13. The method according to claim 12, wherein, The one-dimensional position indicator is provided in real time after the object motion description fails to successfully complete at least one positioning instruction in the predefined positioning instruction sequence.

14. The method of claim 12, further comprising: If the set of current coordinates meets predefined criteria, a success indicator for positioning is provided after each positioning instruction in the predefined positioning instruction sequence; and If the current set of coordinates no longer meets the predefined criteria, the success indicator is removed.

15. A computer program product comprising a computer program, said computer program including machine-executable instructions for execution by a computing system controlling a medical system, wherein, The computer program further includes a position recognition algorithm, wherein the position recognition algorithm is configured to output a set of current coordinates for each of at least one set of predetermined coordinates in response to receiving a current image describing an object, wherein the execution of the machine-executable instructions causes the computing system to repeatedly receive the current image from the camera system, and wherein the execution of the machine-executable instructions also causes the computing system to perform the following operations on the current image: In response to inputting the current image into the location recognition algorithm, the current set of coordinates is received for each of the at least one set of predetermined coordinates; Calculate the positional difference between the at least one set of predetermined coordinates and a set of current coordinates of the at least one set of predetermined coordinates; A one-dimensional value for each set of predetermined coordinates is calculated by inputting the positional difference for each set of predetermined coordinates into an objective function; and A one-dimensional position indicator (208) is provided in real time using a user interface including a display, for each one-dimensional value and controlled by each one-dimensional value. Images are acquired using a medical imaging system, wherein the medical imaging system is any one of the following: an X-ray system, a digital fluorescence microscope, a magnetic resonance imaging system, a diagnostic ultrasound system, a computed tomography system, a positron emission tomography system, and a single-photon emission tomography system, wherein each of the at least one set of predetermined coordinates defines the three-dimensional position and orientation of a body part of an object relative to the imaging area of ​​the medical imaging system.

Images