Apparatus and method for image-based control of imaging system parameters
By monitoring the motion of the imaging probe and automatically adjusting the parameters of the imaging system, the problem of operators being difficult for them to maintain the probe position and adjust the parameters at the same time is solved, and the effect of optimizing image quality and reducing misdetection is achieved.
Patent Information
- Application Number
- CN201910198045.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-03-15
- Publication Date
- 2025-03-21
- Estimated Expiration
- 2039-03-15
AI Technical Summary
When existing imaging systems manually adjust imaging parameters, it is difficult for operators to maintain the correct position and adjustment parameters of the probe at the same time, resulting in unstable image quality and incorrect detection.
By monitoring the motion of the imaging probe, the parameters of the imaging system are automatically adjusted using the processor to optimize image quality and reduce operator intervention.
It realizes optimizing image quality and reducing error detection without the need for operators to manually adjust parameters, and improves the operation efficiency and accuracy of the imaging system.
Smart Images

Figure CN111685793B_ABST
Abstract
Description
Technical Field
[0001] The subject matter disclosed herein relates generally to imaging systems. Background Art
[0002] The imaging system generates image data representative of the imaged volume based on various parameters of the imaging system. These parameters dictate how the volume may be imaged and may have fixed values or may be manually altered by a user of the imaging system.
[0003] For example, some ultrasound imaging systems include software tools (e.g., applications) for automatically segmenting follicles in an ultrasound volume. These tools may have a user-selectable sensitivity slider that allows a user of the ultrasound system to manually change the sensitivity at which images are acquired. A low sensitivity selected by the user may result in the ultrasound imaging system detecting fewer follicles in the ultrasound volume. A higher sensitivity selected by the user may result in more follicles being detected, but this may also result in more false-positive automatic detections of follicles by the imaging system.
[0004] The user may then need to find a sensitivity (or other imaging parameter) that provides useful image data for revealing or detecting bodies (e.g., follicles) within the image, but is not so sensitive (or has other extreme values) that it results in false detection of bodies in the image(s) or false identification of bodies in the image(s). For manually selected imaging parameters, this results in the user having to repeatedly select and / or change the value(s) of the imaging parameter.
[0005] This can be a difficult operation for certain types of imaging systems. With regard to ultrasound imaging systems, a user typically has a handheld ultrasound imaging probe that is held by the user toward a region of interest while the user also simultaneously views a display showing a representation of the image data and changes one or more imaging parameters. The user may not be able to maintain the desired region of interest within the field of view of the imaging probe while also changing the value of an imaging system parameter. Summary of the invention
[0006] In one embodiment, an apparatus includes one or more processors configured to monitor motion of an imaging probe in an imaging system that operates according to one or more parameters. The imaging probe is configured to output image data representative of an imaged volume. The one or more processors are configured to modify the one or more parameters of the imaging system based on the monitored motion of the imaging probe.
[0007] In one embodiment, a method includes: obtaining image data of an imaged body using a movable imaging probe of an imaging system that operates according to one or more parameters; monitoring movement of the imaging probe while the imaging probe is obtaining the image data of the imaged body; and modifying the one or more parameters of the imaging system using one or more processors based on the monitored movement of the imaging probe.
[0008] In one embodiment, a tangible and non-transitory computer-readable storage medium is provided that includes instructions that instruct one or more processors to monitor the movement of an imaging probe of an imaging system that operates according to one or more parameters. The movement of the imaging probe is monitored while the imaging probe is acquiring image data of an imaged body. The movement of the imaging probe is monitored based on one or more of the data output by one or more sensors operably coupled to the imaging probe or based on one or more changes in the image data. The instructions also instruct the one or more processors to use the one or more processors to change the one or more parameters of the imaging system based on the one or more of the data output by the one or more sensors or based on the one or more changes in the image data. BRIEF DESCRIPTION OF THE DRAWINGS
[0009] The inventive subject matter described herein will be better understood by reading the following description of non-limiting embodiments with reference to the accompanying drawings, in which:
[0010] Figure 1 is a schematic diagram of an ultrasound imaging system according to an embodiment;
[0011] Figure 2 Schematically shows Figure 1 An embodiment of a control device for an imaging system as shown in;
[0012] Figure 3 A flow chart illustrating one embodiment of a method for automatically modifying parameters of an imaging system; and
[0013] Figure 4 A flow chart of another embodiment of a method for automatically modifying parameters of an imaging system is presented. DETAILED DESCRIPTION
[0014] One or more embodiments of the inventive subject matter described herein provide apparatus and methods for imaging systems that monitor image quality and / or motion of an imaging probe and automatically change one or more parameters of the imaging system based on the image quality and / or probe motion (or the absence of probe motion). The parameters of the imaging system indicate how image data is acquired, processed, and / or visually presented. For example, the parameters of the imaging system can be settings of the imaging system, such as sensitivity for imaging a region of interest, gain of information sensed by the probe, time gain compensation of information sensed by the probe, line density, reception frequency, speckle reduction filter settings, rendering settings, brightness, focus, etc.
[0015] The monitored motion may be movement of the imaging probe, or the absence of probe motion. For example, the apparatus and method may check the imaging probe to determine whether the probe is moving, how fast the probe is moving, the direction(s) in which the probe is moving, how long the probe has moved, whether the probe is remaining stationary, how long the probe has remained stationary, etc. Not all embodiments of the inventive subject matter described herein are limited to monitoring the movement of the probe as motion of the probe. In at least one embodiment of the inventive subject matter described herein, monitoring a stationary probe is included in monitoring the motion of the probe. For example, monitoring the motion of the probe may involve determining whether the probe remains stationary and does not move relative to the body being imaged.
[0016] The probe of the imaging system can be a device that senses information about the region of interest or the imaged body. For example, the probe can be an ultrasound imaging probe that emits ultrasound pulses and detects echoes of the pulses. Alternatively, the probe can be a camera, a lens system of a camera, an infrared emitter and / or detector, a photoelectric emitter and / or detector (e.g., for LiDAR systems, structured light array systems, etc.), an x-ray detector, etc.
[0017] The parameters of the imaging system can be changed by different amounts based on the type of probe motion detected (e.g., category), the speed of moving the probe, how long the probe remains stationary, how long the probe is moving. The parameter can be one of various settings of the imaging system that change or indicate how to image the region of interest of the imaging probe and / or how to present the image data. For example, the parameter (and the value of the parameter that is changed or set based on the monitored motion of the imaging probe) can include the sensitivity of imaging the region of interest, the gain of the probe sensing information, the time gain compensation of the probe sensing information, the line density, the receiving frequency, the speckle reduction filter setting, the rendering setting, the brightness, the focus, etc.
[0018] The apparatus and method can automatically change one or more imaging parameters based on the motion of the monitored probe. This automatic change to the parameter can occur without operator intervention. For example, the apparatus and method can change the value of an imaging system parameter without receiving any other operator input related to or indicating the change of the parameter. This solves the problem of being unable to change the imaging system parameter without the operator who controls the probe also having to manually change (via touch, voice, etc.) the parameter. The operator can focus on moving or keeping the probe still while the image data is generated by the probe, rather than distracting the operator's attention between moving or keeping the probe, checking the image data, and changing the (multiple) values of one or more imaging system parameters.
[0019] In one embodiment, the apparatus and method calculate an image quality metric based on the monitored motion of the imaging probe. This image quality metric can be a quantitative value indicating the quality of the image data based on the motion of the probe. For example, a probe that generates image data of a region of interest with many motion artifacts can have a lower image quality metric than when the probe generates image data of the same or other regions of interest with fewer motion artifacts. The apparatus and method can calculate the quality metric based on the image data of the probe, and can also change the value of one or more imaging system parameters based on the calculated quality metric.
[0020] As an example of the subject matter of the present invention used in conjunction with an ultrasound imaging system, a user may use an ultrasound probe to image a target organ in a patient being imaged. The user may then hold the probe still, and the apparatus or method may change parameters of the imaging system relative to time for the longer period of time that the probe remains still. For example, the apparatus or method may use a counter to increase the sensitivity of the probe in a manner proportional to the time the user holds the probe still. For example, the longer the user holds the probe in position, the greater the value of the sensitivity parameter of the imaging system. User feedback may be generated and provided via a color bar on a display of the imaging system, etc., to display the progress or current value of the sensitivity parameter. As another example, segmentation results associated with a particular sensitivity parameter may be displayed to the user.
[0021] In another example, the apparatus and method can monitor probe motion to determine if and / or when movement of the probe stops. In response to the movement stopping, the imaging system can start a counter and increase the value of an imaging system parameter. In response to the movement starting (from probe stationary), the value of the parameter can stop increasing, and the current value of the parameter and / or image data can be displayed to the user.
[0022] As another example, a user may move an imaging probe and view image data representing a region of interest. Once the region of interest is found, the user may slow down the movement of the probe so that a decrease in the monitored motion is detected. In response to detecting a decrease in motion, the apparatus and method may instruct the imaging system to begin acquiring image data, such as by beginning to record a two-dimensional movie or video. The user may later begin moving the probe to search for another target. This results in increased movement of the probe, and a change in the motion of the probe is detected. In response to detecting the start of probe movement, the apparatus may instruct the imaging system to stop recording a two-dimensional movie or video.
[0023] At least one technical effect of the inventive subject matter described herein is to provide an imaging system that allows an operator to image a region of interest in an imaged volume while modifying parameters of the imaging system that dictate how image data is obtained and / or generated without providing other intervention or action to the imaging system. This can reduce operator interface requirements for the imaging system, enabling the imaging system to change parameters used to create the imaging system without requiring additional input other than movement of the probe, but while imaging of the volume continues or is ongoing.
[0024] Figure 1 1 is a schematic diagram of an ultrasound imaging system 100 according to an embodiment. The ultrasound imaging system 100 includes a transmit beamformer 101 and a transmitter 102, which drives an element 104 within a probe 106 to transmit a pulsed ultrasound signal into a body (not shown). According to an embodiment, the probe 106 can be a two-dimensional matrix array probe. However, according to other embodiments, any other type of probe capable of acquiring four-dimensional ultrasound data can be used. The four-dimensional ultrasound data can include ultrasound data such as multiple three-dimensional volumes acquired over a period of time. The four-dimensional ultrasound data can include information showing how the three-dimensional volume changes over time.
[0025] The pulsed ultrasound signal is backscattered from various structures in the body (such as blood cells or muscle tissue) to produce echoes that return to the element 104. The element 104 converts the echo into an electrical signal or ultrasound data, and the electrical signal is received by the receiver 108. The electrical signal representing the received echo is passed through the receive beamformer 110, which outputs the ultrasound data. The probe 106 may include all or part of the electronic circuit system for performing transmit beamforming and / or receive beamforming. For example, all or part of the transmit beamformer 101, the transmitter 102, the receiver 108, and the receive beamformer 110 may be located in the probe 106. Scanning may include acquiring data through the process of transmitting and receiving ultrasound signals. The data generated by the probe 106 may include one or more data sets acquired using the ultrasound imaging system. The user interface 115 may be used to control the operation of the ultrasound imaging system 100, including controlling the input of patient data, changing scanning or display parameters, etc.
[0026] The ultrasound imaging system 100 also includes one or more processors 116 that control the transmit beamformer 101, the transmitter 102, the receiver 108, and the receive beamformer 110. The processor 116 electronically communicates with the probe 106 via one or more wired connections and / or wireless connections. The processor 116 can control the probe 106 to acquire data. The processor 116 controls which of the elements 104 are effective and the shape of the beam emitted from the probe 106. The processor 116 also electronically communicates with the display device 118, and the processor 116 can process the data into an image for display on the display device 118. According to an embodiment, the processor 116 may include one or more central processing units (CPUs). According to other embodiments, the processor 116 may include one or more other electronic components capable of performing processing functions, such as one or more digital signal processors, field programmable gate arrays (FPGAs), graphics boards, and / or integrated circuits. According to other embodiments, the processor 116 may include multiple electronic components capable of performing processing functions. For example, the processor 116 may include two or more electronic components selected from a list of electronic components including: one or more central processors, one or more digital signal processors, one or more field programmable gate arrays, and / or one or more graphics boards. According to another embodiment, the processor 116 may also include a complex demodulator (not shown) that demodulates the radio frequency data and generates raw data. In another embodiment, demodulation may be performed earlier in the processing chain.
[0027] The processor 116 is adapted to perform one or more processing operations according to a plurality of selectable ultrasound modalities on the data. When echo signals are received, the data can be processed in real time during the scanning session, such as by processing the data without any intentional delay or processing the data while acquiring additional data during the same imaging session of the same patient. For example, an embodiment can acquire images at a real-time rate of seven to twenty volumes per second. However, the real-time volume rate can depend on the length of time required to acquire each amount of data for display. Therefore, when a relatively large amount of data is acquired, the real-time volume rate may be slower. Some embodiments may have a real-time volume rate much faster than twenty volumes per second, while other embodiments may have a real-time volume rate slower than seven volumes per second.
[0028] The data may be temporarily stored in a buffer (not shown) during a scanning session and processed in less than real time in an on-site or off-line operation. Some embodiments of the inventive subject matter may include multiple processors (not shown) for handling the processing tasks handled by processor 116 according to the exemplary embodiments described above. For example, a first processor may be used to demodulate and extract RF signals, while a second processor may be used to further process the data before displaying an image. It should be understood that other embodiments may use different processor arrangements.
[0029] The ultrasound imaging system 100 can continuously acquire data at a volume rate of, for example, ten to thirty hertz. Images generated from the data can be refreshed at a similar frame rate. Other embodiments can acquire and display data at different rates. For example, some embodiments can acquire data at a volume rate of less than ten hertz or greater than thirty hertz, depending on the size of the volume and the intended application.
[0030] The memory 120 is included for storing the processed acquired data. In one embodiment, the memory 120 has sufficient capacity to store at least several seconds of ultrasound data. The data is stored in a manner that facilitates retrieval based on the order or time in which it was acquired. The memory 120 may include any known data storage medium, such as one or more tangible and non-transitory computer-readable storage media (e.g., one or more computer hard drives, disk drives, universal serial bus drives, etc.).
[0031] Optionally, one or more embodiments of the subject matter of the invention described herein can be implemented using contrast agents. When using an ultrasound contrast agent including microbubbles, contrast imaging generates enhanced images of anatomical structures and blood flow in the body. After acquiring data while using the contrast agent, image analysis includes separating harmonic components and linear components, enhancing the harmonic components, and generating ultrasound images by utilizing the enhanced harmonic components. Separation of harmonic components from the received signal is performed using a suitable filter.
[0032] In various embodiments of the present invention, the processor 116 can process data to form two-dimensional or three-dimensional image data through other or different mode-related modules (e.g., B-mode, color Doppler, M-mode, color M-mode, spectral Doppler, elastic imaging, TVI, strain, strain rate, etc.). For example, one or more modules can generate B-mode, color Doppler, M-mode, color M-mode, spectral Doppler, elastic imaging, TVI, strain, strain rate, and combinations thereof. Image beams and / or volumes are stored, and timing information indicating the time when data was acquired in the memory can be recorded. The module can include, for example, a scan conversion module, which is used to perform a scan conversion operation to convert the image volume from beam space coordinates to display space coordinates. The video processor module can read the image volume from the memory and display the image in real time while performing surgery on the patient. The video processor module can store the image in an image memory, read and display the image from the image memory.
[0033] Figure 2 An embodiment of the control device 200 of the imaging system 100 is schematically shown. Figure 1 1, but the control device 200 may be included in the imaging system 100. For example, the control device 200 may include the processor 116 and may optionally include one or more of the transmit beamformer 101 and / or the receive beamformer 110. Optionally, the processor implementing the operations performed by the control device 200 may be other than the processor 116. Figure 1 Additional processors other than those shown in the figure or other processors. For example, processor 116 is combined with the Figure 1 The operations described for the imaging system 100 may not be performed by the same processor(s) that perform the operations of the control device 200 .
[0034] The control device 200 includes one or more motion sensors 202 operably coupled to the probe 106 or in communication with the motion sensors. For example, the processor 116 can communicate with one or more accelerometers in and / or on the probe 106 to receive motion data from the accelerometers to monitor the motion of the probe 106. Additionally or alternatively, the motion sensors 202 can be external to or separate from the probe 106, such as a radar system, a LiDAR system, a camera system, etc., which generates data indicative of the movement (or lack of movement) of the probe 106. The processor 116 and the sensors 202 can be coupled via a wired connection and / or a wireless connection to communicate data indicative of the movement of the probe 106 while the operator is using the probe 106 to obtain image data of a region of interest in one or more imaged volumes.
[0035] The processor 116 monitors the motion of the imaging probe 106 in the imaging system 100 to control the time-varying parameters of the imaging system 100. The values of the parameters may be changed based on the monitored motion of the imaging probe 106. The processor 116 may change the time-varying parameters of the imaging system 100 based on the motion of the imaging probe 106, thereby changing the image data of the imaged body acquired by the imaging probe 106.
[0036] The processor 116 may examine the acceleration or other motion of the probe 106 (as indicated by data from the sensor 202) to monitor the motion of the imaging probe 106. Such motion data may indicate to the processor 116 whether the probe 106 is stationary or moving, how long the probe 106 has been stationary or moving, the speed at which the probe 106 is moving, the direction(s) in which the probe 106 is moving, the orientation of the probe 106 (while moving or stationary), and / or other information regarding the movement (or lack of movement) of the probe 106.
[0037] Based on the movement data provided by the sensor(s) 202, the processor 116 may modify a time-varying parameter of the imaging system 100. The parameter of the imaging system 100 may be time-varying in that the value of the parameter may change at different times or over time based on the movement of the probe 106 being monitored. The value of the parameter of the imaging system 100 may continue to change at the same rate, at a rate that increases or accelerates relative to time, and / or at a rate that decreases or decelerates relative to time based on the movement of the probe 106. In one embodiment, the parameter of the imaging system 100 may have a first value when the operator is moving the imaging probe 106. In response to the operator holding the imaging probe 106 still for at least a specified period of time (e.g., five seconds or longer), the processor 116 may begin to modify the value of the parameter from the first value, such as by increasing the gain, increasing the number of scan lines, increasing the refresh rate, etc. In response to the operator moving the imaging probe 106 again, the value of the parameter may return to the first value. Alternatively, the parameter value may be modified to another default value.
[0038] For example, the gain at which the probe 106 (or the processor 116) amplifies the received echoes of the ultrasound pulses may be set (by default, by an operator of the probe 106 and / or automatically by the processor 116) to have a first value while the operator is using the probe 106 to obtain image data of a region of interest in a body. The body may be a human patient, an anatomical structure of a patient, or a non-human object, such as a machine or component being examined. The operator may move the probe 106 and examine the image data displayed on the display device 118 (e.g., Figure 1106). Once the field of view of the probe 106 causes the image data to reveal or collect a volume or region of interest in the body (e.g., a region of interest in the body), the operator can stop moving the probe 106. In response to detecting that the movement of the probe 106 has stopped, the processor 116 can automatically and without operator input or other intervention) increase the gain value of the imaging system 100. As the gain value continues to increase, the operator can continue to observe the image data output by the imaging system 100 on the display device 118. The gain can increase by a default amount and then stop increasing, can continue to increase until the operator starts moving the probe 106 again, can increase by a fixed discrete amount (e.g., a step amount) and then remain at this value. The value of the gain can remain at this value for a default amount of time (e.g., five seconds, etc.), or until the operator provides some input (e.g., audibly, via touch, and / or by moving the probe 106).
[0039] In one embodiment, the processor 116 does not change the value of the operating parameter of the imaging system 100 unless or until the probe 106 remains stationary for at least a specified period of time. For example, the processor 116 may require that the probe 106 remain stationary for a non-instantaneous period of time (e.g., at least two seconds, at least five seconds, etc.) to ensure that the operator is not merely taking a break or wanting to briefly observe a region of interest, and the parameter is not changed based on the probe 106 remaining stationary for a brief period of time.
[0040] The processor 116 may change the value of the operating parameter in response to detecting movement of the probe 106. For example, in addition to or in lieu of changing the parameter value in response to the probe 106 remaining stationary, the processor 116 may check data from the sensor 202 to determine whether the probe 106 is moving. In response to determining that the probe 106 is moving, the processor 116 may change the value of the parameter of the imaging system.
[0041] The processor 116 may require that the probe 106 be moved in a specified manner before changing the value of an operating parameter to ensure that the detected movement indicates that the operator wants to change the operating parameter. For example, the processor 116 may examine data from the sensor 202 to determine how fast the probe 106 is moving, and in response to the probe 106 moving faster than a specified non-zero speed or rate, the processor 116 changes the value of the imaging parameter. If the probe 106 is moving, but moving slower than the specified rate, the processor 116 may not automatically change the value of the parameter.
[0042] Optionally, the processor 116 can check the motion of the probe 106, determine that the probe 106 is moving slowly, but still change the value of the imaging parameter. For example, the operator may try to keep the probe 106 still, but may accidentally move the probe 106 slightly. The processor 116 can monitor the motion of the probe 106 based on data from the sensor 202 and determine that the probe 106 is moving but not fast enough and / or far enough to indicate that the operator does not really want to change the imaging parameter. Therefore, the processor 116 can change the value of the parameter.
[0043] The processor 116 may associate different types or categories of motion of the probe 106 with different imaging parameters and / or different changes to imaging parameters. For example, the probe 106 may be actuated by an operator in different movement sequences. This sequence may be associated with imaging parameters and / or changes to imaging parameters of the imaging system 100. Different motion sequences of the probe 106 may be associated with different imaging parameters and / or different changes to imaging parameters. The processor 116 may examine data from the sensor 202 to determine a motion sequence for the probe 106 (e.g., to move and / or remain stationary). Different specified probe motion sequences may be stored in the memory 120 (e.g., Figure 1 The processor 116 may access the specified sequences and compare the motion sequence represented by the sensor data (e.g., the detected motion sequence) to the specified motion sequences. If the detected motion sequence matches or more closely matches one of the specified motion sequences (e.g., exactly matches or more closely matches relative to one or more or all other specified motion sequences), the processor 116 may determine which imaging parameter to change and / or how to change the parameter from the memory 120. The processor 116 may then implement the change.
[0044] The probe motion sequence may include various motions. For example, keeping the probe still for a specified period of time (e.g., two seconds) may be the first motion in a first sequence, and then rotating the probe 106 in a clockwise direction may be the second motion in the first sequence. In response to determining that the probe 106 has been moved according to this first sequence, the processor 116 may determine which parameter (e.g., two-dimensional line density) to change and / or how much to change the parameter value (e.g., increase the parameter by 10%). As another example, keeping the probe still for a specified period of time may be the first motion in a different second sequence, and then rotating the probe 106 in a counterclockwise direction may be the second motion in the second sequence. In response to determining that the probe 106 has been moved according to this second sequence, the processor 116 may determine which parameter (e.g., receiving frequency) to change and / or how much to change the parameter value (e.g., reduce the parameter by 8%). These sequences are provided as examples only and do not limit all embodiments of the subject matter of the present invention. For example, some sequences may not involve keeping the probe 106 still and / or rotating the probe 106.
[0045] Different specified motion sequences may represent different types or categories of motion. Alternatively, a sequence may be a single motion of the probe 106. For example, holding the probe 106 still may be a single movement in the first specified sequence that indicates how to change an imaging parameter and / or how to change the value of a parameter.
[0046] In one embodiment, the parameter that is altered based on the detected motion of the probe 106 is the start and / or stop of video recording. The operator may move (or not move) the probe 106 in a manner that is associated (in the memory 120) with starting to record video (such as a movie start operation). The processor 116 may begin saving a motion video of the image data from the probe 106 (e.g., in the memory 120) and / or presenting this video on the display device 118. In response to detecting the same or other motion of the probe 106, the processor 116 may stop recording the video, or implement a movie stop operation.
[0047] The parameter that is changed based on the detected motion of the probe 106 may be to acquire a still image or photograph. The operator may move (or not move) the probe 106 in a manner associated with acquiring a still photograph. The processor 116 may then save a still image from the image data from the probe 106 and / or present this video on the display device 118.
[0048] The imaging system 100 described herein may allow an operator of the probe 106 to set and / or change imaging parameters without having to provide any other input other than moving (or not moving) the probe 106. The imaging system 100 may change imaging parameters based on monitored motion of the probe 106 without the operator having to actuate any input devices (other than the probe 106), without the operator having to speak for voice-activated controls or to instruct another operator to change parameters, etc.
[0049] In one embodiment, the processor 116 measures the image quality of image data acquired or generated using the probe 106 and determines whether to change imaging parameters based on the image quality. Image quality can be a quantity that represents how clearly the image data displays the region of interest in the body being examined. Images that more clearly indicate or depict the region of interest can be associated with a higher image quality value, while images that do not so clearly indicate or depict the region of interest can be associated with a lower image quality value. The processor 116 can determine the image quality by monitoring the movement of the probe 106. Different types and / or amounts of movement of the probe 106 can be associated with different image quality values. For example, a probe 106 that remains stationary for a certain period of time can have a larger image quality value, while a probe 106 that remains stationary for a shorter period of time can have a smaller image quality value, while a probe 106 that moves slowly can have an even smaller image quality value, and a probe 106 that moves more quickly can have an even smaller image quality value.
[0050] The processor 116 may monitor the motion of the probe 106, calculate an image quality value for the image data from the probe 106, and optionally modify the imaging parameters based on the value of the image quality. For example, if the image quality drops below a specified threshold associated with poor image quality, the processor 116 may modify the parameters. The value of this threshold may represent or indicate the amount of motion artifacts in the image data. A larger threshold may indicate more motion artifacts present in the image data, while a smaller threshold may indicate fewer motion artifacts in the image data.
[0051] The operator can move the probe 106 around to find an area of interest in the body. While the operator is moving the probe 106 around, the processor 116 can reduce the values of sensitivity, gain, line density, etc. of the imaging system 100 so that the image data is not too sensitive or contains too much information that the operator cannot understand. In response to the probe slowing down or stopping movement, the processor 116 can increase sensitivity, gain, line density, etc. because of the improvement in image quality caused by the slowing down or stopping of the probe 106.
[0052] During the imaging session, the operator may continue to move or not move the probe 106, and the processor 116 may repeatedly monitor the motion of the probe 106 to determine whether and / or how to change the parameters of the imaging system 100. This may assist the operator in focusing more on the placement of the probe 106 and the resulting image data as compared to prior systems, which may at least partially distract the operator by having to both manipulate the probe 106 and manually change the imaging parameters by entering the changes into a keyboard, touch screen, or the like.
[0053] Figure 3 1 shows a flow chart of one embodiment of a method 300 for automatically modifying parameters of an imaging system. The method 300 may represent a method for automatically modifying parameters of an imaging system by the processor 116 during an imaging session. Figure 1 ) during which an operator is manually actuating the imaging probe 106 ( Figure 1 ) to obtain image data representing a region of interest in the body. In one embodiment, the memory 120 stores instructions that, when executed by the processor 116, instruct the processor 116 to perform the operations of the method 300 (and / or other operations described herein).
[0054] Execution of method 300 may allow an operator to continue imaging a region of interest while modifying parameters that dictate how image data is acquired and / or generated without providing additional information to imaging system 100 (eg, Figure 1 This can reduce operator interface requirements for the imaging system 100, enabling the imaging system 100 to customize or tailor parameters for creating the imaging system 100 without requiring additional input other than movement of the probe 106.
[0055] At 302, image data of a volume is obtained using an imaging probe of an imaging system. For example, the probe 106 may be used to obtain image data representing a field of view or a region of interest of the volume. At 304, sensor data indicating movement of the imaging probe is received while the volume is being imaged. The sensor data may be provided from a motion sensor (such as an accelerometer) coupled to the probe 106. The data may indicate movement of the probe 106, such as whether the probe 106 is moving, how the probe 106 is moving, the direction(s) in which the probe 106 is moving, the speed at which the probe 106 is moving, etc. As described above, this data may be provided to the processor 116.
[0056] At 306, motion of the probe is determined based on the sensor data. For example, the processor 116 may receive data from an accelerometer or other sensor indicating how and / or whether the probe 106 is being moved. The processor 116 may examine this data to monitor how the probe 106 is moving and / or whether the probe 106 remains stationary. For example, acceleration in different directions may indicate where the probe 106 is moving and / or how fast it is moving.
[0057] At 308, it is determined whether the motion of the probe is associated with a change in an imaging parameter. The processor 116 may examine the motion of the probe 106 and determine whether the motion is associated with an imaging parameter and / or an amount of change in a parameter. As described above, keeping the probe 106 stationary, moving the probe 106, moving the probe 106 slower than a specified threshold, moving the probe 106 faster than the same or another threshold, and / or moving the probe 106 in a specified direction (or along a specified vector) may be associated with a parameter of the imaging system 100 and / or a change to an imaging parameter. If the motion of the probe 106 is associated with a parameter or a parameter change, the flow of the method 300 may proceed toward 312. If the motion of the probe 106 is not associated with a parameter or a parameter change, the flow of the method 300 may proceed toward 310. For example, a single movement or a combination of two or more movements may not be associated with any parameter or parameter change.
[0058] At 310, it is determined whether the motion sequence of the probe is associated with a change in an imaging parameter. Although a single motion or combination of motions of the probe 106 may not be associated with an imaging parameter or a parameter change made by the processor 116, a longer series of continuous motions of the probe 106 may be associated with a parameter or a parameter change. Different motion sequences may be associated with different parameters or parameter changes. If the processor 116 determines that the detected motion sequence of the probe 106 is associated with a parameter or a parameter change, the flow of method 300 may proceed to 312. Otherwise, the monitored motion of the probe 106 is not recognized by the processor 116 using any parameter or parameter change. As a result, the flow of method 300 may return to 302. This may allow the imaging session to continue using the motion of the probe 106 without changing the parameter. Optionally, the flow of method 300 may terminate.
[0059] At 312, a change in imaging parameters is determined. The processor 116 may refer to Figure 1306 and 308) and / or a sequence of probe motions (e.g., according to 306 and 310). Several different probe motions and / or motion sequences may be associated with different parameters and / or parameter changes in memory 120 (or elsewhere), and processor 116 may access such information to determine which parameter to change and / or how to change the parameter.
[0060] At 314, the imaging parameter change is implemented. The processor 116 can automatically change the imaging parameters without operator intervention other than the movement or holding of the probe. As described above, this can reduce the amount and / or source of input information required for the imaging system 100 to change the image data obtained by the probe 106.
[0061] Figure 4 1 shows a flow chart of another embodiment of a method 400 for automatically modifying parameters of an imaging system. The method 400 may represent a method for automatically modifying parameters of an imaging system by the processor 116 during an imaging session. Figure 1 ) during which an operator is manually actuating the imaging probe 106 ( Figure 1 ) to obtain image data representing a region of interest in the body. In one embodiment, the memory 120 stores instructions that, when executed by the processor 116, instruct the processor 116 to perform the operations of the method 300 (and / or other operations described herein).
[0062] Similar to method 300, execution of method 400 may allow an operator to continue imaging a region of interest while modifying parameters that dictate how image data is acquired and / or generated without requiring an operator to send a signal to imaging system 100 (eg, Figure 1 This can reduce operator interface requirements for the imaging system 100, enabling the imaging system 100 to customize or tailor parameters for creating the imaging system 100 without requiring additional input other than movement of the probe 106. Figure 3 and Figure 4 One difference between the flowcharts of methods 300 and 400 shown in FIG. 1 is the reliance on sensor 202 to detect motion of probe 106. Method 300 includes determining motion of probe 106 based on output from sensor 202 (e.g., at 306), while method 400 does not necessarily require or rely on output of the sensor. As described below, method 400 involves examining image data to identify motion of probe 106, which motion may then be used to alter one or more parameters of imaging system 100.
[0063] At 402, image data of a volume is obtained using an imaging probe of an imaging system. For example, the probe 106 can be used to obtain image data representing a field of view or a region of interest of the volume. At 404, the image data acquired using the imaging probe is examined. The image data can be examined to determine whether the image data indicates that the probe is moving. For example, the image data can be examined using one or more cross-correlation techniques, speckle tracking, optical flow analysis, etc. to determine whether and how the image data changes with respect to time. In one embodiment, different frames of image data (indicating image data acquired at different times) can be examined and compared to each other to identify differences in the image data.
[0064] At 406, motion of the probe is determined based on the image data. For example, the processor 116 may receive the image data, identify differences or changes in the image data with respect to time (e.g., at 404), and identify movement of the probe 106 based on the differences. For example, imaging the same body while the probe 106 is moving may cause different frames of the image data to be different. If the probe 106 is moving, the body or one or more parts of the body may be located at different locations in the image frames. The position changes or other differences in the image data may reveal how the probe 106 is moving, such as in which direction the probe 106 is moving and / or how fast the probe 106 is moving. Such probe motion may be identified without using or relying on output from a motion sensor such as an accelerometer. Such analysis of the image data to identify probe motion may occur while additional image data is being acquired. For example, during a continuous imaging session in which the imaging probe 106 is acquiring image data of the body, frames of the image data may be examined while additional frames are being acquired to identify probe motion.
[0065] At 408, it is determined whether the motion of the probe is associated with a change in an imaging parameter. The processor 116 may examine the motion of the probe 106 and determine whether the motion is associated with an imaging parameter and / or an amount of change in a parameter. As described above, keeping the probe 106 stationary, moving the probe 106, moving the probe 106 slower than a specified threshold, moving the probe 106 faster than the same or another threshold, and / or moving the probe 106 in a specified direction (or along a specified vector) may be associated with a parameter of the imaging system 100 and / or a change to an imaging parameter. If the motion of the probe 106 is associated with a parameter or a parameter change, the flow of the method 400 may proceed toward 412. If the motion of the probe 106 is not associated with a parameter or a parameter change, the flow of the method 400 may proceed toward 410. For example, a single movement or a combination of two or more movements may not be associated with any parameter or parameter change.
[0066] At 410, it is determined whether the sequence of motions of the probe is associated with a change in an imaging parameter. Although a single motion or combination of motions of the probe 106 may not be associated with an imaging parameter or a parameter change made by the processor 116, a longer series of continuous motions of the probe 106 may be associated with a parameter or a parameter change. Different sequences of motions may be associated with different parameters or parameter changes. If the processor 116 determines that the detected sequence of motions of the probe 106 is associated with a parameter or a parameter change, the flow of method 400 may proceed to 412. Otherwise, the monitored motion of the probe 106 is not identified by the processor 116 using any parameter or parameter change. As a result, the flow of method 400 may return to 402. This may allow the imaging session to continue using the motion of the probe 106 without changing the parameter. Optionally, the flow of method 400 may terminate.
[0067] At 412, a change in imaging parameters is determined. The processor 116 may refer to Figure 1 4 and 310) to determine which parameter and / or parameter change is associated with the identified probe motion (e.g., according to 406 and 408) and / or probe motion sequence (e.g., according to 406 and 310). Several different probe motions and / or motion sequences may be associated with different parameters and / or parameter changes in memory 120 (or elsewhere), and processor 116 may access such information to determine which parameter to change and / or how to change the parameter.
[0068] At 414, the imaging parameter change is implemented. The processor 116 can automatically change the imaging parameters without operator intervention other than the movement or holding of the probe. As described above, this can reduce the amount and / or source of input information required for the imaging system 100 to change the image data obtained by the probe 106.
[0069] In yet another embodiment, the imaging system 100 and / or methods 300, 400 may use a combination of data from the sensor 202 and analysis of the imaging data to identify motion of the probe 106. For example, another method of the subject matter of the invention described herein may include a combination of operations described in conjunction with 304, 306 in method 300 and in conjunction with 404, 406 in method 400. This combination or hybrid method may involve examining sensor data indicating motion of the probe 106 and analyzing image data to identify motion of the probe 106. In one embodiment, if at least one of the sensor data or image data differences indicates probe motion, this probe motion may be identified and used to modify imaging parameters, as described above. Otherwise, imaging parameters are not automatically modified based on probe motion. In another embodiment, if both sensor data and image data indicate probe motion, imaging parameters are modified accordingly, as described above. Otherwise, imaging parameters are not automatically modified based on probe motion.
[0070] In one embodiment, an apparatus includes one or more processors configured to monitor motion of an imaging probe in an imaging system that operates according to one or more parameters. The imaging probe is configured to output image data representative of an imaged volume. The one or more processors are configured to modify the one or more parameters of the imaging system based on the monitored motion of the imaging probe.
[0071] Optionally, the one or more processors are configured to be communicatively coupled to one or more motion sensors operably coupled to the imaging probe. The one or more processors are configured to identify motion of the imaging probe based on motion data output by the one or more motion sensors.
[0072] Optionally, the one or more processors are configured to monitor movement of the imaging probe by examining the image data and identifying movement of the imaging probe based on the image data.
[0073] Optionally, the one or more processors are configured to monitor motion of the imaging probe by determining that the imaging probe is stationary.The one or more processors may be configured to modify the one or more parameters of the imaging system in response to determining that the imaging probe remains stationary.
[0074] Optionally, the one or more processors are configured to vary the values of the one or more parameters with respect to time while the imaging probe remains stationary.
[0075] Optionally, the one or more processors are configured to modify the one or more parameters of the imaging system such that the imaging probe acquires image data at a different sensitivity in response to a change in motion of the imaging probe.
[0076] Optionally, the one or more processors are configured to modify the one or more parameters of the imaging system such that the imaging probe one or more of starts or stops acquiring image data in response to a change in the motion of the imaging probe.
[0077] Optionally, the one or more processors are configured to instruct the imaging probe to acquire a still image of the imaged body based on the monitored movement of the imaging probe.
[0078] Optionally, the one or more processors are configured to change the one or more parameters of the imaging system by changing one or more of the imaging system's gain, time gain compensation, line density, receive frequency, speckle reduction filter settings, refresh rate, or rendering settings.
[0079] Optionally, the one or more processors are configured to modify the one or more parameters of the imaging system based on the movement of the imaging probe and without receiving or determining any other manual input provided by an operator of the imaging system or the imaging probe.
[0080] Optionally, the one or more processors are configured to calculate an image quality metric based on the monitored motion of the imaging probe. The one or more processors may be configured to modify the one or more parameters of the imaging system in response to the image quality metric exceeding a specified threshold or falling below a specified threshold.
[0081] In one embodiment, a method includes: obtaining image data of an imaged body using a movable imaging probe of an imaging system that operates according to one or more parameters; monitoring movement of the imaging probe while the imaging probe is obtaining the image data of the imaged body; and modifying the one or more parameters of the imaging system using one or more processors based on the monitored movement of the imaging probe.
[0082] Optionally, the movement of the imaging probe is monitored based on data output by one or more sensors operably coupled to the imaging probe.
[0083] Optionally, said movement of said imaging probe is monitored based on analysis of said image data.
[0084] Optionally, monitoring the motion of the imaging probe comprises determining that the imaging probe remains stationary. In response to determining that the imaging probe remains stationary, the one or more parameters of the imaging system may be modified.
[0085] Optionally, the values of the one or more parameters are varied with respect to time while the imaging probe remains stationary.
[0086] In one embodiment, a tangible and non-transitory computer-readable storage medium is provided that includes instructions that instruct one or more processors to monitor the movement of an imaging probe of an imaging system that operates according to one or more parameters. The movement of the imaging probe is monitored while the imaging probe is acquiring image data of an imaged body. The movement of the imaging probe is monitored based on one or more of the data output by one or more sensors operably coupled to the imaging probe or based on one or more changes in the image data. The instructions also instruct the one or more processors to use the one or more processors to change the one or more parameters of the imaging system based on the one or more of the data output by the one or more sensors or based on the one or more changes in the image data.
[0087] Optionally, the instructions direct the one or more processors to monitor motion of the imaging probe by determining that the imaging probe remains stationary, and to modify the one or more parameters of the imaging system in response to determining that the imaging probe remains stationary.
[0088] Optionally, the instructions direct the one or more processors to monitor motion of the imaging probe by determining that the imaging probe is moving, and to modify the one or more parameters of the imaging system in response to determining that the imaging probe is moving.
[0089] Optionally, the instructions are configured to instruct the one or more processors to change the one or more parameters of the imaging system by performing one or more of the following operations: modifying the sensitivity of the imaging probe to acquire image data; starting to acquire image data; stopping to acquire image data; or changing one or more of the gain, time gain compensation, line density, receiving frequency, speckle reduction filter setting, refresh rate, or rendering setting of the imaging system.
[0090] As used herein, an element or step referenced in the singular and preceded by the word "a" or "an" should be understood as not excluding plural elements or steps, unless such exclusion is expressly set forth. Furthermore, reference to "one embodiment" is not intended to be interpreted as excluding the existence of additional embodiments that also incorporate the referenced features. Moreover, unless expressly set forth to the contrary, embodiments in which an embodiment "comprising," "including," or "having" an element or elements having a particular property may include additional such elements that do not have that property.
[0091] It should be understood that the above description is intended to be illustrative, not restrictive. For example, the embodiments described above (and / or aspects of the embodiments) can be used in combination with each other. In addition, many modifications can be made to adapt specific situations or materials to the teachings of the present invention without departing from its scope. Although the size and type of the materials described herein are intended to limit the parameters of the present invention, they are not restrictive and are exemplary embodiments. For those skilled in the art, after reading the above description, many other embodiments will be obvious. Therefore, the scope of the present invention should be determined with reference to the attached claims and the full scope of the equivalent schemes to which these claims are entitled. In the attached claims, the terms "including" and "in which" are used as the English equivalents of the corresponding terms "comprising" and "wherein". Moreover, in the following claims, the terms "first", "second" and "third" etc. are used only as labels and are not intended to impose numerical requirements on their objects. Further, the following claim limitations are not written in means-plus-function format and are not intended to be interpreted based on 35 USC §112(f) unless such claim limitation expressly uses the phrase "means for..." following a recitation of functionality without further structure.
[0092] This written description uses examples to disclose the invention, including the best mode, and also to enable any person skilled in the art to practice the invention, including making and using any device or system and performing any method incorporated. The patentable scope of the invention is defined by the claims and may include other examples that occur to those skilled in the art. These other examples are intended to be within the scope of the claims if they have structural elements that do not differ from the literal language of the claims, or if they include equivalent structural elements with insubstantial differences from the literal language of the claims.
Claims
1. A device for an imaging system, comprising: One or more processors configured to: monitoring motion of an imaging probe in an imaging system operating according to one or more time-varying parameters, the imaging probe being configured to output image data representative of an imaged volume; determining whether motion of the imaging probe is associated with a change in the one or more time-varying parameters; In response to determining that movement of the imaging probe is associated with a change in the one or more time-varying parameters, determining a time-varying parameter to be changed based on the monitored movement of the imaging probe; as well as modifying the determined time-varying parameter, wherein modifying the determined time-varying parameter comprises modifying the determined time-varying parameter during a period of time during which the imaging probe remains stationary, wherein the determined time-varying parameter is modified by different amounts based on how long the imaging probe remains stationary, Wherein, the one or more time-varying parameters include a sensitivity parameter.
2. The device according to claim 1, wherein: The one or more processors are configured to be communicatively coupled to one or more motion sensors, which are operably coupled to the imaging probe, wherein the one or more processors are configured to identify the motion of the imaging probe based on motion data output by the one or more motion sensors.
3. The device according to claim 1, wherein: The one or more processors are configured to monitor the motion of the imaging probe by examining the image data and identifying the motion of the imaging probe based on the image data.
4. The device according to claim 1, wherein: The one or more processors are configured to monitor the motion of the imaging probe by determining that the imaging probe is stationary, and the one or more processors are configured to modify the determined time-varying parameter in proportion to the time that the imaging probe remains stationary.
5. The device according to claim 4, wherein: The one or more processors are configured to increase the sensitivity parameter in proportion to the time that the imaging probe remains stationary.
6. The device according to claim 1, wherein: The one or more processors are configured to modify the one or more time-varying parameters of the imaging system such that the imaging probe acquires the image data at different sensitivities during a period of time during which the imaging probe remains stationary.
7. The device of claim 1, wherein: The one or more processors are configured to modify the determined time-varying parameter such that the imaging probe starts or stops acquiring one or more of the image data in response to a change in the motion of the imaging probe.
8. The device of claim 1, wherein: The one or more processors are configured to instruct the imaging probe to acquire a still image of the imaged body based on the monitored motion of the imaging probe.
9. The device of claim 1, wherein: The one or more processors are configured to modify the determined time-varying parameters by modifying one or more of a gain, a time gain compensation, a line density, a receive frequency, a speckle reduction filter setting, a refresh rate, or a rendering setting of the imaging system.
10. The device of claim 1, wherein: The one or more processors are configured to modify the determined time-varying parameter based on the motion of the imaging probe and without receiving or determining any other manual input provided by an operator of the imaging system or the imaging probe.
11. The device of claim 1, wherein: The one or more processors are configured to calculate an image quality metric based on the monitored motion of the imaging probe, the one or more processors being configured to modify the determined time-varying parameter in response to the image quality metric exceeding or falling below a specified threshold.
12. A method for an imaging system, comprising: acquiring image data of an imaged volume using a movable imaging probe of an imaging system that operates according to one or more time-varying parameters; monitoring movement of the imaging probe while the imaging probe is acquiring the image data of the imaged body; determining whether motion of the imaging probe is associated with a change in the one or more time-varying parameters; In response to determining that movement of the imaging probe is associated with a change in the one or more time-varying parameters, determining a time-varying parameter to be changed based on the monitored movement of the imaging probe; as well as modifying the determined time-varying parameter, wherein modifying the determined time-varying parameter comprises modifying the determined time-varying parameter during a period of time during which the imaging probe remains stationary, wherein the determined time-varying parameter is modified by different amounts based on how long the imaging probe remains stationary, Wherein, the one or more time-varying parameters include a sensitivity parameter.
13. The method of claim 12, wherein: The movement of the imaging probe is monitored based on data output by one or more sensors operably coupled to the imaging probe.
14. The method of claim 12, wherein: The movement of the imaging probe is monitored based on analysis of the image data.
15. The method of claim 12, wherein: Monitoring the motion of the imaging probe includes determining that the imaging probe remains stationary, wherein the determined time-varying parameter is modified in a manner proportional to the time that the imaging probe remains stationary.
16. The method of claim 14, wherein: The sensitivity parameter is increased in proportion to the time that the imaging probe remains stationary.
17. A tangible and non-transitory computer-readable storage medium comprising instructions that direct one or more processors to: monitoring movement of an imaging probe of an imaging system that operates according to one or more time-varying parameters, the movement of the imaging probe being monitored while the imaging probe is acquiring image data of an imaged body, the movement of the imaging probe being monitored based on one or more of data output by one or more sensors operably coupled to the imaging probe or based on one or more changes in the image data; determining whether motion of the imaging probe is associated with a change in the one or more time-varying parameters; In response to determining that movement of the imaging probe is associated with a change in the one or more time-varying parameters, determining a time-varying parameter to be changed based on the one or more of the data output by the one or more sensors or based on the one or more changes in the image data; as well as modifying the determined time-varying parameter, wherein modifying the determined time-varying parameter comprises modifying the determined time-varying parameter during a period of time during which the imaging probe remains stationary, wherein the determined time-varying parameter is modified by different amounts based on how long the imaging probe remains stationary, Wherein, the one or more time-varying parameters include a sensitivity parameter.
18. The computer-readable storage medium of claim 17, wherein: The instructions instruct the one or more processors to perform the following operations: monitoring the motion of the imaging probe by determining that the imaging probe remains stationary; and The determined time-varying parameter is modified in a manner proportional to the time that the imaging probe remains stationary.
19. The computer-readable storage medium of claim 17, wherein: The instructions instruct the one or more processors to perform the following operations: monitoring the motion of the imaging probe by determining that the imaging probe is moving; and The determined time-varying parameter is altered in response to determining that the imaging probe is moving.
20. The computer-readable storage medium of claim 17, wherein: The instructions are configured to instruct the one or more processors to perform the following operations: The one or more time-varying parameters of the imaging system are altered by one or more of the following operations: modifying the sensitivity of the imaging probe to acquire the image data, Start acquiring the image data, stop acquiring the image data, or Changing one or more of the imaging system's gain, time gain compensation, line density, receive frequency, speckle reduction filter settings, refresh rate, or rendering settings.
Citation Information
Patent Citations
Ultrasonic imaging method and system capable of automatically adjusting parameters
CN107811652A
Feature Tracking Using Ultrasound
US20120071758A1
Ultrasound imaging system and method
US20140031688A1
Ultrasound imaging system and method
US20140128739A1
Ultrasound diagnosis apparatus and method of operating the same
US20180214134A1