Medical imaging system and control method of medical imaging system
By introducing contactless detection and signal processing technology into the medical imaging system, the vital sign information of the detected object is obtained, which solves the problem that the imaging timing is difficult to accurately judge and improves the quality of medical images.
Patent Information
- Application Number
- CN202311282013.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-09-28
- Publication Date
- 2025-04-11
AI Technical Summary
In medical imaging systems, it is difficult to accurately obtain the best imaging timing for the subject being tested, resulting in low quality of the medical images obtained, especially during chest or abdominal X-rays.
It provides a medical imaging system, combining an imaging device, a contactless detection device, a signal processing module and a display device, conduct contactless detection through wireless signals, obtain vital sign data of the detected object, and generate information reflecting vital signs through the signal processing module, and display it to the operator to facilitate the judgment of the optimal imaging timing.
Through contactless detection and signal processing, operators can intuitively obtain vital sign information of the detected object, improve the accuracy of imaging timing, and thus improve the quality of medical images.
Smart Images

Figure CN119791704A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the field of medical imaging technology, and in particular, to a medical imaging system and a control method of the medical imaging system. Background Art
[0002] In a medical imaging system, X-rays emitted from an X-ray source are directed toward an object to be inspected, and after penetrating the object to be inspected, are received by a detector that is divided into a matrix of discrete elements (e.g., pixels). The detector elements are read to generate output signals based on the amount or intensity of radiation striking each pixel area, and the signals are processed to generate a medical image of the object to be inspected, which can be displayed on a display device of the medical imaging system. Summary of the invention
[0003] When a medical imaging system is used to perform medical imaging on an object under examination, the timing of imaging is a key factor in obtaining high-quality medical images.
[0004] For example, when performing an X-ray examination of the chest or abdomen, exposure needs to be performed at an appropriate time when the subject is at maximum inhalation. If exposure is performed at other times, the obtained medical image may not clearly show the part to be inspected.
[0005] In order to accurately provide imaging timing, embodiments of the present application provide a medical imaging system and a control method of the medical imaging system.
[0006] According to one aspect of an embodiment of the present application, a medical imaging system is provided, the system comprising:
[0007] An imaging device for acquiring a medical image of a detected object;
[0008] A non-contact detection device, which performs non-contact detection on the detected object based on wireless signals to obtain data related to the vital signs of the detected object;
[0009] a signal processing module, which processes the data to generate information reflecting the vital signs; and
[0010] A display device displays a graphical user interface for controlling the imaging device and information reflecting the vital signs.
[0011] According to one aspect of an embodiment of the present application, a control method for a medical imaging system is provided, wherein the medical imaging system has an imaging device for acquiring a medical image of a detected object, and the method comprises:
[0012] Performing non-contact detection on the detected object based on wireless signals to obtain data related to vital signs of the detected object;
[0013] Processing the data to generate information reflecting the vital signs; and
[0014] A graphical user interface for controlling the imaging device and information reflecting the vital signs are displayed.
[0015] With reference to the following description and accompanying drawings, the specific implementation of the embodiment of the present application is disclosed in detail, indicating the way in which the principle of the embodiment of the present application can be adopted. It should be understood that the implementation of the present application is not limited in scope. Within the scope of the spirit and clauses of the attached claims, the implementation of the present application includes many changes, modifications and equivalents. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] The included drawings are used to provide a further understanding of the embodiments of the present application, which constitute a part of the specification, are used to illustrate the implementation methods of the present application, and together with the text description, explain the principles of the present application. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other implementation methods can be obtained based on these drawings without creative work. In the drawings:
[0017] Figure 1 is a schematic diagram of an X-ray imaging system according to an embodiment of the present application;
[0018] Figure 2 is a schematic diagram of a medical imaging system according to an embodiment of the present application;
[0019] Figure 3 It is a schematic diagram of a non-contact detection device detecting an object to be detected;
[0020] Figure 4 It is a schematic diagram of information reflecting vital signs displayed by the display device;
[0021] Figure 5 is another schematic diagram of information reflecting vital signs displayed by the display device;
[0022] Figure 6 is another schematic diagram of information reflecting vital signs displayed by the display device;
[0023] Figure 7 It is a schematic diagram showing information reflecting vital signs on a graphical user interface;
[0024] Figure 8 is a schematic diagram of a display device displaying information of a moment when an imaging device acquires a medical image;
[0025] Fig. 9It is a schematic diagram of the processing module;
[0026] Fig.10 It is a schematic diagram of predicting information reflecting vital signs in a second time period based on a long short-term memory neural network;
[0027] Fig.11 It is a schematic diagram of extreme values;
[0028] Fig.12 It is a schematic diagram of a control method of a medical imaging system according to an embodiment of the present application. DETAILED DESCRIPTION
[0029] With reference to the accompanying drawings, the foregoing and other features of the embodiments of the present application will become apparent through the following description. In the description and the accompanying drawings, specific embodiments of the present application are specifically disclosed, which show some embodiments in which the principles of the embodiments of the present application can be adopted. It should be understood that the present application is not limited to the described embodiments. On the contrary, the embodiments of the present application include all modifications, variations and equivalents that fall within the scope of the attached claims.
[0030] In the embodiments of the present application, the terms "first", "second", etc. are used to distinguish different elements from the title, but do not represent the spatial arrangement or time sequence of these elements, etc., and these elements should not be limited by these terms. The term "and / or" includes any one and all combinations of one or more of the terms listed in association. The terms "comprise", "include", "have", etc. refer to the existence of the stated features, elements, components or components, but do not exclude the existence or addition of one or more other features, elements, components or components. In the present application, the words "connect", "connected", "coupled", etc. and the like involved in the embodiments are not limited to physical or mechanical connections, but may include electrical connections, whether directly or indirectly.
[0031] In the embodiments of the present application, the singular forms "a", "the", etc. include plural forms and should be broadly understood as "a kind" or "a type" rather than being limited to the meaning of "one"; in addition, the term "said" should be understood to include both singular and plural forms, unless the context clearly indicates otherwise. In addition, the term "according to" should be understood as "at least in part according to...", and the term "based on" should be understood as "at least in part based on...", unless the context clearly indicates otherwise.
[0032] Features described and / or shown for one embodiment may be used in one or more other embodiments in the same or similar manner, combined with features in other embodiments, or replace features in other embodiments. The term "includes / comprising" when used herein refers to the presence of a feature, an entirety, a step, or a component, but does not exclude the presence or addition of one or more other features, entireties, steps, or components.
[0033] Figure 1 is a schematic diagram of an X-ray imaging system according to an embodiment of the present application. Figure 1 As shown, the X-ray imaging system 100 may be an example of a medical imaging system, which includes a suspension device 110, a wall stand device 120, and a detection bed device 130 arranged in a scanning room 101, and a control device 150 arranged in a control room 102. The suspension device 110 includes a longitudinal guide rail 111, a transverse guide rail 112, a telescopic cylinder 113, a pulley 114, and a tube assembly 115.
[0034] Although some embodiments of the present application are described based on a suspended X-ray imaging system, the embodiments of the present application are not limited thereto. For example, the medical imaging system may also be other types of X-ray imaging systems, or the medical imaging system may also be other types of imaging systems, such as a computerized tomography (CT) system, a positron emission tomography (PET) system, a magnetic resonance imaging (MRI) system, etc.
[0035] For ease of description, in the present application, the x-axis, y-axis and z-axis are defined as the x-axis and y-axis are located in a horizontal plane and are perpendicular to each other, and the z-axis is perpendicular to the horizontal plane. Specifically, the direction of the longitudinal guide rail 111 is defined as the x-axis, the direction of the transverse guide rail 112 is defined as the y-axis direction, and the extension direction of the retractable cylinder 113 is defined as the z-axis direction, and the z-axis direction is the vertical direction.
[0036] The longitudinal guide rail 111 and the transverse guide rail 112 are vertically arranged, wherein the longitudinal guide rail 111 is installed on the ceiling, and the transverse guide rail 112 is installed on the longitudinal guide rail 111. The telescopic cylinder 113 is used to carry the ball tube assembly 115.
[0037] The pulley 114 is arranged between the transverse guide rail 112 and the telescopic cylinder 113. The pulley 114 may include a rotating shaft, a motor, a reel and other components. The motor can drive the reel to rotate around the rotating shaft, thereby driving the telescopic cylinder 113 to move along the z-axis and / or slide relative to the transverse guide rail. The pulley 114 can slide relative to the transverse guide rail 112, that is, the pulley 114 can drive the telescopic cylinder 113 and / or the ball tube assembly 115 to move along the y-axis direction. And the transverse guide rail 112 can slide relative to the longitudinal guide rail 111, thereby driving the telescopic cylinder 113 and / or the ball tube assembly 115 to move along the x-axis direction.
[0038] The telescopic cylinder 113 includes a plurality of cylinders with different inner diameters, and the plurality of cylinders can be sequentially sleeved in the cylinder located above them from bottom to top to achieve telescoping. The telescopic cylinder 113 can be telescopic (or movable) in the vertical direction, that is, the telescopic cylinder 113 can drive the ball tube assembly to move along the z-axis direction. The lower end of the telescopic cylinder 113 is also provided with a rotating part, which can drive the ball tube assembly 115 to rotate.
[0039] The tube assembly 115 includes an X-ray tube that can generate X-rays and project X-rays to a desired region of interest ROI of the patient. Specifically, the X-ray tube can be positioned adjacent to a beam limiter that is used to align the X-rays to the desired region of interest of the patient. At least a portion of the X-rays can be attenuated by the patient and can be incident on the detector 121 / 131.
[0040] The suspension device 110 further includes a beam limiter 117, which is usually installed below the X-ray tube. The X-rays emitted by the X-ray tube are irradiated onto the object to be inspected through the opening of the beam limiter 117. The size of the opening of the beam limiter 117 determines the irradiation range of the X-rays, that is, the size of the exposure field of view (FOV). The lateral position of the X-ray tube and the beam limiter 117 determines the position of the exposure field of view FOV on the object to be inspected. It is well known that X-rays are harmful to the human body, so it is necessary to control the X-rays so that they only irradiate the part of the object to be inspected that needs to be inspected, that is, the region of interest (ROI).
[0041] The suspension device 110 further includes a tube control device (console) 116, which is installed on the tube assembly. The tube control device 116 includes a user interface such as a display screen and control buttons for performing pre-shooting preparations, such as patient selection, protocol selection, and positioning.
[0042] The movement of the suspension device 110 includes the movement of the tube assembly along the x-axis, y-axis and z-axis, and the rotation of the tube assembly in the horizontal plane (the rotation axis is parallel to or coincident with the z-axis) and in the vertical plane (the rotation axis is parallel to the y-axis). In the above-mentioned movement, a motor is usually used to drive the corresponding component to rotate and thus achieve the corresponding movement or rotation, and the corresponding control component is generally installed in the pulley 114. The X-ray imaging unit further includes a motion control unit (not shown in the figure), which can control the above-mentioned movement of the suspension device 110. Further, the motion control unit can receive a control signal to control the corresponding component to perform a corresponding movement.
[0043] The column device 120 includes a first detector assembly 121, a column 122 and a connecting portion 123. The connecting portion 123 includes a support arm connected perpendicularly to the height direction of the column 122 and a rotating bracket installed on the support arm. The first detector assembly 121 is installed on the rotating bracket. The column device 120 further includes a detector driving device arranged between the rotating bracket and the first detector assembly 121. Under the drive of the detector driving device, the first detector assembly 121 moves along a direction parallel to the height direction of the column 122 on the plane supported by the rotating bracket. The first detector assembly 121 can also be further rotated relative to the support arm to form a certain angle with the column. The first detector assembly 121 has a plate-like structure, and its direction is variable so that the X-ray incident surface becomes vertical or horizontal according to the incident direction of the X-ray.
[0044] The detection bed device 130 includes a second detector assembly 131. The selection or use of the first detector assembly 121 and the second detector assembly 131 can be determined based on the patient's shooting part and / or shooting protocol, and can also be determined based on the position of the object to be detected obtained by camera shooting, so as to perform shooting inspections in the supine or standing position. Figure 1 Only an example diagram of the column and the detection bed is shown. Those skilled in the art should understand that columns and / or detection beds of any form or arrangement may be selected, or only columns may be installed. The columns and / or detection beds do not limit the entire scheme of the present application.
[0045] In some embodiments, the medical imaging system includes a camera 140 (e.g., a camera), which can be used to capture the detected object to obtain a captured image containing the detected object, such as a static optical image or a series of frame optical images in a dynamic real-time video stream, to assist in positioning and exposure settings, etc. The camera can be installed on a suspension device, such as on the side of the beam limiter 117, etc., and the embodiments of the present application are not limited to this. The camera 140 includes one or more cameras, such as a digital camera, an analog camera, etc., or a depth camera, an infrared camera, or an ultraviolet camera, etc., or a 3D camera, a 3D scanner, etc., or a red, green, and blue (RGB) sensor, an RGB depth (RGB-D) sensor, or other devices that can capture color image data of a target object.
[0046] In some embodiments, the control device 150 may include a source controller and a detector controller. The source controller is used to command the X-ray source to emit X-rays for image exposure. The detector controller is used to select a suitable detector from a plurality of detectors and coordinate the control of various detector functions, for example, automatically selecting a corresponding detector according to the position or posture of the object to be detected, or performing various signal processing and filtering functions, specifically, for initial adjustment of the dynamic range, interleaving of digital image data, etc. In some embodiments, the control device may provide power and timing signals for controlling the operation of the X-ray source and the detector.
[0047] In some embodiments, the control device may also be configured to use the digitized signals to reconstruct one or more desired images and / or determine useful diagnostic information corresponding to the patient, wherein the control device may include one or more dedicated processors, graphics processing units, digital signal processors, microcomputers, microcontrollers, application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or other appropriate processing devices.
[0048] Of course, the medical imaging system may also include other numbers or configurations or forms of control devices, for example, the control device may be local (e.g., co-located with one or more X-ray imaging systems 100, such as in the same facility and / or the same local network); in other implementations, the control device may be remote and therefore only accessible via a remote connection (e.g., via the Internet or other available remote access technology). In a specific implementation, the control device may also be configured in a cloud-like manner and may be accessed and / or used in a manner substantially similar to accessing and using other cloud-based systems.
[0049] The system 100 also includes a storage device (not shown), and the processor can store the digitized signal in the storage. For example, the storage can include a hard disk drive, a floppy disk drive, a CD-ROM read / write drive, a digital universal disk drive, a flash drive, and / or a solid-state memory. The storage can also be integrated with the processor to effectively use the floor space and / or meet the expected imaging requirements.
[0050] The system 100 also includes an input device 160, which may include a form of operator interface such as a keyboard, a mouse, a voice-activated control device, a touch screen (which may also serve as a display device described later), a trackball, or any other suitable input device. The operator may input operation signals / control signals to the control device through the input device.
[0051] The system 100 also includes a display device 151 (such as a touch screen or a display screen), which can be used to display an operation interface such as a list of detected objects, a position or exposure setting of the detected objects, and an image of the detected objects.
[0052] At present, a captured image obtained by photographing the object to be detected by a camera device can be displayed on a display device. The captured image is different from a medical image obtained by performing X-ray imaging. The captured image is used to assist in positioning or exposure setting. For example, assisting in positioning or exposure setting includes obtaining information about the object to be detected, obtaining a shooting protocol, determining shooting dose, posture and other information, performing positioning based on the shooting protocol, and setting the size and position of the exposure area.
[0053] In order to facilitate the operator to accurately determine the timing of imaging the detected object, the present application embodiment provides a medical imaging system and a control method of the medical imaging system.
[0054] The following is a detailed description of the embodiments of the present application.
[0055] An embodiment of the present application provides a medical imaging system. Figure 2 is a schematic diagram of a medical imaging system according to an embodiment of the present application. Figure 2 As shown, the medical imaging system 200 includes: an imaging device 201 , a non-contact detection device 202 , a signal processing module 203 and a display device 204 .
[0056] The imaging device 201 acquires a medical image of the detected object; the non-contact detection device 202 can perform non-contact detection on the detected object to obtain data related to the vital signs of the detected object; the signal processing module 203 processes the data to generate information reflecting the vital signs; the display device 204 can display a graphical user interface for controlling the imaging device 201 and information reflecting the vital signs.
[0057] In the embodiment of the present application, information reflecting the vital signs of the detected object is displayed, so that the operator of the medical imaging system 200 can intuitively obtain the vital signs of the detected object, thereby grasping the appropriate time to obtain the medical image of the detected object to improve the quality of the medical image. In addition, obtaining the vital signs of the detected object through the non-contact detection device 202 can improve efficiency and ensure the safety of the detected object.
[0058] In the description of each embodiment of the present application, the medical imaging system 200 is taken as an example of an X-ray imaging system, but the present application is not limited to this. The present application is also applicable to the case where the medical imaging system 200 is other types of medical imaging systems. For example, the medical imaging system 200 can be a computed tomography (CT) system, a positron emission tomography (PET) system, or a magnetic resonance imaging (MRI) system.
[0059] In some embodiments, the imaging device 201 may include an X-ray source and a detector, and the X-ray source and the detector can cooperate to obtain a medical image of the detected object. For the description of the X-ray source and the detector, reference may be made to the above description. In addition, when the medical imaging system 200 is a computer tomography (CT) system, a positron emission tomography (PET) system, or a magnetic resonance imaging (MRI) system, the imaging device 201 may have a structure corresponding to the medical imaging system, and reference may be made to the relevant technology.
[0060] The implementation of the display device 204 can refer to the aforementioned Figure 1 The description of the display 151 in the corresponding embodiment.
[0061] In the present application, the medical imaging system 200 may also have other components. For descriptions of these other components, please refer to the aforementioned Figure 1 The related descriptions in the corresponding embodiments will not be repeated, and the differences are specifically described below.
[0062] In the present application, the data related to the vital signs of the detected object may include at least one of the following data:
[0063] Data related to the breathing of the subject;
[0064] Data related to the heartbeat of the detected subject;
[0065] Data related to the pulse of the subject being tested.
[0066] In addition, the present application is not limited thereto, and the data related to vital signs may also be other data.
[0067] In the present application, the non-contact detection device 202 can perform non-contact detection on the detected object based on wireless signals (e.g., electromagnetic waves, etc.). For example, the non-contact detection device 202 sends a wireless signal to the detected object and receives the wireless signal reflected by the detected object, thereby performing non-contact detection. Specifically, the non-contact detection device 202 can be a radar. For another example, the non-contact detection device 202 sends a wireless signal to the detected object and receives the wireless signal passing through the detected object, thereby performing non-contact detection.
[0068] In the present application, the signal processing module 203 processes the data acquired by the non-contact detection device 202 to generate information reflecting the vital signs of the detected object. The signal processing module 203 processes the data by at least one of smoothing, filtering, Fourier transform, etc., so as to obtain information such as distance, phase, position, etc.
[0069] In some embodiments, the vital sign information may be information about changes in the vital sign over time.
[0070] In other embodiments, the vital sign information may also be information about the vital sign changing with frequency. In addition, the signal processing module 203 may further perform Fourier inverse transform and other processing on the vital sign changing with frequency, thereby converting it into information about the vital sign changing with time.
[0071] For example, when the non-contact detection device 202 is a radar, the signal processing module 203 filters and performs fast Fourier transform processing on the data obtained by the non-contact detection device 202 to generate information on distance changes over time (for example, distance information arranged in a time series), which can represent the distance between the non-contact detection device 202 and the surface of the object being detected.
[0072] The distance may reflect the vital signs of the detected object, and thus, the information on the distance variation over time generated by the signal processing module 203 may be information reflecting the variation of the vital signs over time.
[0073] For example, when the surface of the detected object is the surface of the chest or abdomen, the distance can reflect the breathing condition of the detected object.
[0074] Below, the embodiment of the present application is further explained by taking the information reflecting the vital signs, which is the information of the respiratory status changing over time, as an example.
[0075] Figure 3 It is a schematic diagram of a non-contact detection device detecting an object to be detected. Figure 3As shown, the non-contact detection device 202 can be arranged on the inner side of the first detector assembly 121 and / or on the tube assembly 115. In addition, when the detected object 300 lies on the detection bed 130 (that is, the detected object 300 is in a supine position), detection can also be performed only by the non-contact detection device 202 installed on the tube assembly 115. Figure 3 For the description of other parts in Figure 1 Description of parts with the same reference numerals in FIG.
[0076] like Figure 3 As shown, the non-contact detection device 202 may be a radar, which sends a wireless signal to the abdomen or chest of the detected object 300 and receives the wireless signal reflected by the body surface of the detected object 300 to obtain data related to the vital signs of the detected object 300.
[0077] The signal processing module 203 processes the data acquired by the non-contact detection device 202 to generate information reflecting vital signs, for example, information on distance changes over time (for example, distance information arranged in a time series), which can reflect the information on breathing changes over time of the detected object 300.
[0078] In the present application, the information of the distance variation over time generated by the signal processing module 203 (i.e., information reflecting vital signs) can be stored (e.g., stored by the recording module 205 described later). In some embodiments, the storage format can be a two-dimensional data format, such as [time, distance]; in other embodiments, the storage format can be a one-dimensional data format, such as "distance 1, distance 2, distance 3, ...", that is, the distance is recorded once every predetermined time period, thereby reducing the amount of data storage. The information can be stored in a picture archiving and communication system (PACS) in the form of a DICOM (Digital Imaging and Communications in Medicine) header file.
[0079] In the present application, the signal processing module 203 can send the generated information of distance change over time (i.e., information reflecting vital signs) to the display device 204, and the display device 204 can display the information reflecting vital signs. The display device 204 can display the information reflecting vital signs in at least one of the following forms: waveform; real-time value; indicator bar, etc.
[0080] Figure 4 is a schematic diagram of information reflecting vital signs displayed by the display device 204. Figure 4 As shown, information reflecting vital signs may be displayed in the form of a waveform 400, where the abscissa represents time and the ordinate represents distance.
[0081] The operator of the medical imaging system 200 can judge the best time to acquire medical images by observing the waveform 400, thereby improving the quality of the medical images. For example, in the waveform 400, the moment of the peak 401 can correspond to the moment when the subject 300 is at the maximum inhalation, and the period 402 of the waveform flatness corresponds to the period when the subject 300 holds his breath after the maximum inhalation. Therefore, exposing at the moment of the peak or during the period of the waveform flatness can acquire medical images with better imaging effects. In particular, in an examination without specific air intake requirements or when the subject 300 cannot follow the breathing instructions, it is convenient for the operator to judge the best time to acquire medical images.
[0082] Figure 5 is another schematic diagram of information reflecting vital signs displayed by the display device 204. Figure 5 As shown, information reflecting vital signs can be displayed as real-time values. For example, Figure 5 The value 403 represents the percentage of the current air intake volume to the maximum air intake volume when the detected object 300 is breathing.
[0083] Figure 6 is another schematic diagram of information reflecting vital signs displayed by the display device 204. Figure 6 As shown, information reflecting vital signs can be displayed as an indicator bar. For example, Figure 6 The indicator bar 404 may include an indicator icon 405 , and the upper and lower positions of the indicator icon 405 may change with the current air intake volume of the detected object 300 , or the indicator icon 405 may jump up and down with the pulse or heartbeat frequency of the detected object 300 .
[0084] In the following embodiments of the present application, the display form of information reflecting vital signs is a waveform as an example for explanation, and the explanation is also applicable to other display forms.
[0085] In the present application, the display device 204 may also display content such as a graphical user interface for controlling the imaging device 201. For example, the graphical user interface may display control icons for enabling the imaging device 201 to acquire a medical image of the object being detected (for example, exposing the imaging device 201). In addition, the graphical user interface may also display control icons for adjusting parameters of the imaging device 201.
[0086] Figure 7 It is a schematic diagram showing information reflecting vital signs in a graphical user interface. Figure 7As shown, the graphical user interface 700 includes a parameter setting display window 701, and the parameter setting display window 701 includes a parameter list 7011. The exposure parameters included in the parameter list 7011 include, for example, tube voltage (KV), tube current (mA), milliampere-seconds (mAs), exposure time (ms), automatic exposure control ionization chamber (Ion-Chamber), etc. The figure shows a parameter list for image stitching, but for different types of exposure, the parameter list is not limited to Figure 7 The arrangement shown in .
[0087] In some embodiments, the graphical user interface 700 may further include a parameter adjustment area 702. The parameter adjustment area is used to set and adjust specific values of parameters.
[0088] In some embodiments, the graphical user interface 700 may also include an area 703 for displaying a camera image, which is used to position the camera before exposure, adjust exposure parameters, etc. For example, the camera image may be Figure 1 The real-time video stream obtained by the camera device 140.
[0089] In addition, after exposure, the area 703 can also be used to display a medical image (eg, an X-ray image).
[0090] In some embodiments, the graphical user interface 700 may further include an area 704 for displaying information reflecting vital signs. The information reflecting vital signs may be, for example, Figure 4 Waveform 400 or other forms as shown.
[0091] In the present application, the area 704 displaying the information reflecting the vital signs may be parallel to or overlapped with the area 703. In addition, the area 704 may also be a part of the area 703. In some examples, the area 704 may be displayed at any position of the area 703, for example, the area 704 is displayed at a corner of the area 703. In addition, the area 704 may also be displayed at any other position of the graphical user interface 700. For example, if the information reflecting the vital signs is displayed in the form of numerical values, then the area 704 may also be displayed in the parameter adjustment area 702. The present application does not limit the position of the area 704.
[0092] like Figure 2 As shown, in some embodiments of the present application, the medical imaging system 200 may further include: a recording module 205. The recording module 205 may record the time information (e.g., the time of exposure) when the imaging device 201 acquires the medical image. For example, the time information when the imaging device 201 acquires the medical image may be annotated in the information reflecting the vital signs. The display device 204 may display the time information when the imaging device 201 acquires the medical image on a graph.
[0093] Figure 8 FIG. 2 is a schematic diagram showing the time information of the imaging device 201 acquiring the medical image. Figure 8 As shown, in the waveform 800 showing the distance changing over time, the time corresponding to the icon 801 represents the time T1 when the imaging device 201 acquires the medical image (eg, the time when the imaging device 201 is exposed).
[0094] The time information recorded by the recording module 205 can help determine whether the timing of acquiring the medical image is appropriate (for example, whether the exposure is performed under maximum inspiratory volume), thereby facilitating review and, in addition, also facilitating analysis and evaluation of the medical image.
[0095] In some embodiments, at a predetermined time after the imaging device 201 acquires the medical image, the non-contact detection device 202 may stop performing non-contact detection on the detected object 300, thereby reducing the amount of data storage. Figure 8 In the embodiment, the predetermined time after the time T1 at which the imaging device 201 acquires the medical image is T2. After the time T2, the non-contact detection device 202 may stop performing non-contact detection on the detected object 300.
[0096] The predetermined moment may be the moment when the imaging device 201 completes image processing of the medical image. In addition, the present application is not limited thereto, and the predetermined moment may also have other meanings.
[0097] like Figure 2 As shown, in some embodiments of the present application, the medical imaging system 200 may further include: a processing module 206. The processing module 206 may calculate the candidate timing for the imaging device 201 to acquire the medical image based on the information reflecting the vital signs, and the display device 204 may display the candidate timing on a graph corresponding to the information reflecting the vital signs. Thus, the operator of the medical imaging system 200 may decide at what moment to acquire the medical image of the detected object based on the candidate timing displayed in the display device 204. That is, the patient is pathologically unable to hold his breath. For example, when the detected object 300 is in a natural breathing state but cannot comply with breath holding or breathing instructions, the operator may still perform exposure based on the candidate timing displayed in the display device 204 when the detected object 300 is at maximum inhalation volume, thereby acquiring a medical image.
[0098] Fig. 9 206 is a schematic diagram of the processing module 206. Fig. 9 As shown, the processing module 206 includes: a prediction module 2601 , an extreme value detection module 2602 and a candidate timing determination module 2063 .
[0099] The prediction module 2061 can predict the information reflecting the vital signs in a second time period after the first time period based on the vital signs information reflected in the first time period. The length of the first time period can be preset (for example, set by a parameter); the length of the second time period can be preset, or the length of the second time period is determined by the prediction capability of the prediction module 2061.
[0100] Among them, the prediction module 2061 can predict the information reflecting the vital signs in the second time period based on the long short-term memory (LSTM) neural network.
[0101] Fig.10 It is a schematic diagram of predicting information reflecting vital signs in a second time period based on a long short-term memory (LSTM) neural network.
[0102] like Fig.10 As shown, the information reflecting the vital signs represented by the waveform 1001 is divided into multiple segments (for example, X1, X2, ..., Xn-1, Xn), and the information in each segment is the information reflecting the vital signs in the first time period. The multiple segments of information are respectively input into the corresponding hidden layers in the long short-term memory neural network 1000 to form corresponding hidden layer vectors (for example, h1, h2, ..., hn-1, hn), and each hidden layer outputs the information reflecting the vital signs in the second time period corresponding to each segment of information (for example, Y1, Y2, ..., Yn-1, Yn), wherein Y1 is after X1, ..., Yn is after Xn, that is, the information in the second time period is the information predicted based on the information in the first time period. X1, X2, ..., Xn-1, Xn will be continuously updated with the data output by the signal processing module 203, and Y1, Y2, ..., Yn-1, Yn will also be updated accordingly.
[0103] In some examples, the long short-term memory neural network 700 may include multiple LSTM layers, each of which may include: an input unit, a memory / forgetting unit, and an output unit. Each LSTM layer also has 10-15 hidden layers, all of which are closely connected to the output unit to output the information in the predicted second time period.
[0104] In this LSTM neural network: the input unit of each LSTM layer uses the input information of the layer and the output information of the hidden layer of the previous LSTM layer to determine which information will be stored in the memory / forget unit of the LSTM layer; the memory / forget unit is responsible for deciding which information in the memory / forget unit of the previous LSTM layer needs to be deleted; the output unit integrates the input information, generates the output result and updates the corresponding hidden layer. Through the information processing of the three units in the LSTM layer, the LSTM neural network can continuously update the hidden layer and output the information of the hidden layer as predicted information.
[0105] In addition, in the present application, the information reflecting the vital signs actually detected and the information reflecting the vital signs predicted can be further input into the LSTM layer of the LSTM neural network for comparison to correct the parameters of the LSTM layer, thereby improving the accuracy of the prediction of the LSTM neural network.
[0106] In the present application, the prediction module 2061 uses a long short-term memory (LSTM) neural network, which can more accurately predict the information reflecting the vital signs in the second time period.
[0107] In addition, the present application may not be limited to long short-term memory (LSTM) neural networks, and other waveform prediction techniques may be used.
[0108] In some embodiments, a model-based approach can be used to perform waveform prediction using linear and nonlinear equations superimposed with prediction parameters, for example:
[0109] Use Autoregressive Moving Average Model (ARIMA);
[0110] Use the Sinusoidal Model;
[0111] Use Kalman Filter.
[0112] In other embodiments, a learning-based method may be used to calculate and adjust parameters using a neural network to achieve the purpose of prediction. For example, the types of neural networks that can be used include: artificial neural network (ANN), recurrent neural network (RNN), etc.
[0113] In the present application, the information of the second time period predicted by the prediction module 2061 (for example, the information of the second time period is displayed in the form of a waveform) can be displayed in a different style from the information of the first time period, for example, using different colors and / or line types (for example, using solid lines and dotted lines for display, respectively). In addition, as time goes by, the predicted information (for example, displayed in the form of a waveform) will be covered by the information actually detected (for example, displayed in the form of a waveform).
[0114] In the present application, the extreme value detection module 2602 detects the extreme value (e.g., the maximum value or the minimum value) in the information reflecting the vital signs in the second time period, and sets the extreme value closest in time to the first time period as the candidate extreme value. The extreme value detection module 2602 can use a matched filter to perform peak detection on the predicted waveform, and can also use other methods to perform peak detection.
[0115] Fig.11 is a schematic diagram of the extreme value. Fig.11 As shown, in the information 1101 reflecting the vital signs in the predicted second time period, the extreme value (for example, the maximum value 1102) closest to the first time period in time is detected, and the maximum value 1102 is used as a candidate extreme value. The moment corresponding to the candidate extreme value is at least a part of the candidate opportunity.
[0116] In the present application, the candidate timing determination module 2603 sets a predetermined time period including the moment corresponding to the candidate extreme value based on the candidate extreme value, and uses the time period as the candidate timing. Fig.11 As shown, time period 1103 is taken as a candidate opportunity, and time period 1103 includes a moment T3 corresponding to a candidate extreme value (for example, maximum value 1102), wherein T3 may be located at the midpoint of time period 1103, or T3 may be located before or after the midpoint of time period 1103.
[0117] In addition, the present application is not limited thereto, and the processing module 206 may not include the candidate timing determination module 2603 , and thus, the candidate extreme value detected by the extreme value detection module 2602 may be used as the candidate timing.
[0118] In the present application, the candidate timing for exposure is indicated by the candidate timing, so that the operator can observe the candidate timing intuitively.
[0119] like Fig. 9 As shown, in some embodiments, the processing module 206 further includes: an indication information generating module 2604. The indication information generating module 2604 can generate indication information at a predetermined time before the time corresponding to the candidate extreme value, and the display device 204 can display the indication information in a graph (for example, on a waveform).
[0120] For example, Fig.11 As shown, at time T4 before time T3 corresponding to the maximum value 1102, indication information 1104 is displayed on the waveform 1100. The time interval between time T4 and time T3 may be, for example, the time required for the exposure action of the imaging device 201. That is, if the operator operates the imaging device 201 at time T4, then the actual time when the imaging device 201 completes the exposure action is around T3. Therefore, the imaging device 201 can be exposed at an appropriate time to obtain a medical image of the object being detected.
[0121] In a specific example, the interval between time T4 and time T3 is about 1500 milliseconds.
[0122] also, Fig.11 The indication information 1104 shown is only an example, and the present application is not limited thereto. In some examples, the indication information may also be text or a pop-up window, or the indication information may be reflected by changing the color or shape of the text or icon. For example, when the indication information is not generated, the icon for controlling the exposure of the user interface (for example, Figure 7 The icon 705 shown can become dark, or become untriggerable or unselectable. When indication information is generated, the indication information can make the icon for controlling exposure brighter, or make the icon triggerable or selectable, etc.
[0123] The above embodiments are merely exemplary of the embodiments of the present application, but the present application is not limited thereto, and appropriate modifications may be made based on the above embodiments. For example, the above embodiments may be used alone, or one or more of the above embodiments may be combined.
[0124] The embodiment of the present application further provides a control method for a medical imaging system, and the contents that are the same as those in the embodiments of the aforementioned aspects are not repeated here. Fig.12 is a schematic diagram of a control method of a medical imaging system according to an embodiment of the present application. Fig.12 As shown, the method includes:
[0125] Operation 1201: performing non-contact detection on the detected object based on wireless signals to obtain data related to vital signs of the detected object;
[0126] Operation 1202: Process the data to generate information reflecting the vital signs; and
[0127] Operation 1203: Display a graphical user interface for controlling the imaging device and information reflecting the vital signs.
[0128] In some embodiments, the data related to the vital signs of the detected subject includes at least one of the following data:
[0129] Data related to the breathing of the detected subject;
[0130] Data related to the heartbeat of the detected subject;
[0131] Data related to the pulse of the subject being detected.
[0132] In some embodiments, Fig.12 As shown, the method also includes:
[0133] Operation 1204: Record the time information when the imaging device acquires the medical image, and display the time information when the imaging device acquires the medical image.
[0134] In some embodiments, at a predetermined time after the imaging device acquires the medical image, the non-contact detection of the detected object is stopped.
[0135] In some embodiments, Fig.12 As shown, the method also includes:
[0136] Operation 1205: Calculate candidate timings for the imaging device to acquire the medical image based on the information reflecting the vital sign, and display the candidate timings.
[0137] Wherein, calculating the candidate timing for the imaging device to acquire the medical image comprises:
[0138] Based on the information reflecting the life form in a first time period, predicting the information reflecting the life sign in a second time period after the first time period; and
[0139] An extreme value in the information reflecting the vital sign in the second time period is detected, and the extreme value closest in time to the first time period is set as a candidate extreme value, wherein the moment corresponding to the candidate extreme value is at least a part of the candidate opportunity.
[0140] In some embodiments, information reflecting the vital signs within the second time period is predicted based on a long short-term memory (LSTM) neural network.
[0141] In some embodiments, Fig.12 As shown, the method also includes:
[0142] Operation 1206: Generate indication information at a predetermined time before the time corresponding to the candidate extreme value, and display the indication information.
[0143] It is worth noting that the above Fig.12 The embodiments of the present application are only schematically described, but the present application is not limited thereto. For example, the execution order of the various operations can be appropriately adjusted, and other operations can be added or some operations can be reduced. Those skilled in the art can make appropriate modifications based on the above content, and are not limited to the above appended Fig.12 Records of.
[0144] The above embodiments are merely exemplary of the embodiments of the present application, but the present application is not limited thereto, and appropriate modifications may be made based on the above embodiments. For example, the above embodiments may be used alone, or one or more of the above embodiments may be combined.
[0145] The above devices and methods of the present application can be implemented by hardware, or by hardware combined with software. The present application relates to such a computer-readable program, which, when executed by a logic component, enables the logic component to implement the above-mentioned devices or components, or enables the logic component to implement the various methods or steps described above. The present application also relates to a storage medium for storing the above program, such as a hard disk, a magnetic disk, an optical disk, a DVD, a flash memory, etc.
[0146] The method / device described in conjunction with the embodiments of the present application may be directly embodied as hardware, a software module executed by a processor, or a combination of the two. For example, one or more of the functional block diagrams shown in the figure and / or one or more combinations of the functional block diagrams may correspond to various software modules of the computer program flow or to various hardware modules. These software modules may correspond to the various steps shown in the figure, respectively. These hardware modules may be implemented by solidifying these software modules, for example, using a field programmable gate array (FPGA).
[0147] The software module may be located in a RAM memory, a flash memory, a ROM memory, an EPROM memory, an EEPROM memory, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. A storage medium may be coupled to a processor so that the processor can read information from the storage medium and write information to the storage medium; or the storage medium may be an integral part of the processor. The processor and the storage medium may be located in an ASIC. The software module may be stored in a memory of a mobile terminal or in a memory card that can be inserted into the mobile terminal. For example, if a device (such as a mobile terminal) uses a large-capacity MEGA-SIM card or a large-capacity flash memory device, the software module may be stored in the MEGA-SIM card or the large-capacity flash memory device.
[0148] For one or more of the functional blocks described in the drawings and / or one or more combinations of functional blocks, it can be implemented as a general-purpose processor, digital signal processor (DSP), application-specific integrated circuit (ASIC), field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component or any appropriate combination thereof for performing the functions described in the present application. For one or more of the functional blocks described in the drawings and / or one or more combinations of functional blocks, it can also be implemented as a combination of computing devices, such as a combination of a DSP and a microprocessor, multiple microprocessors, one or more microprocessors in communication with a DSP, or any other such configuration.
[0149] The present application is described above in conjunction with specific implementation methods, but it should be clear to those skilled in the art that these descriptions are exemplary and are not intended to limit the scope of protection of the present application. Those skilled in the art can make various modifications and variations to the present application based on the principles of the present application, and these modifications and variations are also within the scope of the present application.
Claims
1. A medical imaging system, characterized in that: The system comprises: An imaging device for acquiring a medical image of a detected object; A non-contact detection device, which performs non-contact detection on the detected object based on wireless signals to obtain data related to the vital signs of the detected object; a signal processing module, which processes the data to generate information reflecting the vital signs; and A display device displays a graphical user interface for controlling the imaging device and the information reflecting the vital signs.
2. The medical imaging system according to claim 1, wherein: The data related to the vital signs of the detected object includes at least one of the following data: Data related to the breathing of the detected subject; Data related to the heartbeat of the detected subject; Data related to the pulse of the subject being detected.
3. The medical imaging system according to claim 1, wherein: The system further comprises: a recording module, which records the time information of the imaging device acquiring the medical image, The display device displays the time information at which the imaging device acquires the medical image.
4. The medical imaging system according to claim 3, wherein: At a predetermined time after the time when the imaging device acquires the medical image, The non-contact detection device stops performing non-contact detection on the detected object.
5. The medical imaging system according to claim 1, wherein: The system further comprises: a processing module, which calculates candidate timings for the imaging device to acquire the medical image based on the information reflecting the vital signs, The display device displays the candidate timings.
6. The medical imaging system according to claim 5, characterized in that The processing module comprises: a prediction module, which predicts information reflecting the vital sign in a second time period after the first time period based on the information reflecting the vital sign in the first time period; and an extreme value detection module, which detects the extreme value in the information reflecting the vital signs in the second time period, and sets the extreme value closest in time to the first time period as a candidate extreme value, The time corresponding to the candidate extreme value is at least a part of the candidate opportunity.
7. The medical imaging system according to claim 5, characterized in that The processing module also includes: an indication information generating module, which generates indication information at a predetermined time before the time corresponding to the candidate extreme value, The display device displays the indication information.
8. The medical imaging system according to claim 5, wherein: The prediction module predicts information reflecting the vital signs within the second time period based on a long short-term memory (LSTM) neural network.
9. A control method for a medical imaging system, wherein the medical imaging system has an imaging device for acquiring a medical image of a detected object, characterized in that: The method comprises: Performing non-contact detection on the detected object based on wireless signals to obtain data related to vital signs of the detected object; Processing the data to generate information reflecting the vital signs; and A graphical user interface for controlling the imaging device and the information reflecting the vital signs are displayed.
10. The control method of the medical imaging system according to claim 9, characterized in that: The data related to the vital signs of the detected object includes at least one of the following data: Data related to the breathing of the detected subject; Data related to the heartbeat of the detected subject; Data related to the pulse of the subject being detected.
11. The control method of the medical imaging system according to claim 9, characterized in that: The method further comprises: The time information when the imaging device acquires the medical image is recorded, and the time information when the imaging device acquires the medical image is displayed.
12. The control method of the medical imaging system according to claim 11, characterized in that: At a predetermined time after the time when the imaging device acquires the medical image, Stop non-contact detection of the detected object.
13. The control method of the medical imaging system according to claim 9, characterized in that: The method further comprises: According to the information reflecting the vital signs, candidate timings for the imaging device to acquire the medical image are calculated, and the candidate timings are displayed.
14. The control method of the medical imaging system according to claim 13, characterized in that: Calculating the candidate timing for the imaging device to acquire the medical image includes: Based on the information reflecting the vital sign in the first time period, predicting the information reflecting the vital sign in a second time period after the first time period; and detecting an extreme value in the information reflecting the vital sign in the second time period, and setting the extreme value closest in time to the first time period as a candidate extreme value, The time corresponding to the candidate extreme value is at least a part of the candidate opportunity.
15. The control method of the medical imaging system according to claim 13, characterized in that: The method further comprises: At a predetermined time before the time corresponding to the candidate extreme value, indication information is generated, and the indication information is displayed.
16. The control method of the medical imaging system according to claim 13, characterized in that: Based on a long short-term memory (LSTM) neural network, information reflecting the vital signs within the second time period is predicted.