Method for operating medical imaging system and medical imaging system

Abstract

The embodiment of the invention provides an operation method of a medical imaging system and the medical imaging system, and the system comprises a camera device which shoots a detected object to obtain a shot image containing the detected object; a display device that displays a graphical user interface including the captured image, and a first boundary instruction and a second boundary instruction that superimpose and display an exposure area on the captured image; the control device is used for determining the position indicated by the first boundary and the position indicated by the second boundary and determining the position of an anatomical part corresponding to the position indicated by the first boundary and the position indicated by the second boundary in the shot image, and when the position of the anatomical part changes in the shot image, the position of the anatomical part in the shot image changes. The position indicated by the first boundary and the position indicated by the second boundary change along with the position of the anatomical part.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of medical imaging technology, and in particular, to an operating method of a medical imaging system and a medical imaging system. Background Art

[0002] In a medical imaging system, X-rays emitted from an X-ray source are directed toward an object to be inspected, and after penetrating the object to be inspected, are received by a detector that is divided into a matrix of discrete elements (e.g., pixels). The detector elements are read to generate output signals based on the amount or intensity of radiation striking each pixel area, and the signals are processed to generate a medical image of the object to be inspected, which can be displayed on a display device of the medical imaging system. Summary of the invention

[0003] Embodiments of the present application provide an operating method of a medical imaging system and a medical imaging system.

[0004] According to one aspect of an embodiment of the present application, a medical imaging system is provided, the system comprising:

[0005] An imaging device, comprising an X-ray source and a detector, wherein the X-ray source and the detector can cooperate to obtain a medical image of a detected object;

[0006] A camera device, which photographs the detected object to obtain a photographed image containing the detected object;

[0007] a display device, which displays a graphical user interface including the captured image, and superimposes a first boundary indication and a second boundary indication of an exposure area on the captured image;

[0008] an input device that receives at least one of an input operation to adjust a position of the first boundary indication, an input operation to adjust a position of the second boundary indication, and an input operation to determine positions of the first boundary indication and the second boundary indication;

[0009] A control device that determines the position of the first boundary indication and the position of the second boundary indication based on the input operation received by the input device, and determines the position of the anatomical part corresponding to the position of the first boundary indication and the position of the second boundary indication in the captured image, wherein when the position of the anatomical part changes in the captured image, the position of the first boundary indication and the position of the second boundary indication follow the change of the position of the anatomical part.

[0010] According to one aspect of an embodiment of the present application, a medical imaging system is provided, comprising a display unit, the display unit comprising a graphical user interface, the graphical user interface comprising an area for displaying a captured image, and a first boundary indication and a second boundary indication for displaying an exposure area superimposed on the captured image, wherein when a position of an anatomical part corresponding to a position of the first boundary indication and a position of the second boundary indication changes in the captured image, the position of the first boundary indication and the position of the second boundary indication follow the change in the position of the anatomical part.

[0011] According to one aspect of an embodiment of the present application, a method for operating a medical imaging system is provided, the method comprising:

[0012] photographing the detected object to obtain a photographed image containing the detected object;

[0013] displaying a graphical user interface including the captured image, and superimposing a first boundary indication and a second boundary indication of an exposure area on the captured image;

[0014] receiving at least one of an input operation to adjust a position of the first boundary indication, an input operation to adjust a position of the second boundary indication, and an input operation to determine positions of the first boundary indication and the second boundary indication;

[0015] The position of the first boundary indication and the position of the second boundary indication are determined according to the received input operation, and the position of the anatomical part corresponding to the position of the first boundary indication and the position of the second boundary indication in the captured image is determined, wherein when the position of the anatomical part changes in the captured image, the position of the first boundary indication and the position of the second boundary indication follow the change of the position of the anatomical part.

[0016] With reference to the following description and accompanying drawings, the specific implementation of the embodiment of the present application is disclosed in detail, indicating the way in which the principle of the embodiment of the present application can be adopted. It should be understood that the implementation of the present application is not limited in scope. Within the scope of the spirit and clauses of the attached claims, the implementation of the present application includes many changes, modifications and equivalents. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The included drawings are used to provide a further understanding of the embodiments of the present application, which constitute a part of the specification, are used to illustrate the implementation methods of the present application, and together with the text description, explain the principles of the present application. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other implementation methods can be obtained based on these drawings without creative work. In the drawings:

[0018] Figure 1 is a schematic diagram of a medical imaging system according to an embodiment of the present application;

[0019] Figure 2 is a schematic diagram of a graphical user interface of an embodiment of the present application;

[0020] Figure 3 is a schematic diagram of a graphical user interface of an embodiment of the present application;

[0021] Figure 4 is a schematic diagram of a graphical user interface of an embodiment of the present application;

[0022] Figure 5 is a schematic diagram of a graphical user interface of an embodiment of the present application;

[0023] Figure 6 is a schematic diagram of a graphical user interface of an embodiment of the present application;

[0024] Figure 7 is a schematic diagram of a graphical user interface of an embodiment of the present application;

[0025] Figure 8 is a schematic diagram of a graphical user interface of an embodiment of the present application;

[0026] Fig. 9 is a schematic diagram of an operating method of a medical imaging system according to an embodiment of the present application;

[0027] Fig.10 is a schematic diagram of a graphical user interface of an embodiment of the present application;

[0028] Fig.11 It is a schematic diagram of a graphical user interface of an embodiment of the present application. DETAILED DESCRIPTION

[0029] With reference to the accompanying drawings, the foregoing and other features of the embodiments of the present application will become apparent through the following description. In the description and the accompanying drawings, specific embodiments of the present application are specifically disclosed, which show some embodiments in which the principles of the embodiments of the present application can be adopted. It should be understood that the present application is not limited to the described embodiments. On the contrary, the embodiments of the present application include all modifications, variations and equivalents that fall within the scope of the attached claims.

[0030] In the embodiments of the present application, the terms "first", "second", etc. are used to distinguish different elements from the title, but do not represent the spatial arrangement or time sequence of these elements, etc., and these elements should not be limited by these terms. The term "and / or" includes any one and all combinations of one or more of the terms listed in association. The terms "comprise", "include", "have", etc. refer to the existence of the stated features, elements, components or components, but do not exclude the existence or addition of one or more other features, elements, components or components. In the present application, the words "connect", "connected", "coupled", etc. and the like involved in the embodiments are not limited to physical or mechanical connections, but may include electrical connections, whether directly or indirectly.

[0031] In the embodiments of the present application, the singular forms "a", "the", etc. include plural forms and should be broadly understood as "a kind" or "a type" rather than being limited to the meaning of "one"; in addition, the term "said" should be understood to include both singular and plural forms, unless the context clearly indicates otherwise. In addition, the term "according to" should be understood as "at least in part according to...", and the term "based on" should be understood as "at least in part based on...", unless the context clearly indicates otherwise.

[0032] Features described and / or shown for one embodiment may be used in one or more other embodiments in the same or similar manner, combined with features in other embodiments, or replace features in other embodiments. The term "includes / comprising" when used herein refers to the presence of a feature, an entirety, a step, or a component, but does not exclude the presence or addition of one or more other features, entireties, steps, or components.

[0033] Figure 1 1 is a medical imaging system 100 according to an embodiment of the present application. Figure 1 As shown, the medical imaging system 100 includes a suspension device 110, a wall stand device 120, and a detection bed device 130 arranged in a scanning room 101, and a control device 150 arranged in a control room 102. The suspension device 110 includes a longitudinal guide rail 111, a transverse guide rail 112, a telescopic cylinder 113, a trolley 114, and a tube assembly 115.

[0034] Although some embodiments of the present application are described based on a suspended X-ray imaging system, the embodiments of the present application are not limited thereto.

[0035] For ease of description, in the present application, the x-axis, y-axis and z-axis are defined as the x-axis and y-axis are located in a horizontal plane and are perpendicular to each other, and the z-axis is perpendicular to the horizontal plane. Specifically, the direction of the longitudinal guide rail 111 is defined as the x-axis, the direction of the transverse guide rail 112 is defined as the y-axis direction, and the extension direction of the retractable cylinder 113 is defined as the z-axis direction, and the z-axis direction is the vertical direction.

[0036] The longitudinal guide rail 111 and the transverse guide rail 112 are vertically arranged, wherein the longitudinal guide rail 111 is installed on the ceiling, and the transverse guide rail 112 is installed on the longitudinal guide rail 111. The telescopic cylinder 113 is used to carry the ball tube assembly 115.

[0037] The pulley 114 is arranged between the transverse guide rail 112 and the telescopic cylinder 113. The pulley 114 may include a rotating shaft, a motor, a reel and other components. The motor can drive the reel to rotate around the rotating shaft, thereby driving the telescopic cylinder 113 to move along the z-axis and / or slide relative to the transverse guide rail. The pulley 114 can slide relative to the transverse guide rail 112, that is, the pulley 114 can drive the telescopic cylinder 113 and / or the ball tube assembly 115 to move along the y-axis direction. And the transverse guide rail 112 can slide relative to the longitudinal guide rail 111, thereby driving the telescopic cylinder 113 and / or the ball tube assembly 115 to move along the x-axis direction.

[0038] The telescopic cylinder 113 includes a plurality of cylinders with different inner diameters, and the plurality of cylinders can be sequentially sleeved in the cylinder located above them from bottom to top to achieve telescoping. The telescopic cylinder 113 can be telescopic (or movable) in the vertical direction, that is, the telescopic cylinder 113 can drive the ball tube assembly to move along the z-axis direction. The lower end of the telescopic cylinder 113 is also provided with a rotating part, which can drive the ball tube assembly 115 to rotate.

[0039] The tube assembly 115 includes an X-ray tube that can generate X-rays and project X-rays to a desired region of interest ROI of the patient. Specifically, the X-ray tube can be positioned adjacent to a beam limiter that is used to align the X-rays to the desired region of interest of the patient. At least a portion of the X-rays can be attenuated by the patient and can be incident on the detector 121 / 131.

[0040] The suspension device 110 further includes a beam limiter 117, which is usually installed below the X-ray tube. The X-rays emitted by the X-ray tube are irradiated onto the object to be inspected through the opening of the beam limiter 117. The size of the opening of the beam limiter 117 determines the irradiation range of the X-rays, that is, the size of the exposure field of view (FOV). The lateral position of the X-ray tube and the beam limiter 117 determines the position of the exposure field of view FOV on the object to be inspected. It is well known that X-rays are harmful to the human body, so it is necessary to control the X-rays so that they only irradiate the part of the object to be inspected that needs to be inspected, that is, the region of interest (ROI).

[0041] The suspension device 110 further includes a tube control device (console) 116, which is installed on the tube assembly. The tube control device 116 includes a user interface such as a display screen and control buttons for performing pre-shooting preparations, such as patient selection, protocol selection, and positioning.

[0042] The movement of the suspension device 110 includes the movement of the tube assembly along the x-axis, y-axis and z-axis, and the rotation of the tube assembly in the horizontal plane (the rotation axis is parallel to or coincident with the z-axis) and in the vertical plane (the rotation axis is parallel to the y-axis). In the above-mentioned movement, a motor is usually used to drive the corresponding component to rotate and thus achieve the corresponding movement or rotation, and the corresponding control component is generally installed in the pulley 114. The X-ray imaging unit further includes a motion control unit (not shown in the figure), which can control the above-mentioned movement of the suspension device 110. Further, the motion control unit can receive a control signal to control the corresponding component to perform a corresponding movement.

[0043] The column device 120 includes a first detector assembly 121, a column 122 and a connecting portion 123. The connecting portion 123 includes a support arm connected perpendicularly to the height direction of the column 122 and a rotating bracket installed on the support arm. The first detector assembly 121 is installed on the rotating bracket. The column device 120 further includes a detector driving device arranged between the rotating bracket and the first detector assembly 121. Under the drive of the detector driving device, the first detector assembly 121 moves along a direction parallel to the height direction of the column 122 on the plane supported by the rotating bracket. The first detector assembly 121 can also be further rotated relative to the support arm to form a certain angle with the column. The first detector assembly 121 has a plate-like structure, and its direction is variable so that the X-ray incident surface becomes vertical or horizontal according to the incident direction of the X-ray.

[0044] The detection bed device 130 includes a second detector assembly 131. The selection or use of the first detector assembly 121 and the second detector assembly 131 can be determined based on the patient's shooting part and / or shooting protocol, and can also be determined based on the position of the object to be detected obtained by camera shooting, so as to perform shooting inspections in the supine or standing position. Figure 1 Only an example diagram of the column and the detection bed is shown. Those skilled in the art should understand that columns and / or detection beds of any form or arrangement may be selected, or only columns may be installed. The columns and / or detection beds do not limit the entire scheme of the present application.

[0045] In some embodiments, the medical imaging system includes a camera 140 (e.g., a camera), which can be used to capture the detected object to obtain a captured image containing the detected object, such as a static optical image or a series of frame optical images in a dynamic real-time video stream, to assist in positioning and exposure settings, etc. The camera can be installed on a suspension device, such as on the side of the beam limiter 117, etc., and the embodiments of the present application are not limited to this. The camera 140 includes one or more cameras, such as a digital camera, an analog camera, etc., or a depth camera, an infrared camera, or an ultraviolet camera, etc., or a 3D camera, a 3D scanner, etc., or a red, green, and blue (RGB) sensor, an RGB depth (RGB-D) sensor, or other devices that can capture color image data of a target object.

[0046] In some embodiments, the control device 150 may include a source controller and a detector controller. The source controller is used to command the X-ray source to emit X-rays for image exposure. The detector controller is used to select a suitable detector from a plurality of detectors and coordinate the control of various detector functions, for example, automatically selecting a corresponding detector according to the position or posture of the object to be detected, or performing various signal processing and filtering functions, specifically, for initial adjustment of the dynamic range, interleaving of digital image data, etc. In some embodiments, the control device may provide power and timing signals for controlling the operation of the X-ray source and the detector.

[0047] In some embodiments, the control device may also be configured to use the digitized signals to reconstruct one or more desired images and / or determine useful diagnostic information corresponding to the patient, wherein the control device may include one or more dedicated processors, graphics processing units, digital signal processors, microcomputers, microcontrollers, application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or other appropriate processing devices.

[0048] Of course, the medical imaging system may also include other numbers or configurations or forms of control devices, for example, the control device may be local (e.g., co-located with one or more medical imaging systems 100, such as in the same facility and / or the same local network); in other implementations, the control device may be remote and therefore only accessible via a remote connection (e.g., via the Internet or other available remote access technology). In a specific implementation, the control device may also be configured in a cloud-like manner and may be accessed and / or used in a manner substantially similar to accessing and using other cloud-based systems.

[0049] The system 100 also includes a storage device (not shown), and the processor can store the digitized signal in the storage. For example, the storage can include a hard disk drive, a floppy disk drive, a CD-ROM read / write drive, a digital universal disk drive, a flash drive, and / or a solid-state memory. The storage can also be integrated with the processor to effectively use the floor space and / or meet the expected imaging requirements.

[0050] The system 100 also includes an input device 160, which may include a form of operator interface such as a keyboard, a mouse, a voice-activated control device, a touch screen (which may also serve as a display device described later), a trackball, or any other suitable input device. The operator may input operation signals / control signals to the control device through the input device.

[0051] The system 100 also includes a display device 151 (such as a touch screen or a display screen), which can be used to display an operation interface such as a list of detected objects, a position or exposure setting of the detected objects, and an image of the detected objects.

[0052] Usually, the size of the obtained medical image is generally equal to the size of the X-ray detector (exposure field of view). If the region of interest is within the size of the X-ray detector (exposure field of view), the entire region of interest can be fully presented in one image. If the region of interest exceeds the size of the X-ray detector (exposure field of view), the entire region of interest cannot be presented in one image, which requires dividing the region of interest into multiple regions, exposing and imaging each region separately, and stitching the multiple X-ray images together to obtain a complete medical image. In the following, the images obtained by X-ray imaging of each region are referred to as sub-medical images, and the completed medical image is also referred to as a combined image or a stitched image.

[0053] At present, a captured image obtained by photographing the detected object by a camera device can be displayed on a display device. The captured image is different from a medical image obtained by performing X-ray imaging. The captured image is used to assist in positioning or exposure setting. For example, assisting in positioning or exposure setting includes obtaining information about the detected object, obtaining a shooting protocol, determining information such as a shooting dose and posture, and positioning based on the shooting protocol, as well as setting the size and position of an exposure area. To this end, an embodiment of the present application proposes a method for quickly and conveniently setting the position of the exposure area, a graphical user interface, and a medical imaging system.

[0054] The following is a detailed description of the embodiments of the present application.

[0055] The present application embodiment proposes a medical imaging system, the system comprising: an imaging device, a camera device, a display device, an input device, and a control device. The imaging device comprises an X-ray source and a detector, the X-ray source and the detector can cooperate to obtain a medical image of a detected object; a camera device, which photographs the detected object to obtain a photographed image containing the detected object; and a display device, which displays a graphical user interface including the photographed image. For the implementation of the imaging device, the camera device, the display device, the input device, and the control device, reference can be made to the aforementioned Figure 1 The corresponding embodiments will not be described in detail, and the differences are described in detail below.

[0056] Figure 2 is a schematic diagram of a graphical user interface displayed by a display device according to an embodiment of the present application, such as Figure 2As shown, the graphical user interface 200 includes a first area 201 for displaying a captured image 20, and a first boundary indication 21 and a second boundary indication 22 for displaying an exposure area superimposed on the captured image 20. The captured image may be a still image or a frame of an image in a video stream acquired in real time. An operation area 23 may also be included outside the captured image of the first area 201, and some graphic objects for interaction may be included in the operation area, which will be described in detail later. The first boundary indication 21 and the second boundary indication 22 respectively indicate the positions of the two boundaries of the exposure area. For example, the first boundary indication 21 is closer to the head of the detected object relative to the second boundary indication 22, or the second boundary indication 22 is closer to the feet of the detected object relative to the first boundary indication, that is, the first boundary indication 21 is used to indicate the upper boundary of the exposure area, and the second boundary indication 22 is used to indicate the lower boundary of the exposure area. The first boundary indication 21 and the second boundary indication 22 can be displayed as line segments parallel to the width direction W of the captured image (the width direction of the detected object), and the line segments can be solid lines or dotted lines, etc. The length of the line segments can be equal to the width W1 of the captured image, or longer than the width W1 of the captured image (for example, a portion of the boundary indication line segments are also displayed on the operation area 23), or shorter than the width W1 of the captured image. The embodiments of the present application are not limited to this.

[0057] The above is only an example. For example, the first boundary indication 21 may be closer to the feet of the detected object, and the second boundary indication 22 may be closer to the head of the detected object. Figure 2 The head of the detected object in the captured image is displayed in the upper direction, but Figure 2 The captured image 20 in the image may also be displayed in a direction rotated (clockwise or counterclockwise) by 90°. In addition, the first boundary indicator 21 and the second boundary indicator 22 may also be displayed in a direction rotated (clockwise or counterclockwise) by 90° to limit the left boundary and the right boundary of the exposure area, etc. The embodiment of the present application is not limited to this, and no examples are given here. Figure 2 The relative positions of the first boundary indication 21 and the second boundary indication 22 are illustrated by way of example.

[0058] In some embodiments, after the camera device obtains the captured image, the display device displays the captured image 20, and superimposes and displays the first boundary indicator 21 and the second boundary indicator 22 on the captured image. For example, during the initial display, the control device may determine the initial positions of the first boundary indicator 21 and the second boundary indicator 22 according to the center position of the captured image or the part to be imaged. For example, the control device uses an image recognition algorithm to identify the center position of the captured image, and moves the line segment passing through the center position (parallel to the width direction W of the captured image) upward by a distance of L1 as the initial display position of the first boundary indicator 21, and moves the line segment passing through the center position (parallel to the width direction W of the captured image) downward by a distance of L2 as the initial display position of the second boundary indicator 22. L1 and L2 may be predefined or determined according to the part to be imaged. Alternatively, the control device may determine the initial positions of the first boundary indication 21 and the second boundary indication 22 according to the part to be imaged. For example, when the part to be imaged is the spine, the captured image roughly includes the upper body or the whole body of the detected object. The control device uses an image recognition algorithm or an artificial intelligence algorithm (for example, using a deep learning network) (with the captured object as the recognition object) to identify the position of the human ear, and uses a line segment passing through the position of the human ear (parallel to the width direction W of the captured image) as the initial display position of the first boundary indication 21, and identifies the position of the human coccyx, and uses a line segment passing through the position of the coccyx (parallel to the width direction W of the captured image) as the initial display position of the first boundary indication 21. The initial display position of the second boundary indication 22; when the part to be imaged is the leg bone, the captured image roughly includes the lower body or the whole body of the detected object, and the control device uses an image recognition algorithm or an artificial intelligence algorithm (for example, using a deep learning network) (the captured object is used as the recognition object) to identify the position of the human pelvis, and uses the line segment passing through the pelvic position (parallel to the width direction W of the captured image) as the initial display position of the first boundary indication 21, identifies the position of the human ankle, and uses the line segment passing through the ankle position (parallel to the width direction W of the captured image) as the initial display position of the second boundary indication 22, and the embodiments of the present application are not limited to this. For the specific implementation of the image recognition algorithm or the artificial intelligence algorithm, reference can be made to the relevant technology, and the embodiments of the present application are not limited to this.

[0059] In the above, the control device uses an algorithm to automatically generate the initial positions of the first boundary indication 21 and the second boundary indication 22 as an example, but the present application is not limited to this. For example, the initial positions of the first boundary indication 21 and the second boundary indication 22 can also be initialized according to the initialization input operation received by the input device, that is, after displaying the captured image, the graphical user interface prompts the operator to perform the initialization input operation of the boundary indication position, and the initialization input operation includes a mouse click, a touch screen click, etc. The click position can be on the captured image 20, or on the operation area 23, and the line segment passing through the click position (parallel to the width direction W of the captured image) is used as the initial position of the boundary indication. In this way, the operator can customize the initial position of the first boundary indication 21 or the second boundary indication 22. In this example, the operator can initialize the initial position of the first boundary indication 21 and the second boundary indication 22, or the operator can only initialize the initial position of one of the first boundary indication 21 and the second boundary indication 22, and the other boundary indication position can be automatically generated according to the position of the customized boundary indication. For example, the distance between the first boundary indication 21 and the second boundary indication 22 is predefined as LD, and the control device can move up or down the position LD according to the customized boundary indication position as another boundary position.

[0060] In some embodiments, the control device may use the initial positions of the first boundary indicator and the second boundary indicator as the final positions to determine the size of the exposure area, that is, there is no need to adjust the positions of the first boundary indicator and the second boundary indicator (for example, the input device receives an input operation to determine (lock) the positions of the first boundary indicator and the second boundary indicator, and the control device locks the positions of the first boundary indicator and the second boundary indicator, indicating that the positions of the first boundary indicator and the second boundary indicator cannot be adjusted, and the input operation will be described later); in some embodiments, when the detected object moves or the visible range of the camera device changes, or when the operator determines that the currently displayed exposure area is inaccurate or imprecise, the operator may adjust the positions of the first boundary indicator 21 and the second boundary indicator 22 superimposed on the captured image, and the display device may update the positions of the adjusted first boundary indicator 21 and the second boundary indicator 22 in real time on the captured image along with the adjustment. The input device may receive at least one of an input operation to adjust the position of the first boundary indicator and an input operation to adjust the position of the second boundary indicator. The control device can determine the size of the exposure area based on the adjusted position of the first boundary indication and the position of the second boundary indication as the final position (for example, the input device receives an input operation to determine (lock) the position of the first boundary indication and the second boundary indication, and the control device locks the position of the first boundary indication and the position of the second boundary indication, indicating that the position of the first boundary indication and the position of the second boundary indication can no longer be adjusted).

[0061] In some embodiments, after the control device determines (locks) the position of the first boundary indicator and the position of the second boundary indicator, there may be a certain time interval before exposure. During this time interval, the detected object may move, resulting in changes in the exposure area determined by the first boundary indicator and the second boundary indicator. Therefore, in the embodiment of the present application, the control device determines the position of the anatomical part corresponding to the position of the first boundary indicator and the position of the second boundary indicator in the captured image. When the position of the anatomical part changes in the captured image, the position of the first boundary indicator and the position of the second boundary indicator follow the position of the anatomical part, thereby avoiding errors caused by the movement of the detected object.

[0062] In some embodiments, the control device can determine the position of the anatomical part corresponding to the position indicated by the first boundary and the position indicated by the second boundary, for example, determine and record the position of the anatomical part (ear bone) corresponding to the position indicated by the first boundary, and determine the position of the anatomical part (coccyx) corresponding to the position indicated by the second boundary, and the above positions can be coordinate positions (such as pixel coordinate positions) in the captured image, and the position of the first boundary indication and the position of the second boundary indication follow the position changes of the anatomical part, including: the position of the first boundary indication and the position of the second boundary indication are fixed relative to the position of the anatomical part.

[0063] Fig.11 is a schematic diagram of a graphical user interface after the detected object moves in an embodiment of the present application, such as Fig.11 As shown, the detected object may move forward (toward the direction of the camera device), the captured image displayed by the display device will be updated, and the positions of the first boundary indicator and the second boundary indicator superimposed on the captured image will also be updated. Among them, the detected object in the captured image is enlarged, and the position of the ear bone moves upward and the coccyx moves downward in the captured image. Then, the position of the first boundary indicator also moves upward with the position of the ear bone, and is always located at the position of the ear bone, that is, its position relative to the ear bone is fixed, and the position of the second boundary indicator also moves downward with the position of the coccyx, and is always located at the position of the coccyx, that is, its position relative to the coccyx is fixed.

[0064] In the above example, the position of the detected object (the anatomical part) in the captured image changes due to the movement of the detected object, but the embodiments of the present application are not limited to this. For example, after the visible range of the camera device is adjusted, the position of the detected object (the anatomical part) in the captured image will also change. When the input device receives an input operation for adjusting the visible range of the camera device, similarly, the position of the first boundary indicator and the position of the second boundary indicator follow the position change of the anatomical part, and the position of the first boundary indicator and the position of the second boundary indicator are fixed relative to the position of the anatomical part in the captured image. That is, when the visible range of the camera device is adjusted, the captured image displayed by the display device will be updated, and the positions of the first boundary indicator and the second boundary indicator superimposed on the captured image will also be updated. That is, due to the adjustment of the visible range of the camera device, the position of the anatomical part (for example, ear bone, coccyx) in the captured image will change, and the relative positions of the first boundary indicator and the second boundary indicator in the captured image will change, but they are fixed relative to the anatomical part of the detected object. Figure 3 is a schematic diagram of the operation interface after the visual range of the camera device according to the embodiment of the present application is adjusted, such as Figure 3 As shown, Figure 2In comparison, after the visual range of the camera device is adjusted, the anatomical parts of the detected object in the captured image move upward as a whole. Therefore, the first boundary indication moves upward following the position of the ear bone, and the first boundary indication is always located at the position of the ear bone of the detected object in the captured image. The first boundary indication is fixed relative to the position of the ear bone, and the second boundary indication moves upward following the coccyx, and the second boundary indication is always located at the position of the coccyx in the captured image. The second boundary indication is fixed relative to the position of the coccyx.

[0065] The implementation method of adjusting the visible range of the camera device will be described later.

[0066] How to adjust the position of the first boundary indicator and the position of the second boundary indicator is described below.

[0067] In some embodiments, when the input device receives an input operation for adjusting the position of the first boundary indication, the control device controls the position of the second boundary indication to change with the change of the position of the first boundary indication, so that the distance between the first boundary indication and the second boundary indication remains unchanged. In this way, the position of the exposure area can be adjusted quickly and conveniently. This is described in detail below.

[0068] In some embodiments, the input operation (first input operation) for adjusting the first boundary indication includes triggering the first boundary indication through an input device, or triggering a first mark associated with the first boundary indication, the first mark includes a virtual key or other graphic object, and the first mark can be located on the first boundary indication, or on the operation area 23 corresponding to the position of the first boundary indication. The first input operation for triggering includes clicking the corresponding indication or mark by moving the cursor, or touching or operating (such as dragging, etc.) the indication or mark. For example, after clicking the first boundary indication, drag the first boundary indication to the adjusted position, or after clicking the first boundary indication, click the adjusted position again, so that the first boundary indication superimposed on the captured image changes to the adjusted position with the input operation. Or, as Figure 2As shown, the graphical user interface includes a first mark 24 at a position corresponding to the first boundary indication position on the operation area 23, and the first mark 24 includes an upward mark 241 and a downward mark 242 (after the captured image is rotated 90°, the upper and lower can be replaced by left and right or right left respectively). By clicking the upward mark 241, the first boundary indication is moved up a predetermined distance L3, and by clicking the downward mark 242, the second boundary indication is moved down a predetermined distance L3. The predetermined distance L3 can be determined as needed. For example, when making a coarse adjustment, the L3 can be set to a first value, and when making a fine adjustment, the L3 can be set to a second value, and the first value is greater than or equal to the second value. The above is only an example. In addition, the above click includes a touch screen click or a mouse click (long press or short press), etc., and the embodiment of the present application is not limited to this. Therefore, the position of the first boundary indication can be quickly adjusted by triggering the first mark in the operation area.

[0069] In some embodiments, when the position of the first boundary indicator changes, the control device controls the position of the second boundary indicator to change with the change of the position of the first boundary indicator, so that the distance between the first boundary indicator and the second boundary indicator remains unchanged. That is, the position of the second boundary indicator moves with the position of the first boundary indicator. When the first boundary indicator moves up, the second boundary indicator also moves up, and when the first boundary indicator moves down, the second boundary indicator also moves down, and the distance LD between the first boundary indicator and the second boundary indicator remains fixed, that is, when the first boundary indicator moves up by a distance L4, the second boundary indicator also moves up by the same distance L4, and when the first boundary indicator moves down by a distance L4, the second boundary indicator also moves down by the same distance L4. The distance LD can be predefined, and the distance LD is related to the age, body shape, and imaged part of the detected object, and the embodiment of the present application is not limited thereto. By controlling the position of the second boundary indicator to change with the change of the position of the first boundary indicator, so that the distance between the first boundary indicator and the second boundary indicator remains unchanged, the adjustment steps are simplified, and the position of the exposure area is adjusted quickly and conveniently.

[0070] In some embodiments, the input operation for adjusting the second boundary indication (second input operation) includes triggering the second boundary indication through an input device, or triggering a second mark associated with the second boundary indication, the second mark including a virtual key or other graphic object, and the second mark may be located on the second boundary indication, or located on an operation area 23 corresponding to the position of the second boundary indication. The second input operation for triggering includes clicking on the corresponding indication or mark by moving the cursor, or touching or operating (such as dragging, etc.) the indication or mark. For example, after clicking on the second boundary indication, drag the second boundary indication to the adjusted position, or after clicking on the second boundary indication, click on the adjusted position again, so that the second boundary indication superimposed on the captured image changes to the adjusted position with the input operation. Or, as Figure 2 As shown, the graphical user interface includes a second mark 25 at a position corresponding to the second boundary indication position on the operation area 23. The implementation of the second mark 25 is similar to the implementation of the first mark 24, and will not be repeated here. By clicking the upward mark 251, the second boundary indication is moved up a predetermined distance L5, and by clicking the downward mark 252, the second boundary indication is moved down a predetermined distance L5. The predetermined distance L5 can be determined as needed, for example, equal to L3. In addition, the above clicks include touch screen clicks or mouse clicks (long press or short press), etc., and the embodiments of the present application are not limited to this. Thus, the position of the second boundary indication can be quickly adjusted by triggering the second mark in the operation area. In addition, when adjusting the position of the second boundary indication, the position of the first boundary indication remains unchanged, so that the adjustment of the position of the boundary indication is more flexible and the time for repeated adjustments is reduced.

[0071] In some embodiments, when the first input operation and the second input operation adjust the position of the boundary indicator, the adjustment needs to be made within the range of the captured image. When the position of the second boundary indicator is adjusted to exceed the lower edge of the captured image, the control device limits the position of the second boundary indicator to be adjusted downward; when the position of the first boundary indicator is adjusted to exceed the upper edge of the captured image, the control device limits the position of the first boundary indicator to be adjusted upward. For example, when the position of the first boundary indicator is adjusted to be higher than the upper edge of the captured image, if the upward mark is continued to be clicked or the first boundary indicator is dragged upward, the position of the first boundary indicator remains unchanged at the upper edge. When the position of the second boundary indicator is adjusted to be lower than the lower edge of the captured image, if the downward mark is continued to be clicked or the second boundary indicator is dragged downward, the position of the second boundary indicator remains unchanged at the lower edge.

[0072] In addition, when the position of the second boundary indicator changes to exceed the lower edge of the captured image as the position of the first boundary indicator changes, the control device controls the position of the second boundary indicator to remain unchanged at the lower edge. That is, assuming that the distance between the second boundary indicator and the lower edge of the captured image is L6, when the distance of the first boundary indicator moving downward exceeds L6, the second boundary indicator moves downward by a distance of L6, that is, moves to a position where it coincides with the lower edge. If the position of the first boundary indicator continues to be adjusted downward, the second boundary indicator remains unchanged at the position where it coincides with the lower edge. At this time, if the position of the first boundary indicator is adjusted upward, the position of the second boundary indicator follows the upward movement of the first boundary indicator by the same distance.

[0073] In some embodiments, in addition to the position of the boundary indication limited by the edge of the captured image, the movable boundary of the detector can also limit the position of the boundary indication. This is because the detector may not necessarily cover the entire area of ​​the captured image, and the medical image cannot be obtained in the position that the detector does not cover. Therefore, the exposure area needs to be within the movable boundary range of the detector, or the movable boundary range of the detector needs to be able to cover the exposure area. Therefore, when the position of the second boundary indication is adjusted to exceed the movable lower boundary of the detector, the control device limits the position of the second boundary indication to be adjusted downward; when the position of the first boundary indication is adjusted to exceed the movable upper boundary of the detector, the control device limits the position of the first boundary indication to be adjusted upward.

[0074] For example, when the position of the first boundary indicator is adjusted to be higher than the upper boundary of the movable detector, if the upward movement mark is continuously clicked or the first boundary indicator is dragged upward, the position of the first boundary indicator remains unchanged at the upper boundary. When the position of the second boundary indicator is adjusted to be lower than the lower boundary of the movable detector, if the downward movement mark is continuously clicked or the second boundary indicator is dragged downward, the position of the second boundary indicator remains unchanged at the lower boundary.

[0075] It should be noted that the detector can be the aforementioned first detector component, and the movable boundaries of the first detector component include an upper boundary and a lower boundary, but the embodiment of the present application is not limited to this. The detector can also be the aforementioned second detector component, and the movable boundaries of the second detector component include a left boundary and a right boundary. Its implementation method is similar to that of the upper boundary and the lower boundary, and will not be repeated here.

[0076] In some embodiments, in order to reduce unnecessary repeated adjustment time, the display device may also superimpose and display at least one of the upper and lower boundaries of the detector on the captured image. Thus, when the operator adjusts the position of the first boundary indicator or the second boundary indicator, the operator may refer to the position of the displayed upper or lower boundary to avoid the position of the first boundary indicator or the second boundary indicator exceeding the upper or lower boundary of the detector. Figure 2 As shown, the upper boundary 261 and the lower boundary 262 of the detector that can be moved are superimposed on the captured image, and the upper boundary 261 and the lower boundary 262 are displayed as line segments parallel to the width direction W of the captured image (the width direction of the detected object). The display mode of the line segment is different from the display mode of the line segment of the first boundary indication and the second boundary indication, for example, the line segment colors are different, or the upper and lower boundaries are solid line segments, and the first boundary indication and the second boundary indication are dotted line segments, etc. The embodiment of the present application is not limited to this. When the position of the first boundary indication is adjusted to be higher than the upper boundary 261, if the upward mark is continued to be clicked or the first boundary indication is dragged upward, the position of the first boundary indication remains unchanged at the upper boundary 261. When the position of the second boundary indication is adjusted to be lower than the lower boundary 262, if the downward mark is continued to be clicked or the second boundary indication is dragged downward, the position of the second boundary indication remains unchanged at the lower boundary 262.

[0077] In some embodiments, when the captured image within the current visible range does not fully display the exposure area, or when the position of the exposure area needs to be significantly adjusted, the visible range of the camera device can be adjusted first, and the captured image can be reacquired, and the positions of the first boundary indication and the second boundary indication are determined on the reacquired captured image to determine the exposure area. The input device is also used to receive an input operation (a third input operation) for adjusting the visible range of the camera device, and the display device updates and displays the captured image according to the input operation for adjusting the visible range of the camera device.

[0078] In some embodiments, the third input operation includes triggering a camera field of view adjustment mark, the camera field of view adjustment mark includes a virtual key or other graphic object, and the camera field of view adjustment mark can be located on the captured image, or on the operation area 23. The third input operation for triggering includes clicking a corresponding mark by moving a cursor, or touching or operating (such as dragging, etc.) the mark.

[0079] For example, Figure 2As shown, the operation area 23 of the graphical user interface includes an operation bar 27 and a camera field of view adjustment mark 28 superimposed and displayed on the operation bar. The visual range of the camera (or the vertical movement of the suspension device) is adjusted by adjusting (e.g., dragging or sliding) the position of the camera field of view adjustment mark in the operation bar. By dragging the camera field of view adjustment mark 28 toward one end A of the operation bar 27, the visual range of the camera is adjusted upward (to shoot a position closer to the head of the detected object), and by dragging the camera field of view adjustment mark 28 toward one end B of the operation bar 27, the visual range of the camera is adjusted downward (to shoot a position closer to the feet of the detected object).

[0080] For example, the implementation method of the field of view adjustment mark of the camera device can refer to the virtual button of the first mark. By clicking the upward (or replacing it with the left / right) move mark, the visual range of the camera device can be adjusted upward (to shoot the position of the detected object closer to the head). By clicking the downward (or replacing it with the right / left) move mark, the visual range of the camera device can be adjusted downward (to shoot the position of the detected object closer to the feet).

[0081] In some embodiments, when the input device receives an input operation to adjust the visible range of the camera device, the position of the first boundary indication and the position of the second boundary indication follow the position of the anatomical part, and the position of the first boundary indication and the position of the second boundary indication are fixed relative to the position of the anatomical part in the captured image. The specific implementation method is as described above and will not be repeated here.

[0082] In some embodiments, the adjustment of the visible range of the camera device may also limit the position of the boundary indication, that is, in some cases, when the adjustment of the visible range of the camera device causes the position of the boundary indication to exceed the movable boundary of the detector or the edge of the visible range, the position of the boundary indication will be limited by the movable boundary of the detector or the edge position of the visible range, and thus will change relative to the anatomical position in the captured image. Wherein, when the visible range of the camera device is adjusted so that the position of the first boundary indication exceeds the movable upper boundary of the detector, the control device limits the position of the first boundary indication to remain at the movable upper boundary of the detector; or, when the visible range of the camera device is adjusted so that the position of the first boundary indication exceeds the upper edge of the visible range, the control device limits the position of the first boundary indication to remain at the upper edge of the visible range. When the visual range of the camera device is adjusted so that the position indicated by the second boundary exceeds the lower movable boundary of the detector, the control device limits the position indicated by the second boundary to remain at the lower movable boundary of the detector; or, when the visual range of the camera device is adjusted so that the position indicated by the second boundary exceeds the lower edge of the visual range, the control device limits the position indicated by the second boundary to remain at the lower edge of the visual range.

[0083] For example, before the visible range of the camera device is adjusted, the first boundary indication is located at the position of the ear bone of the detected object in the captured image. After the visible range of the camera device is adjusted, the position of the ear bone of the detected object in the captured image moves upward. If the first boundary indication moves upward with the position of the ear bone, it will exceed the upper movable boundary of the aforementioned detector. In this case, the position of the first boundary indication will remain at the upper movable boundary of the detector and will no longer move upward with the ear bone. Alternatively, if the first boundary indication moves upward with the position of the ear bone, it will exceed the upper edge of the visible range (that is, the ear bone is no longer included in the visible range or the captured image). In this case, the position of the first boundary indication will remain at the upper edge of the visible range.

[0084] For example, before the visible range of the camera device is adjusted, the second boundary indication is located at the position of the ankle bone of the object to be detected in the captured image. After the visible range of the camera device is adjusted, the position of the ankle bone of the object to be detected in the captured image moves downward. If the second boundary indication moves downward with the ankle bone position, it will exceed the movable lower boundary of the aforementioned detector. In this case, the second boundary indication will remain at the movable lower boundary of the detector and will no longer move downward with the ankle bone. Alternatively, if the second boundary indication moves downward with the ankle bone position, it will exceed the lower edge of the visible range (that is, the ankle bone is no longer included in the visible range or the captured image), in this case, the second boundary indication will remain at the lower edge of the visible range.

[0085] In some embodiments, Figure 2 As shown, the graphical user interface may also include an indication position reset mark 29. When the input device receives an input operation (fourth input operation) that triggers the indication position reset mark, the control device resets the positions of the first boundary indication and the second boundary indication back to the initial positions. For example, the indication position reset mark 29 includes a virtual key or other graphic object, and the indication position reset mark 29 may be located on the captured image, or on the operation area 23. The input operation for triggering (fourth input operation) includes clicking on the corresponding mark by moving the cursor, or touching or operating the mark. When the indication position reset mark 29 is triggered, the positions of the first boundary indication and the second boundary indication will return to the aforementioned initialized positions, thereby making the adjustment of the position of the boundary indication more flexible.

[0086] In some embodiments, Figure 2 As shown, the graphical user interface also includes an indication position confirmation mark 30. When the input device receives an input operation (fifth input operation) that triggers the indication position confirmation mark, the control device locks the positions of the first boundary indication and the second boundary indication. After the control device locks the positions of the first boundary indication and the second boundary indication, the position of the anatomical part corresponding to the position of the first boundary indication and the position of the second boundary indication in the captured image is determined. When the position of the anatomical part changes in the captured image, the position of the first boundary indication and the position of the second boundary indication follow the position change of the anatomical part. The specific implementation is as described above and will not be repeated here. For example, the indication position confirmation mark 30 includes a virtual button or other graphic object. The indication position confirmation mark 30 can be located on the captured image or on the operation area 23. The input operation for triggering (fifth input operation) includes clicking the corresponding mark by moving the cursor, or touching or operating the mark. When the indication position confirmation mark 30 is triggered, the positions of the first boundary indication and the second boundary indication will be locked and can no longer be adjusted. At this time, the control device can determine the size of the exposure area based on the positions of the locked first boundary indication and the second boundary indication. For example, the distance between the first boundary indication and the second boundary indication is the length of the exposure area, and the length of the exposure area can be used to determine the number of sub-medical images, which will be described in detail later.

[0087] In the above example, the first boundary indication 21 and the second boundary indication 22 are displayed as line segments, but the embodiment of the present application is not limited to this. For example, the position of the first boundary indication and the second boundary indication that overlaps with the corresponding anatomical part is displayed as the outline of the anatomical part, and the position of the outline is related to the thickness information of the detected object, as illustrated in the following example.

[0088] In some embodiments, a 3D point cloud map or a depth image of the detected object can be obtained according to the camera device, and thickness information of the detected object can be obtained according to the 3D point cloud map or the depth image. The thickness information represents the distance of the detected object from the front (first surface) to the back (detector surface, also called the second surface). The thickness information corresponding to different anatomical parts of the detected object may be different. Since the distance between the ray source and the first surface, the distance between the ray source and the second surface, and the distance between the first surface and the second surface are all known quantities, according to the principle of mathematical similar triangles combined with the thickness information, multiple second positions after the first position (of a certain anatomical part) on the first surface is mapped to the second surface can be calculated. According to the multiple second positions combined with the corresponding thickness information, multiple third positions mapped back to the first surface are obtained by calculation. The multiple third positions can reflect the contour (or real-time boundary) information of the anatomical part.

[0089] Fig.10 is a schematic diagram of a graphical user interface of an embodiment of the present application, such as Figure 2 As shown, when the first boundary indication and the second boundary indication are line segments, the first boundary indication passes through the center of the eyebrows (first position), and the second boundary indication passes through the coccyx (first position). According to the above method, the center of the eyebrows is mapped to multiple second positions of the second surface, and the multiple second positions are mapped back to multiple third positions of the first surface. The curve obtained by connecting the multiple third positions is replaced by the curve. Figure 2 The first boundary indicates a portion of the line segment that overlaps with the corresponding anatomical part, and obtains Fig.10 The first boundary indication in Fig.10 As shown, the position overlapping the head on the first boundary indication is displayed as the outline of the head, reflecting the thickness information of the head; according to the above method, the coccyx and carpal positions are calculated to be mapped to multiple second positions of the second surface, and the multiple second positions are calculated to be mapped back to multiple third positions of the first surface, and the curve obtained by connecting the multiple third positions is replaced by the curve Figure 2 The second boundary indicates the part of the line segment that overlaps with the hip and arm, and we get Fig.10 The second boundary indication in Fig.10 As shown, the position overlapping with the buttocks and the arm on the second boundary indication is displayed as the outline of the buttocks and the arm, respectively reflecting the thickness information of the buttocks and the arm. The above first position can be determined as needed, for example, it can be Figure 2 The first boundary indication and the second boundary indication are central positions of positions overlapping the corresponding anatomical parts.

[0090] Since the captured image is a 2D plane, the positions overlapping the corresponding anatomical parts on the first boundary indication and the second boundary indication are displayed as the outline of the anatomical part. This makes the display of the exposure area more three-dimensional and allows the operator to more intuitively view the thickness information of the anatomical part at the boundary position of the exposure area.

[0091] In some embodiments, the positions on the aforementioned upper edge, lower edge, upper boundary, and lower boundary that overlap with the corresponding anatomical part can also be displayed as the outline of the corresponding anatomical part. The implementation method is similar to the first boundary indication and the second boundary indication and will not be repeated here.

[0092] It should be noted that the graphical user interface in the embodiment of the present application may include one or more of the above indication position reset mark 29, indication position confirmation mark 30, camera field of view adjustment mark 28, movable upper boundary 261 and lower boundary 262 of the detector, first mark 24, second mark 25, and operation area 23, or may not include the above marks and boundaries, and the embodiment of the present application is not limited thereto. In addition, the above marks may also be located in the second area 202 of the graphical user interface described later, which will be described in detail later.

[0093] In some embodiments, the control device can determine the size of the exposure area according to the position of the first boundary indication and the position of the second boundary indication that are finally determined, and determine the first number of sub-medical images according to the size of the exposure area and the size of the detector, and the medical image is stitched together by the first number of sub-medical images; for example, the height direction of the detector is H, the length of the exposure area is LD, and the first number N is an integer greater than or equal to LD / H, or when determining the first number, it is also necessary to consider the distance from the detector to the region of interest, the distance from the focus to the detector, and the size of the overlapping portion of two adjacent sub-medical images when stitching sub-medical images. For details, please refer to the relevant technology, and the embodiments of the present application are not limited to this. Figure 2 As shown, after determining the first number of sub-medical images, the image number of each sub-medical image can also be displayed in the operation area 23 of the first area 201. For example, when the first number is 5, 5 sub-medical images need to be exposed, and the final medical image is obtained by splicing the 5 sub-medical images. The image numbers ①, ②, ③, ④, and ⑤ of the 5 sub-medical images can be displayed in the operation area 23 respectively. Therefore, the operator can intuitively and conveniently determine the approximate position of each sub-medical image corresponding to the captured image.

[0094] In some embodiments, Figure 4 is a schematic diagram of a graphical user interface of an embodiment of the present application, such as Figure 4As shown, in order to facilitate the adjustment of imaging parameters of the first number of sub-medical images, after the first number of sub-medical images are determined, the graphical user interface may also include a second area 202, in which the exposure parameters of each sub-medical image (#1, #2, #3, #4) in the first number (4) of sub-medical images may be simultaneously displayed, and the exposure parameters include at least one of tube voltage (KV), tube current (mA), exposure time (mAs), and automatic exposure control ionization chamber (AEC ion-chamber). The operator may adjust each exposure parameter in the second area 202, and the details may refer to the relevant technology, and the embodiments of the present application are not limited thereto.

[0095] In some embodiments, for the automatic exposure control ionization chamber in the exposure parameters, its switch state can also be set in the first area 201, which is described in detail below.

[0096] In some embodiments, the medical imaging system may include a plurality of (Z) automatic exposure control ionization chambers (for example, arranged in the detector), the plurality of automatic exposure control ionization chambers may be distributed at different positions of the detector, the X-ray tube may generate X-rays, the automatic exposure control ionization chamber may detect the amount of X-rays received after passing through the detected object, if the amount of X-rays exceeds a predetermined amount, the automatic exposure control ionization chamber may send a notification signal to the control device, the control device may stop the irradiation of X-rays, thereby adjusting the amount of X-rays emitted via the automatic exposure control ionization chamber. Before exposure, the operator may select the automatic exposure control ionization chamber at a position corresponding to the position of the region of interest for automatic exposure control.

[0097] In some embodiments, the input device can receive an input operation for selecting a sub-medical image, for example, by clicking on the column where the sub-medical image is located on the second area 202, or clicking on the image number of the sub-medical image on the operation area 23, to select one or more sub-medical images. After selection, the column where the sub-medical image is located on the second area 202 can be highlighted. After the sub-medical image is selected, the marks of the Z automatic exposure control ionization chambers are superimposed and displayed at the position corresponding to the sub-medical image in the captured image. The superimposed displayed position does not represent its real position, but only represents the relative position of the Z automatic exposure control ionization chambers. Among them, a rectangular frame can be used as a mark of an automatic exposure control ionization chamber, or different graphic objects can be used as marks of different automatic exposure control ionization chambers, and the embodiments of the present application are not limited to this. Figure 5 and Figure 6 is a schematic diagram of a graphical user interface of an embodiment of the present application. Taking Z=3 as an example, three automatic exposure control ionization chambers are represented by three rectangular frames, which are schematically superimposed and displayed on the captured image. Figure 5As shown, only the first sub-medical image is selected (the column corresponding to the sub-medical image in the second area 202 can be highlighted), so three automatic exposure control ionization chamber marks (three rectangular frames) are superimposed and displayed at the position corresponding to the first sub-medical image in the captured image, as shown in FIG. Figure 6 As shown, three sub-medical images are selected (the columns corresponding to the three sub-medical images on the second area 202 can be highlighted), so three automatic exposure control ionization chamber marks (3 rectangular boxes) are superimposed and displayed at the position corresponding to each sub-medical image in the captured image. Figure 7 and Figure 8 is a schematic diagram of a graphical user interface of an embodiment of the present application, and Figure 5 and Figure 6 The difference is that the automatic exposure control ionization chambers are marked with different letters. Taking Z=3 as an example, the three automatic exposure control ionization chambers are marked with R, M, and L respectively.

[0098] In some embodiments, the display device also needs to superimpose and display the switch states of Z automatic exposure control ionization chambers corresponding to the selected one or more sub-medical images on the captured image, wherein the on state or off state can be distinguished by the change in the style of the mark of the aforementioned automatic exposure control ionization chamber. The switch state does not indicate the current switch state of the automatic exposure control ionization chamber, but indicates the switch state of the automatic exposure control ionization chamber after the exposure operation starts. The on state indicates that the corresponding automatic exposure control ionization chamber is selected and used for automatic exposure control after the exposure operation starts, and the off state indicates that the corresponding automatic exposure control ionization chamber is not selected and is not used for automatic exposure control after the exposure operation starts. Figure 5 and Figure 6 As shown, rectangles of different filling colors can be used to distinguish between the open state and the closed state. For example, a white rectangle is used to represent the closed state (not selected), and a dark rectangle is used to represent the open state (selected). The reverse is also possible. The embodiment of the present application is not limited to this. Rectangles of different sizes can also be used to distinguish between the open state and the closed state. For example, a small rectangle is used to represent the closed state (not selected), and a large rectangle is used to represent the open state (selected). Figure 7 and Figure 8 As shown, letters of different colors can be used to distinguish the on state or the off state, for example, gray letters are used to represent the off state (not selected), black letters are used to represent the on state (selected), etc., and examples are not given one by one here.

[0099] In some embodiments, when the marks of multiple automatic exposure control ionization chambers are initially superimposed and displayed, they can be defaulted to the closed state, or one of them can be defaulted to the open state and the others to the closed state. The embodiments of the present application are not limited to this.

[0100] In some embodiments, the input device may receive an input operation (sixth input operation) for setting the switch state of the multiple automatic exposure control ionization chambers, and the sixth input operation includes triggering (by moving the cursor to click or touch) a mark of one of the marks of the Z automatic exposure control ionization chambers displayed in a superimposed manner. After receiving the input operation, the control device selects the automatic exposure control ionization chamber in the turned-on state to control the exposure time according to the received input operation for setting the switch state of the multiple automatic exposure control ionization chambers. For example, after receiving the input operation, the style of the mark of the triggered automatic exposure control ionization chamber changes, indicating that the switch state is switched. For example, when the mark of the automatic exposure control ionization chamber is a white rectangle, after the mark is triggered, the mark changes to a dark rectangle, indicating that the automatic exposure control ionization chamber at the position corresponding to the mark is selected, and is in the turned-on state after the exposure operation starts, for automatic exposure control.

[0101] In some embodiments, when only one automatic exposure control ionization chamber can be selected to be in the on state for a sub-medical image, when the sixth input operation is received to change the automatic exposure control ionization chamber corresponding to the mark of the triggered automatic exposure control ionization chamber to the on state (for example, from a white rectangle to a dark rectangle), and there is an automatic exposure control ionization chamber corresponding to the mark of an untriggered automatic exposure control ionization chamber in the on state (that is, there is still an untriggered dark rectangle), synchronously with the sixth input operation, the control device changes the automatic exposure control ionization chamber corresponding to the mark of the untriggered automatic exposure control ionization chamber to the off state, that is, the display device synchronously updates the display style of the mark of the untriggered automatic exposure control ionization chamber (for example, from a dark rectangle to a white rectangle).

[0102] In some embodiments, Figures 5 to 8 As shown, the exposure parameter display area in the second area 202 of the graphical user interface can also synchronously display the switch states 2021 of multiple automatic exposure control ionization chambers corresponding to each sub-medical image. The switch states of the multiple automatic exposure control ionization chambers displayed in the second area 202 corresponding to each sub-medical image are the same as the switch states of the multiple automatic exposure control ionization chambers superimposed and displayed at the corresponding sub-medical image position of the captured image.

[0103] The above input operations may also be input by voice, and the embodiments of the present application are not limited thereto.

[0104] The above embodiments are merely exemplary of the embodiments of the present application, but the present application is not limited thereto, and appropriate modifications may be made based on the above embodiments. For example, the above embodiments may be used alone, or one or more of the above embodiments may be combined.

[0105] The embodiment of the present application further provides an operating method of a medical imaging system, and the contents that are the same as those in the embodiments of the aforementioned aspects are not repeated here. Fig. 9 is a schematic diagram of an operation method of a medical imaging system according to an embodiment of the present application. Fig. 9 As shown, the method includes:

[0106] 901, photographing a detected object to obtain a photographed image including the detected object;

[0107] 902, displaying a graphical user interface including the captured image, and superimposing a first boundary indication and a second boundary indication (displaying an initial position) of an exposure area on the captured image;

[0108] 903, receiving an input operation for adjusting the position of the first boundary indication;

[0109] 904, controlling the position of the second boundary indicator to change as the position of the first boundary indicator changes, so that the distance between the first boundary indicator and the second boundary indicator remains unchanged;

[0110] 905, receiving an input operation for adjusting a position of the second boundary indication;

[0111] 906, receiving an input operation for adjusting the visual range of the camera device, and updating and displaying the captured image according to the input operation for adjusting the visual range of the camera device; the position of the first boundary indication and the position of the second boundary indication are fixed relative to the anatomical position in the captured image, and if there is a need to readjust the position of the first boundary indication or the position of the second boundary indication, the process may return to execute 903-905;

[0112] 907, receiving an input operation for determining the positions of the first boundary indication and the second boundary indication, such as an input operation for triggering the indication position confirmation mark;

[0113] 908, the control device locks the positions of the first boundary indicator and the second boundary indicator, and determines the position of the anatomical part corresponding to the position of the first boundary indicator and the position of the second boundary indicator in the captured image, wherein when the position of the anatomical part changes in the captured image, the position of the first boundary indicator and the position of the second boundary indicator follow the change of the position of the anatomical part;

[0114] 909, determining the exposure area according to the positions of the first boundary indication and the second boundary indication, and determining a first number of sub-medical images;

[0115] 910, receiving an input operation of selecting a sub-medical image;

[0116] 911 , displaying on and off states of multiple automatic exposure control ionization chambers in the exposure parameters corresponding to the selected one or more sub-medical images overlaid on the captured image.

[0117] 912, receiving an input operation for setting the switch states of the plurality of automatic exposure control ionization chambers;

[0118] 913 , according to the received input operation for setting the switch states of the plurality of automatic exposure control ionization chambers, select the automatic exposure control ionization chamber in the turned-on state and perform exposure according to other set exposure parameters.

[0119] It is worth noting that the above Fig. 9 The embodiments of the present application are only schematically described, but the present application is not limited thereto. For example, the execution order of the various operations can be appropriately adjusted, for example, 905 can be executed before 903, and other operations can be added or some operations can be reduced, such as reducing at least one step from 903 to 907 or from 909 to 913. Those skilled in the art can make appropriate modifications based on the above content, and are not limited to the above appended Fig. 9 Records of.

[0120] The above embodiments are merely exemplary of the embodiments of the present application, but the present application is not limited thereto, and appropriate modifications may be made based on the above embodiments. For example, the above embodiments may be used alone, or one or more of the above embodiments may be combined.

[0121] An embodiment of the present application also provides a graphical user interface, which includes a first area for displaying a captured image, and a first boundary indicator and a second boundary indicator for displaying an exposure area superimposed on the captured image, wherein when the position of an anatomical part corresponding to the position of the first boundary indicator and the position of the second boundary indicator changes in the captured image, the position of the first boundary indicator and the position of the second boundary indicator follow the change in the position of the anatomical part.

[0122] In some embodiments, the graphical user interface further includes at least one of an upper boundary and a lower boundary of the movable detector superimposed and displayed on the captured image.

[0123] In some embodiments, the graphical user interface further includes an indication position confirmation mark, and the positions of the first boundary indication and the second boundary indication are locked by triggering the indication position confirmation mark.

[0124] In some embodiments, the graphical user interface further includes a camera field of view adjustment mark, and the camera field of view adjustment mark is triggered to adjust the visual range of the camera.

[0125] In some embodiments, the graphical user interface further includes an indication position reset mark, and by triggering the indication position reset mark, the positions of the first boundary indication and the second boundary indication are reset to initial positions.

[0126] In some embodiments, the graphical user interface also includes marks of the switch states of multiple automatic exposure control ionization chambers corresponding to the selected one or more sub-medical images, which are superimposed and displayed on the captured image. By triggering the switch state marks, the state of each automatic exposure control ionization chamber corresponding to the selected one or more sub-medical images is set to on or off.

[0127] In some embodiments, the graphical user interface further includes a second area, an operation area, a first mark, a second mark, etc. The implementation of each of the above areas or marks or boundaries or boundary indications can refer to the aforementioned embodiments (such as Figures 2 to 8 Any one is shown), which will not be repeated here.

[0128] The medical imaging system and its operating method and graphical user interface provided by the present application are such that when the position of an anatomical part changes in a captured image, the position of the first boundary indication and the second boundary indication of the exposure area change with the position of the anatomical part, thereby avoiding errors in the exposure area caused by movement of the detected object or adjustment of the visual range of the camera device.

[0129] In addition, when adjusting the position of the first boundary indication, the position of the second boundary indication is controlled to change with the position of the first boundary indication so that the distance between the first boundary indication and the second boundary indication remains unchanged, thereby simplifying the adjustment steps and quickly and conveniently adjusting the position of the exposure area.

[0130] In addition, when the position of the second boundary indicator is adjusted, the position of the first boundary indicator remains unchanged, so that the adjustment of the position of the boundary indicator is more flexible and the time for repeated adjustments is reduced.

[0131] In addition, when the position of the second boundary indication is adjusted to exceed the lower movable boundary of the detector, the control device limits the downward adjustment of the position of the second boundary indication; when the position of the first boundary indication is adjusted to exceed the upper movable boundary of the detector, the control device limits the upward adjustment of the position of the first boundary indication, thereby avoiding the exposure area being located outside the movable boundary range of the detector.

[0132] In addition, at least one of the upper limit and the lower limit at which the probe can be moved is superimposed and displayed on the captured image, thereby reducing unnecessary repeated adjustment time.

[0133] In addition, the input device is also used to receive an input operation for adjusting the visible range of the camera device, and the display device updates and displays the captured image according to the input operation for adjusting the visible range of the camera device. Thus, the problem that the captured image within the current visible range does not fully display the exposure area is avoided, and a larger adjustment of the position of the exposure area is supported.

[0134] In addition, by designing an indication position reset mark, when the indication position reset mark is triggered, the positions of the first boundary indication and the second boundary indication will return to the initialization positions, thereby making the adjustment of the position of the boundary indication more flexible.

[0135] In addition, by designing an indication position confirmation mark, when the indication position confirmation mark is triggered, the positions of the first boundary indication and the second boundary indication are locked, thereby avoiding changes in the positions of the first boundary indication and the second boundary indication due to unnecessary misoperation.

[0136] In addition, the positions overlapping the corresponding anatomical parts on the first boundary indication and the second boundary indication are displayed as the outline of the anatomical part, thereby making the display of the exposure area more three-dimensional and allowing the operator to more intuitively view the thickness information of the anatomical part at the boundary position of the exposure area.

[0137] In addition, the marks of the switch status of multiple automatic exposure control ionization chambers are superimposed and displayed on the captured image, and the status of each automatic exposure control ionization chamber corresponding to the second number of sub-medical images is set to on or off by triggering the switch status mark, thereby making the selection of the automatic exposure control ionization chamber more intuitive and convenient.

[0138] The above devices and methods of the present application can be implemented by hardware, or by hardware combined with software. The present application relates to such a computer-readable program, which, when executed by a logic component, enables the logic component to implement the above-mentioned devices or components, or enables the logic component to implement the various methods or steps described above. The present application also relates to a storage medium for storing the above program, such as a hard disk, a magnetic disk, an optical disk, a DVD, a flash memory, etc.

[0139] The method / device described in conjunction with the embodiments of the present application may be directly embodied as hardware, a software module executed by a processor, or a combination of the two. For example, one or more of the functional block diagrams shown in the figure and / or one or more combinations of the functional block diagrams may correspond to various software modules of the computer program flow or to various hardware modules. These software modules may correspond to the various steps shown in the figure, respectively. These hardware modules may be implemented by solidifying these software modules, for example, using a field programmable gate array (FPGA).

[0140] The software module may be located in a RAM memory, a flash memory, a ROM memory, an EPROM memory, an EEPROM memory, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. A storage medium may be coupled to a processor so that the processor can read information from the storage medium and write information to the storage medium; or the storage medium may be an integral part of the processor. The processor and the storage medium may be located in an ASIC. The software module may be stored in a memory of a mobile terminal or in a memory card that can be inserted into the mobile terminal. For example, if a device (such as a mobile terminal) uses a large-capacity MEGA-SIM card or a large-capacity flash memory device, the software module may be stored in the MEGA-SIM card or the large-capacity flash memory device.

[0141] For one or more of the functional blocks described in the drawings and / or one or more combinations of functional blocks, it can be implemented as a general-purpose processor, digital signal processor (DSP), application-specific integrated circuit (ASIC), field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component or any appropriate combination thereof for performing the functions described in the present application. For one or more of the functional blocks described in the drawings and / or one or more combinations of functional blocks, it can also be implemented as a combination of computing devices, such as a combination of a DSP and a microprocessor, multiple microprocessors, one or more microprocessors in communication with a DSP, or any other such configuration.

[0142] The present application is described above in conjunction with specific implementation methods, but it should be clear to those skilled in the art that these descriptions are exemplary and are not intended to limit the scope of protection of the present application. Those skilled in the art can make various modifications and variations to the present application based on the principles of the present application, and these modifications and variations are also within the scope of the present application.

Claims

1. A medical imaging system, characterized in that: The system comprises: An imaging device, comprising an X-ray source and a detector, wherein the X-ray source and the detector can cooperate to obtain a medical image of a detected object; A camera device, which photographs the detected object to obtain a photographed image containing the detected object; a display device, which displays a graphical user interface including the captured image, and superimposes a first boundary indication and a second boundary indication of an exposure area on the captured image; an input device that receives at least one of an input operation to adjust a position of the first boundary indication, an input operation to adjust a position of the second boundary indication, and an input operation to determine positions of the first boundary indication and the second boundary indication; A control device that determines the position of the first boundary indication and the position of the second boundary indication based on the input operation received by the input device, and determines the position of the anatomical part corresponding to the position of the first boundary indication and the position of the second boundary indication in the captured image, wherein when the position of the anatomical part changes in the captured image, the position of the first boundary indication and the position of the second boundary indication follow the change of the position of the anatomical part.

2. The system according to claim 1, characterized in that The position of the first boundary indication and the position of the second boundary indication follow the position change of the anatomical part, which includes: the position of the first boundary indication and the position of the second boundary indication are fixed relative to the position of the anatomical part.

3. The system according to claim 1, characterized in that When the input device receives an input operation for adjusting the position of the first boundary indicator, the control device controls the position of the second boundary indicator to change as the position of the first boundary indicator changes, so that the distance between the first boundary indicator and the second boundary indicator remains unchanged.

4. The system according to claim 3, characterized in that When the position of the second boundary indicator changes to exceed the lower edge of the captured image as the position of the first boundary indicator changes, the control device controls the position of the second boundary indicator to remain unchanged at the lower edge.

5. The system according to claim 1, characterized in that When the input device receives an input operation for adjusting the position of the second boundary indication, the position of the first boundary indication remains unchanged.

6. The system according to claim 1, characterized in that When the position of the second boundary indication is adjusted to exceed the lower movable boundary of the detector, the control device limits the downward adjustment of the position of the second boundary indication; when the position of the first boundary indication is adjusted to exceed the upper movable boundary of the detector, the control device limits the upward adjustment of the position of the first boundary indication.

7. The system according to claim 6, characterized in that The display device further displays at least one of an upper boundary and a lower boundary at which the probe can be moved superimposed on the captured image.

8. The system according to claim 1, characterized in that The control device initializes the initial positions of the first boundary indication and the second boundary indication according to the center position of the captured image or the part to be imaged, or the control device initializes the initial positions of the first boundary indication and the second boundary indication according to the initialization input operation received by the input device.

9. The system according to claim 1, characterized in that The graphical user interface also includes an indication position reset mark. When the input device receives an input operation that triggers the indication position reset mark, the control device resets the positions of the first boundary indication and the second boundary indication back to their initial positions.

10. The system according to claim 1, characterized in that The graphical user interface also includes an indication position confirmation mark, and when the input device receives an input operation that triggers the indication position confirmation mark, the control device locks the positions of the first boundary indication and the second boundary indication; Furthermore, after the control device locks the positions of the first boundary indicator and the second boundary indicator, the position of the anatomical part corresponding to the position of the first boundary indicator and the position of the second boundary indicator in the captured image is determined, and when the position of the anatomical part changes in the captured image, the position of the first boundary indicator and the position of the second boundary indicator follow the change in the position of the anatomical part.

11. The system according to claim 1, characterized in that The input device is further used to receive an input operation for adjusting the visible range of the camera device, and the display device updates and displays the captured image according to the input operation for adjusting the visible range of the camera device.

12. The system according to claim 11, characterized in that The graphical user interface also includes an operation bar and a camera field of view adjustment mark superimposed and displayed on the operation bar. The camera visual range is adjusted by adjusting the position of the camera field of view adjustment mark in the operation bar.

13. The system according to claim 11, characterized in that When the input device receives an input operation for adjusting the visible range of the camera device, the position of the first boundary indication and the position of the second boundary indication follow the position of the anatomical part, and the position of the first boundary indication and the position of the second boundary indication are fixed relative to the position of the anatomical part in the captured image.

14. The system according to claim 13, characterized in that When the visual range of the camera device is adjusted so that the position indicated by the first boundary exceeds the upper boundary of the movable detector, the control device limits the position of the first boundary indicator to remain at the upper boundary of the movable detector; or, when the visual range of the camera device is adjusted so that the position indicated by the first boundary exceeds the upper edge of the visual range, the control device limits the position of the first boundary indicator to remain at the upper edge of the visual range; When the visual range of the camera device is adjusted so that the position indicated by the second boundary exceeds the lower movable boundary of the detector, the control device limits the position indicated by the second boundary to remain at the lower movable boundary of the detector; or, when the visual range of the camera device is adjusted so that the position indicated by the second boundary exceeds the lower edge of the visual range, the control device limits the position indicated by the second boundary to remain at the lower edge of the visual range.

15. The system according to claim 1, characterized in that The control device determines the size of the exposure area according to the position of the first boundary indication and the position of the second boundary indication, and determines a first number of sub-medical images according to the size of the exposure area and the size of the detector, the medical image being formed by splicing the first number of sub-medical images; In addition, the display device also displays the exposure parameters of the first number of sub-medical images. When the input device receives an input operation for selecting a sub-medical image, the display device superimposes and displays the switch states of multiple automatic exposure control ionization chambers in the exposure parameters corresponding to the selected one or more sub-medical images on the captured image.

16. The system according to claim 15, characterized in that The input device receives an input operation for setting the switch status of the multiple automatic exposure control ionization chambers, and the control device selects the automatic exposure control ionization chamber in the turned-on state to control the exposure time according to the received input operation for setting the switch status of the multiple automatic exposure control ionization chambers.

17. The system according to claim 1, characterized in that The positions on the first boundary indication and the second boundary indication that overlap with the corresponding anatomical part are displayed as the outline of the anatomical part, and the position of the outline is related to the thickness information of the detected object.

18. A medical imaging system, comprising a display unit, the display unit comprising a graphical user interface, the graphical user interface comprising an area for displaying a captured image, and a first boundary indication and a second boundary indication for displaying an exposure area superimposed on the captured image, wherein: When the position of the anatomical part corresponding to the position indicated by the first boundary and the position indicated by the second boundary changes in the captured image, the position indicated by the first boundary and the position indicated by the second boundary follow the change in the position of the anatomical part.

19. The system of claim 18, wherein: The graphical user interface further includes at least one of an upper boundary and a lower boundary of a movable detector superimposed and displayed on the captured image.

20. The system of claim 18, wherein: The graphical user interface also includes an indication position confirmation mark, and the positions of the first boundary indication and the second boundary indication are locked by triggering the indication position confirmation mark.

21. The system of claim 18, wherein: The graphical user interface also includes a camera field of view adjustment mark, and the camera field of view adjustment mark is triggered to adjust the visual range of the camera.

22. The system of claim 18, wherein: The graphical user interface also includes an indication position reset mark, and by triggering the indication position reset mark, the positions of the first boundary indication and the second boundary indication are reset to initial positions.

23. The system of claim 18, wherein: The graphical user interface also includes marks of the switch status of multiple automatic exposure control ionization chambers corresponding to the selected one or more sub-medical images, which are superimposed and displayed on the captured image. By triggering the switch status marks, the status of each automatic exposure control ionization chamber corresponding to the selected one or more sub-medical images is set to on or off.

24. A method for operating a medical imaging system, characterized in that: The method comprises: photographing the detected object to obtain a photographed image containing the detected object; displaying a graphical user interface including the captured image, and superimposing a first boundary indication and a second boundary indication of an exposure area on the captured image; receiving at least one of an input operation to adjust a position of the first boundary indication, an input operation to adjust a position of the second boundary indication, and an input operation to determine positions of the first boundary indication and the second boundary indication; The position of the first boundary indication and the position of the second boundary indication are determined according to the received input operation, and the position of the anatomical part corresponding to the position of the first boundary indication and the position of the second boundary indication in the captured image is determined, wherein when the position of the anatomical part changes in the captured image, the position of the first boundary indication and the position of the second boundary indication follow the change of the position of the anatomical part.

Images