X-ray image generation method, X-ray image generation device, and computer readable recording medium
The head image of the subject displayed by the reference line is obtained through the camera, photographed in different regions and adjusted the relative position, used feature points to calculate posture information, stitched and reconstructed the projected image, solving the problem of small-area sensors generating large-area X-ray images, and improving the problem of small-area sensors Dental diagnostic efficiency and image quality.
Patent Information
- Application Number
- CN201980061455.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2018-09-27
- Filing Date
- 2019-07-17
- Publication Date
- 2025-01-14
- Estimated Expiration
- 2039-07-17
AI Technical Summary
In dental diagnosis, it is difficult to generate large-area X-ray images using small-area sensors, and changes in the posture of the subject lead to an increase in image splicing and reconstruction time, affecting diagnostic efficiency.
The camera obtains the head image of the subject displayed on the reference line, photographs it in different regions and adjusts the relative position, uses the camera image to extract feature points to calculate posture information, stitch and reconstruct the projected image to generate X-ray images, and reduces the time required for image generation and resource.
It realizes the generation of high-quality X-ray images under small-area sensors, reduces image generation time and resource consumption, adapts to the posture changes of the subject, and improves the comprehensive judgment ability of dental diagnosis.
Smart Images

Figure CN112739263B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to an X-ray image generating method, an X-ray image generating device and a computer readable recording medium. Background Art
[0002] X-ray imaging devices, which are widely used in the medical technology field, irradiate the human body with X-rays to obtain images of the inside of the human body, thereby detecting abnormalities inside the human body.
[0003] In particular, among X-ray imaging devices, panoramic photography devices mainly used in dentistry can generate images of teeth and alveolar bones as image generation objects on a two-dimensional plane. Therefore, they are very effectively used for various diagnostic purposes such as prognosis judgment of orthodontic treatment, confirmation of tooth eruption status, confirmation of alveolar bone height, etc.
[0004] Furthermore, among X-ray imaging devices, dental CT imaging devices are very useful for understanding the state of anatomical structures such as the thickness of alveolar bones and the location of major nerves in order to perform dental implant surgery, etc.
[0005] Thus, an X-ray imaging device used for diagnostic purposes in dentistry generally irradiates X-rays generated from a generator, and receives X-rays that have passed through a part of the body of the subject or have not passed through the body through a sensor opposite to the generator. Then, the received X-rays are converted into electrical signals and projection data is obtained. In particular, such an X-ray imaging device can continuously irradiate and receive X-rays while rotating the generator and the sensor around a rotation axis to generate electrical signals required for generating X-ray image data.
[0006] The projection data acquisition method has the advantages of being able to check the status of all teeth and anatomical structures with one photography, low radiation dose and fast imaging time, etc. The projection data is converted into an X-ray image such as a panoramic image or a CT image through a splicing or reconstruction process. The panoramic image contains all images of the anatomical structures including the patient's dentition in a plane, and therefore is very helpful for dental diagnosis.
[0007] On the other hand, in dentistry, in addition to the dentition, sometimes images of the jaw joint and the like are required. In other words, if the shape of the dentition and the jaw joint can be confirmed in one image, it will be of great help in comprehensive judgment in dental diagnosis. For this purpose, the image area must be expanded.
[0008] However, increasing the area of the sensor is limited in terms of technology or price. Therefore, it is necessary to propose an X-ray image generation device and method structure that can obtain a large area image when the area of the sensor is small.
[0009] Therefore, a method can be considered in which a subject (e.g., the head of a subject) is photographed once, the position of the subject is changed, and then photographed again to obtain two image data, and an X-ray image is generated by combining these. However, in this case, there is a possibility that the posture or position of the subject may change during the time between the first photographing and the second photographing. In this case, it is difficult to expect a high-quality X-ray image.
[0010] In addition, in order to obtain one X-ray image from two adjacent image data, generally, a three-dimensional reconstruction process is performed on the image data obtained by the first photography, and a three-dimensional reconstruction process is also performed on the image data obtained by the second photography. The reconstructed images thus obtained are spliced into one image. Therefore, there is a problem that the reconstruction time increases compared to the case where the X-ray image is obtained by photography only once, and it takes 2-3 times as long. Summary of the invention
[0011] Technical issues
[0012] The present invention is proposed in view of the above-mentioned problems, and an object of the present invention is to provide an X-ray image generating method, an X-ray image generating device and a computer-readable recording medium having a computer program recorded thereon, which can confirm the shape of a part required for dental diagnosis in one image by using a camera and a small area sensor.
[0013] Another object of the present invention is to provide a correction device that can effectively correct and generate an image even if the local posture of a subject changes during imaging.
[0014] In addition, another object of the present invention is to provide a device that can reduce the time and resources used for stitching and reconstruction work to generate X-ray images.
[0015] Means of solving problems
[0016] To achieve the above object, the method of generating an X-ray image by photographing a subject's head in an X-ray image generating device including an X-ray photographing unit, a driving unit, a reference line display unit, a camera image acquisition unit and an X-ray image generating unit of the present invention may include: a step in which the camera image acquisition unit acquires a first camera image of the subject's head through which the reference line display unit displays a reference line; a step in which the X-ray photographing unit photographs a first area of the subject's head to acquire a first projection image; a step in which the driving unit changes the relative position of the subject's head and the X-ray photographing unit after photographing the first area; a step in which the camera image acquisition unit acquires a second camera image of the subject's head through which the reference line display unit displays a reference line after changing the relative position; a step in which the X-ray photographing unit photographs a second area of the subject's head to acquire a second projection image after changing the relative position; and a step in which the X-ray image generating unit generates an X-ray image by stitching and reconstructing the first projection image and the second projection image based on the acquired first camera image and the acquired second camera image.
[0017] Moreover, preferably, the X-ray image is a three-dimensional CT image or a panoramic image of the whole or part of the subject's head.
[0018] Furthermore, the X-ray image is a three-dimensional CT image of the whole or part of the subject's head, and the step of generating the X-ray image may include: the step of the X-ray image generating unit splicing the acquired first projection image and the second projection image to generate a matching projection image; and the step of the X-ray image generating unit reconstructing the matching projection image to generate the X-ray image.
[0019] Moreover, the X-ray image is a three-dimensional CT image of the whole or part of the subject's head, and the step of generating the X-ray image may include: the step of the X-ray image generating part reconstructing the first projection image and the second projection image respectively; and the step of splicing the reconstructed first projection image and the reconstructed second projection image to generate the X-ray image.
[0020] Moreover, preferably, the step of generating the X-ray image includes: the step of the X-ray image generating unit extracting at least one first feature portion from the acquired first camera image, and extracting at least one second feature portion from the acquired second camera image; the step of the X-ray image generating unit calculating the first posture information of the subject's head by extracting the position and angle information of the first feature portion from the first camera image based on the reference line, and calculating the second posture information of the subject's head by extracting the position and angle information of the second feature portion from the second camera image based on the reference line; and the step of splicing and reconstructing the first X-ray projection image information and the second X-ray projection image information based on the first posture information and the second posture information to generate the X-ray image.
[0021] Furthermore, preferably, the first feature portion and the second feature portion each include at least one of the marker points of the images of eyes, eyebrows, nose, and mouth.
[0022] Moreover, preferably, in the step of the driving unit changing the relative position of the subject's head and the X-ray imaging unit, the driving unit causes the subject's head to rise or fall in a direction perpendicular to the ground on which the X-ray imaging device is installed.
[0023] To achieve the above object, the X-ray image generating device of the present invention comprises: a reference line display unit, which displays a reference line on the head of a subject; a camera image acquiring unit; an X-ray photographing unit; a driving unit; and an X-ray image generating unit, wherein the camera image acquiring unit acquires a first camera image of the head of the subject whose reference line is displayed by the reference line display unit, the X-ray photographing unit acquires a first projection image by photographing a first area of the head of the subject, the driving unit changes the relative position between the head of the subject and the X-ray photographing unit after photographing the first area, the camera image acquiring unit acquires a second camera image of the head of the subject whose reference line is displayed by the reference line display unit after changing the relative position, the X-ray photographing unit acquires a second projection image by photographing a second area of the head of the subject after changing the relative position, and the X-ray image generating unit can generate an X-ray image based on the acquired first camera image and the acquired second camera image by splicing and reconstructing the first projection image and the second projection image.
[0024] The X-ray image may be a three-dimensional CT image or a panoramic image of the entire or a part of the subject's head.
[0025] Moreover, the X-ray image is a three-dimensional CT image of the whole or part of the subject's head. The X-ray image generation unit splices the acquired first camera image and the image to generate a matching projection image, and then reconstructs the matching projection image to generate the X-ray image.
[0026] Moreover, preferably, the X-ray image is a three-dimensional CT image of the whole or part of the subject's head, and after the X-ray image generating unit reconstructs the first projection image and the second projection image respectively, it can generate the X-ray image by splicing the reconstructed first projection image and the reconstructed second projection image.
[0027] Moreover, the X-ray image generating unit extracts at least one first feature portion from the acquired first camera image, and extracts at least one second feature portion from the acquired second camera image, calculates first posture information of the subject's head based on the position and angle information of the first feature portion extracted from the first camera image based on the reference line, and calculates second posture information of the subject's head based on the position and angle information of the second feature portion extracted from the second camera image based on the reference line, and can generate the X-ray image by splicing and reconstructing the first X-ray projection image information and the second X-ray projection image information based on the first posture information and the second posture information.
[0028] Furthermore, the first feature portion and the second feature portion may each include at least one of marker points of images of eyes, eyebrows, nose, and mouth.
[0029] Preferably, the driving unit is configured to change the relative position between the subject's head and the X-ray imaging unit so as to raise or lower the subject's head in a direction perpendicular to the ground on which the X-ray imaging device is disposed.
[0030] Furthermore, preferably, the driving section includes a jaw support that supports a jaw of the subject's head, and the subject's head is raised or lowered by raising or lowering the jaw support.
[0031] Preferably, the X-ray image generating device further includes a camera for photographing the subject's head, and the first camera image and the second camera image are photographed by the camera.
[0032] The camera image acquisition unit may obtain the first camera image and the second camera image through external transmission.
[0033] The X-ray image generating method may be executed by a computer program, and the computer program may be recorded in a computer-readable recording medium.
[0034] Effects of the Invention
[0035] According to various embodiments of the present invention, the shape of a part required for tooth diagnosis can be confirmed in one image by using a camera and a small-area sensor, thereby helping comprehensive judgment during tooth diagnosis.
[0036] Furthermore, according to various embodiments of the present invention, even if the local posture of the subject changes during imaging, images can be effectively corrected and generated.
[0037] In addition, according to various embodiments of the present invention, a device can reduce the time and resources used for stitching and reconstruction work to generate X-ray images. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] Figure 1 This is a diagram showing an example of a conventional X-ray imaging device.
[0039] Figure 2 1 is a schematic diagram showing the structure of an X-ray image generating device according to an embodiment of the present invention.
[0040] Figure 3 1 is an exemplary diagram showing an alignment state of a head of a subject to be X-rayed in an X-ray image generating apparatus according to an embodiment of the present invention.
[0041] Figure 4 It is a sequence diagram for explaining a method for generating an X-ray image according to an embodiment of the present invention.
[0042] Figure 5 It is a schematic diagram for explaining a method for generating an X-ray image according to an embodiment of the present invention.
[0043] Figure 6 It is a sequence diagram for explaining a method for generating an X-ray image according to an embodiment of the present invention.
[0044] Figure 7 It is a sequence diagram for explaining a method for generating an X-ray image according to an embodiment of the present invention.
[0045] Figure 8 It is a sequence diagram for explaining a method for generating an X-ray image according to an embodiment of the present invention.
[0046] Fig. 9 It is a schematic diagram for explaining a method for generating an X-ray image according to an embodiment of the present invention.
[0047] Fig.10 It is a schematic diagram for explaining a method for generating an X-ray image according to an embodiment of the present invention. DETAILED DESCRIPTION
[0048] The following content is only illustrative of the principles of the present invention. Therefore, although not explicitly described or shown in this specification, a person skilled in the art of the present invention may invent various devices within the concept and scope of the present invention. Moreover, all conditional terms and embodiments listed in this specification are in principle only used to clearly understand the concept of the present invention. As mentioned above, the present invention is not limited to the specific embodiments and states listed.
[0049] Furthermore, it should be understood that not only the principles, viewpoints and embodiments of the present invention, but also all detailed descriptions listing specific embodiments include structural and functional equivalents of the matters described. Furthermore, it should be understood that the equivalents include not only currently known equivalents, but also equivalents to be developed in the future, that is, all elements invented in a way to perform the same function regardless of the structure.
[0050] Thus, for example, it should be understood that the flowcharts in this specification show conceptual views of exemplary circuits that embody the principles of the present invention. Similarly, it should be understood that all flow charts, state transition diagrams, pseudo codes, etc. can be substantially embodied by computer-readable media, whether or not a computer or processor is explicitly shown, and represent various processing that can be executed by a computer or processor.
[0051] The functions of the various elements shown in the figure, including functional modules representing processing or similar concepts, are not only related to dedicated hardware, but also to appropriate software, so that hardware with the ability to execute software can be used. When provided by a processor, the functions can be provided by a single dedicated processor, a single shared processor, or multiple individual processors, some of which can be shared.
[0052] Furthermore, the explicit use of terms such as processing, control or similar concepts cannot be interpreted as exclusively referring to hardware capable of executing software, but should be understood to implicitly include digital signal processor (DSP) hardware, read-only memory (ROM) for storing software, random access memory (RAM) and non-volatile memory without limitation. Other conventional hardware may also be included.
[0053] In the scope of the invention claims of this specification, the structural elements that are expressed as the mechanism for executing the functions described in the detailed description are intended to include, for example, all methods of the functions of software in all forms including a combination of circuit elements that execute the functions or firmware / microcode, etc., in a manner to execute the functions in combination with appropriate circuits for executing the software. In the present invention defined by the scope of the invention claims, the functions provided by various mechanisms are combined and combined in the manner required by the scope of the invention claims, and therefore, it should be understood that any mechanism that can provide the functions is also equivalent to the functions grasped from this specification.
[0054] The objects, features and advantages will become more clearly understood through the following detailed description in conjunction with the accompanying drawings, so that a person skilled in the art can easily implement the technical concept of the present invention. In addition, in the process of describing the present invention, if it is determined that the specific description of the known technology related to the present invention will make the gist of the present invention unclear, the detailed description thereof will be omitted.
[0055] Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings.
[0056] Figure 1 1 is a diagram showing an example of a conventional X-ray imaging apparatus. The X-ray imaging apparatus 10 is an apparatus for capturing an X-ray image 300 including the shape of the anatomical structure of the body of a subject.
[0057] The X-ray imaging device 10 may include a base 190 , a support column 185 , a display 175 , a gantry 113 , a handle 195 , and a head 180 .
[0058] The base 190 is configured to support the X-ray imaging device 10 and faces the floor surface on which the X-ray imaging device 10 is installed. The support column 185 is vertically erected from the base 190 and can be adjusted in height by sliding.
[0059] The display 175 is a structure that allows the user to confirm the use of the X-ray imaging device 10 (for example, the rotation of the gantry 113, the start and end of CT imaging, etc.). The gantry 113 may be located below the head 180 above the X-ray imaging device 10.
[0060] In addition, the alignment portion 160 may further include at least one of a chin-rest 161 and a bite block 163. Figure 1 It can be confirmed that the mandibular support 161 is a component for placing the mandibular portion of the subject's head 400. In addition, the bite block 163 is a portion that the subject's head 400 can bite with teeth. The main purpose of the bite block 163 is to align the head posture of the subject's head 400.
[0061] The X-ray image generating device 100 of the present invention is a device for generating an X-ray image 300 including the shape of the anatomical structure of the subject's head 400, and may include Figure 1 The structure of the dental X-ray imaging device 10 is shown.
[0062] Figure 2 1 is a schematic diagram showing the structure of an X-ray image generating device according to an embodiment of the present invention.
[0063] like Figure 2 As shown, an X-ray image generating device 100 according to an embodiment of the present invention basically includes an X-ray photographing unit 110 , a reference line display unit 120 , a camera image acquiring unit 130 , a control unit 140 and a driving unit 150 .
[0064] In addition, an X-ray image generating unit 170 may be further included.
[0065] According to an embodiment of the present invention, the X-ray imaging unit 110 may include a generator 111 , a sensor 112 , and a gantry 113 .
[0066] The generator 111 and the sensor 112 may be attached to both ends of a rotating device called the gantry 113. The gantry 113 may rotate around a rotation axis (not shown) centered on a straight line in the vertical direction of the subject's head 400.
[0067] The driving unit 150 is a component for changing the relative position of the subject's head 400 and the X-ray imaging unit 110 , and may include a rotary motor, a screw, and a linear guide, or may include a linear motor.
[0068] Relative position refers to the position of one element based on the position of the other element.
[0069] More specifically, it comprises: a rotary drive motor (not shown); a screw (not shown) that rotates by receiving the rotational force of the drive motor; and a block (not shown) whose shaft is inserted into the screw and slides in the length direction of the screw by the rotation of the screw, and, as a structure of one embodiment, other components that can apply external force to the subject's head 400 can be attached to the block.
[0070] The block is preferably configured to perform linear motion without deviation by a separately provided linear guide (not shown). In addition, stoppers (not shown) are preferably provided at both ends of the linear guide or the screw to serve as limit points of the parallel motion.
[0071] The driving unit 150 includes a chin support 161 as another component. Finally, the chin support 161 applies an external force to the subject's head 400 , thereby adjusting the height of the subject's head 400 .
[0072] The driving unit 150 , as other components, includes a chair (not shown) for the subject (not shown) to sit on during X-ray photography, and the driving unit 150 can apply external force to the subject (not shown) through the chair to adjust the height of the subject's head 400 .
[0073] The driving unit 150 may include the support column 185 or a rotation axis (not shown) of the gantry 113 as other components. In this case, the relative position of the subject's head 400 and the X-ray imaging unit 110 can be changed while adjusting the height of the gantry 113 .
[0074] The reference line display unit 120 may display a reference line 470 on the subject's head 400 .
[0075] In an embodiment of the present invention, the reference line display unit 120 may irradiate light to display the reference line 470. More specifically, the reference line 470 may be displayed by irradiating a laser beam.
[0076] According to an embodiment of the present invention, as a fixed reference line display unit ( Figure 1 120a), can also be set together with an extension arm provided with a mandibular support 161.
[0077] In addition, according to another embodiment, the reference line display unit 120 is a movable reference line display unit ( Figure 1 120b), which can be set on the generator 111. When the reference line display unit 120b is movable, the position of the generator 111 can also be aligned with the front of the subject's head 400 by rotating the rack 113 to display the reference line 470.
[0078] In addition, the X-ray image generating device 100 may further include an X-ray image generating unit 170, which acquires the projection image photographed by the X-ray photographing unit 110 to generate an X-ray image 300. The X-ray image generating unit 170 may generate a final X-ray image 300 by performing one or more of reference line 470 (stitching) and reconstruction on the projection data.
[0079] In the present invention, the reference line 470 may refer to a process of connecting portions of a plurality of images that are connected to each other and matching them into one image. Also, reconstruction may refer to a process of generating an image by a process of converting image data. The reconstruction and the reference line 470 are terms for a general process used when generating a dental panoramic image or a dental CT image.
[0080] Figure 3 1 is an exemplary diagram showing an alignment state of a subject's head 400 to be X-rayed in an X-ray image generating apparatus 100 according to an embodiment of the present invention. Figure 3 As shown, the gantry 113, the generator 111 and the sensor 112 may be configured into a “ㄷ” shape, and the subject's head 400 is positioned and aligned between the gantry, the generator and the sensor.
[0081] In the case of tooth diagnosis, the dentition and the jaw joint in the subject's head 400 are mainly diagnosed. Therefore, the shapes of the dentition and the jaw joint are preferably included in one X-ray image 300.
[0082] However, when the sensor 112 is a small-area sensor, it is difficult to capture the entire shape of the dentition 420 and the jaw joint 410 through one rotation of the frame 113 .
[0083] Figure 4 FIG. 1 is a sequence diagram for illustrating a method for generating an X-ray image according to an embodiment of the present invention. Figure 4 As shown, in an X-ray image generating device including an X-ray photographing unit 110, a driving unit 150, a reference line display unit 120, a camera image acquisition unit 130 and an X-ray image generating unit 170 of the present invention, a method for generating an X-ray image 300 by photographing a subject's head may include: a step (S100) in which the camera image acquisition unit 130 acquires a first camera image 450 of a subject's head 400 with a reference line 470 displayed by the reference line display unit 120; a step (S200) in which the X-ray photographing unit 110 photographs a first area 410 of the subject's head 400 to acquire a first projection image; after photographing the first area 410, the driving unit 150 changes the position of the subject's head 400 and the X-ray photographing unit 170; the step (S300) of changing the relative position of the first camera image 450 and the second camera image 460 of the subject's head 400 displayed by the reference line display unit 120 after the relative position is changed; the step (S400) of acquiring a second camera image 460 of the subject's head 400 by the camera image acquisition unit 130 through the reference line display unit 120 after the relative position is changed; the step (S500) of acquiring a second projection image by photographing a second area 420 of the subject's head 400 after the relative position is changed; and the step (S600) of generating an X-ray image 300 by the X-ray image generation unit 170 based on the acquired first camera image 450 and the acquired second camera image 460 through the reference line 470 (stitching) and reconstructing the first projection image and the second projection image.
[0084] Figure 5 1 is a diagram for explaining a method for generating an X-ray image according to an embodiment of the present invention. Figure 5 As shown in (a), the region of the subject's head 400 may be divided into a first region 410 and a second region 420. The first region 410 and the second region 420 may have an overlapping region 430 that partially overlaps.
[0085] Figure 5 (b) shows the field of view (FOV) of the camera. Figure 5As shown in (b), the field of view can be divided into a first field of view 415 of the photographing area when photographing the first area 410 and a second field of view 425 of the photographing area when photographing the second area 420.
[0086] The field of view (FOV) refers to the area that is imaged during X-ray photography.
[0087] The X-ray image 300 may preferably be a three-dimensional CT image or a panoramic image of the entire or a portion of the subject's head 400 .
[0088] Figure 6 It is a diagram for explaining a method for generating an X-ray image according to an embodiment of the present invention.
[0089] The X-ray image 300 may be a three-dimensional CT image of the whole or part of the subject's head 400. In this case, Figure 6 As shown, in the step (S600) of generating the X-ray image 300, the X-ray image generating unit 170 may include: a step (S610) of stitching the acquired first projection image and the second projection image to generate a matching projection image; and a step (S620) of the X-ray image generating unit 170 reconstructing the matching projection image to generate the X-ray image 300.
[0090] In order to obtain an X-ray image 300 from two adjacent image data, usually, the image data obtained by the first photography and the two-dimensional image data obtained by the second photography are respectively subjected to a three-dimensional reconstruction process, and then each reconstructed image is spliced into one image. Therefore, there is a problem that the reconstruction time increases by 2 to 3 times compared to the case where the X-ray image 300 is obtained by only one photography.
[0091] As described above, in an X-ray image generation method according to an embodiment of the present invention, after a two-dimensional first projection image and a two-dimensional second projection image are photographed in a partially overlapping manner, a stitching step (S610) is first performed, and then the stitched wide area data is three-dimensionally reconstructed (S620), thereby shortening the reconstruction time.
[0092] That is, since the time required to match two-dimensional data is significantly less than the time required to reconstruct three-dimensional data, reducing the number of reconstructions as described above can greatly help reduce time and resources used for computing.
[0093] Figure 7 is a sequence diagram for explaining a method for generating an X-ray image according to an embodiment of the present invention. The X-ray image 300 according to an embodiment of the present invention is a three-dimensional CT image of the whole or part of the head 400 of the subject, such as Figure 7As shown, the X-ray image generation method (S600) may include the step of the X-ray image generation unit 170 reconstructing the first projection image and the second projection image respectively (S630); and the step of generating the X-ray image 300 by splicing the reconstructed first projection image and the reconstructed second projection image (S640). That is, the X-ray image 300 may also be acquired by first reconstructing and then splicing.
[0094] Figure 8 FIG. 1 is a sequence diagram for illustrating a method for generating an X-ray image according to an embodiment of the present invention. Figure 8 As shown, the step (S600) of generating the X-ray image 300 may include: the X-ray image generating unit 170 extracts at least one first feature portion from the acquired first camera image 450, and extracts at least one second feature portion from the acquired second camera image 460 (S650); the X-ray image generating unit 170 calculates the first posture information of the subject's head 400 by extracting the position and angle information of the first feature portion from the first camera image 450 based on the reference line 470, and calculates the second posture information of the subject's head 400 by extracting the position and angle information of the second feature portion from the second camera image 460 based on the reference line 470 (S660); and the step (S670) of generating the X-ray image 300 by stitching and reconstructing the first X-ray projection image information and the second X-ray projection image information based on the first posture information and the second posture information.
[0095] The first feature portion and the second feature portion may each include at least one of the marker points 480 of the image of eyes, eyebrows, nose, and mouth.
[0096] Next, we will refer to Fig. 9 and Fig.10 Explain in more detail.
[0097] Fig. 9 and Fig.10 is a schematic diagram for illustrating a method for generating an X-ray image according to an embodiment of the present invention. In particular, Fig. 9 This means that the position or posture of the subject's head 400 does not change during X-ray imaging of the first region 410 and during X-ray imaging of the second region 420. Fig.10 This refers to a situation where the position or posture of the subject's head 400 changes between the two imaging operations.
[0098] Fig. 9 (a1) and 10 (a1) show a first camera image 450, Fig. 9( b 1 ) and 10 ( b 1 ) show a second camera image 460 .
[0099] like Fig. 9 and Fig.10 As shown, the marker points 480 may be points in the camera image 460 that represent images of eyes, eyebrows, nose, and mouth.
[0100] More specifically, the marking point 480 may be a point at each of the two ends of the eyes, eyebrows, nose, and mouth. In this way, by using the two ends of the eyes, eyebrows, nose, and mouth as the marking points 480 used as the first characteristic part and the second characteristic part, it is easier to detect the posture of the subject's head 400. That is, if the corresponding two ends are connected by a straight line, it is easy to obtain the angle ( Fig.10 θ) information in (b1).
[0101] A portion of the first field of view 415 and the second field of view 425 of the present invention may overlap in the horizontal direction. The overlapping area may be an area equivalent to 30% to 50% of each of the first field of view 415 and the second field of view 425. More preferably, it may be 40%.
[0102] Fig. 9 The second camera image 460 shown in (b1) is Fig. 9 The second camera image 460 shown in (a1) has no difference in pose and position. In this case, the image can be reconstructed by stitching and Fig. 9 (a2) The first projection image and Fig. 9 The second projection image of (b2) is generated as Fig. 9 (c) shows the X-ray image 300.
[0103] Fig. 9 (a2), (b2) and 10 (a2), (b2) do not reflect the shape of the projection image before reconstruction. In fact, the local shape of the bones shown in these figures represents the reconstruction of the projection image. To help understand the concept, these figures show the projection images of the reconstructed state.
[0104] at the same time, Fig.10 The second camera image 460 shown in (b1) is Fig.10 Compared with the second camera image 460 shown in (a1), the shape of the subject's head 400 is tilted.
[0105] The change in position and posture can be derived from the angle and position information corresponding to the first feature part and the second feature part. That is, the first posture information of the subject's head 400 is calculated by extracting the position and angle information of the first feature part, and the second posture information of the subject's head 400 is calculated by extracting the position and angle information of the second feature part from the second camera image 460 based on the reference line 470 (S660).
[0106] The first posture information and the second posture information may be represented by overall angle and displacement information of the subject's head 400. In addition, the angle and displacement information may include three-dimensional coordinates and angle information.
[0107] According to the difference between the first posture information and the second posture information, the degree of movement of the subject's head 400 can be grasped. In this way, by correcting the position and posture of at least one of the first projection data and the second projection data based on the first posture information and the second posture information, the first projection data and the second projection data are spliced and reconstructed, such as Fig.10 As shown in (c), a high-quality X-ray image 300 can be generated.
[0108] In addition, by obtaining the first posture information and the second posture information from the position information of the reference line, the first feature part, and the second feature part, and thereby correcting the position and posture information of the first projection data and the second projection data, it is possible to implement an image generation method in which the projection data are first spliced to generate matching projection data and then reconstruction is performed. In this case, the calculation speed can be greatly reduced compared to the method of first reconstructing each projection data and then splicing.
[0109] Preferably, in the step of the driving unit 150 changing the relative position of the subject's head 400 and the X-ray imaging unit 110, the driving unit 150 causes the subject's head 400 to rise or fall in a direction perpendicular to a floor surface on which the X-ray imaging device is installed.
[0110] The X-ray image generating device 100 of the present invention comprises: a reference line display unit 120 for displaying a reference line 470 on a head 400 of a subject; a camera image acquiring unit 130; an X-ray photographing unit 110; a driving unit 150; and an X-ray image generating unit 170, wherein the camera image acquiring unit 130 acquires a first camera image 450 of a head 400 of a subject on which the reference line 470 is displayed by the reference line display unit 120, the X-ray photographing unit 110 photographs a first area 410 of the head 400 of the subject to acquire a first projection image, and after photographing the first area 410, the driving unit 150 changes the image of the head 450 of the subject. 00 and the relative position of the X-ray photographing unit 110, and after changing the relative position, the camera image acquisition unit 130 acquires a second camera image 460 of the subject's head 400 with a reference line 470 displayed by the reference line display unit 120, and after changing the relative position, the X-ray photographing unit 110 photographs a second area 420 of the subject's head 400 to acquire a second projection image, and the X-ray image generation unit 170 generates an X-ray image 300 by splicing and reconstructing the first projection image and the second projection image based on the acquired first camera image 450 and the acquired second camera image 460.
[0111] The X-ray image 300 may be a three-dimensional CT image or a panoramic image of the entire or a part of the subject's head 400 .
[0112] In addition, the X-ray image 300 is a three-dimensional CT image of the whole or part of the subject's head 400. After the X-ray image generation unit 170 splices the acquired first camera image 450 and the image to generate a matching projection image, it reconstructs the matching projection image to generate the X-ray image 300.
[0113] In addition, the X-ray image 300 is a three-dimensional CT image of the whole or part of the subject's head 400, and after the X-ray image generation unit 170 reconstructs the first projection image and the second projection image respectively, it splices the reconstructed first projection image and the reconstructed second projection image to generate the X-ray image 300.
[0114] On the other hand, the X-ray image generating unit 170 can extract at least one first feature portion from the acquired first camera image 450, and extract at least one second feature portion from the acquired second camera image 460, and calculate the first posture information of the subject's head 400 based on the position and angle information of the first feature portion extracted from the first camera image 450 based on the reference line 470, and calculate the second posture information of the subject's head 400 based on the position and angle information of the second feature portion extracted from the second camera image 460 based on the reference line 470, and generate the X-ray image 300 by splicing and reconstructing the first X-ray projection image information and the second X-ray projection image information based on the first posture information and the second posture information.
[0115] Furthermore, each of the first feature portion and the second feature portion may include at least one of the marker points 480 of the images of eyes, eyebrows, nose, and mouth.
[0116] In order to change the relative position between the subject's head 400 and the X-ray imaging unit 110 , the driving unit 150 preferably raises or lowers the subject's head 400 in a direction perpendicular to a floor surface on which the X-ray imaging device is installed.
[0117] In addition, the driving unit 150 includes a jaw support 161 for supporting the jaw of the subject's head 400 , and the subject's head 400 is raised or lowered by raising or lowering the jaw support 161 .
[0118] The X-ray image generating device 100 further includes a camera (not shown) for photographing the subject's head 400 , and the first camera image 450 and the second camera image 460 are preferably photographed by the camera (not shown).
[0119] In this case, the camera (not shown) is preferably fixed at a position close to the reference line display unit 120 .
[0120] The camera image acquisition unit 130 may receive the first camera image 450 and the second camera image 460 from the outside. A wireless transmission method such as Wi-Fi or Bluetooth may be used.
[0121] That is, a camera image taken by an external device such as a camera or a smartphone can be received. Even if the user takes a picture of the subject's head 400 with the external device, the first posture information and the second posture information can be extracted because the reference line 470 is displayed in the taken camera image.
[0122] Alternatively, the external device may also be fixedly mounted on an indoor wall or the like.
[0123] In this case, the external device and the X-ray image generating apparatus 100 may constitute an X-ray image generating system (not shown).
[0124] In addition, a computer program for executing the above-mentioned X-ray image generating method may be stored in a computer-readable recording medium.
[0125] That is, the X-ray image generating method according to the various embodiments of the present invention described above may be implemented by a computer program and provided to a server or device in a state of being stored in various computer-readable recording media.
[0126] The recording medium may be a non-transitory computer readable medium, which is not a medium that temporarily stores data, such as a register, a cache, and a memory, but a medium that semi-permanently stores data, and refers to a medium that can be read by a device. Specifically, the various applications or programs may be stored in a non-transitory readable medium such as a CD, a DVD, a hard disk, a Blu-ray disc, a USB, a memory card, a ROM, etc.
[0127] Although preferred embodiments of the present invention are illustrated above, the present invention is not limited to the above-mentioned specific embodiments, and can be variously modified and implemented by ordinary technicians in the technical field to which the present invention belongs without departing from the main purpose of the present invention as claimed in the claims, and these modified implementations should not be understood separately from the technical spirit or prospects of the present invention.
Claims
1. An X-ray image generation method, which is a method for generating an X-ray image by photographing a subject's head in an X-ray image generation device including an X-ray photographing unit, a driving unit, a reference line display unit, a camera image acquisition unit, and an X-ray image generation unit, characterized in that: include: The camera image acquisition unit acquires a first camera image of the subject's head on which the reference line is displayed by the reference line display unit; The X-ray photography unit photographs a first area of the subject's head to obtain a first projection image; After imaging the first area, the driving unit changes the relative position between the subject's head and the X-ray imaging unit; After the relative position is changed, the camera image acquisition unit acquires a second camera image of the subject's head with the reference line displayed by the reference line display unit; After changing the relative position, the X-ray imaging unit photographs a second area of the subject's head to obtain a second projection image; and The X-ray image generating unit generates an X-ray image by stitching and reconstructing the first projection image and the second projection image based on the first camera image and the second camera image. The steps of generating an X-ray image include: The X-ray image generating unit extracts at least one first feature from the first camera image acquired, and extracts at least one second feature from the second camera image acquired; The X-ray image generating unit extracts the position and angle information of the first feature part from the first camera image based on the reference line to calculate the first posture information of the subject's head, and extracts the position and angle information of the second feature part from the second camera image based on the reference line to calculate the second posture information of the subject's head; and The X-ray image generation unit generates the X-ray image by stitching and reconstructing the first projection image and the second projection image based on the first posture information and the second posture information, The first feature part and the second feature part respectively include at least one of the marker points of the image of eyes, eyebrows, nose and mouth, The marking points are points at both ends of each of the eyes, eyebrows, nose and mouth, and angle information relative to the reference line is obtained by connecting the corresponding ends of each of the eyes, eyebrows, nose and mouth with a straight line.
2. The X-ray image generation method according to claim 1, characterized in that: The X-ray image is a three-dimensional CT image or a panoramic image of the whole or part of the subject's head.
3. The X-ray image generation method according to claim 2, characterized in that: The X-ray image is a three-dimensional CT image of the whole or part of the subject's head, The step of generating the X-ray image comprises: The X-ray image generating unit generates a matching projection image by splicing the acquired first projection image and the acquired second projection image; and The X-ray image generating unit reconstructs the matching projection image to generate the X-ray image.
4. The X-ray image generation method according to claim 2, characterized in that: The X-ray image is a three-dimensional CT image of the whole or part of the subject's head, The step of generating the X-ray image comprises: The X-ray image generating unit reconstructs the first projection image and the second projection image respectively; The step of stitching the reconstructed first projection image and the reconstructed second projection image to generate the X-ray image.
5. The X-ray image generation method according to claim 1, characterized in that: In the step of causing the driving unit to change the relative position of the subject's head and the X-ray imaging unit, the driving unit causes the subject's head to rise or fall in a direction perpendicular to a floor surface on which the X-ray imaging device is installed.
6. An X-ray image generating device, characterized in that: include: A reference line display part, for displaying a reference line on the subject's head; Camera image acquisition unit; X-ray Radiography Department; Drive unit; as well as X-ray image generation unit, The camera image acquisition unit acquires a first camera image of the subject's head on which the reference line is displayed by the reference line display unit, The X-ray imaging unit acquires a first projection image by imaging a first area of the subject's head. After the driving unit images the first area, the driving unit changes the relative position of the subject's head and the X-ray imaging unit. the camera image acquisition unit acquires a second camera image of the subject's head whose reference line is displayed by the reference line display unit after the relative position is changed, The X-ray imaging unit acquires a second projection image by imaging a second region of the subject's head after changing the relative position. The X-ray image generation unit generates an X-ray image by stitching and reconstructing the first projection image and the second projection image based on the first camera image and the second camera image. The X-ray image generation unit extracts at least one first feature portion from the first camera image acquired, and extracts at least one second feature portion from the second camera image acquired, extracting the position and angle information of the first feature part from the first camera image based on the reference line to calculate the first posture information of the subject's head, and extracting the position and angle information of the second feature part from the second camera image based on the reference line to calculate the second posture information of the subject's head, The first projection image and the second projection image are stitched and reconstructed based on the first posture information and the second posture information to generate the X-ray image, The first feature part and the second feature part respectively include at least one of the marker points of the image of eyes, eyebrows, nose and mouth, The marking points are points at both ends of each of the eyes, eyebrows, nose and mouth, and angle information relative to the reference line is obtained by connecting the corresponding ends of each of the eyes, eyebrows, nose and mouth with a straight line.
7. The X-ray image generating device according to claim 6, characterized in that: The X-ray image is a three-dimensional CT image or a panoramic image of the whole or part of the subject's head.
8. The X-ray image generating device according to claim 7, characterized in that: The X-ray image is a three-dimensional CT image of the whole or part of the subject's head, The X-ray image generating unit splices the acquired first camera image and the second camera image to generate a matching projection image, and then reconstructs the matching projection image to generate the X-ray image.
9. The X-ray image generating device according to claim 7, characterized in that: The X-ray image is a three-dimensional CT image of the whole or part of the subject's head, After the X-ray image generation unit reconstructs the first projection image and the second projection image respectively, it splices the reconstructed first projection image and the reconstructed second projection image to generate the X-ray image.
10. The X-ray image generating device according to claim 6, characterized in that: The driving unit raises or lowers the subject's head in a direction perpendicular to the ground on which the X-ray imaging device is installed in order to change the relative position between the subject's head and the X-ray imaging unit.
11. The X-ray image generating device according to claim 10, characterized in that: The driving unit includes a jaw support that supports a jaw of the subject's head, and raises or lowers the subject's head by raising or lowering the jaw support.
12. The X-ray image generating device according to claim 6, characterized in that: The system further includes a camera for photographing the subject's head, and the first camera image and the second camera image are photographed by the camera.
13. The X-ray image generating device according to claim 6, characterized in that: The camera image acquisition unit obtains the first camera image and the second camera image via external transmission.
14. A computer-readable recording medium, characterized in that: The computer readable recording medium contains a computer program for executing the X-ray image generating method according to any one of claims 1 to 5.
Citation Information
Patent Citations
X-ray diagnostic apparatus
JP2017063839A
Dental bite block, dental x-ray imaging apparatus and control methdo thereof
KR1020170116776A
System and method for medical imaging
WO2017117517A1
X-ray image display device and method thereof
WO2018074854A1