Target area positioning method and device, equipment, medium and program product

Abstract

The invention provides a method for positioning a target area, and the method comprises the steps: obtaining the volume data of an object to be inspected, and enabling the volume data to correspond to a plurality of image layers; generating a first three-dimensional image of the inspected article in a first direction based on the volume data; a selection area is drawn based on the first three-dimensional image, a second three-dimensional image of the selection area in a second direction is generated, the selection area is composed of one or a plurality of continuous image layers in a plurality of image layers of the volume data, and the first three-dimensional image and the second three-dimensional image have a perspective effect; and determining whether the selected area is the target area based on the second three-dimensional image.

Description

[0001] The present disclosure is a divisional application of the Chinese invention patent application with application number 202010395323.0 (application date: May 11, 2020; invention name: target area positioning method, device, equipment, medium and program product). Technical Field

[0002] Embodiments of the present disclosure relate to radiation imaging, and in particular to a method, apparatus, device, medium, and program product for locating a target area. Background Art

[0003] When conducting a security check on an item being inspected, it is necessary to determine whether the target object exists in the item being inspected, and if so, determine the target area where the target object is located. This process is relatively cumbersome and takes a long time to implement. In the case where objects in the inspected item occlude each other, the area where other objects that occlude the target object are located may be mistakenly selected, resulting in the inability to accurately and efficiently locate the target area. Summary of the invention

[0004] According to an embodiment of the present disclosure, a target area positioning method, apparatus, device, medium and program product are proposed.

[0005] In one aspect of the present disclosure, a target area positioning method is proposed, including: acquiring volume data of an inspected object, the volume data corresponding to multiple image layers; generating a first three-dimensional image of the inspected object in a first direction based on the volume data; drawing a selected area based on the first three-dimensional image, and generating a second three-dimensional image of the selected area in a second direction, the selected area being composed of one or multiple consecutive image layers in the multiple image layers of the volume data, the first three-dimensional image and the second three-dimensional image having a perspective effect; and determining whether the selected area is the target area based on the second three-dimensional image.

[0006] According to an embodiment of the present disclosure, drawing a selected area based on the first three-dimensional image and generating a second three-dimensional image of the selected area in a second direction includes: drawing the selected area based on the first three-dimensional image, wherein an extension plane of the selected area is parallel to the first direction; and generating a second three-dimensional image of the selected area in the second direction, wherein the second direction intersects with the extension plane of the selected area.

[0007] According to an embodiment of the present disclosure, determining whether the selected area is the target area based on the second three-dimensional image includes: determining whether the selected area only contains the envelope area of ​​the target object in the inspected item based on the second three-dimensional image; and if so, taking the selected area as the target area.

[0008] According to an embodiment of the present disclosure, drawing a selection area based on the first three-dimensional image includes: drawing a rectangular two-dimensional area on the first three-dimensional image; and extending the rectangular two-dimensional area along the first direction to form the selection area with the rectangular two-dimensional area as a side, wherein the first long side and the second long side of the rectangular two-dimensional area respectively form a first surface and a second surface of the selection area, the first surface and the second surface are parallel to the first direction, and the second direction intersects with the first surface and the second surface.

[0009] According to an embodiment of the present disclosure, after drawing the rectangular two-dimensional area, the width of the rectangular two-dimensional area is kept unchanged, and the position of the rectangular two-dimensional area is adjusted along the second direction.

[0010] According to an embodiment of the present disclosure, after drawing the rectangular two-dimensional area, the position of the first long side of the rectangular two-dimensional area is adjusted along the second direction; and the position of the second long side of the rectangular two-dimensional area is adjusted along the second direction.

[0011] According to an embodiment of the present disclosure, generating a second three-dimensional image of the selected area in the second direction includes: segmenting three-dimensional volume data for the selected area from the volume data; and generating a second three-dimensional image of the selected area in the second direction based on the three-dimensional volume data.

[0012] According to an embodiment of the present disclosure, the method further includes: after taking the selected area as the target area, adding a label to the selected area; and adding and storing the three-dimensional volume data in a predetermined storage area in association with the label.

[0013] According to an embodiment of the present disclosure, determining whether the selected area is the target area based on the second three-dimensional image includes: using an image recognition algorithm to identify the number of envelope areas in the second three-dimensional image; determining whether the number of envelope areas in the second three-dimensional image is 1; if so, extracting image features of the envelope area in the second three-dimensional image; and when the image features meet predetermined conditions, determining that the selected area only includes the envelope area of ​​the target object.

[0014] According to an embodiment of the present disclosure, it also includes: when it is determined based on the second three-dimensional image that the selected area contains the envelope area of ​​other objects in the inspected item except the target object, generating a third three-dimensional image of the selected area in a third direction; drawing a sub-selected area based on the third three-dimensional image, and the extension plane of the sub-selected area is parallel to the third direction; generating a fourth three-dimensional image of the sub-selected area in a fourth direction, and the fourth direction intersects with the extension plane of the sub-selected area; determining based on the fourth three-dimensional image whether the sub-selected area only contains the envelope area of ​​the target object; and if so, using the sub-selected area as the target area.

[0015] According to an embodiment of the present disclosure, the acquiring of volume data of the inspected object includes: acquiring the volume data of the inspected object using a computer tomography imaging device.

[0016] According to an embodiment of the present disclosure, the second direction is perpendicular to the extension plane of the selected area.

[0017] According to an embodiment of the present disclosure, the second three-dimensional image is generated based on the selected area and changes with the change of the position and / or thickness of the selected area. The second three-dimensional image is used to reflect the content contained in the selected area and eliminate other areas outside the selected area.

[0018] In another aspect of the present disclosure, a device for locating a target area is proposed, comprising: an acquisition module for acquiring volume data of an inspected object, the volume data corresponding to multiple image layers; a first projection module for generating a first three-dimensional image of the inspected object in a first direction based on the volume data; a drawing module for drawing a selected area based on the first three-dimensional image; a second projection module for generating a second three-dimensional image of the selected area in a second direction, the selected area being composed of one or multiple consecutive image layers of the multiple image layers of the volume data; and a determination module for determining whether the selected area is the target area based on the second three-dimensional image.

[0019] In another aspect of the present disclosure, an electronic device is provided, comprising a memory and at least one processor. The memory is used to store instructions. The at least one processor executes the instructions stored in the memory to implement the method described in any of the above embodiments.

[0020] In another aspect of the present disclosure, a computer-readable storage medium is provided, on which computer instructions are stored. When the computer instructions are executed by a processor, the method described in any of the above embodiments is implemented.

[0021] In another aspect of the present disclosure, a computer program product is provided, comprising executable instructions, which implement the method described in any of the above embodiments when executed by a processor.

[0022] By using the solution of the above-mentioned embodiment of the present disclosure, by introducing a volume rendering image with a perspective effect, the target area can be quickly and accurately located from the three-dimensional overall perspective, so that the target object inside the three-dimensional image can be quickly identified with fewer operation steps. At the same time, the first three-dimensional image is used as the main view and the second three-dimensional image is used as the auxiliary view, and the distribution range of the selected layer drawn based on the first three-dimensional image can be assisted in determining based on the second three-dimensional image. The identification and monitoring of the selected layer are completed under the two perspectives of the first three-dimensional image and the second three-dimensional image, which can avoid misidentification as much as possible. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to better understand the embodiments of the present disclosure, the embodiments of the present disclosure will be described in detail according to the following drawings:

[0024] Figure 1 The application scenario of the target area positioning method and device according to the embodiment of the present disclosure is schematically shown;

[0025] Figure 2 A flowchart of a method for locating a target area according to an embodiment of the present disclosure is schematically shown;

[0026] Figure 3A~Figure 3B Schematically showing an example diagram of a first projection image and a second projection image according to an embodiment of the present disclosure;

[0027] Figure 3C~Figure 3D Schematically showing an example diagram of a first projection image and a second projection image according to another embodiment of the present disclosure;

[0028] Figure 4 An exemplary flow chart of a method for locating a target area according to another embodiment of the present disclosure is schematically shown;

[0029] Figure 5A Schematically illustrates an example diagram of a rectangular two-dimensional area according to an embodiment of the present disclosure;

[0030] Figure 5B An example diagram of a selection layer according to an embodiment of the present disclosure is schematically shown;

[0031] Figure 6 An exemplary flow chart of a method for locating a target area according to another embodiment of the present disclosure is schematically shown;

[0032] Figure 7 An exemplary flow chart of a method for locating a target area according to another embodiment of the present disclosure is schematically shown;

[0033] Figure 8 A block diagram schematically shows a target area positioning device according to an embodiment of the present disclosure; and

[0034] Fig. 9 A block diagram of an electronic device according to an embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0035] The specific embodiments of the present disclosure will be described in detail below. It should be noted that the embodiments described herein are only for illustration and are not intended to limit the present disclosure. In the following description, a large number of specific details are set forth in order to provide a thorough understanding of the present disclosure. However, it is apparent to those of ordinary skill in the art that these specific details need not be adopted to implement the present disclosure. In other examples, in order to avoid confusing the present disclosure, known structures, materials or methods are not specifically described.

[0036] Throughout the specification, references to "one embodiment," "an embodiment," "an example," or "an example" mean that a particular feature, structure, or characteristic described in conjunction with the embodiment or example is included in at least one embodiment of the present disclosure. Therefore, the phrases "in one embodiment," "in an embodiment," "an example," or "an example" appearing in various places throughout the specification do not necessarily all refer to the same embodiment or example. In addition, particular features, structures, or characteristics may be combined in one or more embodiments or examples in any appropriate combination and / or subcombination. In addition, those of ordinary skill in the art will appreciate that the term "and / or" as used herein includes any and all combinations of one or more of the associated listed items.

[0037] The embodiments of the present disclosure propose a method, device, equipment, medium and program product for locating a target area. Among them, the target area locating method may include an acquisition process, a first projection process, a drawing process, a second projection process, a determination process and a positioning process. In the acquisition process, the first three-dimensional volume data of the inspected object is acquired. Then the first projection process is performed, and based on the first three-dimensional volume data, a first projection image of the inspected object in the first direction is generated. In the drawing process, a selection layer is drawn on the first projection image, and the selection layer is parallel to the first direction. Then the second projection process is performed to generate a second projection image of the selected layer in the second direction, and the second direction is perpendicular to the selected layer. In the determination process, it is determined based on the second projection image whether the selected layer only contains the envelope area of ​​the target object in the inspected object. If so, a positioning process is performed, and the selected layer is used as the target area.

[0038] Figure 1 The application scenario of the target area positioning method and device according to the embodiment of the present disclosure is schematically shown. It should be noted that: Figure 1The examples shown are merely scenarios in which the embodiments of the present disclosure can be applied, to help those skilled in the art understand the technical content of the present disclosure, but do not mean that the embodiments of the present disclosure cannot be used in other devices, systems, environments or scenarios.

[0039] like Figure 1 As shown, the application scenario exemplarily shows a schematic diagram of the structure of the electronic device 100. In this example, the electronic device 100 is a CT (Computed Tomography) device. In other examples, the electronic device 100 may be a single-energy X-ray detection device, a dual-energy X-ray detection device, etc., which is not limited here. According to an embodiment of the present disclosure, the CT device 100 may include an X-ray source 10, a mechanical motion device 50, a detector and data acquisition system 20, and a control and data processing device 60. The CT device 100 is used to perform CT scanning and data processing on the inspected object 40, such as performing CT scanning and data processing on the inspected items, so as to identify and locate target objects (such as dangerous items, illegal items, etc.) in the inspected items.

[0040] The X-ray source 10 may be, for example, an X-ray machine, and a suitable focal spot size of the X-ray machine may be selected according to the imaging resolution. In other embodiments, an X-ray machine may not be used, but a linear accelerator or the like may be used to generate the X-ray beam.

[0041] The mechanical motion device 50 includes a stage, a frame, a control system, etc. The stage can be translated to adjust the position of the rotation center, and the frame can be translated to align the X-ray source (X-ray machine) 10, the detector, and the rotation center. In this embodiment, the description is made according to the circular scanning trajectory or spiral trajectory of the rotating stage and the fixed frame. Since the movement of the stage and the frame is a relative movement, the method of this embodiment can also be implemented in a way that the stage is stationary and the frame rotates.

[0042] The detector and data acquisition system 20 includes an X-ray detector and a data acquisition circuit. The X-ray detector may use a solid detector, a gas detector or other detectors, but the embodiments of the present disclosure are not limited thereto. The data acquisition circuit includes a readout circuit, an acquisition trigger circuit, and a data transmission circuit.

[0043] The control and data processing device 60 includes, for example, a computer device installed with a control program and a data processing program, which is responsible for completing the control of the operation process of the CT equipment, including mechanical translation, mechanical rotation, electrical control, safety interlock control, etc., and can also process the collected data.

[0044] It should be noted that the target area positioning method provided in the embodiment of the present disclosure can generally be executed by the control and data processing device 60. Accordingly, the target area positioning device provided in the embodiment of the present disclosure can be set in the control and data processing device 60. Alternatively, the target area positioning method provided in the embodiment of the present disclosure can also be executed by a server or server cluster that is different from the control and data processing device 60 and can communicate with the control and data processing device 60. Accordingly, the target area positioning device provided in the embodiment of the present disclosure can also be set in a server or server cluster that is different from the control and data processing device 60 and can communicate with the control and data processing device 60.

[0045] Based on the above application scenarios, when conducting security checks on inspected items, it is necessary to determine whether there is a target object in the inspected items, and determine the target area where the target object is located when there is a target object in the inspected items. In one processing method, transparent areas in the three-dimensional volume data of the inspected object are eliminated through volume rendering methods such as ray casting, and the area where the target object is located is selected within the transmission range of different light rays, and finally a bounding box that tightly envelops the target object is obtained, eliminating the influence of other surrounding areas. This process is relatively cumbersome and takes a long time to implement. In the case where objects in the inspected items occlude each other, the area where other objects that occlude the target object are located may be mistakenly selected, resulting in the inability to accurately and efficiently locate the target area.

[0046] According to an embodiment of the present disclosure, a method for locating a target area is provided to further improve the efficiency and accuracy of locating a target area. The method is exemplarily described below by means of a figure. It should be noted that the sequence number of each operation in the following method is only used as a representation of the operation for the purpose of description, and should not be regarded as indicating the execution order of the various operations. Unless explicitly stated, the method does not need to be executed completely in the order shown.

[0047] Figure 2 The flowchart of the target area positioning method according to the embodiment of the present disclosure is schematically shown.

[0048] like Figure 2 As shown, the method may include the following operations S210~S240.

[0049] In operation S210, volume data of the inspected object is acquired.

[0050] The three-dimensional volume data may be a three-dimensional uniformly distributed data set, that is, a structured data set composed of three-dimensional grids. The first three-dimensional volume data of the inspected object may be obtained by a variety of detection methods, such as the computer tomography imaging technology and X-ray detection technology mentioned above, which are not limited here.

[0051] In operation S220, a first three-dimensional image of the inspected object in a first direction is generated based on the volume data.

[0052] The first direction may be any direction, and there may be no restriction when selecting the direction. For example, the projection image may be a DR (Digital Radiography) image.

[0053] In operation S230, a selected area is drawn based on the first three-dimensional image, and a second three-dimensional image of the selected area in the second direction is generated. The selected area may be a layer area, and an extension plane of the selected layer is parallel to the first direction.

[0054] Exemplarily, the volume data of the inspected object may correspond to multiple image layers, and the selected area may be composed of one or multiple consecutive image layers in the multiple image layers. The one or multiple consecutive image layers included in the selected area are all parallel to the first direction. Therefore, in the following examples, the selected area is also referred to as a selected layer.

[0055] In operation S240, it is determined whether the selected area is the target area based on the second three-dimensional image.

[0056] Exemplarily, after determining the selected layer, the direction intersecting with the extension plane of the selected layer can be determined as the second direction, that is, the second direction intersects with one or more consecutive image layers contained in the selected layer. Thus, a second three-dimensional image of the selected layer in the second direction can be generated. In an embodiment of the present disclosure, the first three-dimensional image and the second three-dimensional image can both be projection images with perspective effects established based on a perspective projection model. In the examples below, the first three-dimensional image and the second three-dimensional image are also referred to as the first projection image and the second projection image, respectively. For example, the first direction can be perpendicular to the second direction.

[0057] Reference below Figure 3A~3D The first projection image and the second projection image are exemplarily described. Figure 3A Schematically shows an example diagram of a first projection image according to an embodiment of the present disclosure, Figure 3B An example diagram of a second projection image according to an embodiment of the present disclosure is schematically shown. Figure 3C Schematically shows an example diagram of a first projection image according to another embodiment of the present disclosure, Figure 3DAn example diagram of a second projection image according to another embodiment of the present disclosure is schematically shown. The first projection image and the second projection image shown in this example are displayed as grayscale images. In other examples, the first projection image and the second projection image can also be displayed as pseudo-color images based on various color models (such as HSV (Hue, Saturation, Value) color model, RGB (Red, Green, Blue) color model, etc.).

[0058] exist Figure 3A~3B In the example shown, for example, in the o-xyz coordinate system, the x direction is the first direction and the y direction is the second direction. Figure 3A The first projection image 301 of the inspected object in the first direction is shown. In the first projection image 301, the first direction is perpendicular to the paper surface. A selection layer 302 is drawn based on the first projection image 301. The extension plane of the selection layer 302 is parallel to the first direction. In this example, the selection layer 302 can be composed of only one image layer. The image layer extends perpendicular to the paper surface. In this case, the thickness of the selection layer 302 is 1 pixel. Figure 3A The selected layer 302 shown on the left can determine a second direction perpendicular to the extension plane of the selected layer 302. For example, in this example, the second direction can be a direction parallel to the paper surface upward or downward. In other examples, the second direction changes with the change of the selected layer 302. Thus, a second projection image 303 of the selected layer 302 in the second direction can be generated. The second projection image 303 is as shown in FIG. Figure 3B Since the selected layer 302 in this example only includes one image layer, the second projection image 303 of the selected layer 302 in the second direction substantially shows the pixel value distribution of the image layer.

[0059] exist Figure 3C~3D In the example shown, for example, in the o-xyz coordinate system, the x direction is the first direction and the y direction is the second direction. Figure 3C The first projection image 301' of the inspected object in the first direction is displayed. In the first projection image 301', the first direction is the direction perpendicular to the paper surface. Based on the first projection image 301', a selection layer 302' is drawn. In this example, the selection layer 302' can be composed of N continuous image layers, and the N image layers extend perpendicular to the paper surface. At this time, the thickness of the selection layer 302' is N pixels, where N is an integer greater than 1. Figure 3C The selected layer 302' shown in FIG. 1 can determine a second direction perpendicular to the extension plane of the selected layer 302'. Thus, a second projection image 303' of the selected layer 302' in the second direction can be generated. The second projection image 303' is as shown in FIG. Figure 3D shown.

[0060] according to Figures 3A to 3D As shown, since the second projection image is generated based on the selected layer, as the position and / or thickness of the selected layer drawn based on the first projection image changes, the second projection image will also change accordingly. The second projection image will reflect the content contained in the selected layer drawn based on the first projection image. Therefore, according to an embodiment of the present disclosure, the first projection image can be used as the main view, and the second projection image can be used as the auxiliary view, and the second projection image can be used to assist in determining whether the selected layer drawn based on the first projection image is the area where the target object is located.

[0061] It is also possible to determine whether the selected layer only includes the envelope area of ​​the target object in the inspected article based on the second projection image. If yes, then in the case of determining that the selected layer only includes the envelope area of ​​the target object in the inspected article, the selected layer is used as the target area.

[0062] Exemplarily, the second projection image can be identified by image processing and computer vision algorithms to determine whether the selected layer uniquely contains the envelope area of ​​the target object, and the selected layer that uniquely contains the envelope area of ​​the target object is used as the target area.

[0063] Those skilled in the art can understand that the target area positioning method according to the embodiment of the present disclosure uses the first projection image as the main view and the second projection image as the auxiliary view, and uses the second projection image to assist in determining the distribution range of the selected layer drawn based on the first projection image. When it is determined that the envelope area in the selected layer uniquely contains the target object, the selected layer is determined to be the target area. The identification and monitoring of the selected layer are completed under the two perspectives of the first projection image and the second projection image, which can avoid misidentification as much as possible. In addition, since the second projection image completely eliminates the influence of other areas except the selected layer, it can be quickly and accurately determined whether the selected layer drawn in the first projection image is the target area based on the second projection image, thereby improving the efficiency and accuracy of target area positioning.

[0064] Figure 4 An example flowchart of a method for locating a target area according to another embodiment of the present disclosure is schematically shown to illustrate an exemplary implementation process of the above operation S230.

[0065] like Figure 4 As shown, the process of drawing the selected area based on the first three-dimensional image may include operations S231-S232.

[0066] In operation S231, a rectangular two-dimensional area is drawn on the first projection image.

[0067] Exemplarily, according to an embodiment of the present disclosure, the process of forming a rectangular two-dimensional area in the first projection image may include: based on a first trigger operation on a specified point in the first projection image, generating a rectangular two-dimensional area including the specified point. The rectangular two-dimensional area may include a first long side and a second long side. The rectangular two-dimensional area may be arbitrarily drawn in the first projection image as needed, and is not limited here.

[0068] Figure 5A An example diagram of a rectangular two-dimensional area according to an embodiment of the present disclosure is schematically shown. Figure 5A As shown, for example, the first trigger operation may be a click operation. After generating a first projection image 500 of the inspected object in the first direction, the first projection image 500 is displayed. It can be understood that Figure 5A In the example shown, the first direction is perpendicular to the paper surface. When the user is more concerned about a certain area in the first projection image (for example, when the user believes that a certain area in the first projection image is suspected to be a target object), any point in the area can be clicked as a designated point. In response to the user's click operation on the designated point A on the first projection image 500, a rectangular two-dimensional area 501 including the designated point A is generated. The rectangular two-dimensional area includes a first long side 5011 and a second long side 5012.

[0069] In another embodiment of the present disclosure, the process of forming a rectangular two-dimensional area in the projection image may also include: based on the user's operation of drawing a closed trajectory in the first projection image, forming a rectangular two-dimensional area with the closed trajectory as a boundary in the projection image.

[0070] Continue to refer Figure 4 In operation S232, the rectangular two-dimensional area is extended along the first direction to form a selection layer with the rectangular two-dimensional area as a side.

[0071] The first long side and the second long side of the rectangular two-dimensional area respectively form the first surface and the second surface of the selection layer, the first surface and the second surface are parallel to the first direction, and the second direction is perpendicular to the first surface and the second surface.

[0072] Figure 5B An example diagram of a selection layer according to an embodiment of the present disclosure is schematically shown. Figure 5B As shown, after forming a rectangular two-dimensional area 501, the rectangular two-dimensional area 501 is extended along a first direction to form a selection layer 502 with the rectangular two-dimensional area 501 as a side. The selection layer 502 includes a first surface 5021 and a second surface 5022 opposite to each other. In this example, the direction perpendicular to the first surface 5021 and the second surface 5022 can be determined as the second direction.

[0073] According to an embodiment of the present disclosure, the process of generating the second projection image of the selected layer in the second direction includes: segmenting the second three-dimensional volume data for the selected layer from the first three-dimensional volume data. Then, based on the second three-dimensional volume data, generating the second projection image of the selected layer in the second direction.

[0074] exist Figure 5B In the example shown, in the first three-dimensional volume data of the inspected object, the three-dimensional volume data for the selected layer 502 can be used as second three-dimensional volume data segmented from the first three-dimensional volume data.

[0075] Since the above-mentioned rectangular two-dimensional area is formed based on the user's first trigger operation on the first projection image, it means that the actual position of the target object should be in the depth direction (first direction) of the rectangular two-dimensional area. Therefore, by extending the rectangular two-dimensional area in the depth direction, the selected layer formed can contain the area where the target object is located with a high probability, and the area where the target object is located will not be mistakenly deleted while narrowing the positioning range. Furthermore, judging the content contained in the selected layer from the perspective of the second projection image (with the second direction as the depth direction) can quickly and accurately locate the target area.

[0076] Figure 6 A flowchart of a method for locating a target area according to another embodiment of the present disclosure is schematically shown. Figure 2 Compared with the embodiment shown, the difference is Figure 6 After drawing the selected area, the target area positioning method shown may further include: operation S270, adjusting the selected layer in the first projection image. Each time the selected layer is adjusted, operation S240 is repeatedly performed to correspondingly update the second projection image of the selected layer in the second direction.

[0077] In addition, when it is determined in operation S250 based on the second projection image that the selected layer does not only include the envelope area of ​​the target object, the process may return to operation S270 to continue adjusting the selected layer.

[0078] Exemplarily, the manner of adjusting the selected layer in the above operation S270 may include the following two manners, for example, to change the distribution range of the selected layer in the first three-dimensional volume data.

[0079] Method 1: The thickness of the selected layer is fixed, and the position of the selected layer is adjusted along the second direction. For example, the thickness value of the selected layer is equal to the initial value preset in the configuration table. Figure 5A In the first projection image shown, the width of the rectangular two-dimensional area 501 is kept unchanged, and the position of the rectangular two-dimensional area 501 is adjusted along the second direction. During the adjustment process, the first long side 5011 and the second long side 5012 move synchronously.

[0080] In the second method, the thickness of the selected layer is not fixed, and the positions of the first surface and the second surface of the selected layer are adjusted along the second direction. Figure 5A In the first projection image shown, the position of the first long side 5011 of the rectangular two-dimensional area 501 is adjusted along the second direction, and the position of the second long side 5012 of the rectangular two-dimensional area 501 is adjusted along the second direction.

[0081] The above adjustment process can be automatically performed by a computer device, for example, the moving object is set to be the first long side and / or the second long side, the moving direction is the second direction, and the moving step length is a predetermined number of pixels each time. After a predetermined number of movements, it is determined that one operation S270 is completed. By continuously adjusting the selected layer, a target area that more tightly wraps the target object can be located.

[0082] According to an embodiment of the present disclosure, the process of determining whether the selected layer only contains the envelope area of ​​the target object in the inspected item based on the second projection image may include: using an image recognition algorithm to identify the number of envelope areas in the second projection image. Determine whether the number of envelope areas in the second projection image is 1. If yes, it means that the selected layer only contains one envelope area, and then extract the image features of the envelope area according to the distribution of pixel values ​​in the envelope area, for example, extract one or more image features such as density features, atomic sequence features, key point features, etc. of the envelope area. When the extracted image features meet the predetermined conditions, it is determined that the selected layer only contains the envelope area of ​​the target object. Exemplarily, the predetermined conditions may be one or more image features of the target object stored in advance, and the extracted image features may be matched with the pre-stored image features. When the match is successful, it is determined that the extracted image features meet the predetermined conditions, indicating that the only envelope area in the selected layer is the envelope area of ​​the target object, thereby determining that the selected layer is the target area.

[0083] Figure 7 An example flowchart of a target area positioning method according to another embodiment of the present disclosure is schematically shown.

[0084] like Figure 7 As shown, the method may include operations S701 to S711. Operations S701 to S706 may be performed by Figure 2 Operations S210 to S260 are implemented in the same manner and will not be described again. In operation S706, when it is determined based on the second projection image that the selected layer includes an envelope area of ​​other objects in the inspected object except the target object, operation S707 is performed.

[0085] In operation S707, a third projection image of the selected layer in a third direction is generated.

[0086] The third direction can be selected arbitrarily as needed. When the third direction is the same as the second direction, the third projection image is the same as the second projection image, and the generated second projection image can be directly acquired.

[0087] In operation S708, a sub-selected layer is drawn based on the third projection image, and an extension plane of the sub-selected layer is parallel to the third direction.

[0088] This process is the same as the principle of drawing the selected layer based on the first projection image, which has been described in detail above and will not be repeated here.

[0089] In operation S709, a fourth projection image of the sub-selected layer in a fourth direction is generated, and the fourth direction is perpendicular to the extension plane of the sub-selected layer.

[0090] This process is the same as the principle of generating the second projection image in the above text, and will not be repeated here.

[0091] Then, in operation S710, it is determined whether the sub-selected layer only contains the envelope area of ​​the target object based on the fourth projection image. The determination process is the same as the principle of determining whether the selected layer only contains the envelope area of ​​the target object based on the second projection image in the above text, and will not be repeated here. If yes, then operation S711 is performed. If not, the sub-selected layer is re-determined according to the above logic until the sub-selected layer that only contains the envelope area of ​​the target object is located.

[0092] In operation S711, the sub-selection layer is used as a target area.

[0093] According to the embodiment of the present disclosure, Figure 7 The target area positioning method shown may also include: in operation S712, after determining the target area, adding a label to the target area. And in operation S713, the three-dimensional volume data for the target area is added and stored in a predetermined storage area in association with the label. Exemplarily, when the selected layer is determined to be the target area, the three-dimensional volume data for the target area is the second three-dimensional volume data mentioned above. Similarly, when a sub-selected layer is determined to be the target area, the three-dimensional volume data for the sub-selected layer is segmented from the first three-dimensional volume data as the three-dimensional volume data of the target area. The content of the label may be, for example, an identifier, identification information, etc., to indicate that the three-dimensional volume data stored in association with the label is the three-dimensional volume data of the target area.

[0094] Figure 8 A block diagram of a target area positioning device according to an embodiment of the present disclosure is schematically shown.

[0095] like Figure 8As shown, the target area positioning device 800 may include: an acquisition module 810 , a first projection module 820 , a drawing module 830 , a second projection module 840 , a determination module 850 and a positioning module 860 .

[0096] The acquisition module 810 is used to acquire first three-dimensional volume data of the inspected object.

[0097] The first projection module 820 is used to generate a first projection image of the inspected object in a first direction based on the first three-dimensional volume data.

[0098] The drawing module 830 is used to draw a selected layer based on the first projection image, where an extension plane of the selected layer is parallel to the first direction.

[0099] The second projection module 840 is used to generate a second projection image of the selected layer in a second direction, where the second direction is perpendicular to the extension plane of the selected layer.

[0100] The determination module 850 is used to determine whether the selected layer only includes the envelope area of ​​the target object in the inspected object based on the second projection image.

[0101] The positioning module 860 is used to use the selected layer as the target area when the selected layer only includes the envelope area of ​​the target object.

[0102] It should be noted that the implementation methods, technical problems solved, functions realized, and technical effects achieved of each module / unit / sub-unit in the device part embodiment are the same or similar to the implementation methods, technical problems solved, functions realized, and technical effects achieved of each corresponding step in the method part embodiment, and will not be repeated here.

[0103] Fig. 9 A block diagram of an electronic device for implementing the method described above according to an embodiment of the present disclosure is schematically shown. Fig. 9 The device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0104] like Fig. 9As shown, the device 900 according to an embodiment of the present disclosure includes a processor 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage part 908 to a random access memory (RAM) 903. The processor 901 may include, for example, a general-purpose microprocessor (e.g., a CPU), an instruction set processor and / or a related chipset and / or a dedicated microprocessor (e.g., an application-specific integrated circuit (ASIC)), etc. The processor 901 may also include an onboard memory for caching purposes. The processor 901 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present disclosure.

[0105] In RAM 903, various programs and data required for the operation of device 900 are stored. Processor 901, ROM 902 and RAM 903 are connected to each other through bus 904. Processor 901 performs various operations of the method flow according to the embodiment of the present disclosure by executing the program in ROM 902 and / or RAM 903. It should be noted that the program can also be stored in one or more memories other than ROM 902 and RAM 903. Processor 901 can also perform various operations of the method flow according to the embodiment of the present disclosure by executing the program stored in the one or more memories.

[0106] According to an embodiment of the present disclosure, the device 900 may further include an input / output (I / O) interface 905, which is also connected to the bus 904. The device 900 may further include one or more of the following components connected to the I / O interface 905: an input portion 906 including a keyboard, a mouse, etc.; an output portion 907 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage portion 908 including a hard disk, etc.; and a communication portion 909 including a network interface card such as a LAN card, a modem, etc. The communication portion 909 performs communication processing via a network such as the Internet. A drive 910 is also connected to the I / O interface 905 as needed. A removable medium 911, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 910 as needed, so that a computer program read therefrom is installed into the storage portion 908 as needed.

[0107] According to an embodiment of the present disclosure, the method flow according to an embodiment of the present disclosure can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable storage medium, and the computer program contains a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 909, and / or installed from the removable medium 911. When the computer program is executed by the processor 901, the above-mentioned functions defined in the system of the embodiment of the present disclosure are executed. According to an embodiment of the present disclosure, the system, equipment, device, module, unit, etc. described above can be implemented by a computer program module.

[0108] According to an embodiment of the present disclosure, the electronic device described above may be used to implement the target object positioning method according to an embodiment of the present disclosure.

[0109] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or may exist independently without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, the method according to the embodiment of the present disclosure is implemented.

[0110] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operations of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0111] It will be appreciated by those skilled in the art that, although the present disclosure has been shown and described with reference to specific exemplary embodiments of the present disclosure, it will be appreciated by those skilled in the art that, without departing from the spirit and scope of the present disclosure as defined by the appended claims and their equivalents, various changes in form and detail may be made to the present disclosure. Therefore, the scope of the present disclosure should not be limited to the above-described embodiments, but should be determined not only by the appended claims, but also by the equivalents of the appended claims.

Claims

1. A method for locating a target area, comprising: Acquire volume data of the inspected object, wherein the volume data corresponds to a plurality of image layers; Based on the volume data, generating a first three-dimensional image of the inspected object in a first direction; Drawing a selected area based on the first three-dimensional image, and generating a second three-dimensional image of the selected area in a second direction, wherein the selected area is composed of one or a plurality of consecutive image layers of the plurality of image layers of the volume data, and the first three-dimensional image and the second three-dimensional image have a perspective effect; as well as Determine whether the selected area is the target area based on the second three-dimensional image.

2. The method according to claim 1, wherein: Drawing the selected area based on the first three-dimensional image and generating a second three-dimensional image of the selected area in the second direction comprises: Drawing a selected area based on the first three-dimensional image, wherein an extension plane of the selected area is parallel to the first direction; A second three-dimensional image of the selected area in a second direction is generated, where the second direction intersects with an extension plane of the selected area.

3. The method according to claim 1 or 2, wherein: Determining whether the selected area is the target area based on the second three-dimensional image includes: Determining whether the selected area only includes the envelope area of ​​the target object in the inspected object based on the second three-dimensional image; and If yes, the selected area is used as the target area.

4. The method according to claim 3, wherein: Drawing the selected area based on the first three-dimensional image comprises: drawing a rectangular two-dimensional area on the first three-dimensional image; and The rectangular two-dimensional area is extended along the first direction to form the selected area with the rectangular two-dimensional area as the side, wherein the first long side and the second long side of the rectangular two-dimensional area respectively form the first surface and the second surface of the selected area, the first surface and the second surface are parallel to the first direction, and the second direction intersects with the first surface and the second surface.

5. The method according to claim 4, further comprising: After drawing the rectangular two-dimensional area, the width of the rectangular two-dimensional area is kept unchanged, and the position of the rectangular two-dimensional area is adjusted along the second direction.

6. The method according to claim 4, further comprising: After drawing the rectangular two-dimensional area, adjusting the position of the first long side of the rectangular two-dimensional area along the second direction; as well as The position of the second long side of the rectangular two-dimensional area is adjusted along the second direction.

7. The method according to any one of claims 1 to 3, wherein: Generating a second three-dimensional image of the selected area in the second direction comprises: Segmenting three-dimensional volume data for the selected area from the volume data; and A second three-dimensional image of the selected area in the second direction is generated based on the three-dimensional volume data.

8. The method according to claim 7, further comprising: After taking the selected area as the target area, adding a label to the selected area; as well as The three-dimensional volume data is added and stored in a predetermined storage area in association with the tag.

9. The method according to any one of claims 1 to 3, wherein: The determining whether the selected area is the target area based on the second three-dimensional image comprises: Using an image recognition algorithm, identifying the number of envelope regions in the second three-dimensional image; determining whether the number of envelope regions in the second three-dimensional image is 1; If yes, extracting image features of the envelope area in the second three-dimensional image; and When the image feature meets a predetermined condition, it is determined that the selected area only includes the envelope area of ​​the target object.

10. The method according to claim 3, further comprising: When it is determined based on the second three-dimensional image that the selected area includes an envelope area of ​​other objects in the inspected object except the target object, generating a third three-dimensional image of the selected area in a third direction; Drawing a sub-selected area based on the third three-dimensional image, wherein an extension plane of the sub-selected area is parallel to the third direction; generating a fourth three-dimensional image of the sub-selected area in a fourth direction, wherein the fourth direction intersects with an extension plane of the sub-selected area; Determining whether the sub-selected area only includes the envelope area of ​​the target object based on the fourth three-dimensional image; as well as If yes, the sub-selected area is used as the target area.

11. The method according to claim 1, wherein: The step of obtaining the volume data of the inspected object comprises: The volume data of the inspected object is acquired using a computer tomography imaging device.

12. The method according to claim 2, wherein: The second direction is perpendicular to an extension plane of the selected area.

13. The method according to any one of claims 1 to 2, 4 to 6, 8, 11 to 12, wherein: The second three-dimensional image is generated according to the selected area and changes with the change of the position and / or thickness of the selected area. The second three-dimensional image is used to reflect the content included in the selected area and exclude other areas outside the selected area.

14. A device for locating a target area, comprising: An acquisition module, used to acquire volume data of the inspected object, wherein the volume data corresponds to a plurality of image layers; A first projection module, configured to generate a first three-dimensional image of the inspected object in a first direction based on the volume data; A drawing module, used for drawing a selected area based on the first three-dimensional image; A second projection module is used to generate a second three-dimensional image of the selected area in a second direction, the selected area is composed of one or a plurality of consecutive image layers of the plurality of image layers of the volume data, and the first three-dimensional image and the second three-dimensional image have a perspective effect; as well as A determination module is used to determine whether the selected area is the target area based on the second three-dimensional image.

15. An electronic device, comprising: A memory for storing instructions; At least one processor: The at least one processor executes instructions stored in the memory to implement the method according to any one of claims 1 to 13.

16. A computer-readable storage medium having computer instructions stored thereon, wherein the computer instructions, when executed by a processor, implement the method according to any one of claims 1 to 13.

17. A computer program product, comprising executable instructions, which, when executed by a processor, implement the method according to any one of claims 1 to 13.

Images