Target object positioning method, device, equipment, medium and program product

Abstract

The present disclosure provides a method for locating a target object, comprising: obtaining first three-dimensional volume data of checked luggage. Based on the first three-dimensional volume data, generating a projection image of the checked luggage in any direction. Based on the projection image, segmenting second three-dimensional volume data from the first three-dimensional volume data, and determining at least one envelope area for at least one object in the checked luggage based on the second three-dimensional volume data. Then, determining the envelope area of ​​the target object from the determined at least one envelope area. The present disclosure also provides a device, apparatus, medium and program product for locating a target object.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to radiation imaging, and more particularly to a method, apparatus, device, medium, and program product for locating a target object. Background Art

[0002] When conducting security inspection on checked luggage, it is necessary to determine whether there is a target object in the checked luggage, and locate the target object if there is a target object in the checked luggage. Generally, mutual occlusion between objects in the checked luggage will bring many obstacles to the identification and location of the target object, resulting in a long time and cumbersome operation process for users. Summary of the invention

[0003] According to an embodiment of the present disclosure, a target object positioning method, apparatus, device, medium and program product are proposed.

[0004] In one aspect of the present disclosure, a method for locating a target object is provided, comprising: obtaining first three-dimensional volume data of checked luggage. Based on the first three-dimensional volume data, generating a projection image of the checked luggage in any direction. Based on the projection image, segmenting second three-dimensional volume data from the first three-dimensional volume data, and determining at least one envelope region for at least one object in the checked luggage based on the second three-dimensional volume data. Then, determining an envelope region of the target object from the determined at least one envelope region.

[0005] According to an embodiment of the present disclosure, the above-mentioned segmenting the second three-dimensional volume data from the first three-dimensional volume data based on the projection image includes: forming a two-dimensional effective area in the projection image. Extending the two-dimensional effective area along any of the above-mentioned directions to form a columnar three-dimensional area with the two-dimensional effective area as a cross-section. The three-dimensional volume data for the columnar three-dimensional area is used as the second three-dimensional volume data.

[0006] According to an embodiment of the present disclosure, the above-mentioned formation of a two-dimensional effective area in the projection image includes: obtaining size parameters of a predetermined shape, and, based on a first trigger operation for a specified point in the projection image, generating a two-dimensional effective area of ​​a predetermined shape centered on the specified point and conforming to the size parameters.

[0007] According to an embodiment of the present disclosure, the obtaining of the size parameters of the predetermined shape includes: obtaining the size parameters of the predetermined shape pre-configured in the configuration table.

[0008] According to an embodiment of the present disclosure, the above-mentioned acquiring the size parameters of the predetermined shape includes: determining the size parameters of the predetermined shape according to the size parameters of the projection image, so that the size parameters of the predetermined shape are in a predetermined ratio with the size parameters of the projection image.

[0009] According to an embodiment of the present disclosure, the determining of at least one envelope region for at least one object in the checked luggage based on the second three-dimensional volume data includes: using an image recognition algorithm to segment at least one group of three-dimensional volume data that meets predetermined image features from the second three-dimensional volume data. Then, determining at least one envelope region based on the at least one group of three-dimensional volume data.

[0010] According to an embodiment of the present disclosure, determining the envelope area of ​​the target object from at least one envelope area includes: calculating the priority of each of the at least one envelope area. Displaying the at least one envelope area in order from high to low according to the calculated priority. And, based on a second trigger operation for any envelope area in the at least one envelope area, determining the any envelope area as the envelope area of ​​the target object.

[0011] According to an embodiment of the present disclosure, the above-mentioned calculation of the priority of each of the at least one envelope region includes: for each envelope region of the at least one envelope region, obtaining the attribute parameters of the envelope region, and calculating the priority of the envelope region according to the attribute parameters of the envelope region.

[0012] According to an embodiment of the present disclosure, the above-mentioned acquisition of the attribute parameters of the envelope area includes at least one of the following: calculating the volume of the envelope area based on the three-dimensional volume data of the envelope area; calculating the density of the envelope area based on the three-dimensional volume data of the envelope area; and calculating the position coordinates of the envelope area in the above-mentioned projection image based on the three-dimensional volume data of the envelope area.

[0013] According to an embodiment of the present disclosure, the above-mentioned displaying the at least one envelope area in order from high to low priority includes: sorting the at least one envelope area in order from high to low priority to obtain a display sequence. Displaying starts from the first envelope area in the display sequence. When displaying an image of any envelope area in the display sequence, based on a third trigger operation for any envelope area, switching to display the subsequent envelope area of ​​any envelope area in the display sequence, and, based on a fourth trigger operation for any envelope area, switching to display the first envelope area in the display sequence.

[0014] According to an embodiment of the present disclosure, the method further includes: after determining that any envelope region is the envelope region of the target object, adding a label to the any envelope region, and adding and storing the three-dimensional volume data of the any envelope region and the label in association with each other to a predetermined storage area.

[0015] According to an embodiment of the present disclosure, the step of obtaining the first three-dimensional volume data of the checked luggage includes: obtaining the first three-dimensional volume data of the checked luggage using a computer tomography imaging device.

[0016] In another aspect of the present disclosure, a target object positioning device is proposed, comprising: an acquisition module, a projection module, a segmentation module, a determination module and a positioning module. The acquisition module is used to acquire first three-dimensional volume data of the checked luggage. The projection module is used to generate a projection image of the checked luggage in any direction based on the first three-dimensional volume data. The segmentation module is used to segment second three-dimensional volume data from the first three-dimensional volume data based on the projection image. The determination module is used to determine at least one envelope area for at least one object in the checked luggage based on the second three-dimensional volume data. The positioning module is used to determine the envelope area of ​​the target object from the determined at least one envelope area.

[0017] In another aspect of the present disclosure, an electronic device is provided, comprising a memory and at least one processor. The memory is used to store instructions. The at least one processor executes the instructions stored in the memory to implement the method described in any of the above embodiments.

[0018] In another aspect of the present disclosure, a computer-readable storage medium is provided, on which computer instructions are stored. When the computer instructions are executed by a processor, the method described in any of the above embodiments is implemented.

[0019] In another aspect of the present disclosure, a computer program product is provided, comprising executable instructions, which implement the method described in any of the above embodiments when executed by a processor.

[0020] By utilizing the solution of the above-mentioned embodiment of the present disclosure, projection can be performed in only one direction based on the first three-dimensional volume data of the checked luggage, and the second three-dimensional volume data of a partial area can be segmented from the first three-dimensional volume data of the checked luggage based on the projection image, thereby greatly reducing the positioning range of the target object. Furthermore, the envelope area of ​​each of at least one object contained in the checked luggage is determined based on the second three-dimensional volume data, so as to determine the envelope area of ​​the target object from the at least one envelope-free area. The above-mentioned process does not require multiple changes of viewing angles to pick up the area where the target object is located, nor does it require consideration of whether there are other objects in any of the above-mentioned directions that block the target object. In addition, the reduction of the positioning range simplifies the positioning process of the target object and improves the efficiency and accuracy of the positioning of the target object. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to better understand the embodiments of the present disclosure, the embodiments of the present disclosure will be described in detail according to the following drawings:

[0022] Figure 1 The application scenario of the target object positioning method and device according to the embodiment of the present disclosure is schematically shown;

[0023] Figure 2A flowchart of a target object positioning method according to an embodiment of the present disclosure is schematically shown;

[0024] Figure 3 An exemplary flow chart of a method for locating a target object according to another embodiment of the present disclosure is schematically shown;

[0025] Figure 4A Schematically illustrates an example diagram of a two-dimensional effective area according to an embodiment of the present disclosure;

[0026] Figure 4B Schematically shows an example diagram of a columnar three-dimensional area according to an embodiment of the present disclosure;

[0027] Figure 5 An exemplary flow chart of a method for locating a target object according to another embodiment of the present disclosure is schematically shown;

[0028] Figure 6 A block diagram schematically shows a target object positioning device according to an embodiment of the present disclosure; and

[0029] Figure 7 A block diagram of an electronic device according to an embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0030] The specific embodiments of the present disclosure will be described in detail below. It should be noted that the embodiments described herein are only for illustration and are not intended to limit the present disclosure. In the following description, a large number of specific details are set forth in order to provide a thorough understanding of the present disclosure. However, it is apparent to those of ordinary skill in the art that these specific details need not be adopted to implement the present disclosure. In other examples, in order to avoid confusing the present disclosure, known structures, materials or methods are not specifically described.

[0031] Throughout the specification, references to "one embodiment," "an embodiment," "an example," or "an example" mean that a particular feature, structure, or characteristic described in conjunction with the embodiment or example is included in at least one embodiment of the present disclosure. Therefore, the phrases "in one embodiment," "in an embodiment," "an example," or "an example" appearing in various places throughout the specification do not necessarily all refer to the same embodiment or example. In addition, particular features, structures, or characteristics may be combined in one or more embodiments or examples in any appropriate combination and / or subcombination. In addition, those of ordinary skill in the art will appreciate that the term "and / or" as used herein includes any and all combinations of one or more of the associated listed items.

[0032] The embodiments of the present disclosure propose a method, device, equipment, medium and program product for locating a target object. The method for locating a target object may include an acquisition process, a projection process, a segmentation process, a determination process and a positioning process. In the acquisition process, the first three-dimensional volume data of the checked luggage is acquired. Then a projection process is performed to generate a projection image of the checked luggage in any direction based on the first three-dimensional volume data. In the segmentation process, based on the projection image, second three-dimensional volume data is segmented from the first three-dimensional volume data. In the determination process, based on the second three-dimensional volume data, at least one envelope area for at least one object in the checked luggage is determined. Then a positioning process is performed to determine the envelope area of ​​the target object from the determined at least one envelope area.

[0033] Figure 1 The application scenario of the target object positioning method and device according to the embodiment of the present disclosure is schematically shown. It should be noted that: Figure 1 The examples shown are merely scenarios in which the embodiments of the present disclosure can be applied, to help those skilled in the art understand the technical content of the present disclosure, but do not mean that the embodiments of the present disclosure cannot be used in other devices, systems, environments or scenarios.

[0034] like Figure 1 As shown, the application scenario exemplarily shows a schematic diagram of the structure of the electronic device 100. In this example, the electronic device 100 is a CT (Computed Tomography) device. In other examples, the electronic device 100 may be a single-energy X-ray detection device, a dual-energy X-ray detection device, etc., which is not limited here. According to an embodiment of the present disclosure, the CT device 100 may include an X-ray source 10, a mechanical motion device 50, a detector and data acquisition system 20, and a control and data processing device 60. The CT device 100 is used to perform CT scanning and data processing on the inspected object 40, such as performing CT scanning and data processing on the inspected luggage, so as to identify and locate target objects (such as dangerous goods, illegal items, etc.) in the inspected luggage.

[0035] The X-ray source 10 may be, for example, an X-ray machine, and a suitable focal spot size of the X-ray machine may be selected according to the imaging resolution. In other embodiments, an X-ray machine may not be used, but a linear accelerator or the like may be used to generate the X-ray beam.

[0036] The mechanical motion device 50 includes a stage, a frame, and a control system. The stage can be translated to adjust the position of the rotation center, and the frame can be translated to align the X-ray source (X-ray machine) 10, the detector, and the rotation center. In this embodiment, the description is made according to the circular scanning trajectory or spiral trajectory of the rotating stage and the fixed frame. Since the movement of the stage and the frame is a relative movement, the method of this embodiment can also be implemented by using a method in which the stage is stationary and the frame rotates.

[0037] The detector and data acquisition system 20 includes an X-ray detector and a data acquisition circuit. The X-ray detector may use a solid detector, a gas detector or other detectors, but the embodiments of the present disclosure are not limited thereto. The data acquisition circuit includes a readout circuit, an acquisition trigger circuit, and a data transmission circuit.

[0038] The control and data processing device 60 includes, for example, a computer device installed with a control program and a data processing program, which is responsible for completing the control of the operation process of the CT equipment, including mechanical translation, mechanical rotation, electrical control, safety interlock control, etc., and can also process the collected data.

[0039] It should be noted that the target object positioning method provided in the embodiment of the present disclosure can generally be executed by the control and data processing device 60. Accordingly, the target object positioning device provided in the embodiment of the present disclosure can be set in the control and data processing device 60. Alternatively, the target object positioning method provided in the embodiment of the present disclosure can also be executed by a server or server cluster that is different from the control and data processing device 60 and can communicate with the control and data processing device 60. Accordingly, the target object positioning device provided in the embodiment of the present disclosure can also be set in a server or server cluster that is different from the control and data processing device 60 and can communicate with the control and data processing device 60.

[0040] Based on the above application scenarios, when conducting security inspections on checked luggage, it is necessary to determine whether there is a target object in the checked luggage, and to locate the target object if there is a target object in the checked luggage. In one processing method, transparent areas in the three-dimensional volume data of the checked luggage are eliminated by volume rendering methods such as ray casting, and the area where the target object is located is selected multiple times from multiple perspectives within the transmission range of different light rays, and finally a bounding box that tightly envelops the suspect is obtained to eliminate the influence of other surrounding areas. Considering that objects in checked luggage are usually placed overlapping with each other, multiple objects may overlap in the depth direction of any perspective, resulting in the area where the target object of interest is located being blocked. In the positioning process, the area where other objects that overlap with the target object are located may be mistakenly selected, thereby bringing more obstacles to the correct picking of the area where the target object is located. In order to correctly locate the target object, it may be necessary to adjust the perspective more times, which takes a long time, and the user's operation process is also cumbersome, resulting in the inability to achieve an accurate and efficient positioning process.

[0041] According to an embodiment of the present disclosure, a method for locating a target object is provided, which can reduce the impact of mutual occlusion of objects in checked luggage on the positioning of the target object, simplify the user operation process, and improve the efficiency and accuracy of locating the target object. The method is exemplarily described below through a legend. It should be noted that the sequence number of each operation in the following method is only used as a representation of the operation for the purpose of description, and should not be regarded as indicating the execution order of the various operations. Unless explicitly stated, the method does not need to be executed in the order shown.

[0042] Figure 2 The flowchart of the target object positioning method according to the embodiment of the present disclosure is schematically shown.

[0043] like Figure 2 As shown, the method may include the following operations S210 to S250.

[0044] In operation S210, first three-dimensional volume data of checked luggage is acquired.

[0045] The three-dimensional volume data may be a three-dimensional uniformly distributed data set, that is, a structured data set composed of three-dimensional grids. The first three-dimensional volume data of the checked luggage may be obtained by a variety of detection methods, such as the above-mentioned computer tomography imaging technology, X-ray detection technology, etc., which are not limited here.

[0046] In operation S220, a projection image of the checked baggage in any direction is generated based on the first three-dimensional volume data.

[0047] The above-mentioned "any direction" may be any direction, and there may be no restriction when selecting the direction. For example, the projection image may be a DR (Digital Radiography) image.

[0048] In operation S230 , second three-dimensional volume data is segmented from the first three-dimensional volume data based on the projection image.

[0049] In operation S240, at least one envelope region for at least one object in the checked luggage is determined based on the second three-dimensional volume data.

[0050] In operation S250 , an envelope region of the target object is determined from the determined at least one envelope region.

[0051] Those skilled in the art can understand that the target object positioning method according to the embodiment of the present disclosure can be projected in only one direction based on the first three-dimensional volume data of the checked luggage, and the second three-dimensional volume data of a partial area can be segmented from the first three-dimensional volume data of the checked luggage according to the projection image, thereby reducing the positioning range of the target object. In addition, the envelope area of ​​each of the at least one object contained in the checked luggage is determined based on the second three-dimensional volume data, so as to determine the envelope area of ​​the target object from the at least one envelope area. The above process does not require multiple changes in viewing angles to pick up the area where the target object is located, nor does it require consideration of whether there are other objects in any of the above directions that block the target object. In addition, the reduction of the positioning range simplifies the positioning process of the target object and improves the efficiency and accuracy of the target object positioning.

[0052] Figure 3 An example flowchart of a target object positioning method according to another embodiment of the present disclosure is schematically shown to illustrate an exemplary implementation process of the above operation S230.

[0053] like Figure 3 As shown, the process of segmenting the second three-dimensional volume data from the first three-dimensional volume data based on the projection image may include operations S231 to S232.

[0054] In operation S231, a two-dimensional effective area is formed in the projection image.

[0055] Exemplarily, according to an embodiment of the present disclosure, the process of forming a two-dimensional effective area in the projected image may include: obtaining size parameters of a predetermined shape. Based on a first trigger operation for a specified point in the projected image, a two-dimensional effective area of ​​a predetermined shape centered at the specified point and conforming to the size parameters is generated.

[0056] Figure 4A Schematically shows an example diagram of a two-dimensional effective area according to an embodiment of the present disclosure. Figure 4AAs shown, for example, the first trigger operation may be a click operation. After generating a projection image 400 of the checked luggage in any direction (e.g., the first direction), the projection image 400 is displayed. It can be understood that in the example shown in FIG. 4, the first direction is perpendicular to the paper surface. When the user believes that a certain area of ​​the projection image is suspected to be a target object, any point in the area can be clicked as a designated point. In response to the user's click operation on the designated point A on the projection image 400, a two-dimensional effective area 401 of a predetermined shape with the designated point A as the center and conforming to the size parameter is generated. In this example, the predetermined shape may be a circle, and the size parameter of the predetermined shape is the radius of the circle. In other examples, the predetermined shape may be any shape, such as a rectangle, a triangle, an ellipse, etc., and accordingly, the size parameters of the predetermined shape may include: the length and width of the rectangle, the side length of the triangle, the major axis and minor axis of the ellipse, etc., which are not limited here.

[0057] In another embodiment of the present disclosure, the process of forming a two-dimensional effective area in the projection image may also include: based on an operation of a user drawing a closed trajectory in the projection image, forming a two-dimensional effective area with the closed trajectory as a boundary in the projection image.

[0058] According to an embodiment of the present disclosure, the process of obtaining the size parameters of the predetermined shape can adopt pre-configured size parameters, or can be calculated according to actual detection data. Exemplarily, in one case, the size parameters of the pre-configured predetermined shape can be obtained from a configuration table stored in an electronic device. For example, the configuration table records the following information: the predetermined shape is a circle with a radius of x pixels, where x is a positive integer; or the predetermined shape is a rectangle with a length of y pixels and a width of z pixels, where y and z are both positive integers; and so on. In another case, the size parameters of the predetermined shape can be determined according to the size parameters of the projected image so that the size parameters of the predetermined shape are in a predetermined ratio with the size parameters of the projected image. For example, the size of the projected image of the checked luggage in the first direction is 1024×1024 pixels. The predetermined ratio between the radius of the circle and the side length of the projected image is set to 1 / 10, and the radius of the circle is estimated to be 102 pixels. Or the predetermined ratio between the side length of the rectangle and the side length of the projected image is set to 1 / 10, and the length and width of the rectangle are estimated to be 102 pixels. Alternatively, a predetermined ratio may be set to represent the ratio between the area of ​​the predetermined shape and the area of ​​the projected image, and the area of ​​the predetermined shape may be calculated based on the predetermined ratio and the area of ​​the projected area, and then the size parameters of the predetermined shape may be calculated.

[0059] Continue to refer Figure 3 In operation S232, the two-dimensional effective area is extended along any of the above directions to form a columnar three-dimensional area with the two-dimensional effective area as a cross-section, and the three-dimensional volume data for the columnar three-dimensional area is used as the second three-dimensional volume data.

[0060] The extension direction of the two-dimensional effective area is consistent with the projection direction of the projection image of the checked luggage (the first direction in the above example), which can also be called the depth direction of the projection image.

[0061] Figure 4B Schematically shows an example diagram of a columnar three-dimensional area according to an embodiment of the present disclosure. Figure 4B As shown on the left, after forming the two-dimensional effective area 401, the two-dimensional effective area 401 is extended along the first direction to form a columnar three-dimensional area 402 with the two-dimensional effective area 401 as a cross section. Since the two-dimensional effective area 401 in this example is circular, the columnar three-dimensional area 402 formed is a cylinder. In other examples, if the two-dimensional effective area 401 is rectangular, the columnar three-dimensional area 402 formed is a quadrangular prism. The columnar three-dimensional area formed based on the two-dimensional effective area of ​​other predetermined shapes is the same, and will not be repeated here. In the first three-dimensional volume data of the checked luggage, the three-dimensional volume data for the columnar three-dimensional area 402 can be used as the second three-dimensional volume data segmented from the first three-dimensional volume data.

[0062] Since the above two-dimensional effective area is formed according to the user's first trigger operation on the projected image, it means that the actual position of the target object should be in the depth direction of the two-dimensional effective area. Therefore, the two-dimensional effective area is extended in the depth direction, and the cylindrical three-dimensional area formed can include the area where the target object is located, and the area where the target object is located will not be mistakenly deleted while narrowing the positioning range. The second three-dimensional volume data for the cylindrical three-dimensional area is used to determine the envelope area of ​​at least one object in the checked luggage, which will be described in detail below.

[0063] Figure 5 An example flow chart of a target object positioning method according to another embodiment of the present disclosure is schematically shown, which is used to illustrate an implementation process of the target object positioning method and does not limit the present disclosure.

[0064] like Figure 5 As shown, the target object positioning method may include operations S501 to S514.

[0065] In operation S501, three-dimensional volume data of checked luggage is loaded.

[0066] The three-dimensional volume data of the checked luggage may be referred to as first three-dimensional volume data to distinguish it from the segmented second three-dimensional volume data. After the first three-dimensional volume data is acquired, the first three-dimensional volume data may be loaded into a program product for executing the above-mentioned target positioning method.

[0067] In operation S502, a projection image of the checked luggage in any direction (eg, a first direction) is generated.

[0068] In operation S503 , based on a first trigger operation of a user on a designated point on a projection image, a two-dimensional effective area centered on the designated point is formed.

[0069] According to the embodiment of the present disclosure, the implementation method of forming a two-dimensional effective area has been illustrated above and will not be repeated here.

[0070] In operation S504, a columnar three-dimensional region is formed based on the two-dimensional effective region.

[0071] According to the embodiment of the present disclosure, the implementation method of forming a columnar three-dimensional region has been illustrated above and will not be repeated here.

[0072] In operation S505 , second three-dimensional volume data for a columnar three-dimensional region is segmented from the first three-dimensional volume data.

[0073] In operation S506 , at least one envelope region for at least one object in the checked luggage is determined based on the second three-dimensional volume data.

[0074] According to the embodiment of the present disclosure, since the second three-dimensional volume data is three-dimensional volume data corresponding to the above-mentioned columnar three-dimensional area segmented from the first three-dimensional volume data of the checked luggage, the at least one object determined in operation S506 according to the specific distribution of the second three-dimensional volume data refers to at least one object in the checked luggage and whose projection image along the first direction is located in the above-mentioned columnar three-dimensional area.

[0075] Exemplarily, the process of determining at least one envelope region for at least one object in the checked luggage based on the second three-dimensional volume data may include: using an image recognition algorithm to segment at least one set of three-dimensional volume data that meets predetermined image features from the second three-dimensional volume data. Then, at least one envelope region is determined based on the at least one set of three-dimensional volume data. In this process, since the features of the three-dimensional volume data corresponding to the object and the three-dimensional volume data corresponding to the background are different, various image recognition algorithms may be used to identify and segment the envelope regions of each object, and the present disclosure does not limit the image recognition algorithm. For example, the background region in the second three-dimensional volume data may be screened out by a light transmission volume rendering method, and the envelope regions of each object may be retained and segmented.

[0076] like Figure 4B As shown, for example, according to the second three-dimensional volume data corresponding to the columnar three-dimensional area on the left, the envelope area of ​​object 1, the envelope area of ​​object 2, ..., the envelope area of ​​object N shown on the right can be segmented. Where N is an integer greater than 2.

[0077] Continue reading Figure 5 In operation S507, the determined at least one envelope region is sorted according to a predetermined rule to obtain a display sequence.

[0078] According to an embodiment of the present disclosure, the above-mentioned predetermined rule may be, for example, sorting in order of priority from high to low. Exemplarily, the above-mentioned process of calculating the priority of each of the at least one envelope area may include: for each envelope area in the above-mentioned at least one envelope area, obtaining the attribute parameters of the envelope area. Then, according to the attribute parameters of the envelope area, calculating the priority of the envelope area.

[0079] For example, the above-mentioned acquisition of the attribute parameters of the envelope area may include at least one of the following: calculating the volume of the envelope area according to the three-dimensional volume data of the envelope area; calculating the density of the envelope area according to the three-dimensional volume data of the envelope area, for example, calculating the density of the envelope area according to the pixel value distribution of the envelope area; and calculating the position coordinates of the envelope area in the above-mentioned projection image according to the three-dimensional volume data of the envelope area. Among them, the volume of the envelope area can reflect the size and shape of the enveloped object, and the density of the envelope area can reflect the density of the enveloped object, and then reflect the material of the object. According to the position coordinates of the envelope area in the above-mentioned projection image, the distance between the center of mass of the object enveloped by the envelope area and the specified point on the projection image can be calculated. The above one or more attribute parameters can characterize the attribute characteristics of the object targeted by the envelope area. On this basis, the above-mentioned process of calculating the priority of any envelope area according to the attribute parameters of the envelope area may include: taking the envelope area of ​​object 1 as an example, comparing the attribute characteristics of object 1 with the attribute characteristics of the desired target object. For example, the attribute characteristics of an object can be represented by a vector form, and the similarity between the attribute characteristics of object 1 and the desired target object is calculated to represent the degree of similarity between the two. For example, the higher the similarity between the object and the target object, the higher the priority is set for the envelope area of ​​the object.

[0080] Continue reading Figure 5 In operation S508, starting from the first envelope region in the display sequence, the envelope regions in the display sequence are displayed in sequence. For example, there are N envelope regions in the display sequence, and the i-th envelope region in the display sequence is displayed. Where i is an integer greater than or equal to 1 and less than or equal to N, the initial value of i is 1, and i increases by 1 each time the display is switched. When i=N, the first envelope region is re-displayed when the display is switched.

[0081] Exemplarily, when displaying the i-th envelope area, the projection image of the i-th envelope area in the second direction may be displayed, and the second direction may be the same as the first direction or different from the first direction, and is not limited here. In one example, when displaying the i-th envelope area, the projection images of the envelope area in multiple directions may be displayed, so that the user can more quickly and accurately identify the object targeted by the envelope area.

[0082] According to an embodiment of the present disclosure, if the envelope regions in the display sequence are arranged in order of priority from high to low, then the above process of sequentially displaying the envelope regions in the display sequence is a process of sequentially displaying the envelope regions in order of priority from high to low. In the above example, since the higher the priority, the closer the object targeted by the envelope region is to the desired target object, such a display order allows the user to quickly identify the envelope region of the target object.

[0083] Continue reading Figure 5 In operation S509, it is determined whether a second trigger operation of the user for the i-th envelope area is received. If yes, operation S512 is performed. If not, operation S510 is performed.

[0084] In operation S510, it is determined whether the third trigger operation of the user for the i-th envelope area is received. If yes, switching display is performed, i is incremented by 1 and then the process returns to operation S508. If no, operation S511 is performed.

[0085] In operation S511, it is determined whether the fourth trigger operation of the user for the i-th envelope area is received. If yes, re-display is performed, i=1 is set and the process returns to operation S508. If no, the process directly returns to operation S508 and continues to display the i-th envelope area.

[0086] In operation S512 , the i-th envelope region is determined to be the envelope region of the target object.

[0087] In operation S513, a label is added to the i-th envelope region.

[0088] In operation S514, the 3D volume data of the i-th envelope area is added and stored in a predetermined storage area in association with a label, wherein the content of the label may be, for example, a predetermined identifier or identification information to indicate that the 3D volume data stored in association with the label is the 3D volume data of the envelope area of ​​the target object.

[0089] This operation S514 stores the determined three-dimensional volume data of the target object in association with the label, which can be used for subsequent use. For example, the stored content can be used as sample data for training an image processing model, and the relevant sample data of various target objects can be gradually accumulated during the security inspection process, so that an image processing model with better performance can be trained.

[0090] According to an embodiment of the present disclosure, the second trigger operation, the third trigger operation and the fourth trigger operation can be preset as needed. For example, when displaying the i-th envelope area, the first control and the second control are displayed in association, and when the user clicks the first control, it is determined that the first trigger operation is performed on the i-th envelope area, and when the user clicks the second control, it is determined that the second trigger operation is performed on the i-th envelope area. Alternatively, a single-click operation on the i-th envelope area is the first trigger operation, and a double-click operation on the i-th envelope area is the second trigger operation. For another example, a predetermined number of consecutive clicks within a shorter predetermined time period can be used as the fourth trigger operation.

[0091] Figure 6 A block diagram of a target object positioning device according to an embodiment of the present disclosure is schematically shown.

[0092] like Figure 6 As shown, the target object positioning device 600 may include: an acquisition module 610 , a projection module 620 , a segmentation module 630 , a determination module 640 and a positioning module 650 .

[0093] The acquisition module 610 is used to acquire first three-dimensional volume data of the checked luggage.

[0094] The projection module 620 is used to generate a projection image of the checked luggage in any direction based on the first three-dimensional volume data.

[0095] The segmentation module 630 is used to segment the second three-dimensional volume data from the first three-dimensional volume data based on the projection image.

[0096] The determination module 640 is configured to determine at least one envelope region for at least one object in the checked luggage based on the second three-dimensional volume data.

[0097] The positioning module 650 is configured to determine an envelope region of the target object from the determined at least one envelope region.

[0098] It should be noted that the implementation methods, technical problems solved, functions realized, and technical effects achieved of each module / unit / sub-unit in the device part embodiment are the same or similar to the implementation methods, technical problems solved, functions realized, and technical effects achieved of each corresponding step in the method part embodiment, and will not be repeated here.

[0099] Figure 7 A block diagram of an electronic device for implementing the method described above according to an embodiment of the present disclosure is schematically shown. Figure 7 The device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0100] like Figure 7 As shown, the device 700 according to an embodiment of the present disclosure includes a processor 701, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 702 or a program loaded from a storage part 708 into a random access memory (RAM) 703. The processor 701 may include, for example, a general-purpose microprocessor (e.g., a CPU), an instruction set processor and / or a related chipset and / or a special-purpose microprocessor (e.g., an application-specific integrated circuit (ASIC)), etc. The processor 701 may also include an onboard memory for caching purposes. The processor 701 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present disclosure.

[0101] In RAM 703, various programs and data required for the operation of device 700 are stored. Processor 701, ROM 702 and RAM 703 are connected to each other via bus 704. Processor 701 performs various operations of the method flow according to the embodiment of the present disclosure by executing the program in ROM 702 and / or RAM 703. It should be noted that the program can also be stored in one or more memories other than ROM 702 and RAM 703. Processor 701 can also perform various operations of the method flow according to the embodiment of the present disclosure by executing the program stored in the one or more memories.

[0102] According to an embodiment of the present disclosure, the device 700 may further include an input / output (I / O) interface 705, which is also connected to the bus 704. The device 700 may further include one or more of the following components connected to the I / O interface 705: an input portion 706 including a keyboard, a mouse, etc.; an output portion 707 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage portion 708 including a hard disk, etc.; and a communication portion 709 including a network interface card such as a LAN card, a modem, etc. The communication portion 709 performs communication processing via a network such as the Internet. A drive 710 is also connected to the I / O interface 705 as needed. A removable medium 711, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 710 as needed, so that a computer program read therefrom is installed into the storage portion 708 as needed.

[0103] According to an embodiment of the present disclosure, the method flow according to an embodiment of the present disclosure can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable storage medium, and the computer program contains a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 709, and / or installed from the removable medium 711. When the computer program is executed by the processor 701, the above-mentioned functions defined in the system of the embodiment of the present disclosure are executed. According to an embodiment of the present disclosure, the system, equipment, device, module, unit, etc. described above can be implemented by a computer program module.

[0104] According to an embodiment of the present disclosure, the electronic device described above may be used to implement the target object positioning method according to an embodiment of the present disclosure.

[0105] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or may exist independently without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, the method according to the embodiment of the present disclosure is implemented.

[0106] The flow charts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0107] It will be appreciated by those skilled in the art that, although the present disclosure has been shown and described with reference to specific exemplary embodiments of the present disclosure, it will be appreciated by those skilled in the art that, without departing from the spirit and scope of the present disclosure as defined by the appended claims and their equivalents, various changes in form and detail may be made to the present disclosure. Therefore, the scope of the present disclosure should not be limited to the above-described embodiments, but should be determined not only by the appended claims, but also by the equivalents of the appended claims.

Claims

1. A method for locating a target object, comprising: Acquire first three-dimensional volume data of the checked luggage; generating a projection image of the checked luggage in any direction based on the first three-dimensional volume data; Based on the projection image, segmenting second three-dimensional volume data from the first three-dimensional volume data; determining at least one envelope region for at least one object in the checked luggage based on the second three-dimensional volume data; as well as determining an envelope region of the target object from the at least one envelope region, Wherein, segmenting the second three-dimensional volume data from the first three-dimensional volume data based on the projection image comprises: forming a two-dimensional effective area in the projected image; Extending the two-dimensional effective area along any one direction to form a columnar three-dimensional area with the two-dimensional effective area as a cross section; and The three-dimensional volume data for the columnar three-dimensional region is used as the second three-dimensional volume data.

2. The method according to claim 1, wherein: The forming of a two-dimensional effective area in the projection image comprises: Obtaining dimension parameters of a predetermined shape; and Based on a first trigger operation on a designated point in the projection image, a two-dimensional effective area of ​​a predetermined shape centered at the designated point and conforming to the size parameter is generated.

3. The method according to claim 2, wherein: The obtaining of the size parameters of the predetermined shape comprises: Get the size parameters of a predetermined shape pre-configured in the configuration table.

4. The method according to claim 2, wherein: The obtaining of the size parameters of the predetermined shape comprises: The size parameters of the predetermined shape are determined according to the size parameters of the projection image, so that the size parameters of the predetermined shape are in a predetermined ratio with the size parameters of the projection image.

5. The method according to claim 1, wherein: The determining, based on the second three-dimensional volume data, at least one envelope region for at least one object in the checked luggage comprises: Using an image recognition algorithm, segmenting at least one group of three-dimensional volume data that meets predetermined image features from the second three-dimensional volume data; and At least one envelope region is determined according to the at least one set of three-dimensional volume data.

6. The method according to claim 5, wherein: The determining the envelope area of ​​the target object from the at least one envelope area comprises: calculating a priority of each of the at least one envelope regions; Displaying the at least one envelope area in order from high to low priority; and Based on a second trigger operation on any envelope region among the at least one envelope region, the any envelope region is determined to be the envelope region of the target object.

7. The method according to claim 6, wherein: The calculating the priority of each of the at least one envelope region comprises: for each envelope region in the at least one envelope region, Acquiring attribute parameters of the envelope area; and The priority of the envelope area is calculated according to the attribute parameter.

8. The method according to claim 7, wherein: The step of obtaining the attribute parameters of the envelope area includes at least one of the following: Calculating the volume of the envelope area according to the three-dimensional volume data of the envelope area; Calculating the density of the envelope area according to the three-dimensional volume data of the envelope area; as well as The position coordinates of the envelope region in the projection image are calculated according to the three-dimensional volume data of the envelope region.

9. The method according to claim 6, wherein: The displaying of the at least one envelope area in order of priority from high to low includes: Sorting the at least one envelope region in descending order of priority to obtain a display sequence; Starting the presentation from the first envelope region in the presentation sequence; When displaying an image of any envelope region in the display sequence, Based on a third trigger operation for any of the envelope regions, switching a subsequent envelope region of any of the envelope regions displayed in the display sequence; and Based on a fourth trigger operation on any one of the envelope regions, switching is performed to display a first envelope region in the display sequence.

10. The method according to claim 6, further comprising: After determining that any one of the envelope regions is the envelope region of the target object, adding a label to any of the envelope regions; as well as The three-dimensional volume data of any one envelope region and the label are added and stored in a predetermined storage area in association with each other.

11. The method according to claim 1, wherein: The obtaining of first three-dimensional volume data of the checked luggage comprises: A computer tomography imaging device is used to acquire first three-dimensional volume data of the checked luggage.

12. A target object positioning device, comprising: An acquisition module, used for acquiring first three-dimensional volume data of the checked luggage; A projection module, configured to generate a projection image of the checked baggage in any direction based on the first three-dimensional volume data; a segmentation module, configured to segment second three-dimensional volume data from the first three-dimensional volume data based on the projection image; a determination module, configured to determine at least one envelope area for at least one object in the checked luggage based on the second three-dimensional volume data; as well as A positioning module, configured to determine an envelope area of ​​the target object from the at least one envelope area; The segmentation module segments the second three-dimensional volume data from the first three-dimensional volume data based on the projection image, comprising: forming a two-dimensional effective area in the projected image; Extending the two-dimensional effective area along any one direction to form a columnar three-dimensional area with the two-dimensional effective area as a cross section; and The three-dimensional volume data for the columnar three-dimensional region is used as the second three-dimensional volume data.

13. An electronic device comprising: A memory for storing instructions; At least one processor: The at least one processor executes instructions stored in the memory to implement the method according to any one of claims 1 to 11.

14. A computer-readable storage medium having computer instructions stored thereon, wherein the computer instructions, when executed by a processor, implement the method according to any one of claims 1 to 11.

15. A computer program product, comprising executable instructions, which, when executed by a processor, implement the method according to any one of claims 1 to 11.

Images