Three-dimensional structure stereoscopic information acquisition method, controller, system, medium and product

Abstract

The embodiment of the present application proposes a method, controller, system, medium and product for obtaining three-dimensional structure stereo information, the method comprising: performing slice imaging processing on a target area of ​​a target structure to obtain slice data of the target area; performing three-dimensional block processing on the slice data to obtain multiple three-dimensional data blocks; extracting the target three-dimensional structure from multiple three-dimensional data blocks according to a preset target structure determination model; performing three-dimensional interconnection information retrieval on the target three-dimensional structure to obtain target three-dimensional structure information; obtaining the adjacent position relationship of multiple three-dimensional data blocks, merging multiple target three-dimensional structure information according to the adjacent position relationship, and obtaining three-dimensional structure stereo information of the target area. Since the present application can merge multiple target three-dimensional structure information according to the adjacent position relationship of multiple three-dimensional data blocks, thereby obtaining three-dimensional structure stereo information of the target area, it can realize the rapid acquisition of three-dimensional structure stereo information.

Description

Technical Field

[0001] The present application relates to the technical field of optical microscopic image analysis and processing, and in particular to a method, controller, system, medium and product for acquiring stereoscopic information of a three-dimensional structure. Background Art

[0002] In the related technologies, the measurement of related structures of semiconductor products mostly adopts microscopic imaging systems and digital cameras. The target structure area of ​​the related products is photographed in some specific ways, and then the target structure to be measured is separated by related image processing technology, and the three-dimensional morphology and position information of its key structure are confirmed. Since some structures have large scales in the horizontal, vertical and deep directions, and the data accuracy requirements of related structures are high, the three-dimensional information of the corresponding structure is obtained by stepping and slicing along a specific direction, and the related structure measurement and detection are realized. In this processing process, due to the high accuracy requirements of the related structures and the relatively large scale, the amount of data to be processed is often relatively large, and the overall process consumes a long time, which seriously affects the processing efficiency of the related processes. Therefore, how to realize the rapid extraction of information such as the scale and position of the related structures is the main problem currently faced by the industry. Summary of the invention

[0003] The present application aims to solve at least one of the technical problems existing in the prior art. To this end, the present application proposes a method, controller, system, medium and product for obtaining three-dimensional structure stereo information, aiming to achieve rapid acquisition of three-dimensional structure stereo information.

[0004] In a first aspect, an embodiment of the present application provides a method for obtaining stereoscopic information of a three-dimensional structure, characterized in that the method comprises: Performing slice imaging processing on a target area of ​​the target structure to obtain slice data of the target area; Performing three-dimensional block processing on the slice data to obtain a plurality of three-dimensional data blocks; Extracting a target three-dimensional structure from the plurality of three-dimensional data blocks according to a preset target structure determination model; Performing three-dimensional interconnection information retrieval on the target three-dimensional structure to obtain target three-dimensional structure information; The adjacent position relationship of the plurality of three-dimensional data blocks is obtained, and the plurality of target three-dimensional structure information is merged according to the adjacent position relationship to obtain the three-dimensional structure stereo information of the target area.

[0005] According to some embodiments of the present application, extracting the target three-dimensional structure from the plurality of three-dimensional data blocks according to a preset target structure determination model includes: Acquire slice image group information of each of the three-dimensional data blocks; Inputting the slice image group information into a preset target structure determination model, and outputting a calculation result through the target structure determination model; When the calculation result is greater than a preset threshold, the three-dimensional data is divided into blocks as the target three-dimensional structure.

[0006] According to some embodiments of the present application, the target structure determination model is:

[0007] Among them, the is the calculation result, the is the target structure determination function, F is the preset feature extraction function corresponding to the target structure, U is the preset neighborhood function, is the slice image group information, the is the preset threshold.

[0008] According to some embodiments of the present application, merging the plurality of target three-dimensional structure information according to the adjacent position relationship to obtain the three-dimensional structure stereo information of the target area includes: According to the plurality of adjacent position relationships, obtaining a plurality of first target three-dimensional structure information of the plurality of three-dimensional data blocks at the current position, and obtaining a plurality of second target three-dimensional structure information of the plurality of three-dimensional data blocks at adjacent positions; The three-dimensional structural information of each of the first targets and the three-dimensional structural information of each of the second targets are merged to obtain the three-dimensional structural stereo information of the target area.

[0009] According to some embodiments of the present application, the merging of each of the first target three-dimensional structure information and each of the second target three-dimensional structure information includes: Acquire a correspondence between each of the first target three-dimensional structure information and each of the second target three-dimensional structure information; The first target three-dimensional structure information and the second target three-dimensional structure information are merged according to the corresponding relationship.

[0010] According to some embodiments of the present application, merging the first target three-dimensional structure information and the second target three-dimensional structure information according to the corresponding relationship includes one of the following: When the first target three-dimensional structure information corresponds to one piece of the second target three-dimensional structure information, merging the first target three-dimensional structure information with the second target three-dimensional structure information; When the first target three-dimensional structure information corresponds to multiple second target three-dimensional structure information, the corresponding second target three-dimensional structure information is merged to obtain third target three-dimensional structure information, and the first target three-dimensional structure information is merged with the third target three-dimensional structure information.

[0011] In a second aspect, an embodiment of the present application provides a controller comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the three-dimensional structure stereo information acquisition method of the first aspect mentioned above when running the computer program.

[0012] In a third aspect, an embodiment of the present application provides a three-dimensional structure stereo information acquisition system, including the controller of the second aspect mentioned above.

[0013] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium storing computer-executable instructions, wherein the computer-executable instructions are used to execute the method for acquiring stereoscopic information of a three-dimensional structure as described in the first aspect above.

[0014] In a fifth aspect, an embodiment of the present application provides a computer program product, comprising a computer program or computer instructions, characterized in that the computer program or the computer instructions are stored in a computer-readable storage medium, a processor of a computer device reads the computer program or the computer instructions from the computer-readable storage medium, and the processor executes the computer program or the computer instructions, so that the computer device executes the three-dimensional structure stereo information acquisition method as described in the first aspect above.

[0015] According to the technical solution of the embodiment of the present application, at least the following beneficial effects are achieved: the embodiment of the present application proposes a method, controller, system, medium and product for obtaining three-dimensional structure stereo information, the method comprising: first, the embodiment of the present application performs slice imaging processing on the target area of ​​the target structure, extracts the information of the target structure in a targeted manner, and obtains slice data of the target area; second, the embodiment of the present application performs three-dimensional block processing on the slice data to obtain multiple three-dimensional data blocks; then, the embodiment of the present application performs true value judgment on the characteristics of the target structure according to the preset target structure judgment model, so that the target three-dimensional structure information is extracted from the multiple three-dimensional data blocks; third, the target three-dimensional structure is retrieved for three-dimensional interconnection information, the three-dimensional interconnection information of the target structure is judged, and the target three-dimensional structure information is obtained; finally, the adjacent position relationship of multiple three-dimensional data blocks is obtained, and the multiple target three-dimensional structure information is merged according to the adjacent position relationship to obtain the three-dimensional structure information of the target area. Since the present application can merge multiple target three-dimensional structure information according to the adjacent position relationship of multiple three-dimensional data blocks, thereby obtaining the three-dimensional structure stereo information of the target area, the three-dimensional structure stereo information can be quickly obtained.

[0016] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The accompanying drawings are used to provide further understanding of the technical solution of the present application and constitute a part of the specification. Together with the embodiments of the present application, they are used to explain the technical solution of the present application and do not constitute a limitation on the technical solution of the present application.

[0018] Figure 1 is a flow chart of a method for obtaining three-dimensional structure stereo information provided by an embodiment of the present application; Figure 2 is a flow chart of a method for obtaining three-dimensional structure stereo information provided by another embodiment of the present application; Figure 3 is a flow chart of a method for obtaining three-dimensional structure stereo information provided by another embodiment of the present application; Figure 4 is a flow chart of a method for obtaining three-dimensional structure stereo information provided by another embodiment of the present application; Figure 5 is a flow chart of a method for obtaining three-dimensional structure stereo information provided by another embodiment of the present application; Figure 6 is a schematic diagram of a surface structure reflection light path of a target structure provided by an embodiment of the present application; Figure 7 is a schematic diagram of a line structure reflection light path of a target structure provided by an embodiment of the present application; Figure 8 is a schematic diagram of a reflection light path of an edge structure of a target structure provided by an embodiment of the present application; Fig. 9 It is a schematic diagram of the structure of three-dimensional data blocks provided by an embodiment of the present application; Fig.10 is a schematic diagram of the structure of a bonding wire provided by an embodiment of the present application; Fig.11 It is a schematic diagram of a neighborhood determination for a three-dimensional retrieval pixel provided by an embodiment of the present application; Fig.12 This is a schematic diagram of a three-dimensional block neighborhood provided by an embodiment of the present application; Fig.13 This is a schematic diagram of the neighboring surface where the current pixel is located provided by an embodiment of the present application; Fig.14 This is a schematic diagram of the neighboring area of ​​the current pixel of the adjacent block provided by an embodiment of the present application; Fig.15 The current pixel and its simplest pixel determination area provided by an embodiment of the present application; Fig.16 This is a tree diagram of the simplest decision process corresponding to the current pixel provided by an embodiment of the present application; Fig.17 It is a pixel neighborhood to be merged at an adjacent edge position provided by an embodiment of the present application; Fig.18 is a simplest determination process tree diagram corresponding to the current pixel provided by another embodiment of the present application; Fig.19 This is a schematic diagram of the position relationship between diagonal vertex blocks provided by an embodiment of the present application; Fig. 20 This is a schematic diagram of the position relationship of diagonal vertex pixels provided by an embodiment of the present application; Fig.21 It is a schematic diagram of a controller for executing a method for acquiring stereoscopic information of a three-dimensional structure provided in one embodiment of the present application. DETAILED DESCRIPTION

[0019] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present application, and cannot be understood as limiting the present application.

[0020] In the description of the present application, it should be understood that descriptions involving orientation, such as up, down, front, back, left, right, etc., indicating orientations or positional relationships, are based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present application.

[0021] In the description of this application, "several" means one or more, "more" means more than two, "greater than", "less than", "exceed", etc. are understood to exclude the number itself, and "above", "below", "within", etc. are understood to include the number itself. If there is a description of "first" or "second", it is only used for the purpose of distinguishing technical features, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features or implicitly indicating the order of the indicated technical features.

[0022] In the description of this application, unless otherwise clearly defined, terms such as setting, installing, connecting, etc. should be understood in a broad sense, and technicians in the relevant technical field can reasonably determine the specific meanings of the above terms in this application based on the specific content of the technical solution.

[0023] In some cases, the measurement of related structures of semiconductor products mostly uses microscopic imaging systems and digital cameras. The target structure area of ​​the related products is photographed in some specific ways, and then the target structure to be measured is separated by related image processing technology, and the three-dimensional morphology and position information of its key structure are confirmed. Since some structures have large scales in the horizontal, vertical and depth directions, and the data accuracy requirements of related structures are high, the method of stepping and slicing along a specific direction is often used to obtain the three-dimensional information of the corresponding structure, and to realize the measurement and detection of related structures. In this processing process, due to the high accuracy requirements of the related structures and the relatively large scale, the amount of data to be processed is often relatively large, and the overall process consumes a long time, which seriously affects the processing efficiency of the related processes. Therefore, how to realize the rapid extraction of information such as the scale and position of related structures is the main problem currently faced by the industry.

[0024] Based on the above situation, the present application proposes a method, controller, system, medium and product for obtaining three-dimensional structure stereo information, aiming to achieve rapid acquisition of three-dimensional structure stereo information.

[0025] The following further describes various embodiments of a method for acquiring three-dimensional structure stereo information of the present application in conjunction with the accompanying drawings.

[0026] like Figure 1 As shown, Figure 1It is a flowchart of a method for obtaining three-dimensional structure stereo information provided by an embodiment of the present application; the method for obtaining three-dimensional structure stereo information may include but is not limited to step S110, step S120, step S130, step S140 and step S150.

[0027] Step S110, performing slice imaging processing on the target area of ​​the target structure to obtain slice data of the target area; Step S120, performing three-dimensional block processing on the slice data to obtain a plurality of three-dimensional data blocks; Step S130, extracting a target three-dimensional structure from a plurality of three-dimensional data blocks according to a preset target structure determination model; Step S140, performing a three-dimensional interconnection information search on the target three-dimensional structure to obtain the target three-dimensional structure information; Step S150: Acquire the adjacent position relationship of multiple three-dimensional data blocks, merge multiple target three-dimensional structure information according to the adjacent position relationship, and obtain the three-dimensional structure stereo information of the target area.

[0028] In one embodiment, first, the embodiment of the present application performs slice imaging processing on the target area of ​​the target structure, and extracts the information of the target structure in a targeted manner to obtain slice data of the target area; secondly, the embodiment of the present application performs three-dimensional block processing on the slice data to obtain multiple three-dimensional data blocks; then, the embodiment of the present application performs a true value judgment on the characteristics of the target structure according to a preset target structure judgment model, so that the target three-dimensional structure information is extracted from the multiple three-dimensional data blocks; thirdly, the three-dimensional connectivity information of the target three-dimensional structure is retrieved, the three-dimensional connectivity information of the target structure is judged, and the target three-dimensional structure information is obtained; finally, the adjacent position relationship of the multiple three-dimensional data blocks is obtained, and the multiple target three-dimensional structure information is merged according to the adjacent position relationship to obtain the three-dimensional structure information of the target area.

[0029] It is worth noting that since the present application can merge multiple target three-dimensional structural information according to the adjacent position relationship of multiple three-dimensional data blocks, the three-dimensional structural stereo information of the target area can be obtained, thereby realizing the rapid acquisition of three-dimensional structural stereo information.

[0030] It can be understood that by stepwise changing the distance between the microscope objective lens and the target to be measured, the slice imaging of the target area is obtained, so that accurate slice data of the target area is obtained.

[0031] It can be understood that, due to the continuity of information in space and the relative stability of data format, the slice data is processed into three-dimensional blocks to obtain three-dimensional data blocks.

[0032] It can be understood that by performing three-dimensional interconnection information retrieval on the target three-dimensional structure, more comprehensive target three-dimensional structure information can be obtained.

[0033] In addition, if Figure 2 As shown, Figure 2 It is a flowchart of a method for acquiring stereoscopic information of a three-dimensional structure provided by another embodiment of the present application; regarding the above-mentioned step S130, it may include but is not limited to step S210, step S220 and step S230.

[0034] Step S210, obtaining slice image group information of each three-dimensional data block; Step S220, inputting the slice image group information into a preset target structure determination model, and outputting a calculation result through the target structure determination model; Step S230: When the calculation result is greater than a preset threshold, the three-dimensional data is divided into blocks as a target three-dimensional structure.

[0035] In one embodiment, the embodiment of the present application obtains slice image group information of each three-dimensional data block, and then inputs the slice image group information into a preset target structure determination model to obtain a calculation result, and then determines the target three-dimensional structure from multiple three-dimensional data blocks based on the calculation result. When the calculation result is greater than a preset threshold, the three-dimensional data block is used as the target three-dimensional structure.

[0036] It can be understood that the target structure determination model is:

[0037] in, To calculate the result, is the target structure determination function, F is the preset feature extraction function corresponding to the target structure, U is the preset neighborhood function, is the slice image group information, is the preset threshold.

[0038] It can be understood that when the target structure is a bonding wire, F can be the gradient information and brightness of adjacent positions, so that the target structure judgment function can be used to judge the absolute value, relative value and other sizes and brightness of the gradients at adjacent positions for multiple three-dimensional data blocks, and then the target three-dimensional structure can be extracted.

[0039] It is understandable that by obtaining the slice image group information of each 3D data block and inputting it into the preset target structure determination model, efficient extraction of the target structure can be achieved. This method avoids the tediousness and time-consuming of traditional manual extraction and improves processing efficiency.

[0040] In addition, if Figure 3 As shown, Figure 3It is a flowchart of a method for acquiring three-dimensional structure stereo information provided by another embodiment of the present application; regarding the above-mentioned step S150 of merging multiple target three-dimensional structure information according to adjacent position relationships to obtain the three-dimensional structure stereo information of the target area, it may include but is not limited to step S310 and step S320.

[0041] Step S310: acquiring a plurality of first target three-dimensional structural information of a plurality of three-dimensional data blocks at a current position according to a plurality of adjacent position relationships, and acquiring a plurality of second target three-dimensional structural information of a plurality of three-dimensional data blocks at adjacent positions; Step S320: Merge the three-dimensional structure information of each first target and the three-dimensional structure information of each second target to obtain the three-dimensional structure stereo information of the target area.

[0042] It can be understood that the adjacent positional relationship includes adjacent faces, diagonal edges and diagonal vertices.

[0043] It is understandable that by merging multiple first target three-dimensional structure information and multiple second target three-dimensional structure information through adjacent position relationship, the three-dimensional structure stereo information of the target area is obtained, thereby enabling rapid acquisition of the three-dimensional structure stereo information.

[0044] In addition, if Figure 4 As shown, Figure 4 It is a flowchart of a method for acquiring stereoscopic information of a three-dimensional structure provided by another embodiment of the present application; regarding the above-mentioned step S320, it may include but is not limited to step S410 and step S420.

[0045] Step S410, obtaining the correspondence between the three-dimensional structure information of each first object and the three-dimensional structure information of each second object; Step S420: Merge the first target three-dimensional structure information and the second target three-dimensional structure information according to the corresponding relationship.

[0046] It can be understood that after obtaining multiple first target three-dimensional structural information and multiple second target three-dimensional structural information based on multiple adjacent position relationships, the first target three-dimensional structural information and the second target three-dimensional structural information are merged according to the corresponding relationship between each first target three-dimensional structural information and each second target three-dimensional structural information to obtain the three-dimensional structural stereo information of the target area, thereby enabling the rapid acquisition of the three-dimensional structural stereo information.

[0047] In addition, if Figure 5 As shown, Figure 5 It is a flowchart of a method for acquiring stereoscopic information of a three-dimensional structure provided by another embodiment of the present application; regarding the above-mentioned step S420, it may include but is not limited to step S510 and step S520.

[0048] Step S510: When the first target three-dimensional structure information corresponds to a second target three-dimensional structure information, the first target three-dimensional structure information and the second target three-dimensional structure information are merged; Step S520: When the first target three-dimensional structure information corresponds to a plurality of second target three-dimensional structure information, the corresponding second target three-dimensional structure information is merged to obtain third target three-dimensional structure information, and the first target three-dimensional structure information is merged with the third target three-dimensional structure information.

[0049] It can be understood that, through the correspondence between the first target three-dimensional structure information and the second target three-dimensional structure information, the first target three-dimensional structure information and the second target three-dimensional structure information are merged to obtain the three-dimensional structure stereo information of the target area, thereby realizing the rapid acquisition of the three-dimensional structure stereo information.

[0050] Based on the three-dimensional structure stereo information acquisition methods of the above-mentioned various embodiments, overall embodiments of the three-dimensional structure stereo information acquisition methods of the present application are respectively proposed below.

[0051] 1. Structural slice acquisition like Figure 6 , Figure 7 and Figure 8 As shown, Figure 6 is a schematic diagram of a surface structure reflection light path of a target structure provided by an embodiment of the present application, Figure 7 is a schematic diagram of a line structure reflection light path of a target structure provided by an embodiment of the present application, Figure 8 It is a schematic diagram of the reflected light path of the edge structure of the target structure provided by one embodiment of the present application.

[0052] Use specific lighting imaging methods to extract information about the target structure in a targeted manner. Taking edge features as an example, using a light source at a specific angle can improve the performance of structural edge information in the field of view and weaken or even shield the interference of certain planar information in describing the structural target structure.

[0053] The slice imaging of the target area is obtained by step-wise changing the distance between the microscope objective lens and the target to be measured, so that accurate slice data of the target area of ​​the target structure can be obtained.

[0054] 2. Data Block Processing like Fig. 9 As shown, Fig. 9 It is a schematic diagram of the structure of three-dimensional data blocks provided by an embodiment of the present application.

[0055] Taking advantage of the continuity of information in space and the relative stability of data format, the slice data of the target area is processed in three dimensions to obtain multiple three-dimensional data blocks, which is prepared for the following parallel processing to improve the operating efficiency of related processes. Fig. 9 shown.

[0056] 3. Target structure extraction The characteristics of the target structure are used to perform true value judgment in the block-based point cloud to filter out and record data information with obvious target characteristics.

[0057] According to the preset target structure determination model, the target three-dimensional structure is extracted from multiple three-dimensional data blocks.

[0058] The target structure determination model is:

[0059] in, To calculate the result, is the target structure determination function, F is the preset feature extraction function corresponding to the target structure, U is the preset neighborhood function, is the slice image group information, is the preset threshold.

[0060] like Fig.10 As shown, Fig.10 It is a schematic diagram of the structure of a bonding wire provided in one embodiment of the present application.

[0061] When the target structure is a bonding wire, F can be the gradient information and brightness of adjacent positions, so that the target structure judgment function can be used to judge the absolute value, relative value and brightness of the gradient of adjacent positions on multiple three-dimensional data blocks, and then extract the target three-dimensional structure.

[0062] 4. Information processing within the block like Fig.11 As shown, Fig.11 It is a schematic diagram of a three-dimensional retrieval pixel determination neighborhood provided by an embodiment of the present application.

[0063] According to the judgment result in the previous step, the three-dimensional connectivity information of the target structure is retrieved and the three-dimensional connectivity information of the target structure is judged. The simplest judgment neighborhood in the twenty-six neighborhoods is as follows: Fig.11 shown.

[0064] Information retrieval is performed in the neighborhood and the CCL strategy is used to determine the relevant communication information, and the relevant information is updated in each block in parallel, providing information support for the information integration between the following blocks.

[0065] 5. Parallel merging between blocks like Fig.12 As shown, Fig.12 This is a three-dimensional block neighborhood schematic diagram provided by an embodiment of the present application.

[0066] The adjacent position relationships between blocks include adjacent face adjacency, diagonal edge adjacency and diagonal vertex adjacency, which correspond to the adjacency relationships of faces, lines and points respectively.

[0067] like Fig.13 , Fig.14 As shown, Fig.13 is a schematic diagram of the neighboring surface where the current pixel is located, provided by an embodiment of the present application. Fig.14 This is a schematic diagram of the neighboring surface neighborhood of the current pixel of an adjacent block provided by an embodiment of the present application.

[0068] like Fig.13 and Fig.14 As shown, when processing the information merging between three-dimensional data blocks with surface adjacent relationships, it is necessary to process the information of 8 positions s2~s9 in the pixel block where the current position is located and the information of 9 pixel positions n1~n9 in the adjacent pixel block. Since the information within the block has completed the information statistics of the spatial position relationship, when processing the information merging of adjacent surfaces, the information that needs to be merged can be simplified to the current pixel position and 9 adjacent positions in the adjacent blocks.

[0069] like Fig.15 and Fig.16 As shown, Fig.15 is a current pixel and its simplest pixel determination area provided by an embodiment of the present application, Fig.16 This is a simplest decision process tree diagram corresponding to the current pixel provided by an embodiment of the present application.

[0070] like Fig.16 As shown, Continue means that the current position will not be processed. For the general The label at the position The tags at the positions are merged. Will and After the labels of multiple locations are merged, The tags at the positions are merged.

[0071] like Fig.17 and Fig.18 As shown, Fig.17 is a pixel neighborhood to be merged at an adjacent edge position provided by an embodiment of the present application, Fig.18 This is a simplest decision process tree diagram corresponding to the current pixel provided by another embodiment of the present application.

[0072] like Fig.17 As shown, c1~c3 represent the pixels in the current block, b1~b3 are the pixels of the adjacent edges, and c2 is the current pixel position when the information is updated. Fig.18 As shown, Continue means that the current position will not be processed. For the general The label at the position The tags at the positions are merged. Will and The tags at The label information at the position is merged.

[0073] Table 1 Simplified edge merging operation truth table

[0074] The left columns c2 and b1~b3 in Table 1 represent the information to be determined at the pixel position. 0 represents that there is no information that meets the requirements at this position, 1 represents that there is information that meets the requirements at this position, and any represents that the information at this position does not affect the determination. The right side is the operation performed at the position with a value of 1 when it is known that the left side has determination information.

[0075] like Fig.19 and Fig. 20 As shown, Fig.19 is a schematic diagram of the position relationship between diagonal vertex blocks provided by an embodiment of the present application, Fig. 20 This is a schematic diagram of the position relationship of diagonal vertex pixels provided by an embodiment of the present application.

[0076] For mutually oblique block graphs, when determining the connected domain relationship, it is sufficient to directly determine the pixels at the oblique angle position. If there is an adjacent connected region relationship, the label pair can be merged.

[0077] The retrieval of adjacent faces, diagonal edges and diagonal vertices between the above blocks can be run in parallel, and finally the information merging between different blocks can be completed.

[0078] 6. Structural information output The merged indicator information is updated and the relevant indicator information is passed as input information to the next process.

[0079] It is worth noting that since the present application can merge multiple target three-dimensional structural information according to the adjacent position relationship of multiple three-dimensional data blocks to obtain three-dimensional structural stereo information of the target area, it can achieve rapid acquisition of three-dimensional structural stereo information.

[0080] Based on the three-dimensional structure stereo information acquisition method of each of the above embodiments, various embodiments of the controller, three-dimensional structure stereo information acquisition system, computer-readable storage medium and computer program product of the present application are respectively proposed below.

[0081] like Fig.21 As shown, Fig.21700 is a schematic diagram of a controller for executing a method for acquiring three-dimensional structure stereo information provided by an embodiment of the present application. The controller 700 implemented in the present application includes: a processor 710, a memory 720, and a computer program stored in the memory 720 and executable on the processor 710, wherein: Fig.21 In the figure, a processor 710 and a memory 720 are taken as an example.

[0082] The processor 710 and the memory 720 may be connected via a bus or other means. Fig.21 The example of connecting through bus is taken in the following.

[0083] The memory 720, as a non-transitory computer-readable storage medium, can be used to store non-transitory software programs and non-transitory computer executable programs. In addition, the memory 720 may include a high-speed random access memory, and may also include a non-transitory memory, such as at least one disk storage device, a flash memory device, or other non-transitory solid-state storage device. In some embodiments, the memory 720 optionally includes a memory 720 remotely arranged relative to the processor 710, and these remote memories 720 can be connected to the controller 700 via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0084] Those skilled in the art will understand that Fig.21 The device structure shown in the figure does not constitute a limitation on the controller 700, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0085] exist Fig.21 In the controller 700 shown, the processor 710 can be used to call the control program stored in the memory 720, so as to implement the above-mentioned three-dimensional structure stereo information acquisition method. Specifically, the non-transient software program and instructions required to implement the three-dimensional structure stereo information acquisition method of the above-mentioned embodiment are stored in the memory 720, and when executed by the processor 710, the three-dimensional structure stereo information acquisition method of the above-mentioned embodiment is executed.

[0086] It is worth noting that since the controller 700 of the embodiment of the present application can execute the three-dimensional structure stereo information acquisition method of any of the above-mentioned embodiments, the specific implementation manner and technical effects of the controller 700 of the embodiment of the present application can refer to the specific implementation manner and technical effects of the three-dimensional structure stereo information acquisition method of any of the above-mentioned embodiments.

[0087] In addition, an embodiment of the present application further provides a three-dimensional structure stereoscopic information acquisition system, and the three-dimensional structure stereoscopic information acquisition system includes the controller of the above embodiment.

[0088] It is worth noting that since the three-dimensional structure stereo information acquisition system of the embodiment of the present application includes the controller of the above-mentioned embodiment, and the controller of the above-mentioned embodiment is capable of executing the three-dimensional structure stereo information acquisition method of any of the above-mentioned embodiments, the specific implementation manner and technical effects of the three-dimensional structure stereo information acquisition system of the embodiment of the present application can refer to the specific implementation manner and technical effects of the three-dimensional structure stereo information acquisition method of any of the above-mentioned embodiments.

[0089] In addition, an embodiment of the present application further provides a computer-readable storage medium, which stores computer-executable instructions, and the computer-executable instructions are used to execute the above-mentioned three-dimensional structure stereo information acquisition method. Figures 1 to 5 The method steps in .

[0090] It is worth noting that since the computer-readable storage medium of the embodiment of the present application can execute the three-dimensional structure stereo information acquisition method of any of the above-mentioned embodiments, the specific implementation manner and technical effects of the computer-readable storage medium of the embodiment of the present application can refer to the specific implementation manner and technical effects of the three-dimensional structure stereo information acquisition method of any of the above-mentioned embodiments.

[0091] In addition, an embodiment of the present application further provides a computer program product, including a computer program or a computer instruction, the computer program or the computer instruction is stored in a computer-readable storage medium, the processor of the computer device reads the computer program or the computer instruction from the computer-readable storage medium, and the processor executes the computer program or the computer instruction, so that the computer device executes the above-mentioned three-dimensional structure stereo information acquisition method. Exemplarily, the above-described Figures 1 to 5 The method steps in .

[0092] It is worth noting that since the computer program product of the embodiment of the present application can execute the three-dimensional structure stereo information acquisition method of any of the above-mentioned embodiments, the specific implementation manner and technical effects of the computer program product of the embodiment of the present application can refer to the specific implementation manner and technical effects of the three-dimensional structure stereo information acquisition method of any of the above-mentioned embodiments.

[0093] It will be appreciated by those skilled in the art that all or some of the steps and systems in the methods disclosed above may be implemented as software, firmware, hardware, and appropriate combinations thereof. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include a computer storage medium (or non-transitory medium) and a communication medium (or transient medium). As known to those skilled in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and can be accessed by a computer. Furthermore, it is well known to those skilled in the art that communication media generally include computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media.

[0094] It should be understood that in the present application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0095] In several embodiments provided in the present application, it should be understood that the disclosed systems, apparatuses and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely schematic, for example, the division of units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of apparatuses or units, which can be electrical, mechanical or other forms. The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the scheme of this embodiment.

[0096] It should also be understood that the various implementations provided in the embodiments of the present application can be combined arbitrarily to achieve different technical effects.

[0097] The above is a specific description of the preferred implementation of the present application, but the present application is not limited to the above implementation mode. Technical personnel familiar with the field can also make various equivalent modifications or substitutions under the shared conditions without violating the spirit of the present application. These equivalent modifications or substitutions are all included in the scope defined by the claims of the present application.

Claims

1. A method for obtaining stereoscopic information of a three-dimensional structure, characterized in that: The method comprises: Performing slice imaging processing on a target area of ​​the target structure to obtain slice data of the target area; Performing three-dimensional block processing on the slice data to obtain a plurality of three-dimensional data blocks; Extracting a target three-dimensional structure from the plurality of three-dimensional data blocks according to a preset target structure determination model; Performing three-dimensional interconnection information retrieval on the target three-dimensional structure to obtain target three-dimensional structure information; The adjacent position relationship of the plurality of three-dimensional data blocks is obtained, and the plurality of target three-dimensional structure information is merged according to the adjacent position relationship to obtain the three-dimensional structure stereo information of the target area.

2. A method for obtaining three-dimensional structure information according to claim 1, characterized in that: The step of extracting the target three-dimensional structure from the plurality of three-dimensional data blocks according to the preset target structure determination model includes: Acquire slice image group information of each of the three-dimensional data blocks; Inputting the slice image group information into a preset target structure determination model, and outputting a calculation result through the target structure determination model; When the calculation result is greater than a preset threshold, the three-dimensional data is divided into blocks as the target three-dimensional structure.

3. A method for obtaining three-dimensional structure information according to claim 2, characterized in that: The target structure determination model is: Among them, the is the calculation result, the is the target structure determination function, F is the preset feature extraction function corresponding to the target structure, U is the preset neighborhood function, is the slice image group information, the is the preset threshold.

4. The method for obtaining three-dimensional structure information according to claim 1, characterized in that: The step of merging the plurality of target three-dimensional structural information according to the adjacent position relationship to obtain the three-dimensional structural stereoscopic information of the target area includes: According to the plurality of adjacent position relationships, obtaining a plurality of first target three-dimensional structure information of the plurality of three-dimensional data blocks at the current position, and obtaining a plurality of second target three-dimensional structure information of the plurality of three-dimensional data blocks at adjacent positions; The three-dimensional structural information of each of the first targets and the three-dimensional structural information of each of the second targets are merged to obtain the three-dimensional structural stereo information of the target area.

5. A method for acquiring three-dimensional structure information according to claim 4, characterized in that: The merging of each of the first target three-dimensional structure information and each of the second target three-dimensional structure information includes: Acquire a correspondence between each of the first target three-dimensional structure information and each of the second target three-dimensional structure information; The first target three-dimensional structure information and the second target three-dimensional structure information are merged according to the corresponding relationship.

6. A method for acquiring three-dimensional structure information according to claim 5, characterized in that: The merging of the first target three-dimensional structure information and the second target three-dimensional structure information according to the corresponding relationship includes one of the following: When the first target three-dimensional structure information corresponds to one piece of the second target three-dimensional structure information, merging the first target three-dimensional structure information with the second target three-dimensional structure information; When the first target three-dimensional structure information corresponds to multiple second target three-dimensional structure information, the corresponding second target three-dimensional structure information is merged to obtain third target three-dimensional structure information, and the first target three-dimensional structure information is merged with the third target three-dimensional structure information.

7. A controller, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes a method for acquiring stereoscopic information of a three-dimensional structure as described in any one of claims 1 to 6 when executing the computer program.

8. A three-dimensional structure stereo information acquisition system, characterized in that: Comprising a controller as claimed in claim 7.

9. A computer-readable storage medium, characterized in that: Computer executable instructions are stored, and the computer executable instructions are used to execute a method for acquiring stereoscopic information of a three-dimensional structure as described in any one of claims 1 to 6.

10. A computer program product comprising a computer program or computer instructions, characterized in that The computer program or the computer instruction is stored in a computer-readable storage medium, and the processor of a computer device reads the computer program or the computer instruction from the computer-readable storage medium. The processor executes the computer program or the computer instruction, so that the computer device executes a method for acquiring three-dimensional structure stereo information as described in any one of claims 1 to 6.

Images