Measurement method and device based on coded semantic speckle

Abstract

The application provides a kind of based on the measuring method and device of encoding semantic speckle, belong to image measurement field, wherein, the method includes: configuration speckle semantics, and based on the speckle semantics and preset characteristic parameter constructs speckle pattern, wherein, the speckle semantics is used to indicate the arrangement shape and arrangement position of speckle;With the speckle pattern and the speckle semantics fusion generates encoding semantic speckle;Based on the encoding semantic speckle measures the physical parameter of target object. Through the embodiment of the application, the technical problem that the measurement result is wrong due to the shielding or isolation of the pre-orientation mark point in the related art is solved, while realizing the original mark point function, it also has the constraint of semantics, so higher precision measurement result can be realized, complete global measurement result is realized, and the global measurement precision is improved.

Description

Technical Field

[0001] This invention relates to the field of image measurement, and more specifically, to a measurement method and apparatus based on coded semantic speckle. Background Technology

[0002] In related technologies, digitally driven processing and inspection of modern components is one of the important directions for the current development of the digital economy and society. Rapid and accurate morphological and deformation measurements of geometric components have become crucial for assisting in the analysis of their mechanical properties, service life, and related digital structural construction. Currently, with the development of computers and storage devices, photogrammetry techniques, represented by Digital Image Correlation (DIC), play an important monitoring and inspection role in fields such as civil engineering, automotive, aerospace, and materials science due to their simple structure, non-contact nature, and ability to perform high-precision full-field deformation measurements, achieving fruitful results. Currently, grating projection and digital image correlation methods are the two most widely used non-contact measurement techniques in the industrial field.

[0003] In related technologies, using multiple cameras for non-destructive testing of components or structures is the mainstream method for obtaining high-precision or large-scale full-field measurement results. This method uses multiple cameras to perform relevant measurements on various local areas, ensuring achievable measurement resolution. Simultaneously, it utilizes the spatial mapping relationship between the camera systems to stitch together the global measurement results. One stitching method uses a combination of pre-defined markers and DIC (Digital Indicator): the markers are used for pre-orientation calculations to form a global coordinate system, then the multi-camera DIC method is used for corresponding calculations and tracking to form local coordinate system results, and finally the results are fused. Because in industrial testing, the installation distance of systems often reaches several meters, and there is little overlap between camera systems, the method of using markers for pre-orientation has been widely used. However, the markers required for pre-orientation must be placed on the surface of the object being measured, which can lead to the isolation or even loss of some local measurement results, affecting the final evaluation results. Especially when the obscured part has defects or structural problems, the measurement results can lead to incorrect analysis directions, making it impossible to obtain the correct improvement plan.

[0004] No efficient and accurate solution has yet been found to address the aforementioned issues in the relevant technologies. Summary of the Invention

[0005] This invention provides a measurement method and apparatus based on encoded semantic speckle to solve technical problems in related technologies.

[0006] According to an embodiment of the present invention, a measurement method based on coded semantic speckle is provided, comprising: configuring speckle semantics; constructing a speckle pattern based on the speckle semantics and preset feature parameters, wherein the speckle semantics is used to indicate the arrangement shape and arrangement position of speckles; generating coded semantic speckle by fusing the speckle pattern and the speckle semantics; and measuring the physical parameters of a target object based on the coded semantic speckle.

[0007] Furthermore, configuring speckle semantics includes: determining the shape regularity of the target object; if the shape regularity of the target object is greater than a preset threshold, configuring a first speckle semantic; if the shape regularity of the target object is less than or equal to the preset threshold, configuring a second speckle semantic, wherein the first speckle semantic is used to characterize a definition point, and the second speckle semantic is used to characterize geometric constraints and / or orientation points.

[0008] Furthermore, constructing a speckle pattern based on the speckle semantics and preset feature parameters includes: counting the number of semantics in the speckle semantics; determining whether the number of semantics is greater than a first preset number; if the number of semantics is greater than the first preset number, constructing a first speckle pattern conforming to the preset feature parameters using geometric particle size; if the number of semantics is less than or equal to the first preset number, constructing a second speckle pattern conforming to the preset feature parameters using a grayscale optimization algorithm.

[0009] Furthermore, the preset feature parameters include: a duty cycle of 1:1, a particle size of 3 to 5 pixels, and a randomness of 0.3.

[0010] Furthermore, the process of generating coded semantic speckles by fusing the speckle pattern and the speckle semantics includes: searching for a matching encoding type based on the semantic quantity of the speckle semantics, wherein the encoding type includes one of the following: 2n encoding, Green code encoding, directed ring encoding, and undirected ring encoding; generating coded semantic speckles based on the speckle pattern, the speckle semantics, and the encoding type, and converting them into digitized coded semantic speckles.

[0011] Furthermore, generating coded semantic speckles based on the speckle pattern, the speckle semantics, and the encoding type includes: if the encoding type is directed ring encoding or undirected ring encoding, constructing background speckles based on the speckle pattern and the speckle semantics; and adding positioning rings to the background speckles using black circular speckles to obtain coded semantic speckles.

[0012] Furthermore, the encoding type for matching based on the semantic quantity of the speckle semantics includes: determining whether the semantic quantity of the speckle semantics is greater than a preset quantity; if the semantic quantity of the speckle semantics is less than or equal to the preset quantity, using Green's code encoding, undirected loop encoding, or binary encoding; if the semantic quantity of the speckle semantics is greater than the preset quantity, using 2n encoding or directed loop encoding.

[0013] Furthermore, the physical parameters of the target object are measured based on the encoded semantic speckle, which includes: constructing a speckle region on the surface of the target object using the encoded semantic speckle; calibrating the camera based on the speckle region; and performing a full-field measurement of the target object using the multi-camera digital image correlation (DIC) method to obtain the displacement field and strain field of the target object, wherein the physical parameters include the displacement field and the strain field.

[0014] According to another embodiment of the present invention, a measurement device based on coded semantic speckle is provided, comprising: a configuration module for configuring speckle semantics and constructing a speckle pattern based on the speckle semantics and preset feature parameters, wherein the speckle semantics is used to indicate the arrangement shape and arrangement position of the speckles; a generation module for generating coded semantic speckles by fusing the speckle pattern and the speckle semantics; and a measurement module for measuring the physical parameters of a target object based on the coded semantic speckles.

[0015] Furthermore, the configuration module includes: a determining unit, used to determine the shape regularity of the target object; and a configuration unit, used to configure a first speckle semantic if the shape regularity of the target object is greater than a preset threshold; and to configure a second speckle semantic if the shape regularity of the target object is less than or equal to the preset threshold, wherein the first speckle semantic is used to characterize a definition point, and the second speckle semantic is used to characterize geometric constraints and / or orientation points.

[0016] Furthermore, the configuration module includes: a statistics unit for counting the number of speckle semantics; a judgment unit for judging whether the number of semantics is greater than a first preset number; and a construction unit for constructing a first speckle pattern conforming to the preset feature parameters using geometric particle size if the number of semantics is greater than the first preset number; and constructing a second speckle pattern conforming to the preset feature parameters using a grayscale optimization algorithm if the number of semantics is less than or equal to the first preset number.

[0017] Furthermore, the preset feature parameters include: a duty cycle of 1:1, a particle size of 3 to 5 pixels, and a randomness of 0.3.

[0018] Furthermore, the generation module includes: a search unit, used to search for a matching encoding type based on the semantic quantity of the speckle semantics, wherein the encoding type includes one of the following: 2n encoding, Green code encoding, directed ring encoding, and undirected ring encoding; and a generation unit, used to generate encoded semantic speckles based on the speckle pattern, the speckle semantics, and the encoding type, and convert them into digitized encoded semantic speckles.

[0019] Furthermore, the generation unit includes: a construction subunit, used to construct background speckles based on the speckle pattern and the speckle semantics if the encoding type is directed ring encoding or undirected ring encoding; and an addition subunit, used to add positioning rings to the background speckles using black circular speckles to obtain encoded semantic speckles.

[0020] Furthermore, the search unit includes: a judgment subunit, used to judge whether the number of semantics of the speckle semantics is greater than a preset number; and a determination subunit, used to use Green code encoding, undirected loop encoding, or binary encoding if the number of semantics of the speckle semantics is less than or equal to the preset number; and to use 2n encoding or directed loop encoding if the number of semantics of the speckle semantics is greater than the preset number.

[0021] Furthermore, the measurement module includes: a construction unit for constructing a speckle region on the surface of the target object using the encoded semantic speckle; and a measurement unit for calibrating the camera based on the speckle region and performing full-field measurement on the target object using the multi-camera digital image correlation (DIC) method to obtain the displacement field and strain field of the target object, wherein the physical parameters include the displacement field and the strain field.

[0022] According to another aspect of the embodiments of this application, a storage medium is also provided, the storage medium including a stored program that executes the above steps when the program is run.

[0023] According to another aspect of the embodiments of this application, an electronic device is also provided, including a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus; wherein: the memory is used to store computer programs; and the processor is used to execute the steps in the above method by running the programs stored in the memory.

[0024] This application also provides a computer program product containing instructions that, when run on a computer, cause the computer to perform the steps in the above-described method.

[0025] The beneficial effects of this invention are:

[0026] 1. This invention designs speckle patterns, assigns semantic meaning to speckles, and constructs reasonable coding rules to form coded semantic speckles, thereby replacing the coded markers used in traditional methods, solving the problems of occlusion and isolation of pre-directed markers, and achieving complete global measurement results.

[0027] 2. This invention designs the encoding based on the types of semantics, enabling not only the semantics to be recognized but also to possess encoded features. This replaces the original encoded markers, achieving the functionality of the original markers while also incorporating semantic constraints, thus enabling higher-precision measurement results.

[0028] 3. In order to ensure that it can successfully replace the function of the original marker points, the present invention constructs a positioning ring with ordinary speckle during the ring coding process, thereby improving the measurement accuracy. Attached Figure Description

[0029] The accompanying drawings, which are included to provide a further understanding of the invention and form part of this application, illustrate exemplary embodiments of the invention and, together with their description, serve to explain the invention and do not constitute an undue limitation thereof. In the drawings:

[0030] Figure 1 This is a hardware structure block diagram of an in-vehicle terminal according to an embodiment of the present invention;

[0031] Figure 2 This is a flowchart of a measurement method based on coded semantic speckle according to an embodiment of the present invention;

[0032] Figure 3 This is a schematic diagram of the speckle pattern according to an embodiment of the present invention;

[0033] Figure 4 This is a schematic diagram of the encoding type in an embodiment of the present invention;

[0034] Figure 5 This is a schematic diagram of the semantic speckle pattern and the corresponding DIC calculation results designed in an embodiment of the present invention;

[0035] Figure 6 This is a flowchart of an embodiment of the present invention;

[0036] Figure 7 This is a structural block diagram of a measurement device based on coded semantic speckle according to an embodiment of the present invention. Detailed Implementation

[0037] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, and not all of them. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present application. It should be noted that, unless otherwise specified, the embodiments and features in the embodiments of the present application can be combined with each other.

[0038] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0039] Example 1

[0040] The method embodiment provided in Embodiment 1 of this application can be executed in a computer, image measuring instrument, image measuring tool, or similar processing device. Taking running on a computer as an example, Figure 1 This is a hardware structure block diagram of a computer according to an embodiment of the present invention. For example... Figure 1 As shown, a computer may include one or more ( Figure 1 Only one is shown in the diagram. A processor 102 (which may include, but is not limited to, a microprocessor MCU or a programmable logic device FPGA, etc.) and a memory 104 for storing data are also shown. Optionally, the computer may further include a transmission device 106 for communication functions and an input / output device 108. Those skilled in the art will understand that... Figure 1 The structure shown is for illustrative purposes only and does not limit the structure of the computer described above. For example, the computer may also include components that are larger than... Figure 1 The more or fewer components shown, or having the same Figure 1 The different configurations shown.

[0041] The memory 104 can be used to store computer programs, such as application software programs and modules, like the computer program corresponding to a measurement method based on coded semantic speckle in this embodiment of the invention. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, thereby implementing the aforementioned method. The memory 104 may include high-speed random access memory and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include memory remotely located relative to the processor 102, and these remote memories can be connected to the computer via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0042] The transmission device 106 is used to receive or send data via a network. Specific examples of the network described above may include a wireless network provided by a computer's communication provider. In one example, the transmission device 106 includes a Network Interface Controller (NIC), which can connect to other network devices via a base station to communicate with the Internet. In another example, the transmission device 106 may be a Radio Frequency (RF) module used for wireless communication with the Internet.

[0043] This embodiment provides a measurement method based on encoded semantic speckle. Figure 2 This is a flowchart of a measurement method based on encoded semantic speckle according to an embodiment of the present invention, such as... Figure 2 As shown, the process includes the following steps:

[0044] Step S202: Configure speckle semantics and construct speckle patterns based on speckle semantics and preset feature parameters, wherein speckle semantics is used to indicate the arrangement shape and position of speckles;

[0045] The speckle semantics in this embodiment are designed and selected according to actual needs. Semantics such as "location point", "geometric constraint" and "direction point" are given by humans according to actual measurement conditions and requirements. Therefore, the way of decoding semantics will also be different.

[0046] Step S204: Generate encoded semantic speckle by fusing speckle patterns and speckle semantics;

[0047] In this embodiment, semantics refers to one or more types of features defined by the user based on the test. These features give specific meanings or constraints to speckle patterns. The encoding is designed according to the types of semantics, so that the semantics are not only recognizable but also possess coded features, thus replacing the original coded markers. While achieving the function of the original markers, it also has semantic constraints, thereby achieving higher accuracy measurement results. Furthermore, since additional markers are no longer attached, the problems of occlusion and isolation of pre-oriented markers are solved, resulting in complete global measurement results.

[0048] Step S206: Measure the physical parameters of the target object based on encoded semantic speckle.

[0049] The target object in this embodiment is the object under test, which can be a two-dimensional or three-dimensional object, such as the geometric parameters of automotive parts. It can also be applied to measurements in fields such as civil engineering, automotive, aerospace, and materials. It can cover dynamic and static tests of all full-scale structures involved in existing measurement methods, and can also be applied in crash test scenarios; it can also be used for high-precision measurement schemes using camera arrays within a local area.

[0050] Through the above steps, speckle semantics are configured, and speckle patterns are constructed based on speckle semantics and preset feature parameters. The speckle semantics are used to indicate the arrangement shape and position of the speckles. The speckle patterns and speckle semantics are fused to generate coded semantic speckles. The physical parameters of the target object are measured based on the coded semantic speckles. The speckle pattern is designed using the characteristics of the speckles themselves, and the coded relationship is constructed to replace the marker points in related technologies. This solves the technical problem in related technologies where the predetermined marker points are occluded or isolated, leading to incorrect measurement results. While realizing the original marker point function, it also has semantic constraints, thus achieving higher accuracy measurement results, realizing complete global measurement results, and improving global measurement accuracy.

[0051] In one example, constructing a speckle pattern based on speckle semantics and preset feature parameters includes: counting the number of speckle semantics; determining whether the number of semantics is greater than a first preset number; if the number of semantics is greater than the first preset number, constructing a first speckle pattern that conforms to the preset feature parameters using geometric particle size; if the number of semantics is less than or equal to the first preset number, constructing a second speckle pattern that conforms to the preset feature parameters using a grayscale optimization algorithm.

[0052] In this embodiment, two styling options are available: one is to replace the original speckle shape, such as using triangular or quadrilateral particle sizes; the other is to use grayscale optimization. Grayscale optimization is used when semantic requirements are low, while different particle sizes are introduced when semantic requirements are high. The speckle combination methods are either replacing the original speckle shape or using grayscale optimization. The former (grayscale optimization) can easily form new speckle shapes, while the latter (geometric particle size) involves some computation but can improve the accuracy of related calculation results. An optional approach is to combine both (geometric particle size and grayscale optimization).

[0053] Figure 3 These are schematic diagrams of speckle patterns according to embodiments of the present invention, illustrating four patterns. The first three images (patterns 1 to 3) show the results obtained by replacing the original speckle particles (black circular objects) with triangular, hexagonal, and quadrilateral particle sizes, respectively. The last image (pattern 4) shows the result obtained by optimizing the grayscale gradient of the sub-region.

[0054] Optional preset feature parameters include: a duty cycle of 1:1, a particle size of 3 to 5 pixels, and a randomness of 0.3.

[0055] To ensure the accuracy of the final calculation results is not compromised, and even to improve measurement precision, regardless of the method used to generate the pattern, the three feature values ​​upon which the final calculation depends should be: a duty cycle of 1:1, a particle size of 3-5 pixels, and a randomness of 0.3. These three design parameters must be guaranteed during the design process.

[0056] In one embodiment of this example, configuring speckle semantics includes: determining the shape regularity of the target object; if the shape regularity of the target object is greater than a preset threshold, configuring a first speckle semantic; if the shape regularity of the target object is less than or equal to the preset threshold, configuring a second speckle semantic, wherein the first speckle semantic is used to characterize a definition point, and the second speckle semantic is used to characterize geometric constraints and / or orientation points.

[0057] The semantics of speckle are designed according to the needs of practical applications. In some examples, speckle semantics include "location point," "geometric constraint," and "direction point." These semantics are all given manually based on the actual measurement situation and requirements. The requirements for speckle semantics are flexibly determined according to the actual measured object. For example, for ordinary measurement needs, the semantics only need to provide the "location" function; for the measurement of some long and narrow objects with irregular shapes, which may be difficult to calibrate, "direction" and "shape" semantics can be added on the basis of the "location" function to assist in calibration. The definitions of speckle semantics in this embodiment are all manual, so they can be changed in any way, and are highly flexible. Generally, the definition of semantics can include "location point," "geometric constraint," "direction point," and "starting point," etc. The semantics are manually defined and related to shape and design position. For example, the semantics of all triangular speckle centers forming a "square" shape constraint means that the arrangement of all triangular speckles is strictly designed to be a square.

[0058] In one embodiment of this example, generating coded semantic speckles by fusing speckle patterns and speckle semantics includes: searching for matching coding types based on the semantic quantity of speckle semantics, wherein the coding type includes one of the following: 2n coding, Green code coding, directed ring coding, and undirected ring coding; generating coded semantic speckles based on speckle patterns, speckle semantics, and coding types, and converting them into digitized coded semantic speckles.

[0059] After the styles and semantics are constructed, encoding is performed. Encoding can be done in various ways depending on the number of semantics. Figure 4 This is a schematic diagram of the encoding type in an embodiment of the present invention. If there are two semantics, then it can be used. Figure 4 The first image uses either binary encoding or the corresponding Green's coding scheme; for images with multiple semantic meanings, the following can be used: Figure 4 The second image in the middle is 2 n For encoding situations requiring a large amount of encoding space, one can use... Figure 4 The undirected cycle encoding in the third image.

[0060] This implementation integrates speckle patterns and semantics to design a semantic-digit encoding mapping, constructing an encoding scheme to form coded semantic speckles. Optional encoding forms primarily include 2n encoding, Green's code encoding, directed cyclic encoding, and undirected cyclic encoding. When matching the encoding scheme with the measurement scene, a deep learning network is first used to find regions, and then digital correlation techniques are used for matching to obtain the final image location. Based on the aforementioned semantic patterns and encoding methods, digitized coded semantic speckles are generated and produced using water transfer printing technology. This can be achieved by generating an electronic image PDF file using computer code and then generating the speckles using a pasting method, or by using screen printing or other techniques.

[0061] In one implementation scenario, generating coded semantic speckles based on speckle pattern, speckle semantics, and coding type includes: if the coding type is directed ring coding or undirected ring coding, constructing background speckles based on speckle pattern and speckle semantics; adding positioning rings to the background speckles using black circular speckles to obtain coded semantic speckles.

[0062] In this implementation scenario, the constructed directed and undirected loop codes should also include a positioning circle. This positioning circle is preferably designed with the same semantic meaning as the coding ring. To ensure it can successfully replace the original marker points, a positioning ring needs to be constructed using ordinary speckle patterns during ring coding to improve the accuracy of the acquisition. Ordinary speckle patterns: if artificially created, they are randomly painted black or white dots; if electronically generated, they are the most common black circular speckles. The positioning ring is simply an additional circle added inside the coding ring, such as... Figure 4 The positioning ring is a common design in traditional circular ring-coded speckle. This design draws on its stability and ease of recognition to create a semantic speckle that can completely replace the function of the coded marker points.

[0063] In one example, the encoding type for matching based on the number of semantics in speckle semantics includes: determining whether the number of semantics in speckle semantics is greater than a preset number; if the number of semantics in speckle semantics is less than or equal to the preset number, using Green code encoding, undirected cyclic encoding, or binary encoding; if the number of semantics in speckle semantics is greater than the preset number, using 2n encoding or directed cyclic encoding.

[0064] Optionally, the encoding scheme is related to the semantic design. Different numbers of semantics should have corresponding encoding schemes. If there is only one semantic, Green's code encoding or undirected cyclic encoding can be used directly; if there are multiple semantics, 2n encoding or directed cyclic encoding should be used.

[0065] In this embodiment, the physical parameters of the target object are measured based on coded semantic speckle, which includes: constructing a speckle region on the surface of the target object using coded semantic speckle; calibrating the camera based on the speckle region; and performing full-field measurement of the target object using the multi-camera digital image correlation (DIC) method to obtain the displacement field and strain field of the target object, wherein the physical parameters include the displacement field and strain field.

[0066] Using the generated water transfer printing semantic speckle pattern, an coded speckle region is constructed on the measurement object. Subsequent related measurements are then performed using multi-camera DIC full-field measurement technology to obtain the displacement and strain fields of the measurement object. The measurement process includes: transferring the designed coded semantic speckle pattern onto the surface of the object being measured using water transfer printing semantic speckle. The object can be any surface such as metal, concrete, or plastic. After creating the speckle pattern on the surface, the traditional method requires affixing markers and calibrating the camera. However, the solution in this embodiment simplifies these steps by directly calibrating the camera. Following this, the object is loaded, the camera acquires images, and post-processing calculations are performed using relevant calculations to obtain the strain field of the object's surface.

[0067] Figure 5 This is a schematic diagram of semantic speckle patterns and corresponding DIC calculation results designed according to an embodiment of the present invention. Four optimized speckle patterns replace the original speckle regions, which are used as semantic "location points" with known actual physical distances. Measurement results from the compression test show that the semantic speckle formed and constructed using the scheme of this embodiment is not lost during calculation, can be well integrated with the original speckle results, and the results are continuous without causing abrupt changes in calculation.

[0068] This embodiment proposes a coding semantic speckle design method based on traditional speckle. Utilizing the inherent characteristics of speckle, a speckle pattern is designed, and coding relationships are constructed to replace marker points, thus solving the occlusion and isolation problems of predetermined marker points and achieving complete global measurement results. Figure 6 This is a flowchart of an embodiment of the present invention, including:

[0069] Design the speckle pattern;

[0070] Determine the required semantic categories based on actual testing needs;

[0071] Based on the semantic category, determine the corresponding encoding method. Based on the semantic pattern and encoding method, form a semantic speckle pattern.

[0072] Electronic generation, water transfer printing manufacturing. Based on the above semantic style and encoding method, digitized encoded semantic speckles are generated and then produced using water transfer printing technology;

[0073] The sample is attached to the surface of the test piece and subjected to multi-camera DIC measurements. Using the generated water transfer printing semantic speckle, an coded speckle region is constructed for the measured object. Then, the traditional multi-camera DIC full-field measurement technique is used for subsequent related measurements to obtain the displacement and strain fields of the measured object in the full field.

[0074] This embodiment is based on the traditional speckle coding semantic speckle design method, which endows semantic information into traditional speckles, giving different artificial meanings to the feature points of the speckle region; at the same time, through style design and coding design, a coded semantic speckle pattern is formed, which is generated as an electronic pattern to replace the pre-directed markers of the traditional method. Through the designed semantics and coding, the problems of occlusion and isolation of pre-directed markers are solved, and complete global measurement results are achieved.

[0075] This embodiment designs speckle patterns, assigns semantic meaning to the speckles, and constructs reasonable coding rules to form semantically encoded speckles. This replaces the coded markers used in traditional methods. It utilizes the randomness and gray background characteristics of the speckles themselves for identification and encoding, replacing the original markers and solving the problems of occlusion and isolation of pre-directed markers, thus achieving complete global measurement results. Through the semantic design of the speckles, high-precision extrinsic parameter evaluation is achieved, thereby improving the global measurement accuracy and the fusion accuracy of the whole field measurement, providing a new application direction for more accurate monitoring and detection.

[0076] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods according to the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0077] Example 2

[0078] This embodiment also provides a measurement device based on encoded semantic speckle, which is used to implement the above embodiments and preferred embodiments; details already described will not be repeated. As used below, the term "module" can refer to a combination of software and / or hardware that implements a predetermined function. Although the device described in the following embodiments is preferably implemented in software, hardware implementation, or a combination of software and hardware, is also possible and contemplated.

[0079] Figure 7 This is a structural block diagram of a measurement device based on coded semantic speckle according to an embodiment of the present invention, such as... Figure 7 As shown, the device includes:

[0080] Configuration module 70 is used to configure speckle semantics and construct speckle patterns based on the speckle semantics and preset feature parameters, wherein the speckle semantics are used to indicate the arrangement shape and arrangement position of speckles;

[0081] Generation module 72 is used to generate coded semantic speckle by fusing the speckle pattern and the speckle semantics;

[0082] Measurement module 74 is used to measure the physical parameters of the target object based on the encoded semantic speckle.

[0083] Optionally, the configuration module includes: a determining unit, configured to determine the shape regularity of the target object; and a configuration unit, configured to configure a first speckle semantic if the shape regularity of the target object is greater than a preset threshold, and to configure a second speckle semantic if the shape regularity of the target object is less than or equal to the preset threshold, wherein the first speckle semantic is used to characterize a definition point, and the second speckle semantic is used to characterize geometric constraints and / or orientation points.

[0084] Optionally, the configuration module includes: a statistics unit for counting the number of speckle semantics; a judgment unit for judging whether the number of semantics is greater than a first preset number; and a construction unit for constructing a first speckle pattern conforming to the preset feature parameters using geometric particle size if the number of semantics is greater than the first preset number; and constructing a second speckle pattern conforming to the preset feature parameters using a grayscale optimization algorithm if the number of semantics is less than or equal to the first preset number.

[0085] Optionally, the preset feature parameters include: a duty cycle of 1:1, a particle size of 3 to 5 pixels, and a randomness of 0.3.

[0086] Optionally, the generation module includes: a search unit, used to search for a matching encoding type based on the semantic quantity of the speckle semantics, wherein the encoding type includes one of the following: 2n encoding, Green code encoding, directed ring encoding, and undirected ring encoding; and a generation unit, used to generate encoded semantic speckles based on the speckle pattern, the speckle semantics, and the encoding type, and convert them into digitized encoded semantic speckles.

[0087] Optionally, the generation unit includes: a construction subunit, used to construct background speckles based on the speckle pattern and the speckle semantics if the encoding type is directed ring encoding or undirected ring encoding; and an addition subunit, used to add positioning rings to the background speckles using black circular speckles to obtain encoded semantic speckles.

[0088] Optionally, the search unit includes: a judgment subunit, used to judge whether the number of semantics of the speckle semantics is greater than a preset number; and a determination subunit, used to, if the number of semantics of the speckle semantics is less than or equal to the preset number, use Green's code encoding, undirected loop encoding, or binary encoding; and if the number of semantics of the speckle semantics is greater than the preset number, use 2... n Encoding or directed ring encoding.

[0089] Optionally, the measurement module includes: a construction unit for constructing a speckle region on the surface of the target object using the encoded semantic speckle; and a measurement unit for calibrating a camera based on the speckle region and performing full-field measurements on the target object using the multi-camera digital image correlation (DIC) method to obtain the displacement field and strain field of the target object, wherein the physical parameters include the displacement field and the strain field.

[0090] It should be noted that the above modules can be implemented by software or hardware. For the latter, they can be implemented in the following ways, but are not limited to: all the above modules are located in the same processor; or, the above modules are located in different processors in any combination.

[0091] Example 3

[0092] Embodiments of the present invention also provide a storage medium storing a computer program, wherein the computer program is configured to execute the steps in any of the above method embodiments when running.

[0093] Optionally, in this embodiment, the storage medium may be configured to store a computer program for performing the following steps:

[0094] S1, Configure speckle semantics, and construct speckle patterns based on the speckle semantics and preset feature parameters, wherein the speckle semantics are used to indicate the arrangement shape and arrangement position of speckles;

[0095] S2, using the speckle pattern and the speckle semantic fusion to generate encoded semantic speckle;

[0096] S3, measure the physical parameters of the target object based on the encoded semantic speckle.

[0097] Optionally, in this embodiment, the storage medium may include, but is not limited to, various media capable of storing computer programs, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.

[0098] Embodiments of the present invention also provide an electronic device including a memory and a processor, the memory storing a computer program and the processor being configured to run the computer program to perform the steps in any of the above method embodiments.

[0099] Optionally, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor and the input / output device is connected to the processor.

[0100] Optionally, in this embodiment, the processor can be configured to perform the following steps via a computer program:

[0101] S1, Configure speckle semantics, and construct speckle patterns based on the speckle semantics and preset feature parameters, wherein the speckle semantics are used to indicate the arrangement shape and arrangement position of speckles;

[0102] S2, using the speckle pattern and the speckle semantic fusion to generate encoded semantic speckle;

[0103] S3, measure the physical parameters of the target object based on the encoded semantic speckle.

[0104] Optionally, specific examples in this embodiment can refer to the examples described in the above embodiments and optional implementations, and will not be repeated here.

[0105] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0106] In the above embodiments of this application, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0107] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual coupling, direct coupling, or communication connection may be through some interfaces; the indirect coupling or communication connection between units or modules may be electrical or other forms.

[0108] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0109] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0110] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as a USB flash drive, read-only memory (ROM), random access memory (RAM), portable hard drive, magnetic disk, or optical disk.

[0111] The above description is only a preferred embodiment of this application. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of this application, and these improvements and modifications should also be considered within the scope of protection of this application.

Claims

1. A measurement method based on coded semantic speckles, characterized in that, The method comprises the following steps: configuring speckle semantics, and constructing a speckle pattern based on the speckle semantics and preset characteristic parameters, wherein the speckle semantics are used to indicate the arrangement shape and arrangement position of speckles; generating coded semantic speckles by fusing the speckle pattern and the speckle semantics; measuring physical parameters of a target object based on the coded semantic speckles. Wherein, the encoding semantic speckle generated by fusing the speckle pattern and the speckle semantics includes: based on the semantic quantity of the speckle semantics, finding a matched encoding type, wherein the encoding type includes one of the following: 2 n Encoding, Golay code encoding, directed ring encoding and undirected ring encoding; based on the speckle pattern, the speckle semantics and the encoding type, generate an encoding semantic speckle and convert it into a digitized encoding semantic speckle.

2. The method of claim 1, wherein, The step of configuring speckle semantics comprises the following steps: determining the shape regularity of the target object; if the shape regularity of the target object is greater than a preset threshold, configuring first speckle semantics; if the shape regularity of the target object is less than or equal to the preset threshold, configuring second speckle semantics, wherein the first speckle semantics are used to represent definition points, and the second speckle semantics are used to represent geometric constraints and / or direction points.

3. The method of claim 1, wherein, The step of constructing a speckle pattern based on the speckle semantics and preset characteristic parameters comprises the following steps: counting the number of semantics of the speckle semantics; determining whether the number of semantics is greater than a first preset number; if the number of semantics is greater than the first preset number, constructing a first speckle pattern that meets the preset characteristic parameters by using geometric particle sizes; if the number of semantics is less than or equal to the first preset number, constructing a second speckle pattern that meets the preset characteristic parameters by using a gray-scale optimization algorithm.

4. The method of claim 3, wherein, The preset characteristic parameters comprise: a duty cycle of 1:1, a particle size of 3 to 5 pixels, and a randomness of 0.

3.

5. The method of claim 1, wherein, The step of generating coded semantic speckles based on the speckle pattern, the speckle semantics, and the encoding type comprises the following steps: if the encoding type is directed ring encoding or undirected ring encoding, constructing background speckles based on the speckle pattern and the speckle semantics; adding a positioning ring in the background speckles by using black circular speckles to obtain coded semantic speckles.

6. The method of claim 1, wherein, The step of looking up a matching encoding type based on the number of semantics of the speckle semantics comprises the following steps: determining whether the number of semantics of the speckle semantics is greater than a preset number; If the number of semantic elements in the speckle semantics is less than or equal to a preset number, Green's code encoding, undirected loop encoding, or binary encoding is used; if the number of semantic elements in the speckle semantics is greater than the preset number, 2T encoding is used. n Encoding or directed ring encoding.

7. The method of claim 1, wherein, The step of measuring physical parameters of a target object based on the coded semantic speckles comprises the following steps: constructing a speckle region on the surface of the target object by using the coded semantic speckles; calibrating a camera based on the speckle region, and performing full-field measurement on the target object by using a multi-camera digital image correlation method (DIC) to obtain a displacement field and a strain field of the target object, wherein the physical parameters comprise the displacement field and the strain field.

8. A measuring device based on coded semantic speckles, characterized in that, The method comprises the following steps: a configuration module is configured to configure speckle semantics, and construct a speckle pattern based on the speckle semantics and preset characteristic parameters, wherein the speckle semantics are used to indicate the arrangement shape and arrangement position of speckles; a generation module is configured to generate coded semantic speckles by fusing the speckle pattern and the speckle semantics; a measurement module is configured to measure physical parameters of a target object based on the coded semantic speckles. The generating module comprises: a searching unit, configured to search a matched encoding type based on the semantic quantity of the speckle semantics, wherein the encoding type comprises one of the following: 2 n encoding, Golay code encoding, directed ring encoding and undirected ring encoding; a generating unit, configured to generate encoded semantic speckles based on the speckle pattern, the speckle semantics and the encoding type, and convert the encoded semantic speckles into digital encoded semantic speckles.

9. The apparatus of claim 8, wherein, The configuration module comprises: a determination unit is configured to determine the shape regularity of the target object; a configuration unit is configured to configure first speckle semantics if the shape regularity of the target object is greater than a preset threshold, and to configure second speckle semantics if the shape regularity of the target object is less than or equal to the preset threshold, wherein the first speckle semantics are used to represent definition points, and the second speckle semantics are used to represent geometric constraints and / or direction points.

10. A storage medium, characterized by The storage medium stores a computer program, and the computer program is configured to execute the method in any one of claims 1 to 7 when running. 11.An electronic device comprising a memory and a processor, the electronic device characterized by, The memory stores a computer program, and the processor is configured to execute the computer program to execute the method in any one of claims 1 to 7.

Images