A high-precision machine vision positioning system

Abstract

The present invention discloses a high-precision machine vision positioning system, which relates to the field of machine vision technology. The system includes the following components: an adaptive multispectral imaging module, an image data processing module, a positioning calculation module, and a storage and control module; the adaptive multispectral imaging module integrates visible light, infrared, and ultraviolet imaging subunits, an adaptive optical adjustment subunit, and a spectral band adaptive switching subunit. The present invention integrates multispectral imaging capabilities such as visible light, infrared, and ultraviolet, and adjusts optical parameters in real time according to multiple factors such as ambient light conditions, target distance, and target reflection characteristics, thereby realizing adaptive switching and collaborative imaging of spectral bands, enabling the system to obtain comprehensive information about an object in multiple spectral bands, effectively overcoming the problems of incomplete information acquisition and image distortion in complex environments caused by traditional single visible light band imaging.

Description

Technical Field

[0001] The present invention relates to the technical field of machine vision, and in particular to a high-precision machine vision positioning system. Background Art

[0002] In many fields such as modern industrial production, logistics, and security, the demand for precise positioning of objects is growing. As a key technology to achieve this goal, the machine vision positioning system can realize automatic identification and positioning of objects through image acquisition and analysis. With the continuous advancement of technology, the machine vision positioning system has been widely used in various complex environments, providing strong support for industrial automation, intelligent manufacturing and other fields.

[0003] Traditional machine vision positioning systems mostly rely on visible light band imaging to analyze and locate objects. However, this single-band imaging method has many limitations. First, traditional machine vision positioning systems can only obtain limited visual information on the surface of an object, such as its appearance, shape, color, texture, etc., but cannot obtain deeper information. As a result, when faced with complex environments and special positioning needs, such as positioning detection for thermal management of electronic components, it is impossible to accurately determine the specific location of the component with abnormal heating. Secondly, factors such as ambient light conditions, target distance, and target reflection characteristics will have a significant impact on visible light imaging, causing image distortion and further affecting positioning accuracy. At the same time, changes in target distance and differences in target surface reflection characteristics will also affect imaging quality, causing deviations in positioning results. In addition, although traditional multispectral imaging technology can make up for the shortcomings of visible light imaging to a certain extent, it usually images different spectral bands in a fixed order or preset mode. This imaging method makes the imaging of each band relatively independent, making it difficult to comprehensively and accurately obtain relevant information about the object.

[0004] In response to the above problems, it is necessary to optimize the existing machine vision positioning system. By integrating multispectral imaging capabilities, the optical parameters can be adjusted in real time according to environmental and target factors, and adaptive switching and collaborative imaging of spectral bands can be achieved, thereby achieving accurate positioning of objects. Therefore, it is of great significance to develop a high-precision machine vision positioning system that can comprehensively realize the above characteristics. Summary of the Invention

[0005] The purpose of the present invention is to make up for the shortcomings of the existing technology and provide a high-precision machine vision positioning system. It can integrate multi-spectral imaging capabilities such as visible light, infrared, and ultraviolet, adjust optical parameters in real time according to environmental and target factors, realize adaptive switching and collaborative imaging of spectral bands, and obtain comprehensive information of objects in different spectral bands, combine image processing and positioning algorithms, and realize precise positioning of objects, effectively overcoming the shortcomings of traditional machine vision positioning systems in complex environments and special positioning requirements.

[0006] In order to solve the above technical problems, the present invention provides the following technical solutions: a high-precision machine vision positioning system, which includes the following components: an adaptive multispectral imaging module, an image data processing module, a positioning calculation module, and a storage and control module;

[0007] The adaptive multispectral imaging module integrates visible light, infrared, ultraviolet imaging subunits, adaptive optical adjustment subunits and spectral band adaptive switching subunits. The visible light imaging subunit is responsible for collecting image information of the object to be located in the visible light band, and can clearly present the conventional visual features of the object's appearance, shape, color and texture, and provide basic visual information of the object's surface for subsequent positioning analysis. The infrared imaging subunit is used to collect infrared images of the object to be located to obtain the object's heat distribution information. By sensing the infrared radiation emitted by the object itself, it accurately detects the temperature difference in different areas of the object's surface, and then presents the heat distribution inside or on the object. The ultraviolet imaging subunit is responsible for collecting images of the object to be located in the ultraviolet band, and can capture information related to the surface material characteristics of the object under ultraviolet light. The spectral band adaptive switching subunit integrates multiple types of sensors for real-time monitoring of the phase of the object to be located. The adaptive optics adjustment subunit uses a high-precision light sensor to monitor the intensity and spectral distribution parameters of ambient light in real time, and uses laser ranging and triangulation to accurately measure the distance between the object to be located and the imaging system. By emitting light of a specific frequency and detecting the characteristics of the light reflected by the object, the reflectivity of the object to be located and the reflective characteristic parameters of the reflection spectrum are analyzed. According to the calculated optical system parameter adjustment value, the optical system lens curvature and focal length parameters are adjusted in real time by driving the motor and piezoelectric element.

[0008] The image data processing module receives and processes the multispectral image data from the adaptive multispectral imaging module, uses an adaptive filtering algorithm to perform denoising, and uses relevant technologies to perform enhancement operations based on the characteristics of images in different spectral bands. At the same time, it uses a fusion algorithm based on deep learning to fuse the pre-processed image data of different spectral bands, and analyzes the fused data to extract feature information related to positioning, and transmits it to the positioning calculation module;

[0009] The positioning calculation module performs positioning calculations based on the feature information extracted by the image data processing module to determine the precise position of the object to be located. By extracting features from sample images collected in advance and constructing a pre-stored standard feature template, after receiving the feature information of the object to be located, a positioning algorithm based on feature matching is used to calculate the similarity with the standard feature template, find the most similar template, and combine the established unified coordinate system with a coordinate transformation calculation method that introduces correction parameters considering the perspective and posture changes to obtain the precise position of the object to be located in the coordinate system;

[0010] The storage and control module includes a storage submodule and a control submodule. The storage submodule uses a large-capacity, high-speed storage device to store the original image data collected by the adaptive multispectral imaging module, the intermediate data of the image data processing module, and the positioning results of the positioning calculation module according to format classification, and establishes an index to facilitate data management and query. The control submodule can control the imaging parameters of the adaptive multispectral imaging module and schedule the workflow of each module to ensure smooth data flow.

[0011] Furthermore, the spectral band adaptive switching subunit in the adaptive multispectral imaging module uses a preset algorithm and rule system to perform comprehensive analysis and judgment, and its algorithm formula is: ,in, Indicates the spectral bands, It is The spectral band is Under various combinations of environment and object characteristics, the surface temperature of the object to be located is measured by the temperature sensor. The maximum value of the pre-set temperature-related influence value, It is The spectral band is The influence of the ambient light intensity detected by the light sensor on the imaging of this band under the combination of environment and object characteristics, is the maximum value of the preset light intensity impact value, It is the ambient humidity value monitored by the ambient humidity sensor. It is the maximum value of the preset ambient humidity value. It is The spectral band is Under the combination of environment and object characteristics, the reflection characteristic detection unit detects the influence of the reflection characteristics of the object to be located on the imaging of this band. is the maximum value of the pre-set reflection characteristic influence value, It is The spectral band is Under the combination of environment and object characteristics, the material type of the object to be located detected by the material sensor has an impact on the imaging of this band. It is the maximum value of the pre-set material type influence value.

[0012] Furthermore, the adaptive optical adjustment subunit in the adaptive multispectral imaging module realizes real-time adjustment of the lens curvature and focal length parameters of the optical system by driving the motor and the piezoelectric element. The adjustment formula of the mirror curvature is: ,in, is the light intensity value, is the distance between the object to be located and the imaging system, is the average reflectivity of the object to be located, is a distance constant related to the propagation characteristics of light, is a periodic constant related to the distance.

[0013] Furthermore, the adaptive optical adjustment subunit in the adaptive multispectral imaging module realizes real-time adjustment of the lens curvature and focal length parameters of the optical system by driving the motor and the piezoelectric element. The focal length adjustment formula is: ,in, represents the focal length of the optical system, 、 The meanings of are the same as those in the lens curvature adjustment formula, representing the ambient light intensity, the distance between the object to be located and the imaging system, and the average reflectivity of the object to be located. is a reference intensity value related to the light intensity characteristics, is another distance constant related to distance.

[0014] Furthermore, the image data processing module uses an adaptive filtering algorithm for denoising, and its calculation formula is: ,in, Indicates the coordinates of the image after denoising The pixel value at The input image is at coordinates The original pixel value at and The half width of the filter window in the horizontal and vertical directions is defined respectively, which determines the range of neighborhood pixels involved in the filter calculation. The coordinates in the filter window are The adaptive weight coefficient corresponding to the pixel is calculated as follows: ,in, Indicates that the image is at coordinates The local variance of the pixel value at is used to measure the discrete degree of the pixel value in the local area where the pixel is located. is the image at coordinates The local mean of the pixel value at is used to reflect the average level of pixel values ​​in the local area where the pixel is located. and are pre-set reference values ​​for variance and mean.

[0015] Furthermore, the image data processing module uses a fusion algorithm based on deep learning to fuse the pre-processed image data of different spectral bands. The formula of the fusion algorithm is: ,in, Indicated in coordinates The pixel value of the fused image at the coordinate is obtained by weighted fusion of the pixel values ​​of images of different spectral bands at the coordinate, and is used to construct a complete fused image. Represents the number of spectral bands It is The weight coefficient corresponding to each spectral band is determined according to the importance of different spectral band images in positioning analysis and the characteristics of the current environment and the object to be positioned. It is spectral band images at coordinates The pixel value at , that is, the pixel value at this coordinate after the original image of different spectral bands collected from the adaptive multispectral imaging module is preprocessed, is used as the basic data for fusion calculation.

[0016] Furthermore, the image data processing module uses a fusion algorithm based on deep learning to fuse the pre-processed image data of different spectral bands. In the fusion formula, the weight coefficient is determined. When , the dynamic adjustment algorithm formula is: ,in, It is with The adjustment parameters related to each spectral band are used to adjust the weight coefficient according to the characteristics of different spectral bands and their importance in different scenarios. Indicates the The impact value of environmental factors related to imaging in each spectral band, is a reference value related to light intensity. It is with The temperature influence value of the object to be located related to the imaging of the spectral band, is a temperature-dependent reference value. It is with The reflection characteristic influence value of the object to be located related to the imaging of each spectral band, It is a reference value related to reflection characteristics.

[0017] Furthermore, the positioning calculation module uses a positioning algorithm based on feature matching to calculate the similarity with the standard feature template and find the most similar template. The algorithm formula is: ,in, Indicates the first Group features and pre-stored The similarity score between standard feature templates, is the first The first in the group characteristics eigenvalues, It is the pre-stored The first eigenvalues, Indicates the number of features used for matching, It is a preset feature difference tolerance value, which is used to limit the calculation range of feature differences to avoid excessive influence of similarity score due to excessive difference of individual feature values. Exceed When, take As the calculated value, based on the similarity score calculated above, the formula Determine the standard feature template that best matches the features of the object to be located, where: Represents the index value of the standard feature template that best matches the feature of the object to be located, by finding the similarity score The largest value to determine the best matching template, Is to make the following expression When the maximum value is obtained The operator that takes the value of .

[0018] Furthermore, the positioning calculation module combines the established unified coordinate system with a coordinate transformation calculation method that introduces correction parameters considering the perspective and posture change factors to obtain the precise position of the object to be positioned in the coordinate system. The transformation calculation formula is: ,in, and Respectively represent the precise location of the object to be positioned in the unified coordinate system Coordinates and coordinate, and It is the known standard feature template that best matches the object to be located in the unified coordinate system. Coordinates and coordinate, and Respectively represent the feature offset of the object to be located relative to the most matching standard feature template in the horizontal and vertical directions, Indicates the rotation angle of the object to be located relative to the most matching standard feature template.

[0019] Compared with the existing technology, this high-precision machine vision positioning system has the following beneficial effects:

[0020] 1. The present invention integrates multispectral imaging capabilities such as visible light, infrared, and ultraviolet light, and adjusts optical parameters in real time based on multiple factors such as ambient light conditions, target distance, and target reflection characteristics. This achieves adaptive switching of spectral bands and collaborative imaging, enabling the system to obtain comprehensive information about objects in multiple spectral bands. This effectively overcomes the problems of incomplete information acquisition and image distortion in complex environments caused by traditional single-visible light band imaging.

[0021] 2. The present invention uses adaptive filtering algorithms for denoising and image enhancement technology, and can output high-quality, high signal-to-noise ratio image data, providing a solid foundation for subsequent positioning calculations. At the same time, the fusion algorithm based on deep learning can automatically learn the intrinsic connections and feature representations between image data in different spectral bands, achieve precise fusion of image data, and further extract feature information related to positioning. In the positioning calculation module, the system uses a positioning algorithm based on feature matching combined with calculation methods such as coordinate transformation, which can accurately determine the precise position of the object to be located, ensuring a high level of positioning accuracy.

[0022] Other advantages, objects and features of the present invention will be described in part in the following description and, in part, will be apparent to those skilled in the art based on an examination of the following or may be learned from the practice of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] To more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. Those skilled in the art can also derive other drawings based on these drawings without inventive effort.

[0024] Figure 1 This is a structural diagram of a high-precision machine vision positioning system;

[0025] Figure 2 This is a flow chart of a high-precision machine vision positioning system. DETAILED DESCRIPTION

[0026] The following is a clear and complete description of the technical solutions in the embodiments of the present invention. Obviously, the embodiments described are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0027] Example

[0028] This embodiment describes in detail the use of a high-precision machine vision positioning system for positioning components on an electronic component production line. Various tiny electronic components can be accurately positioned through the present invention.

[0029] As the front-end image acquisition part of the entire positioning system, the adaptive multispectral imaging module is responsible for collecting comprehensive and clear multispectral image data according to the complex environment of the electronic component production line and the characteristics of the electronic components themselves. It includes visible light, infrared, and ultraviolet imaging subunits and adaptive optical adjustment subunits, and spectral band adaptive switching subunits. The visible light imaging subunit is equipped with a high-resolution visible light camera and an adaptive optical lens system. Based on the principle of reflection of visible light by electronic components, it collects images of components in the visible light band and presents conventional visual features such as the appearance, shape, color, and texture of the components. In the production line environment, these feature information helps to preliminarily identify the basic form and surface condition of electronic components, and provide basic visual data for subsequent more accurate positioning analysis. In addition, during collaborative imaging and other operations, the imaging parameters such as exposure time and gain can be dynamically adjusted according to instructions from the control submodule to ensure To ensure effective coordination with imaging in other bands and obtain better quality images, the infrared imaging subunit is equipped with a highly sensitive infrared detector and infrared optical lens. It collects infrared images of electronic components based on the principle of thermal radiation, thereby obtaining the heat distribution information of the components. In the production process of electronic components, some components have temperature differences due to their working conditions or their own characteristics. Infrared imaging is very critical for detecting these abnormally heated areas or identifying components with different thermal characteristics, and can provide an important basis for precise positioning. The ultraviolet imaging subunit uses specially designed ultraviolet optical lenses and image sensors sensitive to ultraviolet light to collect images of electronic components in the ultraviolet band and capture information related to the material properties of the component surface. Different electronic component materials may exhibit unique reflection or absorption characteristics in the ultraviolet band. These material-related feature information can be obtained through ultraviolet imaging, further enriching the image data content required for positioning.

[0030] The adaptive optical adjustment subunit uses high-precision sensors to monitor the ambient light intensity, spectral distribution and other parameters of the electronic component production workshop in real time, and quickly transmits this information to the optical parameter adjustment unit. At the same time, it uses appropriate technologies such as laser ranging and triangulation to accurately measure the distance between the electronic component to be located and the imaging system, and transmits the measurement results to the optical parameter adjustment unit in the form of digital signals. In addition, by emitting light of a specific frequency and detecting the characteristics of the light reflected back by the electronic component, the average reflectivity, reflection spectrum and other reflection characteristic parameters of the electronic component to be located are analyzed and obtained, and these detection data are transmitted to the optical parameter adjustment unit in a timely manner. The surface materials and process treatments of different electronic components may cause their reflection characteristics to vary. Understanding these reflection characteristics helps to adjust the optical system in a targeted manner to optimize the imaging quality. Based on the light information received from the light sensor, the distance data of the distance measurement unit and the reflection characteristic parameters of the reflection characteristic detection unit, the preset optical parameter adjustment algorithm is used for calculation to adjust the lens curvature, focal length and other parameters of the optical system of each imaging subunit in real time. The lens curvature The adjustment formula is: ,in, It is the light intensity value. The difference in light intensity in different areas of the workshop will affect the adjustment of the lens curvature. is the distance between the electronic component to be located and the imaging system. The farther the distance, the more serious the light divergence. The average reflectivity of the electronic components to be located. Electronic components made of different materials and with different surface treatments have different reflectivities. Components with high reflectivity may require special lens curvature settings to optimize the imaging effect. is a distance constant related to the light propagation characteristics, which is predetermined based on the characteristics of the optical system and the typical light propagation conditions in the electronic component production workshop. is a periodic constant related to distance, which is also pre-set based on the characteristics of the optical system and the production workshop environment. The adjustment formula is: ,in, Indicates the focal length of the optical system. Accurately setting the focal length is crucial for clearly presenting the electronic components to be positioned on the imaging plane. 、 The meanings of are the same as those in the lens curvature adjustment formula, representing the ambient light intensity, the distance between the electronic component to be positioned and the imaging system, and the average reflectivity of the electronic component to be positioned. It is a reference intensity value related to the light intensity characteristics, which is predetermined according to the sensitivity of the optical system to light intensity and the common light intensity range in electronic component production workshops. is another distance constant related to distance.

[0031] The spectral band adaptive switching subunit integrates multiple sensors to comprehensively monitor the environment of the electronic component production line and the characteristics of the electronic components themselves. Among them, the material sensor is used to detect the material type of the electronic components, the temperature sensor is used to measure the surface temperature of the electronic components, and the surface roughness sensor is used to obtain the roughness information of the surface of the electronic components, etc., to monitor the characteristics of the electronic components. At the same time, a light sensor is set to sense the ambient light intensity in the workshop, and a humidity sensor is used to monitor the ambient humidity in the workshop. In combination with the image analysis algorithm, the image data of the visible light imaging subunit is used to analyze the background interference in real time, etc., to monitor environmental factors, and use pre-set complex algorithms and rule systems to conduct comprehensive analysis and judgment on the monitoring data. The specific judgment is made through the following formula: ,in, Indicates the Spectral bands ( Represents the visible light band, Represents the infrared band, represents the ultraviolet band) in the The imaging suitability score under various combinations of environment and object characteristics is calculated. The higher the score, the more suitable the spectral band is for imaging under the current situation. The most suitable spectral band combination and collaborative imaging strategy are determined by comparing the scores of different bands. It is The spectral band is The impact value of the surface temperature of the electronic component measured by the temperature sensor under a combination of various environments and object characteristics, The maximum value of the pre-set temperature-related influence value, It is The spectral band is The influence of the ambient light intensity detected by the light sensor on the imaging of this band under the combination of environment and object characteristics, The maximum value of the pre-set light intensity impact value, It is the ambient humidity value monitored by the ambient humidity sensor. The maximum value of the preset ambient humidity value, It is The spectral band is Under various combinations of environment and object characteristics, The maximum value of the pre-set reflection characteristic influence value, It is The spectral band is The influence of the material type of the electronic component detected by the material sensor on the imaging of this band under the combination of environment and object characteristics, The maximum value of the pre-set material type influence value is used, and according to the decision result, precise control instructions are issued to the visible light imaging subunit, infrared imaging subunit and ultraviolet imaging subunit. Specifically, these instructions include starting or stopping the imaging operation of a certain imaging subunit, dynamically adjusting the imaging parameters of each imaging subunit (such as exposure time, gain, detector sensitivity, ultraviolet light excitation intensity, etc.), and controlling the timing and method of collaborative imaging of each imaging subunit at the same time, so as to realize adaptive switching of spectral bands and collaborative imaging of different bands at the same time, thereby obtaining comprehensive and targeted multispectral image data of electronic components.

[0032] The image data processing module uses an adaptive filtering algorithm for denoising. Its core algorithm formula is: ,in, Indicates the coordinates of the image after denoising The pixel value at The input image (i.e. the original image of each spectral band collected by the adaptive multispectral imaging module) is in the coordinate The original pixel value at and The half width of the filter window in the horizontal and vertical directions is defined respectively, which determines the range of neighborhood pixels involved in the filter calculation. The coordinates in the filter window are The adaptive weight coefficient corresponding to the pixel is calculated as follows: ,in, Indicates that the image is at coordinates The local variance of the pixel value at is used to measure the discrete degree of the pixel value in the local area where the pixel is located. is the image at coordinates The local mean of the pixel values ​​at , and are the pre-set variance and mean reference values ​​used for normalization, so that The value range of is within the appropriate interval, so as to better adjust the weight coefficient according to the characteristics of different areas of the image, achieve adaptive denoising effect, and use the backbone multi-spectral feature weighted fusion algorithm to fuse image data of different spectral bands. The formula is ,in, Indicated in coordinates The pixel value of the fused image at the coordinate is obtained by weighted fusion of the pixel values ​​of images of different spectral bands at the coordinate, and is used to construct a complete fused image. Represents the number of spectral bands. In the present invention, considering the three spectral bands of visible light, infrared and ultraviolet, , It is The weight coefficient corresponding to each spectral band is determined according to the importance of different spectral band images in positioning analysis and the characteristics of the current environment and the electronic components to be located. It is spectral band images at coordinates The pixel value at that coordinate, that is, the pixel value at that coordinate after preprocessing of the original image of different spectral bands collected from the adaptive multispectral imaging module, is used as the basic data for fusion calculation. When , we can further use the formula To dynamically adjust according to environmental factors and object characteristics, :It is with The adjustment parameters related to each spectral band are used to adjust the weight coefficient according to the characteristics of different spectral bands and their importance in different scenarios. Indicates the The impact value of environmental factors related to imaging in each spectral band, is a reference value related to light intensity, It is with The temperature impact value of the electronic components to be located related to the imaging of the spectral band, is a temperature-dependent reference value. It is with The reflection characteristics of the electronic components to be located related to the imaging of each spectral band are affected by the reflection characteristics of different electronic components. The reflection characteristics of different electronic components vary in different spectral bands. This value reflects the impact of the reflection characteristics on the imaging quality of the band, and thus affects its weight in the fusion. It is a reference value related to the reflection characteristics. Based on the fused image data, further analysis is performed to extract feature information related to positioning, such as the shape characteristics of electronic components (such as the curvature of the contour, the ratio of the side length, etc.), texture characteristics (such as the direction and frequency of the texture), and heat distribution characteristics (if it involves heat information obtained by infrared band imaging), etc. These feature information will be transmitted to the positioning calculation module to provide key data support for subsequent positioning calculations.

[0033] The positioning calculation module collects a large number of sample images for different types of electronic components, and extracts feature information from these sample images through the image data processing module, such as the shape features of the electronic components (such as the curvature of the contour, the ratio of the side length, etc.), texture features (such as the direction and frequency of the texture, etc.), and heat distribution features (if it involves heat information obtained by infrared band imaging), etc., and organizes and normalizes these feature information to construct pre-stored standard feature templates, which are stored in the database inside the module. These standard feature templates will serve as a reference for subsequent matching with the features of the electronic components to be located. After receiving the feature information of the electronic components to be located transmitted from the image data processing module, it will be matched with the pre-stored standard feature templates, and the following positioning algorithm formula based on feature matching is used to calculate the similarity between the features of the electronic components to be located and the standard feature templates: ,in, Indicates the first Group features and pre-stored The similarity score between the standard feature templates is calculated. The higher the score, the more similar the electronic component to be located is to the standard feature template. By comparing the similarity scores between the electronic component to be located and each standard feature template, the best matching template can be found, and then the position of the electronic component can be determined. The first electronic component to be positioned The first in the group characteristics These eigenvalues ​​are extracted by processing the collected multispectral image data through the image data processing module, and the specific values ​​depend on the imaging band and the characteristics of the electronic components. Pre-stored The first of the standard feature templates These standard feature templates are constructed by collecting a large number of sample images for different types of electronic components in the early stage, extracting features through the image data processing module, and then sorting and normalizing them. They are stored in the database inside the module and are used to match the features of the electronic components to be located. Indicates the number of features used for matching, that is, the number of feature values ​​contained in each set of features. It is a preset feature difference tolerance value, which is used to limit the calculation range of feature differences to avoid excessive influence of similarity scores due to excessive differences in individual feature values. Exceed When, take As the calculated value, based on the similarity score calculated above, the formula Determine the standard feature template that best matches the features of the object to be located, where: Represents the index value of the standard feature template that best matches the feature of the electronic component to be located, and the similarity score is found by The largest value to determine the best matching template, Is a search to make the following expression (here is ) when the maximum value is achieved The operator of the value of , that is, in all possible standard feature templates (index is In the image processing, find the index of the template with the highest similarity to the characteristics of the electronic component to be located. During the imaging process, establish a unified coordinate system. The coordinate system covers the imaging area and the possible position range of the electronic component to be located. The origin, coordinate axis direction and other parameters of the coordinate system are set when the system is initialized and kept consistent. During the imaging process, establish a unified coordinate system. The coordinate system covers the imaging area and the possible position range of the electronic component to be located. The origin, coordinate axis direction and other parameters of the coordinate system are set when the system is initialized and kept consistent. According to the matching results and the coordinate system, the following coordinate transformation calculation formula is used to determine the precise position of the electronic component to be located in the unified coordinate system: ,in, and Respectively represent the precise location of the electronic components to be positioned in the unified coordinate system Coordinates and Coordinates, which are the final coordinates of the electronic components to be located. and It is the known standard feature template that best matches the electronic component to be positioned in the unified coordinate system. Coordinates and Coordinates, these coordinates are determined and stored when constructing the standard feature template. Because the standard feature template has its fixed position information in the coordinate system, the position of the electronic component to be located is calculated by matching the position information of this template with the electronic component to be located. and They represent the feature offsets of the electronic component to be located in the horizontal and vertical directions relative to the most matching standard feature template (the units are consistent with the units of the coordinate system, such as meters, pixels, etc.). These offsets are determined by analyzing the feature differences between the electronic component to be located and the matching template. For example, the shape features of the electronic component may have certain changes such as scaling, translation or rotation. The offsets in the horizontal and vertical directions are obtained by quantitatively analyzing these feature changes. It represents the rotation angle (in radians) of the electronic component to be located relative to the most matching standard feature template. It is also determined by analyzing the feature differences between the electronic component to be located and the matching template, especially when it involves changes in the posture of the electronic component. The rotation of the electronic component relative to the template is determined so that the rotation factor can be accurately considered in the coordinate transformation calculation, thereby more accurately calculating the position of the electronic component to be located.

[0034] The storage and control module consists of a storage submodule and a control submodule, which is responsible for the data storage, operation control and coordination of the entire system. The storage submodule uses large-capacity, high-speed storage devices, such as solid-state drives (SSDs) or large-capacity hard disks (HDDs). The stored data types include the original image data collected by the adaptive multispectral imaging module, the intermediate data processed by the image data processing module, and the positioning results calculated by the positioning calculation module. For different types of data, appropriate file formats are used for storage. For example, the original image data can use common image file formats (such as JPEG, PNG, etc.), and the intermediate data can use custom data formats for subsequent analysis and processing. The positioning results can use text file formats to record information such as the position coordinates of electronic components. In order to facilitate data query, call and management, a complete data management system is established, each stored data is numbered, and an index table is established. The required data can be quickly located through the index table. At the same time, the data is classified and stored according to attributes such as data type, acquisition time, and processing stage to improve the efficiency of data retrieval. The control submodule can control the imaging parameters of the adaptive multispectral imaging module. Such as exposure time, gain, aperture size, etc., according to different imaging requirements and environmental conditions, by sending corresponding control instructions to the adaptive multispectral imaging module, these parameters are adjusted to ensure the acquisition of high-quality image data. At the same time, it is responsible for scheduling the workflow of each module of the system. When the system starts, each module is started in a predetermined order and the data flow between the modules is ensured to be smooth. For example, the adaptive multispectral imaging module is triggered to perform imaging first, and then the positioning calculation module is started to perform positioning calculation after the image data processing module has processed the image data. During the operation of the system, the working order and working mode of each module can be flexibly adjusted according to the real-time situation (such as abnormal conditions or the need to re-acquire images). In addition, the operating status of the system is monitored in real time, including the working status of each module (such as whether it is working normally or whether there is a fault), the usage of system resources (such as CPU usage, memory usage, etc.), and the status of data transmission (such as whether the data is successfully transmitted and the transmission speed, etc.). By monitoring these status information, problems can be discovered in time and corresponding measures can be taken to deal with them, such as restarting the faulty module and adjusting the allocation of system resources, to ensure the continuous and stable operation of the system.

[0035] In summary, through the close collaboration of the above four modules, the high-precision machine vision positioning system of the present invention can accurately locate various tiny electronic components on the electronic component production line, provide accurate position information for subsequent assembly, inspection and other processes, and effectively improve production efficiency and product quality.

[0036] It will be apparent to those skilled in the art that the present invention is not limited to the details of the exemplary embodiments described above and that the invention can be embodied in other specific forms without departing from the spirit or essential characteristics of the invention. Therefore, the embodiments should be considered in all respects as illustrative and non-restrictive, and the scope of the invention is defined by the appended claims, not the foregoing description, and all variations within the meaning and range of equivalents of the claims are intended to be included therein. Any reference sign in a claim should not be construed as limiting the claim to which it relates.

Claims

1. A high-precision machine vision positioning system, characterized in that: The system includes the following components: adaptive multispectral imaging module, image data processing module, positioning calculation module and storage and control module; The adaptive multispectral imaging module integrates visible light, infrared, ultraviolet imaging subunits, adaptive optical adjustment subunits and spectral band adaptive switching subunits. The visible light imaging subunit is responsible for collecting image information of the object to be located in the visible light band, and can clearly present the conventional visual features of the object's appearance, shape, color and texture, and provide basic visual information of the object's surface for subsequent positioning analysis. The infrared imaging subunit is used to collect infrared images of the object to be located to obtain the object's heat distribution information. By sensing the infrared radiation emitted by the object itself, it accurately detects the temperature difference in different areas of the object's surface, and then presents the heat distribution inside or on the object. The ultraviolet imaging subunit is responsible for collecting images of the object to be located in the ultraviolet band, and can capture information related to the surface material characteristics of the object under ultraviolet light. The spectral band adaptive switching subunit integrates multiple types of sensors for real-time monitoring of the phase of the object to be located. The adaptive optics adjustment subunit uses a high-precision light sensor to monitor the intensity and spectral distribution parameters of ambient light in real time, and uses laser ranging and triangulation to accurately measure the distance between the object to be located and the imaging system. By emitting light of a specific frequency and detecting the characteristics of the light reflected by the object, the reflectivity of the object to be located and the reflective characteristic parameters of the reflection spectrum are analyzed. According to the calculated optical system parameter adjustment value, the optical system lens curvature and focal length parameters are adjusted in real time by driving the motor and piezoelectric element. The image data processing module receives and processes the multispectral image data from the adaptive multispectral imaging module, uses an adaptive filtering algorithm to perform denoising, and uses relevant technologies to perform enhancement operations based on the characteristics of images in different spectral bands. At the same time, it uses a fusion algorithm based on deep learning to fuse the pre-processed image data of different spectral bands, and analyzes the fused data to extract feature information related to positioning, and transmits it to the positioning calculation module; The positioning calculation module performs positioning calculations based on the feature information extracted by the image data processing module to determine the precise position of the object to be located. By extracting features from sample images collected in advance and constructing a pre-stored standard feature template, after receiving the feature information of the object to be located, a positioning algorithm based on feature matching is used to calculate the similarity with the standard feature template, find the most similar template, and combine the established unified coordinate system with a coordinate transformation calculation method that introduces correction parameters considering the perspective and posture changes to obtain the precise position of the object to be located in the coordinate system; The storage and control module includes a storage submodule and a control submodule. The storage submodule uses a large-capacity, high-speed storage device to store the original image data collected by the adaptive multispectral imaging module, the intermediate data of the image data processing module, and the positioning results of the positioning calculation module according to format classification, and establishes an index to facilitate data management and query. The control submodule can control the imaging parameters of the adaptive multispectral imaging module and schedule the workflow of each module to ensure smooth data flow.

2. A high-precision machine vision positioning system according to claim 1, characterized in that: The spectral band adaptive switching subunit in the adaptive multispectral imaging module uses a preset algorithm and rule system to perform comprehensive analysis and judgment, and its algorithm formula is: ,in, Indicates the spectral bands, It is The spectral band is Under various combinations of environment and object characteristics, the surface temperature of the object to be located is measured by the temperature sensor. The maximum value of the pre-set temperature-related influence value, It is The spectral band is The influence of the ambient light intensity detected by the light sensor on the imaging of this band under the combination of environment and object characteristics, is the maximum value of the preset light intensity impact value, It is the ambient humidity value monitored by the ambient humidity sensor. It is the maximum value of the preset ambient humidity value. It is The spectral band is Under the combination of environment and object characteristics, the reflection characteristic detection unit detects the influence of the reflection characteristics of the object to be located on the imaging of this band. is the maximum value of the pre-set reflection characteristic influence value, It is The spectral band is Under the combination of environment and object characteristics, the material type of the object to be located detected by the material sensor has an impact on the imaging of this band. It is the maximum value of the pre-set material type influence value.

3. A high-precision machine vision positioning system according to claim 1, characterized in that: The adaptive optical adjustment subunit in the adaptive multispectral imaging module realizes real-time adjustment of the lens curvature and focal length parameters of the optical system by driving the motor and the piezoelectric element. The adjustment formula of the mirror curvature is: ,in, is the light intensity value, is the distance between the object to be located and the imaging system, is the average reflectivity of the object to be located, is a distance constant related to the propagation characteristics of light, is a periodic constant related to the distance.

4. A high-precision machine vision positioning system according to claim 3, characterized in that: The adaptive optical adjustment subunit in the adaptive multispectral imaging module realizes real-time adjustment of the lens curvature and focal length parameters of the optical system by driving the motor and the piezoelectric element. The focal length adjustment formula is: ,in, represents the focal length of the optical system, 、 The meanings of are the same as those in the lens curvature adjustment formula, representing the ambient light intensity, the distance between the object to be located and the imaging system, and the average reflectivity of the object to be located. is a reference intensity value related to the light intensity characteristics, is another distance constant related to distance.

5. The high-precision machine vision positioning system according to claim 1, characterized in that: The image data processing module uses an adaptive filtering algorithm for denoising, and its calculation formula is: ,in, Indicates the coordinates of the image after denoising The pixel value at The input image is at coordinates The original pixel value at and The half width of the filter window in the horizontal and vertical directions is defined respectively, which determines the range of neighborhood pixels involved in the filter calculation. The coordinates in the filter window are The adaptive weight coefficient corresponding to the pixel is calculated as follows: ,in, Indicates that the image is at coordinates The local variance of the pixel value at is used to measure the discrete degree of the pixel value in the local area where the pixel is located. is the image at coordinates The local mean of the pixel value at is used to reflect the average level of pixel values ​​in the local area where the pixel is located. and are pre-set reference values ​​for variance and mean.

6. A high-precision machine vision positioning system according to claim 1, characterized in that: The image data processing module uses a fusion algorithm based on deep learning to fuse the pre-processed image data of different spectral bands. The formula of the fusion algorithm is: ,in, Indicated in coordinates The pixel value of the fused image at the coordinate is obtained by weighted fusion of the pixel values ​​of images of different spectral bands at the coordinate, and is used to construct a complete fused image. Represents the number of spectral bands It is The weight coefficient corresponding to each spectral band is determined according to the importance of different spectral band images in positioning analysis and the characteristics of the current environment and the object to be positioned. It is spectral band images at coordinates The pixel value at , that is, the pixel value at this coordinate after the original image of different spectral bands collected from the adaptive multispectral imaging module is preprocessed, is used as the basic data for fusion calculation.

7. A high-precision machine vision positioning system according to claim 6, characterized in that: The image data processing module uses a fusion algorithm based on deep learning to fuse the pre-processed image data of different spectral bands. In its fusion formula, the weight coefficient When , the dynamic adjustment algorithm formula is: ,in, It is with The adjustment parameters related to each spectral band are used to adjust the weight coefficient according to the characteristics of different spectral bands and their importance in different scenarios. Indicates the The impact value of environmental factors related to imaging in each spectral band, is a reference value related to light intensity. It is with The temperature influence value of the object to be located related to the imaging of the spectral band, is a temperature-dependent reference value. It is with The reflection characteristic influence value of the object to be located related to the imaging of each spectral band, It is a reference value related to reflection characteristics.

8. The high-precision machine vision positioning system according to claim 1, characterized in that: The positioning calculation module uses a positioning algorithm based on feature matching to calculate the similarity with the standard feature template and find the most similar template. The algorithm formula is: ,in, Indicates the first Group features and pre-stored The similarity score between standard feature templates, is the first The first in the group characteristics eigenvalues, It is the pre-stored The first eigenvalues, Indicates the number of features used for matching, It is a preset feature difference tolerance value, which is used to limit the calculation range of feature differences to avoid excessive influence of similarity score due to excessive difference of individual feature values. Exceed When, take As the calculated value, based on the similarity score calculated above, the formula Determine the standard feature template that best matches the features of the object to be located, where: Represents the index value of the standard feature template that best matches the feature of the object to be located, by finding the similarity score The largest value to determine the best matching template, Is to make the following expression When the maximum value is obtained The operator that takes the value of .

9. The high-precision machine vision positioning system according to claim 1, characterized in that: The positioning calculation module combines the established unified coordinate system and the coordinate transformation calculation method that introduces correction parameters considering the perspective and posture changes to obtain the precise position of the object to be positioned in the coordinate system. The transformation calculation formula is: ,in, and Respectively represent the precise location of the object to be positioned in the unified coordinate system Coordinates and coordinate, and It is the known standard feature template that best matches the object to be located in the unified coordinate system. Coordinates and coordinate, and Respectively represent the feature offset of the object to be located relative to the most matching standard feature template in the horizontal and vertical directions, Indicates the rotation angle of the object to be located relative to the most matching standard feature template.

Images