Material matching method, device and equipment

Abstract

The invention relates to a material matching method, a material matching device and material matching equipment, and the method comprises the steps: obtaining image information of to-be-assembled materials including a first material and a second material which are used for combined assembly, recognizing the image features in each piece of image information, determining the feature values corresponding to the image features, determining the errors of each to-be-assembled material based on the feature values, and carrying out the matching of the to-be-assembled materials. And determining the first material and the second material which are subjected to error matching as a target assembly material pair, wherein error matching represents that the sum of the two errors is smaller than a preset matching threshold value. Therefore, on the basis of the image recognition technology, feature extraction and analysis are carried out on the image information of the materials, the two different materials with the small sum of errors are determined as the target assembly material pair, the influence of the material errors on the product formed by assembling the target assembly material pair can be reduced, the product precision can be improved, and the product quality is improved.

Description

Technical Field

[0001] The present application relates to the technical field of material processing, and in particular to a material matching method, a material matching device and a material matching equipment. Background Art

[0002] With the development and progress of the times, the standards for product precision and aesthetics are getting higher and higher, which requires higher precision of product materials and higher processing precision of the product materials during processing.

[0003] However, due to the limitation of mechanical precision, the original error and processing error of product materials cannot be avoided. If the product materials with errors are used directly, the product formed by processing the product materials will have poor precision and appearance, which will have a bad impact on product quality. Summary of the invention

[0004] Based on this, it is necessary to provide a material matching method, material matching device and material matching equipment that can help improve product quality in order to address the technical problem of poor product quality caused by traditional material usage methods.

[0005] In a first aspect, the present application provides a material matching method, the method comprising:

[0006] Acquire image information of materials to be assembled; the materials to be assembled include a first material and a second material for combined assembly;

[0007] Identify image features in each of the image information, and determine feature values ​​corresponding to the image features;

[0008] Determining the error of each of the materials to be assembled based on the characteristic value;

[0009] The first material and the second material with error matching are determined as a target assembly material pair; the error matching indicates that the sum of the two errors is less than a preset matching threshold.

[0010] In one embodiment, determining the first material and the second material with error matching as a target assembly material pair includes:

[0011] Mark errors that are greater than or equal to a preset error center value as positive errors;

[0012] Marking an error smaller than the preset error center value as a negative error;

[0013] The first material with a positive error and the second material with a negative error that have error matching are determined as a target assembly material pair; or, the first material with a negative error and the second material with a positive error that have error matching are determined as a target assembly material pair.

[0014] In one embodiment, determining the error-matched first material with a positive error and the second material with a negative error as a target assembly material pair includes:

[0015] Calculating the sum of the positive error of the first material and the negative error of each of the second materials in sequence;

[0016] The second material and the first material corresponding to the minimum error sum are determined as the target assembly material pair.

[0017] In one embodiment, determining the first material with a negative error and the second material with a positive error that are error matched as a target assembly material pair includes:

[0018] Calculating the sum of the negative error of the first material and the positive error of each of the second materials in sequence;

[0019] The second material and the first material corresponding to the minimum error sum are determined as the target assembly material pair.

[0020] In one embodiment, the method further comprises:

[0021] Gets the user-defined preset error center value.

[0022] In one embodiment, after acquiring the image information of the material to be assembled and before identifying the image features in each of the image information and determining the feature values ​​corresponding to the image features, the method further includes:

[0023] Pushing the image information;

[0024] The image features fed back by the user based on the pushed image information are obtained.

[0025] In one embodiment, the method further comprises:

[0026] Push identification information of the target assembly material pair.

[0027] In one embodiment, the step of obtaining image information of the material to be assembled includes:

[0028] When the first materials are placed in preset positions in sequence, image information of the first materials is acquired in sequence;

[0029] After the image information of each of the first materials is acquired, and when each of the second materials is sequentially placed in a preset position, the image information of each of the second materials is sequentially acquired.

[0030] In a second aspect, the present application further provides a material matching device, the device comprising:

[0031] An image information acquisition module is used to acquire image information of materials to be assembled; the materials to be assembled include a first material and a second material for combined assembly;

[0032] A feature recognition module, used to recognize image features in each of the image information and determine feature values ​​corresponding to the image features;

[0033] An error determination module, used for determining the error of each of the materials to be assembled based on the characteristic value;

[0034] The material matching module is used to determine the first material and the second material with error matching as a target assembly material pair; the error matching indicates that the sum of the two errors is less than a preset matching threshold.

[0035] In a third aspect, the present application provides a material matching device, the device comprising an image acquisition device and a processing device, the image acquisition device being communicatively connected to the processing device;

[0036] The image acquisition device is used to acquire image information of the materials to be assembled and send the image information to the processing device, and the processing device is used to perform material matching based on the above method.

[0037] In one of the embodiments, an interaction device is further included, and the interaction device is communicatively connected to the processing device.

[0038] In one of the embodiments, it further includes a storage platform, wherein the storage platform is used to accommodate materials to be assembled.

[0039] The above-mentioned material matching method, material matching device and material matching equipment, after acquiring image information of the materials to be assembled including the first material and the second material for combined assembly, identify the image features in each image information, determine the characteristic value corresponding to the image feature, determine the error of each material to be assembled based on the characteristic value, and determine the first material and the second material with error matching as the target assembly material pair, and the error matching represents that the sum of the two errors is less than a preset matching threshold. Therefore, based on image recognition technology, by extracting and analyzing the features of the image information of the material, different materials with a smaller sum of two errors are determined as the target assembly material pair, which can reduce the impact of the material error on the product assembled using the target assembly material pair, which is conducive to improving the product precision, thereby improving the product quality. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0041] Figure 1 A schematic diagram of a material matching method in one embodiment;

[0042] Figure 2 A schematic flow chart of a step of determining a first material and a second material with error matching as a target assembly material pair in one embodiment;

[0043] Figure 3 It is a flowchart of a step of determining a first material with a positive error and a second material with a negative error that have error matching as a target assembly material pair in one embodiment;

[0044] Figure 4 A schematic flow chart of a step of determining a first material with a negative error and a second material with a positive error that have error matching as a target assembly material pair in one embodiment;

[0045] Figure 5 A schematic diagram of a material matching method in another embodiment;

[0046] Figure 6 It is a flowchart of the steps of obtaining image information of materials to be assembled in one embodiment;

[0047] Figure 7 It is a schematic diagram of a structural block diagram of a material matching device in one embodiment;

[0048] Figure 8 It is a structural schematic diagram of a material matching device in one embodiment;

[0049] Fig. 9 Schematic diagram of the processing flow of a material matching device in one embodiment. DETAILED DESCRIPTION

[0050] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0051] The material matching method provided in the embodiment of the present application is used to match materials, specifically to determine two materials that match each other. The two matching materials are then processed, for example, the two materials are assembled together. Among them, the material can be understood as the basis for making a product, and the type of material is not limited. For example, if the product being made is a mobile phone, the material may include a screen and a casing, etc.

[0052] In addition, the execution subject of the material matching method is not unique. For example, the material matching method can be executed by a terminal or a server. The terminal can be, but is not limited to, various personal computers, laptops, smart phones, tablet computers, Internet of Things devices, and portable wearable devices. The server can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides cloud computing services.

[0053] In an exemplary embodiment, Figure 1 As shown, a material matching method is provided, and the method is applied to a terminal as an example, and is specifically applied to a processing device of the terminal for explanation, including the following steps 102 to 108. Among them:

[0054] Step 102: Obtain image information of the material to be assembled.

[0055] The materials to be assembled include a first material and a second material for combined assembly. The first material and the second material are generally different types of materials. During the processing, the first material and the second material can be combined and assembled to facilitate the subsequent formation of a molded product. Exemplarily, the first material can be a mobile phone screen, and the second material can be a mobile phone shell. The mobile phone screen and the mobile phone shell can be assembled together to form a mobile phone. Alternatively, the first material can be a mobile phone side shell, and the second material can be a mobile phone back shell. The mobile phone side shell and the mobile phone back shell can be assembled together to form a mobile phone. It can be understood that in other embodiments, the first material and the second material can also be other materials, which are not limited here.

[0056] It can be understood that the image information obtained in this step includes multiple image information of the first material and the second material. The number of the first material can be multiple, and the number of the second material can also be multiple.

[0057] The method of obtaining image information of the material to be assembled is not unique. For example, the image information of the material to be assembled can be obtained by an image acquisition device. The image acquisition device is connected to the processing device for communication. After the image acquisition device obtains the image information of the material to be assembled, it sends it to the processing device, so that the processing device obtains the image information of the material to be assembled.

[0058] The setting position of the image acquisition device is not unique, and can be determined in combination with the position of the material to be assembled, as long as the image of the material to be assembled can be acquired. For example, the material to be assembled can be set on a storage platform, and the storage platform is used to accommodate the material to be assembled. When image acquisition is required, the material to be assembled can be placed on the storage platform, and the storage platform is within the image acquisition range of the image acquisition device, and the image acquisition device can acquire images of the material to be assembled on the storage platform.

[0059] In addition, the number of image acquisition devices is not unique. For example, the number of image acquisition devices may be one, and one image acquisition device may perform image acquisition on one material to be assembled at a time to improve the accuracy of the acquired image information. Alternatively, one image acquisition device may perform image acquisition on multiple materials to be assembled at a time to improve the efficiency of image acquisition while reducing the hardware structure. Alternatively, the number of image acquisition devices may be multiple, and multiple image acquisition devices may simultaneously acquire image information of multiple different materials to be assembled to improve the efficiency of image information acquisition. Alternatively, multiple image acquisition devices may also perform image acquisition on the same material to be assembled, and determine the final image information based on the multiple acquired images, which is beneficial to reduce errors in the image acquisition process, thereby facilitating improving the accuracy of image information.

[0060] Step 104: Identify image features in each image information and determine feature values ​​corresponding to the image features.

[0061] After acquiring multiple image information, each image information is processed, the image features in each image information are identified, and the feature values ​​corresponding to the image features are determined.

[0062] The image feature refers to the part of the image information that needs to be analyzed in detail. The category of the image feature is not limited, and may include features at a specific position of the material or the overall features of the material, such as the edge R angle of the material, or the overall size of the material. The feature value corresponding to the image feature may be a specific numerical value corresponding to the image feature. For example, when the image feature is the edge R angle of the material, the feature value corresponding to the image feature is the specific size of the edge R angle. When the image feature is the overall size of the material, the feature value corresponding to the image feature is the specific size of the overall size of the material.

[0063] The category of the image feature can be a default category, for example, the correspondence between a certain type of material to be assembled and the category of one or more image features can be stored. After the type of material to be assembled is determined later, the category of the corresponding stored image feature can be directly called to confirm the image feature, and the process is simple. Subsequently, the default image feature is identified, and the feature value corresponding to the image feature is confirmed. For example, when the material to be assembled is a shell, the category of the default image feature includes the size of the shell and the edge R angle of the shell. After determining that the material to be assembled is a shell, the size of the shell and the edge R angle of the shell in the image information can be directly identified, and the specific values ​​of the size of the shell and the edge R angle of the shell can be determined. There is no need to determine the category of the image feature, which can simplify the implementation process of the method.

[0064] Step 106: Determine the error of each material to be assembled based on the characteristic value.

[0065] After obtaining the characteristic values ​​corresponding to each material to be assembled, the error of each material to be assembled can be determined based on the characteristic values. The method of determining the error of each material to be assembled based on the characteristic values ​​is not unique. For example, each characteristic value can be compared to determine the average value of each characteristic value, and then the difference between each characteristic value and the average value is used as the error of each characteristic value, that is, the error of each material to be assembled. It can be understood that in other embodiments, each characteristic value can also be compared with other values ​​to obtain the error of each material to be assembled.

[0066] Step 108: determine the first material and the second material with matching errors as a target assembly material pair.

[0067] The error matching indicates that the sum of the two errors is less than a preset matching threshold. The specific value of the preset matching threshold is not unique and can be set according to actual needs. When the sum of the two errors is less than the preset matching threshold, it indicates that the sum of the two errors is small.

[0068] After the error of each material to be assembled is determined, error matching is performed according to the error of each material to be assembled, and a material with error matching is selected from the first material and the second material to form a target assembly material pair. The process of error matching can be, first, select a material from the first material, obtain the error of the material, and then calculate the sum of the error of the material and the error of each material of the second material one by one, and then determine the second material corresponding to the sum value less than the preset matching threshold and the first material as the target assembly material pair. It should be noted that if there are multiple sum values ​​less than the preset matching threshold at this time, any one of the second materials corresponding to the multiple sum values ​​can be selected to determine the target assembly material pair with the first material; or, the second material corresponding to the smallest sum value and the first material are determined as the target assembly material pair. After that, another material from the first material is selected, the error of the other material is obtained, and then the sum of the error of the material and the error of each material of the remaining second materials is calculated one by one, and then the second material corresponding to the sum value less than the preset matching threshold and the other first material are determined as the target assembly material pair. Similarly, corresponding processing is performed on other materials in the first material until all materials in the first material are combined with the second material to form a target assembly material pair.

[0069] Alternatively, the process of error matching may also be: first, select a material from the second material, obtain the error of the material, then calculate the sum of the error of the material and the error of each material of the first material one by one, and then determine the first material and the second material corresponding to the sum value less than the preset matching threshold as the target assembly material pair. It should be noted that if there are multiple sum values ​​less than the preset matching threshold at this time, any one of the first materials corresponding to the multiple sum values ​​can be selected to determine the target assembly material pair with the second material; or, the first material corresponding to the smallest sum value and the second material are determined as the target assembly material pair. After that, select another material from the second material, obtain the error of the other material, then calculate the sum of the error of the material and the error of each material of the remaining first material one by one, and then determine the first material and the other second material corresponding to the sum value less than the preset matching threshold as the target assembly material pair. Similarly, corresponding processing is performed on other materials in the second material until all materials in the second material form a target assembly material pair with the first material.

[0070] After the first material and the second material with matching errors are determined as the target assembly material pair, when the target assembly material pair is subsequently assembled together, the error after the two materials are assembled can be reduced, which is beneficial to improving product quality.

[0071] The above-mentioned material matching method, after acquiring image information of the materials to be assembled including the first material and the second material for combined assembly, identifies the image features in each image information, determines the feature value corresponding to the image feature, determines the error of each material to be assembled based on the feature value, and determines the first material and the second material with error matching as the target assembly material pair, and the error matching indicates that the sum of the two errors is less than a preset matching threshold. Therefore, based on the image recognition technology, by extracting and analyzing the features of the image information of the materials, different materials with a smaller sum of two errors are determined as the target assembly material pair, which can reduce the impact of the material error on the product assembled using the target assembly material pair, which is conducive to improving the product precision, thereby improving the product quality.

[0072] In an exemplary embodiment, Figure 2 As shown, step 108 includes steps 202 to 206 .

[0073] Step 202: Mark an error that is greater than or equal to a preset error center value as a positive error.

[0074] Step 204: Mark the error that is smaller than the preset error center value as a negative error.

[0075] The specific value of the preset error center value is not limited, and can be a user-defined value according to the user's needs, so as to represent the user's product assembly needs. Alternatively, the preset error center value can also be a default value, which can be determined according to the type of material to be assembled and can be directly called when needed, which is convenient to use.

[0076] After the error of each material to be assembled is determined, the error of each material to be assembled is compared with the preset error center value, the errors are grouped, and the errors greater than or equal to the preset error center value are marked as positive errors, and the errors less than the preset error center value are marked as negative errors. It can be understood that the first material may only include materials with positive errors, or only include materials with negative errors, or may include both materials with positive errors and fabrics with negative errors. The second material may only include materials with positive errors, or only include materials with negative errors, or may include both materials with positive errors and fabrics with negative errors.

[0077] Step 206 , determining the first material with a positive error and the second material with a negative error that have error matching as a target assembly material pair; or determining the first material with a negative error and the second material with a positive error that have error matching as a target assembly material pair.

[0078] Since the first material may only include materials with positive errors, or only include materials with negative errors, or may include both materials with positive errors and negative errors. The second material may only include materials with positive errors, or may only include materials with negative errors, or may include both materials with positive errors and negative errors. Therefore, when performing error matching, the error-matched first material with positive errors and the error-matched second material with negative errors are determined as the target assembly material pair, or the error-matched first material with negative errors and the error-matched second material with positive errors are determined as the target assembly material pair. This allows all materials in the first material and the second material to be matched as much as possible to form the target assembly material pair of suitable materials, which is conducive to improving the overall product instructions.

[0079] In this embodiment, an error greater than or equal to the preset error center value is marked as a positive error, and an error less than the preset error center value is marked as a negative error. The first material with a positive error and the second material with a negative error that match the error are determined as a target assembly material pair, or the first material with a negative error and the second material with a positive error that match the error are determined as a target assembly material pair. Thus, by first determining whether the error is a positive error or a negative error and then matching the material pair, the matching efficiency can be improved, and the material with a positive error and the material with a negative error form a target assembly material pair, so that the final error of the product formed after assembling the target assembly material pair is reduced, and the accuracy and aesthetics of the product are improved.

[0080] In an exemplary embodiment, the material matching method further includes the step of obtaining a user-defined preset error center value.

[0081] When the preset error center value is a user-defined value, the positive and negative errors determined according to the preset error center value and the target assembly materials determined according to the positive and negative errors can better meet the user's personalized needs after assembly.

[0082] The method of obtaining the user-defined preset error center value is not unique. Exemplarily, the processing device is connected to the interactive device for communication, and the user can set the preset error center value through the interactive device. After receiving the preset error center value set by the user, the interactive device sends it to the processing device, so that the processing device obtains the user-defined preset error center value. The interactive device can be a touch screen, a voice recognition device, or a button, etc., which is not limited here.

[0083] In this embodiment, the material matching method further includes the step of obtaining a preset error center value customized by the user, so that the positive and negative errors determined according to the preset error center value and the target assembly material pair determined according to the positive and negative errors can better meet the personalized needs of the user after assembly.

[0084] In an exemplary embodiment, Figure 3As shown, in step 206, the step of determining the first material with a positive error and the second material with a negative error that match the error as the target assembly material pair includes steps 302 and 304:

[0085] Step 302, sequentially calculating the sum of the positive error of the first material and the negative error of each second material.

[0086] Step 304 , determining the second material and the first material corresponding to the minimum error sum as a target assembly material pair.

[0087] First, a material with a positive error is selected from the first material, and then the error sum of the positive error of the material and each second material with a negative error is calculated one by one to obtain a set of error sums corresponding to the material with the positive error. Then, the minimum error sum is found from this set of error sums, and the second material with a negative error corresponding to the minimum error sum and the first material with the positive error are determined as the target assembly material pair.

[0088] After that, another material in the first material with positive error is selected to obtain the error of the other material. Then, the sum of the positive error of the material and the error of each of the remaining second materials with negative error is calculated one by one to obtain a set of error sums corresponding to the material with positive error. Then, the smallest error sum is found from this set of error sums, and the second material with negative error corresponding to the smallest error sum and the first material with positive error are determined as the target assembly material pair. Similarly, corresponding processing is performed on other materials in the first material with positive error until all materials with positive error in the first material form a target assembly material pair with the second material.

[0089] In this embodiment, the sum of the positive error of the first material and the negative error of each second material is calculated in sequence, and the second material and the first material corresponding to the smallest sum of errors are determined as the target assembly material pair. Thus, the first material with the smallest sum of errors, the positive error, and the second material with the negative error can be combined into a target assembly material pair, which can effectively reduce the errors of the assembled materials and thus effectively improve the quality of the products.

[0090] In an exemplary embodiment, Figure 4 As shown, in step 206, the step of determining the first material with a negative error and the second material with a positive error that match the error as the target assembly material pair includes steps 402 and 404:

[0091] Step 402, sequentially calculating the sum of the negative error of the first material and the positive error of each second material.

[0092] Step 404 , determining the second material and the first material corresponding to the minimum error sum as a target assembly material pair.

[0093] First, a material with a negative error is selected from the first material, and then the error sum of the negative error of the material and each second material with a positive error is calculated one by one to obtain a set of error sums corresponding to the material with the negative error. Then, the minimum error sum is found from this set of error sums, and the second material with a positive error corresponding to the minimum error sum and the first material with a negative error are determined as the target assembly material pair.

[0094] After that, another material in the first material with negative error is selected to obtain the error of the other material. Then, the sum of the negative error of the material and the error of each of the remaining second materials with positive error is calculated one by one to obtain a set of error sums corresponding to the material with negative error. Then, the smallest error sum is found from this set of error sums, and the second material with positive error corresponding to the smallest error sum and the first material with negative error are determined as the target assembly material pair. Similarly, corresponding processing is performed on other materials in the first material with negative error until all materials with negative error in the first material form a target assembly material pair with the second material.

[0095] In this embodiment, the error sum of the negative error of the first material and the positive error of each second material is calculated in sequence, and the second material and the first material corresponding to the smallest error sum are determined as the target assembly material pair. Thus, the first material with the smallest error sum and the second material with the positive error can be combined into a target assembly material pair, which can effectively reduce the error of the assembled materials and thus effectively improve the quality of the product.

[0096] In an exemplary embodiment, Figure 5 As shown, after step 102 and before step 104 , the material matching method further includes steps 503 and 504 .

[0097] Step 503: Push image information.

[0098] After the image information of the material to be assembled is obtained, the image information is pushed. For example, the image information can be pushed to a terminal or server that is in communication with the processing device, so that the user can remotely receive and understand the image information. Alternatively, the image information can be pushed to an interactive device, which displays the image information, so that the user can receive and understand the image information locally.

[0099] Step 504: Obtain image features fed back by the user based on the pushed image information.

[0100] After the user receives the image information, he can select or set the image features as the features that need to be analyzed and compared later based on the pushed image information. After the processing device receives the feedback signal received by the user, it can determine the image features based on the feedback signal. Exemplarily, the user can select a specific position such as the edge R angle in the image information. After the processing device obtains the user's selection signal, it determines that the image feature is the edge R angle. In other embodiments, the processing device can also push some preset options to the user, such as size, area, thickness, etc., for the user to choose, so as to improve the convenience of user selection.

[0101] In this embodiment, after the image information is pushed, the image features fed back by the user based on the pushed image information are obtained to facilitate the user to determine the image features. Subsequently, feature values ​​can be obtained based on the image features determined by the user and error matching can be performed, so that the determined target assembly material pair can be more in line with the actual needs of the user.

[0102] In an exemplary embodiment, the material matching method further includes the step of: pushing identification information of the target assembly material pair.

[0103] The identification information is information that can indicate the uniqueness of a material, and can be a material number, or a characteristic identification of a material, etc.

[0104] For example, the identification information of the target assembly material pair can be pushed to a terminal or server that is in communication with the processing device, so that the user can remotely receive and understand the identification information of the target assembly material pair. Alternatively, the identification information of the target assembly material pair can be pushed to an interactive device, which displays the identification information of the target assembly material pair, so that the user can receive and understand the identification information of the target assembly material pair locally.

[0105] After the target assembly material pair is determined, the identification information of the target assembly material pair is pushed so that the user can understand the specific materials of the target assembly material pair. When the target assembly material pair is subsequently assembled, the situation of assembling wrong materials can be reduced, thereby improving the accuracy of assembling the target assembly material pair.

[0106] In this embodiment, pushing the identification information of the target assembly material pair can reduce the situation of assembling wrong materials and improve the accuracy of assembling the target assembly material pair.

[0107] In an exemplary embodiment, Figure 6 As shown, step 102 includes step 602 and step 604 .

[0108] Step 602: When each first material is sequentially placed in a preset position, image information of each first material is sequentially acquired.

[0109] Step 604, after the image information of each first material is acquired, the image information of each second material is acquired in sequence when each second material is sequentially placed in a preset position.

[0110] The preset position is a fixed position determined in advance, for example, it may be a storage platform that has been set up.

[0111] When collecting image information of each assembly material, the image information of the first material can be collected first. After the image information of the first material is collected, the image information of the second material can be collected to simplify the process of image information collection and facilitate storage and management of the collected image information.

[0112] When collecting image information of the first material, the user or staff can place one first material to the preset position each time, and the image acquisition device will collect images of the first materials placed in the preset position in turn, and send the collected images to the processing device, so that the processing device can obtain the image information of each first material in turn, avoiding detection errors caused by collecting image information of multiple first materials at the same time.

[0113] After the image information of each first material is acquired, the image information of the second material is acquired. When acquiring the image information of the second material, the user or staff can place one second material at a preset position at a time, and the image acquisition device sequentially acquires images of the second materials placed at the preset position, and sends the acquired images to the processing device, so that the processing device sequentially acquires the image information of each second material, thereby avoiding detection errors caused by acquiring the image information of multiple second materials at the same time.

[0114] In this embodiment, when each first material is sequentially placed in a preset position, image information of each first material is sequentially acquired, and after the image information of each first material is acquired, when each second material is sequentially placed in a preset position, image information of each second material is sequentially acquired. Thus, it is beneficial to store and manage the acquired image information, and can also reduce the detection error during image acquisition.

[0115] Based on the same inventive concept, the embodiment of the present application also provides a material matching device for implementing the material matching method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more material matching device embodiments provided below can refer to the limitations on the material matching method above, and will not be repeated here.

[0116] In an exemplary embodiment, Figure 7 As shown, a material matching device is provided, including: an image information acquisition module 702, a feature recognition module 704, an error determination module 706 and a material matching module 708, wherein:

[0117] The image information acquisition module 702 is used to acquire image information of the materials to be assembled; the materials to be assembled include a first material and a second material for combined assembly.

[0118] The feature recognition module 704 is used to recognize the image features in each image information and determine the feature values ​​corresponding to the image features.

[0119] The error determination module 706 is used to determine the error of each material to be assembled based on the characteristic value.

[0120] The material matching module 708 is used to determine the first material and the second material with error matching as a target assembly material pair; the error matching indicates that the sum of the two errors is less than a preset matching threshold.

[0121] In an exemplary embodiment, the material matching module is also used to mark an error greater than or equal to a preset error center value as a positive error; mark an error less than a preset error center value as a negative error; determine a first material with a positive error and a second material with a negative error that match the error as a target assembly material pair; or, determine a first material with a negative error and a second material with a positive error that match the error as a target assembly material pair.

[0122] In an exemplary embodiment, the material matching module is further used to sequentially calculate the error sum of the positive error of the first material and the negative error of each second material; and determine the second material and the first material corresponding to the minimum error sum as the target assembly material pair.

[0123] In an exemplary embodiment, the material matching module is further used to sequentially calculate the error sum of the negative error of the first material and the positive error of each second material; and determine the second material and the first material corresponding to the minimum error sum as the target assembly material pair.

[0124] In an exemplary embodiment, the material matching module is further used to obtain a user-defined preset error center value.

[0125] In an exemplary embodiment, the material matching device also includes a first pushing module, which is used to push the image information after the image information acquisition module acquires the image information of the material to be assembled and before the feature recognition module identifies the image features in each image information and determines the feature value corresponding to the image feature; and obtain the image features fed back by the user based on the pushed image information.

[0126] In an exemplary embodiment, the material matching device further includes a second pushing module, and the second pushing module is used to push identification information of the target assembly material pair.

[0127] In an exemplary embodiment, the image information acquisition module is also used to sequentially acquire the image information of each first material when each first material is sequentially placed in a preset position; after the image information of each first material is acquired, the image information of each second material is sequentially acquired when each second material is sequentially placed in a preset position.

[0128] Each module in the material matching device can be implemented in whole or in part by software, hardware or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.

[0129] In one embodiment, a material matching device is provided, which includes an image acquisition device and a processing device, wherein the image acquisition device is communicatively connected to the processing device; the image acquisition device is used to detect image information of a material to be assembled and send the image information to the processing device, and the processing device is used to perform material matching based on the method of any of the above embodiments.

[0130] The image acquisition device is in communication connection with the processing device. After the image acquisition device obtains the image information of the material to be assembled, it sends it to the processing device, so that the processing device obtains the image information of the material to be assembled.

[0131] The setting position of the image acquisition device is not unique, and can be determined in combination with the position of the material to be assembled, as long as the image of the material to be assembled can be acquired. For example, the material to be assembled can be set on a storage platform, and the storage platform is used to accommodate the material to be assembled. When image acquisition is required, the material to be assembled can be placed on the storage platform, and the storage platform is within the image acquisition range of the image acquisition device, and the image acquisition device can acquire images of the material to be assembled on the storage platform.

[0132] In addition, the number of image acquisition devices is not unique. For example, the number of image acquisition devices may be one, and one image acquisition device may perform image acquisition on one material to be assembled at a time to improve the accuracy of the acquired image information. Alternatively, one image acquisition device may perform image acquisition on multiple materials to be assembled at a time to improve the efficiency of image acquisition while reducing the hardware structure. Alternatively, the number of image acquisition devices may be multiple, and multiple image acquisition devices may simultaneously acquire image information of multiple different materials to be assembled to improve the efficiency of image information acquisition. Alternatively, multiple image acquisition devices may also perform image acquisition on the same material to be assembled, and determine the final image information based on the multiple acquired images, which is beneficial to reduce errors in the image acquisition process, thereby facilitating improving the accuracy of image information.

[0133] The material matching device includes an image acquisition device and a processing device, wherein the image acquisition device is in communication with the processing device; the image acquisition device is used to detect image information of the material to be assembled and send the image information to the processing device, and the processing device is used to perform material matching based on the method of any of the above embodiments. Thus, based on image recognition technology, by extracting and analyzing the image information of the material, two different materials with a smaller sum of errors are determined as the target assembly material pair, which can reduce the impact of material errors on the products assembled using the target assembly material pair, and is conducive to improving product accuracy, thereby improving product quality.

[0134] In an exemplary embodiment, the material matching device further includes an interaction device, which is in communication with the processing device. The user can send instructions through the interaction device, and the processing device can obtain the user instructions through the interaction device, and can also push relevant information to the interaction device, so that the user can easily understand the relevant information, thereby improving the human-computer interaction performance of the material matching device.

[0135] In an exemplary embodiment, the material matching device further includes a placement platform, which is used to accommodate the materials to be assembled. The placement platform can provide a stable accommodation position to facilitate material placement and image information collection. Exemplarily, after the materials to be assembled are placed on the placement platform, image information of the materials to be assembled can be collected by the image collection device to improve the accuracy of the collected image information.

[0136] In order to better understand the above embodiment, a detailed explanation is given below in conjunction with a specific embodiment. Figure 8 As shown, the material matching device includes an image acquisition device, a processing device, an interaction device and a storage platform. Among them, the image acquisition device is a camera, and the processing device and the interaction device are integrated into a processing and display terminal.

[0137] The specific processing flow of material matching equipment is as follows Fig. 9 As shown, including:

[0138] First, materials A and B are numbered A1, A2, ..., B1, B2, ... in sequence. Materials A and B are not the same type of materials. Materials A and B are materials used for combined assembly, such as screen and shell, side shell and back shell, and other matching assembled materials.

[0139] Then, materials A and B are placed on the storage platform in turn for photographing and recording. The camera will transmit each image information to the processing terminal. When materials A and B are all photographed, the user can manually select the features of the materials that need to be compared. For example, the position of the features to be compared can be selected in the image, and one or more features can be selected in materials A and B (note that the number of special features selected for materials A and B is the same), and the equipment will automatically compare all material features. The image features can specifically be the R angle of the material edge, positive and negative dimensional tolerances, etc., which can be selected by the user in the image.

[0140] Afterwards, the processing terminal extracts and compares the features of all materials, and groups the positive and negative errors of materials A and B respectively. The positive and negative errors may be different in specific materials, depending on the user's choice, which may be the length of the size, the size of the R angle, etc. When grouping, the device will automatically lock the center point of the material, establish a coordinate system in the image data of the material, and then the user will provide the center value. The features will be compared relative to the center value provided by the user as needed, and those greater than the center value will be judged as positive error groups, and those less than the center value will be judged as negative error groups. In an extensible way, the algorithm optimization can be used to achieve simultaneous comparison of different features of multiple different materials.

[0141] Finally, match material A with positive error with material B with negative error, and match material A with negative error with material B with positive error in turn, find the material code with the most matching absolute error value and display it in groups, and finally use this matched grouping method for installation to reduce the final error of the product and improve the accuracy and aesthetics of the product.

[0142] The above-mentioned material matching equipment can capture and store images of materials, and by extracting and analyzing the image features of the selected materials, perform positive and negative complementary matching of two different materials, matching the negative error of material A with the positive error of material B, or vice versa, thereby reducing the impact of material errors on products and improving the accuracy and aesthetics of materials.

[0143] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0144] In one embodiment, a computer device is further provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps in the above method embodiments when executing the computer program.

[0145] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0146] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.

[0147] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.

[0148] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0149] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A material matching method, characterized in that: The method comprises: Acquire image information of materials to be assembled; the materials to be assembled include a first material and a second material for combined assembly; Identify image features in each of the image information, and determine feature values ​​corresponding to the image features; Determining the error of each of the materials to be assembled based on the characteristic value; The first material and the second material with error matching are determined as a target assembly material pair; the error matching indicates that the sum of the two errors is less than a preset matching threshold.

2. The method according to claim 1, characterized in that The step of determining the first material and the second material with error matching as a target assembly material pair includes: Mark errors that are greater than or equal to a preset error center value as positive errors; Marking an error smaller than the preset error center value as a negative error; The first material with a positive error and the second material with a negative error that have error matching are determined as a target assembly material pair; or, the first material with a negative error and the second material with a positive error that have error matching are determined as a target assembly material pair.

3. The method according to claim 2, characterized in that The step of determining the first material with a positive error and the second material with a negative error that are error matched as a target assembly material pair comprises: Calculating the sum of the positive error of the first material and the negative error of each of the second materials in sequence; The second material and the first material corresponding to the minimum error sum are determined as the target assembly material pair.

4. The method according to claim 2, characterized in that: The step of determining the first material with a negative error and the second material with a positive error that are error matched as a target assembly material pair comprises: Calculating the sum of the negative error of the first material and the positive error of each of the second materials in sequence; The second material and the first material corresponding to the minimum error sum are determined as the target assembly material pair.

5. The method according to claim 2, characterized in that: The method further comprises: Gets the user-defined preset error center value.

6. The method according to claim 1, characterized in that After acquiring the image information of the material to be assembled and before identifying the image features in each of the image information and determining the feature values ​​corresponding to the image features, the method further includes: Pushing the image information; The image features fed back by the user based on the pushed image information are obtained.

7. The method according to claim 1, characterized in that The method further comprises: Push identification information of the target assembly material pair.

8. The method according to claim 1, characterized in that The step of obtaining image information of the material to be assembled includes: When the first materials are placed in preset positions in sequence, image information of the first materials is acquired in sequence; After the image information of each of the first materials is acquired, and when each of the second materials is sequentially placed in a preset position, the image information of each of the second materials is sequentially acquired.

9. A material matching device, characterized in that: The device comprises: An image information acquisition module is used to acquire image information of materials to be assembled; the materials to be assembled include a first material and a second material for combined assembly; A feature recognition module, used to recognize image features in each of the image information and determine feature values ​​corresponding to the image features; An error determination module, used for determining the error of each of the materials to be assembled based on the characteristic value; The material matching module is used to determine the first material and the second material with error matching as a target assembly material pair; the error matching indicates that the sum of the two errors is less than a preset matching threshold.

10. A material matching device, characterized in that: The device comprises an image acquisition device and a processing device, wherein the image acquisition device is communicatively connected with the processing device; The image acquisition device is used to acquire image information of materials to be assembled and send the image information to the processing device, and the processing device is used to perform material matching based on the method according to any one of claims 1 to 8.

11. The material matching device according to claim 10, characterized in that: It also includes an interaction device, which is communicatively connected with the processing device.

12. The material matching device according to claim 10, characterized in that: It also includes a storage platform, which is used to accommodate materials to be assembled.

Images