Customer data intelligent supervision system and method based on Internet of Things

Through an intelligent customer data supervision system based on the Internet of Things, the image acquisition, three-dimensional reconstruction and identification module are used to convert customer data into three-dimensional information for comparison, solving the problem of large burden on graphics processing in the existing technology and realizing intelligent data supervision and improve accuracy.

CN119027596AActive Publication Date: 2024-11-26SUZHOU GONGYING INTERNET TECH CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
CN202411506295.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-28
Publication Date
2024-11-26
Estimated Expiration
2044-10-28

AI Technical Summary

Technical Problem

The prior art increases the burden of graphics processing when generating three-dimensional graphics as a whole in customer data supervision, resulting in slowing down the system processing speed and insufficient data processing accuracy.

Method used

Adopt an intelligent customer data supervision system based on the Internet of Things, and convert customer data into three-dimensional information for comparison through image acquisition module, three-dimensional reconstruction module, result marking module, image cutting module, single image recognition module and result comparison module. Mark and identify abnormal locations, reduce the burden of data computing, and improve processing accuracy.

Benefits of technology

It realizes intelligent supervision of customer data, intuitively discovers data changes through three-dimensional information comparison, avoids the increased processing burden of the overall generation of three-dimensional graphics, and improves the system processing speed and data processing accuracy.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119027596A_ABST
    Figure CN119027596A_ABST
Patent Text Reader

Abstract

The invention discloses an intelligent customer data supervision system and method based on the Internet of Things, and relates to the technical field of data supervision, and the system comprises an image collection module, a three-dimensional reconstruction module, a result marking module, and an image cutting module. According to the intelligent customer data supervision system and method based on the Internet of Things, the customer data is converted into the three-dimensional information, and the change of the customer data can be visually found through the comparison of the three-dimensional information, so that the intelligent supervision of the customer data is realized; meanwhile, only three-dimensional reconstruction needs to be carried out on a single-sided image so as to realize comparison with three-dimensional information of a corresponding surface of reference data, so that the situation that the image processing burden is increased and the image processing speed of the system is increased by integrally generating a three-dimensional graph when a client data image three-dimensional graph is constructed is avoided; and meanwhile, a single-sided image marked as unqualified data by a result marking module is cut into single images for processing, so that the data operation burden can be further reduced, and the processing accuracy in the data processing process is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of data supervision, and in particular to a customer data intelligent supervision system and method based on the Internet of Things. Background Art

[0002] Information supervision technology refers to the use of various technical means and methods to monitor and manage information to ensure the security, accuracy and legality of information. With the rapid development of information technology, the status of information in social and economic life is becoming more and more important, and society's requirements for information security and supervision are getting higher and higher.

[0003] Currently, when conducting customer data supervision, three-dimensional image information of customer sensitive data is collected through data integration, and anomalies are marked through reference three-dimensional images of standard customer sensitive data and three-dimensional graphics of detection data. This will result in increasing the burden of graphics processing and increasing the system's processing speed for image processing when generating three-dimensional graphics of customer data through overall data when constructing the three-dimensional graphics of customer data. Summary of the invention

[0004] The purpose of the present invention is to provide a customer data intelligent supervision system and method based on the Internet of Things to solve the above-mentioned deficiencies in the prior art.

[0005] In order to achieve the above-mentioned object, the present invention provides the following technical solution: a customer data intelligent supervision system based on the Internet of Things, comprising an image acquisition module, a three-dimensional reconstruction module, a result marking module, an image cutting module, a single image recognition module, a result comparison module and a result identification module, characterized in that: The image acquisition module is used to acquire customer data images, reference data three-dimensional images, and images of reference data at various viewing angles based on IoT data; The three-dimensional reconstruction module is used to perform single-sided three-dimensional reconstruction based on the customer data image; The result marking module is used to mark a single-sided image whose single-sided 3D reconstruction result is the same as the comparison result of the three-dimensional information of the corresponding surface of the collected reference data as qualified data, and mark a single-sided image whose single-sided 3D reconstruction result is different from the comparison result of the three-dimensional information of the corresponding surface of the collected reference data as unqualified data; The image cutting module is used to cut the single-sided image marked as unqualified data by the result marking module into a single image; The single image recognition module is used to perform single image recognition on the single image cut by the image cutting module, so as to recognize the corresponding single pixel stroke line in the single image; The result comparison module is used to compare the single-side 3D reconstruction result of the single-side image with the corresponding face 3D information of the collected reference data, and to compare the recognized single-pixel stroke line with the corresponding position of the reference data image; The result identification module is used to identify the single-pixel stroke line whose comparison result between the identified single-pixel stroke line and the corresponding position of the reference data image is different as an abnormal position.

[0006] Furthermore, the three-dimensional reconstruction module includes: An image extraction module, in which a mask operation is used to extract the main body of the image in a single-sided image; An image enhancement module, in which an exponential adjustment method is used to enhance the extracted image; A surface model recovery module, in which the surface model of a single-surface image is reconstructed using gradient field information; A model macrostructure optimization module, in which the macrogeometry of the single-sided image model is optimized using the image medial axis curve constraint; The single-sided image macrostructure optimization module uses the macromodel to optimize the single-sided image model, and fuses the single-sided image model with the macrostructure model to generate the final single-sided image 3D model result; A single-side image three-dimensional model output module is used to output a single-side image three-dimensional model.

[0007] Furthermore, the single image recognition module includes: Hole filling module, which can fill small holes in drawing strokes by filling the background with white pixels, performing image negation on the filled image, and performing image XOR operation on the original image and the image after the negation operation; The error elimination module eliminates isolated small dots still existing in the stroke area through opening operations; Grayscale processing module, which obtains grayscale image by processing with three different weights of RGB; The stroke smoothing module uses median filtering to smooth the stroke outline and remove noise points; The stroke measurement module integrates the original morphological stroke algorithm and constructs a thinning algorithm to obtain single-pixel stroke lines without burrs.

[0008] A method for intelligent supervision of customer data based on the Internet of Things, comprising the following steps: S1, collecting customer data, marking the collected single-sided images of customer data, the single-sided images including but not limited to the front view, side view, top view and bottom view; S2, single-sided 3D reconstruction of single-sided images; S3, comparing the single-side 3D reconstruction result of the single-side image with the corresponding surface 3D information of the collected reference data; S4, marking the single-side images with the same comparison results in step S3 as qualified data, and marking the single-side images with different comparison results in step S3 as unqualified data; S5, cutting the single-sided image marked as unqualified data in step S4 into a single image; S6, performing single image recognition on the single image cut in step S5, so as to identify the corresponding single pixel stroke line in the single image; S7, comparing the identified single-pixel stroke line with the corresponding position of the reference data image, and marking the single-pixel stroke line with different comparison results as an abnormal position.

[0009] Furthermore, the single-side 3D reconstruction of the single-side image specifically includes the following steps: A1, input image; A2, mask operation to extract the main body of the picture in the single-sided image; A3, image enhancement, in which the extracted image is enhanced using an exponential adjustment method; A4, surface model recovery, specifically includes the following steps: A41, surface model reconstruction; A42, gradient field information extraction, in which the intensity of pixel values ​​in the enhanced image is used as a clue to calculate the gradient field information of the leaves in the image; A43, discrete set processing; A44, surface model recovery, uses gradient field information to reconstruct the surface model of a single-sided image; A5, model macro structure optimization, using the image center axis curve constraint to optimize the macro geometry of the single-sided image model, specifically including the following steps: A51, macro geometry optimization; A52, image medial axis curve fitting, where the medial axis curve is taken from a single-sided image; A53, shape function constraint; A54, model macrostructure; A6, single-sided image macro structure optimization, finally the macro model optimizes the single-sided image model, and the single-sided image model and the macro structure model are integrated to generate the final single-sided image 3D model result; A7, output single-sided image 3D model.

[0010] Furthermore, the single image recognition includes the following working steps: B1, to fill the tiny holes in the strokes, use the flood fill algorithm to fill the background with white pixels, perform image negation on the filled image, and perform image XOR operation on the original image and the image after the negation operation. Through the above three steps, the tiny holes in the drawing strokes can be completely filled; B2, there are still isolated small dots in the stroke area, which can be eliminated by opening operation; B3, the stroke image is processed with three different weights of RGB to obtain a grayscale image. The calculation formula for grayscale processing is as follows: Gray=0.29*R+0.578*G+0.123*B Among them, R, G, B represent the values ​​of the three primary colors of the stroke segmentation image - red, green, and blue, and "Gray" represents the grayscale value; B4, in order to retain more stroke details, use median filtering to smooth the stroke outline and remove noise points, which specifically includes the following steps: B41, the pixel values ​​of the stroke image are divided into [1, 2, ..., l] levels, n i It is used to represent the number of image pixel values. Therefore, the calculation formula for the total pixel value of the stroke image is as follows: ; B42, where the frequency of a single pixel in the image is p i The calculation formula is as follows: ; B43, define two variables as the sum of the frequency values ​​of local variables w0 and w1. The relationship between the two is shown in the following formula: ; B45, the foreground pixel frequency u0 and background pixel frequency u1 of the stroke area image are as follows: , in ; B5, use the maximum inter-class variance method to perform binary processing on the image; B6, in order to measure the stroke length, the original morphological stroke algorithm is finally integrated to construct a thinning algorithm to obtain a single-pixel stroke line without burrs; B7, the single-pixel stroke lines obtained by combining are used to obtain the result of the single image to be identified.

[0011] Furthermore, the specific steps of cutting the single-sided image into a single image include: C1, the connected region analysis method is used to perform the first segmentation of the single-face image to obtain each block; C2: Project each block to get the length of each block; C3: Define the width of a single character and record it as L. Use this as the threshold and transfer the blocks whose projection length is greater than the threshold to C4 for the second segmentation. C4: Use the initial point selection process to find the initial point, use the left descent algorithm, and use the improved permeation rule of the permeation process to segment. If the permeation is unsuccessful, it is considered that the permeation has entered a closed loop and go to C5, where the specific steps of the initial point selection process are C41, and the specific steps of the permeation process improvement are C42; C41 (1), first, at the inflection point of the glued digit or where it is connected, the pixels will be more concentrated than other places; these pixels represent the characteristics of the digits, we can call them key points; select the leftmost and rightmost points, these two points must be located on both sides of the glued digit, representing the characteristics of the two digits respectively; C41 (2), assuming that BB is a connected component, and the distance between the leftmost point and the rightmost point is BD; take 1 / 3 of BD to intersect with the connected component. Since the number of intersection points may be greater than one, select the top point and name it point a; C41 (3), if the right point or upper right point of point a is a black point, then this point will replace point a and become the new point a, until its right point or upper right point is a white point; at this time, the latest point a is the extreme point of this area; C41 (4), if the horizontal position of the latest point a is less than 2 / 3 of BD, it means that the latest point a is the extreme point of the left part of the connected component; then the latest point a is used as the starting point of the permeation process; otherwise, if the horizontal position of the latest point a is greater than 2 / 3 of BD, it means that the initial point a is on the connecting line of adjacent numbers; then the initial point a is used as the starting position of the permeation process; C42, the penetration process improvement rules can be described as: Rule 1: if n1=0 and n3 =0, then next_pixel = n3 Rule 2: if n1=0 and n2 =1, then next_pixel = n1 Rule 3: if n1=0, then next_pixel = n1 Rule 4: if n6=1 and n7 =0, then next_pixel = n7 Where 0 is a white pixel, 1 is a black pixel, n1 is the pixel to the left of the current pixel, n2 is the pixel to the lower left of the current pixel, n3 is the pixel below the current pixel, n4 is the pixel to the lower right of the current pixel, n5 is the pixel to the right of the current pixel, n6 is the pixel to the upper left of the current pixel, and n7 is the pixel above the current pixel; C5: The upper part uses the left-down algorithm and stops immediately after the first penetration. The trajectory is recorded as P1. The lower part uses the left-upward algorithm. Same as before, it stops immediately after the first penetration. The trajectory is recorded as P2. The intersection points of the trajectory and the contact number are recorded as p1 and p2. A shortest path connecting p1 and p2 is found on the contour of the contact number. The connecting trajectory is recorded as P3. C6: The final complete image cutting trajectory includes P1, P2 and P3.

[0012] Compared with the prior art, the present invention provides a customer data intelligent supervision system and method based on the Internet of Things. By converting customer data into three-dimensional information, changes in customer data can be intuitively discovered through comparison of the three-dimensional information, thereby realizing intelligent supervision of customer data. At the same time, such a setting only requires three-dimensional reconstruction of a single-sided image to realize comparison with the three-dimensional information of the corresponding surface of the reference data, thereby avoiding increasing the graphics processing burden and increasing the processing speed of the system for image processing by generating a three-dimensional graphic as a whole when constructing a three-dimensional graphic of the customer data image. At the same time, by cutting the single-sided image marked as unqualified data by the result marking module into a single image for processing, the data calculation burden can be further reduced and the processing accuracy in the data processing process can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present invention. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.

[0014] Figure 1 A system structure block diagram provided for an embodiment of the present invention. DETAILED DESCRIPTION

[0015] In order to enable those skilled in the art to better understand the technical solution of the present invention, the present invention will be further described in detail below with reference to the accompanying drawings.

[0016] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise" and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as limiting the present invention.

[0017] In addition, the terms "first" and "second" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present invention, "multiple" means two or more, unless otherwise clearly and specifically defined. In addition, the terms "installed", "connected" and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal connection of two components. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0018] Example embodiments will be described more fully below with reference to the accompanying drawings, but the example embodiments may be embodied in different forms and should not be construed as limited to the embodiments set forth herein. On the contrary, the purpose of providing these embodiments is to make the present disclosure thorough and complete and to enable those skilled in the art to fully understand the scope of the present disclosure.

[0019] In the absence of conflict, the various embodiments of the present disclosure and the various features therein may be combined with each other.

[0020] As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items.

[0021] The terms used herein are only used to describe specific embodiments and are not intended to limit the present disclosure. As used herein, the singular forms "a", "an" and "the" are also intended to include the plural forms, unless the context clearly indicates otherwise. It will also be understood that when the terms "comprising" and / or "made of" are used in this specification, the presence of the features, wholes, steps, operations, elements and / or components is specified, but the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or groups thereof is not excluded.

[0022] The embodiments described herein may be described with reference to plan views and / or cross-sectional views by means of idealized schematic diagrams of the present disclosure. Therefore, the example illustrations may be modified according to manufacturing techniques and / or tolerances. Therefore, the embodiments are not limited to the embodiments shown in the drawings, but include modifications of the configurations formed based on the manufacturing process. Therefore, the regions illustrated in the drawings have schematic properties, and the shapes of the regions shown in the figures illustrate the specific shapes of the regions of the elements, but are not intended to be limiting.

[0023] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by those of ordinary skill in the art. It will also be understood that terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant art and the present disclosure, and will not be interpreted as having an idealized or overly formal meaning unless explicitly defined as such herein.

[0024] See also Figure 1 , a customer data intelligent supervision system based on the Internet of Things, including an image acquisition module, a three-dimensional reconstruction module, a result marking module, an image cutting module, a single image recognition module, a result comparison module and a result identification module, characterized in that: The image acquisition module is used to acquire customer data images, reference data three-dimensional images, and images of reference data from various viewing angles based on IoT data; The 3D reconstruction module is used to perform single-sided 3D reconstruction based on the customer data image; The result marking module is used to mark the single-sided image whose single-sided 3D reconstruction result is the same as the comparison result of the three-dimensional information of the corresponding surface of the collected reference data as qualified data, and mark the single-sided image whose single-sided 3D reconstruction result is different from the comparison result of the three-dimensional information of the corresponding surface of the collected reference data as unqualified data; The image cutting module is used to cut the single-sided image marked as unqualified data by the result marking module into a single image; The single image recognition module is used to perform single image recognition on the single image cut by the image cutting module, so as to recognize the corresponding single pixel stroke line in the single image; The result comparison module is used to compare the single-side 3D reconstruction result of the single-side image with the corresponding face 3D information of the collected reference data, and to compare the recognized single-pixel stroke line with the corresponding position of the reference data image; The result identification module is used to identify the single-pixel stroke line whose comparison result between the identified single-pixel stroke line and the corresponding position of the reference data image is different as an abnormal position.

[0025] The customer data image, the reference data three-dimensional image and the images of each viewing angle of the reference data are collected through the image acquisition module, and the collected single-sided image of the customer data is marked, and the single-sided image is reconstructed in single-sided three-dimensional through the three-dimensional reconstruction module. The single-sided three-dimensional reconstruction result of the single-sided image is compared with the three-dimensional information of the corresponding surface of the collected reference data through the result comparison module. The single-sided images with the same comparison results are marked as qualified data, and the single-sided images with different comparison results are marked as unqualified data. The single-sided image marked as unqualified data is cut into single images through the image cutting module, and the single image recognition module performs single image recognition on the cut single image, so as to identify the corresponding single-pixel stroke line in the single image, and the recognized single image is compared with the result comparison module. The pen strokes are compared with the corresponding positions of the reference data image, and the single-pixel pen strokes with different comparison results are marked as abnormal positions through the result identification module. By converting the customer data into three-dimensional information, the changes in the customer data can be intuitively discovered through the comparison of the three-dimensional information, thereby realizing intelligent supervision of the customer data. At the same time, such a setting only requires three-dimensional reconstruction of the single-sided image to realize the comparison with the three-dimensional information of the corresponding surface of the reference data, thereby avoiding increasing the graphics processing burden and increasing the system's processing speed for image processing by generating a three-dimensional graphic as a whole when constructing the three-dimensional graphics of the customer data image. At the same time, by cutting the single-sided image marked as unqualified data by the result marking module into a single image for processing, the data calculation burden can be further reduced and the processing accuracy during the data processing process can be improved.

[0026] The 3D reconstruction module includes: An image extraction module, in which a mask operation is used to extract the main body of the image in a single-sided image; An image enhancement module, in which an exponential adjustment method is used to enhance the extracted image; A surface model recovery module, in which the surface model of a single-surface image is reconstructed using gradient field information; A model macrostructure optimization module, in which the macrogeometry of the single-sided image model is optimized using the image medial axis curve constraint; The single-sided image macrostructure optimization module uses the macromodel to optimize the single-sided image model, and fuses the single-sided image model with the macrostructure model to generate the final single-sided image 3D model result; The single-sided image 3D model output module is used to output the single-sided image 3D model.

[0027] The single image recognition module includes: Hole filling module, which can fill small holes in drawing strokes by filling the background with white pixels, performing image negation on the filled image, and performing image XOR operation on the original image and the image after the negation operation; The error elimination module eliminates isolated small dots still existing in the stroke area through opening operations; Grayscale processing module, which obtains grayscale image by processing with three different weights of RGB; The stroke smoothing module uses median filtering to smooth the stroke outline and remove noise points; The stroke measurement module integrates the original morphological stroke algorithm and constructs a thinning algorithm to obtain single-pixel stroke lines without burrs.

[0028] A method for intelligent supervision of customer data based on the Internet of Things, comprising the following steps: S1, customer data collection, marking the collected single-sided images of the customer data, the single-sided images including but not limited to the front view, side view, top view and bottom view; S2, single-sided 3D reconstruction of single-sided images; S3, comparing the single-side 3D reconstruction result of the single-side image with the corresponding surface 3D information of the collected reference data; S4, marking the single-side images with the same comparison results in step S3 as qualified data, and marking the single-side images with different comparison results in step S3 as unqualified data; S5, cutting the single-sided image marked as unqualified data in step S4 into a single image; The single-sided image can be cut according to the complete cutting trajectory to obtain a single image, and the cut single image is transmitted to step S6 for single image recognition, so as to recognize the corresponding single-pixel stroke line in the single image.

[0029] S6, performing single image recognition on the single image cut out in step S5 by the single image recognition module, thereby recognizing the corresponding single pixel stroke line in the single image; S7, compare the single-sided 3D reconstruction result of the single-sided image with the three-dimensional information of the corresponding surface of the collected reference data through the result comparison model. When the comparison result of the single-sided 3D reconstruction result of the single-sided image is the same as the comparison result of the three-dimensional information of the corresponding surface of the collected reference data, compare the single-pixel stroke line identified in step S6 with the corresponding position of the reference data image through the result comparison model, and mark the single-pixel stroke line with a different comparison result between the single-pixel stroke line identified in step S6 and the corresponding position of the reference data image as an abnormal position.

[0030] By modifying the single-pixel stroke line marked as an abnormal position, data correction can be achieved, and then the correct three-dimensional graphics of the customer data image can be obtained. By converting the customer data into three-dimensional information, the changes in the customer data can be intuitively discovered through the comparison of the three-dimensional information, thereby realizing intelligent supervision of the customer data. At the same time, such a setting only requires three-dimensional reconstruction of the single-sided image to realize the comparison with the three-dimensional information of the corresponding surface of the reference data, thereby avoiding increasing the graphics processing burden and increasing the system's processing speed for image processing by generating a three-dimensional graphic as a whole when constructing the three-dimensional graphics of the customer data image.

[0031] Single-sided 3D reconstruction of a single-sided image specifically includes the following steps: A1, input image; A2, mask operation to extract the main body of the picture in the single-sided image; A3, image enhancement, in which the extracted image is enhanced using an exponential adjustment method; A4, surface model recovery, specifically includes the following steps: A41, surface model reconstruction; A42, gradient field information extraction, in which the intensity of pixel values ​​in the enhanced image is used as a clue to calculate the gradient field information of the leaves in the image; A43, discrete set processing; A44, surface model recovery, uses gradient field information to reconstruct the surface model of a single-sided image; A5, model macro structure optimization, using the image center axis curve constraint to optimize the macro geometry of the single-sided image model, specifically including the following steps: A51, macro geometry optimization; A52, image medial axis curve fitting, where the medial axis curve is taken from a single-sided image; A53, shape function constraint; A54, model macrostructure; A6, single-sided image macro structure optimization, finally the macro model optimizes the single-sided image model, and the single-sided image model and the macro structure model are integrated to generate the final single-sided image 3D model result; A7, output single-sided image 3D model.

[0032] Single image recognition includes the following steps: B1, to fill the tiny holes in the strokes, use the flood fill algorithm to fill the background with white pixels, perform image negation on the filled image, and perform image XOR operation on the original image and the image after the negation operation. Through the above three steps, the tiny holes in the drawing strokes can be completely filled; B2, there are still isolated small dots in the stroke area, which can be eliminated by opening operation; B3, the stroke image is processed with three different weights of RGB to obtain a grayscale image. The calculation formula for grayscale processing is as follows: Gray=0.29*R+0.578*G+0.123*B Among them, R, G, B represent the values ​​of the three primary colors of the stroke segmentation image - red, green, and blue, and "Gray" represents the grayscale value; B4, in order to retain more stroke details, use median filtering to smooth the stroke outline and remove noise points, which specifically includes the following steps: B41, the pixel values ​​of the stroke image are divided into [1, 2, ..., l] levels, n i It is used to represent the number of image pixel values. Therefore, the calculation formula for the total pixel value of the stroke image is as follows: ; B42, where the frequency of a single pixel in the image is p i The calculation formula is as follows: ; B43, define two variables as the sum of the frequency values ​​of local variables w0 and w1. The relationship between the two is shown in the following formula: ; B45, the foreground pixel frequency u0 and background pixel frequency u1 of the stroke area image are as follows: , in ; B5, use the maximum inter-class variance method to perform binary processing on the image; B6, in order to measure the stroke length, the original morphological stroke algorithm is finally integrated to construct a thinning algorithm to obtain a single-pixel stroke line without burrs; B7, the single-pixel stroke lines obtained by combining are used to obtain the result of the single image to be identified.

[0033] The specific steps of cutting a single image from a single side image include: C1, the connected region analysis method is used to perform the first segmentation of the single-face image to obtain each block; C2: Project each block to get the length of each block; C3: Define the width of a single character and record it as L. Use this as the threshold and transfer the blocks whose projection length is greater than the threshold to C4 for the second segmentation. C4: Use the initial point selection process to find the initial point, use the left descent algorithm, and use the improved permeation rule of the permeation process to segment. If the permeation is unsuccessful, it is considered that the permeation has entered a closed loop and go to C5, where the specific steps of the initial point selection process are C41, and the specific steps of the permeation process improvement are C42; C41 (1), first, at the inflection point of the glued digit or where it is connected, the pixels will be more concentrated than other places; these pixels represent the characteristics of the digits, we can call them key points; select the leftmost and rightmost points, these two points must be located on both sides of the glued digit, representing the characteristics of the two digits respectively; C41 (2), assuming that BB is a connected component, and the distance between the leftmost point and the rightmost point is BD; take 1 / 3 of BD to intersect with the connected component. Since the number of intersection points may be greater than one, select the top point and name it point a; C41 (3), if the right point or upper right point of point a is a black point, then this point will replace point a and become the new point a, until its right point or upper right point is a white point; at this time, the latest point a is the extreme point of this area; C41 (4), if the horizontal position of the latest point a is less than 2 / 3 of BD, it means that the latest point a is the extreme point of the left part of the connected component; then the latest point a is used as the starting point of the permeation process; otherwise, if the horizontal position of the latest point a is greater than 2 / 3 of BD, it means that the initial point a is on the connecting line of adjacent numbers; then the initial point a is used as the starting position of the permeation process; C42, the penetration process improvement rules can be described as: Rule 1: if n1=0 and n3 =0, then next_pixel = n3 Rule 2: if n1=0 and n2 =1, then next_pixel = n1 Rule 3: if n1=0, then next_pixel = n1 Rule 4: if n6=1 and n7 =0, then next_pixel = n7 Where 0 is a white pixel, 1 is a black pixel, n1 is the pixel to the left of the current pixel, n2 is the pixel to the lower left of the current pixel, n3 is the pixel below the current pixel, n4 is the pixel to the lower right of the current pixel, n5 is the pixel to the right of the current pixel, n6 is the pixel to the upper left of the current pixel, and n7 is the pixel above the current pixel; C5: The upper part uses the left-down algorithm and stops immediately after the first penetration. The trajectory is recorded as P1. The lower part uses the left-upward algorithm. Same as before, it stops immediately after the first penetration. The trajectory is recorded as P2. The intersection points of the trajectory and the contact number are recorded as p1 and p2. A shortest path connecting p1 and p2 is found on the contour of the contact number. The connecting trajectory is recorded as P3. C6: The final complete image cutting trajectory includes P1, P2 and P3.

[0034] When step C6 is completed, the single-sided image can be cut according to the complete cutting trajectory obtained in step C6 to obtain a single image, and the cut single image is transmitted to the single image recognition module for single image recognition, so as to identify the corresponding single-pixel stroke line in the single image, and the single-sided 3D reconstruction result of the single-sided image is compared with the three-dimensional information of the corresponding surface of the collected reference data through the result comparison module. When the single-sided 3D reconstruction result of the single-sided image is the same as the comparison result of the three-dimensional information of the corresponding surface of the collected reference data, based on the comparison of the single-pixel stroke line identified in step S6 with the corresponding position of the reference data image through the result comparison module, the single-pixel stroke line identified in step S6 is compared with the corresponding position of the reference data image. A single-pixel stroke line with a different comparison result from the corresponding position of the reference data image is marked as an abnormal position. By modifying the single-pixel stroke line marked as an abnormal position, data correction can be achieved, and the correct three-dimensional graphics of the customer data image can be obtained. By converting the customer data into three-dimensional information, changes in the customer data can be intuitively discovered through the comparison of the three-dimensional information, thereby achieving intelligent supervision of the customer data. At the same time, such a setting only requires three-dimensional reconstruction of a single-sided image to achieve comparison with the three-dimensional information of the corresponding surface of the reference data, thereby avoiding increasing the graphics processing burden by generating a three-dimensional graphics as a whole when constructing the three-dimensional graphics of the customer data image, and increasing the system's processing speed for image processing.

[0035] The above description is only by way of illustration of certain exemplary embodiments of the present invention. It is undoubted that those skilled in the art can modify the described embodiments in various ways without departing from the spirit and scope of the present invention. Therefore, the above drawings and descriptions are illustrative in nature and should not be construed as limiting the scope of protection of the claims of the present invention.

Claims

1. A customer data intelligent supervision system based on the Internet of Things, comprising an image acquisition module, a three-dimensional reconstruction module, a result marking module, an image cutting module, a single image recognition module, a result comparison module and a result identification module, characterized in that: The image acquisition module is used to acquire customer data images, reference data three-dimensional images, and images of reference data at various viewing angles based on IoT data; The three-dimensional reconstruction module is used to perform single-sided three-dimensional reconstruction based on the customer data image; The result marking module is used to mark a single-sided image whose single-sided 3D reconstruction result is the same as the comparison result of the three-dimensional information of the corresponding surface of the collected reference data as qualified data, and mark a single-sided image whose single-sided 3D reconstruction result is different from the comparison result of the three-dimensional information of the corresponding surface of the collected reference data as unqualified data; The image cutting module is used to cut the single-sided image marked as unqualified data by the result marking module into a single image; The single image recognition module is used to perform single image recognition on the single image cut by the image cutting module, so as to recognize the corresponding single pixel stroke line in the single image; The result comparison module is used to compare the single-side 3D reconstruction result of the single-side image with the corresponding face 3D information of the collected reference data, and to compare the recognized single-pixel stroke line with the corresponding position of the reference data image; The result identification module is used to identify the single-pixel stroke line whose comparison result between the identified single-pixel stroke line and the corresponding position of the reference data image is different as an abnormal position.

2. According to claim 1, a customer data intelligent supervision system based on the Internet of Things is characterized by: The three-dimensional reconstruction module comprises: An image extraction module, in which a mask operation is used to extract the main body of the image in a single-sided image; An image enhancement module, in which an exponential adjustment method is used to enhance the extracted image; A surface model recovery module, in which the surface model of a single-surface image is reconstructed using gradient field information; A model macrostructure optimization module, in which the macrogeometry of the single-sided image model is optimized using the image medial axis curve constraint; The single-sided image macrostructure optimization module uses the macromodel to optimize the single-sided image model, and fuses the single-sided image model with the macrostructure model to generate the final single-sided image 3D model result; A single-side image three-dimensional model output module is used to output a single-side image three-dimensional model.

3. According to claim 1, the customer data intelligent supervision system based on the Internet of Things is characterized by: The single image recognition module comprises: Hole filling module, which can fill small holes in drawing strokes by filling the background with white pixels, performing image negation on the filled image, and performing image XOR operation on the original image and the image after the negation operation; The error elimination module eliminates isolated small dots still existing in the stroke area through opening operations; Grayscale processing module, which obtains grayscale image by processing with three different weights of RGB; The stroke smoothing module uses median filtering to smooth the stroke outline and remove noise points; The stroke measurement module integrates the original morphological stroke algorithm and constructs a thinning algorithm to obtain single-pixel stroke lines without burrs.

4. A method for intelligent supervision of customer data based on the Internet of Things, which is applicable to the intelligent supervision system for customer data based on the Internet of Things according to any one of claims 1 to 3, characterized in that: The following steps are involved: S1, collecting customer data, marking the collected single-sided images of customer data, the single-sided images including but not limited to the front view, side view, top view and bottom view; S2, single-sided 3D reconstruction of single-sided images; S3, comparing the single-side 3D reconstruction result of the single-side image with the corresponding surface 3D information of the collected reference data; S4, marking the single-side images with the same comparison results in step S3 as qualified data, and marking the single-side images with different comparison results in step S3 as unqualified data; S5, cutting the single-sided image marked as unqualified data in step S4 into a single image; S6, performing single image recognition on the single image cut in step S5, so as to identify the corresponding single pixel stroke line in the single image; S7, comparing the identified single-pixel stroke line with the corresponding position of the reference data image, and marking the single-pixel stroke line with different comparison results as an abnormal position.

5. The method for intelligent supervision of customer data based on the Internet of Things according to claim 4 is characterized in that: The single-side 3D reconstruction of the single-side image specifically comprises the following steps: A1, input image; A2, mask operation to extract the main body of the picture in the single-sided image; A3, image enhancement, in which the extracted image is enhanced using an exponential adjustment method; A4, surface model recovery, specifically includes the following steps: A41, surface model reconstruction; A42, gradient field information extraction, in which the intensity of pixel values ​​in the enhanced image is used as a clue to calculate the gradient field information of the leaves in the image; A43, discrete set processing; A44, surface model recovery, uses gradient field information to reconstruct the surface model of a single-sided image; A5, model macro structure optimization, using the image center axis curve constraint to optimize the macro geometry of the single-sided image model, specifically including the following steps: A51, macro geometry optimization; A52, image medial axis curve fitting, where the medial axis curve is taken from a single-sided image; A53, shape function constraint; A54, model macrostructure; A6, single-sided image macro structure optimization, finally the macro model optimizes the single-sided image model, and the single-sided image model and the macro structure model are integrated to generate the final single-sided image 3D model result; A7, output single-sided image 3D model.

6. The method for intelligent supervision of customer data based on the Internet of Things according to claim 5 is characterized in that: The single image recognition comprises the following working steps: B1, to fill the tiny holes in the strokes, use the flood fill algorithm to fill the background with white pixels, perform image negation on the filled image, and perform image XOR operation on the original image and the image after the negation operation. Through the above three steps, the tiny holes in the drawing strokes can be completely filled; B2, there are still isolated small dots in the stroke area, which can be eliminated by opening operation; B3, the stroke image is processed with three different weights of RGB to obtain a grayscale image. The calculation formula for grayscale processing is as follows: Gray=0.29*R+0.578*G+0.123*B Among them, R, G, B represent the values ​​of the three primary colors of the stroke segmentation image - red, green, and blue, and "Gray" represents the grayscale value; B4, in order to retain more stroke details, use median filtering to smooth the stroke outline and remove noise points, which specifically includes the following steps: B41, the pixel values ​​of the stroke image are divided into [1, 2, ..., l] levels, n i It is used to represent the number of image pixel values. Therefore, the calculation formula for the total pixel value of the stroke image is as follows: ; B42, where the frequency of a single pixel in the image is p i The calculation formula is as follows: ; B43, define two variables as the sum of the frequency values ​​of local variables w0 and w1. The relationship between the two is shown in the following formula: ; B45, the foreground pixel frequency u0 and background pixel frequency u1 of the stroke area image are as follows: , in ; B5, use the maximum inter-class variance method to perform binary processing on the image; B6, in order to measure the stroke length, the original morphological stroke algorithm is finally integrated to construct a thinning algorithm to obtain a single-pixel stroke line without burrs; B7, the single-pixel stroke lines obtained by combining are used to obtain the result of the single image to be identified.

7. The method for intelligent supervision of customer data based on the Internet of Things according to claim 6 is characterized in that: The specific steps of cutting a single image from a single-sided image include: C1, the connected region analysis method is used to perform the first segmentation of the single-face image to obtain each block; C2: Project each block to get the length of each block; C3: Define the width of a single character and record it as L. Use this as the threshold and transfer the blocks whose projection length is greater than the threshold to C4 for the second segmentation. C4: Use the initial point selection process to find the initial point, use the left descent algorithm, and use the improved permeation rule of the permeation process to segment. If the permeation is unsuccessful, it is considered that the permeation has entered a closed loop and go to C5, where the specific steps of the initial point selection process are C41, and the specific steps of the permeation process improvement are C42; C41 (1), first, at the inflection point of the glued digit or where it is connected, the pixels will be more concentrated than other places; these pixels represent the characteristics of the digits, we can call them key points; select the leftmost and rightmost points, these two points must be located on both sides of the glued digit, representing the characteristics of the two digits respectively; C41 (2), assuming that BB is a connected component, and the distance between the leftmost point and the rightmost point is BD; take 1 / 3 of BD to intersect with the connected component. Since the number of intersection points may be greater than one, select the top point and name it point a; C41 (3), if the right point or upper right point of point a is a black point, then this point will replace point a and become the new point a, until its right point or upper right point is a white point; at this time, the latest point a is the extreme point of this area; C41 (4), if the horizontal position of the latest point a is less than 2 / 3 of BD, it means that the latest point a is the extreme point of the left part of the connected component; then the latest point a is used as the starting point of the permeation process; otherwise, if the horizontal position of the latest point a is greater than 2 / 3 of BD, it means that the initial point a is on the connecting line of adjacent numbers; then the initial point a is used as the starting position of the permeation process; C42, the penetration process improvement rules can be described as: Rule 1: if n1=0 and n3 =0, then next_pixel = n3 Rule 2: if n1=0 and n2 =1, then next_pixel = n1 Rule 3: if n1=0, then next_pixel = n1 Rule 4: if n6=1 and n7 =0, then next_pixel = n7 Where 0 is a white pixel, 1 is a black pixel, n1 is the pixel to the left of the current pixel, n2 is the pixel to the lower left of the current pixel, n3 is the pixel below the current pixel, n4 is the pixel to the lower right of the current pixel, n5 is the pixel to the right of the current pixel, n6 is the pixel to the upper left of the current pixel, and n7 is the pixel above the current pixel; C5: The upper part uses the left-down algorithm and stops immediately after the first penetration. The trajectory is recorded as P1. The lower part uses the left-upward algorithm. Same as before, it stops immediately after the first penetration. The trajectory is recorded as P2. The intersection points of the trajectory and the contact number are recorded as p1 and p2. A shortest path connecting p1 and p2 is found on the contour of the contact number. The connecting trajectory is recorded as P3. C6: The final complete image cutting trajectory includes P1, P2 and P3.

Citation Information

Patent Citations

  • A multi-view solid geometry method based on image details and structure enhancement

    CN109816781A

  • Method for automatically generating three-dimensional model based on two-dimensional hand-drawn image feature

    CN110544300A

  • Signature identification method and device

    CN111985319A

  • Three-dimensional model generation method and device based on single freehand sketch and electronic equipment

    CN113129447A

  • Image processing method and device, equipment and computer readable storage medium

    CN113821663A