Surface pressure analyzer, method, program, and recording medium

Abstract

To provide a surface pressure analyzer, method, and program that can automatically evaluate surface pressure applied to a control surface of an object to be measured and support a tester who determines passing or failing of the object to be measured.SOLUTION: An image acquisition unit 210A of a server functioning as a surface pressure analyzer acquires an inspection image 10 from a user terminal. The inspection image 10 is a photographed image of a pressure measuring sheet that is arranged on a control surface of an object to be measured and develops colors in a density distribution according to the intensity of pressure applied to the control surface. A conversion unit 222 converts a density value of the inspection image 10 into a first pressure value distributed in a two-dimensional manner. An evaluation information generation processing unit 224 compares the first pressure value with a boundary sample read out from a memory 240, and generates information indicating the degree of coincidence of both values (evaluation information) as a primary determination result. The primary determination result is output (transmitted) from an output unit 210B to the user terminal and displayed on a display of the user terminal.SELECTED DRAWING: Figure 9

Description

[Technical Field]

[0001] The present invention relates to a surface pressure analysis device, method, program and recording medium, and more particularly to a technique for analyzing and evaluating a two-dimensionally distributed surface pressure applied to an inspection surface of a measurement object. [Background technology]

[0002] A known method for measuring the two-dimensionally distributed pressure applied to the test surface of an object is to use a pressure measurement sheet with a microcapsule layer containing a color former. One example of such a pressure measurement film is "Prescale" (product name) available from Fujifilm Corporation.

[0003] The pressure measurement sheet placed on the test surface of the object to be measured develops a color with a density distribution corresponding to the surface pressure applied to the test surface. The inspector visually checks the colored pressure measurement sheet to determine whether the surface pressure applied to the test surface of the object to be measured passes or fails.

[0004] Furthermore, Patent Document 1 proposes a pressure measurement method that, when measuring the maximum pressure applied to a point or line contact portion of an object to be measured using a pressure measurement sheet, is capable of measuring a maximum pressure that is greater than the pressure range that can be measured using the pressure measurement sheet.

[0005] In this pressure measurement method, an elastic sheet is sandwiched between the test surface of the object to be measured and the pressure measurement sheet, dispersing the pressure applied to the point or line contact area of ​​the object to be measured. The colored pressure measurement sheet is then scanned with a scanner, and the scanned image (test image) is cut out along a line that crosses the point or line contact area, and the cut-out image is converted into a pressure value corresponding to its shading. The pressure distribution of the converted pressure values ​​is then used to calculate and estimate the maximum pressure that would normally be applied to the point or line contact area of ​​the object to be measured. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Application Laid-Open No. 2000-321152 Summary of the Invention [Problem to be solved by the invention]

[0007] However, when an inspector visually checks the color gradation that corresponds to the strength of pressure applied to a pressure measurement sheet and determines whether the surface pressure applied to the inspection surface of the measurement object passes or fails (i.e., whether the measurement object passes or fails), there is a problem that the judgment results vary depending on the inspector because the inspection is done visually, and it is desirable to standardize the judgment results so that they do not depend on the inspector.

[0008] Furthermore, Patent Document 1 describes a method of reading a colored pressure measurement sheet with a scanner and analyzing the image that has been read, but the pressure measurement method described in Patent Document 1 is a method of measuring a maximum pressure that is greater than the measurable pressure range of the pressure measurement sheet, and is not a method of automatically evaluating the surface pressure applied to the inspection surface of the object to be measured.

[0009] The present invention has been made in view of the above circumstances, and aims to provide a surface pressure analysis device, method, and program that can automatically evaluate the surface pressure applied to the inspection surface of a measurement object and assist an inspector in making a pass / fail judgment on the measurement object, etc. [Means for solving the problem]

[0010] In order to achieve the above object, the invention according to a first aspect is a surface pressure analysis device comprising a processor and a memory for storing reference information corresponding to an object to be measured, wherein the processor comprises a process for acquiring a first pressure value distributed two-dimensionally applied to an inspection surface of the object to be measured, a process for generating evaluation information for the surface pressure applied to the inspection surface of the object to be measured based on the acquired first pressure value and the reference information stored in the memory, and a process for outputting the generated evaluation information to a display.

[0011] According to the first aspect of the present invention, first pressure values ​​that are two-dimensionally distributed and applied to the inspection surface of the measurement object are acquired, and evaluation information generated based on these first pressure values ​​and reference information is output to a display, thereby supporting an inspector who makes a pass / fail judgment on the measurement object. That is, by referring to the evaluation information output to the display, the inspector can make a highly accurate pass / fail judgment on the measurement object, and also, when pass / fail judgments on the measurement object are made by multiple inspectors, the judgment results can be standardized.

[0012] In the surface pressure analysis device according to the second aspect of the present invention, the process of acquiring the first pressure value preferably includes a process of acquiring an inspection image from a camera that photographs the pressure measurement sheet that is placed on the inspection surface of the object to be measured and that develops color with a density distribution according to the surface pressure applied to the inspection surface, or a scanner that scans the pressure measurement sheet, and a process of converting the acquired inspection image into first pressure values ​​that are distributed two-dimensionally, and acquiring the converted first pressure value.

[0013] In the surface pressure analysis device according to the third aspect of the present invention, the process of acquiring the first pressure value preferably involves acquiring the first pressure value from a surface pressure distribution measuring instrument that includes a pressure sensor sheet placed on the inspection surface of the object to be measured and outputs the first pressure value that is distributed two-dimensionally based on an electrical signal corresponding to the surface pressure applied to the inspection surface that is output from the pressure sensor sheet.

[0014] In the surface pressure analysis device according to the fourth aspect of the present invention, it is preferable that the processor performs processing to generate an inspection image having a density distribution corresponding to the electrical signal based on the electrical signal corresponding to the surface pressure applied to the inspection surface.

[0015] In the surface pressure analysis device according to the fifth aspect of the present invention, the processor preferably displays the inspection image on the display.

[0016] In the surface pressure analysis device according to the sixth aspect of the present invention, the reference information is a limit sample having a second pressure value that should be distributed two-dimensionally on the inspection surface, and the process of generating the evaluation information preferably generates information indicating the degree of agreement between the acquired first pressure value and the limit sample as the evaluation information.

[0017] In the surface pressure analysis device according to the seventh aspect of the present invention, the reference information includes a preset tolerance range value, and the degree of match is at least one of the degree of match in area and the degree of match in shape between a first region where the first pressure value is within the tolerance range value and a second region where the second pressure value of the limit sample is within the tolerance range value.

[0018] In the surface pressure analysis device according to the eighth aspect of the present invention, the degree of coincidence of the areas is the ratio of the areas of the first region to the second region, and the higher this ratio, the higher the degree of coincidence of the areas.

[0019] In the surface pressure analysis device according to the ninth aspect of the present invention, the degree of shape agreement is the ratio of the area where the first region and the second region overlap to the area of ​​the second region. The higher this ratio, the higher the degree of shape agreement.

[0020] In the surface pressure analysis device according to the tenth aspect of the present invention, the degree of agreement is the degree of agreement between the first pressure value and the second pressure value at one or more determination locations on the inspection surface.

[0021] In the surface pressure analysis device according to an eleventh aspect of the present invention, the degree of agreement is a degree of agreement between the first pressure value and the second pressure value at each of the plurality of determination locations on the inspection surface, and the process of generating the evaluation information preferably generates, as the evaluation information, information indicating at least one degree of agreement among the degrees of agreement among the plurality of determination locations. For example, if the degree of agreement among the plurality of determination locations is low, the evaluation information can be one indicating a low degree of agreement.

[0022] In the surface pressure analysis device according to the twelfth aspect of the present invention, the degree of agreement is a product-sum calculation value of the absolute difference between the first pressure value and the second pressure value at a plurality of determination points on the inspection surface and a weighting coefficient for each of the plurality of determination points, thereby making it possible to obtain the degree of agreement taking into account information on whether or not a determination point is one to be emphasized.

[0023] In the surface pressure analysis device according to the thirteenth aspect of the present invention, it is preferable that the reference information is a preset tolerance value, and the process of generating the evaluation information generates, as the evaluation information, at least one of the area of ​​the first region where the first pressure value is within the tolerance value, and the ratio between the area of ​​the first region and the area of ​​the inspection surface. Note that the tolerance value can be appropriately set by user operation, for example, when a user (inspector) inspects an object to be inspected, and in this case, a limit sample is not required.

[0024] In the surface pressure analysis device according to a fourteenth aspect of the present invention, the reference information is determination location information indicating regions or positions of a plurality of determination locations on the measurement object, and the process of generating the evaluation information preferably identifies first pressure values ​​at the plurality of determination locations based on the determination location information, and generates information indicating the degree of agreement of the identified first pressure values ​​as the evaluation information. By setting a plurality of determination locations of interest on the inspection surface of the measurement object, the degree of agreement between the first pressure values ​​at the plurality of determination locations can be used as the evaluation information.

[0025] In the surface pressure analysis device according to a fifteenth aspect of the present invention, it is preferable that the reference information includes a threshold value set for the absolute difference between the pressures applied to the plurality of determination locations on the measurement object, and the process of generating the evaluation information calculates the absolute difference between the identified first pressure values ​​and generates, as the evaluation information, information indicating whether the calculated absolute difference is within the threshold value. If the absolute difference between the pressures applied to the plurality of determination locations is within the threshold value, it can be determined that the pressure difference applied to the plurality of determination locations is relatively low, and this can be used as the evaluation information of the pressures applied to the plurality of determination locations.

[0026] In the surface pressure analysis device according to the 16th aspect of the present invention, the reference information is judgment location information indicating an area or position indicating one or more judgment locations of the object to be measured, and an allowable range value preset corresponding to the judgment location information, and the process of generating the evaluation information preferably identifies a first pressure value at the judgment location based on the judgment location information, and generates the evaluation information based on the identified first pressure value and the allowable range value.

[0027] In the surface pressure analysis device according to the seventeenth aspect of the present invention, it is preferable that the processor performs a process of receiving, by user designation, judgment location information indicating an area or position indicating a judgment location of the object to be measured, and a process of registering the received judgment location information in a memory.

[0028] In the surface pressure analysis device according to the eighteenth aspect of the present invention, it is preferable that the processor generates an inspection image in which images corresponding to pressures within the first pressure range value and images exceeding the first pressure range value can be distinguished from each other. For example, the images corresponding to pressures within the first pressure range value and images exceeding the first pressure range value can be distinguished by color coding. Furthermore, the images exceeding the first pressure range value may be further color coded into images exceeding the low pressure side and images exceeding the high pressure side.

[0029] In the surface pressure analysis device according to the nineteenth aspect of the present invention, it is preferable that the processor performs a process of receiving a second pressure range value designated by a user, and when generating an inspection image, generates an inspection image in which the gradation width representing the shades of the images corresponding to the second pressure range value among the inspection images is expanded. For example, when a pressure range (second pressure range) that is desired to be checked in detail is received by user designation, the gradation width representing the shades of the images corresponding to the second pressure range value can be expanded, thereby emphasizing the shades of the images within the second pressure range value (enriching the gradation).

[0030] In the surface pressure analysis device according to the twentieth aspect of the present invention, the processor preferably performs a process of generating a three-dimensional image having a concave-convex shape corresponding to the magnitude of the first pressure value based on the inspection image, a process of receiving a rotation instruction for the three-dimensional image by a user operation, and rotates and moves the three-dimensional image on the display based on the received rotation instruction. This makes it possible to easily determine the intensity distribution of the first pressure value, the difference in intensity between adjacent regions, the gradient, etc. from the three-dimensional image.

[0031] In the surface pressure analysis device according to the 21st aspect of the present invention, the reference information is a limit sample having a second pressure value that should be distributed two-dimensionally on the inspection surface, and the process of generating the evaluation information preferably generates a superimposed image by superimposing an inspection image having a shading corresponding to the first pressure value on an image of the limit sample having a shading corresponding to the second pressure value, and uses the superimposed image as the evaluation information. This makes it easy to determine the overlapping and non-overlapping areas of both images.

[0032] In the surface pressure analysis device according to the 22nd aspect of the present invention, it is preferable that the inspection image to be superimposed on the image of the limit sample has a display color different from the display color of the image of the limit sample and is a transparent image having a transparency according to the first pressure value.

[0033] In the surface pressure analysis device according to the 23rd aspect of the present invention, it is preferable that the processor accepts the pass / fail judgment result of the inspection for each measurement object by user instruction and performs processing to store the inspection image for each measurement object and the supplementary information of the inspection including the pass / fail judgment result in the database. This makes it possible to view or print out the inspection image for each measurement object and the supplementary information of the inspection including the pass / fail judgment result as needed.

[0034] In the surface pressure analysis device according to the 24th aspect of the present invention, it is preferable that the incidental information includes, in addition to the pass / fail judgment result, one or more of identification information of the object to be measured, the type of pressure measurement sheet, and information on the inspector who instructed the inspection conditions, the type of pressure, and the pass / fail judgment result.

[0035] In the surface pressure analysis device according to the 25th aspect of the present invention, it is preferable that the processor has a trained model that has been machine-learned using a set of test images and pass / fail judgment results stored in a database as training data, and that the trained model outputs a pass / fail judgment result when an arbitrary test image is input. Note that the output of the pass / fail judgment result includes an output of the probability (certainty) of pass / fail.

[0036] A surface pressure analysis device according to a 26th aspect of the present invention preferably comprises a user terminal and a server that communicates with the user terminal, wherein the user terminal transmits an inspection image to the server, the server generates evaluation information for the inspection image upon receiving the inspection image from the user terminal and transmits the generated evaluation information to the user terminal, and the user terminal displays the evaluation information on a display of the user terminal upon receiving the evaluation information from the server. This allows the surface pressure analysis device to be configured as a system comprising user terminals of multiple users and a server, and the server can generate evaluation information for inspection images uploaded from each user terminal or collected from each user terminal, and provide this to the user.

[0037] The invention according to the 27th aspect is a surface pressure analysis method in which a processor analyzes a two-dimensionally distributed surface pressure applied to an inspection surface of a measurement object, and each process of the processor includes a step of acquiring a two-dimensionally distributed first pressure value applied to the inspection surface of the measurement object, a step of generating evaluation information for the surface pressure applied to the inspection surface of the measurement object based on the acquired first pressure value and reference information stored in a memory, and a step of outputting the generated evaluation information to a display.

[0038] The invention according to a 28th aspect is a surface pressure analysis program that causes a computer to implement a surface pressure analysis method for analyzing a surface pressure distributed two-dimensionally that is applied to an inspection surface of a measurement object, the surface pressure analysis method including the steps of acquiring a first pressure value distributed two-dimensionally that is applied to the inspection surface of the measurement object, generating evaluation information for the surface pressure applied to the inspection surface of the measurement object based on the acquired first pressure value and reference information stored in a memory, and outputting the generated evaluation information to a display. [Effects of the Invention]

[0039] According to the present invention, it is possible to automatically evaluate the surface pressure applied to the inspection surface of the object to be measured, and by outputting the automatically evaluated evaluation information on a display, it is possible to assist the inspector in making a pass / fail judgment on the object to be measured. [Brief explanation of the drawings]

[0040] [Figure 1] FIG. 1 is a schematic diagram showing the configuration of an embodiment of a surface pressure analysis device according to the present invention. [Figure 2] FIG. 2 is a conceptual diagram showing the preparations required before using this system. [Figure 3] FIG. 3 is a plan view showing a first embodiment of the calibration sheet. [Figure 4] FIG. 4 is a plan view showing a second embodiment of the calibration sheet. [Figure 5] FIG. 5 is a plan view showing a third embodiment of the calibration sheet. [Figure 6] FIG. 6 is a diagram showing an example of an image of a limit sample. [Figure 7] FIG. 7 shows the screen transition of the smartphone when photographing the pressure measurement sheet. [Figure 8] FIG. 8 is a diagram showing the transition of the smartphone screen from displaying the test image to displaying the test result. [Figure 9] FIG. 9 shows screen transitions on a smartphone when viewing test images, test results, and the like. [Figure 10] FIG. 10 is a block diagram showing the electrical configuration of the surface pressure analysis device shown in FIG. [Figure 11] FIG. 11 is a block diagram showing a first embodiment of a surface pressure analysis device according to the present invention. [Figure 12] FIG. 12 is a block diagram showing a second embodiment of the surface pressure analysis device according to the present invention. [Figure 13] FIG. 13 shows screen transitions on a smartphone when the shading of a captured inspection image is emphasized. [Figure 14] FIG. 14 is a conceptual diagram of the internal processing when enhancing the shading of an inspection image. [Figure 15] FIG. 15 shows screen transitions on a smartphone when a captured examination image is displayed in 3D. [Figure 16] FIG. 16 shows screen transitions on a smartphone when a captured inspection image and a limit sample are displayed superimposed on each other. [Figure 17] FIG. 17 is a block diagram showing a third embodiment of the surface pressure analysis device according to the present invention. [Figure 18] FIG. 18 is a diagram showing another screen transition on the smartphone from displaying an examination image to displaying an examination result. [Figure 19] FIG. 19 is a diagram showing an example of the test result summary report. [Figure 20] FIG. 20 is a flowchart showing an embodiment of the surface pressure analysis method according to the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0041] Hereinafter, preferred embodiments of a surface pressure analysis device, method, and program according to the present invention will be described with reference to the accompanying drawings.

[0042] [Summary of the Invention] FIG. 1 is a schematic diagram showing the configuration of an embodiment of a surface pressure analysis device according to the present invention.

[0043] The surface pressure analysis device shown in Figure 1 analyzes the two-dimensionally distributed surface pressure applied to the inspection surface of a measurement object and provides the evaluation results to the user. It is configured as a surface pressure analysis system consisting of a user terminal and a server.

[0044] Possible user terminals include, for example, a smartphone 100, a PC (Personal Computer) 160 connected to a scanner 150, and a PC 180 connected to a surface pressure distribution measuring instrument 170 including a pressure sensor sheet 170A. Application software for using the present system is installed on the smartphone 100, PC 160, and PC 180. In this example, the scanner 150 is connected to the PC 160 via a wire (a USB (Universal Serial Bus) cable), but it may be connected wirelessly, and similarly, the surface pressure distribution measuring instrument 170 may be connected to the PC 180 wirelessly.

[0045] The server 200 shown in FIG. 1 is made up of one or more servers including an authentication server, a Web server, a measurement processing engine, and an image database server.

[0046] <System Function Overview> The authentication server in the server 200 authenticates the function license of the user terminal. The function license includes the ability to read a pressure measurement sheet (prescale) with a camera, measure, view inspection history, and manage the system. When the user terminal is started up, the authentication server authenticates the functions to be used.

[0047] The web server accepts HTTP (Hyper Text Transfer Protocol) requests from user terminals and links with the measurement processing engine and image database server. Note that the communication protocol is not limited to HTTP; other communication protocols can also be used.

[0048] The measurement processing engine and image database server process the input prescaled image (inspection image) to convert it into pressure values, and then convert the pressure values ​​into a pressure value distribution. The inspection image may be input from a surface pressure distribution measuring instrument 170 having a pressure sensor sheet 170A.

[0049] The first pressure value indicating the pressure value distribution is compared with the limit sample, and the comparison result (evaluation information) is returned to the user terminal. The user (inspector)'s final judgment (pass / fail judgment result) is accepted from the user terminal, and the inspection image and pass / fail judgment result at that time are registered in the image database. In addition, the inspection history is registered in the history database.

[0050] The smartphone 100, which functions as a user terminal, photographs the pressure measurement sheet with a camera built into the smartphone 100. Here, the pressure measurement sheet is a film having a microcapsule layer containing a coloring agent, which is placed on the test surface of the object to be measured during use and develops color with a density distribution according to the strength of pressure applied to the test surface. In other words, the entire pressure measurement sheet is a sensor that detects pressure, and the density distribution of the color development on the pressure measurement sheet indicates the pressure value distribution.

[0051] The smartphone 100 transmits an image (inspection image) of the pressure measurement sheet taken by the camera to the server 200, receives evaluation information on the inspection image (pressure applied to the inspection surface) processed by the measurement processing engine of the server 200 from the server 200, and displays it on the display of the smartphone 100. The smartphone 100 also transmits to the server 200 the pass / fail judgment result made by the inspector.

[0052] The PC 160 is wirelessly connected to a scanner 150 that functions as another user terminal, and the scanner 150 functions as a camera for the smartphone 100. That is, the scanner 150 scans the color-developing surface of the pressure measurement sheet, acquires an image of the pressure measurement sheet (test image), and transfers the acquired test image to the PC 160. Other functions of the PC 160 are the same as those of the smartphone 100, so a description thereof will be omitted.

[0053] Furthermore, a PC 180 connected to a surface pressure distribution measuring instrument 170 functioning as another user terminal inputs pressure values ​​(first pressure values) distributed two-dimensionally from the surface pressure distribution measuring instrument 170 .

[0054] The surface pressure distribution measuring instrument 170 includes a pressure sensor sheet 170A placed on the inspection surface of the measurement object, and outputs a first pressure value distributed two-dimensionally to the PC 180 based on an electrical signal output from the pressure sensor sheet 170A in accordance with the surface pressure applied to the inspection surface. The pressure sensor sheet 170A has a large number of pressure-sensitive elements arranged in a matrix, and the surface pressure distribution measuring instrument 170 scans each pressure-sensitive element to output a first pressure value in accordance with the pressure applied to each pressure-sensitive element to the PC 180.

[0055] The PC 180 transmits the first pressure value acquired from the surface pressure distribution measuring instrument 170 to the server 200. Note that the first pressure value distributed two-dimensionally can be used as an inspection image by allocating the first pressure value to a gradation value of 0 to 255, for example, and therefore the PC 180 can convert it into an inspection image and transmit it to the PC 160.

[0056] <Advance preparation> FIG. 2 is a conceptual diagram showing the preparations required before using this system.

[0057] As shown in Figure 2, the user of each user terminal performs advance preparations corresponding to their respective user terminals. Note that advance preparations include preparations that are performed only the first time and preparations that are performed each time the inspection target object is changed.

[0058] The following describes the preparations to be made when the user terminal is a smartphone 100.

[0059] (1) Download application software compatible with this system from the server 200 or the like.

[0060] (2) Calibration method setting FIG. 3 is a plan view showing a first embodiment of the calibration sheet.

[0061] a) Start the camera on the application software and take a picture of the calibration sheet 2 shown in Figure 3.

[0062] Density charts 2A to 2D are provided at the four corners of the calibration sheet 2, and a rectangular frame 2E is provided in the center. Note that a pressure measurement sheet 1 corresponding to a limit sample or the like is appropriately placed within frame 2E of the calibration sheet 2 and photographed simultaneously, but this is not limiting, and the calibration sheet 2 and the pressure measurement sheet 1 corresponding to the limit sample or the like may be photographed separately and consecutively.

[0063] b) The images of the density charts 2A to 2D in the image of the calibration sheet 2 are automatically analyzed by application software.

[0064] c) Based on the analysis results of the images of the density charts 2A to 2D, the system sets the optimal calibration method (correction method for the captured image) for the camera of the smartphone 100 (capture environment).

[0065] The calibration sheet 2 is not limited to the first embodiment shown in FIG. 3, but may be, for example, a calibration sheet of a second embodiment or a calibration sheet of a third embodiment shown in FIGS. 4 and 5, respectively.

[0066] The calibration sheet 2-1 shown in Fig. 4 has density charts with one color gradation at each of the four corners. The calibration sheet 2-2 shown in Fig. 5 differs from the calibration sheet 2 shown in Fig. 3, which has density charts at each of the four corners, in that it has density charts at two diagonal corners.

[0067] (3) Registration of standard information The reference information corresponding to the object to be measured is information used when evaluating the surface pressure applied to the inspection surface of the object to be measured, and is, for example, a limit sample, judgment point information indicating an area or position indicating one or more judgment points on the inspection surface of the object to be measured, and a threshold value for evaluating the absolute difference (absolute value of the difference) of the pressure applied to multiple judgment points.

[0068] a) The pressure measurement sheet 1 corresponding to the limit sample (for example, the second pressure value to be distributed two-dimensionally on the inspection surface of the measurement object) is placed within the frame 2E of the calibration sheet 2 (see FIG. 2), and the pressure measurement sheet 1 is photographed together with the calibration sheet 2. Alternatively, the calibration sheet 2 and the pressure measurement sheet 1 corresponding to the limit sample or the like may be photographed separately and consecutively.

[0069] The captured image is corrected using the information on the calibration sheet 2 and registered as a limit sample. The information in the frame 2E on the calibration sheet 2 can be used to correct the image size and distortion of the limit sample.

[0070] b) The user selects and registers the area (position, region) to be inspected.

[0071] The area to be measured can be selected by marking it on the pressure measurement sheet 1 corresponding to the limit sample.

[0072] In addition to marking, the inspection range can be specified by image coordinate information, or the measurement target area can be registered using coordinates on the inspection image of the pressure measurement sheet 1 corresponding to the limit sample. Furthermore, position information can be specified from a CAD (computer-aided design) drawing of the area to be inspected.

[0073] FIG. 6 is a diagram showing an example of an image of a limit sample.

[0074] 6A shows a limit sample image 10-1 corresponding to an object to be inspected having a flat circular inspection surface. In this case, the user can specify an area indicating the judgment point of the object to be measured (for example, the outer edge of the circular inspection surface) using a user interface such as a display of the smartphone 100 on which the limit sample image 10-1 is displayed.

[0075] FIG. 6(B) is an image 10-2 of a limit sample corresponding to the gasket inspection object.

[0076] 6(B) has a ring-shaped inspection surface with four holes. In this case, the user can use the display of the smartphone 100, which displays the image 10-2 of the limit sample of the gasket, to specify the ring-shaped area of ​​the gasket as the area indicating the judgment point.

[0077] Also, as shown in Figure 6(B), the area around the four holes of the gasket can be marked on the limit sample image 10-2 and designated as the area to be inspected. Note that in Figure 6(B), the area to be inspected is designated with a circular marker, but it is not limited to this, and can also be designated with a rectangular marker or any closed curve.

[0078] Furthermore, in addition to the area indicating the determination point of the measurement object, positions (coordinates in the image) indicating one or more determination points may be specified. Also, registration of reference information such as a limit sample may be performed on the server 200 side.

[0079] On the other hand, when the PC 160 connected to the scanner 150 is a user terminal, the calibration method corresponding to the scanner 150 is selected by capturing an image of the calibration sheet 2 with the scanner 150. Also, when the PC 180 is connected to the surface pressure distribution measuring instrument 170, setting of the calibration method can be omitted.

[0080] Everything related to the inspection work, such as the above-mentioned shooting conditions, the correction method for the captured image, the reference information, the conditions for storing the pass / fail judgment results, and the conditions for viewing them, is defined as "inspection work."

[0081] <photograph> FIG. 7 shows the screen transition of the smartphone when photographing the pressure measurement sheet.

[0082] Select the "inspection work" defined in the advance preparation, select or enter the necessary information (part name of the object to be inspected, part number, inspection date, inspection method, etc.), and take a photo of the object to be inspected.

[0083] For example, as shown in FIG. 7A, the part name and part number of the inspection target object to be inspected are set using the display 120 of the smartphone 100.

[0084] Next, the pressure measurement sheet pressed against the inspection surface of the inspection object is photographed with the camera of the smartphone 100. The image photographed with the camera of the smartphone 100 is corrected using predefined photographing conditions and the like, and is displayed as an inspection image on the display 120 of the smartphone 100 as shown in FIG. 7(B).

[0085] When the smartphone 100 receives the instruction to transmit the test image, it transmits the captured test image to the server 200.

[0086] <Measurement and judgment support> FIG. 8 is a diagram showing the transition of the smartphone screen from displaying the test image to displaying the test result.

[0087] The display 120 of the smartphone 100 shown in FIG. 8(A) displays an inspection image similar to that shown in FIG. 7(B).

[0088] The server 200 measures and compares the test image transmitted from the smartphone 100 under conditions such as predefined reference information, and returns the measurement results (including evaluation information) to the smartphone 100 as the primary judgment results.

[0089] The display 120 of the smartphone 100 shown in FIG. 8B displays the primary determination result obtained by measuring and determining the test image by the server 200.

[0090] In the example shown in Fig. 8(B), the comparison result with the limit sample is displayed as the primary judgment result, for example, the degree of match with the pressure values ​​(first pressure values) distributed two-dimensionally on the inspection surface grasped from the inspection image, and an image showing the degree of match are displayed.

[0091] Here, the degree of correspondence can be, for example, at least one of the area and shape correspondence between a region (first region) where the first pressure value on the inspection surface grasped from the inspection image is within the allowable range value and a region (second region) where the pressure value (second pressure value) distributed on the limit sample is within the allowable range value.

[0092] The allowable range can be set in advance as reference information. For example, if a user uses an LW (a type of prescale capable of measuring pressures from 2.5 to 10 MPa) as a pressure measurement sheet (prescale) and wants to check the degree of agreement in particular at 5 to 6 MPa (= the user's allowable range value) (when the user wants to make a judgment based only on this pressure range value), 5 to 6 MPa is set as the allowable range value.

[0093] The degree of area agreement can be, for example, the ratio between the area of ​​the first region obtained from the inspection image and the area of ​​the second region obtained from the limit sample, and the degree of shape agreement can be the ratio between the area where the first region and the second region overlap and the area of ​​the second region.Furthermore, it is also possible to determine the degree of agreement by multiplying the area ratio by an acceptable range value.

[0094] In the example shown in Figure 8(B), "80% match" is displayed. Furthermore, among the images that exceed the tolerance range, images that exceed the upper limit and images that exceed the lower limit are displayed in different colors. The images in each color-coded region are displayed as images with the same shading as the inspection image.

[0095] This allows checking the area of ​​the inspection surface (inspection image) of the measurement object that satisfies the tolerance range value, and can be used as a reference for pass / fail judgment.

[0096] [Other matching and evaluation methods] Judgment point information indicating an area or position (coordinates on the inspection image) indicating one or more judgment points on the inspection surface of the object to be measured is set as reference information, and the degree of agreement can be the degree of agreement between a first pressure value at one or more judgment points on the inspection surface and a second pressure value at the same judgment points on the limit sample.

[0097] Furthermore, when degrees of match are obtained from a plurality of judgment locations, information indicating at least one of the degrees of match for each of the plurality of judgment locations may be generated as the primary judgment result (evaluation information). For example, if the degrees of match for even one of the plurality of judgment locations is low, the evaluation information may indicate a low degree of match.

[0098] The degree of coincidence can be calculated by multiplying and adding the absolute difference (absolute value of the difference) between the first pressure value and the second pressure value at multiple determination points on the inspection surface by a weighting coefficient for each of the multiple determination points. This makes it possible to calculate the degree of coincidence taking into account information on whether or not a determination point is one that should be emphasized.

[0099] Furthermore, a tolerance value may be set as the reference information without setting a limit sample. In this case, at least one of the area of ​​the first region on the inspection surface grasped from the inspection image where the first pressure value is within the tolerance value and the ratio of the area of ​​the first region to the area of ​​the inspection surface may be generated as evaluation information. Note that the tolerance value can be appropriately set by user operation, for example, when a user (inspector) inspects an object to be inspected.

[0100] Furthermore, determination location information indicating regions or positions indicating multiple determination locations on the measurement object can be set as the reference information. In this case, the first pressure values ​​at the multiple determination locations can be identified based on the determination location information, and information indicating the degree of agreement of the identified first pressure values ​​can be generated as evaluation information. For example, a user sets two determination locations of interest on the inspection surface of the measurement object, and if the first pressure values ​​at the two determination locations match or nearly match, the degree of agreement can be evaluated as high.

[0101] Furthermore, as the reference information, judgment location information indicating regions or positions indicating multiple judgment locations on the measurement object and a threshold value set for the absolute difference of the pressure applied to the multiple judgment locations on the measurement object can be set. In this case, first pressure values ​​at the multiple judgment locations can be identified based on the judgment location information, absolute differences between the identified first pressure values ​​can be calculated, and information indicating whether the calculated absolute difference is within the threshold value can be used as evaluation information. If the absolute difference between the pressures applied to the multiple judgment locations is within the threshold value, it can be determined that the pressure difference applied to the multiple judgment locations is relatively low, and this can be used as evaluation information for the pressures applied to the multiple judgment locations.

[0102] Furthermore, as the reference information, judgment location information indicating an area or position of one or more judgment locations on the measurement object, and a preset allowable range value corresponding to the judgment location information can be set. In this case, the first pressure value at the judgment location is identified based on the judgment location information, and evaluation information is generated based on the identified first pressure value and the allowable range value. For example, evaluation information can be generated indicating whether the first pressure value at one or more judgment locations that the user is paying attention to is within the preset allowable range value.

[0103] Returning to Fig. 8, an "OK" icon and an "NG" icon are displayed below the display 120 of the smartphone 100 shown in Fig. 8(B). The inspector refers to the test image shown in Fig. 8(A) and the primary judgment result by the server 200 shown in Fig. 8(B) to make a final judgment on the measurement object, i.e., pass / fail, and taps the "OK" icon if the result is pass or the "NG" icon if the result is fail.

[0104] In addition, in case it is not possible to determine either of the above, a "HOLD" icon may be provided to reserve the decision.

[0105] The pass / fail judgment result of the inspection for each measurement object based on a user instruction (operation of the "OK" icon, "NG" icon, etc.) is sent to the server 200 and stored as supplementary information of the inspection image in the image database in the server 200. Furthermore, it is preferable to store measurement results such as the primary judgment result in association with the inspection image in the image database or an associated database related to the image database.

[0106] The additional information of the inspection image includes, in addition to the pass / fail judgment result, one or more of the following: identification information of the object to be measured (part name, part number), type of pressure measurement sheet, and information on the inspector who instructed the inspection conditions, pressure type, and pass / fail judgment result.This additional information can be entered at the advance preparation stage and registered in server 200.

[0107] The types of pressure measurement sheets are types of pressure measurement sheets (prescales) with different measurable pressure ranges, such as low pressure (LW), medium pressure (MS), and high pressure (HS). Testing conditions include the temperature and humidity during use. The relationship between the color density of the pressure measurement sheet and pressure changes depending on the temperature and humidity, so the temperature and humidity conditions are used as correction information to determine the correct pressure. Pressure type refers to the way pressure is applied to the pressure measurement sheet, and includes instantaneous pressure, sustained pressure, etc.

[0108] <View history> FIG. 9 shows screen transitions on a smartphone when viewing test images, test results, and the like.

[0109] 9(B) displays an inspection image (original image) of a desired measurement object stored in the image database of the server 200. A user can use the smartphone 100 to search for the corresponding original image from the image database using identification information (part name, part number) of the desired measurement object, etc., and display the original image on the display 120.

[0110] In addition, the user can switch from the original image of the object to be measured displayed on the display 120 of the smartphone 100 shown in Figure 9(B) to the inspection results of the original image at the server 200 (Figure 9(A)), or to the additional information (text information) for the original image (Figure 9(C)).

[0111] That is, the user can request viewing from the smartphone 100 to the server 200, and have the original image showing the pressure distribution on the inspection surface of the desired measurement object displayed on the display 120 of the smartphone 100, and can also switch between displaying the original image and the inspection results, or between displaying the original image and the accompanying information.

[0112] [Electrical configuration of the surface pressure analysis device] FIG. 10 is a block diagram of the main parts showing the electrical configuration of the surface pressure analysis device shown in FIG. 1, and shows the case where a smartphone is used as the user terminal.

[0113] <Smartphone> The smartphone 100 includes, as its main components, a main control unit 101, a wireless communication unit 110, a display 120, an operation unit 140, and a camera 141. The smartphone 100 also includes a call unit and memories such as RAM (Random Access Memory), ROM (Read Only Memory), and flash ROM, but these are omitted from FIG.

[0114] The main control unit 101 includes a processor, and operates in accordance with a control program, application software, and control data stored in a memory, and controls each unit of the smartphone 100 in an integrated manner.

[0115] The main control unit 101 of the smartphone 100 has a program (application software) according to the present invention installed therein, and by executing this application software, it functions as a display control unit 101A, an image acquisition unit 101B, and a communication control unit 101C.

[0116] The display control unit 101A controls the display 120 to display various information input screens, inspection images captured by the camera 141, inspection results received from the server 200, etc., in accordance with user instructions from the operation unit 140.

[0117] When the camera 141 is started on this application software and an image of the pressure measurement sheet taken by the camera 141 is acquired from the camera 141, the image acquisition unit 101B corrects the image using the calibration method set in advance preparation and acquires an image (inspection image) that is independent of the model of the camera 141, the shooting conditions, etc.

[0118] Furthermore, when a pressure measurement sheet is placed on the calibration sheet 2 shown in FIG. 3 and photographed with the camera 141, the image acquisition unit 101B uses information such as the density charts 2A to 2D of the calibration sheet 2 and the rectangular frame 2E of the image acquired from the camera 141 to standardize the density, size and shape of the image of the pressure measurement sheet, and cuts out the image within the frame 2E to use it as a test image.

[0119] The communication control unit 101C transmits the inspection image acquired by the image acquisition unit 101B to the server 200 via the wireless communication unit 110 and the network 4, and acquires the primary judgment result measured and judged by the server 200 based on the inspection image via the network 4 and the wireless communication unit 110.

[0120] The display 120 is a touch panel display with a touch panel on the screen, and under the control of the main control unit 101, displays images, text information, etc. to visually convey information to the user, and also detects user operations on the displayed information.

[0121] The operation unit 140 is a hardware key using a key switch or the like, and receives instructions from a user. For example, the operation unit 140 includes a mechanical switch provided on the housing of the smartphone 100, as well as a "keyboard" icon, a "numeric keypad" icon, icon buttons, and the like displayed on the display 120.

[0122] The camera 141 can be used for various functions of the smartphone 100. When the camera 141 is activated on this application software, it is used to take a picture of a pressure measurement sheet for evaluating the pressure applied to the inspection surface of the measurement object.

[0123] <Server 200> The server 200 shown in FIG. 10 functions as the main part of the surface pressure analysis device or surface pressure analysis system, and is mainly composed of a communication unit 210, a CPU (Central Processing Unit) 220, an image database 230, and a memory 240.

[0124] The CPU 220 controls each unit of the server 200 and also functions as a measurement processing engine that generates a primary determination result (evaluation information) based on the inspection image in accordance with a surface pressure analysis program stored in the memory 240. The CPU 220 also transmits (replies to) the primary determination result acquired by the measurement processing engine via the communication unit 210 to the smartphone 100 (the smartphone 100 that transmitted the inspection image).

[0125] The image database 230 is a part that registers and manages inspection images of measurement objects received from a user terminal in association with identification information such as the part name and part number of the measurement object. The image database 230 also registers the final judgment (pass / fail judgment result) by the inspector received from the user terminal, as well as other information associated with the inspection image, such as the part name, part number, inspection date, type of pressure measurement sheet, inspection conditions, pressure type, and information about the inspector who instructed the pass / fail judgment result. Furthermore, the image database 230 may store the primary judgment result in association with the identification information of the measurement object.

[0126] The data set, which is stored and accumulated in the image database 230 and is a pair of the inspection image and the pass / fail judgment result, can be used as learning data. By using this learning data to train a learning model, a trained model can be created that judges the pass / fail of the inspection image (classifies the pass / fail judgment).

[0127] The memory 240 includes a memory in which an operating system and various programs including a surface pressure analysis program are stored, a memory for storing reference information corresponding to the object to be measured, such as limit samples, allowable range values, threshold values, and judgment location information indicating areas or positions indicating one or more judgment locations on the object to be measured, and a memory that serves as a working area for the CPU 220.

[0128] [First embodiment] FIG. 11 is a block diagram showing a first embodiment of a surface pressure analysis device according to the present invention, and is a functional block diagram showing the functions of the server 200 shown in FIG.

[0129] The surface pressure analysis device of the first embodiment shown in FIG. 1 mainly includes an image acquisition unit 210A, an output unit 210B, a conversion unit 222, an evaluation information generation processing unit 224, and a memory 240.

[0130] The image acquisition unit 210A acquires the inspection image 10 captured by the user terminal (FIG. 8(A)). The image acquisition unit 210A corresponds to the communication unit 210 of the server 200 that receives the inspection image 10 transmitted from the user terminal.

[0131] The conversion unit 222 has a conversion table or a conversion formula that indicates the relationship between pressure values ​​and density values, and converts the density values ​​of the inspection image 10 acquired by the image acquisition unit 210A into pressure values ​​using the conversion table or the conversion formula, thereby acquiring first pressure values ​​that are distributed two-dimensionally.

[0132] The evaluation information generation processing unit 224 is a processing unit based on the measurement processing engine, which compares the first pressure value output from the conversion unit 222 with a limit sample read from the memory 240, and generates information (evaluation information) indicating the degree of agreement between the two as a primary judgment result. Here, the limit sample is reference information having pressure values ​​(second pressure values) that should be distributed two-dimensionally on the inspection surface of the measurement object, and is set and registered in advance in the memory 240 by the user.

[0133] The primary judgment result generated by the evaluation information generation processing unit 224 is output (transmitted) from the output unit 210B to the user terminal and displayed on the display of the user terminal (FIG. 8(B)). This output unit 210B corresponds to the communication unit 210 of the server 200 that transmits the primary judgment result to the user terminal.

[0134] Thereafter, the inspector makes a pass / fail judgment, which is the final judgment on the measurement object, referring to the primary judgment result, etc., and when he taps the "OK" icon or the "NG" icon on the user terminal (smartphone 100), the pass / fail judgment result is sent to the server 200. The pass / fail judgment result, together with the inspection image, is registered in the image database 230 of the server 200 as supplementary information of the inspection image.

[0135] [Second embodiment] Fig. 12 is a block diagram showing a second embodiment of the surface pressure analysis device according to the present invention. In Fig. 12, parts common to those of the surface pressure analysis device of the first embodiment shown in Fig. 11 are given the same reference numerals, and detailed description thereof will be omitted.

[0136] The surface pressure analysis device of the second embodiment shown in FIG. 12 differs from the surface pressure analysis device of the first embodiment mainly in that an image database 230 and an inspection image processing unit 226 are added.

[0137] The inspection image 10 acquired by the image acquisition unit 210A is registered in the image database 230 and also added to the inspection image processing unit 226.

[0138] The inspection image processing unit 226 is one of the processing units of the measurement processing engine, and reads out the allowable range value as reference information corresponding to the inspection image 10 from the memory 240 .

[0139] The inspection image processing unit 226 determines, within the inspection image 10, areas where the first pressure value converted from the inspection image 10 falls within the first pressure range and areas where the first pressure value exceeds the first pressure range (areas where the first pressure value exceeds the upper and lower limits of the first pressure range), and makes the images of these areas distinguishable. Specifically, the color (hue) of the images of these areas is changed, for example, the image of the area where the first pressure value falls within the first pressure range is colored magenta, the image of the area where the first pressure value exceeds the upper limit of the first pressure range is colored yellow, and the image of the area where the first pressure value exceeds the lower limit of the first pressure range is colored green. The first pressure range can be set in advance by the user and stored in the memory 240, or it can be set to the same value as the allowable range.

[0140] The image color-coded by the inspection image processing unit 226 is output to the user terminal via the output unit 210B and displayed on the display of the user terminal (FIG. 8(B)). By visually checking the color-coded image, the inspector can confirm the area of ​​the pressure applied to the inspection surface of the measurement object that satisfies the allowable range value, and can use it as a reference for making a pass / fail judgment, which is the final judgment on the measurement object.

[0141] <Highlighting of pressure distribution> FIG. 13 is a diagram showing the screen transitions of a smartphone when emphasizing the shading of a photographed inspection image, and FIG. 14 is an image diagram of the internal processing when emphasizing the shading of an inspection image.

[0142] 13(A) shows the test image as it is displayed on the display 120 of the smartphone 100. The test image in this case is an image that develops color according to the pressure distribution applied to the pressure measurement sheet.

[0143] Now, it is assumed that the inspection image shown in FIG. 13(A) has a gradation width (tone) of 0 to 255 assigned to correspond to 1 to 10 MPa on the pressure scale on the left side of FIG.

[0144] In contrast, if the pressure distribution applied to the inspection surface of the object to be measured is 1 to 4 MPa, or if the user wants to make a judgment based only on 1 to 4 MPa, the inspection image shown in Figure 13(A) has a narrow gradation width corresponding to 1 to 4 MPa, making it difficult to confirm the pressure change rate (degree of uneven contact), etc.

[0145] In this case, it is preferable to widen the gradation width corresponding to 1 to 4 MPa shown on the left side of FIG. 14, as shown on the right side of FIG.

[0146] To expand the gradation width, the knobs 122U and 122D of the slide bar 122 displayed on the display 120 of the smartphone 100 are operated to set the pressure range value (second pressure range value) for which the gradation range is to be expanded.

[0147] The display control unit 101A (Figure 10) of the smartphone 100 accepts the second pressure range value specified by the user, and when generating a test image, generates a test image in which the gradation width representing shades is expanded for images among the test images that correspond to within the second pressure range value, and displays the test image with the expanded gradation width on the display 120.

[0148] As a result, of the color gradations that occur according to the strength of the pressure applied to the pressure measurement sheet, the gradations within the desired pressure range are emphasized, thereby assisting the user in making a pass / fail judgment.

[0149] <3D display of pressure distribution> FIG. 15 shows screen transitions on a smartphone when a captured examination image is displayed in 3D.

[0150] 15(A) shows the test image displayed in 2D (D: Dimension) on the display 120 of the smartphone 100. The test image displayed in 2D shows the strength of pressure (pressure distribution) by the shading of the image.

[0151] The display 120 shown in FIG. 15(A) displays a "tilt display" icon, and when this "tilt display" icon is tapped, the screen switches to one that displays the examination image in 3D, as shown in FIG. 15(B).

[0152] FIG. 15(B) shows the test image displayed in 3D on the display 120 of the smartphone 100.

[0153] The 3D-displayed inspection image is configured as a three-dimensional image (3D image) having a concave and convex shape corresponding to the magnitude of the pressure value (first pressure value) corresponding to the density distribution of the inspection image. It is preferable that each pixel corresponding to the inspection surface of the 3D image has the same density information as each pixel of the 3D-displayed inspection image.

[0154] This 3D image may be generated by the display control unit 101A (FIG. 10) of the smartphone 100 or may be generated by the server 200 and received by the smartphone 100.

[0155] The display control unit 101A of the smartphone 100 has a function as a 3D viewer, and when the "tilt display" icon is tapped, the display control unit 101A displays the test image in 3D on the display 120. Then, when the display control unit 101A receives an instruction to rotate the 3D image by a touch operation on the display 120 (for example, an operation of touching the screen and sliding a finger in any direction), the display control unit 101A performs display control to rotate and move the 3D image on the display 120 based on the received rotation instruction.

[0156] By displaying the test image in 3D in this way, the user can intuitively confirm the gradient of the pressure distribution, etc.

[0157] In addition, a 3D image showing the second pressure value of the limit sample may be generated, and the 3D image showing the first pressure value of the inspection image and the 3D image showing the second pressure value of the limit sample may be displayed on the display 120 of the smartphone 100 so that they can be compared.

[0158] <Overlay display of inspection image and limit sample> FIG. 16 shows screen transitions on a smartphone when a captured inspection image and a limit sample are displayed superimposed on each other.

[0159] 16(A) shows a captured test image displayed on the display 120 of the smartphone 100. The test image displayed on the display 120 indicates the strength of pressure (pressure distribution) by varying the shading of the image.

[0160] FIG. 16(B) shows the test image and the limit sample image to be combined.

[0161] The image of the limit sample is a limit sample having a second pressure value that should be distributed two-dimensionally on the inspection surface of the measurement object, and is an image with a shade corresponding to the second pressure value. It is preferable that the inspection image to be combined with this limit sample has a display color different from the display color of the image of the limit sample.

[0162] Furthermore, it is preferable that the test image has a transparency corresponding to the shading of the test image (i.e., the first pressure value). The transparency can be set based on the brightness (shading) of each pixel of the test image, so that lighter colored areas have a higher transparency and are set to be transparent, and darker colored areas have a lower transparency and are set to be opaque.

[0163] The inspection image processing unit 226 (Figure 12) of the server 200 generates a transmission image from the input inspection image 10, which has a display color different from the display color of the limit sample image and has a transparency corresponding to the first pressure value, and generates a superimposed image by superimposing the generated transmission image on the limit sample image.

[0164] When superimposing a transmission image and an image of a limit sample, it is preferable to extract multiple feature points of the transmission image and multiple feature points of the image of the limit sample, determine corresponding feature points, and superimpose the transmission image by projective transformation so that the corresponding feature points match. Furthermore, if the size and shape of the inspection image and the image of the limit sample are normalized, the transmission image may be translated and rotated so that it most closely matches the image of the limit sample.

[0165] The inspection image processing unit of the server 200 transmits the superimposed image generated as described above as evaluation information to the smartphone 100 via the output unit 210B.

[0166] FIG. 16C shows a state in which the superimposed image transmitted from the server 200 is displayed on the display 120 of the smartphone 100.

[0167] The inspector refers to the inspection image shown in Figure 16(A) as well as the superimposed image of the inspection image and the limit sample image shown in Figure 16(C) to determine the final pass / fail judgment for the object to be measured, and taps the "OK" icon if it passes, or the "NG" icon if it fails.

[0168] The pass / fail judgment result of the inspection for each measurement object instructed by the user is transmitted to the server 200 and stored in the image database 230 in the server 200 as supplementary information of the inspection image.

[0169] [Third embodiment] Fig. 17 is a block diagram showing a third embodiment of the surface pressure analysis device according to the present invention. In Fig. 12, parts common to those of the surface pressure analysis device of the first embodiment shown in Fig. 11 are given the same reference numerals, and detailed description thereof will be omitted.

[0170] The surface pressure analysis device of the third embodiment shown in FIG. 17 differs from the surface pressure analysis device of the first embodiment mainly in that a trained model 228 is added.

[0171] The inspection image 10 acquired by the image acquisition unit 210A is input to the trained model 228.

[0172] The trained model 228 uses a data set that pairs test images stored in the image database 230 (Figure 10) with pass / fail judgment results (correct answer data), which are one of the additional information for the test images, as training data, and trains the learning model by machine learning to make a pass / fail judgment for the input test image.

[0173] As a learning model, a CNN model configured with a convolutional neural network (CNN) can be considered, and representative learning models such as VGG16 and Alex Net can also be applied.

[0174] The pass / fail judgment result determined by the trained model 228 is transmitted to the smartphone 100 via the output unit 210B.

[0175] FIG. 18 is a diagram showing another screen transition on the smartphone from displaying an examination image to displaying an examination result.

[0176] The display 120 of the smartphone 100 shown in FIG. 18(A) displays an inspection image similar to that shown in FIG. 8(A).

[0177] The server 200 uses the test image sent from the smartphone 100 as an input image for the trained model 228 (Figure 17) and returns to the smartphone 100 the pass / fail judgment result determined by the trained model 228, etc.

[0178] 18(B) displays the primary judgment result for the test image, which is judged by the server 200. In the example shown in FIG. 18(B), "OK!" and "Pass" are displayed as the primary judgment result.

[0179] Furthermore, since the trained model 228 can obtain a classification result (probability of pass / fail classification) for the input test image, classifying it into two categories, "pass" and "fail," the server 200 may transmit this determination probability to the smartphone 100 and display the "probability" of pass for the measured object on the display 120 of the smartphone 100.

[0180] In addition, in Figure 10 and the first to third embodiments, the user terminal that communicates with the server 200 is the smartphone 100, but this is not limited to this, and the user terminal may be a PC 160 connected to a scanner 150 as shown in Figure 1, or a PC 180 connected to a surface pressure distribution measuring instrument 170 including a pressure sensor sheet 170A, etc.

[0181] [Issuance of inspection result summary report] The server 200 can issue (transmit) an examination result summary report to a user terminal such as the smartphone 100, PC 160, or PC 180. That is, the user terminal can access the server 200, download the examination result summary report from the image database 230, etc., and output it to a printer or a display.

[0182] Fig. 19 is a diagram showing an example of an inspection result summary report. The inspection result summary report shown in Fig. 19 includes items such as inspection date, part number, inspection method, pass / fail result, inspector name, approver name, and document number.

[0183] The server 200 can also output statistical information reports such as the success rate (such as the pass rate) during the inspection history period and the progress of success rate by day. The report output may also be data output in text format.

[0184] In the above embodiments, the user terminal is described as being a smartphone 100 having application software corresponding to the present system installed thereon. However, the present invention is not limited to this, and it goes without saying that the present invention can also use other user terminals such as PC 160, PC 180, etc., having application software corresponding to the present system shown in FIG. 1 installed thereon.

[0185] [Surface pressure analysis method] Fig. 20 is a flowchart showing an embodiment of the surface pressure analysis method according to the present invention. The processing of each step shown in Fig. 20 is performed by a processor including, for example, the smartphone 100 of the surface pressure analysis device shown in Fig. 10 and the CPU 220 of the server 200.

[0186] 20, a user uses the smartphone 100 to photograph the pressure measurement sheet with the camera 141 of the smartphone 100 (step S10). The photographed pressure measurement sheet is colored with a density distribution according to the surface pressure applied to the inspection surface of the measurement object.

[0187] When an instruction to transmit the inspection image 10 captured by the camera 141 is received through a user operation, the smartphone 100 transmits the inspection image 10 to the server 200 (step S12).

[0188] The processor of the server 200 performs a process of converting the inspection image 10 transmitted from the smartphone 100 into pressure values ​​(first pressure values ​​distributed two-dimensionally) corresponding to the shading of the inspection image 10 (step S14).

[0189] Next, the processor performs a process to generate evaluation information for the surface pressure applied to the inspection surface of the measurement object based on the first pressure value and preset reference information (e.g., a limit sample) (step S16). The evaluation information can be information indicating the degree of match between the first pressure value converted from the inspection image 10 and the second pressure value of the limit sample. Furthermore, if the user wants to check the degree of match within a preset tolerance range, the evaluation information can be the degree of match in area and / or shape between a first region on the inspection surface grasped from the inspection image 10 where the first pressure value falls within the tolerance range and a second region on the limit sample where the second pressure value falls within the tolerance range.

[0190] The processor transmits the generated evaluation information to the smartphone 100 (step S18). As a result, the evaluation information is displayed on the display 120 of the smartphone 100 (step S20).

[0191] The inspector can make a final pass / fail judgment of the object to be measured by referring to the evaluation information (first judgment result) displayed on the display 120. This pass / fail judgment result is transmitted from the smartphone 100 to the server 200 and managed as supplementary information of the inspection image 10 in the image database 230.

[0192] In this way, the inspector makes a pass / fail judgment on the measured object by referring to the primary judgment result provided by server 200, which enables a highly accurate pass / fail judgment on the measured object, and also makes it possible to standardize the judgment results when multiple inspectors make pass / fail judgments on the measured object.

[0193] [others] 1 and 10 is configured as a surface pressure analysis system consisting of a user terminal and a server, but is not limited to this and may be configured as a server alone or a user terminal alone (standalone). In this case, the user terminal needs to be equipped with the various processing functions that were previously performed by the server by installing a surface pressure analysis program.

[0194] Furthermore, the hardware realizing the surface pressure analysis device according to the present invention can be configured with various processors. The various processors include a CPU (Central Processing Unit), which is a general-purpose processor that executes programs and functions as various processing units; a programmable logic device (PLD), such as an FPGA (Field Programmable Gate Array), whose circuit configuration can be changed after manufacture; and a dedicated electrical circuit, such as an ASIC (Application Specific Integrated Circuit), which is a processor having a circuit configuration specifically designed to execute specific processes. A processing unit constituting the surface pressure analysis device may be configured with one of the various processors described above, or may be configured with two or more processors of the same or different types. For example, a processing unit may be configured with multiple FPGAs or a combination of a CPU and an FPGA. Alternatively, multiple processing units may be configured with a single processor. A first example of configuring multiple processing units with a single processor is a configuration in which one or more CPUs and software are combined to form a single processor, as typified by a computer such as a client or server, and this processor functions as multiple processing units. Second, there is a form using a processor that realizes the functions of an entire system including multiple processing units on a single IC (Integrated Circuit) chip, as typified by a System on Chip (SoC). In this way, various processing units are configured as a hardware structure using one or more of the above-mentioned various processors. Furthermore, the hardware structure of these various processors is more specifically an electric circuit that combines circuit elements such as semiconductor elements.

[0195] The present invention also includes a surface pressure analysis program that, when installed in a computer, causes the computer to function as the surface pressure analysis device according to the present invention, and a storage medium on which this surface pressure analysis program is recorded.

[0196] Furthermore, it goes without saying that the present invention is not limited to the above-described embodiment, and various modifications are possible without departing from the spirit of the present invention. [Explanation of symbols]

[0197] 1 Pressure measurement sheet 2, 2-1, 2-2 Calibration Sheet 2A~2D Density Chart 2E frame 4 Network 10 Inspection images 10-1, 10-2 images 100 smartphones 101 Main control unit 101A Display control unit 101B Image acquisition section 101C Communication control unit 110 Radio Communication Department 120 Display 122 Slide Bar 140 Operation section 141 Camera 150 scanner 160, 180 PCs 170 Surface pressure distribution measuring device 170A Pressure Sensor Sheet 200 servers 210 Communications Department 210A Image acquisition unit 210B Output section 220 CPU 222 Conversion Unit 224 Evaluation information generation processing unit 226 Inspection image processing section 228 trained models 230 Image Database 240 memory S10~S20 steps

Claims

1. A surface pressure analysis device equipped with a processor, The processor: acquiring a first pressure value that is two-dimensionally distributed and that is applied to an inspection surface of a measurement object that is an article; acquiring reference information related to the measurement object, the reference information being used to evaluate the first pressure value; generating evaluation information for the first pressure value based on the first pressure value and the reference information; Surface pressure analysis device.

2. the processor performs processing to display the evaluation information. The surface pressure analysis device according to claim 1 .

3. The processor generates supplementary information including information for identifying the measurement object. The surface pressure analysis device according to claim 1 or 2.

4. The processor performs processing to display the supplementary information. The surface pressure analysis device according to claim 3 .

5. The evaluation information is information used as a reference for a user to determine whether the object to be measured is acceptable or not. The surface pressure analysis device according to any one of claims 1 to 4.

6. the reference information is determination location information indicating regions or positions of a plurality of determination locations on the measurement object, and an allowable range value indicating a pressure range value preset corresponding to the determination location information, the processor identifies the first pressure value at the determination location based on the determination location information, and generates the evaluation information based on the identified first pressure value and the allowable range value. The surface pressure analysis device according to any one of claims 1 to 5.

7. the reference information is determination point information indicating regions or positions indicating a plurality of determination points of the measurement object, the processor identifies a plurality of the first pressure values ​​at a plurality of the determination locations based on the determination location information, and generates, as the evaluation information, information indicating a degree of agreement between the identified plurality of first pressure values. The surface pressure analysis device according to any one of claims 1 to 5.

8. The processor obtaining the first pressure value includes: a pressure measurement sheet to be placed on the inspection surface of the measurement object, the pressure measurement sheet being colored with a density distribution according to the surface pressure applied to the inspection surface, and an inspection image being acquired from a camera that photographs the pressure measurement sheet or a scanner that scans the pressure measurement sheet; converting the acquired inspection image into the first pressure values ​​distributed two-dimensionally; The surface pressure analysis device according to any one of claims 1 to 7.

9. The processor obtaining the first pressure value includes: The first pressure value is acquired from a surface pressure distribution measuring device that includes a pressure sensor sheet disposed on an inspection surface of the measurement object, and outputs the first pressure value that is two-dimensionally distributed based on an electrical signal output from the pressure sensor sheet in accordance with the surface pressure applied to the inspection surface. The surface pressure analysis device according to any one of claims 1 to 7.

10. the processor generates an inspection image having a density distribution according to an electrical signal corresponding to a surface pressure applied to the inspection surface. The surface pressure analysis device according to claim 9.

11. The processor performs processing to display the inspection image. The surface pressure analysis device according to claim 8 or 10.

12. the processor generates the inspection image in such a way that images corresponding to pressures within a first range value and images exceeding the first range value can be distinguished from the inspection image. The surface pressure analysis device according to claim 8, 10 or 11.

13. The processor: Accepting a second pressure range value designated by the user; When generating the inspection image, a gradation width representing shades is expanded for an image corresponding to a second pressure range value among the inspection images to generate the inspection image. The surface pressure analysis device according to claim 8, 10 or 11.

14. The processor: generating a three-dimensional image having a concave-convex shape corresponding to the magnitude of the first pressure value based on the inspection image; receiving a rotation instruction for the three-dimensional image through a user operation; rotating and moving the three-dimensional image on a display based on the received rotation instruction; The surface pressure analysis device according to claim 8, 10 or 11.

15. the processor accepts a pass / fail judgment result of the inspection for each of the measurement objects in accordance with a user instruction, and performs a process of storing the inspection image for each of the measurement objects and supplementary information of the inspection including the pass / fail judgment result in a database. The surface pressure analysis device according to claim 8, 10 or 11.

16. The additional information includes, in addition to the pass / fail judgment result, one or more of identification information of the measurement object, the type of pressure measurement sheet, inspection conditions, pressure type, and information on the inspector who instructed the pass / fail judgment result. The surface pressure analysis device according to claim 15.

17. the processor has a trained model that has been machine-learned using the set of the inspection image and the pass / fail judgment result stored in the database as training data; The trained model outputs a pass / fail judgment result when an arbitrary inspection image is input. The surface pressure analysis device according to claim 15 or 16.

18. The system comprises a user terminal and a server that communicates with the user terminal, The user terminal transmits the inspection image to the server; When the server receives the inspection image from the user terminal, the server generates the evaluation information for the inspection image and transmits the generated evaluation information to the user terminal; When the user terminal receives the evaluation information from the server, the user terminal displays the evaluation information on the user terminal. The surface pressure analysis device according to claim 8 or 10.

19. A surface pressure analysis method for analyzing a two-dimensionally distributed surface pressure applied to an inspection surface of a measurement object, which is an article, by a processor, comprising: acquiring a first pressure value that is applied to an inspection surface of the measurement object and that is distributed two-dimensionally; acquiring reference information related to the measurement object, the reference information being used to evaluate the first pressure value; generating evaluation information for the first pressure value based on the first pressure value and the reference information; A surface pressure analysis method including:

20. A surface pressure analysis program that causes a computer to realize a surface pressure analysis method for analyzing a two-dimensionally distributed surface pressure applied to an inspection surface of a measurement object, which is an article, comprising: The surface pressure analysis method includes: acquiring a first pressure value that is applied to an inspection surface of the measurement object and that is distributed two-dimensionally; acquiring reference information related to the measurement object, the reference information being used to evaluate the first pressure value; generating evaluation information for the first pressure value based on the first pressure value and the reference information; Surface pressure analysis program including.

21. A non-transitory computer-readable recording medium having the program according to claim 20 recorded thereon.

Images