How to estimate tire measurements

Abstract

To provide a method for efficiently estimating a measurement value of a tire.SOLUTION: A method for estimating a measurement value of a tire includes: acquiring a tire cross sectional image showing a cross sectional structure of the tire; inputting the acquired tire cross sectional image to a learned machine learning model; deriving an output from the learned machine learning model; and estimating position information of one or a plurality of measurement points at the cross section of the tire on the basis of the output.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a method, a program, and an apparatus for estimating tire measurement values, and a method for generating a trained model. [Background technology]

[0002] Patent Document 1 discloses a method for quantifying a tire's meridian cross section. In this method, in order to create a tire model to be used for simulations, etc., an image of the tire's outline and an image of the tire's internal structure are extracted from an image of the tire's meridian cross section, and then these are superimposed to obtain a composite tire cross section image. From this tire cross section image, the coordinates of the outline of the tire cross section image and internal structures such as belts are obtained. According to Patent Document 1, the "tire meridian cross section" is a cross section of the tire when cut on a plane that is parallel to and passes through the tire's rotation axis. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2007-179194 A Summary of the Invention [Problem to be solved by the invention]

[0004] According to Patent Document 1, the tire cross-sectional image is digitized using a pointing device such as a digitizer or a mouse. In other words, to obtain coordinates on the tire cross-sectional image, a person must trace the composite image and specify a position on the composite image. Therefore, when it is desired to digitize position information of a specific point on the actual tire cross-section and thereby estimate a measurement value of a specific location, a person must accurately specify a point on the tire cross-sectional image that corresponds to the specific point, which is a heavy burden and not efficient.

[0005] The present invention aims to provide an efficient method, program, and device for estimating tire measurement values, as well as a method for generating a trained model. [Means for solving the problem]

[0006] A method for estimating a tire measurement according to the present disclosure includes: Acquiring a tire cross-sectional image showing the cross-sectional structure of the tire Inputting the acquired tire cross-sectional image into a trained machine learning model. Deriving an output from the trained machine learning model. Estimating position information of one or more measurement points on a cross section of the tire based on the output.

[0007] The method may further include estimating a distance between two predetermined points among the plurality of measurement points.

[0008] In the above method, the measurement points may be indicated by markers provided on the cross section of the tire represented by the tire cross section image.

[0009] In the above method, the tire cross-sectional image may be an image representing a cross-sectional structure when the tire is cut along a plane including a rotation axis of the tire.

[0010] The tire measurement value estimation program according to the present disclosure causes a computer to execute the following: Acquiring a tire cross-sectional image showing the cross-sectional structure of the tire Inputting the acquired tire cross-sectional image into a trained machine learning model. Deriving an output from the trained machine learning model. Estimating position information of one or more measurement points on a cross section of the tire based on the output.

[0011] The tire measurement value estimation device according to the present disclosure includes an image acquisition unit, a storage unit, a derivation unit, and an estimation unit. The image acquisition unit acquires a tire cross-sectional image representing a cross-sectional structure of the tire. The storage unit stores a trained machine learning model. The derivation unit inputs the acquired tire cross-sectional image to the trained machine learning model and derives an output from the trained machine learning model. The estimation unit estimates position information of one or more measurement points on the tire cross-section based on the output.

[0012] The method for generating a trained model according to the present disclosure includes: Prepare learning data, which is a data set of tire cross-sectional images showing the cross-sectional structure of the tire and ground truth data. Using the learning data, parameters of a machine learning model are adjusted so that when a tire cross-sectional image showing a cross-sectional structure of a tire is input, data corresponding to the correct answer data is output. The correct answer data is position information of one or more measurement points in the tire cross-sectional image. Effect of the Invention

[0013] According to the above disclosure, position information of one or more measurement points is estimated from a tire cross-sectional image by a machine learning model, which makes it possible to efficiently estimate tire measurement values ​​based on the position information of the measurement points. [Brief description of the drawings]

[0014] [Figure 1] 1 is a functional block diagram illustrating a configuration of a tire measurement value estimation device according to an embodiment. [Diagram 2] An example of a cross-sectional image of a tire. [Diagram 3] 1 is a plan view of a sample showing a cross section of a tire. [Figure 4] 11 is a flowchart showing the flow of an estimation process. [Diagram 5] FIG. 1 is a diagram illustrating an outline of the structure of a machine learning model according to an embodiment. [Figure 6] An example of a screen generated by the estimation device. [Figure 7] 11 is a flowchart showing the flow of a learning process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] Hereinafter, a method, a program, and an apparatus for estimating a tire measurement value according to an embodiment of the present disclosure will be described.

[0016] <1. Overview of estimation method> Fig. 1 is a functional block diagram showing the configuration of a tire measurement value estimation device 1 according to an embodiment of the present disclosure, and Fig. 2 shows an example of a tire cross-sectional image (hereinafter also simply referred to as a "cross-sectional image") G0 showing the cross-sectional structure of a tire. The estimation device 1 according to this embodiment estimates the measurement value of a tire cross section from an image such as the cross-sectional image G0. The cross-sectional image G0 shows the outline of the tire cut at a specified plane and the internal structure of the tire.

[0017] The cross-sectional image G0 may be an image acquired by, for example, a computed tomography (CT) device. The cross-sectional image G0 may also be an image captured by a camera of a tire cross-section cut at a predetermined plane, a cut sample (hereinafter also simply referred to as a "sample") 3 representing a full-size tire cross-section, or an image acquired by reading these with a scanner. The cross-sectional image G0 according to this embodiment is image data acquired by reading the sample 3 with a scanner. The gradation of the scanner is, for example, 24-bit color, and the resolution is preferably 300 dpi or more, more preferably 600 dpi or more.

[0018] FIG. 3 shows an example of a plan view of the sample 3. The sample 3 is a sample that represents a cross-sectional structure of a tire in actual size when the tire is cut on a plane including the rotation axis of the tire. The sample 3 shows the rubber 30, which is the main material of the tire, and the internal structures 31-34 contained in the rubber 30. The rubber 30 forms the contour of the tire and defines, for example, the grooves 300 of the tread portion. The internal structures 31-34 are members formed separately from the rubber 30, and are, for example, reinforcing materials for imparting strength to the tire. The internal structures shown in FIG. 3 are, in detail, the cord 31, the belt 32, the ply 33, and the bead wire 34. Furthermore, the sample 3 may be provided with one or more markers corresponding to predetermined measurement points. In this embodiment, a plurality of markers 41-46 are provided, and these markers 41-46 represent measurement points P1-P6 described later. The measurement points P1-P6 may be points on the rubber 30 and points on the internal structures 31-34.

[0019] The tire measurement values ​​include dimensions of a predetermined measurement point on the tire cross section. The dimensions of the predetermined measurement point can be expressed as the distance between two predetermined points among the measurement points on the tire cross section represented by the sample 3. There may be one or more predetermined measurement points, and measurement points that are the start and end points of the measurement can be determined for each predetermined measurement point. Typically, such measurements are obtained by manually identifying points on the sample 3 that correspond to points specified on the tire design data as measurement points, and manually measuring the distance between the identified measurement points.

[0020] However, the series of tasks of identifying measurement points on the sample 3, measuring the distances between them, and recording the measurement results each time is time- and labor-intensive, which may ultimately lead to increased tire design and development costs and quality control costs. Furthermore, with this type of work, it is not possible to digitize the position information of the measurement points identified by hand, making it difficult to refer to which positions were used as measurement points after measurement.

[0021] The estimation device 1 according to the present embodiment is configured to estimate position information of a measurement point specified by a person on a sample 3 from the output of a trained machine learning model (hereinafter also simply referred to as a "trained model") 130, and measure the distance between two points based on the estimated position information. As a result, the position information of the points set as measurement points is digitized, making it easier to verify whether a valid measurement point has been specified for a specified point, and improving the reliability of the estimated measurement value. Furthermore, the measurement value is efficiently estimated, and the burden of work by a person can be reduced. The estimated measurement value can be used in various situations, such as feedback to tire design and development and tire quality control. Below, the hardware configuration of the estimation device 1 will be described, and then the flow of the estimation process by the estimation device 1 will be described.

[0022] 2. Hardware configuration of the estimation device The estimation device 1 is a general-purpose computer in terms of hardware, and is configured by installing a predetermined program 131 in such a computer. The program 131 is a program that causes the estimation device 1 to execute processing described below, and is obtained, for example, from another device via a communication network 2 such as a LAN or the Internet, or from a computer-readable recording medium 132 such as a CD-ROM or a USB memory.

[0023] As shown in Fig. 1, the estimation device 1 includes a control unit 10, a display unit 11, an input unit 12, a storage unit 13, and a communication unit 14. These units 10 to 14 are connected to each other via a bus line 15 and can communicate with each other. In this embodiment, the display unit 11 is configured with a liquid crystal display or the like, and displays various information to a user. The input unit 12 is configured with a mouse, keyboard, touch panel, operation buttons, etc., and accepts operations on the estimation device 1 from a user.

[0024] The storage unit 13 is composed of a non-volatile storage device such as a hard disk or a flash memory, and stores a trained model 130 and a program 131. The control unit 10 is composed of a processor (Central Processing Unit: CPU, Graphics Processing Unit: GPU), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. The control unit 10 reads and executes the program 131 in the storage unit 13, thereby operating as an image acquisition unit 10A, a derivation unit 10B, an estimation unit 10C, and a learning unit 10D. The operation of each unit 10A to 10D will be described in detail later. The communication unit 14 functions as a communication interface that connects the estimation device 1 to a communication network 2 and external devices such as a scanner.

[0025] In this embodiment, the trained model 130 is generated by a learning unit 10D incorporated in the estimation device 1 as described below. However, the learning function of training a machine learning model and generating the trained model 130 may be independent of the estimation function of estimating tire measurement values ​​based on the trained model 130. In other words, the estimation device 1 may be equipped with only the estimation function, and the trained model 130 trained by another computer may be imported into the storage unit 13.

[0026] <3. Estimation process flow> Next, the flow of the estimation process performed by the estimation device 1 will be described with reference to FIG.

[0027] In step S1, the image acquisition unit 10A of the estimation device 1 acquires the cross-sectional image G0 as described above via the communication unit 14. The image acquisition unit 10A stores the acquired cross-sectional image G0 in the storage unit 13. Note that the image acquisition unit 10A may generate an image in which the cross-sectional image G0 is divided into predetermined regions or an image in which the cross-sectional image G0 is resized to a predetermined size so as to be suitable for input to the trained model 130, and store the image in the storage unit 13. In the following, the cross-sectional image G0 also includes an image that has been appropriately processed prior to input to the trained model 130. In addition, the xy coordinate system for the cross-sectional image G0 is defined as shown in FIG. 2, with the upper left vertex of the cross-sectional image G0 as the origin (0,0).

[0028] In step S2, the derivation unit 10B inputs the cross-sectional image G0 to the trained model 130 and derives an output from the trained model 130. The trained model 130 is configured to detect the markers 41-46 by extracting features from the input cross-sectional image G0, and estimate the most appropriate points (pixels) corresponding to the markers 41-46 as the measurement points P1-P6. The trained model 130 outputs the xy coordinates of the points estimated as the measurement points P1-P6 as position information.

[0029] The type of the trained model 130 is not particularly limited, but in this embodiment, it is a convolutional neural network (CNN). FIG. 5 is a diagram for explaining the structure of a CNN. As shown in FIG. 5, the trained model 130 according to this embodiment includes an input layer, alternating convolutional layers and pooling layers, a fully connected layer, and an output layer. The input layer has H×W×(number of channels) units, where H is the number of pixels in the y-axis direction of the input image, W is the number of pixels in the x-axis direction of the input image, and the number of channels is 3 in this embodiment.

[0030] The convolution layer applies a filter of a smaller size to the input three-dimensional data and outputs a feature map. The number, size, and stride of the filters are not particularly limited and can be selected as appropriate. The filters are automatically generated, and the parameters are adjusted by a learning process described later to more appropriately extract features. The pooling layer extracts and outputs characteristic values ​​from the feature map output by the convolution layer. The size of the pooling is not particularly limited and can be selected as appropriate.

[0031] The fully connected layer puts all the outputs from the final pooling layer together in vector format. The number of output units in the output layer can be set according to the number of estimated measurement points, and is 12 in this embodiment. That is, a vector having 12 elements representing the coordinates of six measurement points P1 to P6 is output from the output layer.

[0032] The above structure of the trained model 130 is merely an example, and the number of layers, the number of units, and the like are not limited to this. In addition, the convolutional layers and the pooling layers do not necessarily need to be arranged alternately, and these layers can be increased or decreased as appropriate. Furthermore, a dropout layer and an activation layer may be added as appropriate as necessary. The activation layer is a layer that performs calculations using an activation function, and an identity function, for example, is used as the activation function. However, the activation function is not limited to this, and any appropriate function can be used.

[0033] In step S3, the estimation unit 10C calculates the distance on the xy plane corresponding to the predetermined measurement location based on the coordinates output as the coordinates of the measurement points P1 to P6. For example, the estimation unit 10C can calculate the distance on the xy plane between the combinations of the measurement points P1 and P2, the measurement points P3 and P5, and the measurement points P4 and P6, which are combinations of the start and end points of the measurement, respectively. The estimation unit 10C may also calculate a distance defined by a combination other than the above-mentioned combinations. Furthermore, the estimation unit 10C may calculate the distance between a point separately identified by known image processing or the like and any of the estimated measurement points P1 to P6, without relying on the trained model 130.

[0034] In step S4, the estimation unit 10C converts the calculated distances on the xy plane into distances on the sample 3. In this way, the tire measurement values ​​are estimated. Note that constants for the conversion are calculated in advance and stored in the storage unit 13.

[0035] In step S5, the estimation unit 10C outputs the estimation result. The output mode is not particularly limited, but the estimation unit 10C may generate a screen showing the estimated measurement value for each predetermined measurement point and display it on the display unit 11. The estimation unit 10C may also generate an image in which pixels corresponding to the estimated measurement points P1 to P6 are displayed in a predetermined color, or an image in which figures N1 to N6 showing the positions of the estimated measurement points P1 to P6 are displayed, and the image may be superimposed on the cross-sectional image G0 and displayed on the display unit 11. FIG. 6 is an example of an image in which images in which cross-shaped figures N1 to N6 corresponding to the coordinates of the estimated measurement points P1 to P6 are displayed, respectively, are superimposed on the cross-sectional image G0. This allows a person to intuitively judge whether the estimation by the estimation device 1 is valid by looking at the image displayed on the display unit 11.

[0036] <4. Learning process flow> Hereinafter, with reference to FIG. 7, a method for generating the trained model 130, that is, a method for training a machine learning model by the training unit 10D, will be described.

[0037] In step ST1, the learning unit 10D reads N training data sets prepared prior to learning. The training data sets can be acquired from another device via a communication network 2 such as a LAN or the Internet, or from a computer-readable recording medium 132 such as a CD-ROM or a USB memory.

[0038] The learning dataset is a dataset in which cross-sectional images Gn (n=1, ..., N) representing a cross section of a tire are combined with correct answer data Yn. The cross-sectional images Gn can be acquired in the same manner as the cross-sectional image G0 described above, and have the same size (H x W) as the cross-sectional image G0 to be input to the trained model 130. The correct answer data Yn according to this embodiment is a vector having 12 elements representing the xy coordinates (position information) of the measurement points P1 to P6. The learning dataset is divided in advance into a training dataset and a test dataset, and the ratio between the two can be set appropriately.

[0039] The correct answer data Yn is determined by identifying the xy coordinates of a representative pixel among the pixels (points) in the cross-sectional image Gn that correspond to the markers 41-46 indicating the measurement points P1-P6. The representative pixel can be identified, for example, by referring to a measurement value when a person measures the sample 3. The representative pixel can also be identified by using a known program that detects the markers 41-46, or by a person checking the positions of the markers 41-46 on a monitor.

[0040] In step ST2, the learning unit 10D randomly selects K sample data sets from the training data set, where K is a value called a batch size and can be set appropriately.

[0041] In step ST3, the learning unit 10D inputs the cross-sectional images Gk (k=1, ..., K) of the sample data set to a machine learning model having a structure as shown in Fig. 5, and derives an output Tk from the machine learning model. The output Tk is data corresponding to the correct answer data Yk combined with the cross-sectional image Gk of the input sample data set, and is a vector having 12 elements representing the xy coordinates (position information) of points Pk1 to Pk6.

[0042] In step ST4, the learning unit 10D adjusts parameters so that the value of the error function between the output Tk derived in step ST3 and the correct answer data Yk combined with the cross-sectional image Gk input in step ST3 is minimized. More specifically, the learning unit 10D adjusts and updates the weighting parameters in the fully connected layer of the machine learning model and the filter parameters in the convolution layer by the error backpropagation method. The error function according to this embodiment is expressed as a square sum error. The square sum error represents the distance between the measurement points P1 to P6 and the predicted points Pk1 to Pk6.

[0043] In step ST5, it is determined whether or not learning of one epoch has been completed. In this embodiment, when the processes from step ST2 to step ST4 are performed for the same number of sample data sets as the number of training data sets, it is determined that learning of one epoch has been completed. If it is determined that learning of one epoch has not been completed, the learning unit 10D returns to step ST2 after step ST4. That is, the learning unit 10D randomly selects a sample data set again, and repeats the procedures of steps ST3 and ST4 using the newly selected sample data set. On the other hand, if it is determined that learning of one epoch has been completed, it is determined in step ST6 whether or not learning of all epochs has been completed.

[0044] If it is determined in step ST6 that the learning of all epochs has not been completed, the process returns to step ST2 to perform the learning of the next epoch. The total number of epochs is not particularly limited and can be set appropriately. If it is determined in step ST6 that the learning of all epochs has been completed, the learning unit 10D ends the learning of the machine learning model. The learning unit 10D stores the latest parameters of the machine learning model in the storage unit 13, and sets the parameters as the trained model 130. That is, the trained model 130 is generated by the above procedure.

[0045] Note that the learning unit 10D may input a test data set to the machine learning model every time one epoch of learning is completed, calculate the error between the output and the supervised data of the test data set, and display the calculation result on the display unit 11. Furthermore, if it is considered that the error of the output of the machine learning model with respect to the supervised data of the test data set has converged within a predetermined range before the completion of learning for all epochs, learning may be terminated at that point.

[0046] <5.Features> According to the above estimation process, when a person performs a measurement operation, the position information of the measurement point that the person would identify on the sample 3 is efficiently digitized, and further, it becomes possible to refer to the identified measurement point later. This makes it easy to verify the reliability of the measurement, and makes it possible to suppress the measurement variation when the measurement operation is performed by a person. In addition, the measurement value of a specified measurement point is efficiently estimated from the cross-sectional image, reducing the burden and time of the measurement operation performed by a person.

[0047] <6. Variations> Although one embodiment of the present invention has been described above, the present invention is not limited to the above embodiment, and various modifications are possible without departing from the spirit of the present invention. The gist of the modified examples shown below can be combined as appropriate.

[0048] <6-1> In the above embodiment, the CNN model is used as the machine learning model, but the machine learning model is not limited to this, and other machine learning models such as a neural network (NN) model may be used. In addition, multiple machine learning models may be combined. For example, the machine learning model may be a model in which a CNN model (decoder) and a CNN inverse implementation model (encoder) are combined, and a trained model 130 may be generated in which an image is output in which figures N1 to N6 indicating estimated measurement points P1 to P6 appear at the positions of the estimated measurement points P1 to P6.

[0049] <6-2> In the above embodiment, the supervised data Yk of the learning data set and the output of the trained model 130 are vectors having 12 elements, but the supervised data Yk and the output of the trained model 130 are not limited to this. For example, the supervised data Yk and the output of the trained model 130 may be data indicating the probability that each pixel in the input cross-sectional images Gk and G0 corresponds to the markers 41 to 46. In this case, the coordinates of the pixel with the highest probability for each of the markers 41 to 46 may be set as the position information of the measurement points P1 to P6, respectively.

[0050] <6-3> The learning method of the machine learning model is not limited to the above embodiment, and any known parameter optimization algorithm such as stochastic gradient descent can be applied. The loss function is also not limited to the above embodiment, and can be changed appropriately depending on the nature of the output data.

[0051] <6-4> The measurement value estimation method of the above embodiment can be combined with other known image processing and applied to estimating various measurement values ​​on the cross-sectional image G0. For example, the image processing can be applied to generate a virtual line that does not actually exist connecting the points on both ends of the groove 300 of the sample 3, and to calculate the distance between the points on this virtual line and the points estimated as the measurement points P1 to P6. [Explanation of symbols]

[0052] 1 Estimation device 10 Control section 10A Image acquisition unit 10B Derivation part 10C Estimation part 10D Learning Department 41~46 Marker 130 trained models 131 Programs P1~P6 measurement points

Claims

1. Obtaining a tire cross-sectional image representing a cross-sectional structure of the tire; Inputting the acquired tire cross-sectional image into a trained machine learning model; Deriving an output from the trained machine learning model; and estimating position information of one or more measurement points on a cross section of the tire based on the output; and Including, the output corresponds to position information of the measurement point or a probability that each pixel of the tire cross-sectional image corresponds to the measurement point. How to estimate tire measurements.

2. Estimating the distance between two predetermined points among the plurality of measurement points. Further comprising: The method for estimating a measurement value of a tire according to claim 1 .

3. The measurement points are indicated by markers attached to the cross section of the tire represented by the tire cross section image. The method for estimating a measurement value of a tire according to claim 1 or 2.

4. The tire cross-sectional image is an image representing a cross-sectional structure of the tire when the tire is cut along a plane including a rotation axis of the tire. The method for estimating a measurement value of a tire according to any one of claims 1 to 3.

5. Obtaining a tire cross-sectional image representing a cross-sectional structure of the tire; Inputting the acquired tire cross-sectional image into a trained machine learning model; Deriving an output from the trained machine learning model; and estimating position information of one or more measurement points on a cross section of the tire based on the output; and Run the following on your computer: the output corresponds to position information of the measurement point or a probability that each pixel of the tire cross-sectional image corresponds to the measurement point. A program to estimate tire measurement values.

6. an image acquisition unit that acquires a tire cross-sectional image representing a cross-sectional structure of the tire; A memory unit that stores a trained machine learning model; A derivation unit that inputs the acquired tire cross-sectional image into the trained machine learning model and derives an output from the trained machine learning model; an estimation unit that estimates position information of one or a plurality of measurement points on the cross section of the tire based on the output; Equipped with the output corresponds to position information of the measurement point or a probability that each pixel of the tire cross-sectional image corresponds to the measurement point. A tire measurement estimation device.

7. Preparing learning data, which is a data set of a tire cross-sectional image showing a cross-sectional structure of a tire and ground truth data; Using the learning data, adjusting parameters of a machine learning model so that when a tire cross-sectional image showing a cross-sectional structure of a tire is input, data corresponding to the ground truth data is output; Including, The correct answer data is position information of one or more measurement points in the tire cross-sectional image. How to generate a trained model.

Images