Concrete quality prediction method

Abstract

To provide a method capable of highly accurately predicting the quality of concrete (especially, finishing property of concrete) in a short time without depending on the sensation and experience of a person.SOLUTION: There is provided a method for predicting the quality of concrete by using a prediction model. The prediction model is created with machine learning using a plurality of pieces of learning data being the combination of learning input data including image data and learning output data about the finishing property of concrete. The concrete quality prediction method inputs prediction input data including image data to the prediction model, outputs prediction output data about the finishing property of concrete from the prediction model, and predicts the quality of concrete by using the prediction output data.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a method for predicting the quality of concrete. [Background technology]

[0002] At a concrete product factory, ready-mix concrete is first produced by mixing the various materials in a mixer based on a concrete mix adjusted to suit the application, quality, etc. of the concrete product. Next, compaction, surface finishing, curing, etc. are carried out as appropriate according to the properties of the ready-mix concrete to produce the concrete product. On the other hand, even if the mix proportions and mixing time are the same, the properties of ready-mixed concrete will vary depending on the surface moisture content of the aggregate, the outside temperature, etc., so in order to produce the desired concrete product, it is necessary to adjust the conditions in the finishing process as appropriate. For example, if ready-mixed concrete with higher fluidity than expected is produced, there is a high possibility that sagging will occur during finishing, so the finishing process is carried out after leaving it to stand for a predetermined period of time. Also, if ready-mixed concrete with lower fluidity than expected is produced, the time required for the finishing process may be longer than expected.

[0003] Patent Document 1 describes a method for predicting the quality of fresh concrete using a prediction model, which is a method that can predict the quality of fresh concrete in a short time and with high accuracy without relying on human senses or experience. The prediction model is created by machine learning using multiple pieces of training data that are a combination of training input data including image data and training output data related to the quality of the fresh concrete. The prediction model includes inputting prediction input data including image data into the prediction model, outputting prediction output data related to the quality of the fresh concrete from the prediction model, and predicting the quality of the fresh concrete using the prediction output data.

[0004] Furthermore, Patent Document 2 describes a method for predicting a suitable time for leveling work to be performed before leveling the surface of concrete being constructed, which includes the steps of: assuming that there is a correlation between the air temperature during the construction period and the temperature of the concrete; applying the predicted air temperature during the construction period to the relationship between the slope information of an approximation equation that expresses the relationship between a penetration resistance value obtained by a predetermined penetration resistance test and elapsed time, which is known in advance, and the temperature of the concrete, to obtain slope information corresponding to the predicted air temperature; applying the obtained slope information to the relationship between the slope information and the time from the pouring time to the time when the conductivity of the concrete decreases, which is known in advance, to estimate the time when the conductivity decreases corresponding to the obtained slope information; estimating the relationship between the penetration resistance value corresponding to the obtained slope information and elapsed time; and predicting the time when the concrete can be leveled from the relationship between the estimated penetration resistance value and elapsed time and the estimated time when the conductivity decreases. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Publication No. 2020-144132 [Patent Document 2] Japanese Patent Application Publication No. 2019-73962 Summary of the Invention [Problem to be solved by the invention]

[0006] The slump value of concrete is known as one of the indicators for determining finishing processes such as surface finishing and compaction of concrete. However, when the slump value of concrete is set low from the beginning, as in the case of low-slump concrete commonly used in concrete product factories, the reliability of the slump value as an indicator of the above-mentioned problem is low. For this reason, the adjustment of various conditions in the finishing process largely depends on the sense and experience of skilled workers. An object of the present invention is to provide a method for predicting the quality of concrete (particularly the finishability of concrete) in a short time with high accuracy without relying on human senses or experience. [Means for solving the problem]

[0007] As a result of intensive research into solving the above-mentioned problems, the inventors discovered that the above-mentioned object can be achieved by a method of predicting the quality of concrete by inputting input data including image data into a prediction model created by machine learning using multiple combinations of input data including image data and output data related to the finishability of concrete, and using the output data obtained, and thus completed the present invention. That is, the present invention provides the following [1] to [7]. [1] A method for predicting the quality of concrete using a predictive model, wherein the predictive model is created by machine learning using multiple pieces of training data that are a combination of training input data including image data and training output data related to the finishability of concrete, and the method comprises inputting prediction input data including image data into the predictive model, outputting prediction output data related to the finishability of concrete from the predictive model, and predicting the quality of concrete using the prediction output data. [2] The method for predicting the quality of concrete according to [1], wherein the learning output data and the prediction output data include data relating to work during concrete finishing.

[0008] [3] The method for predicting the quality of concrete according to [1] or [2], wherein the learning output data and the prediction output data include data on the quality of the concrete after finishing. [4] The method for predicting the quality of concrete according to any one of [1] to [3], wherein at least one type of data used as the learning input data and the prediction input data is standardized data. [5] The method for predicting quality of concrete according to [4], wherein the standardized data is image data included in the learning input data and the prediction input data, the image data is a grayscale image, and the pixel values ​​of each pixel constituting the grayscale image are standardized. [6] A method for predicting the quality of concrete according to any one of [1] to [5], wherein the image data is a plurality of image data continuously photographed showing the mixing of concrete materials in a mixer for mixing the materials, and the image data and the prediction output data are displayed on a display means. [7] A method for predicting the quality of concrete according to any one of [1] to [6], wherein at least one type of data included in the learning input data and the prediction input data is obtained from an information management system at a concrete factory. [Effects of the Invention]

[0009] The method for predicting concrete quality of the present invention makes it possible to predict the quality of concrete (particularly the finishability of concrete) in a short time with high accuracy, thereby enabling efficient and stable production of concrete of the desired quality. [Brief explanation of the drawings]

[0010] [Figure 1] In the embodiment, this figure shows a still image taken from above the two-axis mixer, the position of image data extracted from the still image (a), and the position of image data shifted by 5 pixels from the position (b). DETAILED DESCRIPTION OF THE INVENTION

[0011] The concrete quality prediction method of the present invention is a method for predicting concrete quality using a prediction model, which is created by machine learning using multiple pieces of training data that are a combination of training input data including image data and training output data related to the finishability of concrete.The prediction input data including image data is input to the prediction model, and prediction output data related to the finishability of concrete is output from the prediction model, and the quality of concrete is predicted using the prediction output data. A detailed explanation is provided below.

[0012] The predictive model was created using machine learning. Examples of learning methods used in machine learning include neural networks, linear regression, decision trees, support vector regression, ensemble methods, support vector machines, discriminant analysis, naive Bayes methods, nearest neighbor methods, etc. These may be used alone or in combination of two or more. Among these, neural networks are preferred from the viewpoint of being able to predict quality with higher accuracy. From the viewpoint of being able to predict quality with higher accuracy, a hierarchical neural network having one or more intermediate layers between an input layer and an output layer is preferable.

[0013] Examples of neural networks include convolutional neural networks (CNNs) such as 3D convolutional neural networks (3DCNNs), recurrent neural networks (RNNs), and long short-term memory (LSTM) neural networks (recurrent neural networks improved using LSTMs). Among these, convolutional neural networks (neural networks with a convolutional layer, a pooling layer, or the like as an intermediate layer) are more suitable because they have excellent performance in the field of image recognition. Convolutional neural networks can detect features from image data and create a prediction model capable of classification or regression using the features. The number of layers in a convolutional neural network, which is a combination of convolutional layers and pooling layers, is preferably two or more, more preferably three or more, from the viewpoint of enabling prediction with higher accuracy. Machine learning can also be performed using, for example, "TensorFlow" ("TENSORFLOW" is a registered trademark), a software library developed by Google, or "IBM Watson" ("IBM WATSON" is a registered trademark), a system developed by IBM.

[0014] The predictive model is created through machine learning using multiple training data, which are combinations of training input data including image data and training output data related to the finishability of concrete. Examples of image data used as training input data include image data related to concrete production. Specific examples include image data photographed of the mixing of concrete ingredients in a mixer (hereinafter simply referred to as a "mixer"); image data photographed of the mixing of ingredients in a mixer to obtain ready-mixed concrete and then the pouring of the ready-mixed concrete from the mixer into a hopper; image data photographed of the ready-mixed concrete being stirred in the drum of a truck agitator (for example, photographed by shining a light or the like on the inside of the drum near the ready-mixed concrete inlet of the truck agitator); and image data photographed of a monitor displaying the history of the mixer's power load value during the mixing of concrete ingredients (visually displaying the change in power load value over time using a graph or the like). These may be used alone or in combination of two or more. Among these, from the viewpoint of being able to predict quality with higher accuracy, image data photographed while the materials are being mixed in the mixer is preferred. The image data may be image data taken at any time from immediately after mixing the materials to the end of mixing, but from the viewpoint of being able to predict quality at an early stage, it is preferred to take the image data when the rate of decrease in the power load value becomes gradual.

[0015] The number of image data used as learning input data is preferably 100 or more, more preferably 1,000 or more, even more preferably 10,000 or more, even more preferably 50,000 or more, and particularly preferably 100,000 or more, from the viewpoint of being able to predict quality with higher accuracy. The image data may be either moving image data or still image data, and the image may be either a two-dimensional image or a three-dimensional image. The image data is captured by a camera appropriately installed inside the mixer or around the mixer, etc. For example, a camera is installed at the top of the mixer so that the materials being mixed can be clearly seen. In addition, in order to make the unevenness of each mixed material more visible, light may be applied from the side or diagonally above each mixed material using a light or the like to create a darker shadow. In addition, from the viewpoint of being able to predict quality with higher accuracy, it is preferable to capture image data when the stirring blade (mixer blade) rotating in the mixer is at a specific rotation position that has been arbitrarily determined. The position may be one position or two or more positions.

[0016] The image data may be an image of a specific range cut out from an image taken inside the mixer (for example, an image taken so that the entire inside of the mixer is visible). From the viewpoint of enabling predictions with higher accuracy, it is preferable that the above-mentioned specific range be a range in which parts of the concrete that are likely to show the behavior of the materials are likely to be captured when continuous images are taken of the process of mixing concrete materials inside the mixer. Specifically, the specific range is the vicinity of all of the following parts (1) to (3) of the mixing member consisting of the mixer's rotating shaft and the mixing blades fixed to the rotating shaft, and is the range in which concrete materials may be reflected. (1) At least a portion of the rotating shaft (2) Tip of the above stirring blade (3) The part where the stirring blade is fixed to the rotating shaft When there are a plurality of stirring blades, the specific range may be such that the tip portion and the fixed portion of at least one stirring blade are visible. Furthermore, if the mixer is a twin-shaft mixer, it is preferable that the range be such that all of the above (1) to (3) are reflected on both one rotating shaft and the other rotating shaft, and that the concrete material may be reflected in the range. It should be noted that multiple image data may be extracted from one image taken of the inside of the mixer.

[0017] Difference data obtained from two image data arbitrarily selected from two or more captured image data may be used as image data to be used as learning input data. For example, difference data between two image data captured when the mixer blades are positioned at two arbitrarily determined positions within the mixer may be used as image data to be used as learning input data. In this specification, the differential data refers to image data obtained by comparing two pieces of image data and extracting only the different portions. Alternatively, multiple still images that are consecutive over time may be superimposed and synthesized to form image data. Such image data can be obtained, for example, by using commercially available image software to adjust the opacity (or transparency) of each of the multiple still images to about 30 to 70% and then superimposing them. From the viewpoint of work efficiency, the number of still images to be superimposed is preferably 2 to 20. Image data is captured for 10 seconds, for example, at 10 frames per second, thereby obtaining data for 100 still images.

[0018] From the viewpoint of being able to predict quality with higher accuracy, data on the power load value of the mixer during mixing (hereinafter simply referred to as "power load value") may also be used as learning input data. Examples of data related to power load values ​​include power load values ​​and their absolute values ​​at specific times from immediately after the start of mixing each material to the end of mixing, maximum or minimum power load values ​​during mixing, amount of change in power load value per unit time, change pattern of power load value, etc. These may be used alone or in combination of two or more. Furthermore, the number of data relating to the power load value may be one, but from the viewpoint of being able to predict quality with higher accuracy, it is preferably two or more, and more preferably five or more.

[0019] Furthermore, image data to be used as learning input data (image data captured of the process of mixing the materials in the mixer) may be determined based on data related to the power load values. For example, from the perspective of being able to predict quality with higher accuracy and at an earlier stage, it is preferable to use image data captured after mixing of water and other concrete materials has started and the mixer's power load value has stabilized (the point at which the rate of change in the power load value per unit time has become small). When mixing concrete ingredients, the time when the mixer's power load value stabilizes varies depending on the water-cement ratio of the concrete, etc., but if the water-cement ratio is around 50 to 70%, it will be around 30 seconds after the start of mixing water and concrete ingredients other than water (for example, after the concrete ingredients other than water are poured into the mixer and dry mixed, water is poured into the mixer and mixing begins). Furthermore, if the water-cement ratio is set lower than the above-mentioned range (50-70%) from the viewpoint of strength development, the time when the above-mentioned power load value stabilizes will be delayed, and in the case of high-strength concrete, it may take 5 to 10 minutes from the start of mixing the water and concrete ingredients other than water.

[0020] Furthermore, two or more image data may be captured based on data relating to the power load value, and difference data obtained between two image data arbitrarily selected from the captured two or more image data may be used as image data to be used as input data for learning. For example, after the power load value has stabilized, image capture may be performed for an arbitrary time (for example, capturing 30 frames per second), and difference data obtained between two image data arbitrarily selected from the captured plurality of image data may be used as image data to be used as input data for learning.

[0021] Moreover, from the viewpoint of predicting quality with higher accuracy, other data may also be used as learning input data. Other data include data on concrete mix conditions, data on concrete quality, data on cement, data on concrete materials other than cement, data on mixing means and methods, data on the environment during mixing, data on concrete transportation, etc. These may be used alone or in combination of two or more. These various data include numerical data and classification data. In this specification, "numerical data" refers to data that can be expressed as specific numerical values. Numerical data also includes data obtained by dividing the quality of concrete into multiple stages and evaluating it based on the worker's visual inspection or sense when working manually (for example, when hitting concrete with a trowel, lifting concrete with a hand shovel, etc.), and replacing each stage with a numerical value. Data relating to classification means data classified according to criteria such as a specific mix design, a specific type, a specific property, or a specific numerical range.

[0022] Examples of data on concrete mix conditions include the mixing ratios of cement, fine aggregate, coarse aggregate, water, various admixtures (AE agents, water-reducing agents, AE water-reducing agents, high-performance water-reducing agents, high-performance AE water-reducing agents, superplasticizers, setting retarders, etc.), and various admixtures (ground granulated blast furnace slag, silica fume, fly ash, etc.) mixed into concrete (for example, the amount (mass%) of admixture relative to 100 mass% of cement), as well as items in the specified mix table, such as the water-cement ratio, air content, fine aggregate ratio, and unit water content (per 1 m of concrete). 3 These may be used alone or in combination of two or more.

[0023] Examples of data relating to the quality of concrete include target concrete design data such as strength (nominal strength, compressive strength, flexural strength, etc.), slump, slump flow, air content, chloride content, crack resistance, dynamic modulus of elasticity, dynamic shear modulus of elasticity, dynamic Poisson's ratio, hardened body void volume and void size distribution, durability, color, etc. These may be used alone or in combination of two or more. Of these, slump and slump flow are preferred because they are highly important in terms of concrete quality. The strength, slump, slump flow, air content, and chloride content of concrete can be measured, for example, by the test methods described in "JIS A 5308:2014 (Ready-mixed concrete)."

[0024] Examples of data related to cement include data related to cement as a whole, data related to raw materials for cement clinker, data related to burning conditions for cement clinker, data related to grinding conditions for cement, and data related to cement clinker. Examples of data on cement as a whole include: (i) data on cement used as a material for concrete, such as type, chemical composition, mineral composition, wet f.CaO (free lime content), loss on ignition, Blaine specific surface area, particle size distribution, sieve residue, and color; (ii) mineralogical and crystalline properties of each mineral contained in cement; and (iii) hemihydration rate of gypsum contained in cement. Examples of data on raw materials for cement clinker include: (i) data on the raw materials for cement clinker, such as chemical composition, hydraulic hardness calculated from the chemical composition, sieve residue, Blaine specific surface area (fineness), ignition loss, supply amount, supply amount of auxiliary materials (special raw materials such as waste), amount stored in the blending silo (remaining amount), amount stored in the storage silo (remaining amount), (ii) current value of the cyclone located between the raw material mill and the blending silo for the mixed raw materials (representing the rotation speed of the cyclone, which is correlated with the speed of the raw materials passing through the cyclone), (iii) the time from when the raw materials were fed into the kiln, (iv) Data on raw materials for cement clinker, such as the chemical composition, hydraulic hardness calculated from the chemical composition, of the raw materials for cement clinker (mixed raw materials for cement clinker from which fine particles and the like have been removed by a countercurrent airflow during transportation; hereinafter referred to as the raw materials for cement clinker to be kilned) at a point in time a predetermined time ago (for example, one point in time 5 hours ago, or multiple points in time such as four points in time 3 hours, 4 hours, 5 hours, and 6 hours ago), and the like.

[0025] Examples of data on cement burning conditions include: (i) data on the burning of cement clinker, such as the amount of cement clinker raw material inserted into the kiln, kiln rotation speed, outlet temperature, burning zone temperature, cement clinker temperature, kiln average torque, O2 concentration, NO X (ii) clinker cooler temperature; and (iii) preheater gas flow rate (which is correlated with the preheater temperature). Examples of data related to cement milling conditions include milling temperature, amount of water sprayed inside the finishing mill, separator air volume, type of gypsum, amount of gypsum added, amount of cement clinker added, number of revolutions of the finishing mill, temperature of powder discharged from the finishing mill, amount of powder discharged from the finishing mill, amount of powder not discharged from the finishing mill, etc. Examples of data on cement clinker include (i) mineral composition, chemical composition, wet f.CaO (free lime), and volumetric weight, (ii) crystallographic properties (lattice constant, crystallite size, etc.) of each mineral contained in the cement clinker, and (iii) ratios of two or more minerals contained in the cement clinker. These may be used alone or in combination of two or more.

[0026] Examples of data on concrete materials other than cement include (i) aggregate (fine aggregate and coarse aggregate) data such as type, density, water absorption rate, water content, surface water content, particle size distribution, maximum size, and particle shape, (ii) type of admixture, and (iii) type of admixture. These may be used alone or in combination of two or more. Examples of data relating to the mixing means and method include the type, model, and capacity of the mixer, the amount of material to be mixed, the mixing time, etc. These may be used alone or in combination of two or more. Examples of data relating to the environment during mixing include temperature (outside air temperature, temperature inside the mixer, temperature of concrete), temperature of mixing water, humidity, production date, production time, etc. These may be used alone or in combination of two or more. Examples of data related to concrete transportation include the power load value inside the drum of a truck agitator, the volume, mass, and temperature of the concrete, the outside air temperature during transportation, the transportation time (the time from the end of mixing to the end of transportation (unloading)), the transportation distance, the date of transportation, the time of transportation, etc. These may be used alone or in combination of two or more.

[0027] The various learning input data described above may be obtained from an existing information management system in a concrete factory. An information management system for a concrete factory is a system that centrally manages data necessary to control the production of concrete and data obtained during the production of concrete using computers, networks, etc. Examples of concrete factories include ready-mix concrete factories, concrete product factories, etc. The various learning input data may be obtained from either an existing information management system in the ready-mix concrete factory or an existing information management system in the concrete product factory, or may be obtained from both information management systems. Examples of information management systems include systems for managing the composition information of materials used in ready-mixed concrete at ready-mixed concrete factories (information that is disclosed as information indicating the quality of the concrete when the ready-mixed concrete is shipped), systems for setting the measurement values ​​of stored materials (the amount of each material added per batch) and for controlling ready-mixed concrete manufacturing equipment such as mixers, and systems for managing information such as the transportation conditions when transporting manufactured ready-mixed concrete using agitator trucks, etc. (for example, ``Sky One II'' (manufactured by Pacific Systems Co., Ltd.), a ready-mixed concrete dispatch system that utilizes GPS). The above-described information management system is an example, and the method of acquiring various data is not particularly limited. In this specification, "ready-mixed concrete" refers to concrete that has fluidity before it hardens. The term "concrete" includes both concrete that has fluidity before it hardens (ready-mixed concrete) and concrete after it hardens.

[0028] Examples of learning output data regarding the finishability of concrete include data regarding the work performed during finishing of concrete when the concrete is actually produced, data regarding the quality of the concrete after finishing, and data regarding the fluidity of the concrete before finishing (slump value, slump flow value, etc.). Finishing concrete refers to finishing the surface of the concrete using a trowel or similar tool after the concrete has been poured. Examples of data related to work during concrete finishing include qualitative evaluation of finishability, finishing work time, cumulative value of finishing work time and number of people required for finishing, and compaction performance (time spent using a vibrator).

[0029] The qualitative evaluation of finishability is an evaluation based on the visual inspection and manual sensation of the concrete finishability (ease of finishing the concrete surface with a trowel, etc.) by the worker who actually finished the concrete surface. For example, the finishability may be evaluated on a five-point scale: very hard, hard, good, soft, and very soft. Furthermore, each of the five-level evaluations may be replaced with a number. For example, very hard may be replaced with "-2," hard may be replaced with "-1," good may be replaced with "0," soft may be replaced with "1," and very soft may be replaced with "2."

[0030] Examples of data on the quality of concrete after finishing include visual evaluation of the finished condition of the concrete, dimensions (actual measured values ​​of the concrete product after hardening), rebound degree measured using a test hammer (for example, rebound degree measured in accordance with JIS A 1155:2012 (Method for measuring rebound degree of concrete)), and air permeability coefficient using the Trent method. Visual evaluation of the concrete finish is a visual evaluation of the appearance of the concrete after it has been actually finished. For example, a good appearance is given an "A," junk is given a "B," cracks are given a "C," surface bubbles are given a "D," laitance is given an "E," and cross-sectional defects are given an "F." The appearance of the concrete may be rated as, for example, "A," "B and C," etc.

[0031] The machine learning in the present invention is performed according to a conventional machine learning method known in the art, using multiple pieces of training data that are combinations of training input data including image data and training output data related to the finishability of concrete. The learning input data and learning output data used as learning data are data such as images and actual measurements obtained when concrete is actually produced as samples for learning data. The number of samples for training data varies depending on the types of training input data and training output data required, but from the viewpoint of being able to predict quality with higher accuracy, it is preferably 4 or more, more preferably 6 or more, and particularly preferably 8 or more.

[0032] From the viewpoint of being able to predict quality with higher accuracy, the number of learning times is preferably 1,000 or more, more preferably 8,000 or more, and particularly preferably 10,000 or more. In one learning session, it is not necessary to use all of the data obtained from the sample, and only a portion of the data may be used. The selection of the learning data to be used in one learning is not particularly limited, and the learning data may be selected in the order in which they are arranged from top to bottom according to a specific condition (for example, the order in which they were photographed), or may be selected randomly. Furthermore, when there are multiple samples for the learning data, it is preferable to select the data so that at least one piece of data from each sample is included in the learning data. Furthermore, the number of image data obtained from one sample is preferably 1,000 or more, more preferably 2,000 or more, and particularly preferably 2,500 or more, from the viewpoint of being able to predict quality with higher accuracy. In addition, in this specification, "machine learning" refers to learning by machines (particularly computers) alone, without the intervention of human thought.

[0033] Prediction input data including image data is input into a prediction model created by machine learning, and prediction output data regarding the finishability of concrete is output from the prediction model.The prediction output data can then be used to predict the quality of the concrete. From the viewpoint of being able to predict quality with higher accuracy, the prediction input data may further include data on the power load value of the mixer during mixing, data on the concrete mix conditions, data on the desired concrete quality, data on cement, data on concrete materials other than cement, data on mixing means and methods, data on the environment during mixing, and data on concrete transportation. These data may be used alone or in combination of two or more. These data are obtained in real time during concrete production.

[0034] The details of the image data and the like used as the input data for prediction are the same as those of the image data and the like used as the input data for learning described above. The details of the prediction output data relating to the finishability of concrete are the same as those of the learning output data relating to the finishability of concrete described above. Furthermore, from the viewpoint of being able to centrally manage and control concrete quality predictions in real time and to periodically retrain the prediction model, it is preferable that at least one type of data included in the above-mentioned learning input data and prediction input data is obtained from an information management system at the concrete factory (at least one of a ready-mix concrete factory and a concrete product factory).

[0035] From the viewpoint of predicting the finishability of concrete with higher accuracy, standardized data may be used as at least one of the data used as the learning input data and prediction input data described above. In addition, when a specific type of data in the learning input data is standardized, the same type of prediction input data must also be standardized. For example, when a design slump value used as one type of learning input data is standardized, the design slump value used as prediction input data must also be standardized before being input into the prediction model. Furthermore, data that can be standardized is numerical data (data that can be expressed as a number). Data normalization can be performed using the following procedure. Let the number of training data be n, and the data to be standardized that is used as training input data be x. Then, from the following formulas (1) and (2), x i (where i is an integer from 1 to n), the average value μ and standard deviation σ are calculated. The data to be standardized is data arbitrarily selected from the learning input data, and may be one type or two or more types.

[0036]

number

[0037]

number

[0038] Next, using the average value μ, the standard deviation σ, and the following formula (3), x i can be standardized to obtain the standardized data Z. Standardized data are numerical values ​​with a mean of 0 and a variance of 1. Multiple types of data with different units and orders of magnitude (e.g., design slump value (cm), design air content (%), maximum coarse aggregate size (mm), unit coarse aggregate amount (kg / m)) 3 )), standardization allows data with different units and digits to be compiled. This makes it easier to compare the impact of each data on the prediction output data, and makes it easier to select the training data to use when creating a prediction model. In addition, when predicting the quality of concrete using a predictive model, the prediction input data of the same type as the standardized data (data arbitrarily selected from the learning input data) also needs to be standardized. In this case, the mean value μ and standard deviation σ used for standardizing the prediction input data are calculated using the learning input data.

[0039]

number

[0040] From the viewpoint of predicting the finishability of concrete with higher accuracy, it is preferable to use standardized image data as the image data included in the learning input data and the prediction input data. By using standardized image data, it is possible to reduce the influence of changes in the brightness value of the entire image (for example, changes in the brightness of the entire screen due to differences in the image capture time or conditions) on the creation of the prediction model. Examples of methods for standardizing image data include the following. The image data to be standardized is grayscale image data. If the captured image data is a color image, the color image must be converted to a grayscale image. There are no particular limitations on the method for converting a color image to a grayscale image; a common method such as the NTSC weighted average method can be used, using the functions of commercially available image software.

[0041] Next, the pixel values ​​(luminance values) of the pixels that make up the grayscale image are standardized. Specifically, if the image data included in the learning input data is image data consisting of 30 images of 64 x 64 pixels, the average value μ and standard deviation σ are calculated using the pixel values ​​of all pixels that make up the image data (64 x 64 x 30 = 122,880 pixel values) and the above formulas (1) and (2) (in formula (1), n ​​is 122,880 and x is the pixel value (brightness value)). Next, using the average value μ, the standard deviation σ, and the formula (3), x i can be standardized to obtain the standardized data Z.

[0042] According to the concrete quality prediction method of the present invention, in concrete production, by inputting image data of the concrete being produced into a prediction model created in advance, it is possible to quickly predict the finish quality of the concrete to be obtained with high accuracy without relying on human judgment. In particular, when the design slump value of the target concrete is set small from the beginning (for example, when the slump value is set to 15 cm or less, preferably 10 cm or less, and more preferably 5 cm or less), or when the measured slump value of the manufactured concrete is small (for example, when the slump value is 15 cm or less, preferably 10 cm or less, and more preferably 5 cm or less), there is a problem that the fluidity of the concrete decreases, making finishing difficult, and the reliability of the slump value as an indicator for judging finishing processes such as surface finishing and compaction of the concrete decreases. According to the concrete quality prediction method of the present invention, when using learning data (a combination of learning input data and learning output data) obtained from concrete whose design slump value is set small from the beginning (particularly set to a value within the range of 0 to 5 cm) and prediction input data, it is possible to predict with higher accuracy the finishability of concrete with a small stamp value, which has previously been difficult to predict accurately, and to easily make adjustments in the finishing process according to variations in the finishability of concrete. In particular, since concrete product factories often produce low-slump concrete, the concrete quality prediction method of the present invention is suitable as a method for predicting the quality of concrete in concrete product factories. Furthermore, since the prediction of concrete finishability can be performed for each of the multiple image data acquired during production, multiple output data (e.g., qualitative evaluation of finishability) can be obtained from the multiple image data. Of the multiple output data obtained, data that is clearly different from the others can be eliminated, or an average value calculated from the multiple output data obtained can be used as the output data for prediction.

[0043] If it is predicted that the finishability of the resulting concrete will not satisfy the desired finishability of the concrete, appropriate measures such as changing the concrete production conditions can be taken to produce concrete efficiently and stably. For example, if the qualitative evaluation of finishability obtained from the predictive model differs significantly from the target qualitative evaluation of finishability, it is possible that there is an abnormality in the quality of the cement, aggregate, admixtures, etc. used as concrete materials, or that the measurement values ​​of these materials were incorrect, and the manufacturing process must be reviewed immediately.It is also possible that the set value of the surface water of the aggregate differs from the actual value, and a correction value can be calculated before the aggregate is discharged from the mixer, and an appropriate amount of additional water can be injected into the mixer based on the correction value. Furthermore, image data obtained by continuously photographing the mixing of concrete ingredients in a mixer may be input to the prediction model as input data for prediction, and the resulting output data for prediction may be displayed on a display means (for example, a display) together with the image data. By displaying the display in real time, for example, it is possible to more quickly respond by changing the concrete production conditions while checking the output data for prediction and the state of the concrete in the mixer. In addition, if a qualitative evaluation of finishability is predicted periodically and the predicted value of the qualitative evaluation of finishability deviates slightly from the target value, this may be due to a fluctuation in the surface water content of the aggregate, and appropriate measures can be taken, such as reviewing the set value of the surface water. Furthermore, the accuracy of predictions may be improved by accumulating the prediction input data and data on the finishability of actual concrete used to predict the quality of concrete, and periodically re-learning the prediction model using the accumulated data.

[0044] Furthermore, by connecting a computer that controls concrete production with a computer used to implement the concrete quality prediction method of the present invention, the control system can be automated. Furthermore, various data relating to concrete production at multiple factories may be transmitted via the Internet and centrally managed and controlled in real time at one location using the concrete quality prediction method of the present invention. [Example]

[0045] [Preparation of concrete 1-20] Cement, fine aggregate (mountain sand), coarse aggregate A (crushed stone No. 5), and coarse aggregate B (crushed stone No. 6) were put into a twin-shaft mixer and mixed dry, after which water was added and mixed to produce concrete (ready-mixed concrete) 1 to 20. The amount of each material was adjusted to the unit amount shown in Table 1. The concrete had a target slump value of 3.0 cm, and the mix design of each material was carried out so that this slump value could be achieved. In addition, when preparing the concrete, a video camera was installed above the twin-shaft mixer to capture video images of the materials being mixed. The actual slump value of each concrete produced was measured in accordance with "JIS A 1101:2014 (Concrete slump test method)". In addition, a qualitative evaluation of the finishability of each concrete (based on the worker's visual sense when finishing the surface with a trowel) was conducted with very hard being "-2", hard being "-1", good being "0", soft being "1", and very soft being "2". The results are shown in Table 1.

[0046] [Table 1]

[0047] [Example 1] Concrete 1, 3-7, 11, and 13-15 were selected as samples for training data. For each sample, 450 (15 × 30) still images capturing the entire interior of the twin-shaft mixer were obtained from a 15-second video sequence, starting one minute after water was poured into the mixer and mixing began, at a frame rate of 30 frames per second. From each still image, image data (256 × 256 pixels) was extracted from the approximate center of the twin-shaft mixer, between one and the other rotating shafts, within the area where concrete material likely appeared when the images were taken during mixing. The areas were: (1) portions of both rotating shafts, (2) at least one of the tips of the blades attached to the rotating shafts (either or both of the two rotating shafts), and (3) at least one of the blades attached to the rotating shafts (either or both of the two rotating shafts) (see the area enclosed by the line in Figure 1(a)). The power load value of the twin-shaft mixer was already stable one minute after mixing started, and remained stable until mixing was completed.

[0048] As shown in Figure 1(b), a total of 24 256 x 256 pixel image data pieces (each piece of image data cut at a different position) were cut out from positions shifted by 5 pixels vertically and horizontally (up and down and left and right) based on the position where the image data was cut out. In other words, a total of 25 image data pieces were cut out from one still image, resulting in 11,250 (30 x 15 x 25) pieces of image data per sample, for a total of 112,500 (11,250 x 10) pieces of image data. The 25 pieces of image data were image data for all of the above portions (1) to (3) within a range in which the material of ready-mixed concrete located nearby could be reflected. Next, each image data was reduced to an image size of 64 x 64 pixels, and 90,000 image data, or 80% of the 112,500 images used as training input data, were used, and the remaining 20%, or 22,500 images, were used as training test data.

[0049] The obtained 64×64 pixel image data was converted into a grayscale image by converting each pixel constituting the image data into 256 gradations. The converted image data (grayscale image) was subjected to a standardization process, and the image data after standardization was used as the learning input data. The actual measured slump value of the sample from which the image data used as the learning input data was obtained, and the qualitative evaluation of the concrete finishability (evaluation based on the worker's visual inspection or sense during manual work, with very hard being ``-2'', hard being ``-1'', good being ``0'', soft being ``1'', and very soft being ``2''; data related to the concrete finishability) were used as the learning output data. Using the learning data consisting of a combination of the learning input data and the learning output data, machine learning of the prediction model was performed to obtain a trained prediction model. For machine learning, we used "TensorFlow" and trained a six-layer convolutional neural network. Note that the combination of a convolutional layer and a pooling layer is counted as one layer. The number of learning times was 500,000, and the number of image data (learning input data) input in each learning was 50 (randomly selected). In addition, the least squares method was used as the error function in the learning.

[0050] As samples for validation data, concrete samples 2, 8-10, 12, and 16-20, which were not used for learning, were selected. For each sample, 450 still images showing the entire interior of the twin-shaft mixer were obtained from a 15-second video sequence starting one minute after water was poured into the mixer and mixing began, with a frame rate of 30 frames per second. From each still image, image data (256 × 256 pixels) was extracted from the range in which the ready-mixed concrete materials located nearby could be reflected for all of the above sections (1) to (3). Next, using the position where the image data was extracted as a reference, eight 256 × 256 pixel image data pieces (each extracted at a different position) were extracted from positions shifted by 10 pixels vertically and horizontally (up and down and left and right). In other words, a total of nine image data pieces were extracted from one still image, resulting in 11,250 images per sample, for a total of 112,500 images.

[0051] Each of the obtained image data was reduced to an image size of 64×64 pixels, and then each pixel constituting the image data was converted into a grayscale image with 256 gradations. A standardization process was performed on the converted image data (grayscale image), and the standardized image data was input as input data for prediction into the trained prediction model. The prediction model then output, as output data for prediction regarding the finishability of concrete, the predicted slump value of the sample from which the image data used as input data for learning was obtained, and a qualitative evaluation of the finishability of concrete (output data for prediction regarding the finishability of concrete). For each of the verification data samples (a total of 10 samples: Concrete 2, 8-10, 12, and 16-20), the prediction input data (11,250 image data) obtained from the samples was input into the prediction model, and the average value of the predicted slump (prediction output data) was calculated. The actual measured slump values ​​of the samples were then compared with the average value, and the average value was considered correct (within the acceptable range) if it was within ±0.25 cm of the actual measured value. The accuracy rate (the percentage of samples for which the average value was within ±0.25 cm of the actual measured value of slump) obtained from the verification data samples (10 samples) was 80%. In addition, for each of the verification data samples (a total of 10 samples: concrete 2, 8-10, 12, and 16-20), the prediction input data (11,250 image data) obtained from the above samples was input into the prediction model, and the most frequent values ​​(10) of the qualitative evaluation of the concrete finishability were obtained as prediction output data. The accuracy rate of the obtained finishability data (the percentage of samples for which the prediction was correct (i.e., the predicted rating (-2, -1, 0, 1, or 2) was the same as the actual rating of the sample (-2, -1, 0, 1, or 2)))) was 90%. From Example 1, it can be seen that according to the present invention, the finishability of concrete can be predicted with high accuracy using image data.

[0052] [Example 2] In the actual production of concrete at a concrete product factory, the finishability of concrete was predicted using the concrete quality prediction method described below. The concrete materials used were cement (ordinary Portland cement, moderate-heat Portland cement, or low-heat Portland cement), fine aggregate (a mixture of crushed sand and mountain sand), coarse aggregate (crushed stone 2005), and admixtures (at least one selected from air-entraining agents, air-entraining water-reducing agents, and high-performance air-entraining water-reducing agents). The type and amount of each material was determined appropriately so that the water-cement ratio of the concrete was in the range of 30-40% and the slump value of the resulting concrete was in the range of 2-4 cm. Each material was mixed in a twin-shaft mixer (capacity 5 m 3 ) is used, the mixing time is within the range of 60 to 120 seconds, and the total amount of each ingredient is 1.00 to 3.25 m 3 The range was set as follows.

[0053] Under the above conditions, 70 batches of concrete with various blending ratios were produced, and training data was obtained from the batches. Specifically, a video camera was installed on top of the twin-shaft mixer to capture video images of the materials being mixed during concrete production. The captured video images were displayed on a monitor in the monitoring room via a video signal distributor and saved as video data on an SD card in the recording device. Video images were taken for 15 seconds, starting 15 seconds before the end of mixing (just before the concrete was discharged from the twin-shaft mixer) and continuing for 15 seconds until the end of mixing. The video was recorded at 30 frames per second, resulting in 450 (30 x 15) still images showing the entire interior of the twin-shaft mixer. Image data (512 x 512 pixels) was extracted from each still image in an area that could potentially capture concrete material located near the mixing blades that are fixed to the rotating shaft inside the twin-shaft mixer. The above range was determined by checking multiple consecutive still images over time and determining that the concrete surface reflected in the images had significant movement, and this range was the area near the stirring blades. The power load value of the twin-shaft mixer was already in a stable state when the video recording started, and remained stable until the mixing was completed.

[0054] Furthermore, using the position where the image data was extracted as a reference, a total of 24 512 x 512 pixel image data pieces (image data extracted at different positions) were extracted from positions shifted by 5 pixels in the vertical and horizontal directions (up and down and left and right directions). In other words, a total of 25 image data pieces were extracted from one still image, resulting in 11,250 (30 x 15 x 25) pieces of image data per batch, for a total of 787,500 (11,250 x 70) pieces of image data (70 batches of image data). In addition, for all of the above-mentioned parts, the 25 pieces of image data were image data from an area in which concrete material located near the mixing blades fixed to the rotating shaft inside the twin-shaft mixer could be reflected. Next, each image data was reduced to an image size of 64 x 64 pixels, and the resulting 64 x 64 pixel image data was converted into a grayscale image with 256 gradations for each pixel (picture element) that makes up the image data. The converted image data (grayscale images) were standardized, and 630,000 images, equivalent to 80% of the standardized image data (787,500 images), were used as input data for training. The remaining 20%, or 157,500 images, were used as test data to verify the reliability of the prediction model obtained after machine learning.

[0055] The concrete after production was discharged from the mixer, and the discharged concrete was sampled. The actual slump values ​​of 70 batches were measured in accordance with "JIS A 1101:2014 (Concrete slump test method)", and these actual measured values ​​were used as learning output data or test data. In addition, qualitative evaluation of the finishability of 70 batches of concrete (evaluation based on the worker's visual inspection and sense during manual work, with very hard being ``-2'', hard being ``-1'', good being ``0'', soft being ``1'', and very soft being ``2''; data regarding the finishability of concrete) was used as learning output data or test data. The training data was a combination of training input data (image data) and training output data (measured slump value and qualitative evaluation of concrete finishability) for the batch from which the image data used as the training input data was obtained. The video data in the SD card was saved to another computer, and then the computer was used to perform machine learning of the prediction model using the training data, thereby obtaining a trained prediction model. For machine learning, we used "TensorFlow" and performed training using a seven-layer convolutional neural network. In training, we also used the least squares method as the error function. The number of learning rounds was set to 500,000, and the number of image data (learning input data) input in each learning round was set to 50 (randomly selected).

[0056] For verification data, 26 new batches of concrete were produced under the same conditions as the 70 batches described above, and video images were taken in the same manner as the 70 batches of concrete described above. From the video images, 450 (30 x 15) still images were obtained per batch. From each still image, one image data was extracted in the same manner as for the 70 batches described above, and then, using the position where the image data was extracted as a reference, eight 512 x 512 pixel image data pieces (image data pieces with all different extraction positions) were extracted from positions shifted by 10 pixels in the vertical and horizontal directions (up and down and left and right directions). In other words, a total of nine image data pieces were extracted from one still image, resulting in 4,050 (30 x 15 x 9) images per batch, for a total of 105,300 (4,050 x 26) image data pieces (26 batches of image data). The image data is located near all of the above (1) to (3). The image data was of an area in which the concrete material to be placed could be reflected. Next, each image data was reduced to an image size of 64×64 pixels, and each pixel constituting the image data was converted into a grayscale image with 256 gradations. The converted image data (grayscale image) was subjected to standardization processing, and the standardized image data was used as verification data. Furthermore, the actual slump values ​​of the ready-mixed concrete after production and the qualitative evaluation of the finishability of the concrete were measured in the same manner as for the above-mentioned 70 batches of ready-mixed concrete.

[0057] The 26 batches of image data from which the verification data was obtained were input as prediction input data into the trained prediction model, and the prediction model output data for prediction regarding the finishability of concrete: a predicted value of concrete slump and a qualitative evaluation of the finishability of concrete. Next, the average value of the predicted value of concrete slump and the most frequent value of the qualitative evaluation of the finishability of concrete were obtained for each batch. When the actual measured slump value was compared with the average predicted slump value (the average predicted slump value of the concrete output as prediction output data), and batches where the average predicted slump value was within ±0.25 cm of the actual measured value were considered correct (within the acceptable range), the accuracy rate was 88%.In addition, the accuracy rate for the most common value of the qualitative evaluation of concrete finishability (the percentage of cases where the prediction was correct (i.e., the predicted classification (-2, -1, 0, 1, or 2) was the same as the actual sample classification (-2, -1, 0, 1, or 2))) was 92%. These results show that the present invention makes it possible to predict the finishability of concrete with high accuracy using image data.

Claims

1. 1. A method for predicting concrete quality using a predictive model, comprising: The prediction model is created by machine learning using a plurality of pieces of training data, which are combinations of training input data including image data and training output data related to the finishability of concrete, inputting prediction input data including image data into the prediction model, outputting prediction output data relating to the finishability of concrete from the prediction model, and predicting the quality of concrete using the prediction output data; the learning data is obtained from concrete having a design slump value within a range of 0 to 5 cm, and the design slump value of the concrete to be predicted is within a range of 0 to 5 cm, A method for predicting the quality of concrete, wherein the learning output data and the prediction output data are data relating to work during concrete finishing.

2. 2. The method for predicting quality of concrete according to claim 1, wherein the learning output data and the prediction output data are qualitative evaluations of the finishability of concrete.

3. 3. The method for predicting quality of concrete according to claim 1, wherein the learning output data and the prediction output data include data relating to the quality of finished concrete.

4. The method for predicting concrete quality according to any one of claims 1 to 3, wherein at least one type of data among the data used as the learning input data and the data used as the prediction input data is standardized data.

5. the standardized data is image data included in the learning input data and the prediction input data, 5. The method for predicting quality of concrete according to claim 4, wherein the image data is a grayscale image, and the pixel values ​​of the pixels constituting the grayscale image are standardized.

6. The image data is a plurality of image data continuously captured to capture a state in which concrete materials are mixed in a mixer for mixing the materials, The method for predicting quality of concrete according to any one of claims 1 to 5, wherein the image data and the prediction output data are displayed on a display means.

7. The method for predicting concrete quality according to any one of claims 1 to 6, wherein at least one type of data included in the learning input data and the prediction input data is obtained from an information management system in a concrete factory.

Images