Tire failure determination method and tire failure determination device

The tire failure determination method employs thermography and temperature analysis to automate tire inspection, improving detection accuracy and efficiency by prioritizing inspections and predicting tire replacement needs, addressing the inefficiencies of current methods in industrial settings.

WO2024247312A1PCT designated stage expired Publication Date: 2024-12-05BRIDGESTONE CORP
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2023/042268
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-31
Filing Date
2023-11-24
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

Current tire failure detection methods are inefficient and costly, particularly in industrial settings like mining, where sudden tire breakdowns lead to decreased productivity and require periodic inspections, necessitating an automated solution for improved tire failure determination.

Method used

A tire failure determination method using a thermography camera to acquire thermoimages of tires, analyzing surface temperature variations, and estimating damage depth based on both surface and inner cavity temperatures, with alerts for prioritizing inspections and predicting tire replacement needs.

Benefits of technology

This method enhances the accuracy and efficiency of tire failure detection by identifying high-risk areas for closer inspection and reducing unnecessary checks, thereby improving productivity and reducing maintenance costs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2023042268_05122024_PF_FP_ABST
    Figure JP2023042268_05122024_PF_FP_ABST
Patent Text Reader

Abstract

A tire failure determination method according to the present disclosure is carried out by a computer, said method comprising: acquiring a thermographic image obtained by imaging a tire with a thermography camera; determining a relative relationship between surface temperatures which have been respectively acquired for a plurality of damaged parts of the tire on the basis of the thermographic image; and notifying a user of a first alert on the basis of a determination result of the relative relationship.
Need to check novelty before this filing date? Find Prior Art

Description

Tire failure detection method and tire failure detection device

[0001] The present disclosure relates to a tire malfunction determination method and a tire malfunction determination device.

[0002] There are known technologies for determining tire damage. For example, Patent Literature 1 discloses a tire damage detection system that detects the size of a damaged portion of a tire based on the diameter of a rim wheel, based on image data of the tire mounted on the rim wheel.

[0003] Patent Publication No. 2019-202729

[0004] However, there is a need for further improvements in the usefulness of technology for determining tire failure. For example, if a mining vehicle used at a mining site experiences a sudden tire failure, productivity is reduced due to the need to transport the vehicle and change the tire. Regular tire inspections by workers to prevent sudden failures are a cost burden. Therefore, there is a need for automation of tire failure determination.

[0005] In view of the above circumstances, an object of the present disclosure is to provide a tire fault determination method and a tire fault determination device that improve the usefulness of the technology for determining tire faults.

[0006] [1] A tire fault detection method according to one embodiment of the present disclosure is a computer-implemented tire fault detection method that includes: acquiring a thermal image of a tire captured by a thermographic camera; determining a relative relationship between the surface temperatures acquired for each of a plurality of damaged portions of the tire based on the thermal image; and notifying a user of a first alert based on the result of the determination of the relative relationship. The tire fault detection method according to one embodiment of the present disclosure can motivate a user to more thoroughly inspect damaged portions of the tire in the thermal image that have particularly high surface temperatures. Conversely, the tire fault detection method can also encourage a user to simplify or omit inspection of damaged portions of the tire in the thermal image that have low surface temperatures. Therefore, the tire fault detection method can improve the usefulness of tire fault detection technology.

[0007] [2] A tire fault detection method according to an embodiment of the present disclosure is the tire fault detection method described in [1] above, wherein determining the relative relationship may include determining whether the surface temperatures of the plurality of damaged portions at the same time include an outlier that is relatively high above a first threshold. A tire fault detection method having such a configuration makes it possible to identify a damaged portion having a relatively high surface temperature among the plurality of damaged portions.

[0008] [3] In a tire fault determination method according to an embodiment of the present disclosure, the tire fault determination method according to the above [2] may include, when it is determined that the tire contains an outlier, notifying the first alert may include prompting the user to inspect the damaged portion corresponding to the outlier. The tire fault determination method having such a configuration allows the user to grasp the location of a specified damaged portion among multiple damaged portions in the tire, thereby motivating the user to inspect the damaged portion.

[0009] [4] A tire fault detection method according to an embodiment of the present disclosure is the tire fault detection method described in any one of [1] to [3] above, wherein determining the relative relationship may include determining whether the amount of change over time in the surface temperature of the plurality of damaged portions includes a relatively high outlier that exceeds a second threshold. A tire fault detection method having such a configuration makes it possible to identify, among the plurality of damaged portions, a damaged portion whose surface temperature changes over time are significant.

[0010] [5] A tire fault detection method according to one embodiment of the present disclosure is the tire fault detection method described in any one of [1] to [4] above, and may further include acquiring the tire cavity temperature and estimating the depth of each of the plurality of damaged portions based on the surface temperature in the thermal image and the cavity temperature at the time the thermal image was captured. According to this tire fault detection method, using the tire cavity temperature can improve the accuracy of estimating the depth of the damaged portion based on the surface temperature of the damaged portion of the tire. Therefore, this tire fault detection method can improve the usefulness of the technology for detecting tire faults.

[0011] [6] A tire fault detection method according to an embodiment of the present disclosure is the tire fault detection method described above in [5], wherein estimating the depth may include correcting the depth depending on the position of the damaged portion in the tire. According to a tire fault detection method having such a configuration, by taking into account structural characteristics inside the tire, it is possible to further improve the accuracy of estimating the depth of the damaged portion.

[0012] [7] A tire fault detection method according to an embodiment of the present disclosure is the tire fault detection method described in [5] or [6] above, and may further include notifying the user of a second alert based on the depth estimation result. A tire fault detection method having such a configuration can also notify the user of an estimate of when to replace the tire due to the fault.

[0013] [8] In a tire failure determination method according to an embodiment of the present disclosure, the tire failure determination method according to the above [7] may include notifying the user that the tire is faulty due to the corresponding damaged portion when it is determined that the estimated depth is not within an allowable range of durability of the tire. A tire failure determination method having such a configuration makes it possible to notify the user that the tire should be immediately replaced due to a fault.

[0014] [9] A tire fault detection device according to an embodiment of the present disclosure includes a control unit that acquires a thermal image of a tire captured by a thermographic camera, determines the relative relationship of the surface temperatures acquired for each of multiple damaged portions of the tire based on the thermal image, and notifies a user of a first alert based on the determination result of the relative relationship. The tire fault detection device according to an embodiment of the present disclosure can motivate a user to more thoroughly inspect damaged portions of the tire in the thermal image that have particularly high surface temperatures. Conversely, the tire fault detection device can also encourage a user to simplify or omit inspection of damaged portions of the tire in the thermal image that have low surface temperatures. Therefore, the tire fault detection device can improve the usefulness of technology for detecting tire faults.

[0015] According to the present disclosure, it is possible to provide a tire fault determination method and a tire fault determination device that can improve the usefulness of the technology for determining tire faults.

[0016] Fig. 6 is a diagram showing a schematic configuration of a tire malfunction determination system. Fig. 7 is a block diagram showing the configuration of a server. Fig. 8 is a sequence diagram showing a first operation of the tire malfunction determination system. Fig. 9 is a sequence diagram showing a second operation of the tire malfunction determination system. Fig. 10 is a diagram showing an example of a thermo image of a tire. Fig. 11 is a graph showing how the surface temperature of a plurality of damaged portions of a tire changes over time. Fig. 12 is another graph corresponding to Fig. 6.

[0017] A tire fault determination system according to an embodiment of the present disclosure will be described below with reference to the drawings. Common components and parts in each drawing are designated by the same reference numerals. However, please note that the drawings are schematic, and the proportions of each dimension may differ from those in reality.

[0018] (Configuration of Tire Failure Determination System) First, an overview of a tire failure determination system 1 according to this embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing the schematic configuration of the tire failure determination system 1. As shown in Fig. 1, the tire failure determination system 1 includes a server 10, an imaging device 20, a measuring device 30, and a terminal device 40. Fig. 1 shows one server 10, one imaging device 20, one measuring device 30, and one terminal device 40. However, the tire failure determination system 1 may include any number of servers 10, one imaging device 20, one measuring device 30, and one terminal device 40.

[0019] The server 10 is configured with one or more computers. In this embodiment, the server 10 is described as being configured with one computer. However, the server 10 may be configured with multiple computers, such as in a cloud computing system. In this disclosure, the server 10 is also referred to as a "tire malfunction determination device."

[0020] The imaging device 20 is configured with a computer including one or more cameras. The imaging device 20 is equipped with, for example, a thermographic camera capable of capturing thermal images. However, the imaging device 20 is not limited to a thermographic camera, and may be equipped with a camera capable of capturing any image, such as a visible light camera or an infrared camera. The image captured by the imaging device 20 may be a still image such as a photograph, or may be a video. As shown in FIG. 5 , which will be described later, the imaging device 20 generates a thermographic image 60 of the tire 2 and transmits it to the server 10. In this embodiment, the thermographic image 60 of the tire 2 captures at least a portion of the tire 2. The thermographic image 60 of the tire 2 may also capture at least a portion of the vehicle 3 on which the tire 2 is mounted, in addition to at least a portion of the tire 2.

[0021] 1 again, the imaging device 20 may be, for example, a fixed imaging device 20 installed on the travel route of the vehicle 3 at the mine site. This allows the imaging device 20 to capture images of the vehicle 3 traveling on the travel route, and is less likely to reduce the operating rate of the vehicle 3 and productivity at the mine. However, the imaging device 20 is not limited to a fixed imaging device 20, and may be an imaging device 20 mounted on a drone or a mobile imaging device 20 such as a tablet terminal that can be carried by a person.

[0022] The measurement device 30 is configured with a computer including one or more sensors. The sensors may be, but are not limited to, a digital tachograph, a tire pressure monitoring system (TPMS), an electronic control unit (ECU), a car navigation device, or the like. The measurement device 30 acquires time-series data regarding the tire 2 mounted on the vehicle 3 and transmits the data to the server 10. Therefore, the measurement device 30 may be installed on the vehicle 3 or the tire 2.

[0023] The time-series data regarding the tire 2 mounted on the vehicle 3 includes measurement values ​​regarding the tire 2, the measurement dates and times, etc. For example, if the measurement device 30 includes a TPMS installed on the tire 2, the measurement values ​​regarding the tire 2 may include tire condition information of the tire 2, such as the internal pressure (air pressure), cavity temperature, or thermal history of the tire 2. The thermal history of the tire 2 is the history of heat applied to the tire 2 as the tire 2 is used. The thermal history of the tire 2 is used to evaluate how much energy has been applied to the tire 2 since the tire 2 was first used. Generally, the greater the thermal history, the more severe the deterioration of the tire 2. The thermal history can be calculated, for example, by applying the cavity temperature of the tire 2 to the Arrhenius equation. For example, if the measurement device 30 includes a digital tachograph installed on the vehicle 3, the measurement values ​​regarding the tire 2 may include driving information of the vehicle 3, such as the driving time, driving distance, speed, acceleration, or number of rotations of the tire 2.

[0024] The terminal device 40 is a computer such as a smartphone, a tablet terminal, or a personal computer.

[0025] The network 50 is any communication network that allows communication between the server 10, the imaging device 20, the measuring device 30, and the terminal device 40. The network 50 in this embodiment may be, for example, the Internet, a mobile communication network, a local area network (LAN), or a combination of these.

[0026] The tire malfunction determination system 1 is used to determine malfunctions in one or more tires 2. In the tire malfunction determination system 1, the server 10 acquires a thermographic image 60 of the tire 2 captured by a thermographic camera from, for example, the imaging device 20. The server 10 determines the relative relationship between the surface temperatures acquired for each of a plurality of damaged portions of the tire 2 based on the thermographic image 60.

[0027] The server 10 acquires time-series data of the cavity temperature of the tire 2 from the measuring device 30. The server 10 estimates the depth of each of the multiple damaged portions based on the surface temperatures of the multiple damaged portions of the tire 2 in the thermal image 60 and the cavity temperature at the time the thermal image 60 was captured. In this way, according to the tire failure determination system 1, by using the cavity temperature of the tire 2 in addition to the surface temperatures of the multiple damaged portions of the tire 2 in the thermal image 60, the depth of the damaged portions can be estimated more accurately.

[0028] In the present disclosure, the tire 2 is not particularly limited, but may be an OR (Off The Road) tire mounted on a mining vehicle such as a transport vehicle, construction vehicle, work vehicle, or heavy equipment vehicle used at a mining site, etc. However, the tire 2 may be a tire other than an OR tire.

[0029] In the present disclosure, the vehicle 3 is, for example, a mining vehicle used at a mining site, etc. However, the vehicle 3 is not limited to the above-described mining vehicle, and may be any vehicle on which the tire 2 can be mounted, such as a transport vehicle, a construction vehicle, a work vehicle or heavy machinery vehicle, a bus, a passenger car, a motorcycle, a bicycle, or an airplane.

[0030] The configuration of the server 10, which is a tire malfunction determination device, will be described in detail with reference to Fig. 2. Fig. 2 is a block diagram showing the configuration of the server 10. As shown in Fig. 2, the server 10 includes a communication unit 11, an output unit 12, an input unit 13, a storage unit 14, and a control unit 15. In the server 10, the communication unit 11, the output unit 12, the input unit 13, the storage unit 14, and the control unit 15 are connected to each other via wire or wirelessly so as to be able to communicate with each other.

[0031] The communication unit 11 includes a communication module for connecting to the network 50. The communication module is a communication module compatible with mobile communication standards such as 4G (4th Generation) or 5G (5th Generation). The communication module may be a communication module compatible with standards such as wired LAN or wireless LAN. The communication module may be a communication module compatible with short-range wireless communication standards such as Wi-Fi (registered trademark), Bluetooth (registered trademark), or infrared communication. In this embodiment, the server 10 is connected to the network 50 via the communication unit 11. This allows the server 10 to communicate with the imaging device 20, the measurement device 30, the terminal device 40, other computers, etc.

[0032] The output unit 12 includes one or more output devices, such as a display, a speaker, a lamp, etc. As a result, the output unit 12 outputs an image, sound, light, etc.

[0033] The input unit 13 includes one or more input devices, such as a touch panel, a camera, a microphone, etc. The input unit 13 receives input operations by the user of the server 10, for example.

[0034] The storage unit 14 is, for example, a semiconductor memory, a magnetic memory, an optical memory, or the like. The storage unit 14 functions, for example, as a main storage device, an auxiliary storage device, or a cache memory. The storage unit 14 stores any information used in the operation of the server 10. For example, the storage unit 14 stores a system program, an application program, embedded software, a database, or the like. The information stored in the storage unit 14 may be updatable with information obtained from the network 50 via the communication unit 11, for example.

[0035] For example, the storage unit 14 may store tire identification information of one or more tires 2 that are the target of failure determination. In the present disclosure, tire identification information is also referred to as a tire ID (Identifier). The tire identification information of a tire 2 is information that can uniquely identify the tire 2. The tire identification information of a tire 2 is, for example, uniquely issued by the server 10, but is not limited to this and may be the manufacturing number of the tire 2 or the vehicle number of the vehicle 3 on which the tire 2 is mounted, etc. The storage unit 14 may store information related to the tire 2 in association with the tire identification information of the tire 2.

[0036] The information about the tire 2 includes any information about the tire 2. The information about the tire 2 may include, for example, the time-series data about the tire 2 described above, damage information about the tire 2, configuration information about the tire 2, information about the vehicle 3 on which the tire 2 is mounted, or position information about the location of the tire 2 on the vehicle 3. The damage information about the tire 2 may be information including, for example, the position, shape, depth, and registration date and time of damage previously sustained by the tire 2. The configuration information about the tire 2 includes, for example, the type, model number, material properties, tread pattern, belt angle, size, or weight of the tire 2. The information about the vehicle 3 on which the tire 2 is mounted includes identification information, type, model number, engine displacement, number of tires mounted, or number of shafts of the vehicle 3.

[0037] The control unit 15 includes one or more processors. The processor may be, for example, a general-purpose processor such as a CPU (Central Processing Unit) or a dedicated processor specialized for specific processing. The control unit 15 is not limited to a processor and may include one or more dedicated circuits. The dedicated circuits may be, for example, an FPGA (Field-Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit). The control unit 15 controls each component to realize the functions of the server 10, including the functions of the components such as the communication unit 11, the output unit 12, the input unit 13, and the memory unit 14 described above.

[0038] (Operation of Tire Failure Determination System) The operation of the tire failure determination system 1 will be described with reference to Figures 3, 4, 5, 6, and 7. Figure 3 is a sequence diagram showing a first operation of the tire failure determination system 1. Figure 4 is a sequence diagram showing a second operation of the tire failure determination system 1. Figure 5 is a diagram showing an example of a thermal image 60 captured of the tire 2. Figure 6 is a graph showing how the surface temperature of multiple damaged portions 70 of the tire 2 changes over time. Figure 7 is another graph corresponding to Figure 6.

[0039] 3 illustrates the operations of the server 10, the imaging device 20, the measuring device 30, and the terminal device 40 included in the tire malfunction determination system 1. Therefore, the explanation of the operations corresponds to the tire malfunction determination method executed by the tire malfunction determination system 1, and also corresponds to the tire malfunction determination method executed by each of the server 10, the imaging device 20, the measuring device 30, and the terminal device 40 included in the tire malfunction determination system 1.

[0040] For the purpose of explaining this operation, it is assumed that the control unit 15 of the server 10 stores, in the memory unit 14, the tire identification information of the tire 2 and information about the tire 2 associated with the tire identification information of the tire 2.

[0041] In this operation example, as an example, an operation will be described in which the server 10 detects multiple damaged portions 70 on the outer surface of the side of the tire 2 based on the thermo image 60 shown in Fig. 5. In such a case, the imaging device 20 may be installed in a position on the travel path of the vehicle 3 at the mining site where it can capture the thermo image 60 of the side of the vehicle 3.

[0042] Referring to FIG. 3, in step S101 , the measurement device 30 acquires time-series data related to the tire 2 mounted on the vehicle 3 and transmits the data to the server 10 .

[0043] Specifically, the measurement device 30 uses a sensor to acquire time-series data related to the tire 2 at a predetermined timing. The measurement device 30 may associate the acquired time-series data related to the tire 2 with identification information of the tire 2 and transmit the data to the server 10. For example, the measurement device 30 may transmit time-series data related to the tire 2 to the server 10 each time the measurement device 30 acquires the time-series data. Alternatively, the measurement device 30 may collectively transmit time-series data measured over a predetermined period to the server 10. In this operation example, the measurement device 30 includes a digital tachograph and a TPMS. Therefore, the time-series data related to the tire 2 may include tire condition information of the tire 2, such as the internal pressure (air pressure), cavity temperature, and thermal history of the tire 2, as well as driving information of the vehicle 3, such as the driving time and driving distance of the vehicle 3. However, the time-series data transmitted from the measurement device 30 is not limited to the information described above.

[0044] In step S102, the control unit 15 of the server 10 acquires time-series data related to the tire 2, including the temperature of the tire cavity and the like.

[0045] Specifically, the control unit 15 of the server 10 receives time series data related to the tire 2 from the measuring device 30 via the communication unit 11. However, the control unit 15 may receive the time series data related to the tire 2 acquired by the measuring device 30 via a computer other than the measuring device 30. The control unit 15 may store the received time series data related to the tire 2 in the storage unit 14 in association with the identification information of the tire 2.

[0046] In step S103 , the imaging device 20 transmits a thermographic image 60 of the tire 2 captured by the thermography camera to the server 10 .

[0047] Specifically, the imaging device 20 uses a thermographic camera to capture an image of the tire 2 and generate a thermographic image 60 of the tire 2. In this operation example, as shown in FIG. 5 , the thermographic image 60 is described as a single still image, but it may be a plurality of continuously captured still images or a video. The imaging device 20 transmits the captured thermographic image 60 to the server 10 along with information on the capture time of the thermographic image 60. However, the image transmitted from the imaging device 20 is not limited to the thermographic image 60. For example, the imaging device 20 may transmit a photograph taken with a visible light camera to the server 10 along with the thermographic image 60. The thermographic image 60 of the tire 2 may include at least a portion of the tire 2 and at least a portion of the vehicle 3 on which the tire 2 is mounted. The thermographic image 60 shown in FIG. 5 captures the tire 2 and a portion of the vehicle 3 on which the tire 2 is mounted.

[0048] Referring back to FIG. 3, in step S104, the control unit 15 of the server 10 acquires a thermo image 60 of the tire 2.

[0049] Specifically, the control unit 15 of the server 10 receives a thermo image 60 of the tire 2 from the imaging device 20 via the communication unit 11, together with information on the time the thermo image 60 was captured. However, the control unit 15 may receive the thermo image 60 captured by the imaging device 20 via a computer other than the imaging device 20. The control unit 15 may store the received thermo image 60 and its capture time in the memory unit 14 in association with the identification information of the tire 2.

[0050] In step S104, the control unit 15 of the server 10 may further specify, from the thermographic image 60, the identification information of the tire 2 captured in the thermographic image 60. This allows the control unit 15 to identify the tire 2 from the thermographic image 60 even if the tire 2 captured in the thermographic image 60 has not been identified in advance. Specifically, the control unit 15 extracts a display portion indicating the identification information of the tire 2 from the thermographic image 60 by image processing. The display portion may be, for example, a two-dimensional code such as a QR (Quick Response) Code (registered trademark) attached to the tire 2 or the vehicle 3. In such a case, the control unit 15 can read the identification information of the tire 2 from the display portion which is a two-dimensional code. However, the display portion is not limited to a two-dimensional code and may be any display information such as a character string, a symbol, a figure, a color, a pattern, or a one-dimensional code.

[0051] The display portion indicating the identification information of the tire 2 may be displayed in any position. For example, the display portion may be provided on the outer surface of the tire 2, such as on the side of the tire 2. In this case, even if the tire 2 is remounted from one vehicle 3 to another vehicle 3 due to tire rotation or the like, the identification information of the tire 2 can be continuously identified based on the same display portion. However, the display portion may also be provided on the body of the vehicle 3 on which the tire 2 is mounted. In this case, since the display portion is provided on the body of the vehicle 3, the visibility of the display portion is less likely to decrease even if the outer surface of the tire 2 is soiled with mud or damaged. In this operation example, the control unit 15 of the server 10 is described as identifying the identification information of the tire 2 captured in the thermal image 60 from the thermal image 60, but this is not limited thereto. For example, if a photograph taken with a visible light camera is received from the imaging device 20 along with the thermal image 60, the control unit 15 may identify the identification information of the tire 2 from the photograph.

[0052] Referring again to FIG. 3, in step S105, the control unit 15 of the server 10 detects a plurality of damaged portions 70 on the outer surface of the tire 2 captured in the thermal image 60.

[0053] Any method can be used to detect the multiple damaged portions 70. For example, the control unit 15 of the server 10 may store in advance in the storage unit 14 an image analysis algorithm for identifying the multiple damaged portions 70 of the tire 2 captured in the thermal image 60.

[0054] Specifically, the control unit 15 of the server 10 uses an image analysis algorithm to detect areas on the outer surface of the tire 2 captured in the thermal image 60 that have a temperature higher than the surrounding areas by a threshold or more as damaged areas 70 such as cuts or cracks. Generally, the temperature of the inner cavity of the tire 2 rises as the vehicle 3 travels. The damaged areas 70 on the outer surface of the tire 2 are closer to the inner cavity of the tire 2 than other areas, and therefore have a higher surface temperature. For this reason, the thermal image 60 can be used to detect the position, depth, etc. of the damaged areas 70 on the outer surface of the tire 2.

[0055] By using the thermal image 60, damage detection accuracy is less likely to decrease even when damage detection accuracy is reduced in photographs taken with a visible light camera, such as when the outer surface of the captured tire 2 is dirty or when the tire 2 is photographed at night. In this operation example, the control unit 15 detects, as damaged portions 70, portions that are hotter than the surrounding portions in the thermal image 60 shown in FIG. 5 . However, if there are multiple damaged portions 70 in the tire 2, the control unit 15 may detect all of the multiple damaged portions 70. The control unit 15 may store information such as the positions and number of the detected damaged portions 70 in the memory unit 14 as damage information of the tire 2, in association with the identification information of the tire 2.

[0056] The threshold temperature used to detect the damaged portion 70 may be a fixed value, such as 5 degrees. In this case, the control unit 15 of the server 10 can detect, as the damaged portion 70, a portion of the outer surface of the tire 2 captured in the thermal image 60 that is 5 degrees or more higher than the surrounding portions. The threshold temperature may be changed by the control unit 15 depending on the cavity temperature of the tire 2 when the thermal image 60 was captured (or the thermal history calculated from the cavity temperature). For this purpose, the control unit 15 may store in advance in the memory unit 14 information correlating the threshold temperature with the cavity temperature of the tire 2.

[0057] In this embodiment, the image analysis algorithm and the threshold temperature calculation algorithm may be constructed using a statistical method such as machine learning or deep learning. For example, these algorithms may be constructed using a statistical method using a thermographic image 60 of the tire 2 and a damaged portion 70 in the tire 2 identified by a human or the like as training data. This allows the accumulation of training data to improve the accuracy of detecting the damaged portion 70 on the outer surface of the tire 2. However, the image analysis algorithm and the calculation algorithm may include predetermined arithmetic processing that does not rely on a statistical method.

[0058] In step S106 , the control unit 15 of the server 10 determines the relative relationship of the surface temperatures acquired for each of the multiple damaged portions 70 of the tire 2 based on the thermo image 60 .

[0059] Determining the relative relationship in step S106 may include determining whether or not the surface temperatures of the multiple damaged portions 70 in the tire 2 at the same time include any outliers that are relatively high and exceed a first threshold. In the present disclosure, the "first threshold" is determined based on the standard deviation of the surface temperatures of the multiple damaged portions 70 in the tire 2. For example, the first threshold may be the standard deviation itself, or may be a value that is two to three times or more the standard deviation that is considered typical when determining outliers using a statistical method.

[0060] Referring now to Figure 6, the results of a test study on how the surface temperature of multiple damaged portions 70 at different positions and depths in the tire 2 changes over time are shown. In Figure 6, the surface temperatures of the multiple damaged portions 70 in the tire 2 are represented by a cloud of points for each block of elapsed time, and a curve is used to represent a graph fitting the cloud of points. In Figure 6, the elapsed time increases as the numbers increase from block number 1. For example, time may pass at a fixed time interval of one hour for each block, or time may pass at different time intervals.

[0061] The horizontal axis of the graph shown in Figure 6 represents the distance from the inner tip of the damaged portion 70 of the tire 2 in the depth direction to a component such as a carcass ply that constitutes the tire 2. For example, in block number 1 of elapsed time, 11 points indicating the surface temperatures of the multiple damaged portions 70 are plotted for each distance. The distances for the multiple damaged portions 70 indicated by the 11 points are different from one another. The distance of the point plotted at a predetermined position on the horizontal axis in block number 1 is the same in each block from block number 2 onwards, and points are plotted at positions corresponding to the predetermined positions in each block.

[0062] As time passes, the surface temperatures of the multiple damaged portions 70 generally increase. As time passes, the range of variation in the surface temperatures of the multiple damaged portions 70 tends to widen. The difference between the minimum and maximum values ​​of the surface temperatures of the multiple damaged portions 70 tends to increase as time passes. However, even in such cases, the relative positional relationships of the plots for the surface temperatures of the multiple damaged portions 70 in each block are similar to each other. The profiles showing the dependence of the surface temperatures of the multiple damaged portions 70 on the distance are similar to each other in each block. In each block, the surface temperature of the damaged portions 70 tends to increase as the distance becomes smaller.

[0063] The control unit 15 of the server 10 determines whether or not the surface temperatures of multiple damaged portions 70 in the tire 2 at the same time, i.e., in the same block, contain any outliers that are relatively high above the first threshold. For example, as shown in an example in Figure 6, the control unit 15 determines that the surface temperatures of the multiple damaged portions 70 contain outliers if some of the multiple points plotted in each block are included in a relatively high temperature region S.

[0064] The process is not limited to the above, and determining the relative relationship in step S106 may include determining whether or not the amount of change over time in the surface temperature of the plurality of damaged portions 70 in the tire 2 includes a relatively high outlier that exceeds a second threshold. In the present disclosure, the "second threshold" is determined based on the standard deviation of the amount of change over time in the surface temperature of the plurality of damaged portions 70 in the tire 2. For example, the second threshold may be the standard deviation itself, or may be a value that is two to three times or more the standard deviation that is considered to be typical when determining outliers using a statistical method.

[0065] 7, there is shown a graph for one block of elapsed time shown in FIG. 6, and a graph of another example different from that shown in FIG. 6 after a predetermined time has elapsed from the one block. In FIG. 7, similar to FIG. 6, the surface temperatures of multiple damaged portions 70 in the tire 2 are represented by a cloud of points at two different times, and a graph fitting to the cloud of points is represented by a curve.

[0066] In Figure 6, the relative positional relationships of the plots regarding the surface temperatures of multiple damaged areas 70 were similar to each other even over time, but this is not limited to such a case. For example, as shown in Figure 7, it is also possible that only a specific point P changes significantly over time.

[0067] The control unit 15 of the server 10 compares the graphs of the surface temperatures of the multiple damaged portions 70 in the tire 2 at two different times and determines whether or not the graphs contain any outliers that are relatively high above the second threshold. For example, as shown in an example in Figure 7, if the amount of change over time in the surface temperature at point P plotted at a predetermined position on the horizontal axis is relatively large, the control unit 15 determines that the amount of change over time in the surface temperatures of the multiple damaged portions 70 contains an outlier.

[0068] 3 , in step S107, the control unit 15 of the server 10 notifies the user of a first alert based on the result of the determination of the relative relationship in step S106. Specifically, the control unit 15 of the server 10 generates information about the first alert and transmits it to the terminal device 40 via the communication unit 11.

[0069] Issuing the first alert in step S107 may include, when it is determined that the surface temperatures of the multiple damaged portions 70 include outliers, prompting inspection of the damaged portions 70 corresponding to the outliers. Issuing the first alert may further include identifying and presenting the position on the tire 2 of the damaged portions 70 corresponding to the outliers. The position of the damaged portions 70 on the tire 2 may be represented by the distance from the rotation axis R of the tire 2 in the tire radial direction, for example, as shown in FIG. 5 . Here, the "tire radial direction" refers to the direction perpendicular to the rotation axis R of the tire 2.

[0070] 3 , in step S108, the terminal device 40 displays the content of the first alert based on the notification of the first alert in step S107. By checking the content of the first alert displayed on the terminal device 40, the user can grasp the location of the damaged portion 70 identified by the server 10 among the multiple damaged portions 70 in the tire 2, and is motivated to inspect the damaged portion 70.

[0071] 4, in step S201, the measurement device 30 acquires time-series data related to the tire 2 mounted on the vehicle 3 and transmits the data to the server 10. The specific processing content is the same as that of step S101 in FIG.

[0072] In step S202, the control unit 15 of the server 10 acquires time-series data related to the tire 2, including the temperature of the inner cavity of the tire 2. The specific processing content is the same as that of step S102 in FIG.

[0073] In step S203, the imaging device 20 transmits a thermographic image 60 of the tire 2 captured by the thermographic camera to the server 10. The specific processing content is the same as that of step S103 in FIG.

[0074] In step S204, the control unit 15 of the server 10 acquires a thermo image 60 of the tire 2. The specific processing content is the same as that of step S104 in FIG.

[0075] In step S205, the control unit 15 of the server 10 detects a plurality of damaged portions 70 on the outer surface of the tire 2 captured in the thermal image 60. The specific processing content is the same as that of step S105 in FIG.

[0076] In step S206, the control unit 15 of the server 10 estimates the depth of each of the multiple damaged portions 70 on the outer surface of the tire 2 captured in the thermal image 60.

[0077] Any method can be used to estimate the depth of the damaged portion 70. For example, the control unit 15 of the server 10 may estimate the depth of the damaged portion 70 from the surface temperature of the damaged portion 70 of the tire 2 detected in step S205. The control unit 15 may store in advance in the memory unit 14 a depth estimation algorithm for estimating the depth of the damaged portion 70 from the surface temperature of the damaged portion 70 on the outer surface of the tire 2. The control unit 15 estimates the depth of the damaged portion 70 from the surface temperature of the damaged portion 70 using the depth estimation algorithm. The depth of the damaged portion 70 is, for example, a depth corresponding to the portion of the damaged portion 70 of the tire 2 with the highest surface temperature.

[0078] At this time, the control unit 15 may estimate the depth of the damaged portion 70 using the cavity temperature of the tire 2 included in the time-series data related to the tire 2 acquired from the measuring device 30, in addition to the surface temperature of the damaged portion 70 of the tire 2 in the thermal image 60. More specifically, in estimating the depth of the damaged portion 70 shown in the thermal image 60, the depth of the damaged portion 70 is corrected to a different value depending on the cavity temperature at the time the thermal image 60 was captured. Estimating the depth of the damaged portion 70 in step S206 includes correcting the depth of the damaged portion 70 depending on the cavity temperature at the time the thermal image 60 was captured. The surface temperature of the damaged portion 70 of the tire 2 changes due to the influence of the cavity temperature of the tire 2. Therefore, by correcting the surface temperature of the damaged portion 70 using the relative relationship with the cavity temperature of the tire 2, the accuracy of estimating the depth of the damaged portion 70 can be improved.

[0079] As described above, in order to correct the depth of the damaged portion 70 estimated from the surface temperature of the damaged portion 70 on the outer surface of the tire 2 using the cavity temperature of the tire 2, the control unit 15 of the server 10 may store in advance in the storage unit 14 information correlating the surface temperature and depth of the damaged portion 70 with the cavity temperature of the tire 2. As the vehicle 3 travels further and the cavity temperature of the tire 2 increases, the deviation between the temperature of the damaged portion 70 and the cavity temperature of the tire 2 increases. Therefore, in estimating the depth of the damaged portion 70, the control unit 15 may correct the depth of the damaged portion 70 such that the higher the cavity temperature of the tire 2 when the thermal image 60 is captured, the greater the correction amount for the depth of the damaged portion 70. In this way, by performing correction using the relative relationship between the surface temperature of the damaged portion 70 and the cavity temperature of the tire 2, the accuracy of estimating the depth of the damaged portion 70 can be improved.

[0080] In this embodiment, the depth estimation algorithm may be constructed using a statistical method such as machine learning or deep learning. For example, the depth estimation algorithm may be constructed using a statistical method using training data that includes the characteristics of the damaged portion 70 of the tire 2 and the depth of the damaged portion 70 measured by a human or the like. This allows the accumulation of training data to improve the accuracy of estimating the depth of the damaged portion 70 of the tire 2. However, the depth estimation algorithm may include a predetermined calculation process that does not rely on a statistical method.

[0081] Estimating the depth of the damaged portion 70 in step S206 may include correcting the depth of the damaged portion 70 depending on the position of the damaged portion 70 in the tire 2. Even if the damaged portion 70 is at the same depth, the temperature (surface temperature) of the damaged portion 70 may differ depending on the position of the damaged portion 70 in the tire 2. For example, if a folded-up portion of the carcass ply of the tire 2 is present on the inner cavity side of the damaged portion 70, the surface temperature of the damaged portion 70 will be higher than if no folded-up portion of the carcass ply is present. This is because heat from the folded-up portion of the carcass ply is transferred to the damaged portion 70. In this way, the way in which the temperature of the inner cavity of the tire 2 is transferred to the surface of the damaged portion 70 varies depending on, for example, the thickness of the rubber in the damaged portion 70, the presence or absence of a carcass ply, and other internal structure differences. Therefore, by taking into account structural characteristics inside the tire 2 that differ depending on the distance from the rotation axis R of the tire 2 in the tire radial direction, the accuracy of estimating the depth of the damaged portion 70 can be further improved.

[0082] The control unit 15 may store the estimated depth of the damaged portion 70 in the memory unit 14 as damage information of the tire 2 in association with the identification information of the tire 2. If only one damaged portion 70 is detected in the tire 2 captured in the thermal image 60, the control unit 15 may estimate the depth of only one damaged portion 70 in this step.

[0083] In step S207, the control unit 15 of the server 10 determines whether the depth of the damaged portion 70 of the tire 2 is within the allowable range of durability of the tire 2.

[0084] In the determination in step S207, the allowable range of durability of the tire 2 may be determined arbitrarily. For example, the allowable range of durability of the tire 2 may be determined according to the depth of the damaged portion 70 of the tire 2. For example, if the depth of the damaged portion 70 is greater than a value determined as the allowable range of durability of the tire 2, the control unit 15 of the server 10 can determine that the depth of the damaged portion 70 of the tire 2 is outside the allowable range of durability of the tire 2. This allows the control unit 15 of the server 10 to automatically determine whether the tire 2 is within the allowable range of durability based on the depth of the damaged portion 70 of the tire 2. If multiple damaged portions 70 are detected in the tire 2 captured in the thermal image 60, the control unit 15 may make this determination based on the damaged portion 70 estimated to be the deepest of the multiple damaged portions 70. Alternatively, the control unit 15 may make this determination based on the total or average depth of the multiple damaged portions 70.

[0085] When multiple damaged portions 70 are detected in the tire 2 captured in the thermal image 60, the control unit 15 of the server 10 may determine whether the depths of the multiple damaged portions 70 are within an acceptable range based on the relative depths of the multiple damaged portions 70. Specifically, if the depth of any one of the multiple damaged portions 70 detected in the tire 2 is deeper than the other damaged portions 70, it is considered that the progression of that damaged portion 70 is rapid. Therefore, when a damaged portion 70 that is deeper than the other damaged portions 70 exists in the tire 2, the depth of the damaged portion 70 may be set to be more likely to exceed the acceptable range. This can further improve the accuracy of determining whether the tire 2 is within an acceptable range of durability based on the depth of the damaged portions 70 in the tire 2.

[0086] The tolerance range of the durability of the tire 2 may be set in multiple stages. For example, the tolerance range of the durability of the tire 2 may be set in stages, such as a level at which the tire 2 needs to be replaced immediately, a level at which the tire 2 needs to be replaced within one month, a level at which the tire 2 needs to be replaced within two months, etc. This allows the tire failure determination system 1 to perform different processing, such as sending a different warning message as a second alert (described later), depending on the level of the tolerance range of durability.

[0087] In step S208, the control unit 15 of the server 10 notifies the user of a second alert based on the estimation result of the depth of the damaged portion 70. Specifically, the control unit 15 of the server 10 generates information about the second alert and transmits it to the terminal device 40 via the communication unit 11.

[0088] Notifying the second alert in step S208 may include notifying that the tire 2 is faulty due to the corresponding damaged portion 70 when it is determined that the estimated depth of the damaged portion 70 is not within an acceptable range for durability of the tire 2. For example, notifying the second alert may include notifying a message warning that the tire 2 needs to be replaced immediately.

[0089] In step S209, the terminal device 40 displays the content of the second alert based on the notification of the second alert in step S208. The user confirms the content of the second alert displayed on the terminal device 40 and thereby understands that the tire 2 has a malfunction.

[0090] Without being limited to the above, notifying the second alert in step S208 may include outputting damage information for tire 2, including the position, number, or depth of damaged portion 70, when it is determined that damaged portion 70 of tire 2 is outside the acceptable range.

[0091] Any method can be employed for outputting the damage information of the tire 2. For example, the control unit 15 of the server 10 may display the damage information of the tire 2 via the output unit 12 such as a display. Alternatively, the control unit 15 may transmit a request to display the damage information of the tire 2 to the terminal device 40 via the communication unit 11. In such a case, the terminal device 40 can display the damage information of the tire 2 via a display or the like based on the request received from the server 10 in step S209.

[0092] The damage information of the tire 2 includes, for example, the depth of the damaged portion 70 of the tire 2. However, the damage information of the tire 2 is not limited to the depth of the damaged portion 70 of the tire 2, and may include any information such as the position, number, and warning messages of the damaged portions 70. As a result, the user of the tire failure determination system 1 can easily grasp the depth of the damaged portion 70 on the outer surface of the tire 2, and can plan inspection, repair, replacement, etc. of the tire 2 before the tire 2 fails.

[0093] In particular, when replacing the tires 2, the tires 2 may be replaced with different tires 2 according to the damage information of the tires 2. For example, if the surface temperature of the damaged portions 70 is higher than the temperature tolerance set for the tires 2, the tires 2 may be replaced with different types of tires 2 that are more heat resistant. Alternatively, if the number of damaged portions 70 is greater than a predetermined number, the tires 2 may be replaced with different types of tires 2 that are less susceptible to the presence of damaged portions 70. In this way, the user of the tire failure determination system 1 can select tires 2 that are suitable for use at mining sites based on the damage information of the tires 2.

[0094] As described above, in this embodiment, the server 10, which is a tire malfunction determination device, acquires a thermographic image 60 of the tire 2 captured by a thermographic camera, and determines the relative relationship of the acquired surface temperatures for each of the multiple damaged portions 70. The server 10 notifies the user of a first alert based on the determination result of the relative relationship.

[0095] According to this configuration, the server 10 can motivate the user to more carefully inspect damaged portions 70 of the tire 2 in the thermal image 60 that have particularly high surface temperatures. Conversely, the server 10 can also urge the user to simplify or omit inspection of damaged portions 70 of the tire 2 in the thermal image 60 that have low surface temperatures. Therefore, according to this embodiment, the usefulness of the technology for determining faults in the tire 2 can be improved.

[0096] In the above-described operational example, the tire malfunction determination system 1 has been described as detecting a damaged portion 70 on the outer surface of the side portion of the tire 2, but this is not limiting. The outer surface of the tire 2 that is the processing target of the tire malfunction determination system 1 may include at least one of the outer surface of the side portion or the outer surface of the tread portion of the tire 2. The tire malfunction determination system 1 may be used to detect a damaged portion 70 on the outer surface of the tread portion of the tire 2 in addition to or instead of the side portion of the tire 2.

[0097] In such a case, the imaging device 20 may be installed in a position where it can image the front or rear of the vehicle 3 in order to image the tread portion of the tire 2. As in the above-described operational example, the server 10 acquires a thermal image 60 of the tread portion of the tire 2 from the imaging device 20, and also acquires the cavity temperature of the tire 2. The server 10 estimates the depth of the damaged portion 70 based on the surface temperature of the damaged portion 70 of the tire 2 in the thermal image 60 and the cavity temperature at the time the thermal image 60 was captured. This allows the server 10 to determine the depth of the damaged portion 70 on the outer surface of the tread portion of the tire 2 in addition to / instead of the side portion of the tire 2.

[0098] Although the present disclosure has been described based on the drawings and embodiments, it should be noted that those skilled in the art can make various modifications and alterations based on the present disclosure. Therefore, it should be noted that these modifications and alterations are included within the scope of the present disclosure. For example, the configurations or functions included in each embodiment can be rearranged so as not to cause logical inconsistencies. The configurations or functions included in each embodiment can be used in combination with other embodiments, and multiple configurations or functions can be combined into one, divided, or partially omitted.

[0099] For example, an embodiment is also possible in which a general-purpose computer functions as the server 10 according to the above-described embodiment. Specifically, a program describing the processing content for realizing each function of the server 10 according to the above-described embodiment is stored in the memory of the general-purpose computer, and the program is read and executed by a processor. Therefore, the present disclosure can also be realized as a program executable by a processor or a non-transitory computer-readable medium storing the program. Examples of non-transitory computer-readable media include a magnetic recording device, an optical disk, a magneto-optical recording medium, and a semiconductor memory.

[0100] According to the present disclosure, it is possible to provide a tire fault determination method and a tire fault determination device that can improve the usefulness of the technology for determining a fault in a tire 2.

[0101] [Contribution to the United Nations-led Sustainable Development Goals (SDGs)] The SDGs have been proposed to realize a sustainable society. It is believed that one embodiment of the present disclosure can be a technology that contributes to "No. 9 - Build resilient infrastructure, promote industrial and technological innovation" and the like.

[0102] 1: Tire failure determination system, 2: Tire, 3: Vehicle, 10: Server (tire failure determination device), 11: Communication unit, 12: Output unit, 13: Input unit, 14: Memory unit, 15: Control unit, 20: Imaging device, 30: Measuring device, 40: Terminal device, 50: Network, 60: Thermographic image, 70: Damaged part, P: Point, R: Rotation axis, S: Temperature range

Claims

1. A tire fault determination method executed by a computer, comprising: acquiring a thermographic image of a tire taken with a thermographic camera; determining a relative relationship between surface temperatures acquired for each of a plurality of damaged portions of the tire based on the thermographic image; and notifying a user of a first alert based on the result of the determination of the relative relationship.

2. A tire fault determination method as described in claim 1, wherein determining the relative relationship includes determining whether or not the surface temperatures of the multiple damaged areas at the same time include any outliers that are relatively high above a first threshold value.

3. A tire fault determination method as described in claim 2, wherein notifying the first alert includes, when it is determined that the outlier is included, prompting inspection of the damaged portion corresponding to the outlier.

4. A tire fault determination method according to any one of claims 1 to 3, wherein determining the relative relationship includes determining whether or not the amount of change over time in the surface temperature of the multiple damaged areas includes a relatively high outlier that exceeds a second threshold value.

5. A tire fault determination method according to any one of claims 1 to 3, further comprising: acquiring the tire cavity temperature; and estimating the depth of each of the plurality of damaged portions based on the surface temperature in the thermo image and the cavity temperature at the time the thermo image was captured.

6. A tire fault detection method according to claim 5, wherein estimating the depth includes correcting the depth depending on a position of the damaged portion in the tire.

7. A tire fault determination method according to claim 5, further comprising notifying the user of a second alert based on the depth estimation result.

8. A tire malfunction determination method as claimed in claim 7, wherein notifying the second alert includes, when it is determined that the estimated depth is not within an acceptable range of durability of the tire, notifying that the tire is malfunctioning due to the corresponding damaged portion.

9. A tire malfunction determination device comprising a control unit, which obtains a thermographic image of a tire taken with a thermographic camera, determines a relative relationship between the surface temperatures obtained for each of a plurality of damaged portions of the tire based on the thermographic image, and notifies a user of a first alert based on the result of the determination of the relative relationship.

Citation Information

Patent Citations

  • Target object identification method and device

    CN114973158A

  • Tire inspection device and method

    JP2000283893A

  • Peeling inspection device for tire, and peeling inspection method for tire

    JP2005207763A

  • Tire damage detection system

    JP2005283452A

  • Tire running test method and apparatus

    JP2005321311A