Tire damage monitoring device, tire damage monitoring method, and program

Abstract

To provide a tire damage monitoring device, a tire damage monitoring method and a program, capable of improving availability of a technology for monitoring damage of a tire.SOLUTION: A tire damage monitoring device according to the present disclosure comprises a control unit configured to: acquire an image of a tire; identify one or more reference positions on an external surface of the tire captured in the image; detect damage on the external surface of the tire captured in the image; and output damage information including position information of the detected damage relative to the one or more reference positions on the external surface of the tire.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present disclosure relates to a tire damage monitoring device, a tire damage monitoring method, and a program.

Background Art

[0002] Techniques for monitoring tire damage are known. For example, Patent Document 1 discloses a tire damage detection system that detects the size of a tire damage portion based on the image data of a tire assembled to a rim wheel with reference to the diameter of the rim wheel.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In recent years, further improvement in the usefulness of techniques for monitoring tire damage has been demanded. For example, it has been demanded to specify the position information of a tire damage in order to monitor the state of the tire damage over time.

[0005] In view of such circumstances, an object of the present disclosure is to provide a tire damage monitoring device, a tire damage monitoring method, and a program that improve the usefulness of techniques for monitoring tire damage.

Means for Solving the Problems

[0006] [1] A tire injury monitoring device according to one embodiment of the present disclosure includes a control unit configured to acquire an image of a tire, identify one or more reference positions on the outer surface of the tire captured in the image, detect injuries on the outer surface of the tire captured in the image, and output injury information including positional information of the detected injuries on the outer surface of the tire with respect to the one or more reference positions. According to a tire damage monitoring device according to one embodiment of this disclosure, the location of damage on the outer surface of the tire can be determined. Therefore, this tire damage monitoring device can improve the usefulness of tire damage monitoring technology.

[0007] [2] A tire damage monitoring device according to one embodiment of the present disclosure is the tire damage monitoring device described in [1] above, wherein the outer surface preferably includes at least one of the outer surface of the side portion or the outer surface of the tread portion of the tire. A tire damage monitoring device having such a configuration can further improve the usefulness of the technology for monitoring tire damage.

[0008] [3] A tire injury monitoring device according to one embodiment of the present disclosure is the tire injury monitoring device described in [1] or [2] above, wherein the control unit is further configured to estimate the depth of the injury from at least one of the length or width of the injury on the outer surface of the tire as captured in the image, and the injury information preferably includes the depth of the injury. With a tire injury monitoring device having such a configuration, the depth of the injury can be determined along with the location of the injury on the tire.

[0009] [4] A tire injury monitoring device according to one embodiment of the present disclosure is the tire injury monitoring device described in [3] above, wherein the control unit is preferably configured to determine the actual length per unit pixel in the image based on the actual length of a reference member associated with the tire and the length of the reference member as captured in the image. A tire injury monitoring device having such a configuration can improve the accuracy of estimating the depth of tire injury.

[0010] [5] A tire injury monitoring device according to one embodiment of the present disclosure is a tire injury monitoring device as described in [3] or [4] above, wherein the control unit is further configured to determine whether the injury is located within a predetermined range from the tire's contact position in the image, and, if the injury is located within the predetermined range, to output injury information including positional information with respect to one or more reference positions based on the image. A tire injury monitoring device having such a configuration can improve the accuracy of tire injury information.

[0011] [6] A tire injury monitoring device according to one embodiment of the present disclosure is the tire injury monitoring device described in [3] or [4] above, wherein the control unit is further configured to determine in the image whether the injury is located within a predetermined range from the tire's contact point, and, if the injury is located within the predetermined range, to estimate the depth of the injury based on the image. A tire injury monitoring device having such a configuration can improve the accuracy of estimating the depth of tire injuries.

[0012] [7] A tire injury monitoring device according to one embodiment of the present disclosure is the tire injury monitoring device described in [5] or [6] above, wherein the predetermined range from the tire's contact point is preferably the range from the tire's contact point to the lower end of the rim in the height direction within the image. A tire injury monitoring device having such a configuration can further improve the accuracy of estimating the depth of tire damage.

[0013] [8] A tire injury monitoring device according to one embodiment of the present disclosure is a tire injury monitoring device according to any one of the above items [3] to [7], wherein the control unit preferably outputs an alert when the depth of the injury falls outside a predetermined threshold range. A tire injury monitoring device having such a configuration can further improve the usefulness of the technology for monitoring tire injuries.

[0014] [9] A tire injury monitoring device according to one embodiment of the present disclosure is the tire injury monitoring device described in [8] above, wherein the predetermined threshold range is preferably different depending on the position information of the injury with respect to one or more reference positions. A tire injury monitoring device having such a configuration can output alerts under different conditions depending on the location of the injury in the tire, and the accuracy of outputting alerts can be improved.

[0015]

[10] A tire injury monitoring device according to one embodiment of the present disclosure is a tire injury monitoring device according to any one of the above items [1] to [9], wherein the image of the tire is preferably a thermographic image taken by a thermographic camera. With a tire injury monitoring device having such a configuration, the accuracy of detecting tire injury is less likely to decrease even when the outer surface of the captured tire is dirty with mud or the like, or when the tire 2 is photographed at night.

[0016]

[11] A tire injury monitoring device according to one embodiment of the present disclosure is a tire injury monitoring device according to any one of the above items [1] to

[10] , wherein identifying one or more reference positions preferably includes identifying at least one reference position among a plurality of reference positions on the outer surface of the tire. With a tire injury monitoring device having such a configuration, the accuracy of identifying the location of tire injuries is less likely to decrease even when the imaged outer surface of the tire is dirty with mud or the like.

[0017]

[12] A tire injury monitoring device according to one embodiment of the present disclosure is a tire injury monitoring device according to any one of the above items [1] to

[11] , wherein outputting the injury information preferably includes outputting a request to visualize and display the injury information of the tire with respect to one or more reference positions. A tire injury monitoring device having such a configuration can further improve the usefulness of the technology for monitoring tire injury.

[0018]

[13] A tire injury monitoring method according to one embodiment of the present disclosure is a tire injury monitoring method performed by one or more computers, comprising: acquiring an image of a tire; identifying one or more reference positions on the outer surface of the tire captured in the image; detecting an injury on the outer surface of the tire captured in the image; and outputting injury information, which includes position information of the detected injury with respect to the one or more reference positions on the outer surface of the tire. According to a tire damage monitoring method according to one embodiment of this disclosure, the location of damage on the outer surface of the tire can be determined. Therefore, this tire damage monitoring method can improve the usefulness of techniques for monitoring tire damage.

[0019] 〔14〕A program according to an embodiment of the present disclosure causes one or more computers to perform operations including: acquiring an image of a tire; identifying one or more reference positions on an outer surface of the tire shown in the image; detecting a damage on the outer surface of the tire shown in the image; and outputting damage information including position information of the detected damage with respect to the one or more reference positions on the outer surface of the tire. According to a program according to an embodiment of the present disclosure, the position of a damage on the outer surface of a tire can be grasped. Therefore, according to the program, the usefulness of a technique for monitoring tire damage can be improved.

Effects of the Invention

[0020] According to the present disclosure, it is possible to provide a tire damage monitoring device, a tire damage monitoring method, and a program that can improve the usefulness of a technique for monitoring tire damage.

Brief Description of the Drawings

[0021] [Figure 1] It is a diagram showing a schematic configuration of a tire damage monitoring system according to an embodiment of the present disclosure. [Figure 2] It is a block diagram showing the configuration of the server shown in FIG. 1. [Figure 3] It is a flowchart showing the operation of the tire damage monitoring system shown in FIG. 1. [Figure 4] It is a diagram showing an example of an image of a tire taken. [Figure 5] It is a diagram showing an example of a screen displaying tire damage information.

Modes for Carrying Out the Invention

[0022] A tire injury monitoring system according to one embodiment of this disclosure will be described below with reference to the drawings. Common components and parts in each figure are denoted by the same reference numerals. However, please note that the drawings are schematic, and the proportions of dimensions may differ from those of reality.

[0023] (Configuration of the tire damage monitoring system) First, an overview of the tire injury monitoring system 1 according to this embodiment will be described with reference to Figure 1. Figure 1 is a diagram showing the schematic configuration of the tire injury monitoring system 1. As shown in Figure 1, the tire injury monitoring system 1 includes a server 10, an imaging device 20, and a terminal device 30. In Figure 1, one server 10, one imaging device 20, and one terminal device 30 are shown, respectively. However, the tire injury monitoring system 1 may include any number of servers 10, imaging devices 20, and terminal devices 30.

[0024] Server 10 is comprised of one or more computers. In this embodiment, Server 10 is described as being comprised of one computer. However, Server 10 may be comprised of multiple computers, such as a cloud computing system. In this disclosure, Server 10 is also referred to as a "tire injury monitoring device".

[0025] The imaging device 20 consists of a computer including one or more cameras. The cameras are, for example, visible light cameras, but are not limited to these; they may be any cameras capable of capturing images, such as thermographic cameras or infrared cameras. The images captured by the imaging device 20 may be still images such as photographs, or they may be videos. The imaging device 20 generates an image of the tire 2 and transmits it to the server 10. The image of the tire 2 shows at least a part of the tire 2. In addition to at least a part of the tire 2, the image of the tire 2 may also show at least a part of the vehicle 3 on which the tire 2 is mounted. The imaging device 20 may be a fixed imaging device installed along the vehicle 3's travel path, or it may be a portable imaging device such as a tablet terminal that can be carried by a person.

[0026] The terminal device 30 is a computer, such as a smartphone, tablet, or personal computer.

[0027] Network 40 is any communication network that enables the server 10, imaging device 20, and terminal device 30 to communicate with each other. In this embodiment, network 40 may be, for example, the Internet, a mobile communication network, a LAN (Local Area Network), or a combination thereof.

[0028] The tire injury monitoring system 1 is used to monitor injuries to one or more tires 2. In the tire injury monitoring system 1, the server 10 acquires images of the tire 2, for example, from an imaging device 20. The server 10 then identifies one or more reference positions on the outer surface of the tire 2 captured in the image and detects injuries on the outer surface of the tire 2 captured in the image. The server 10 outputs injury information, including the positional information of the detected injuries relative to one or more reference positions on the outer surface of the tire 2. For example, this tire injury information for the tire 2 may be transmitted from the server 10 to a terminal device 30 and visualized and displayed by the terminal device 30. In this way, the location of injuries on the outer surface of the tire 2 can be accurately identified based on the images acquired from the imaging device 20. As a result, the usefulness of the technology for monitoring tire injuries can be improved.

[0029] In this disclosure, tire 2 is not particularly limited, but may be an OR (Off The Road) tire mounted on a large vehicle such as a construction vehicle, engineering vehicle, or heavy machinery vehicle used at a mining site, etc. However, tire 2 may be a tire other than an OR tire.

[0030] Furthermore, in this disclosure, Vehicle 3 is a large vehicle such as a construction vehicle, engineering vehicle, or heavy machinery vehicle used at a mining site, for example. However, Vehicle 3 is not limited to the large vehicles described above, and may be any vehicle capable of being fitted with tires 2, such as a truck, bus, passenger car, motorcycle, bicycle, or airplane.

[0031] Next, with reference to Figure 2, the configuration of the server 10, which is a tire injury monitoring device, will be described in detail. Figure 2 is a block diagram showing the configuration of the server 10. As shown in Figure 2, the server 10 comprises a communication unit 11, an output unit 12, an input unit 13, a storage unit 14, and a control unit 15. In the server 10, the communication unit 11, the output unit 12, the input unit 13, the storage unit 14, and the control unit 15 are connected to each other so as to be able to communicate with each other by wire or wireless.

[0032] The communication unit 11 includes a communication module for connecting to the network 40. The communication module is a communication module compatible with a mobile communication standard such as 4G (4th Generation) or 5G (5th Generation). The communication module may also be a communication module compatible with a standard such as wired LAN or wireless LAN. The communication module may also be a communication module compatible with a short-range wireless communication standard such as Wi-Fi (registered trademark), Bluetooth (registered trademark), or infrared communication. In this embodiment, the server 10 is connected to the network 40 via the communication unit 11. This allows the server 10 to communicate with the imaging device 20, the terminal device 30, or other computers, etc.

[0033] The output unit 12 includes one or more output devices. These output devices include, for example, a display, speaker, or lamp. As a result, the output unit 12 outputs images, sounds, or light.

[0034] The input unit 13 includes one or more input devices. These input devices may include, for example, a touch panel, a camera, or a microphone. The input unit 13 accepts input operations from, for example, users of the server 10.

[0035] The storage unit 14 is, for example, a semiconductor memory, magnetic memory, or optical memory. The storage unit 14 functions, for example, as a main memory, auxiliary memory, or cache memory. The storage unit 14 stores any information used in the operation of the server 10. For example, the storage unit 14 stores system programs, application programs, embedded software, or databases. The information stored in the storage unit 14 may be updateable with information obtained from the network 40 via the communication unit 11, for example.

[0036] For example, the storage unit 14 may store tire identification information for one or more tires 2 that are subject to trauma monitoring. The tire identification information for tire 2 is information that can uniquely identify tire 2. The tire identification information is, for example, the ID (Identifier) ​​of tire 2 uniquely issued by the server 10, but is not limited to this, and may be the manufacturing number of tire 2, etc. Furthermore, the storage unit 14 may store information about tire 2 in association with the tire identification information of tire 2.

[0037] Information regarding tire 2 includes, for example, at least one of the following: damage information for tire 2, reference position information for tire 2, reference member information for tire 2, configuration information for tire 2, information about the vehicle 3 on which tire 2 is mounted, or position information of tire 2 on vehicle 3. Damage information for tire 2 may be time-series data including, for example, the location, shape, depth, and registration date and time of damage previously sustained by tire 2. Reference position information for tire 2 is reference position information for identifying the location of damage on the outer surface of tire 2. For example, reference position information for tire 2 includes features such as shape, color, or pattern of the reference position. Furthermore, reference position information for tire 2 is associated with its position on the outer surface of tire 2 by position information such as coordinates. Reference member information for tire 2 is reference member information for evaluating the length of damage captured in image 50. Reference member information for tire 2 includes, for example, features such as shape, color, or pattern of the reference member and the actual length of the reference member. The configuration information for tire 2 includes, for example, the type, model number, material properties, belt angle, size, or weight of tire 2. The information for vehicle 3 on which tire 2 is mounted includes the vehicle 3's identification information, type, model number, engine displacement, number of tires mounted, or number of shafts.

[0038] The control unit 15 includes one or more processors. The processors may be general-purpose processors such as CPUs (Central Processing Units), or dedicated processors specialized for specific processing. The control unit 15 is not limited to processors and may include one or more dedicated circuits. The dedicated circuits may be, for example, FPGAs (Field-Programmable Gate Arrays) or ASICs (Application Specific Integrated Circuits). The control unit 15 controls each component in order to realize the functions of the server 10, including the functions of the components described above, such as the communication unit 11, output unit 12, input unit 13, and storage unit 14.

[0039] (Operation of the tire damage monitoring system) The operation of the tire injury monitoring system 1 will be explained with reference to Figures 3, 4, and 5. Figure 3 is a flowchart showing the operation of the tire injury monitoring system 1. Figure 4 is a diagram showing an example of an image 50 of a tire 2. Figure 5 is a diagram showing an example of a screen displaying injury information for the tire 2. The flowchart shown in Figure 3 shows the operation of the server 10, imaging device 20, and terminal device 30 included in the tire injury monitoring system 1. Therefore, this explanation of operation corresponds to the control method of the tire injury monitoring system 1, as well as the control methods of the server 10, imaging device 20, and terminal device 30 included in the tire injury monitoring system 1.

[0040] For the purposes of this explanation, it is assumed that the control unit 15 of the server 10 stores in the storage unit 14 the tire identification information of tire 2 and information related to tire 2 associated with the tire identification information of tire 2. As described above, the information related to tire 2 includes, for example, the history of past damage to tire 2, information on the reference position of tire 2, and information on the reference member of tire 2.

[0041] Furthermore, the control unit 15 of the server 10 may store the actual length per unit pixel in the image 50 in the storage unit 14 in order to calculate the actual length of the object depicted in the image 50.

[0042] Furthermore, this example illustrates, as an example, the operation in which the server 10 detects damage 60 on the outer surface of the side portion 2A of the tire 2, as shown in Figure 4. In this case, the imaging device 20 may be installed in a position that allows imaging of the side of the vehicle 3.

[0043] Referring to Figure 3, in step S101, the imaging device 20 transmits an image 50 of the tire 2 captured by the camera to the server 10.

[0044] Specifically, in step S101, the imaging device 20 uses a camera to image the tire 2 and generates an image 50 of the tire 2. Preferably, the image 50 is a series of still images or a video taken in sequence. However, the image 50 may be a single still image. In addition, the image 50 of the tire 2 may also show at least a part of the vehicle 3 on which the tire 2 is mounted. In this example, as an example, the image 50 shown in Figure 4 will be transmitted from the imaging device 20 to the server 10. The image 50 shows the entire tire 2 and a part of the vehicle 3 on which the tire 2 is mounted.

[0045] If the imaging device 20 is equipped with a thermographic camera, the image 50 of the tire 2 may be a thermographic image taken by the thermographic camera. Generally, as the vehicle 3 is driven, the temperature of the cavity of the tire 2 rises. The injury 60 on the outer surface of the tire 2 has a higher surface temperature because it is closer to the cavity of the tire 2 than other parts. For this reason, in the processing described later, the thermographic image can be used to detect the location and depth of the injury 60 on the outer surface of the tire 2. By using a thermographic image, the accuracy of detecting the injury to the tire 2 is less likely to decrease even if the outer surface of the tire 2 is dirty with mud or the like, or if the tire 2 is photographed at night. However, the image 50 may be an image taken by any camera, such as a visible light camera.

[0046] Referring again to Figure 3, in step S102, the control unit 15 of the server 10 acquires an image of the tire 2.

[0047] Specifically, the control unit 15 of the server 10 receives the image 50 of the tire 2 from the imaging device 20 via the communication unit 11. However, the control unit 15 may also receive the image 50 captured by the imaging device 20 via a computer other than the imaging device 20. The control unit 15 may store the received image 50 in the storage unit 14 in association with the identification information of the tire 2.

[0048] In step S102, the control unit 15 of the server 10 may further identify the tire 2 or the tire 2 identification information displayed on the vehicle 3 equipped with the tire 2, as captured in the image 50. This allows the control unit 15 to identify the tire 2 from the image 50 even if the tire 2 captured in the image 50 has not been identified in advance. Specifically, the control unit 15 identifies the display portion 51 that indicates the identification information of the tire 2 in the image 50 through image processing. As shown in Figure 4, the display portion 51 may be a two-dimensional code such as a QR (Quick Response) code (registered trademark) or an AR (Augmented Reality) marker. In this case, the control unit 15 can read the tire 2 identification information from the display portion 51, which is a two-dimensional code. However, the display portion 51 is not limited to a two-dimensional code, but may be any display such as a string of characters, symbols, figures, patterns, or a one-dimensional code.

[0049] The display portion 51 showing the identification information of tire 2 may be displayed at any position. For example, in Figure 4, display portions 51A and 51B are shown. Display portion 51A is provided on the side portion 2A of tire 2. In this case, even if tire 2 is mounted on another vehicle 3 due to tire rotation or the like, the identification information of tire 2 can be identified based on the same display portion 51. Display portion 51B is provided on the body of vehicle 3 on which tire 2 is mounted. In this case, because the display portion 51 is provided on the body of vehicle 3, the visibility of the display portion 51 is less likely to decrease even if the outer surface of tire 2 is soiled with mud or damaged.

[0050] Referring again to Figure 3, in step S103, the control unit 15 of the server 10 identifies one or more reference positions 52 on the outer surface of the tire 2 as captured in the image 50.

[0051] As described above, the reference position 52 is used to identify the location of the damage 60 on the outer surface of the tire 2. For example, the reference position 52 may be a letter, symbol, figure, or pattern provided on the outer surface of the tire 2. The information of the reference position 52 is associated with its position on the outer surface of the tire 2 by positional information such as coordinates. Because the reference position 52 is on the outer surface of the tire 2, even if the tire 2 is mounted on another vehicle 3 or wheel due to tire rotation or the like, the location of the damage 60 on the tire 2 can be continuously identified based on the same reference position 52. Therefore, the accuracy of identifying the location of the damage 60 on the tire 2 is less likely to decrease.

[0052] Any method can be used to identify the reference position 52. For example, the control unit 15 of the server 10 performs image analysis of the image 50 based on information about the reference position 52 of the tire 2 that is stored in the storage unit 14 beforehand. For example, the information about the reference position 52 includes features such as the shape, color, or pattern of the reference position 52. This allows the control unit 15 to identify one or more reference positions 52 on the outer surface of the tire 2 as captured in the image 50. In Figure 4, three reference positions 52A, 52B, and 52C are provided on the outer surface of the side portion 2A of the tire 2. The three reference positions 52A, 52B, and 52C each have different characteristics and are distinguishable. The control unit 15 may identify at least one of the multiple reference positions 52A, 52B, or 52C on the outer surface of the tire 2 and designate that (or them) as the reference position 52 of the tire 2. In this way, by providing multiple reference positions 52 on the outer surface of the tire 2, it becomes easier to identify the reference positions 52 even if part of the tire 2 is soiled with mud or damaged. For example, in the example shown in Figure 4, if reference position 52A is soiled with mud and cannot be extracted by image analysis, the control unit 15 can use reference position 52B or 52C as a reference to identify the location of the damage 60 in subsequent processing. However, the number of references 152 provided on the outer surface of the tire 2 may be just one.

[0053] Referring again to Figure 3, in step S104, the control unit 15 of the server 10 determines the actual length per unit pixel in the image 50 based on the actual length of the reference member associated with the tire 2 and the length of the reference member as depicted in the image 50.

[0054] The reference member associated with tire 2 may be, for example, the rim diameter of tire 2. Alternatively, the reference member may be a letter, symbol, figure, or pattern provided on the outer surface of tire 2. For example, the reference position 52 described above may be used as the reference member.

[0055] Any method can be used to determine the actual length per unit pixel. For example, the control unit 15 of the server 10 identifies the contour of a reference member captured in the image 50. The control unit 15 identifies the distance between the two furthest points of the identified contour of the reference member as the length of the reference member captured in the image 50. The length of the reference member captured in the image 50 may be expressed in pixels. The control unit 15 can determine the actual length per unit pixel in the image 50 from the number of pixels corresponding to the length of the reference member captured in the image 50 and the actual length of the reference member associated with the tire 2. This improves the accuracy of estimating the depth of the damage 60 to the tire 2 in subsequent processing. However, the actual length per unit pixel in the image 50 may be predetermined.

[0056] In step S105, the control unit 15 of the server 10 detects the damage 60 on the outer surface of the tire 2 as captured in the image 50.

[0057] Any method can be used to detect the injury 60. For example, the control unit 15 of the server 10 may pre-store an image analysis algorithm in the storage unit 14 for identifying the injury 60 of the tire 2 captured in the image 50. The control unit 15 uses the image analysis algorithm to detect the outline of the injury 60, such as a cut or crack, present on the outer surface of the tire 2 captured in the image 50 as the injury 60.

[0058] In this embodiment, the image analysis algorithm may be constructed using statistical methods such as machine learning or deep learning. For example, the image analysis algorithm may be constructed using statistical methods, with the image 50 of the tire 2 and the contour of the injury 60 on the tire 2 identified by a human or the like as training data. This allows for improved detection accuracy of the injury 60 on the outer surface of the tire 2 through the accumulation of training data. However, the image analysis algorithm may also include predetermined computational processing that does not rely on statistical methods.

[0059] Then, in step S105, the control unit 15 generates positional information of the detected injury 60 with respect to one or more reference positions 52 on the outer surface of the tire 2. The positional information of the injury 60 is, for example, coordinate information on the outer surface of the tire 2 with respect to the reference positions 52. In Figure 4, different coordinates are set for each of the three reference positions 52A, 52B, and 52C. The control unit 15 can determine the coordinates of the injury 60 from the positional relationship between the injury 60 and any of the three reference positions 52A, 52B, or 52C.

[0060] Referring again to Figure 3, in step S106, the control unit 15 of the server 10 estimates the depth of the injury 60 from at least one of the length or width of the injury 60 on the outer surface of the tire 2 as captured in the image 50.

[0061] Any method can be used to estimate the depth of the injury 60. For example, the control unit 15 of the server 10 may pre-store in the storage unit 14 a correspondence algorithm for estimating the depth of the injury 60 from at least one of the length or width of the injury 60 of the tire 2 as captured in the image 50. The control unit 15 may use the distance between the two furthest points in the contour of the injury 60 identified in step S105 as the length, and the distance between the two furthest points in a direction perpendicular to the direction of length as the width. When calculating the length and width of the injury 60, the control unit 15 may use the actual length per unit pixel in the image 50 calculated in step S104. Then, the control unit 15 estimates the depth of the injury 60 from at least one of the length or width of the injury 60 using the correspondence algorithm. The depth of the injury 60 is, for example, the distance from the outer surface of the tire 2 to the deepest part of the injury 60, but is not limited to this.

[0062] In this embodiment, the matching algorithm may be constructed using statistical methods such as machine learning or deep learning. For example, the matching algorithm may be constructed using statistical methods, with at least one of the length or width of the damage 60 to the tire 2 and the depth of the damage 60 measured by a human or the like as training data. This allows for improved accuracy in estimating the depth of the damage 60 to the tire 2 through the accumulation of training data. However, the matching algorithm may also include predetermined computational processing that does not rely on statistical methods.

[0063] In step S106, when estimating the depth of the injury 60, it is preferable that the injury 60 is located within a predetermined range from the tire 2's contact point in image 50. Preferably, the predetermined range from the tire 2's contact point is the range H from the tire 2's contact point to the lower end of the rim in the height direction of image 50, as shown in Figure 4. More preferably, the predetermined range from the tire 2's contact point is the range H from the tire 2's contact point to the lower end of the rim in the height direction of image 50, and also the range W between both ends of the rim in the width direction of image 50. Even more preferably, the predetermined range from the tire 2's contact point is the range within image 50 that is bounded by the straight line connecting the center C of the tire 2 and both ends E1 and E2 of the tire 2's contact point in the width direction of image 50. The control unit 15 may estimate the depth of the injury 60 based on image 50 if the injury 60 is located within the predetermined range. Thus, when the injury 60 is located near the ground contact point, the load on the tire 2 causes the injury 60 to open, making it easier to measure the length or width of the injury 60, and consequently improving the accuracy of estimating the depth of the injury 60. For this reason, if the image 50 consists of multiple still images or a video captured in sequence, the control unit 15 of the server 10 may determine in step S106 whether the injury 60 is located within a predetermined range from the ground contact point of the tire 2 within the image 50. The control unit 15 may select an image (frame) in which the injury 60 is located within the predetermined range and use it to estimate the depth of the injury 60 in step S106.

[0064] Referring again to Figure 3, in step S107, the control unit 15 of the server 10 outputs information about the damage to the tire 2.

[0065] In step S107, when outputting the damage information for tire 2, the control unit 15 of the server 10 may associate the location information and contour of the damage 60 identified in step S105, and the length, width, and depth information of the damage 60 identified in S106, with the tire identification information of tire 2, and store them in the storage unit 14 as the damage information for tire 2. The damage information for tire 2 may include information for multiple damages 60. If the damage information for tire 2 already contains information for a damage 60 with the same location information that has been detected in the past, the control unit 15 may update the information with new contour and depth information, or add new information to the information as time-series data.

[0066] Any method can be used to output the damage information of tire 2. For example, the control unit 15 of server 10 may visualize and display the damage information of tire 2 based on one or more reference positions 52 via an output unit 12 such as a display. Alternatively, the control unit 15 may send a request to the terminal device 30 via the communication unit 11 to visualize and display the damage information of tire 2 based on one or more reference positions 52. In this case, the terminal device 30 can visualize and display the damage information of tire 2 via a display or the like based on the request received from server 10. For example, as shown in Figure 5, a screen may be displayed in which the location of the damage 60 based on the reference position 52 is mapped onto a photograph or illustration of tire 2 and highlighted (shown by diagonal lines in the illustrated example).

[0067] As a result, users of the tire injury monitoring system 1 can easily determine the location of the injury 60 on the outer surface of the tire 2. Furthermore, by identifying a reference position 52 on the outer surface of the tire 2, the location of the injury 60 on the tire 2 can be continuously identified even when the tire 2 is mounted on another vehicle 3 or wheel. Therefore, it becomes possible to monitor the injury 60 over time, such as the occurrence of new injuries 60 or changes in the depth of the injury 60, by comparing it with past injury information of the tire 2. In this way, the tire injury monitoring system 1 can improve the usefulness of the technology for monitoring tire injury 2. Moreover, if the injury information of the tire 2 includes information such as the length, width, or depth of the injury 60, as shown in Figure 5, the length, width, or depth of the injury 60 can be displayed in addition to the location of the injury 60 on the tire 2. This further improves the usefulness of the technology for monitoring tire injury 2.

[0068] Referring again to Figure 3, in step S108, the control unit 15 of the server 10 may output an alert if the depth of the damage 60 to the tire 2 falls outside a predetermined threshold range. The predetermined threshold range may be, for example, a threshold indicating the acceptable range of durability of the tire 2. Alternatively, the predetermined threshold range may be associated with at least one of the following: replacement, retreading, or rotation of the tire 2. For example, if the predetermined threshold range is associated with replacement of the tire 2, the control unit 15 may output an alert prompting replacement of the tire 2 if the damage information of the tire 2 falls outside the predetermined threshold range.

[0069] Any method can be used to output the alert. The control unit 15 of the server 10 may display information, or output sound or light via the output unit 12. Alternatively, the control unit 15 may send a request to output an alert to the terminal device 30 via the communication unit 11. In this case, the terminal device 30 can output the alert via a display or the like based on the request received from the server 10. As a result, the user of the tire damage monitoring system 1 can be prompted to take action such as replacing, retreading, or rotating the tire 2.

[0070] Furthermore, the predetermined threshold range used for outputting the alert described above may differ depending on the position of the damage 60 on the outer surface of the tire 2, that is, the position information of the damage 60 relative to one or more reference positions 52. For example, the control unit 15 of the server 10 may store in the storage unit 14 a plurality of threshold ranges that differ depending on the position of the damage 60 relative to one or more reference positions 52 on the outer surface of the tire 2 as a predetermined threshold range. Specifically, in locations where the risk of failure is high due to the structure of the tire 2, such as near the end of a belt or carcass ply, the depth of the damage for which an alert is output may be set to be shallower than in other parts. This makes it possible to output an alert according to the failure risk of the location of the damage 60 on the tire 2, and improves the accuracy of alert output.

[0071] As described above, in this embodiment, the server 10, which is a tire injury monitoring device, acquires an image 50 of the tire 2. The server 10 then identifies one or more reference positions 52 on the outer surface of the tire 2 captured in the image 50, and detects injuries 60 on the outer surface of the tire 2 captured in the image 50. The server 10 outputs injury information, which includes the position information of the detected injuries 60 relative to one or more reference positions 52 on the outer surface of the tire 2.

[0072] With this configuration, the server 10 can accurately identify the location of the damage 60 on the outer surface of the tire 2 based on the acquired image 50. In particular, by identifying one or more reference positions 52 on the outer surface of the tire 2, the location of the damage 60 on the tire 2 can be continuously identified even when the tire 2 is mounted on another vehicle 3 or wheel. Therefore, this embodiment can improve the usefulness of the technology for monitoring damage to the tire 2.

[0073] In the above example of operation, the operation of detecting damage 60 on the outer surface of the side portion 2A of the tire 2 in the tire damage monitoring system 1 has been described, but this is not limited to this. The outer surface of the tire 2 that is processed by the tire damage monitoring system 1 may include at least one of the outer surface of the side portion 2A or the outer surface of the tread portion 2B of the tire 2. That is, the tire damage monitoring system 1 may be used to detect damage 60 on the outer surface of the tread portion 2B of the tire 2 in addition to / instead of the side portion 2A of the tire 2. In such a case, the imaging device 20 may be installed in a position that can image the front or rear of the vehicle 3 in order to image the tread portion 2B of the tire 2. Then, similar to the above example of operation, the server 10 acquires an image 50 of the tread portion 2B of the tire 2 from the imaging device 20. The server 10 then identifies one or more reference positions 52 on the outer surface of the tread portion 2B of the tire 2 captured in the image 50, and detects damage 60 on the outer surface of the tread portion 2B of the tire 2 captured in the image 50. The reference position 52 may be, for example, a character, symbol, figure, or pattern provided on the outer surface of the tread portion 2B of the tire 2. The server 10 outputs injury information, which includes the position information of the detected injury 60 relative to one or more reference positions 52 on the outer surface of the tread portion 2B of the tire 2. This allows the server 10 to detect injuries 60 on the outer surface of the tread portion 2B of the tire 2 in addition to / instead of the side portion 2A of the tire 2, and to pinpoint their location.

[0074] While this disclosure has been described based on the drawings and embodiments, it should be noted that those skilled in the art can make various modifications and alterations based on this disclosure. Therefore, it should be noted that these modifications and alterations are within the scope of this disclosure. For example, the configurations or functions included in each embodiment can be rearranged in a logically consistent manner. Furthermore, the configurations or functions included in each embodiment can be used in combination with other embodiments, and multiple configurations or functions can be combined into one, divided, or partially omitted.

[0075] Furthermore, for example, an embodiment is also possible in which a general-purpose computer functions as the server 10 according to the above-described embodiment. Specifically, a program describing the processing content that realizes each function of the server 10 according to the above-described embodiment is stored in the memory of the general-purpose computer, and the processor reads and executes the program. Therefore, this disclosure can also be realized as a program that can be executed by a processor, or as a non-temporary computer-readable medium that stores said program. Examples of non-temporary computer-readable media include magnetic recording devices, optical discs, magneto-optical recording media, or semiconductor memory. [Industrial applicability]

[0076] This disclosure provides a tire damage monitoring device, a tire damage monitoring method, and a program that can improve the usefulness of techniques for monitoring tire damage.

[0077] [Contribution to the United Nations-led Sustainable Development Goals (SDGs)] The SDGs have been proposed to realize a sustainable society. One embodiment of this invention is considered to be a technology that can contribute to "No. 9 - Build resilient infrastructure, promote inclusive and sustainable industrialization and foster innovation," among others. [Explanation of symbols]

[0078] 1: Tire injury monitoring system, 2: Tire, 2A: Side section, 2B: Tread section, 3: Vehicle, 10: Server (Tire injury monitoring device), 11: Communication unit, 12: Output unit, 13: Input unit, 14: Storage unit, 15: Control unit, 20: Imaging device, 30: Terminal device, 40: Network, 50: Image, 51 (51A, 51B): Display section, 52 (52A, 52B, 52C): Reference position, 60: Injury, H: Height range, W: Width range, C: Center, E1, E2: Both ends of the contact point

Claims

1. A tire damage monitoring device, We acquire images of the tires, Identify one or more reference positions on the outer surface of the tire as captured in the aforementioned image, The external damage on the outer surface of the tire captured in the aforementioned image is detected. The control unit is configured to output injury information, which includes position information of the detected injury relative to one or more reference positions on the outer surface of the tire. The control unit, The depth of the injury is estimated from at least one of the length or width of the injury on the outer surface of the tire as captured in the image. A tire injury monitoring device further configured to output an alert when the depth of the injury falls outside a predetermined threshold range.

2. The tire damage monitoring device according to claim 1, wherein the outer surface includes at least one of the outer surface of the side portion or the outer surface of the tread portion of the tire.

3. The tire injury monitoring device according to claim 1, wherein the injury information includes the depth of the injury.

4. The tire injury monitoring device according to claim 1, wherein the control unit is configured to determine the actual length per unit pixel in the image based on the actual length of the reference member associated with the tire and the length of the reference member as captured in the image.

5. The control unit, In the aforementioned image, it is determined whether the injury is located within a predetermined range from the tire's contact point. The tire injury monitoring device according to claim 1, further configured to output injury information including positional information relative to one or more reference positions based on the image when the injury is located within the predetermined range.

6. The control unit, In the aforementioned image, it is determined whether the injury is located within a predetermined range from the tire's contact point. The tire injury monitoring device according to claim 1, further configured to estimate the depth of the injury based on the image when the injury is located within the predetermined range.

7. The tire injury monitoring device according to claim 5 or claim 6, wherein the predetermined range from the tire's contact point is the range from the tire's contact point to the lower end of the rim in the height direction within the image.

8. The tire injury monitoring device according to claim 1, wherein the predetermined threshold range differs depending on the positional information of the injury relative to one or more reference positions.

9. The tire injury monitoring device according to claim 1, wherein the image of the tire is a thermographic image taken by a thermographic camera.

10. The tire injury monitoring device according to claim 1, wherein identifying one or more reference positions includes identifying at least one reference position among a plurality of reference positions on the outer surface of the tire.

11. The tire damage monitoring device according to claim 1, wherein outputting the damage information includes outputting a request to visualize and display the damage information of the tire with reference to one or more reference positions.

12. A tire damage monitoring method performed by one or more computers, Acquiring images of the tires, Identifying one or more reference positions on the outer surface of the tire as captured in the aforementioned image, To detect damage on the outer surface of the tire as captured in the aforementioned image, Outputting injury information, including positional information of the detected injury relative to one or more reference positions on the outer surface of the tire; Includes, The depth of the injury is estimated from at least one of the length or width of the injury on the outer surface of the tire as captured in the image, A tire injury monitoring method further comprising: outputting an alert when the depth of the injury falls outside a predetermined threshold range.

13. On one or more computers, Acquiring images of the tires, Identifying one or more reference positions on the outer surface of the tire as captured in the aforementioned image, To detect damage on the outer surface of the tire as captured in the aforementioned image, Outputting injury information, including positional information of the detected injury relative to one or more reference positions on the outer surface of the tire; A program that causes an action including the following: The aforementioned operation is, The depth of the injury is estimated from at least one of the length or width of the injury on the outer surface of the tire as captured in the image, A program further comprising: outputting an alert if the depth of the trauma falls outside a predetermined threshold range.

Images