Tire wear notification system

Abstract

A tire wear notification system is provided. In an exemplary embodiment, methods and systems are provided for monitoring a tire tread for a tire of a vehicle, including: obtaining an image of the tread for the tire of the vehicle via one or more sensors of the vehicle after initiating tire wear monitoring for the vehicle; determining, via a processor coupled to one or more sensors, a depth of a tread of a tire for the vehicle using the image when tire wear monitoring is initiated for the vehicle; and providing a notification to a user of the vehicle regarding the depth of the tread for the tire of the vehicle based on the instructions provided by the processor.

Description

Technical Field

[0001] The technical field generally relates to platforms such as vehicles, and more specifically to methods and systems for monitoring tire wear and for providing notifications about tire wear. Background Technology

[0002] Many vehicles include tires mounted on the corresponding wheels of the vehicle. However, in some situations, existing technology may not be able to provide optimal monitoring of tire wear.

[0003] Accordingly, there is a need to provide improved methods and systems for monitoring tire wear on vehicles. Summary of the Invention

[0004] In an exemplary embodiment, a method for monitoring the tire tread of a vehicle is provided, the method comprising: acquiring an image of the tire tread of the vehicle via one or more sensors of the vehicle after tire wear monitoring of the vehicle is initiated; determining the depth of the tire tread of the vehicle via a processor coupled to one or more sensors using the image when tire wear monitoring of the vehicle is initiated; and providing a notification to a user of the vehicle regarding the depth of the tire tread of the vehicle based on instructions provided by the processor.

[0005] Furthermore, in an exemplary embodiment, the step of obtaining an image of the tire tread includes obtaining images from one or more cameras of the vehicle; and the step of determining the depth of the tire tread includes determining the depth of the tire tread via a processor using camera images from one or more cameras combined with a calibrated camera projection matrix.

[0006] Furthermore, in an exemplary embodiment, the step of obtaining an image of the tire tread includes obtaining images from a plurality of cameras on the vehicle, including a first camera adjacent to the side mirrors of the vehicle and a second camera located on the underside of the vehicle.

[0007] Furthermore, in an exemplary embodiment, the method also includes providing instructions via a processor for the movement of the vehicle's wheels during the initiation of tread monitoring, thereby allowing for clarity of observation of the tire tread via one or more cameras and repeatability of the generation of tread images.

[0008] Furthermore, in an exemplary embodiment, instructions are provided to the vehicle user via a processor through the vehicle's display, allowing the user to engage the vehicle's steering wheel, thereby moving the vehicle's wheels and enabling clarity of observation of the tire tread via one or more cameras and repeatability of the generated images of the tire tread.

[0009] Furthermore, in an exemplary embodiment, instructions are provided via a processor to one or more actuators of the vehicle for autonomous movement of the vehicle's wheels, and allow for clarity of observation of the tire tread via one or more cameras and repeatability of the generation of images of the tire tread.

[0010] Furthermore, in an exemplary embodiment, the method also includes storing a tire tread pattern for the tire in a computer memory based on an image of the tread according to instructions provided by a processor.

[0011] Furthermore, in an exemplary embodiment, the method also includes determining tire decolorization based on an image via a processor; and adjusting the tire tread pattern based on the determination of decolorization via a processor for storage in a computer memory.

[0012] Furthermore, in an exemplary embodiment, the method also includes determining, via a processor, whether to recommend tire rotation, replacement, or both based on the tire tread pattern, including whether the tire tread pattern indicates uneven tread depth between the front and rear tires, uneven tread depth between the left and right tires, or uneven tread depth between the front and rear tires and between the left and right tires.

[0013] Furthermore, in an exemplary embodiment, the method also includes storing an identifier for a tire pressure monitoring system (TPMS) identifier for a tire in a computer memory according to instructions provided by the processor, for identifying a specific tire to determine whether a specific tire has been replaced or rotated.

[0014] Furthermore, in an exemplary embodiment, the method also includes determining via a processor whether there is sufficient light to obtain an image of the tire tread; and automatically activating an external lighting system of the vehicle to illuminate the tire when the image of the tire tread is obtained, according to instructions provided by the processor.

[0015] Furthermore, in an exemplary embodiment, the method further includes obtaining additional sensor data from one or more additional sensors of the vehicle, including information regarding: acceleration time values ​​when the vehicle has been operated, braking, tire pressure, terrain of the lane the vehicle has traveled, and external air temperature around the vehicle; wherein tire wear monitoring is initiated at a frequency based on additional sensor data for the vehicle, including each of acceleration, braking, tire pressure, terrain of the lane the vehicle has traveled, and external air temperature around the vehicle.

[0016] In another exemplary embodiment, a system for monitoring the tire tread of a vehicle is provided, the system including a processor and one or more sensors of the vehicle. The one or more sensors are configured to acquire an image of the tire tread of the vehicle's tires after tire wear monitoring is initiated for the vehicle. The processor is coupled to the one or more sensors and is configured to at least facilitate: using the image to determine the depth of the tire tread of the vehicle's tires when tire wear monitoring is initiated for the vehicle; and providing notification to a user of the vehicle regarding the depth of the tire tread of the vehicle's tires based on instructions provided by the processor.

[0017] Furthermore, in an exemplary embodiment, one or more sensors include multiple cameras of the vehicle, including a first camera positioned adjacent to the side mirrors of the vehicle; and a second camera positioned on the underside of the vehicle; and the processor is also configured to at least facilitate the determination of tread depth using camera images from the multiple cameras combined with a calibrated camera projection matrix.

[0018] Furthermore, in an exemplary embodiment, the processor is also configured to at least facilitate the provision of instructions for the movement of the vehicle's wheels during the initiation of tread monitoring, thereby allowing for clarity of observation of the tire tread via multiple cameras and repeatability of the generation of tread images.

[0019] Furthermore, in an exemplary embodiment, the processor is also configured to at least facilitate: storing a tire tread pattern for a tire in a computer memory based on an image of the tread according to instructions provided by the processor; and determining, based on the tire tread pattern, whether to recommend tire rotation, replacement, or both, including based on whether the tire tread pattern indicates uneven tread depth between the front and rear tires, uneven tread depth between the left and right tires, or uneven tread depth between the front and rear tires and between the left and right tires.

[0020] Furthermore, in an exemplary embodiment, the system also includes one or more additional sensors for the vehicle, configured to acquire additional sensor data, including information regarding: acceleration time values ​​when the vehicle has been operated, braking, tire pressure, terrain of the lane the vehicle has traveled, and ambient air temperature around the vehicle; and the processor is further configured to at least facilitate initiating tire wear monitoring at a frequency based on additional sensor data for the vehicle, including each of acceleration, braking, tire pressure, terrain of the lane the vehicle has traveled, and ambient air temperature around the vehicle.

[0021] In another exemplary embodiment, a vehicle is provided, the vehicle including one or more wheels; one or more sensors; and a processor. One or more tires are disposed on the one or more wheels. The one or more sensors are configured to acquire an image of the tire tread after tire wear monitoring is initiated for the vehicle. The processor is coupled to the one or more sensors and is configured to at least facilitate: using the image to determine the tread depth of the tires for the vehicle when tire wear monitoring is initiated for the vehicle; and providing a user of the vehicle with notification regarding the tread depth of the tires for the vehicle based on instructions provided by the processor.

[0022] Furthermore, in an exemplary embodiment, one or more sensors include multiple cameras of the vehicle, including a first camera positioned adjacent to the side mirrors of the vehicle; and a second camera positioned on the underside of the vehicle; and the processor is further configured to at least facilitate: providing instructions for movement of the vehicle's wheels during initiation of tread monitoring, thereby allowing for clarity of observation of the tire tread via the multiple cameras and repeatability of the generation of tread images; and determining the tread depth using camera images from the multiple cameras combined with a calibrated camera projection matrix.

[0023] Furthermore, in an exemplary embodiment, the vehicle also includes one or more additional sensors configured to acquire additional sensor data for the vehicle, including information regarding: acceleration time values ​​when the vehicle has been operated, braking, tire pressure, terrain of the lane the vehicle has traveled, and ambient air temperature around the vehicle; and the processor is further configured to at least facilitate initiating tire wear monitoring at a frequency based on the additional sensor data for the vehicle, the additional sensor data including each of acceleration, braking, tire pressure, terrain of the lane the vehicle has traveled, and ambient air temperature around the vehicle. Attached Figure Description

[0024] The present disclosure will be described below with reference to the following figures, wherein the same numerals denote the same elements, and wherein:

[0025] Figure 1 This is a functional block diagram of a system including a vehicle according to an exemplary embodiment, the vehicle having multiple wheels with accompanying tires and a control system for monitoring tire wear.

[0026] Figure 2 This is a flowchart of a process for monitoring tire wear on a vehicle, according to an exemplary embodiment, and the process may be combined with... Figure 1 This is achieved through systems and vehicles (including their control systems); and

[0027] Figure 3 This is according to an exemplary embodiment. Figure 2A more detailed flowchart of the process is attached. Detailed Implementation

[0028] The following detailed description is merely exemplary in nature and is not intended to limit this disclosure or its application and use. Furthermore, it is not intended to be bound by the foregoing background information or any theories set forth in the following detailed description.

[0029] Figure 1 The figure illustrates system 10 according to an exemplary embodiment. For example... Figure 1 As depicted, in an exemplary embodiment, system 10 includes vehicles 100, communication network 160, and remote server 162, each as described below.

[0030] As described in further detail below, vehicle 100 includes a plurality of wheels 112 having corresponding tires 101 coupled thereto, a control system 102 for monitoring tire wear, and other components. (The following is in conjunction with...) Figure 1 as well as Figure 2 and Figure 3 As described in further detail in various embodiments, the process 200 involves the control system 102 using various sensor data and processor-based determinations to monitor the tread on the tire 101 and, based on this, provide appropriate notifications to the user of the vehicle 100.

[0031] In various embodiments, vehicle 100 includes automobiles, such as any of several different types of automobiles, such as, for example, sedans, vans, trucks, sport utility vehicles (SUVs), etc. In some embodiments, vehicle 100 may also include motorcycles or other vehicles, such as aircraft, spacecraft, ships, etc., and / or one or more other types of mobile platforms (e.g., robots and / or another mobile platform).

[0032] In the depicted embodiment, vehicle 100 includes a body 104 disposed on a chassis 116. The body 104 substantially surrounds the other components of vehicle 100. The body 104 and chassis 116 may collectively form a frame. Vehicle 100 also includes a plurality of wheels 112. Each wheel 112 is rotatably coupled to chassis 116 near a corresponding corner of body 104 to facilitate movement of vehicle 100. In one embodiment, vehicle 100 includes four wheels 112, although this may vary in other embodiments (e.g., for trucks, motorcycles, and certain other vehicles).

[0033] Furthermore, in various embodiments, the corresponding tire 101 is mounted or otherwise disposed on or coupled to each of the wheels 112.

[0034] The drive system 110 is mounted on the chassis 116 and drives the wheels 112, for example, via axle 114. In some embodiments, the drive system 110 includes a propulsion system having a motor 113 (e.g., in various embodiments, it includes one or more internal combustion engines, electric motors, etc.).

[0035] like Figure 1 As depicted, in various embodiments, the vehicle also includes a braking system 106 and a steering system 108. In an exemplary embodiment, the braking system 106 uses braking components to control the braking of the vehicle 100, which are controlled via input provided by the driver (e.g., via brake pedal 107) and / or via a control system (including control system 102) from primary control.

[0036] Furthermore, in an exemplary embodiment, the steering system 108 controls the steering of the vehicle 100 via a steering component, which is controlled via input provided by the driver (e.g., via the steering wheel 109) and / or autonomously controlled via a control system (including control system 102). In various embodiments, as described below... Figure 2 and Figure 3 The process 200 is described in further detail. In addition to rotation and other movements that are part of the operation of vehicle 100, wheels 112 and tires 101 are also rotated via inputs provided by the user and / or control system 102 for checking the tread on tires 101. In some embodiments, wheels 112 and tires 101 are rotated via one or more actuators 111 (e.g., in some embodiments, as part of the steering column of steering system 108).

[0037] In some embodiments, vehicle 100 also includes one or more lighting systems 115 for illuminating one or more portions of vehicle 100 and / or lanes, etc., on which vehicle 100 is being operated. In some embodiments, according to Figure 2 and Figure 3 In process 200, the lighting system 115 is used to illuminate the tire 101 for inspecting its tread, and for other purposes.

[0038] exist Figure 1 In the depicted embodiments, the control system 102 is coupled to the braking system 106, the steering system 108, and the drive system 110, and controls their operation and function. Furthermore, in various embodiments, according to... Figure 2 and Figure 3 In process 200 and further described below, the control system 102 provides monitoring of the tread of the tires 101 of the vehicle 100.

[0039] In addition, such as Figure 1As depicted in various embodiments, as described in more detail below, the control system 102 includes a sensor array 120, a display 130, a transceiver 138, and a controller 140.

[0040] In various embodiments, sensor array 120 includes various sensors that acquire sensor data for monitoring the tread of tires 101 of vehicle 100 and for other purposes. In the depicted embodiments, sensor array 120 includes one or more steering sensors 122, tire pressure monitoring system (TPMS) sensors 124, vehicle dynamics sensors 127, and inertial measurement unit (IMU) sensors 128. In some embodiments, sensor array 120 may also include one or more other sensors 129.

[0041] In various embodiments, the steering sensor 122 detects measurements of steering relative to the vehicle 100. In various embodiments, the steering sensor 122 detects engagement of the steering wheel 109 and / or angular movement of the wheels 112 and tires 101 (e.g., including steering initiated by the driver and / or automatic steering of the vehicle via the control system 102).

[0042] In various embodiments, the TPMS sensor 124 measures the tire pressure of the tire 101.

[0043] In various embodiments, camera 126 is configured to acquire camera data (e.g., camera images) of tire 101 (including the tread on tire 101). In various embodiments, camera 126 is positioned at various locations on vehicle 100 for different views of tire 101. In some embodiments, one or more first cameras 126 are positioned below one or more side mirrors of vehicle 100, while one or more second cameras 126 are positioned on the bottom of vehicle 100 (below the body 104 of vehicle 100). In some embodiments, camera 126 may also be positioned at one or more other locations on vehicle 100.

[0044] In various embodiments, the vehicle dynamics sensor 127 measures the movement of the vehicle 100. In some embodiments, in addition to one or more brake sensors (e.g., for measuring braking of the vehicle 100 via the braking system 106), the vehicle dynamics sensor 127 also includes one or more vehicle speed sensors (e.g., wheel speed sensors), and other possible sensors for measuring the movement of the vehicle 100.

[0045] In various embodiments, IMU sensor 128 includes one or more accelerometers and gyroscopes, as well as other possible sensors for or related to inertial measurements of vehicle 100. It will be understood that some of these sensors may also overlap into one or more other categories (e.g., in some embodiments, an accelerometer may also be considered as vehicle dynamics sensor 127, etc.).

[0046] In various embodiments, other sensors 129 may include one or more input sensors that detect user engagement with the tire monitoring system or process for vehicle 100. Additionally, in some embodiments, other sensors 129 may also include one or more ultrasonic sensors, lidar sensors, traction sensors, and / or one or more additional sensors, which may also be used to obtain sensor data regarding tire 101, its tread, and / or the operations and / or conditions experienced by vehicle 100, etc. Furthermore, in some embodiments, in addition to ambient or outside air temperature sensors, other sensors 129 may also include one or more ambient light sensors configured to measure ambient light to determine whether there is sufficient light to capture an image of tire 101, and other possible types of sensors.

[0047] In various embodiments, each sensor of the sensor array 120 is disposed within or on the vehicle 100, such as on the body 104 and / or on one or more of its other components.

[0048] In various embodiments, the display 130 provides information to the driver, including information about the implementation of evasive steering maneuvers by the control system 102 of the vehicle 100. Figure 1 As depicted, in some embodiments, in addition to the visual (or video) component 134 (including one or more displays), the display 130 also includes an audio component 132 (including one or more speakers). In some embodiments, the display 130 may also include a display screen or a head-up display, among other possibilities. In various embodiments, based on instructions provided by the controller 140, the display 130 provides instructions to the user to manipulate the steering wheel 109 for checking the tread of the tire 101. Furthermore, in various embodiments, based on instructions provided by the controller 140, the display 130 also provides the results of tire tread analysis, including recommendations for the user of the vehicle 100 regarding changing the tire 101 and / or rotating the tire 101.

[0049] In various embodiments, transceiver 138 is used to communicate with remote server 162 via communication network 160, including for tire tread analysis. In various embodiments, transceiver 138 performs these tasks according to instructions provided by controller 140.

[0050] In various embodiments, controller 140 is coupled to sensor array 120, display 130, and transceiver 138. In some embodiments, controller 140 is also coupled to braking system 106, steering system 108, and drive system 110. In various embodiments, controller 140 receives sensor data from sensor array 120 and other data (e.g., regarding historical or reference tire data) from transceiver 138, interprets and processes the sensor data and other data while monitoring the tread of tire 101 for vehicle 100, and provides notifications to the user of the vehicle via display 130. In some embodiments, controller 140 also controls steering via steering system 108 during tire testing for the purpose of obtaining tire tread images. Additionally, in some embodiments, controller 140 may also control the automatic operation of braking system 106, steering system 108, drive system 110, and / or other vehicle systems (e.g., for autonomous or semi-autonomous operation of vehicle 100 in some embodiments and situations).

[0051] In various embodiments, the controller 140 according to Figure 2 and Figure 3 These functions are provided by the steps of process 200, which are described in the text and further described in more detail below.

[0052] like Figure 1 As depicted, in various embodiments, controller 140 includes a computer system (also referred to herein as computer system 140) and includes processor 142, memory 144, interface 146, storage device 148, and computer bus 150.

[0053] Processor 142 performs the computational and control functions of controller 140 and may include any type of processor or multiple processors, a single integrated circuit such as a microprocessor, or any suitable number of integrated circuit devices and / or circuit boards that work together to perform the functions of the processing unit. During operation, processor 142 executes one or more programs 152 contained in memory 144 and thus controls the general operation of controller 140 and the computer system of controller 140, typically by performing the processes described herein (such as...). Figure 2 and Figure 3 During the process 200), and as further described below.

[0054] Memory 144 can be any suitable type of memory, including various types of nontransitory computer-readable storage media. In some examples, memory 144 is located on and / or co-located with processor 142 on the same computer chip. In the depicted embodiment, memory 144 stores the above-described program 152 as well as stored values ​​157 (e.g., stored tire tread data and tire identification values, and in some embodiments, also stores lookup tables, thresholds, and / or other values ​​related to process 200).

[0055] Interface 146 allows communication, for example, from a system drive and / or another computer system to the computer system of controller 140, and can be implemented using any suitable methods and means. In one embodiment, interface 146 obtains various data from sensor array 120 and other possible data sources. Interface 146 may include one or more network interfaces for communicating with other systems or components. Interface 146 may also include one or more network interfaces for communicating with technicians, and / or one or more storage interfaces for connecting to storage devices (such as storage device 148).

[0056] Storage device 148 can be any suitable type of storage device, including various types of direct access storage and / or other memory devices. In one exemplary embodiment, storage device 148 includes a program product from which memory 144 can receive program 152, which performs one or more embodiments of one or more processes of this disclosure, such as Figure 2 and Figure 3 The process 200 steps, and as further described below in conjunction with them. In another exemplary embodiment, the program product may be stored directly in memory 144 and / or disk (e.g., disk 156) and / or otherwise accessed by memory 144 and / or disk, as referenced below.

[0057] Bus 150 is used to transmit programs, data, status, and other information or signals between various components of the computer system of controller 140. Bus 150 can be any suitable physical or logical device for connecting the computer system and components. This includes, but is not limited to, direct hardwired connections, fiber optic, infrared, and wireless bus technologies. During operation, program 152 is stored in memory 144 and executed by processor 142.

[0058] It will be understood that although this exemplary embodiment is described in the context of a full-featured computer system, those skilled in the art will recognize that the mechanisms of this disclosure can be distributed as a program product using one or more types of nontransitory computer-readable signal-bearing media used to store a program and its instructions and to perform its distribution, such as a nontransitory computer-readable medium carrying a program and containing computer instructions stored therein for causing a computer processor (such as processor 142) to execute and run the program.

[0059] Continue to refer to Figure 1 In various embodiments, the communication network 160 includes one or more wireless communication networks and / or systems, such as one or more cellular networks, satellite-based networks and / or other wireless networks.

[0060] Furthermore, in various embodiments, the remote server 162 is configured to be physically remote from vehicle 100. In various embodiments, the remote server 162 communicates with vehicle 100 (and other vehicles, such as in a convoy in some embodiments) via communication network 160. In various embodiments, the remote server 162 records and maintains information relating to various vehicles (including vehicle 100) and their respective tires 101, including information about the corresponding type of tire 101, its identification, and tire tread measurements, and communicates these values ​​to and from vehicle 100 via communications to and from vehicle 100. Figure 1 The remote server 162 depicted includes a transceiver 164, a processor 166, and a memory 168 with stored values ​​170 (similar in various embodiments to those described above with respect to the controller 140 of vehicle 100), as well as other systems and components.

[0061] Figure 2 This is a flowchart of a process 200 for monitoring tire tread in a vehicle. In various embodiments, process 200 may be combined with... Figure 1 System 10 (including Figure 1 This is achieved through the vehicle 100 and its control system 102. Process 200 will also be discussed in detail below. Figure 3 To be further described, Figure 3 An additional flowchart of process 200 is described in more detail.

[0062] like Figure 2 As depicted, in various embodiments, process 200 begins at 202. In some embodiments, process 200 begins when vehicle 100 is ready to test tire 101 (i.e., monitor the tread of tire 101). In some embodiments, this may occur when the vehicle is currently being driven or when the ignition cycle is complete; however, this may vary in other embodiments.

[0063] In various embodiments, tire monitoring is initiated (step 204). In some embodiments, this occurs when the user... Figure 1 The control system 102 enables tire wear measurement when it is activated, and / or when a preset measurement time trigger has been met. However, this may vary in other embodiments.

[0064] In various embodiments, vehicle conditions are assessed (step 206). In various embodiments, step 206 includes checking or assessing the battery level of vehicle 100, other vehicle conditions, and / or the surrounding environment of vehicle 100, which relates to whether the analysis of the tire tread is appropriate. In some embodiments, such conditions include circumstances that would indicate potential wear on tire 101 and / or its tread, such as driving on rough roads, frequent or rapid braking and / or acceleration, typical wear of tire 101 for this particular type of vehicle 100, etc.

[0065] In various embodiments, a determination is made as to whether the vehicle conditions have been met (step 208). In various embodiments, during step 208, processor 142 determines whether the analysis of the tire tread is appropriate at the current time based on the evaluation of step 206.

[0066] In various embodiments, if it is determined in step 208 that the vehicle conditions have not yet been met, process 200 returns to step 206, and steps 206-208 are subsequently repeated in new iterations until it is determined in the iteration of step 208 that the vehicle conditions have been met. Conversely, once it is determined during the iteration of step 208 that the vehicle conditions have been met, process 200 proceeds to step 210, where the tire tread measurement mode is initiated.

[0067] Once the tire tread measurement mode is initiated at step 210, steering is performed (step 212). In various embodiments, the steering wheel 109 of vehicle 100 is moved so that camera 126 can acquire an image of the tire tread on tire 101. In some embodiments, processor 142 provides instructions via display 130 for a user (e.g., a driver) to follow in turning the steering wheel 109. In some other embodiments, processor 142 can provide instructions for automatically moving the steering wheel 109, for example via instructions provided to... Figure 1 The actuator 111 is instructed. In any case, in various embodiments, engagement and / or movement of the steering wheel 109 causes the wheels 112 of the vehicle 100 to move, and allows for clarity of observation of the tread of the tire 101 via one or more cameras 126 and repeatability of the generation of images of the tread (e.g., because the sensors of the sensor array 120 of the vehicle 100, including the cameras 126 of the vehicle 100, are utilized during process 200).

[0068] In various embodiments, a tire image is captured (step 214). In various embodiments, a camera 126 is used to capture a camera image of the tire 101 (including its tread) according to instructions provided by the processor 142. In some embodiments, one or more other sensors 129 (e.g., one or more ultrasonic sensors) may also be used to obtain an image of the tire tread. In various embodiments, the tire image is obtained at various different angles (e.g., via camera 126 or, in some embodiments, via other sensors 129) based on a calibrable load wheel angle threshold, as described above, including by rotating the steering wheel.

[0069] In some embodiments, a determination is made regarding whether visibility is acceptable (step 216). In some embodiments, during step 216, processor 142 determines whether there is sufficient light to obtain a clear image of tire 101. In some embodiments, this is determined via camera 126 and / or one or more other sensors 129 (e.g., one or more ambient light sensors, etc.).

[0070] In various embodiments, if visibility is determined to be unacceptable in step 216, an adjustment is made (step 218). In various embodiments, according to instructions provided by processor 142, Figure 1 The lighting system 115 is illuminated to provide illumination for an image of the tire tread. In some embodiments, one or more cameras 126 and / or other sensors may be adjusted to help enhance the image of the tire (e.g., by putting camera 126 in night mode, etc.). In various embodiments, the process then returns to step 214, where a new tire image is obtained, and the process continues in a new iteration.

[0071] Conversely, in various embodiments, if visibility is alternatively determined to be acceptable, the process then proceeds alternatively to step 220. In various embodiments, during step 220, the tire tread profile is measured and stored. In various embodiments, the tire tread profile for tire 101 is measured via image processing edge detection, which is performed via processor 142 for a tire image (e.g., a camera image in some embodiments). Additionally, in various embodiments, the tire tread profile is... Figure 1 The stored value 157 is stored in the memory 144 for further use and processing.

[0072] In various embodiments, tire measurements are compared with factory tire data (step 222). Specifically, in various embodiments, based on the type of tire 101 used in vehicle 100, the tire tread profile of step 220 is compared with factory-supplied tire data regarding typical or expected tire tread values ​​for operating conditions similar to those of vehicle 100. In various embodiments, the factory-supplied data is from stored values ​​157 in the vehicle's memory 144 and / or Figure 1 The value 170 was retrieved from the memory 168 of the remote server 162.

[0073] Furthermore, in various embodiments, tire data is uploaded (step 224). In various embodiments, the tire measurements and profiles from step 220 and the comparison from step 222 are sent to a remote server 162 for storage therein and for subsequent use with vehicle 100 and / or other vehicles (e.g., in some embodiments, having a tire profile with ... Figure 1 The tires are used in combination with those of other vehicles (such as vehicle 100). Additionally, in various embodiments, data related to conditions and events experienced by vehicle 100 are also sent to a remote server 162 along with the tire data.

[0074] Continue to refer to Figure 2 Similarly, in various embodiments, a determination is made regarding whether the tire tread is worn away (step 226). Specifically, in various embodiments, during step 226, the processor 142 determines whether the remaining tire tread of one or more tires 101 of the vehicle 100 is less than or equal to a predetermined value.

[0075] In various embodiments, if it is determined in step 226 that the tire tread has worn away (e.g., the remaining tire tread is less than or equal to a predetermined value in step 226), a notification is provided (step 228). In various embodiments, this is done via instructions provided by processor 142. Figure 1 The display 130 provides notification about the remaining tire tread level, as well as one or more recommended actions (e.g., tire removal). In various embodiments, the process then terminates at step 232.

[0076] Conversely, in various embodiments, if it is determined in step 226 that the tire tread has not been worn away (e.g., the remaining tire tread is greater than the predetermined value in step 226), the process terminates at step 232 without any corrective action or notification.

[0077] Furthermore, in various embodiments, a determination is made regarding whether uneven tire wear is detected (step 230). Specifically, in various embodiments, during step 230, the processor 142 determines whether the remaining tire tread of one or more first tires 101 of the vehicle 100 is sufficiently different from that of one or more second tires 101 of the vehicle 100 (e.g., having a difference greater than or equal to a predetermined threshold).

[0078] In various embodiments, if uneven tire wear is determined in step 230, a notification is provided (in a new iteration of step 228). In various embodiments, this is done via instructions provided by processor 142. Figure 1 The display 130 provides notifications about uneven tire wear, as well as one or more recommended actions (e.g., rotating the tires). In various embodiments, the process then terminates at step 232.

[0079] Conversely, in various embodiments, if it is determined instead in step 230 that there is no uneven tire wear, the process terminates at step 232 without any corrective action or notification.

[0080] As described above, according to an exemplary embodiment, Figure 3 Provided with, for example Figure 2 Additional flowcharts for the process 200.

[0081] like Figure 3 As depicted, in various embodiments, tire monitoring is initiated by the user (step 302). In various embodiments, this corresponds to... Figure 2 Step 204.

[0082] In various embodiments, image data is acquired from various sensors (step 304). In various embodiments, the image data is acquired from various cameras 126 (such as exterior rearview mirror cameras and / or bottom cameras) and / or other sensors (such as side lidar sensors and / or other sensors in some embodiments). In various embodiments, image data is acquired with respect to tires 101 and other conditions around the lane and / or vehicle 100.

[0083] Additionally, a determination is made regarding whether TPMS data has been detected for the tire (step 306). In some embodiments, when data is available, TPMS data, including tire pressure values, is obtained via... Figure 1 The data was obtained from the TPMS sensor 124.

[0084] Furthermore, in various embodiments, tire identification (ID) values ​​are stored (step 308). In various embodiments, the ID values ​​for the front left, front right, rear left, rear right (and any other applicable tires) are stored in... Figure 1The value 157 is stored in memory 144.

[0085] In various embodiments, an initial tire analysis is performed (step 310). In various embodiments, the initial tire analysis is performed by the processor 142 based on sensor data, including information about: the tire tread value at an initial current value (e.g., an initial counter value equal to zero).

[0086] In various embodiments, calibration is performed (step 312). Specifically, in various embodiments, processor 142 performs calibration on the sensors and sensor data (including tire tread values) at set intervals (e.g., every 10,000 km in some embodiments, although this may vary in other embodiments). Furthermore, in various embodiments, the calibration is adjusted as appropriate based on the predicted data from step 312. In various embodiments, the predicted data for step 312 includes the following items and other possible data: (i) anti-lock braking system (ABS) data 314 (e.g., regarding ABS activation, including the number or frequency of skidstops, sudden braking, etc.); (ii) acceleration 316 (e.g., including acceleration at pedal positioning greater than a predetermined threshold, such as 90 percent in an exemplary embodiment); (iii) road terrain 318 (e.g., measurement of operating distance on a road versus an asphalt surface, etc.); (iv) outside air temperature 320 (e.g., including warm weather above a first predetermined threshold (e.g., six degrees Celsius) in one embodiment, and, in comparison, cold weather below a second predetermined threshold (e.g., negative six degrees Celsius) in one embodiment, etc.); and (v) low tire pressure reading 322, and other possible predicted data.

[0087] Furthermore, in various embodiments, tire pressure relearning is detected (step 326). In various embodiments, during step 326, processor 142 determines whether any tire change (e.g., tire replacement or transposition) has occurred based on the detected TPMS learning. Specifically, in various embodiments, TPMS data and learning are used to identify specific tires to determine whether a specific tire has been moved (e.g., such as when a specific tire has been replaced or transpositioned).

[0088] In various embodiments, the tire ID is updated (step 328). Specifically, in various embodiments, the processor 142 updates the tire ID in memory for each tire 101 of the vehicle 100 to reflect any tire changes (e.g., replacement or transposition), etc.

[0089] In various embodiments, the tire pattern is evaluated (step 330). Specifically, in various embodiments, the processor 142 evaluates the current tire pattern (including the tread) based on recently updated image and sensor data and compares it with stored values ​​from memory.

[0090] Furthermore, in various embodiments, the user is asked about tire replacement (step 332). Specifically, in various embodiments, the processor 142 via... Figure 1 The display 130 alerts the user of vehicle 100 whether a tire change has occurred, including the use of winter tires when entering colder temperatures and / or areas.

[0091] Furthermore, in various embodiments, if a tire replacement is confirmed, the tire ID for the replaced tire (e.g., a winter tire) is stored in memory by the processor 142 (step 334).

[0092] Returning to step 310, after performing the initial tire analysis (where the counter is initialized to zero), step 336 further determines whether vehicle 100 has sufficient battery power to perform tire movement and analysis. In various embodiments, the determination in step 336 is performed by processor 142 based on whether the vehicle's battery power is greater than a predetermined threshold (e.g., 20 percent in one exemplary embodiment, although this may vary in other embodiments).

[0093] Additionally, in various embodiments, ambient light sensor data is obtained at step 338, and a determination is made at step 340 regarding whether the ambient light conditions are sufficient for tire imaging and monitoring. In various embodiments, if it is determined that the ambient light is insufficient, the illumination system is turned on to illuminate the tire and tire threads for image acquisition (step 342), after which the process proceeds to step 344 (discussed below). Otherwise, if the light is sufficient, the process proceeds to step 344 without the illumination required in step 342.

[0094] In various embodiments, during step 344, tire color cleanliness is determined. Specifically, in various embodiments, during step 344, processor 142 determines that the color cleanliness of the tire is reflected in the sensor image (e.g., camera image). In various embodiments, color cleanliness may refer to color differences across the tire width, such as white representing snow, brown representing mud, etc. In various embodiments, processor 142 also determines a correlation with weather reports (such as blizzards, dust storms, etc.) for verification. Furthermore, in various embodiments, processor 142 adjusts the tire tread pattern based on the determination of discoloration (e.g., to account for discoloration, etc.). For example, in various embodiments, when tire 101 is covered with mud, snow, etc., this adjustment helps ensure that this is not misinterpreted as a bare or excessively worn tire 101, etc.

[0095] In various embodiments, edge detection is performed (step 346). In various embodiments, edge detection is performed by processor 142 to determine the tire tread pattern and store it in memory (such as stored in memory). Figure 1 (In the memory 144, the stored value 157).

[0096] Furthermore, in various embodiments, the tire tread profile is generated and stored (step 348). In various embodiments, the processor 142 generates and stores the tire thread profile by processing and edge detection, and by image processing of sensor images (e.g., camera images) of the tire.

[0097] Furthermore, in some embodiments, various sensors are used to detect object obstacles (step 350). Specifically, in some embodiments, one or more cameras (e.g., exterior rearview mirror cameras) and / or other sensors (e.g., side ultrasonic sensors) are used to detect and / or consider objects adjacent to tire 101 that may obstruct the tire threads.

[0098] Furthermore, in some embodiments, a scan is performed (step 351). In some embodiments, a tire scan is performed within a predetermined object distance to remove or consider objects that may obstruct the image of tire 101.

[0099] Furthermore, in various embodiments, steering ratio data is obtained (step 352). Specifically, in various embodiments, processor 142 obtains steering ratio data from sensor array 120 regarding the correlation between steering wheel angle and road wheel angle, including data for determining whether the tires and wheels are ready to turn for tire wear monitoring.

[0100] In various embodiments, the steering wheel is rotated (step 354). In various embodiments, the steering wheel is rotated accordingly once conditions are determined to be suitable for turning the tires and wheels for tire wear monitoring. In various embodiments, once steering availability is confirmed for the front wheels, the front wheels are slowly rotated by a certain angle (referred to herein as "X" degrees), which allows the tire tread to be fully exposed and mapped accordingly. Similar to the discussion above, in some embodiments, steering is autonomously performed via instructions provided by processor 142, while in other embodiments, processor 142 may be directed via... Figure 1 The display 130 provides steering instructions for the user. In any case, in various embodiments, sensor images (e.g., camera images) are obtained about the tire tread of the front tire as the front wheels rotate at various different angles accordingly.

[0101] Furthermore, in various embodiments, rear wheel steering availability is similarly confirmed (step 356), after which the rear wheels are similarly rotated (step 358), and as the rear wheels are rotated accordingly at various different angles, sensor images (e.g., camera images) are similarly obtained regarding the tire tread of the rear wheels.

[0102] In various embodiments, tire depth is calculated (step 360). Specifically, in various embodiments, processor 142 calculates the tire tread depth for different tires based on sensor (e.g., camera) images of the tires at various angles. In various embodiments, these calculations are performed by the processor based on a calibrated camera projection matrix.

[0103] Furthermore, in various embodiments, during step 362, a final value of the tire tread depth is calculated via the camera projection matrix and compared with each other and with reference images (e.g., data from historical data and / or data provided by the factory). In various embodiments, this is done via... Figure 1 It is executed by processor 142.

[0104] Furthermore, in various embodiments, tire replacement time is estimated or updated (step 364). Specifically, in various embodiments, processor 142 estimates and / or updates the expected amount of time the tires will remain in usable conditions based on tread depth, and / or the amount of continued use and / or distance for which replacement of one or more of the tires may be recommended. In various embodiments, this determination may also be made using stored values ​​157 in memory 144 (such as one or more lookup tables, historical data, factory-provided guidelines, etc.).

[0105] Furthermore, in various embodiments, a determination is made regarding whether uneven wear is detected (step 366). Specifically, in various embodiments, and similar to the discussion above, uneven wear can be detected when the difference in wear between different tires or between tire treads exceeds a predetermined difference threshold.

[0106] In various embodiments, if uneven wear is determined in step 366, a determination is made regarding whether the overall front tire wear is greater than the rear tire wear (step 368). In various embodiments, if it is determined in step 366 that the front tire wear is greater than the rear tire wear, tire rotation, including exchanging the front and rear tires, may be recommended (step 370). In various embodiments, this recommendation is made via processor 142. Figure 1 The display 130 provides instructions to the user.

[0107] Furthermore, in various embodiments, a determination is made regarding whether the wear on the left side is significantly different from that on the right side (step 372). In various embodiments, if it is determined in step 372 that the wear on the left tire is greater than that on the right tire (e.g., the tread depth on the left tire is smaller compared to the right tire), then wheel alignment is recommended in various embodiments (step 374). In various embodiments, this recommendation is made via processor 142. Figure 1 The display 130 provides instructions to the user. Furthermore, in some embodiments, wheel alignment may be recommended in other situations (such as other types of uneven tire wear).

[0108] Therefore, methods, systems, and vehicles are provided for monitoring tire tread depth using camera and / or other sensor data (including images of tire tread taken with a camera and / or other sensors while selectively rotating the steering wheel of a vehicle under controlled image conditions) and utilizing various other sensor data regarding vehicle operation and environmental conditions.

[0109] It will be understood that the systems, vehicles, and methods may differ from those depicted in the accompanying drawings and described herein. For example, in relation to... Figure 1 The description in and / or the combination of the above Figure 1 In different embodiments described, Figure 1 The vehicle 100 (including the control system 102 and / or its other components) may vary. Similarly, it will be understood that the steps of process 200 and how they are implemented may differ. Figure 2 and Figure 3 The various steps of process 200 described herein can occur simultaneously and / or with Figure 2 or Figure 3 The order in which the events described and / or the events described above occur differs from the order in which they occur.

[0110] While at least one exemplary embodiment has been presented in the foregoing detailed description, it should be understood that numerous variations exist. It should also be understood that the exemplary embodiments or multiple exemplary embodiments are merely examples and are not intended to limit the scope, applicability, or configuration of this disclosure in any way. Rather, the foregoing detailed description will provide those skilled in the art with a convenient roadmap for implementing the exemplary embodiments or multiple exemplary embodiments. It should be understood that various changes can be made to the function and arrangement of the elements without departing from the scope of this disclosure as set forth in the appended claims and their legal equivalents.

Claims

1. A method for monitoring the tire tread of a vehicle's tires, the method comprising: After tire wear monitoring is initiated for the vehicle, an image of the tire tread of the vehicle is obtained via one or more sensors of the vehicle; When tire wear monitoring is initiated for the vehicle, the depth of the tire tread for the vehicle is determined using the image via a processor coupled to the one or more sensors; as well as The processor provides instructions to the user of the vehicle to notify them of the depth of the tread of the tires for the vehicle.

2. The method according to claim 1, wherein: The step of obtaining the image of the tire tread includes obtaining the image from one or more cameras of the vehicle; as well as The step of determining the depth of the tread includes using camera images from the one or more cameras combined with a calibrated camera projection matrix via the processor to determine the depth of the tread.

3. The method according to claim 2, further comprising: During the initiation of monitoring of the tire tread, instructions for the movement of the vehicle's wheels are provided via the processor, thereby allowing for clarity of observation of the tire tread via the one or more cameras and repeatability of the generation of the images of the tire tread.

4. The method according to claim 1, further comprising: The processor provides instructions to store a tire tread pattern for the tire in a computer memory based on the image of the tread. The processor determines the decolorization of the tire based on the image; as well as The processor adjusts the tire tread pattern based on the determination of the decolorization for storage in the computer memory.

5. The method according to claim 1, further comprising: The processor provides instructions to store a tire tread pattern for the tire in a computer memory based on the image of the tread. as well as The processor determines whether to recommend tire rotation, replacement, or both based on the tire tread pattern, including whether the tire tread pattern indicates uneven tread depth between the front and rear tires, uneven tread depth between the left and right tires, or uneven tread depth between the front and rear tires and between the left and right tires.

6. The method according to claim 1, further comprising: According to instructions provided by the processor, an identifier for the tire pressure monitoring system (TPMS) of the tire is stored in the computer memory to identify a specific tire and to determine whether the specific tire has been replaced or rotated.

7. The method according to claim 1, further comprising: The processor determines whether there is enough light to obtain the image of the tire tread. as well as Upon receiving the image of the tire tread, the vehicle's external lighting system is automatically activated to illuminate the tire, according to instructions provided by the processor.

8. A vehicle comprising: One or more wheels; One or more tires are mounted on the one or more wheels; One or more sensors are configured to acquire an image of the tire tread after tire wear monitoring is initiated for the vehicle; as well as A processor, coupled to the one or more sensors and configured to at least facilitate: The image is used to determine the tread depth of the tires for the vehicle when tire wear monitoring is initiated. as well as The processor provides instructions to the user of the vehicle to notify them of the depth of the tread of the tires for the vehicle.

9. The vehicle according to claim 8, wherein: The one or more sensors include multiple cameras of the vehicle, including: A first camera is positioned adjacent to the side mirror of the vehicle; and A second camera is installed on the bottom of the vehicle; and The processor is also configured to at least facilitate: During the initiation of monitoring of the tire tread, instructions are provided for the movement of the vehicle's wheels, thereby allowing for clarity of observation of the tire tread via the plurality of cameras and repeatability of the generation of the images of the tire tread; and The depth of the tire tread is determined by combining camera images from the plurality of cameras with a calibrated camera projection matrix.

10. The vehicle according to claim 8, further comprising: One or more additional sensors are configured to acquire additional sensor data for the vehicle, including: acceleration time values, braking, tire pressure, terrain of the lane the vehicle has traveled, and outside air temperature around the vehicle when the vehicle has been operated. The processor is also configured to at least facilitate the initiation of tire wear monitoring at a frequency based on additional sensor data for the vehicle, including each of the following: acceleration, braking, tire pressure, terrain of the lane the vehicle has traveled, and ambient air temperature around the vehicle.

Images