Wheel area state monitoring method, device and equipment and storage medium

Abstract

The invention relates to a state monitoring method, device and equipment for a wheel area and a storage medium, and the method comprises the steps: obtaining a wheel image and an infrared image, the wheel image is obtained by photographing wheels in a target vehicle through a visible light camera device, and the infrared image is obtained by photographing the wheels in the target vehicle through a visible light camera device; the infrared image is obtained by shooting wheels in the target vehicle through an infrared camera device; based on the wheel image and the infrared image, state monitoring is conducted on the wheel, state information of a target wheel area is obtained, and the state information is used for reflecting whether an abnormal condition matched with the state information appears in the target wheel area or not. In this way, the state information of the target wheel area can be comprehensively and accurately monitored, and therefore the safety of vehicle driving is guaranteed.

Description

Technical Field

[0001] The present disclosure relates to the field of vehicle technology, and in particular to a method, device, equipment and storage medium for monitoring the state of a wheel area. Background Art

[0002] With the development of technology and the improvement of people's living standards, cars have become popular in thousands of households, and have changed from fuel cars to new energy cars. But no matter what type of car, it usually uses wheels to move forward. It can be seen that the wheel part of the car is an important part of the entire car, providing basic safety guarantees for car driving. At present, the state monitoring of wheels in related technologies usually stops at tire pressure monitoring, but there are many factors that affect the safety performance of wheels, such as deformation, temperature, etc. In order to ensure the safety of wheel driving, how to monitor the state information of the wheel area is an important issue that needs to be solved urgently. Summary of the invention

[0003] In order to overcome the problems existing in the related art, the present disclosure provides a wheel area status monitoring method, device, equipment and storage medium, which can comprehensively and accurately monitor the status information of the target wheel area, thereby ensuring the safety of vehicle driving.

[0004] According to a first aspect of an embodiment of the present disclosure, a method for monitoring a state of a wheel region is provided, comprising:

[0005] Acquire a wheel image and an infrared image, wherein the wheel image is obtained by photographing the wheel of the target vehicle through a visible light camera device, and the infrared image is obtained by photographing the wheel of the target vehicle through an infrared camera device;

[0006] The state of the wheel is monitored based on the wheel image and the infrared image to obtain state information of a target wheel area, wherein the target wheel area is a wheel area constituting the wheel, and the state information of the target wheel area is used to reflect whether an abnormal condition matching the state information occurs in the target wheel area.

[0007] In some embodiments, the performing status monitoring on the wheel based on the wheel image and the infrared image to obtain status information of the target wheel area includes:

[0008] Perform wheel partitioning on the wheel image to obtain the target wheel area, wherein the target wheel area includes at least one of the following: an axle area, a contour area, and a tire area;

[0009] Performing mapping processing on the infrared image according to the target wheel area to obtain a mapped infrared area in the infrared image corresponding to the target wheel area;

[0010] The mapped infrared area is subjected to status monitoring to obtain status information of the target wheel area.

[0011] In some embodiments, the performing status monitoring on the mapped infrared area to obtain status information of the target wheel area includes:

[0012] Performing temperature field distribution statistics on the mapped infrared region to obtain temperature distribution information of the mapped infrared region;

[0013] State monitoring is performed based on the temperature distribution information of the mapped infrared area to obtain state information of the target wheel area; wherein the state information includes at least one of the following: deformation state, crack state, foreign matter state and temperature distribution state; the deformation state is at least used to indicate whether an abnormal deformation condition has occurred in the target wheel area, the crack state is at least used to indicate whether an abnormal crack condition has occurred in the target wheel area, the foreign matter state is at least used to indicate whether a foreign matter condition has occurred in the target wheel area, and the temperature distribution state is at least used to indicate whether an abnormal temperature condition has occurred in the target wheel area.

[0014] In some embodiments, the state monitoring based on the temperature distribution information of the mapped infrared area to obtain the state information of the target wheel area includes any one of the following:

[0015] If the state information is the deformation state, deformation detection is performed on the temperature distribution information of the mapped infrared area to obtain the deformation state of the target wheel area;

[0016] If the state information is the crack state, performing crack anomaly detection on the temperature distribution information of the mapped infrared area to obtain the crack state of the target wheel area;

[0017] If the state information is the foreign object state, performing foreign object detection on the temperature distribution information of the mapped infrared area to obtain the foreign object state of the target wheel area;

[0018] If the state information is the temperature distribution state, a statistical analysis is performed on the temperature distribution information of the mapped infrared region to obtain the temperature distribution state of the target wheel.

[0019] In some embodiments, when the deformation amount indicated by the deformation state of the target wheel area is not within a preset deformation range, the deformation state of the target wheel area is also used to indicate that an abnormal deformation condition has occurred in the target wheel area; or, when the temperature value indicated by the temperature distribution state of the target wheel area is greater than a preset temperature value, the temperature distribution state of the target wheel area is also used to indicate that an abnormal overtemperature condition has occurred in the target wheel area.

[0020] In some embodiments, the visible light camera device and the infrared camera device are both disposed in the target vehicle.

[0021] In some embodiments, the method further comprises at least one of the following:

[0022] Performing zone deformation detection on the wheel image to obtain a deformation state of the target wheel area;

[0023] Performing zone-by-zone crack detection on the wheel image to obtain a crack state of the target wheel area;

[0024] The wheel image is subjected to a partitioned foreign object detection to obtain the foreign object status of the target wheel area.

[0025] In some embodiments, the method further comprises:

[0026] When the status information of the target wheel area is used to reflect that an abnormal condition matching the status information occurs in the target wheel area, an early warning message is output, where the early warning message is used to prompt that an abnormal condition occurs in the status information of the target wheel area.

[0027] According to a second aspect of an embodiment of the present disclosure, a device for monitoring a state of a wheel region is provided, comprising:

[0028] an acquisition module, configured to acquire a wheel image and an infrared image, wherein the wheel image is acquired by photographing the wheel of the target vehicle through a visible light camera device, and the infrared image is acquired by photographing the wheel of the target vehicle through an infrared camera device;

[0029] The processing module is configured to monitor the state of the wheel based on the wheel image and the infrared image to obtain state information of a target wheel area, wherein the target wheel area is a wheel area constituting the wheel, and the state information of the target wheel area is used to reflect whether an abnormal condition matching the state information occurs in the target wheel area.

[0030] For the contents not introduced or described in the embodiments of the present disclosure, please refer to the relevant introduction in the aforementioned method embodiments, and the embodiments of the present disclosure are not limited thereto.

[0031] According to a third aspect of an embodiment of the present disclosure, there is provided a terminal device, comprising: a processor; and a memory for storing processor executable instructions; wherein the processor is configured to execute the executable instructions to implement the steps of the above-mentioned wheel area status monitoring method.

[0032] According to a fourth aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided, on which computer program instructions are stored. When the program instructions are executed by a processor, the steps of the wheel area condition monitoring method provided in the first aspect of the present disclosure are implemented.

[0033] According to a fifth aspect of an embodiment of the present disclosure, there is provided a chip comprising: a processor and an interface; the processor is used to read instructions to execute the steps of the above-mentioned wheel area status monitoring method.

[0034] The technical solution provided by the embodiments of the present disclosure may include the following beneficial effects: the terminal device acquires a wheel image and an infrared image, wherein the wheel image is obtained by photographing the wheel in the target vehicle through a visible light camera device, and the infrared image is obtained by photographing the wheel in the target vehicle through an infrared camera device; the wheel is monitored based on the wheel image and the infrared image to obtain the status information of the target wheel area, wherein the target wheel area is the wheel area constituting the wheel, and the status information of the target wheel area is used to reflect whether an abnormal condition matching the status information occurs in the target wheel area. It can be seen that the terminal device can monitor the status of the wheel partition based on the wheel image photographed by the visible light camera device and the infrared image photographed by the infrared camera device, and obtain the status information of the target wheel area, thereby identifying whether the target wheel area has a corresponding abnormal condition to ensure the safety of vehicle driving; at the same time, it can also improve the reliability and accuracy of wheel area status monitoring.

[0035] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0037] Figure 1 is a system schematic diagram shown according to an exemplary embodiment.

[0038] Figure 2 The figure is a flow chart of a method for monitoring the state of a wheel area according to an exemplary embodiment.

[0039] Figure 3 The present invention is a flowchart of a state monitoring method according to an exemplary embodiment.

[0040] Figure 4 The figure is a schematic diagram showing the partitioning of a wheel area according to an exemplary embodiment.

[0041] Figure 5is a schematic diagram of temperature field distribution according to an exemplary embodiment.

[0042] Figure 6 The figure is a schematic diagram showing temperature distribution in a wheel area according to an exemplary embodiment.

[0043] Figure 7 is a deformation schematic diagram shown according to an exemplary embodiment.

[0044] Figure 8 It is a schematic structural diagram of a device for monitoring the state of a wheel area according to an exemplary embodiment.

[0045] Fig. 9 The diagram is a schematic structural diagram of a terminal device according to an exemplary embodiment.

[0046] Fig.10 The figure is a schematic diagram showing the structure of a chip according to an exemplary embodiment. DETAILED DESCRIPTION

[0047] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0048] It should be noted that all actions of acquiring signals, information or data in the present disclosure are carried out in compliance with the relevant data protection laws and policies of the country where the device is located and with the authorization given by the owner of the corresponding device.

[0049] See also Figure 1 FIG. 1 is a schematic diagram of a system according to an exemplary embodiment. Figure 1The system shown may include a target vehicle 100 and a camera device 200, and optionally the system may also include but is not limited to any one or more of the following combinations: a user device 300, a server 400, a base station 500, and a terminal device 600 (also referred to as a central control device). Among them, the present disclosure does not limit the number of each device or apparatus in the system, which can be determined according to actual conditions. The camera device 200 of the present disclosure may include but is not limited to, for example, the visible light camera device and the infrared camera device involved in the present disclosure below, and may optionally include other customized camera devices, etc. The above-mentioned camera device 200 can be deployed in the target vehicle 100 in the form of area array detection / monitoring, and the present disclosure does not limit the specific setting position of the above-mentioned camera device 200, for example, it can be customized according to actual needs in a specific internal space of the target vehicle 200, etc.

[0050] In some optional embodiments, the above system may also include a terminal device 600 (which may also be referred to as a central control device). The terminal device 600 may perform processing based on the image captured by the above camera device 200, such as performing wheel area status monitoring involved in the present disclosure below, which is specifically described in detail below in the present disclosure. Optionally, the terminal device 600 may also upload the processing results (such as the monitoring results of the wheel area status monitoring, i.e., the status information of the target wheel area below), the data monitored by the terminal device (such as the temperature distribution information of the target wheel area at a certain driving speed), the image captured by the camera device 200 and other information to the server 400 through the base station 500 for storage, so as to facilitate the user device 300 to query the corresponding information from the server 400 in real time or according to actual needs. Alternatively, the camera device 200 may upload the relevant images captured by itself to the server 400 for storage through the base station 500, so as to enable the user device 300 to view them in real time. The user device 300 may be installed with a corresponding application APP, through which corresponding information, such as status information of the monitored wheel area, may be queried and obtained from a terminal device or a server 400, etc., and the present disclosure does not make too many restrictions and details on this.

[0051] The terminal device involved in the present disclosure may be a mobile phone, a tablet computer, a computer with wireless transceiver function, or a wireless terminal used in scenarios such as virtual reality (VR), augmented reality (AR), industrial control, self-driving, remote medical, smart grid, transportation safety, smart city, and smart home, such as a central processing unit or a central control device. In the present disclosure, the aforementioned terminal devices and chips applicable to the aforementioned terminal devices are collectively referred to as terminal devices. It should be understood that the embodiments of the present disclosure do not limit the specific technology and specific device form adopted by the terminal devices.

[0052] Based on the above examples, see Figure 2 FIG. 1 is a flow chart of a method for monitoring the state of a wheel region according to an exemplary embodiment. Figure 2 The method shown is applied to a terminal device, and the method may include the following implementation steps:

[0053] S201. Acquire a wheel image and an infrared image, wherein the wheel image is obtained by photographing the wheels of a target vehicle using a visible light camera, and the infrared image is obtained by photographing the wheels of the target vehicle using an infrared camera.

[0054] The wheel image mentioned above in the present disclosure refers to an image obtained by photographing the wheel in the target vehicle using a visible light camera, and the infrared image mentioned above refers to an image obtained by photographing the same wheel using an infrared camera. There is no limitation on the respective settings / installation methods of the visible light camera and the infrared camera. For example, they can be set in other external devices outside the target vehicle; or they can be set in the target vehicle using an area array detection / monitoring method, so that the visible light camera and the infrared camera can use an area array detection method to perform comprehensive status monitoring of the wheels in the target vehicle, which is beneficial to improving the comprehensiveness and reliability of status monitoring. The present disclosure does not limit the specific setting positions of the visible light camera and the infrared camera. For example Figure 1 The visible light camera device and the infrared camera device may be arranged in a specific interior space of the target vehicle.

[0055] The present disclosure does not limit the respective acquisition methods of the above-mentioned wheel images and infrared images. For example, the corresponding visible light camera device or infrared camera device can be directly called to photograph the wheels of the target vehicle, or the images can be obtained from other devices or servers through the network.

[0056] S202. Performing status monitoring on the wheel based on the wheel image and the infrared image to obtain status information of a target wheel area, wherein the target wheel area is a wheel area constituting the wheel, and the status information of the target wheel area is used to reflect whether an abnormal condition matching the status information occurs in the target wheel area.

[0057] The present disclosure does not limit the specific implementation methods of the above-mentioned state monitoring. For example, see Figure 3 FIG. 1 is a flow chart showing a state monitoring process according to an exemplary embodiment. Figure 3 The process shown may include the following implementation steps:

[0058] S301. Partition the wheel image to obtain the target wheel area, where the target wheel area includes at least one of the following: an axle area, a contour area, and a tire area.

[0059] S302: mapping the infrared image according to the target wheel area to obtain a mapped infrared area in the infrared image corresponding to the target wheel area.

[0060] The present disclosure can realize the status monitoring of the wheel area by using the wheel image obtained by the visible light camera device in combination with the infrared image obtained by the infrared camera device. In the specific implementation process, the present disclosure can first perform image segmentation or wheel partitioning on the wheel image to obtain the target wheel area constituting the wheel image, such as the axle area, contour area, tire area or other custom wheel area. The present disclosure does not limit the specific implementation method of the above wheel partitioning, for example, the wheel image is partitioned and segmented by a preset image segmentation algorithm, and the image segmentation algorithm is a system-customized algorithm for image partitioning, etc. The present disclosure does not make too many limitations and details on this.

[0061] The target wheel area mentioned above refers to any one or more areas that make up the wheel, including but not limited to the axle area (also called the shaft area), the profile area, the tire area, or other custom wheel component areas. Among them, the axle area usually refers to the area where the axle is located in the wheel, the tire area usually refers to the area where the tire is located on the wheel surface, and the profile area usually refers to other areas of the wheel except the axle and the tire. For example, see Figure 4 FIG. 1 is a schematic diagram showing a partition of a wheel area according to an exemplary embodiment. Figure 4As shown, the regions that make up the wheel may include an axle region, a profile region, and a tire region. Among them, the wheel materials of the axle region and the profile region are usually metal, and the wheel material of the tire region is usually rubber, etc. It is understandable that since the axle region and the profile region are made of metal materials in a high temperature environment, the internal characteristics of the metal can be captured by the infrared camera device, such as cracks, foreign matter, and the like. Therefore, the present disclosure can utilize the thermal imaging characteristics of the infrared camera device to monitor the corresponding wheel region for abnormal conditions / conditions, and specifically can monitor the temperature field distribution of the corresponding wheel region to achieve abnormal condition monitoring. Please refer to Figure 5 FIG. 1 is a schematic diagram of temperature field distribution according to an exemplary embodiment. Figure 5 As shown, the horizontal axis represents time, and the vertical axis represents temperature data (° C.) of the contact portion between the wheel and the ground. The figure specifically shows the temperature data of the contact portion when the wheel is in contact with the ground at a certain moment.

[0062] Next, the present disclosure performs mapping processing on the infrared image based on the target wheel area to find a mapping infrared area in the infrared image that matches the target wheel area. The present disclosure does not limit the specific implementation of the mapping processing. For example, the present disclosure can perform coordinate conversion on the infrared image according to the position information of the target wheel area in the wheel image, so as to find a mapping infrared area in the infrared image that matches the position of the target wheel area.

[0063] In some optional embodiments, the present disclosure may also display the wheel image captured by the visible light camera device on a display device (such as a display screen of a terminal device, etc.) for real-time viewing by the user.

[0064] S303: Perform status monitoring on the mapped infrared area to obtain status information of the target wheel area.

[0065] After obtaining the mapped infrared region in the above infrared image, the present disclosure can perform state monitoring on the mapped infrared region to obtain state information of the target wheel region. The state information of the present disclosure can be used to reflect the relevant state of the target wheel region (i.e., the corresponding wheel state in the region), which includes but is not limited to, for example, deformation state, crack state, foreign matter state, temperature distribution state or other customized wheel state (such as other abnormal state), etc.

[0066] The present disclosure does not limit the specific implementation method of the state monitoring of the above-mentioned mapped infrared area. For example, the present disclosure can perform temperature field distribution statistics on the above-mentioned mapped infrared area to obtain the temperature distribution information of the above-mentioned mapped infrared area, that is, to obtain the temperature distribution information of the above-mentioned target wheel area. It can be understood that due to the thermal imaging principle of the above-mentioned infrared camera device, the infrared image captured by the above-mentioned infrared camera device contains the temperature information (such as temperature value) of the corresponding wheel area. Therefore, the present disclosure can directly perform temperature field distribution statistics on the mapped infrared area to obtain the temperature distribution information of the above-mentioned mapped infrared area (or the above-mentioned target wheel area). Taking the temperature distribution data of the axle area as an example, due to the rotation of the axle and wheel area, the axle and even the entire wheel metal area (excluding the tire area) will have a higher temperature, especially in summer when the temperature of the rubber wheel is also relatively high. Metal thermal imaging data under high temperature conditions can very sensitively detect status information such as cracks and foreign matter inside the metal. In addition, by modeling the temperature data of the area, the temperature distribution information of the area at a specific temperature can be obtained. For example, please refer to Figure 6 FIG. 1 is a schematic diagram showing temperature distribution in a wheel region according to an exemplary embodiment. Figure 6 As shown, the temperature distribution fields of the axle area, the profile area and the tire area are respectively shown, that is, the temperature distribution information. Among them, different color partitions in the figure represent different temperature distribution information of the corresponding areas, and this disclosure does not make too many limitations and descriptions on this.

[0067] Optionally, further, state monitoring is performed based on the temperature distribution information of the mapped infrared area, so as to obtain the state information of the target wheel area. The present disclosure does not limit the specific implementation method of state monitoring of the temperature distribution information, for example, it includes but is not limited to any one or more of the following implementation methods according to actual conditions:

[0068] In one embodiment, when the state information of the target wheel area is the deformation state of the target wheel area, the present disclosure can perform deformation detection on the temperature distribution information of the mapped infrared area to obtain the deformation state of the target wheel area, which may include the deformation amount of each position in the target wheel area, the average deformation amount of the target wheel area, or other customized deformation information. When the deformation amount (such as the average deformation amount or the deformation amount at any position) indicated by the deformation state of the target wheel area is not located in / is in the preset deformation interval, it can be determined that the deformation state of the target wheel area is used to indicate that the target wheel area has an abnormal deformation condition, such as excessive wheel pressure causing the wheel to deform. On the contrary, when the deformation amount indicated by the deformation state of the target wheel area is located in / is in the preset deformation interval, it can be determined that the target wheel area has not been deformed abnormally and is in the normal deformation range. The preset deformation interval of the present disclosure is a deformation area customized according to actual conditions, which may be related to the current driving speed of the target vehicle, and the present disclosure does not make too many restrictions and details on this.

[0069] The present disclosure does not limit the specific implementation of the above deformation detection. For example, the present disclosure can use the temperature distribution information of the above-mentioned mapped infrared area and the preset temperature distribution information corresponding to the area to compare and analyze, so as to calculate the deformation state of the area (i.e., the target wheel area). It can be understood that for any wheel area of ​​metal material or rubber material, the material itself has temperature characteristics. The temperature distribution of the wheel area with a regular shape is relatively uniform and continuous. The deformation amount or crack size of the wheel area has a certain dependence on the temperature distribution of the area. For example, when the wheel area is deformed or cracked, the wheel area can be in the form of concentric circles with the wheel axis as the center and a specific length as the radius. The temperature value shows a trend of increasing or decreasing. The change trend can be specifically determined according to the material properties of the wheel area; therefore, the present disclosure can directly use the temperature distribution information of the area (i.e., the real temperature distribution) and the preset temperature distribution information (standard or reference temperature distribution) for comparison and calculation, so as to obtain information such as the deformation state of the area.

[0070] In another embodiment, when the state information of the target wheel area is the crack state of the target wheel area, the present disclosure may perform crack detection on the temperature distribution information of the mapped infrared area to obtain the crack state of the target wheel area, and the crack state may include whether cracks occur in the target wheel area, the crack size at each position in the target wheel area, the average crack size of the target wheel area, or other custom crack information, etc. The crack state of the target wheel area may at least be used to indicate whether an abnormal crack condition occurs / appears in the target wheel area.

[0071] The present disclosure does not limit the specific implementation methods of the above-mentioned crack detection. For example, taking the wheel area of ​​metal material as an example, under high temperature conditions, due to the characteristics of the metal material itself, the temperature distribution information of the area can be compared with the corresponding preset temperature distribution information at the temperature, so as to analyze the crack state of the area, such as whether cracks appear in the area.

[0072] In another embodiment, when the state information of the target wheel area is the foreign matter state of the target wheel area, the present disclosure can perform foreign matter detection on the temperature distribution information of the mapped infrared area to obtain the foreign matter state of the target wheel area, which may include, for example, whether a foreign matter appears in the target wheel area, the size of the foreign matter, or other customized foreign matter information. The foreign matter state can at least be used to indicate whether a foreign matter or a foreign matter condition appears in the target wheel area.

[0073] In another embodiment, when the state information of the target wheel area is the temperature distribution state of the target wheel area, the present disclosure can perform statistical analysis on the temperature distribution information of the mapped infrared area, so as to obtain the temperature distribution state of the target wheel area, and the temperature distribution state can include information such as the temperature value of each position in the target wheel area, the average temperature value of the target wheel area, etc. The present disclosure does not limit the specific implementation of the above statistical analysis, for example, the temperature value and the preset temperature value of each position distribution in the above mapped infrared area can be judged by the size, etc. Among them, when the temperature value indicated by the temperature distribution state of the target wheel area (such as the average temperature value or the temperature value of any position) is greater than the preset temperature value, it can be determined that the temperature distribution state is used to indicate that the temperature of the target wheel area is too high, an abnormal temperature condition has occurred, etc. On the contrary, it can be determined that the temperature distribution state is used to indicate that the temperature of the target wheel area is normal. The preset temperature value of the present disclosure can be set according to actual conditions, for example, it can be related to factors such as the current driving speed of the target vehicle and the current ambient temperature, etc., and the present disclosure does not make too many restrictions and details on this.

[0074] In some embodiments, the present disclosure may also directly monitor the state of the wheel image to obtain the state information of the target wheel area, for example, it may include but is not limited to any one or more of the following implementations according to actual conditions:

[0075] In one embodiment, the present disclosure can perform zone deformation detection on the wheel image to obtain the deformation state of the target wheel area. Among them, the present disclosure does not limit the specific implementation of the above-mentioned zone deformation detection. For example, the present disclosure can perform zone comparison calculation on the wheel image and the preset standard image. For example, the wheel image can be firstly processed by zone to obtain the target wheel area that constitutes the wheel image; and then the target wheel area and the mapping area in the standard image that matches the target wheel area are compared and calculated to analyze the deformation state of the target wheel area in the wheel image, such as whether deformation occurs, deformation amount and other information. The preset standard image is a reference image that is customized according to actual conditions. For example, the present disclosure shows a wheel image of a wheel in an ideal state below.

[0076] In another embodiment, the present disclosure can perform partition crack detection on the wheel image to obtain the crack status of the target wheel area. Among them, the present disclosure does not limit the specific implementation of the above-mentioned partition crack detection. For example, the present disclosure can perform partition comparison calculation on the wheel image and the preset reference image. For example, the wheel image can be first partitioned to obtain the target wheel area that constitutes the wheel image; and then based on the target wheel area and the mapping area in the reference image that matches the target wheel area, a comparison calculation is performed to analyze the crack status of the target wheel area in the wheel image, such as whether there is a crack, the size of the crack and other information. The preset reference image is a reference image that is customized according to actual conditions, such as a reference image that matches the current driving speed of the target vehicle (such as a wheel temperature distribution image).

[0077] In another embodiment, the present disclosure can perform partitioned foreign body detection on the wheel image to obtain the foreign body status of the target wheel area. Among them, the present disclosure does not limit the specific implementation of the above-mentioned partitioned foreign body detection. For example, the present disclosure can perform partitioned comparison calculations on the wheel image and the preset reference image. For example, the wheel image can be first partitioned to obtain the target wheel area that constitutes the wheel image; and then a comparison calculation is performed based on the target wheel area and the mapping area in the reference image that matches the target wheel area, so as to analyze the foreign body status of the target wheel area in the wheel image, such as whether there are foreign bodies, the size of the foreign bodies, and other information. The preset reference image is a reference image that is customized according to actual conditions, such as a reference image that matches the current driving speed of the target vehicle (such as a wheel temperature distribution image). Regarding the corresponding state of the above-mentioned target wheel area, please refer to the introduction in the aforementioned related embodiments, which will not be repeated here.

[0078] That is to say, the present disclosure can process the wheel image to realize the state monitoring of the wheel area; for example, the tire deformation size, the presence of directional cracks, the presence of foreign objects (such as nails and other foreign objects) and other state information of the wheel tire area can be monitored and analyzed. For example, see Figure 7 FIG. 1 is a deformation diagram according to an exemplary embodiment. Figure 7 As shown, the left wheel shows a cross-sectional schematic diagram of the wheel in an ideal state, in which the contact area between the wheel and the ground does not have any pressure, deformation, etc. However, during the driving of the vehicle, due to reasons such as the gravity of the vehicle, the wheel will be in another state under the force state. Compared with the wheel in the ideal state, this state has a certain level of deformation, as shown in the black area of ​​the wheel on the right side of the figure. The wheel image obtained by the visible light camera device in the present disclosure generally refers to a wheel image with a certain deformation, and the left image in the ideal state can be called a preset standard image. In the implementation process, the present disclosure can compare and analyze the wheel image with the preset standard image to calculate the deformation state of the wheel at the current driving speed. The deformation state can include information such as the deformation of the contact area between the wheel and the ground. The present disclosure does not limit the specific implementation method of the above-mentioned image comparison and analysis. For example, a preset image processing algorithm can be used to compare and analyze the above-mentioned two images, and the present disclosure does not make too many limitations and descriptions on this.

[0079] In some embodiments, when the state information of the target wheel area is used to indicate / reflect that a corresponding abnormal condition has occurred in the target wheel area, an early warning message may be output, and the early warning message is used to prompt that an abnormal condition has occurred in the state information of the target wheel area, prompting the user to check, slow down or brake in time, etc., which may be determined according to actual conditions. The present disclosure does not limit the output form of the early warning message, for example, it may be output in the form of vibration, picture, subtitle, voice, text message, or any one or more combinations thereof.

[0080] By implementing the disclosed embodiment, the terminal device acquires a wheel image and an infrared image, wherein the wheel image is obtained by photographing the wheel in the target vehicle through a visible light camera device, and the infrared image is obtained by photographing the wheel in the target vehicle through an infrared camera device; based on the wheel image and the infrared image, the state of the wheel is monitored to obtain the state information of the target wheel area, wherein the target wheel area is the wheel area constituting the wheel, and the state information of the target wheel area is used to reflect whether an abnormal condition matching the state information occurs in the target wheel area. It can be seen that the terminal device can perform state monitoring of the wheel partition based on the wheel image photographed by the visible light camera device and the infrared image photographed by the infrared camera device, and obtain the state information of the target wheel area, thereby identifying whether the target wheel area has a corresponding abnormal condition to ensure the safety of vehicle driving; at the same time, it can also improve the reliability and accuracy of wheel area state monitoring.

[0081] Based on the above examples, see Figure 8 FIG. 1 is a schematic diagram showing a structure of a device for monitoring the state of a wheel region according to an exemplary embodiment. Figure 8 The device shown can be applied to a terminal device, and the device may include an acquisition module 801 and a processing module 802. Among them:

[0082] The acquisition module 801 is configured to acquire a wheel image and an infrared image, wherein the wheel image is acquired by photographing the wheel of the target vehicle through a visible light camera device, and the infrared image is acquired by photographing the wheel of the target vehicle through an infrared camera device;

[0083] The processing module 802 is configured to monitor the state of the wheel based on the wheel image and the infrared image to obtain state information of a target wheel area, wherein the target wheel area is a wheel area constituting the wheel, and the state information of the target wheel area is used to reflect whether an abnormal condition matching the state information occurs in the target wheel area.

[0084] In some embodiments, the processing module 802 is configured to:

[0085] Perform wheel partitioning on the wheel image to obtain the target wheel area, wherein the target wheel area includes at least one of the following: an axle area, a contour area, and a tire area;

[0086] Performing mapping processing on the infrared image according to the target wheel area to obtain a mapped infrared area in the infrared image corresponding to the target wheel area;

[0087] The mapped infrared area is subjected to status monitoring to obtain status information of the target wheel area.

[0088] In some embodiments, the processing module 802 is configured to:

[0089] Performing temperature field distribution statistics on the mapped infrared region to obtain temperature distribution information of the mapped infrared region;

[0090] Performing status monitoring based on the temperature distribution information of the mapped infrared area to obtain status information of the target wheel area;

[0091] Among them, the status information includes at least one of the following: deformation state, crack state, foreign matter state and temperature distribution state; the deformation state is at least used to indicate whether an abnormal deformation condition has occurred in the target wheel area, the crack state is at least used to indicate whether an abnormal crack condition has occurred in the target wheel area, the foreign matter state is at least used to indicate whether a foreign matter condition has occurred in the target wheel area, and the temperature distribution state is at least used to indicate whether an abnormal temperature condition has occurred in the target wheel area.

[0092] In some embodiments, the processing module 802 is configured to perform any of the following:

[0093] If the state information is the deformation state, deformation detection is performed on the temperature distribution information of the mapped infrared area to obtain the deformation state of the target wheel area;

[0094] If the state information is the crack state, performing crack anomaly detection on the temperature distribution information of the mapped infrared area to obtain the crack state of the target wheel area;

[0095] If the state information is the foreign object state, performing foreign object detection on the temperature distribution information of the mapped infrared area to obtain the foreign object state of the target wheel area;

[0096] If the state information is the temperature distribution state, a statistical analysis is performed on the temperature distribution information of the mapped infrared region to obtain the temperature distribution state of the target wheel.

[0097] In some embodiments, when the deformation amount indicated by the deformation state of the target wheel area is not within a preset deformation range, the deformation state of the target wheel area is used to indicate that an abnormal deformation condition has occurred in the target wheel area; or, when the temperature value indicated by the temperature distribution state is greater than a preset temperature value, the temperature distribution state of the target wheel area is used to indicate that an abnormal overtemperature condition has occurred in the target wheel area.

[0098] In some embodiments, the processing module 802 is further configured to perform at least one of the following:

[0099] Performing zone deformation detection on the wheel image to obtain a deformation state of the target wheel area;

[0100] Performing zone-by-zone crack detection on the wheel image to obtain a crack state of the target wheel area;

[0101] The wheel image is subjected to a partitioned foreign object detection to obtain the foreign object status of the target wheel area.

[0102] In some embodiments, the visible light camera device and the infrared camera device are both disposed in the target vehicle.

[0103] In some embodiments, the processing module 802 is further configured to:

[0104] When the status information of the target wheel area is used to reflect that an abnormal condition matching the status information occurs in the target wheel area, an early warning message is output, where the early warning message is used to prompt that an abnormal condition occurs in the status information of the target wheel area.

[0105] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0106] The present disclosure also provides a computer-readable storage medium having computer program instructions stored thereon. When the program instructions are executed by a processor, the steps of the wheel area condition monitoring method provided by the present disclosure are implemented.

[0107] Fig. 9 9 is a schematic diagram of a terminal device according to an exemplary embodiment. For example, the terminal device 900 may be a mobile phone, a computer, a digital broadcast terminal, a message transceiver, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, or other terminal devices.

[0108] Reference Fig. 9 The terminal device 900 may include one or more of the following components: a processing component 902 , a memory 904 , a power component 906 , a multimedia component 908 , an audio component 910 , an input / output interface 912 , a sensor component 914 , and a communication component 916 .

[0109] The processing component 902 generally controls the overall operation of the device 900, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 902 may include one or more processors 920 to execute instructions to complete all or part of the steps of the above-mentioned wheel area state monitoring method. In addition, the processing component 902 may include one or more modules to facilitate the interaction between the processing component 902 and other components. For example, the processing component 902 may include a multimedia module to facilitate the interaction between the multimedia component 908 and the processing component 902.

[0110] The memory 904 is configured to store various types of data to support operations on the device 900. Examples of such data include instructions for any application or method operating on the device 900, contact data, phone book data, messages, pictures, videos, etc. The memory 904 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0111] The power supply component 906 provides power to the various components of the device 900. The power supply component 906 can include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 900.

[0112] The multimedia component 908 includes a screen that provides an output interface between the device 900 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 908 includes a front camera and / or a rear camera. When the terminal device 900 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and the rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0113] The audio component 910 is configured to output and / or input audio signals. For example, the audio component 910 includes a microphone (MIC), and when the device 900 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 904 or sent via the communication component 916. In some embodiments, the audio component 910 also includes a speaker for outputting audio signals.

[0114] The input / output interface 912 provides an interface between the processing component 902 and the peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0115] The sensor assembly 914 includes one or more sensors for providing various aspects of status assessment for the device 900. For example, the sensor assembly 914 can detect the open / closed state of the device 900, the relative positioning of components, such as the display and keypad of the device 900, and the sensor assembly 914 can also detect the position change of the device 900 or a component of the device 900, the presence or absence of user contact with the device 900, the orientation or acceleration / deceleration of the device 900, and the temperature change of the device 900. The sensor assembly 914 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 914 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 914 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0116] The communication component 916 is configured to facilitate wired or wireless communication between the device 900 and other devices. The device 900 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 916 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 916 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0117] In an exemplary embodiment, the device 900 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above-mentioned wheel area condition monitoring method.

[0118] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 904 including instructions, and the instructions can be executed by the processor 920 of the device 900 to complete the above-mentioned upper wheel area state monitoring method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0119] In addition to being an independent electronic device, the above-mentioned device can also be a part of an independent electronic device. For example, in one embodiment, the device can be an integrated circuit (IC) or a chip, wherein the integrated circuit can be an IC or a collection of multiple ICs; the chip can include but is not limited to the following types: GPU (Graphics Processing Unit), CPU (Central Processing Unit), FPGA (Field Programmable Gate Array), DSP (Digital Signal Processor), ASIC (Application Specific Integrated Circuit), SOC (System on Chip, SoC), etc. The above-mentioned integrated circuit or chip can be used to execute executable instructions (or codes) to implement the above-mentioned wheel area state monitoring method. The executable instructions can be stored in the integrated circuit or chip, or can be obtained from other devices or equipment, such as the integrated circuit or chip includes a processor, a memory, and an interface for communicating with other devices. The executable instruction may be stored in the memory, and when the executable instruction is executed by the processor, the above-mentioned method for monitoring the state of the wheel area may be implemented; alternatively, the integrated circuit or chip may receive the executable instruction through the interface and transmit it to the processor for execution, so as to implement the above-mentioned method for monitoring the state of the wheel area.

[0120] In another exemplary embodiment, a computer program product is also provided. The computer program product includes a computer program executable by a programmable device, and has a code portion for executing the above-mentioned method for monitoring the condition of a wheel region when the computer program is executed by the programmable device.

[0121] See also Fig.10 FIG. 1 is a schematic diagram showing the structure of a chip according to an exemplary embodiment. Fig.10 The chip 1000 shown includes a processor 1001 and an interface 1002. Optionally, it may also include a memory 1003. The number of the processors 1001 may be one or more, and the number of the interfaces 1002 may be multiple.

[0122] In one embodiment, for a case where a chip is used to implement the method embodiment of the present disclosure:

[0123] The interface 1002 is used to receive or output signals;

[0124] The processor 1001 is used to execute part or all of the contents of the embodiment of the method for monitoring the state of the wheel area.

[0125] Understandably, the processor in the embodiment of the present disclosure may be an integrated circuit chip having signal processing capabilities. In the implementation process, each step of the above method embodiment may be completed by an integrated logic circuit of hardware in the processor or an instruction in the form of software. The above processor may be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components.

[0126] It is understandable that the memory in the embodiments of the present disclosure may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct RAM (DR RAM). It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0127] It should be noted here that the description of the above storage medium, device and chip embodiments is similar to the description of the above method embodiments, and has similar beneficial effects as the method embodiments. For technical details not disclosed in the storage medium, storage medium and device embodiments of the present disclosure, please refer to the description of the method embodiments of the present disclosure for understanding.

[0128] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the present disclosure. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered as exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0129] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A method for monitoring the state of a wheel area, characterized in that: include: Acquire a wheel image and an infrared image, wherein the wheel image is obtained by photographing the wheel of the target vehicle through a visible light camera device, and the infrared image is obtained by photographing the wheel of the target vehicle through an infrared camera device; The state of the wheel is monitored based on the wheel image and the infrared image to obtain state information of a target wheel area, wherein the target wheel area is a wheel area constituting the wheel, and the state information of the target wheel area is used to reflect whether an abnormal condition matching the state information occurs in the target wheel area.

2. The method according to claim 1, characterized in that The performing state monitoring on the wheel based on the wheel image and the infrared image to obtain state information of the target wheel area comprises: Perform wheel partitioning on the wheel image to obtain the target wheel area, wherein the target wheel area includes at least one of the following: an axle area, a contour area, and a tire area; Performing mapping processing on the infrared image according to the target wheel area to obtain a mapped infrared area in the infrared image corresponding to the target wheel area; The mapped infrared area is subjected to status monitoring to obtain status information of the target wheel area.

3. The method according to claim 2, characterized in that The state monitoring of the mapped infrared area to obtain the state information of the target wheel area includes: Performing temperature field distribution statistics on the mapped infrared region to obtain temperature distribution information of the mapped infrared region; Performing status monitoring based on the temperature distribution information of the mapped infrared area to obtain status information of the target wheel area; Among them, the status information includes at least one of the following: deformation state, crack state, foreign matter state and temperature distribution state; the deformation state is at least used to indicate whether an abnormal deformation condition has occurred in the target wheel area, the crack state is at least used to indicate whether an abnormal crack condition has occurred in the target wheel area, the foreign matter state is at least used to indicate whether a foreign matter condition has occurred in the target wheel area, and the temperature distribution state is at least used to indicate whether an abnormal temperature condition has occurred in the target wheel area.

4. The method according to claim 3, characterized in that: The state monitoring based on the temperature distribution information of the mapped infrared area to obtain the state information of the target wheel area includes any one of the following: If the state information is the deformation state, deformation detection is performed on the temperature distribution information of the mapped infrared area to obtain the deformation state of the target wheel area; If the state information is the crack state, performing crack anomaly detection on the temperature distribution information of the mapped infrared area to obtain the crack state of the target wheel area; If the state information is the foreign object state, performing foreign object detection on the temperature distribution information of the mapped infrared area to obtain the foreign object state of the target wheel area; If the state information is the temperature distribution state, a statistical analysis is performed on the temperature distribution information of the mapped infrared region to obtain the temperature distribution state of the target wheel.

5. The method according to claim 4, characterized in that When the deformation amount indicated by the deformation state is not within the preset deformation range, the deformation state of the target wheel area is used to indicate that an abnormal deformation condition has occurred in the target wheel area; or, When the temperature value indicated by the temperature distribution state is greater than a preset temperature value, the temperature distribution state of the target wheel region is used to indicate that an over-temperature abnormal condition occurs in the target wheel region.

6. The method according to claim 1, characterized in that The visible light camera device and the infrared camera device are both arranged in the target vehicle.

7. The method according to any one of claims 1 to 6, characterized in that The method further comprises: When the status information of the target wheel area is used to reflect that an abnormal condition matching the status information occurs in the target wheel area, an early warning message is output, where the early warning message is used to prompt that an abnormal condition occurs in the status information of the target wheel area.

8. A wheel area condition monitoring device, characterized in that: include: an acquisition module, configured to acquire a wheel image and an infrared image, wherein the wheel image is acquired by photographing the wheel of the target vehicle through a visible light camera device, and the infrared image is acquired by photographing the wheel of the target vehicle through an infrared camera device; The processing module is configured to monitor the state of the wheel based on the wheel image and the infrared image to obtain state information of a target wheel area, wherein the target wheel area is a wheel area constituting the wheel, and the state information of the target wheel area is used to reflect whether an abnormal condition matching the state information occurs in the target wheel area.

9. A terminal device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to execute the executable instructions to implement the steps of the method according to any one of claims 1 to 9.

10. A computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the computer program instructions are executed by a processor, the steps of the method according to any one of claims 1 to 9 are implemented.

Images