Information interaction method and device, equipment, medium and product
Patent Information
- Application Number
- CN202611184351.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-08-05
- Publication Date
- 2026-10-30
AI Technical Summary
对于方式一,车辆轮胎检测对技术人员的专业经验要求较高,导致轮胎检测结果不客观
[0010]本发明实施例所提供的技术方案,基于第一界面中每个图像呈现区域的图像采集控件来采集相应车辆轮胎的轮胎图像并展示,此种方式可以通过格式化的方式来展示相应轮胎的轮胎图像,以达到用户可以清晰了解每个车辆轮胎的轮胎图像是否采集以及采集结果是否满足预设要求。进一步的,每个图像呈现区域对应一个车辆轮胎,因此,在将轮胎图像输入至智能系统进行处理时,可以使智能系统明确每一幅轮胎图像所对应的车辆轮胎,从而针对每个车辆轮胎相关联的轮胎图像进行分析,以获取每个车辆轮胎的分析结果。进一步的,同一车辆轮胎的多个轮胎图像可以使智能系统在分析时用来佐证分析结果的准确性。最后,在基于智能系统对每个图像呈现区域所对应的多个轮胎图像分析时,还可以结合待进行轮胎检测车辆的驱动方式进一步验证相应图像呈现区域所属轮胎的分析结果准确性,达到了轮胎分析全面性和针对性的效果。
Smart Images

Figure CN123015448A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present invention relate to the field of information technology, and in particular to an information interaction method, apparatus, device, medium and product. Background Technology
[0002] Currently, there are two methods for vehicle tire inspection in existing scenarios. One method relies on the experience of technicians to identify tire anomalies. The other method involves the user continuously inputting tire inspection-related prompts into a large language model, which then outputs corresponding results.
[0003] When implementing this technical solution based on the above method, the inventors discovered the following problems: For Method 1, vehicle tire inspection requires a high level of expertise from technicians, leading to potentially unreliable results. For Method 2, it necessitates continuous adjustment of prompts or multiple rounds of input polling to obtain the desired results. Furthermore, insufficient user input limits the analysis capabilities of the large language model, resulting in inaccurate inspection results. Summary of the Invention
[0004] This invention provides an information interaction method, apparatus, equipment, medium, and product that achieves intelligent tire inspection and improves the accuracy and comprehensiveness of analysis results.
[0005] In a first aspect, embodiments of the present invention provide an information interaction method, the method comprising: Multiple tire images are collected and displayed through multiple image display areas on the first interface. The vehicle to be inspected includes multiple vehicle tires, and each vehicle tire corresponds to an image display area. The display position of the image display area on the first interface is related to the tire position of the multiple vehicle tires on the vehicle to be inspected. The tire acquisition angles corresponding to the multiple tire images collected in the same image display area are different. In response to the first operation, the intelligent system performs multi-dimensional analysis on the multiple tire images to obtain the analysis results of the multiple vehicle tires; wherein, the analysis results include at least the anomalies of each vehicle tire, the analysis information of the anomalies, and the processing suggestion information. The analysis results are presented.
[0006] Secondly, embodiments of the present invention also provide an information interaction device, the device comprising: The image display module is used to collect and display multiple tire images through multiple image display areas of the first interface. The vehicle to be inspected includes multiple vehicle tires, and each vehicle tire corresponds to an image display area. The display position of the image display area in the first interface is related to the tire position of the multiple vehicle tires on the vehicle to be inspected. The tire acquisition angles corresponding to the multiple tire images collected in the same image display area are different. The analysis result determination module is used to respond to the first operation by performing multi-dimensional analysis on the multiple tire images based on the intelligent system to obtain the analysis results of the multiple vehicle tires; wherein, the analysis results include at least the anomalies of each vehicle tire, the analysis information of the anomalies, and the processing suggestion information; The analysis results display module is used to display the analysis results.
[0007] Thirdly, embodiments of the present invention provide an electronic device, the electronic device comprising: One or more processors; Memory, used to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the information interaction method provided in any embodiment of the present invention.
[0008] Fourthly, embodiments of the present invention also provide a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the information interaction method as provided in any embodiment of the present invention.
[0009] Fifthly, embodiments of the present invention also provide a computer program product, including a computer program, characterized in that the computer program, when executed by a processor, implements the information interaction method as described in any of the embodiments of the present invention.
[0010] The technical solution provided by this invention acquires and displays tire images of corresponding vehicle tires based on the image acquisition controls in each image presentation area of the first interface. This method allows for the formatted display of tire images, enabling users to clearly understand whether tire images of each vehicle tire have been acquired and whether the acquisition results meet preset requirements. Furthermore, each image presentation area corresponds to one vehicle tire. Therefore, when tire images are input into the intelligent system for processing, the intelligent system can clearly identify the vehicle tire corresponding to each tire image, thereby analyzing the associated tire images for each vehicle tire to obtain analysis results for each tire. Furthermore, multiple tire images of the same vehicle tire can be used by the intelligent system to verify the accuracy of the analysis results. Finally, when analyzing multiple tire images corresponding to each image presentation area based on the intelligent system, the accuracy of the analysis results for the tires belonging to the corresponding image presentation areas can be further verified by combining the driving mode of the vehicle to be inspected, achieving a comprehensive and targeted effect in tire analysis. Attached Figure Description
[0011] To more clearly illustrate the technical solutions of exemplary embodiments of the present invention, the accompanying drawings used in describing the embodiments are briefly introduced below. Obviously, the accompanying drawings described are only a portion of the drawings of the embodiments to be described in this invention, and not all of the drawings. For those skilled in the art, other drawings can be obtained from these drawings without any creative effort.
[0012] Figure 1 An example diagram of an entry interface for entering the first interface provided in an embodiment of the present invention; Figure 2 An example diagram illustrating the first interface provided for an embodiment of the present invention; Figure 3 A flowchart of an information interaction method provided in an embodiment of the present invention; Figure 4 An example diagram of the first interface provided for an embodiment of the present invention; Figure 5 This is an example diagram of the intelligent system analysis progress interface provided in an embodiment of the present invention; Figure 6 Example diagram of triggering the display of the second interface provided in an embodiment of the present invention; Figure 7 A flowchart of another information interaction method provided in an embodiment of the present invention; Figure 8 An example diagram of the shooting interface provided in an embodiment of the present invention; Figure 9 An example diagram of the shooting interface provided in an embodiment of the present invention; Figure 10 An example diagram of the image pre-acquisition interface provided in an embodiment of the present invention; Figure 11 This is an example diagram of the first interface after acquiring a tire image, provided in an embodiment of the present invention. Figure 12 This is a flowchart illustrating the process of detecting tire images provided in an embodiment of the present invention. Figure 13 A flowchart of another information interaction method provided in an embodiment of the present invention; Figure 14 An example diagram of the third interface provided in an embodiment of the present invention; Figure 15 An example diagram of the fourth interface provided in an embodiment of the present invention; Figure 16 Example diagram of an interface for displaying negative feedback data using the trigger error option provided in an embodiment of the present invention; Figure 17 A flowchart of another information interaction method provided in an embodiment of the present invention; Figure 18 Example diagrams of the fifth interface and tire inspection items provided in embodiments of the present invention; Figure 19 This is a diagram illustrating the architecture of a vehicle tire detection system provided in an embodiment of the present invention. Figure 20 This is a schematic diagram of the structure of an information interaction device provided in an embodiment of the present invention; Figure 21 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. Detailed Implementation
[0013] The present invention will now be described in further detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and not intended to limit it. Furthermore, it should be noted that, for ease of description, the accompanying drawings show only the parts relevant to the present invention, and not all of the structures.
[0014] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, data stored, data displayed, etc.) and signals involved in this invention are all authorized by the user or fully authorized by all parties, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.
[0015] It should be noted that the collection, gathering, updating, analysis, processing, use, transmission, and storage of user personal information (such as user interaction data on terminal devices) involved in the technical solutions of this invention comply with relevant laws and regulations, are used for legitimate purposes, and do not violate public order and good morals. Necessary measures are taken to prevent unauthorized access to user personal information data and to safeguard user personal information security, network security, and national security.
[0016] Before introducing the technical solutions provided by the embodiments of the present invention, the application scenarios can be described by way of example. Based on the information interaction method provided by the embodiments of the present invention, applications, functional modules, or human-computer interaction display interfaces can be developed to execute the information interaction method. These applications, functional modules, or human-computer interaction display interfaces can be deployed on terminal devices to achieve tire detection, corresponding data interaction, and visualization display.
[0017] Specifically, for the application used to perform the information interaction method, users can deploy it on a terminal device to acquire and upload tire images through interaction with the application's first interface, thereby obtaining vehicle tire analysis results. The functional block used to perform the information interaction method can be integrated into any application with image acquisition and analysis capabilities. When a user has a need for vehicle tire detection, they can obtain analysis results matching the acquired and uploaded tire images by interacting with the first interface of this functional block. For the human-machine interface (HMI), users can directly interact with it to obtain vehicle tire analysis results. The HMI has the same functions as the aforementioned first interface.
[0018] The vehicle tire inspection method provided in this invention is suitable for both general users and repair personnel. For general users, it allows them to independently inspect their vehicle tires, lowering the barrier to entry and making it easier for them to determine the condition of their tires at any time. For repair personnel, it assists them in performing detailed tire inspections, improving the accuracy of tire inspections.
[0019] Before detailing the technical solutions provided by the embodiments of the present invention, the first interface and input operations can be described first. The first interface may be an interactive interface displayed when inspecting vehicle tires.
[0020] For example, when the first interface is the relevant interface of the application, the first interface can be accessed through... Figure 1 The display is triggered in the manner shown. Figure 1This is the entry screen used to trigger the display of the first interface. This entry screen displays the "Start Photo Detection" control, which is used to display the first interface. In this case, this entry screen is the application's home screen. On the home screen, the user triggers the "Start Photo Detection" control to display the first interface. Additionally, the application's home screen may also include analysis results from historical vehicle tire detection.
[0021] For example, the first interface can also be the interface corresponding to a functional block. In this case, the entry interface can be the functional interface of the functional module. The first interface can be displayed by triggering the functional interface. See also Figure 2 Users can Figure 2 (a) In the application's home screen, triggering the control corresponding to the function block displays the corresponding function interface. This function interface can be as follows: Figure 2 As shown in (b), the "Start Photo Detection" control on this functional interface is triggered to display the first interface. Based on the above, regardless of the method of displaying the first interface, the displayed first interface can interact with the user to achieve vehicle tire image acquisition and detection processing.
[0022] After deploying the aforementioned applications, functional modules, or human-machine interface on a terminal device, when a user performs vehicle tire checks, it may involve inputting data into the relevant interfaces of the applications, functional modules, or human-machine interface. The following describes these input operations.
[0023] Input operations are either trigger operations or contactless interactive operations on corresponding functional controls, and corresponding processing is achieved based on the functions of the functional controls.
[0024] The trigger operation is used to activate the corresponding functional control to achieve the corresponding function. Optionally, the trigger operation can be a click operation, a selection operation, or an information input operation. Optionally, a click operation is to click on the functional control to achieve the function of the functional control. A selection operation can be a drop-down selection of the functional control to achieve the corresponding function. An information input operation can be to input information into the input box corresponding to the functional control to achieve the corresponding function based on the input information.
[0025] For contactless interaction, terminal devices can integrate gesture recognition modules, audio recognition modules, facial recognition modules, and gaze tracking modules. Contactless interaction can be related to gestures, audio commands, facial information, and / or gaze information.
[0026] For interactions related to gestures, when a user makes a corresponding gesture, the gesture recognition module identifies the gesture information. If the gesture information matches the standard gesture information corresponding to the function control, it is considered an input operation to the function control. For interactions related to audio commands, when a user issues a corresponding audio command, the audio recognition module identifies the audio command. If the audio command matches the standard audio information of the function control, it is considered an input operation to the function control. For interactions related to facial information, when a user makes a corresponding facial movement, the facial recognition module identifies the facial movement. If the facial movement matches the standard facial movement of the function control, it is considered an input operation to the function control. For interactions related to gaze information, the user's gaze can be tracked to determine the pixel on the terminal device interface corresponding to the user's gaze. When this pixel is determined to be a pixel in a function control, it is considered an input operation to the function control. It should be noted that input operations to function controls can also be implemented based on two or more of the above-mentioned contactless interaction methods.
[0027] It should be noted that the information interaction device provided in this embodiment can be integrated into application software that supports interactive functions, and this software can be installed on an electronic device, optionally a mobile terminal or a PC. The application software can be a type of data interaction software; specific application software will not be detailed here, as long as it enables data interaction. Alternatively, it can be a specially developed application program integrated into the interactive software, or integrated into a corresponding page, allowing users to interact through the integrated page on the PC.
[0028] Figure 3 This is a flowchart illustrating an information interaction method provided in an embodiment of the present invention. This embodiment is applicable to any situation requiring vehicle tire inspection. The information interaction method is executed by a client or a server, or it can be implemented through interaction between the client and the server. The client is installed in a terminal device, which can be a PC, a mobile terminal, or any electronic device that supports the client.
[0029] like Figure 3 As shown, the method specifically includes the following steps: S110: Collect and display multiple tire images through multiple image display areas on the first interface.
[0030] The first interface is a visual interface designed for content display and user interaction. Content display can be achieved through pre-configured image presentation areas.
[0031] It should be noted that the technical solution corresponding to the embodiments of the present invention can process any vehicle that needs tire inspection. The vehicle currently requiring tire inspection can be considered as the vehicle to be inspected. The following explanation will focus on the vehicle to be inspected.
[0032] The vehicle to be inspected includes multiple tires, and the number of image display areas in the first interface is related to the number of tires on the vehicle. That is, each tire corresponds to one image display area. The display position of the image display area in the first interface is related to the tire positions on the vehicle. For example, if the vehicle to be inspected has four wheels, then there are four image display areas, corresponding to the left front wheel, left rear wheel, right front wheel, and right rear wheel. The image display area can be displayed at the corresponding position of each wheel.
[0033] Furthermore, multiple tire images captured within the same image presentation area correspond to different tire acquisition perspectives. The image presentation area can include multiple sub-regions, each displaying tire images from different tire acquisition perspectives. Optionally, the number of sub-regions can include three. The sub-regions within the image presentation area indicate to the user the number of tire images that can be captured.
[0034] The image display area also includes an image acquisition control, which indicates that the tire image will be captured once the image display area is triggered. In other words, the user can click the image acquisition control in the image display area to activate the associated camera device and capture the tire image.
[0035] To ensure the accuracy of vehicle tire analysis results, multiple tire images can be acquired from multiple tire acquisition perspectives for each vehicle tire using the image acquisition control in each image presentation area. Additionally, the image presentation area can include an image count indicator to show the number of tire images acquired at the current tire location, as well as the total number of tire images that can be acquired.
[0036] Specifically, in response to user actions on the entry interface, the first interface is displayed. For the multiple image display areas within the first interface, triggering the image acquisition controls in these areas invokes the camera device to capture tire images of each vehicle tire from different viewing angles, thus obtaining multiple tire images. These multiple tire images for each vehicle tire are then displayed in a sub-area of the corresponding image display area. Based on this, real-time acquisition and display of vehicle tire images are achieved.
[0037] For example, see Figure 4 , Figure 4This is an example of the first interface. If the vehicle to be inspected has four wheels, the first interface can have four corresponding image display areas, used to display the tire images of the left front wheel, right front wheel, left rear wheel, and right rear wheel. Each image display area has three sub-areas, used to display tire images from different tire acquisition perspectives at the corresponding tire location. Figure 4 The image quantity indicator "0 / 3" in the image presentation area indicates that no tire images of the vehicle tires corresponding to this image presentation area have been captured, and that 3 tire images of the vehicle tires can be captured.
[0038] See also Figure 4 The image acquisition and display process is similar for different vehicle tires; the following explanation uses the left front tire as an example. Users can click the image acquisition control in the image display area corresponding to the left front tire to invoke the camera device to acquire tire images of the left front tire from three different tire acquisition perspectives, and then display the acquired tire images of the left front tire in the three sub-areas of the left front tire image display area.
[0039] It should also be noted that, in order to achieve tire image acquisition for all vehicle tires, the first interface can also display the image acquisition order. That is, the first interface can use the image display area corresponding to the tire position, combined with the image acquisition order, to allow users to complete the acquisition of tire images for each vehicle tire in sequence, transforming the tire detection behavior from "free shooting" to "completing the task according to the wheel position", effectively ensuring the standardized acquisition of tire images.
[0040] S120, in response to the first operation, performs multi-dimensional analysis on multiple tire images based on the intelligent system to obtain analysis results for multiple vehicle tires.
[0041] The first interface also displays functional controls related to initiating tire detection. The first operation can be an input operation to this functional control on the first interface. This can be understood as the user triggering or performing a non-contact interactive operation on this functional control on the first interface to initiate a multi-dimensional analysis of the tire image.
[0042] For example, see Figure 4The first interface displays functional controls related to initiating tire detection. These controls display the message "Start Tire Detection". Taking the first operation as a trigger operation as an example, the trigger operation can be one of the following: a click operation, a drop-down selection operation, or an information input operation. The user can click the "Start Tire Detection" control to perform the first operation of tire image analysis. Alternatively, the first interface may display a drop-down control, which may include at least one control displaying the "Start Tire Detection" message. Selecting this "Start Tire Detection" control from the drop-down menu will perform the first operation of tire image analysis. Alternatively, the first interface may display a corresponding input box, where the user can enter a command similar to "Start Tire Detection" to perform the first operation of tire image analysis.
[0043] Whether to respond to the first operation to perform tire image detection may be related to the number of tire images displayed in the image presentation area of the first interface. Optionally, upon receiving the first operation to analyze tire images, if it is determined that at least one tire image is displayed in at least one image presentation area of the first interface, the first operation can be responded to to detect the tire images. Further, to ensure the accuracy of the analysis results, upon receiving the first operation, if it is determined that multiple tire images are displayed in multiple image presentation areas of the first interface, the first operation can be responded to to perform tire image analysis. If no tire images are found in any of the image presentation areas of the first interface, corresponding prompt information is provided based on the first operation. For example, the prompt information could be: "No tire images have been collected yet; please collect tire images before detection."
[0044] Multi-dimensional analysis of tire images can be achieved by retrieving the corresponding intelligent system. Accordingly, the detection results of the vehicle tires are used as the analysis results. That is, in response to the first operation of analyzing tire images, the intelligent system is retrieved to analyze and process multiple acquired tire images to obtain the analysis results of the vehicle tires.
[0045] The intelligent system can be an agent or a Large Language Model (LLM) used to detect tire images of vehicles to determine the analysis results. The following section explains how the intelligent system performs multi-dimensional analysis of tire images, using several abnormal vehicle tire scenarios as examples.
[0046] For example, to detect sidewall bulges, the intelligent system can perform image preprocessing and segmentation on multiple acquired tire images to determine the region of interest (ROI) corresponding to the sidewall. It then determines the tire surface depth map corresponding to the ROI and calculates the corresponding surface curvature information. Based on the surface curvature information and a standard surface curvature threshold, it determines whether a sidewall bulge exists. If present, it provides the corresponding analysis results. Similarly, for tire crack detection, the intelligent system can perform image preprocessing and texture feature extraction on multiple tire images to determine tire crack features. It then performs multi-scale detection on these crack features to determine the presence of tire cracks. If present, it determines the crack depth, width, and other information, and provides corresponding analysis results based on this information. Furthermore, for tread wear detection, the intelligent system can perform image preprocessing and tread depth feature extraction on multiple tire images to determine the tread depth features. Using these tread depth features, it determines the remaining tread depth of the vehicle's tire. Based on the remaining tread depth, it determines the tire wear information. Finally, based on this wear information, it provides analysis results related to the tread wear condition. It should be noted that the above are only examples of some vehicle tire anomalies, and do not specify the specific content and number of anomalies or the analysis information for anomalies.
[0047] Correspondingly, the analysis result can be structured text adjusted from the output of the intelligent system. Optionally, when the intelligent system detects tires based on tire images and outputs corresponding information, the output information can be extracted to obtain text related to vehicle tire detection. This text is then processed to remove code block markers (Markdown tags) and obtain the corresponding JSON field information. Normalization, error correction, and strong structured validation are performed on the JSON field information to obtain structured text, which is then used as the analysis result. The above processing effectively ensures the quality of the analysis results.
[0048] The analysis results should include at least: anomalies for each vehicle tire, analysis information for these anomalies, and recommended handling information. Anomalies describe the abnormalities present in the tires of the vehicle undergoing inspection. The analysis information for these anomalies is related to the specific anomalies. Recommended handling information may be suggestions for addressing the anomalies. For example, an anomaly could be a sidewall bulge; the analysis information could include the confidence level and urgency of the bulge. Correspondingly, a recommended handling information might be to replace the left front tire.
[0049] Specifically, in response to the first operation, the intelligent system associated with the first interface is invoked. Based on this intelligent system, multiple tire images are analyzed and detected to determine the analysis results for each vehicle tire. It should also be noted that during the analysis and detection of the acquired tire images based on the intelligent system, an analysis progress interface can be displayed to allow the user to clearly understand the processing progress of the tire images, thus improving the human-computer interaction experience. The intelligent system analysis progress interface can be as follows: Figure 5 As shown.
[0050] S130. Present the analysis results.
[0051] Specifically, the analysis results are displayed so that users can clearly understand the tire condition of the vehicle to be inspected based on the anomalies, the analysis information of the anomalies, and the processing suggestions in the analysis results.
[0052] The technical solution provided by this invention acquires and displays tire images of corresponding vehicle tires based on the image acquisition controls in each image presentation area of the first interface. This method allows for the formatted display of tire images, enabling users to clearly understand whether tire images of each vehicle tire have been acquired and whether the acquisition results meet preset requirements. Furthermore, each image presentation area corresponds to one vehicle tire. Therefore, when tire images are input into the intelligent system for processing, the intelligent system can clearly identify the vehicle tire corresponding to each tire image, thereby analyzing the associated tire images for each vehicle tire to obtain analysis results for each tire. Furthermore, multiple tire images of the same vehicle tire can be used by the intelligent system to verify the accuracy of the analysis results. Finally, when analyzing multiple tire images corresponding to each image presentation area based on the intelligent system, the accuracy of the analysis results for the tires belonging to the corresponding image presentation areas can be further verified by combining the driving mode of the vehicle to be inspected, achieving a comprehensive and targeted effect in tire analysis.
[0053] Based on the above embodiments, the first interface can be displayed in one or more ways. For a detailed description of different display methods, please refer to this embodiment. Technical terms that are the same as or corresponding to those in the above embodiments will not be repeated in this embodiment. The technical solution provided by this invention can detect tires of specific vehicle types, or tires of different vehicle types. The way the first interface is displayed differs for different tire detection scenarios.
[0054] In one scenario, for a vehicle tire inspection of a specific vehicle type, the first interface can be displayed in one of the following ways: receive input for tire inspection and display the first interface.
[0055] The input operations for tire detection can be either triggering functional controls on the entry interface or non-contact interactive operations. Specific triggering and non-contact interactive operations have been described above and will not be repeated here.
[0056] Specifically, in response to the user's input operation on the entry interface regarding tire detection, the first interface is displayed.
[0057] For example, let's take a click operation as an input action. See [link / reference] Figure 1 When the entry interface is the application's home screen, the home screen displays functional controls related to launching the first interface. The text displayed on these controls is: "Start Photo Detection". Users can click on these controls to display the first interface. See also... Figure 2 (b) When the entry interface is a function block interface, the function interface displays a function control related to starting the first interface. The text displayed by the function control is: "Start photo detection". The user can click on the function control to display the first interface.
[0058] In another scenario, for the detection of tires of different vehicle types, the first interface can be displayed in the following way: receiving input operations for tire detection and displaying a second interface including multiple vehicle type identifiers, wherein the vehicle type identifiers are related to the number of wheels of the vehicle; based on the selection operation of the vehicle type identifiers, displaying the first interface, wherein the number of image display areas in the first interface is related to the number of wheels of the triggered vehicle type identifiers.
[0059] In this scenario, the input operation for tire detection is used to display the second interface. Correspondingly, this input operation can also be a trigger operation for the corresponding functional control in the entry interface or a contactless interactive operation. The second interface includes multiple vehicle type identifiers. These vehicle type identifiers are used to identify the vehicle type. The vehicle type is categorized based on the number of wheels. In other words, different vehicle type identifiers correspond to different numbers of wheels.
[0060] For example, the second interface may include: vehicle type identifier 1, vehicle type identifier 2, and vehicle type identifier 3. Among them, vehicle type identifier 1 can correspond to a four-wheeled vehicle, vehicle type identifier 2 can correspond to a six-wheeled vehicle, and vehicle type identifier 3 can correspond to an eight-wheeled vehicle. This is only an example and does not impose a specific restriction on the number of wheels of the vehicle.
[0061] The selection of a vehicle type identifier can be triggered by choosing one of multiple vehicle type identifiers. The number of wheels corresponding to the selected vehicle type identifier is consistent with the number of wheels of the vehicle to be tire inspected. Accordingly, the first interface displayed based on this selection operation is a first interface that matches the number of wheels corresponding to the vehicle type identifier.
[0062] Specifically, the system receives input for tire detection and displays a second interface. For the multiple vehicle type identifiers displayed on the second interface, in response to a selection operation of a vehicle type identifier, a first interface matching the number of wheels corresponding to the vehicle type identifier is displayed. Tire images are then acquired and displayed based on multiple image presentation areas in the first interface.
[0063] For example, taking a click operation as the input for tire detection, see [link to relevant documentation]. Figure 6 , Figure 6 Example image to trigger the display of the second interface. Figure 6 (a) is an example image of the entry interface. Figure 6 (b) is an example image of the second interface. Users can click... Figure 6 (a) shows the "Start Photo Detection" control in the entry interface, which is used to display the second interface, such as... Figure 6 As shown in (b). Accordingly, the user can click on one of the three vehicle type icons displayed in the second interface based on the number of wheels of the vehicle currently undergoing tire inspection, to display the first interface corresponding to the vehicle type icon. For example, clicking on vehicle type icon 1 will display the interface shown in (b). Figure 4 The first interface shown.
[0064] In practical applications, to adapt to the tire inspection needs of different vehicle types, a second interface with multiple vehicle type identifiers can be displayed. By selecting the second interface, a first interface matching the actual requirements can be displayed, that is, the interface content matching the triggered vehicle type identifier. The displayed first interface accurately matches the number of tires of the corresponding vehicle, effectively avoiding missed or false detections and ensuring the comprehensiveness of tire image acquisition for each vehicle.
[0065] In this embodiment of the invention, the first interface includes not only the image presentation area mentioned above, but also a schematic diagram display area, in which a vehicle schematic diagram is displayed.
[0066] The vehicle diagram can be a visual image simulating the shape of a vehicle. See also Figure 4 ,exist Figure 4The interface displays a schematic diagram of a four-wheeled vehicle. The advantage of displaying this diagram in the first screen is that it not only presents the vehicle type intuitively and clearly, but also, during tire image acquisition, clearly identifies the tire being captured, ensuring the intuitiveness of information during the tire image acquisition process.
[0067] In this embodiment of the invention, the main focus is on the detection of vehicle tires. To facilitate users' understanding of relevant information about vehicle tires, a vehicle tire diagram corresponding to the number of wheels can be displayed in the vehicle diagram.
[0068] The vehicle tire diagram can be an image simulating a vehicle tire. The vehicle tire diagram may also include markers indicating the number of tire images. These markers represent the number of tire images collected. For example, see [continued]. Figure 4 If no tire images have been captured yet, the number of tire images at each tire's corresponding location will be marked as 0.
[0069] A vehicle tire diagram can be displayed in a preset format, which may include displaying color, displaying shape, etc. For example, see... Figure 4 The vehicle tire diagram can show the color of the vehicle body in a way that distinguishes it from the vehicle body in the diagram.
[0070] The image display area can be correlated with the position of the vehicle's tire diagram. Furthermore, to help users understand the wheel position corresponding to each image display area, a tire position description is included in the image display area. This tire position description serves as a prompt to indicate which tire image has been captured for the corresponding vehicle tire.
[0071] The tire position description can be used to indicate which wheel's tire image to capture. For example, see... Figure 4 , Figure 4 The tire position descriptions are: left front wheel, right front wheel, left rear wheel, and right rear wheel, which are used to prompt the user to collect the tires at the corresponding positions.
[0072] Specifically, the first interface includes multiple image display areas, the number of which can be matched to the vehicle type. Each image display area includes a tire position description to prompt the acquisition of tire images at the corresponding locations. The first interface also includes a vehicle schematic diagram, which includes a schematic diagram of the vehicle's tires corresponding to the number of wheels. The vehicle tire schematic diagram also includes tire quantity marking information, which changes as the number of tire images at the corresponding location changes.
[0073] The technical solution provided by this invention displays a first interface upon receiving an input operation for tire detection, enabling the acquisition and display of tire images through various image presentation areas within the first interface. Alternatively, upon receiving an input operation for tire detection, a second interface including multiple vehicle type identifiers is displayed; by selecting a vehicle type identifier in the second interface, the first interface is displayed, thus meeting the tire detection needs of different vehicle types. Furthermore, the first interface can also display image presentation areas, vehicle diagrams, and vehicle tire diagrams, achieving regional display of vehicle tire detection-related information, ensuring comprehensive information display, and facilitating targeted analysis of tire images in each image presentation area, thereby improving the accuracy of tire image analysis.
[0074] Figure 7 This is a flowchart illustrating another information interaction method provided by an embodiment of the present invention. Based on the foregoing embodiments, the step of "collecting multiple tire images through multiple image presentation areas of the first interface" is described in detail. The specific implementation method can be found in the detailed description of this embodiment. Technical terms that are the same as or corresponding to those in the above embodiments are not repeated in this embodiment.
[0075] like Figure 7 As shown, the method specifically includes the following steps: S210, In response to the triggering operation of the image acquisition control in the target image presentation area, display the shooting interface.
[0076] In this embodiment of the invention, the shooting interface can be integrated into the terminal device. The terminal device can be a mobile device. During user-controlled movement of the terminal device, a camera is invoked based on a trigger operation on an image acquisition control in any image display area to display the shooting interface on the terminal device.
[0077] The triggered image display area is the target image display area. The triggering operation can be to activate the image acquisition control within the target image display area to invoke the camera device's operation. The image acquisition control can be a control that is triggered to acquire images of the tire. It should be noted that each image display area in the first interface can include an image acquisition control resembling a "camera." When the image acquisition control is triggered, the shooting interface can be displayed.
[0078] The shooting interface can be used to acquire tire images in real time. The following is combined with... Figure 4 and Figure 8 This section explains the display and specific content of the shooting interface. Specifically, Figure 8 This is an example image of the camera interface. Users can... Figure 4Clicking the image acquisition control in the image display area corresponding to the left front wheel in the first interface will display the shooting interface related to the acquisition of the left front wheel tire image, such as... Figure 8 As shown.
[0079] The shooting interface includes a first area and a second area. As the user moves the terminal device, the content displayed in the first area changes with the device's position, while the content displayed in the second area remains constant. The first area of the shooting interface displays a real-time image of the vehicle's tires. This first area includes a viewfinder for capturing the tire image. The viewfinder displays the real-time image within the field of view. The field of view can be the spatial range currently captured by the terminal device. Correspondingly, the real-time image of the vehicle's tires can be a continuously refreshed image transmitted in real-time from the terminal device's camera, corresponding to the field of view.
[0080] The field of view is determined by the camera's field of view on the terminal device. Optionally, the field of view can be adjusted by changing the current position of the terminal device and / or by adjusting the field of view parameters of the camera on the terminal device. The field of view parameters can include: horizontal field of view parameters, vertical field of view parameters, and diagonal field of view parameters. Adjusting one or more of these parameters will change the field of view. It should be noted that when the field of view changes, the real-time image in the first region will also change.
[0081] The second area displays a reference image. The reference image is used to indicate the tire acquisition perspective of the tire image. The reference image can be a standard image used for comparison during image acquisition. The reference image can include standard tire images from different tire acquisition perspectives. The second area may also display a corresponding reference description to explain the reference image based on the description.
[0082] Optionally, one or more images can be selected as reference images based on historical tire defect images stored in the database. The selected reference images are used to characterize the image acquisition requirements under the corresponding tire acquisition viewpoint. Typically, see [link to relevant documentation]. Figure 8 The reference images can be three: a sidewall reference image, a damaged area reference image, and a tread reference image. The sidewall reference image can be an image of the sidewall area of the vehicle tire, and must include at least the tire's brand or size. The damaged area image can be a close-up image of the defective part of the vehicle tire, used to highlight the current tire problem. The tread reference image can be an image of the tread area of the vehicle tire, and must include at least the tread pattern.
[0083] Furthermore, to clarify image acquisition requirements for users during shooting, a reference description can be displayed at a preset location below the reference image. This reference description can be a tire image acquisition prompt corresponding to the reference image. See also... Figure 8 The reference description for a tire sidewall reference image can be "showing the complete tire sidewall (brand or specification captured)". The reference description for a damaged area reference image can be "close-up of the damaged area (e.g., a crack, bulge, or puncture in the tire)". The reference description for a tread reference image can be "tread depth (photographed perpendicularly to the tread)". The benefit of displaying reference images and descriptions is that it provides a reference standard for tire image acquisition, prompting the acquisition of similar tire images, thereby improving the accuracy of subsequent tire inspections.
[0084] Specifically, for multiple image display areas, the currently selected image display area can be used as the target image display area. In response to a trigger operation on the image acquisition control in the target image display area, a shooting interface is displayed. This allows adjustment of the real-time image presented in the first area based on the reference image and description displayed in the second area, in order to acquire a tire image that conforms to the reference image and corresponding description. It should also be noted that the shooting interface can also include an album control, allowing users to use pre-captured tire images from the album as the currently selected tire image for detection.
[0085] The aforementioned shooting interface not only displays real-time images of the vehicle's tires but also shows reference images in corresponding areas. Since the tire acquisition perspective of the reference images has been repeatedly verified and validated, users can instruct the capture of the current vehicle's tire images based on the reference image's tire acquisition perspective, thereby obtaining tire images adapted to the reference image's perspective. When combining tire images from such perspectives to analyze the current tire condition, more effective information about the vehicle's tires can be extracted, thus improving the accuracy of vehicle tire analysis.
[0086] Optionally, to ensure the accuracy of subsequent tire detection by the intelligent system, the real-time image can be detected during the display of the image on the shooting interface to determine and display shooting prompts, and the shooting parameters can be adjusted based on the shooting prompts. The shooting parameters include at least one or more of the following: shooting angle, shooting light, and sharpness.
[0087] The shooting prompts are used to guide adjustments to the live feed in the first area. For example, see... Figure 8The shooting prompt message could be something like, "Please keep the photo clear and avoid strong reflections." Optionally, the shooting prompt message can be obtained in the following ways: When capturing real-time footage from the shooting interface, the captured footage can be transmitted to a server, or an intelligent system can be invoked to perform multi-dimensional analysis of the real-time footage, including brightness, contrast, sharpness, and image content integrity, to determine the image analysis results. Based on the image analysis results, the shooting prompt message is intelligently generated. This shooting prompt message ensures that the captured tire images meet the actual image quality requirements.
[0088] Shooting parameters can be various parameters that can be manually configured or adjusted during tire image acquisition. Among them, the shooting angle represents the angle of the terminal device's camera relative to the tire. Adjusting the shooting angle ensures the tire is fully displayed within the viewfinder of the first area, avoiding obstruction. Shooting light controls the brightness of the acquired tire image. Optionally, brightness can be adjusted using the "flash" control or other controls in the shooting interface. Sharpness controls the sharpness of the acquired tire image. Optionally, sharpness can be adjusted using controls such as "focus" and "exposure" in the shooting interface.
[0089] Specifically, while displaying the real-time image on the shooting interface, shooting prompts corresponding to the current real-time image can also be displayed simultaneously. Based on the shooting prompts, one or more of the shooting angle, shooting light, and sharpness can be adjusted to obtain a tire image that meets the actual needs and ensures the quality of the tire image.
[0090] Furthermore, firstly, to help users clearly understand the tire acquisition angle corresponding to the tire image to be captured, and secondly, to help users understand which tire acquisition angle is currently being captured, the corresponding reference image can be presented based on the following method. The following combination... Figure 9 Explain (a), (b), and (c) in the text.
[0091] The first method involves displaying at least a portion of the reference image in a first form in the second area of the shooting interface. The first form is used to indicate the reference sample corresponding to the tire image that has not yet been captured.
[0092] Here, a reference example can be understood as at least one reference image corresponding to a tire image that has not yet been captured. The first form can be highlighting or marking the reference example corresponding to the tire image that has not yet been captured. For example, the first form can be color marking, label marking, or other marking processing.
[0093] Specifically, based on the currently acquired tire images, the reference examples corresponding to the tire images that have not yet been acquired are determined, and prompts are given in the first form.
[0094] For example, see Figure 9 (a) If a tire image corresponding to the first tire sidewall reference image is displayed in the image display area corresponding to the left front wheel in the first interface, the remaining two reference images in the second area can be highlighted in red to indicate that tire images corresponding to the remaining two reference images have not yet been collected.
[0095] The above method distinguishes the reference image corresponding to the uncaptured viewpoint from the reference image corresponding to the captured viewpoint in a first form, allowing the user to clearly see the tire image at the currently captured viewpoint as well as the tire image at the uncaptured viewpoint, thus achieving the effect of focusing the tire image capture viewpoint.
[0096] The second method involves displaying at least a portion of the reference image in a second form within a second area of the shooting interface. This second form serves to represent a reference example of the tire image to be captured.
[0097] Here, a reference example can be understood as at least one reference image corresponding to the currently acquired tire image. The second form can be a method of highlighting or marking the reference example corresponding to the currently acquired tire image. For example, the second form could be color marking, label marking, or other marking methods.
[0098] Specifically, if the tire images are acquired sequentially according to the reference image order, the reference sample corresponding to the current tire image to be acquired is determined based on the currently acquired tire images, and the reference image corresponding to the current tire image to be acquired is prompted in a second form.
[0099] For example, see Figure 9 (b) is an example of tire images acquired in the following order: tire image corresponding to the sidewall reference image, tire image corresponding to the damaged area reference image, and tire image corresponding to the tread reference image.
[0100] If a tire image corresponding to the first tire sidewall reference image is detected in the image display area corresponding to the left front wheel in the first interface, then the reference sample corresponding to the current tire image to be acquired is determined to be a damaged area reference image, and the damaged area reference image can be highlighted in red. This method, by differentiating the reference image corresponding to the next acquisition viewpoint from other reference images in a second form, allows the user to clearly see the reference image corresponding to the next tire image to be acquired. Based on this reference image, the user is instructed to acquire the tire image from the corresponding tire acquisition viewpoint, achieving the effect of targeted acquisition of tire images from each tire acquisition viewpoint.
[0101] The third method: In response to an event that a tire image already exists in the target image presentation area, a reference image of the uncaptured viewpoint is displayed in the second area of the shooting interface.
[0102] Specifically, when a tire image is detected in the target image display area of the first interface, the tire acquisition viewpoint corresponding to the displayed tire image and the reference image corresponding to that tire acquisition viewpoint are determined. Based on the reference image corresponding to that tire acquisition viewpoint, the reference image displayed in the second area of the shooting interface is adjusted so that only the reference image of the unacquired viewpoint is displayed in the second interface.
[0103] For example, see Figure 9 (c) If a tire image corresponding to the first tire sidewall reference image is detected in the image display area corresponding to the left front wheel in the first interface, then the reference images of the uncaptured viewpoint are determined to be the damaged area reference image and the tire tread reference image. Then, only these two reference images can be displayed in the second area of the shooting interface.
[0104] It should be noted that the reference images displayed in the second area of the aforementioned shooting interface can change as the tire image acquisition progresses. That is, in this case, by dynamically changing the number of reference images in the second area, the user can clearly see which tire image(s) have not yet been acquired, making tire image acquisition more targeted.
[0105] S220, in response to the second operation, acquire the tire image of the vehicle tire corresponding to the target image rendering area.
[0106] The second area of the shooting interface may include shooting controls. The second operation can be a trigger operation on the shooting controls or a contactless interactive operation. Through the second operation on the shooting controls, the real-time image presented in the first area of the shooting interface is determined to be the tire image.
[0107] Specifically, in response to the second operation of the shooting control in the shooting interface, the real-time image in the first area of the current shooting interface is used as the tire image to achieve tire image acquisition.
[0108] Optionally, in response to a second operation on the shooting controls in the shooting interface, an image pre-capture interface is displayed. The image pre-capture interface includes the currently captured tire image, the captured tire images, and an image completion control or an image deletion control.
[0109] Combination Figure 10 To explain, Figure 10 This is an example image of the image pre-acquisition interface. Figure 10The image pre-capture interface includes the currently captured tire image, as well as previously captured tire images at the current wheel position. Users can use the image completion or deletion controls in the image pre-capture interface to confirm or delete the captured tire images. Additionally, the image pre-capture interface includes a "Complete this wheel" control to indicate whether to end the capture of tire images at the current wheel position.
[0110] S230. Display the acquired tire images in the target image presentation area; based on the vehicle tire position corresponding to the target image presentation area, update the number of vehicle tire images in the vehicle schematic diagram and at the vehicle tire position.
[0111] The vehicle schematic diagram is adapted to the vehicle to be inspected for tire testing. The corresponding position can be the location in the vehicle schematic diagram related to the vehicle tire schematic diagram, used to display the number of tire images collected.
[0112] Specifically, for each vehicle to be detected, there are multiple wheels. Each image display area in the first interface is associated with a wheel position. When the user triggers an operation on an image display area to collect tire images, the wheel position of the tire image to be collected is also determined. Correspondingly, the collected tire images can be backfilled into the triggered image display area. At the same time, based on the vehicle tire position corresponding to the target image display area, the number of tire images in the vehicle schematic diagram and at the vehicle tire position on the first interface is updated.
[0113] The advantages of the above processing are as follows: By performing a second operation on the shooting control, the real-time image on the shooting interface is frozen into a tire image, and the acquired tire image is transmitted back to the corresponding target image display area. This achieves a correspondence between the tire image and the vehicle tire, ensuring that all images in the target image display area are of the same vehicle tire. This facilitates subsequent targeted analysis of tire images for each vehicle's tires by the intelligent system, clarifying the tire condition of the corresponding vehicle tire. Simultaneously, when displaying tire images in the target image display area, the number of tire images is updated at the corresponding tire position in the vehicle schematic diagram, clearly reflecting the current number of tire images acquired. This clarifies whether further acquisition of tire images at that position is needed, ensuring comprehensive tire image acquisition. Furthermore, it allows users to easily use the number of tire images as a reference for analysis results.
[0114] For example, the following combination Figure 4 and Figure 11The following explanation is provided. When the image acquisition control in the image display area corresponding to the left front wheel is triggered and the tire image acquisition is completed, the acquired tire image can be backfilled into the corresponding image display area of the left front wheel. At this time, the image display area corresponding to the left front wheel... Figure 4 The situation shown changes to Figure 11 As shown in the diagram, two captured tire images are displayed in the image presentation area for the left front wheel. Simultaneously, in the corresponding upper right corner of the vehicle tire diagram for the left front wheel, the current tire image count is displayed as 2.
[0115] During the process of acquiring, displaying, or analyzing tire images, the image quality of the tire images can be checked to ensure that the image quality meets the requirements, thereby ensuring the accuracy of the analysis results of the vehicle tires.
[0116] Optionally, after displaying the tire image in the corresponding image presentation area, or when receiving the first operation to analyze the tire image and processing the tire image according to the intelligent system, a quality inspection can be performed on the tire image to determine whether the image quality of the tire image meets preset detection conditions. If it is determined that the tire image does not meet the preset detection conditions, a prompt to retake the tire image can be made through at least one of the following methods.
[0117] The first method: In response to the detection that the tire image in the image presentation area does not meet the preset detection conditions, a first prompt message is displayed on the tire image to prompt the user to retake the tire image.
[0118] The preset detection conditions can be pre-set conditions that the tire image quality must meet. Optionally, the tire image is subjected to detection processing in at least one quality detection dimension, such as sharpness, completeness, and shooting angle, to obtain image quality detection results. If the image quality detection results meet the preset quality range, the tire image is determined to meet the preset detection conditions. Conversely, if the image quality detection results do not meet the preset quality range, the tire image is determined to not meet the preset detection conditions.
[0119] The first prompt message can be used to prompt the user to retake the tire image. Optionally, the first prompt message can be a text prompt, or a prompt message that combines color coding, icon coding, and / or text.
[0120] Specifically, the image quality detection results will differ for different tire images. When the image quality detection result of the current tire image does not meet the preset quality range, i.e., the tire image does not meet the preset detection conditions, a first prompt message can be displayed in the tire image to allow the tire image to be re-captured from the corresponding tire acquisition perspective.
[0121] The second method: In response to the detection that the tire image in the image presentation area does not meet the preset detection conditions, the vehicle tire position corresponding to the image presentation area is displayed in the vehicle schematic diagram in a third form according to the vehicle tire position.
[0122] To help users clearly identify which wheel of the vehicle corresponds to an abnormal tire image, a third form of notification can be used. This third form is used to indicate that the tire image corresponding to the vehicle's tire position is abnormal.
[0123] Optionally, the third form may include one or more. For example, the third form may be a blinking border or outline of the vehicle tire diagram, displaying the vehicle tire diagram in a different color (e.g., the vehicle tire diagram corresponding to a tire image without anomalies is blue, and the vehicle tire diagram corresponding to a tire image with anomalies is red), or adding a warning icon (e.g., the warning icon may be an exclamation mark or a warning triangle, etc.) at the corresponding position of the vehicle tire diagram.
[0124] Specifically, for the acquired tire images, if the tire image in the image presentation area does not meet the preset detection conditions, the corresponding vehicle tire diagram in the vehicle schematic diagram can be determined based on the vehicle tire position corresponding to the image presentation area, and the vehicle tire diagram can be displayed in a third form.
[0125] The third method: In response to the detection that the tire image in the image presentation area does not meet the preset detection conditions, while displaying the first prompt information on the tire image to prompt for retaking the tire image, the vehicle tire diagram corresponding to the vehicle tire position is displayed in the vehicle diagram in a third form according to the vehicle tire position corresponding to the image presentation area.
[0126] Based on the above, real-time visual feedback on abnormal tire images can be achieved through the first prompt information and / or the third form, which highlights the abnormal tire images, not only facilitating timely replacement of abnormal tire images, but also avoiding the need for subsequent detection of abnormal tire images, thus ensuring the accuracy of the analysis results.
[0127] For example, see [link to previous article] Figure 11 For the tire image in the image display area of the left front wheel, if it is determined that the acquired tire image does not meet the preset detection conditions, the border of the tire image can be highlighted in red, and the first prompt message "Retake required" can be displayed. Additionally, the vehicle tire diagram corresponding to the left front wheel can be displayed in red.
[0128] Optional, Figure 12 This is a flowchart illustrating the process of detecting tire images. The following is combined with... Figure 12This section describes the detection process for tire images. For the acquired tire images, multiple parallel-processing agents within the intelligent system perform structured recognition of the images, and a quality gate is used to detect whether the tire image contains tire information and whether it is unclear.
[0129] If a tire is detected as missing or unclear in the tire image, the image is located, its wheel position and the exact image number are determined, and information indicating that a new tire image needs to be taken is output. If a tire is found to be present and clear in the image, JSON parsing can be performed. If the tire image cannot be parsed, the image is located, and information indicating that a new tire image needs to be taken is output.
[0130] If the tire image can be analyzed, it is determined that there are no abnormalities and re-capture is unnecessary. In this case, the JSON data corresponding to the tire image can be processed according to one or more of the pre-configured tire defect verification rules, visual evidence extraction strategies, tire mutual exclusion rules, and tread depth decision trees in the intelligent system. The analysis result is output after all images of the wheel to which the tire image belongs have been processed. Otherwise, a "complete order failed" result is output.
[0131] The system includes tire diagnostic rules for detecting anomalies in vehicle tires. A visual evidence extraction strategy extracts visual information from tire images corresponding to these anomalies. Tire mutual exclusion rules can be rules for mutual exclusion of tire anomalies, such as the mutual exclusion rules between tire wear and tread depth. A tread depth decision tree is used to detect tread depth in tire images. Optionally, tire detection knowledge is broken down into independently versionable prompt word projects (block-based prompts) to obtain the tire diagnostic rules, visual evidence extraction strategy, tire mutual exclusion rules, and tread depth decision tree within the intelligent system.
[0132] In a single call to the intelligent system (Vision-Language Model (VLM)), the JSON data corresponding to the tire image is formatted and anchored using the minimum available data structure specification (MINIMAL_SCHEMA). Furthermore, tire defect name verification rules ensure that the anomaly names output by the intelligent system precisely match the standard names corresponding to the tire defect name verification rules, avoiding alias mapping.
[0133] The above processing pre-writes tire detection knowledge into the block Prompt, uses a decision tree to constrain the order of tread depth level selection, and uses a whitelist to filter the output information through tire defect name verification rules. This ensures that the output of the intelligent system is constrained to the label space corresponding to a limited number of anomalies, thereby reducing false alarms in the intelligent system and improving cross-model transferability.
[0134] The technical solution provided by this invention displays a shooting interface when a trigger operation is detected on the image acquisition control in the target image presentation area. This allows the user to be instructed to perform targeted and standardized image acquisition processing on the vehicle tires based on the reference image and description displayed on the shooting interface, thereby obtaining tire images. Furthermore, the acquired tire images are backfilled into the corresponding target image presentation area. Simultaneously, based on the vehicle tire position corresponding to the target image presentation area, the number of tire images is updated in the vehicle schematic diagram and at the tire position. This provides a multi-dimensional prompt to the user regarding the currently acquired tire images and their corresponding quantity, providing a basis for deciding whether to continue tire image acquisition. If the number of tire images is insufficient or the acquired tire images do not include tire images from the corresponding tire acquisition perspective, the user is prompted to continue tire image acquisition, thus ensuring the comprehensiveness and integrity of tire image acquisition and providing reliable and comprehensive image support for subsequent tire image analysis.
[0135] Figure 13 This is a flowchart illustrating another information interaction method provided in an embodiment of the present invention. Based on the foregoing embodiments, the step "responding to the first operation, performing multi-dimensional analysis on multiple tire images based on the intelligent system to obtain analysis results for multiple vehicle tires" is described in detail. The specific implementation method can be found in the detailed description of this embodiment. Technical terms that are the same as or corresponding to those in the above embodiments are not repeated in this embodiment.
[0136] like Figure 13 As shown, the method specifically includes the following steps: S310: Collect and display multiple tire images through multiple image display areas on the first interface.
[0137] The vehicle to be inspected includes multiple vehicle tires, and each vehicle tire corresponds to an image display area. The display position of the image display area in the first interface is related to the tire position of the multiple vehicle tires on the vehicle to be inspected. The tire acquisition angles corresponding to the multiple tire images collected in the same image display area are different.
[0138] S320, in response to the first operation of analyzing the acquired tire images, analyzes and processes multiple tire images in each image presentation area based on the intelligent system.
[0139] It should be noted that for a vehicle undergoing tire inspection, the corresponding tire can be analyzed based on the wheel to which the acquired tire image belongs, yielding a sub-analysis result. This can be understood as follows: for each vehicle tire with an acquired tire image, a corresponding sub-analysis result can be determined. The displayed analysis result can be a combination of the sub-analysis results for at least one vehicle tire.
[0140] Specifically, for the acquired tire images, in response to the first operation, the intelligent system is invoked, and multiple tire images in each image presentation area are analyzed and processed by the intelligent system to obtain analysis sub-results corresponding to each vehicle tire. Based on the analysis sub-results for each vehicle tire, the analysis result corresponding to the vehicle whose tires are to be inspected is determined.
[0141] It should be noted that if there is one or more tire images corresponding to the current vehicle's tires, the intelligent system can be invoked to analyze at least one tire image and determine the corresponding analysis result. If there are zero tire images corresponding to the current vehicle's tires, the invoked intelligent system will not analyze this vehicle's tires and will continue to analyze the tire images of the next vehicle's tires.
[0142] S330. In response to the completion of the analysis, a third interface including the analysis results is displayed, wherein the analysis results are displayed in a preset format.
[0143] The third interface can be used to display the analysis results. In this interface, the results can be displayed using a preset format. This preset format represents the way the analysis results are displayed. Essentially, it characterizes how the anomalies, analysis information, and processing suggestions for each vehicle tire in the analysis results are presented. For example, in the third interface, each vehicle tire displays its anomalies, analysis information, and processing suggestions in a corresponding area. These anomalies, analysis information, and processing suggestions can be displayed either flatly or stacked.
[0144] By detecting the completion of tire image analysis and processing by the intelligent system, and displaying the analysis results in a third interface according to a preset format, the visualization of the analysis results is achieved.
[0145] Optionally, the display of analysis results in the third interface may include: in response to the completion of the analysis, displaying the whole vehicle evaluation information of the vehicle to be inspected, displaying an urgency indicator at the position of each vehicle tire diagram in the vehicle diagram, displaying the tire evaluation information of each vehicle tire, and providing handling suggestions for abnormal tires.
[0146] The vehicle assessment information can be used to characterize the overall tire abnormalities present in the vehicle undergoing tire inspection. The vehicle assessment information includes at least a description of the tire abnormalities at the first urgency level. The first urgency level characterizes the urgency of the overall tire abnormalities in the vehicle undergoing tire inspection. See also... Figure 14 , Figure 14This is an example image of the third interface, which displays the vehicle assessment information at the top. The highest urgency level is "Emergency," and the tire abnormality description is: left front tire sidewall damage, exposed cords, tread depth less than 1.6 mm. Do not drive at high speeds; immediate replacement is recommended.
[0147] To help users clearly understand the urgency level of each tire on the vehicle undergoing tire inspection, the analysis results displayed on the third interface also include a display of the urgency level indicators in the vehicle tire diagram. See also Figure 14 The system displays a vehicle diagram at a preset location within the overall vehicle assessment information, and displays the corresponding urgency level indicator and health attribute for each tire in the corresponding position of the vehicle tire diagram. Figure 14 Taking the left front wheel tire diagram as an example, the urgency level indicator for the left front wheel is displayed at the location shown on the tire diagram: Urgent, with a health attribute of 30 points. It should be noted that this urgency level indicator is used to characterize the urgency of the tire malfunction requiring immediate attention. The health attribute is consistent with the health attribute in the tire assessment information.
[0148] Tire assessment information includes the vehicle's tire health attributes, at least one anomaly, the urgency of the anomaly, and its confidence level. The urgency and confidence level of the anomaly correspond to the analysis information mentioned above. The tire assessment information is described in detail below.
[0149] The health attribute of vehicle tires is used to characterize the health or safety level of vehicle tires. The determination of the vehicle tire health attribute can be as follows: For each vehicle tire image, an intelligent system performs a severity level judgment on each tire image to determine the numerical range of health attribute for each tire. If the tire image indicates a relatively severe condition, the vehicle tire's health attribute is determined to belong to the first numerical range (e.g., [1,35]); if the tire image indicates a moderately severe condition, the health attribute is determined to belong to the second numerical range (e.g., (35,55]); if the tire image indicates a non-severe condition, the health attribute is determined to belong to the third numerical range (e.g., (55,100]). Further analysis of each vehicle tire image by the intelligent system determines the specific value of each tire within the corresponding numerical range, thus obtaining the health attribute of each vehicle tire. Finally, based on the health attribute of each vehicle tire, the minimum health attribute is taken as the overall vehicle health attribute.
[0150] For a display of the health attributes determined using the above method, please refer to... Figure 14 . Figure 14 The data shows that the health attribute of the left front wheel is 30 points, and the health attribute of the right front wheel is 60 points.
[0151] Anomalies are used to characterize abnormalities in vehicle tires. It should be noted that, in this embodiment of the invention, the pre-configured tire defect verification rules in the intelligent system correspond to multiple anomalies. The tire images are analyzed using these tire defect verification rules to identify the anomalies in the vehicle tires.
[0152] For each vehicle tire, there can be one or more anomalies. Anomalies can be grouped and displayed according to the vehicle tire they belong to, or they can be displayed in ascending order of the tire's health attribute. See also Figure 14 , Figure 14 The system first displays the abnormalities of the left front tire, which has a health score of 30. These abnormalities are: "Tread depth less than 1.6mm (very easy to slip in the rain, braking distance greatly increased)" and "Side bulge (extremely high risk of tire blowout, repair not recommended)". Below the abnormalities of the left front tire, the system displays the abnormalities of the right front tire, such as: "Nail puncture / foreign object puncture (increased risk of slow air leakage and tire blowout)".
[0153] The urgency level is used to characterize the urgency or importance of an anomaly. Optionally, the urgency level can be determined based on the data range to which the vehicle tire health belongs and the anomaly. The urgency level can be divided into four levels: Urgent, Moderate, Recommended, and Good. The urgency level corresponding to the data range to which the vehicle tire health belongs is determined. Based on this urgency level, the urgency level label for the vehicle tire is determined. Furthermore, based on this urgency level and the specific anomaly, an analysis is performed to determine the urgency level corresponding to the vehicle tire anomaly.
[0154] For example, if a vehicle's tire health attribute is between 1 and 39, the urgency level of the corresponding tire diagram is determined to be "Urgent." The urgency level of the corresponding anomaly is then determined by combining the tire's abnormality and the urgency level indicator. If the tire health attribute is between 40 and 59, the urgency level of the corresponding tire diagram is determined to be "Moderate." The urgency level of the corresponding anomaly is then determined by combining the tire's abnormality and the urgency level indicator. If the tire health attribute is between 60 and 79, the urgency level of the corresponding tire diagram is determined to be "Suggested." The urgency level of the corresponding anomaly is then determined by combining the tire's abnormality and the urgency level indicator. If the tire health attribute is between 80 and 100, the urgency level of the corresponding tire diagram is determined to be "Good." The urgency level of the corresponding anomaly is then determined by combining the tire's abnormality and the urgency level indicator. Additionally, the number of tire images can be used to mark any vehicle tire with fewer than three images, allowing for subsequent alerts.
[0155] The urgency level of each identified anomaly can be displayed in a preset position to the left of the anomaly. See also Figure 14 Taking the left front wheel as an example, for the abnormal item "tread depth less than 1.6mm", its urgency level is displayed as "urgent" on the left side of the abnormal item.
[0156] Confidence level is used to characterize the credibility of an outlier. Optionally, confidence levels can be categorized as: high confidence, relatively confident, and requiring verification. A corresponding confidence level can be determined for each outlier. See also... Figure 14 Taking the left front wheel as an example, at the preset location of the area corresponding to the abnormal item "pattern depth less than 1.6mm" on the left front wheel, the corresponding confidence level is displayed as high confidence.
[0157] The suggested handling information can be based on abnormal information about the vehicle's tires, providing recommendations for handling the tires. This information includes solutions for the abnormal tires and their urgency level. The urgency level, or the severity level, can be determined based on the urgency indicator and health attribute of the abnormal tire.
[0158] When there are multiple handling suggestions to display, they can be arranged according to their urgency for the abnormal tire. For example, see... Figure 14 Prioritize displaying the handling suggestions information corresponding to "Immediately" ("Replace the left front and right front tires") and the solution "Left front and right front tire bulge / expired age issue"), and display the handling suggestions corresponding to "As soon as possible" ("Four-wheel alignment") and the solution "Right rear tire uneven wear to avoid premature tire failure" in the preset position under the previous handling suggestion information.
[0159] Specifically, when the intelligent system detects that the tire image analysis is complete, the third interface displays the vehicle evaluation information of the vehicle to be inspected, the urgency level indicator at the position of each vehicle's tire diagram in the vehicle diagram, the tire evaluation information of each vehicle's tire, and the handling suggestions for abnormal tires.
[0160] The aforementioned analysis of tire images from various vehicles using an intelligent system not only automatically identifies various anomalies such as tire bulges, sidewall cracks, punctures, uneven wear, low tread depth, and premature aging, achieving a comprehensive, multi-dimensional analysis of vehicle tires, but also allows the intelligent system to use multiple tire images from the same vehicle to corroborate the accuracy of the analysis results. Furthermore, the intelligent system can further verify the accuracy of the tire analysis results by considering the drive mode of the vehicle being inspected, effectively ensuring the comprehensiveness and relevance of the analysis results. Finally, the obtained analysis results are displayed in the corresponding positions on the third interface, ensuring the clarity and organization of the analysis results presentation.
[0161] The technical solution provided in this invention acquires and displays multiple tire images through multiple image presentation areas on a first interface. In response to a first operation analyzing the acquired tire images, an intelligent system analyzes and processes the multiple tire images in each image presentation area to achieve targeted analysis of the tire images of each vehicle's tires, obtaining analysis results corresponding to each vehicle's tires. Furthermore, when the tire image analysis of the vehicle to be inspected is detected as complete, the obtained analysis results are displayed on a third interface to display multi-dimensional information from the analysis results, ensuring the comprehensiveness of the analysis result display.
[0162] Based on the above embodiments, the displayed analysis results can include not only vehicle assessment information, urgency level indicators at the corresponding vehicle positions in the vehicle diagram, tire assessment information, and handling suggestions, but also tire specification information and the inspection items passed by the vehicle tires. Specific processing details can be found in the detailed description of this embodiment. Technical terms that are the same as or corresponding to those in the above embodiments will not be repeated in this embodiment.
[0163] To help users quickly understand or obtain vehicle tire information, the system can also: in response to a triggering action on the tire specification information of an abnormal tire, redirect to a target page to display detailed business information associated with the tire specification information of the abnormal tire.
[0164] It should be noted that tire specification information is primarily for tires of vehicles with anomalies. If the analysis results include multiple tires with anomalies, the tire specification information for each anomaly tire can be displayed directly, or the corresponding tire specification information can be displayed when the corresponding vehicle tire diagram is triggered. If two or more vehicle tires have the same tire specification information, they can be displayed together.
[0165] The tire specification information may include one or more of the following: brand, tread pattern, tread pattern type, DOT (Dual Origin and Tread Rotation) date, and remaining years of the corresponding faulty tire. It should be noted that the tire specification information can be linked to a target page in a third-party application. When a user triggers a control corresponding to the tire specification information, the target page will display the vehicle tire matching the specified specification for the user's convenience.
[0166] The target page can be a display page showing the trade details associated with the tire specifications of the abnormal tire. These trade details can be detailed tire information for the vehicle tires corresponding to the abnormal tire's specifications. In other words, users can interact with controls related to the trade details on the target page to retrieve the corresponding normal tires.
[0167] Specifically, tires of vehicles with anomalies are identified as abnormal tires, and their tire specifications are displayed in the corresponding location on the third interface. Upon detecting a trigger action on the abnormal tire's tire specifications, the user is redirected to a target page where detailed product information associated with the abnormal tire's specifications is displayed. Tire retrieval is then achieved using controls related to this detailed product information.
[0168] When using intelligent systems to inspect vehicle tires, multiple checks are typically performed sequentially. To help users understand the tire inspection items and increase the confidence in the analysis results, the analysis results displayed on the third interface can also include the tires that passed the required checks.
[0169] The inspection items can be pre-set and include checks on vehicle tires. Optionally, based on the collected tire images of all vehicle tires, if it is determined that all vehicle tires pass the inspection item, then the inspection item is displayed. Conversely, if a vehicle tire fails the inspection item, then the inspection item is identified as an anomaly and displayed accordingly.
[0170] For example, see [link to previous article] Figure 14 Below the display area corresponding to the processing suggestion information, the tire specification information of the triggered vehicle tires is displayed, and below the tire specification information, the inspection items passed by the vehicle tires are displayed.
[0171] The technical solution provided by this invention displays the tire specification information of the abnormal tire while showing the anomaly information and processing suggestions in the analysis results, making the displayed analysis results richer and more comprehensive. When a trigger operation on the tire specification information of the abnormal tire is detected, the system redirects to a target page to display related commercial details. This allows for the acquisition and processing of vehicle tires with the same tire specification information based on the commercial details on the target page, improving the convenience of obtaining vehicle tires.
[0172] Based on the above embodiments, when acquiring tire images of a vehicle, the number of tire images may be less than a preset number. In this case, the tire images can still be analyzed using the above method, and the analysis results of the vehicle tires can be displayed. To ensure the accuracy of the analysis results, a prompt message indicating that the number of tire images is insufficient can also be given. Specific processing details can be found in the detailed description of this embodiment. Technical terms that are the same as or corresponding to those in the above embodiments will not be repeated in this embodiment.
[0173] For any image display area, if the number of tire images in the image display area is less than a preset threshold, a second prompt message for the tire to which the image display area belongs is displayed in the analysis results.
[0174] The preset quantity threshold is related to the number of tire acquisition perspectives. For example, for each vehicle tire, the tire acquisition perspectives typically include: the acquisition perspective corresponding to the tire sidewall, the acquisition perspective related to the damaged part of the tire, and the acquisition perspective corresponding to the tire tread. Therefore, the preset quantity threshold could be 3 images. The second prompt message encourages the user to acquire more tire images to continue obtaining analysis results.
[0175] In practical applications, to ensure the accuracy of tire detection, images of the tire tread, sidewall, and damaged areas are typically captured for each vehicle tire. If the number of tire images displayed in the image presentation area is less than a preset threshold, a second prompt message can be generated based on the already captured tire images to remind the user to capture additional tire images from the corresponding capture perspective.
[0176] Specifically, for any image display area, if the number of tire images displayed in the current image display area is less than a preset threshold, a second prompt message can be determined and displayed based on the tire images displayed in the current image display area and the tire acquisition angle corresponding to the tire images. This prompt message serves as a reminder to re-acquire tire images in order to obtain accurate analysis results.
[0177] For example, the second prompt message could be: "The analysis results are based on two tire images of the left front wheel. To obtain more accurate analysis results, please collect additional tire images of the left front wheel and the tire images of the other wheels, so that the number of tire images for each vehicle is no less than three."
[0178] It should be noted that for each tire image captured at a wheel location, a corresponding SHA-256 fingerprint is calculated. Upon receiving a re-captured tire image, the SHA-256 fingerprints of the re-captured tire image and the pre-captured tire image at the same wheel location are verified according to the wheel location to which the re-captured tire image belongs. Based on the fingerprint verification results, the tire image that needs to be detected by the intelligent system (the re-captured tire image) is determined. When the intelligent system analyzes the tire image that needs to be detected, the analysis results of the tire image before the re-capture are inherited or merged to determine a more accurate analysis result after the re-captured tire image. This process avoids wasting the analysis results before the re-captured tire image and the problem of inconsistency in the analysis results of the intelligent system before and after the re-capture, thus improving the efficiency, consistency, and accuracy of the analysis result output.
[0179] In this way, by comparing the number of tire images in the image presentation area with a preset threshold, a second prompt message is generated to remind the user to collect tire images from multiple angles and in multiple quantities. This ensures the comprehensiveness of the collected tire images and the integrity of the collection perspective, further guaranteeing the accuracy of the tire analysis results.
[0180] Based on the above embodiments, the content that can be presented on the analysis results display interface is usually limited. Therefore, the interface typically displays key information such as anomalies, analysis information of the anomalies, and processing suggestions. Further related information can be displayed by triggering an operation on each anomaly in the analysis results display interface. The following details the information displayed by triggering anomalies. Technical terms that are the same as or corresponding to those in the above embodiments are not repeated in this embodiment.
[0181] When displaying anomalies in vehicle tires, a fourth interface can be displayed in response to a triggering operation on any anomaly, to show the evidence chain information of the triggered anomaly.
[0182] The triggering operation for an anomaly can be an operation that triggers a control in the area containing the anomaly on the third interface. The fourth interface can be used to display the evidence chain information for the anomaly. For example, it can be accessed by clicking... Figure 14 The corresponding area for the anomaly is used to display the evidence chain information for the anomaly. The fourth interface for the evidence chain information can be found in [link to relevant documentation]. Figure 15 .
[0183] The chain of evidence information can be determined by the intelligent system based on tire images and further processing of the analysis results. The chain of evidence information includes at least one of the following: conclusion information about the anomaly, analysis information that caused the anomaly, annotation information of the anomaly region in the tire image, and information on the impact of the anomaly on vehicle driving.
[0184] The following combination Figure 15 Provide detailed information about the chain of evidence. The conclusion information for an anomaly can be a brief summary of the triggered anomaly. This conclusion information may include: the anomaly, its urgency, and its confidence level. For example, Figure 15 The conclusion information includes: abnormal item "side bulge", the urgency level of the abnormal item "urgent", and the confidence level "relatively reliable".
[0185] The analytical information causing anomalies can be information that leads to the presence of corresponding anomalies in the vehicle tires. Anomaly region annotation information in the tire image can be used to characterize the abnormal tire region corresponding to the anomaly in the tire image. See also... Figure 15 If the anomaly is a bulge on the left front tire side, the bulge area in the corresponding tire image of the left front tire can be highlighted in red, and the analysis information causing the anomaly can be displayed. For example... Figure 15 The analysis information is as follows: "Sidewall bulge: Excluding normal wear and tear, the bulge is determined to be caused by impact with a curb, pothole, or hard object during driving. The extent of internal cord breakage cannot be determined from the image and requires disassembly and inspection."
[0186] Impact information can be used to characterize the effect of anomalies on vehicle driving. Impact information includes at least the braking impact distance of the vehicle tires, remaining safe mileage, and driving risk attributes. For multiple impact information items, they can be displayed in blocks based on the display area to which they belong. The braking impact distance can be defined as the increased braking slip distance compared to standard tires when braking on the same road surface and at the same speed, given the presence of the anomaly in the vehicle tires. For example, see... Figure 15 If the abnormality of the vehicle tire is a sidewall bulge, it can be displayed in the display area of the impact information: when the vehicle speed is 80km / h, the braking impact distance increases by 25%.
[0187] The remaining safe mileage can be the upper limit of the remaining distance a vehicle can safely travel even with this tire abnormality. For example, see... Figure 15If the tire abnormality is a sidewall bulge, it can be displayed in the area showing the impact information: "Remaining safe mileage less than 6000km, inspection recommended as soon as possible." The driving risk attribute characterizes the risk of continuing to drive the vehicle given this tire abnormality. Optionally, the driving risk attribute can include attributes under at least one driving risk dimension. This at least one driving risk dimension can include: slow air leakage risk dimension, slippage risk dimension, and tire blowout risk, etc. For example, see... Figure 15 If the abnormality of the vehicle tire is a sidewall bulge, it can be displayed in the area where the impact information belongs: "High driving risk attribute when driving at a high speed of 120km / h".
[0188] Specifically, when displaying anomalies in the analysis results of vehicle tires, a fourth interface can be displayed in response to a triggering operation on any anomaly. This fourth interface displays the evidence chain information for the triggered anomaly, including the conclusion information of the anomaly, the analysis area causing the anomaly, the anomaly area annotation information in the tire image, and the impact of the anomaly on vehicle driving. This clarifies the cause of the anomaly and its resulting impact, making the processing recommendations more theoretically grounded. Furthermore, displaying the corresponding evidence chain information in response to anomaly triggering operations not only saves display space on the third interface corresponding to the analysis results, allowing the third interface to display analysis results from more analytical perspectives, but also makes the display of evidence chain information more targeted. It should be noted that, to improve the completeness of the evidence chain information, an explanation of the anomaly can also be displayed at the bottom of the evidence chain information display interface. For example, Figure 15 The explanation of "bulge" in Chinese.
[0189] Furthermore, while displaying the chain of evidence information through the fourth interface, the fourth interface can also display a first control representing accurate analysis results and a second control representing biased analysis results. This allows for adjustments or optimizations to the intelligent system based on the cause information and chain of evidence information corresponding to the triggering operation, in response to triggering the first or second control. Specifically, in response to triggering the first control, positive feedback data is generated based on the chain of evidence information and the judgment information indicating accurate analysis results; or, in response to triggering the second control, negative feedback data is generated based on the judgment information indicating biased analysis results. Based on the positive or negative feedback data, sample data for calibrating the intelligent system is obtained.
[0190] The first control can be used to indicate the accuracy of the analysis results and the chain of evidence. The second control can be used to indicate a deviation between the analysis results and the chain of evidence. Both the first and second controls can be judgment controls. That is, if the user triggers the first control, it indicates that the analysis results and the corresponding chain of evidence are accurate; if the user triggers the second control, it indicates that there is a deviation between the analysis results and the corresponding chain of evidence.
[0191] Positive feedback data is data generated based on the chain of evidence and accurate judgments made from the analysis results. For example, taking the first control as... Figure 15 The "Accurate" control in the text is explained, if the user... Figure 15 Clicking the "Accurate" control in the settings will generate positive feedback data based on the judgment information corresponding to that "Accurate" control.
[0192] Negative feedback data can be generated based on judgments where there is a discrepancy between the evidence chain information and the analysis results. Sample data can be generated from both positive and negative feedback data, and is used to adjust and optimize the intelligent system. For example, using the second control as... Figure 15 The "false positive" control in the text is explained. If the user misjudges... Figure 15 Clicking the "Misjudgment" control will generate negative feedback data based on the judgment information corresponding to the "Misjudgment" control.
[0193] Specifically, in response to a trigger operation on the first control in the fourth interface, judgment information corresponding to the trigger operation is determined. This judgment information is used to characterize the accuracy of the evidence chain information and the analysis results. Positive feedback data is generated based on this judgment information. Alternatively, in response to a trigger operation on the second control in the fourth interface, judgment information corresponding to the trigger operation is determined. This judgment information is used to characterize the deviation between the evidence chain information and the analysis results. Negative feedback data is generated based on this judgment information. Sample data for calibrating the intelligent system is obtained based on the positive or negative feedback data. The above processing can achieve the adjustment and optimization of the intelligent system based on the evidence chain information, achieving a closed-loop processing effect, thereby effectively ensuring the accuracy of the intelligent system in detecting vehicle tires.
[0194] Optionally, negative feedback data can be determined by: displaying at least one error option in response to a triggering operation on the second control; and generating negative feedback data based on the selected error option, the chain of evidence information, and the judgment information that the analysis results are biased in response to a triggering operation on at least one error option.
[0195] In response to a triggering operation on the second control, at least one error option can be displayed. The error option can be used to characterize the reason for the discrepancy between the judgment analysis results and the evidence chain information. At least one error option can include one or more of the following: "There's actually no problem here (false alarm)," "Anomaly judgment error," "The location / range of the anomaly area is incorrectly marked," "The urgency level is overestimated," "The urgency level is underestimated," and "Other." The triggering operation for at least one error option can be to select one of the at least one error option.
[0196] Specifically, in response to a trigger operation on the second control, at least one error option is displayed. In response to the trigger operation on at least one error option, negative feedback data is generated based on the selected error option, evidence chain information, and judgment information used to characterize the bias in the analysis results. By displaying at least one error option to the user, the system categorizes and displays possible error scenarios, facilitating targeted error option feedback, avoiding disorganized error information feedback, improving the accuracy and analyzability of negative feedback data, and enabling effective adjustments to the intelligent system based on the negative feedback data.
[0197] Optionally, if the selected error option is related to the tire image, the abnormal area annotation information of the tire image in the evidence chain information can be updated, or a three-dimensional tire image can be generated based on the tire image of the abnormal tire in the evidence chain information, so as to generate negative feedback data in response to the user's trigger operation on the three-dimensional tire image.
[0198] For example, see Figure 16 , Figure 16 This is an example screenshot of the interface that triggers the error option to display negative feedback data. Figure 16 (a) is the interface displaying at least one error option, and (b) is the interface displaying negative feedback data. Users can... Figure 15 After clicking the "Misjudgment" control in the middle, you can... Figure 16 (a) In the interface shown, select the corresponding misjudgment option. Based on the selected misjudgment option, the chain of evidence information, and the judgment information corresponding to the "misjudgment" control, feedback will be generated, negative feedback data will be displayed, such as... Figure 16 As shown in (b). In this way, the intelligent system can be optimized based on the misjudged options and the chain of evidence information.
[0199] The technical solution provided by this invention displays a fourth interface in response to a triggering operation on any anomaly. This fourth interface displays the evidence chain information of the triggered anomaly, enabling targeted display of the evidence chain information for anomalies in the analysis results and enriching the relevant information for vehicle tire detection. Furthermore, the displayed evidence chain information corresponds to the anomaly in the analysis results, providing further explanation of the anomaly and improving the credibility and verifiability of the vehicle tire analysis results.
[0200] Figure 17 This is a flowchart illustrating another information interaction method provided by an embodiment of the present invention. As can be seen from the above, the technical solution provided by this embodiment can be applied to both ordinary users and maintenance personnel. When applied to maintenance personnel, the provided technical solution assists them in inspecting vehicle tires. By adopting the analysis results determined by the intelligent system, an anomaly inspection report is generated, allowing maintenance personnel to re-inspect the vehicle tires based on the anomaly inspection report, thereby achieving both manual and intelligent dual-dimensional inspection of vehicle tires. Specific implementation methods can be found in the detailed description of this embodiment. Technical terms that are the same as or corresponding to those in the above embodiments are not repeated in this embodiment.
[0201] like Figure 17 As shown, the method specifically includes the following steps: S410. In response to the detection of an input operation that triggers the adoption analysis results, a fifth interface is displayed to show the anomaly item title information.
[0202] The third interface, which displays the analysis results, includes a functional control for adopting those results. The input for adopting the analysis results can be either a trigger action on this functional control or a contactless interactive action.
[0203] When a maintenance worker triggers or performs a non-contact interactive operation on the function control, and it is determined that the worker has adopted at least part of the analysis results, a fifth interface related to that function control is displayed. In this case, the displayed interface serves as the fifth interface. For example, see... Figure 14 and Figure 18 (a) In the third interface, an "Accept" control can be displayed. Maintenance personnel can click this "Accept" control to display... Figure 18 (a) shows the fifth interface.
[0204] The fifth interface can be used to display the anomaly item titles. These titles are related to the anomalies related to vehicle tires in the analysis results. Essentially, the anomaly item titles provide a brief overview of the anomaly. Optionally, the titles may include the vehicle tire to which the anomaly belongs, the corresponding problem, and its urgency level.
[0205] In this embodiment, the display of anomaly item title information in the fifth interface can be reflected in two dimensions: content and display format. Regarding content, each anomaly item corresponds to multiple pieces of information. When presented on the third interface, one or more of the following can be displayed as the anomaly item title information: the vehicle tire to which the anomaly item belongs, the corresponding anomaly issue, and the urgency level, thus achieving a concise display of the anomaly item's related information. Regarding the display format, the anomaly item title information can be displayed using at least one of the following: tiling, collapsing, or grouping / aggregating. Tiling allows all anomaly item title information to be displayed completely on the third interface, with all anomaly item content presented. Collapsing allows the anomaly item content to be collapsed and hidden by default, displaying only the anomaly item title information. When the user triggers the anomaly item, other content of the anomaly item is displayed, such as the evidence chain information. Grouping / aggregating allows the corresponding anomaly item title information to be displayed in separate areas according to wheel position or anomaly item category. It should be noted that anomalies related to vehicle tires can be displayed using one of the above three display formats, or a combination of at least two display formats.
[0206] Specifically, when an input operation on the adoption analysis results is detected, a fifth interface is displayed, and the title information of the abnormal items is shown on the fifth interface.
[0207] S420. In response to the triggering operation of the abnormal item title information, an abnormal inspection report is generated based on the abnormal item corresponding to the triggered abnormal item title information, and the vehicle tires of the vehicle to be inspected are inspected based on the abnormal inspection report.
[0208] The triggering operation can be understood as selecting at least some of the abnormal item title information in the fifth interface. The third interface displays abnormal item title information for each vehicle's tires. Repair personnel can trigger the selection based on actual needs or the presented title information to choose one or more abnormal item titles. The abnormal item corresponding to the triggered abnormal item title information can be referred to as the target abnormal item. The abnormal inspection report can be an inspection report used to inspect the vehicle whose tires are to be inspected. The abnormal inspection report can include at least one tire inspection item corresponding to the target abnormal item.
[0209] Optionally, tire inspection items may include at least one of the following: tire age and condition, whether the tire tread is abnormally worn, whether the tire tread is punctured or leaking air, whether the tire is cracked or damaged, whether the tread depth is close to the 1.6mm wear limit, whether the tire age is more than 5 years, whether the tread depth is close to the 3mm wear limit, and whether only the tire is removed and installed.
[0210] Specifically, when a triggering operation is detected on at least some of the anomaly item title information in the fifth interface, the anomaly item corresponding to the triggered anomaly item title information is identified as the target anomaly item. At least one tire inspection item is generated based on the target anomaly item. An anomaly inspection report is generated based on the at least one tire inspection item, and the tires of the vehicle to be inspected are then re-inspected based on the anomaly inspection report. This achieves a combination of manual inspection and intelligent system inspection, enabling dual inspection of vehicle tires. Furthermore, the manual inspection and intelligent system inspection can corroborate each other, further ensuring the accuracy of vehicle tire inspection.
[0211] For example, see Figure 18 , Figure 18 (a) is a sample screenshot of the fifth interface. Figure 18 (a) displays the anomaly title information for the left front tire and the right front tire. Even if the left and right rear tires have no anomalies, their anomaly title information can still be displayed on the third interface to meet the user's need to detect tires without anomalies. For each vehicle tire's anomaly title information display area, the urgency level and the nature of the anomaly can be shown. Repair personnel can select... Figure 18 (a) The two abnormal items of the left front wheel, and click Figure 18 (a) The "OK" control. By responding to the trigger operation of the "OK" control, based on the two target anomalies of the selected left front wheel, an anomaly inspection report corresponding to the target anomalies is determined. This report is then used to manually re-inspect the vehicle to be inspected for tire testing. The tire inspection items in the anomaly inspection report can be as follows: Figure 18 As shown in (b).
[0212] Optionally, when inspecting the tires of a vehicle to be inspected based on an anomaly inspection report, the system can receive inspection feedback information for the tire inspection items in the anomaly inspection report and generate a target report for the vehicle tires.
[0213] The inspection feedback information can be the information provided by maintenance personnel when inspecting the tires based on the tire inspection items in the anomaly inspection report. The inspection feedback information must include at least tire images related to the tire inspection items. The target report can be a document detailing the condition of the tires of the vehicle to be inspected. The target report may include at least tire images of the vehicle's tires, analysis results, tire inspection items, and corresponding inspection feedback information.
[0214] Specifically, upon receiving inspection feedback information for tire inspection items, a target report is generated based on the tire images of the vehicle to be inspected, the analysis results, the tire inspection items, and the inspection feedback information corresponding to the tire inspection items, and the target report is then fed back to the user or the server.
[0215] For example, see [link to previous article] Figure 18 , Figure 18 (b) displays multiple tire inspection items corresponding to the anomaly inspection report. Repair personnel can inspect the vehicle to be inspected by selecting the displayed tire inspection items, filling in the corresponding tire images, and then using the selected tire inspection items and the filled-in tire images as inspection feedback information. Based on this feedback information, a target report is generated and sent to the user or server. This process of receiving inspection feedback information and generating a target report combines intelligent system detection with manual verification, improving the accuracy of tire inspection and reducing the risk of missed or false detections. Simultaneously, the feedback target report ensures the richness, comprehensiveness, and accuracy of the tire inspection results, improving their understandability.
[0216] Optionally, the target report can be sent to a first terminal to display the target report of the vehicle tires, the first terminal being at least a user terminal; or, the target report can be sent to a first server to enable the first server to perform parameter optimization based on the target report and tire images.
[0217] The first terminal can be a user's terminal device that requires tire repair or maintenance. Optionally, the first terminal can be a terminal device belonging to an ordinary user (e.g., a car owner), in which case the ordinary user can receive the target report and determine the current tire condition of the vehicle. If the first terminal is a repair technician's terminal device, the technician can obtain the target report and perform repairs on the inspected vehicle based on the target report. The first server can be a server used to receive the target report. The first server is associated with the intelligent system and is used to optimize the intelligent system based on the received target report.
[0218] Specifically, the target report can be sent to a first terminal to display the vehicle's tire status, allowing ordinary users or maintenance personnel to clearly understand the tire condition. Alternatively, the target report can be sent to a first server, enabling the server to optimize the intelligent system's parameters based on the target report and tire images.
[0219] For example, taking a four-wheeled vehicle as an example, the specific processing of vehicle tire inspection is as follows: The repair personnel can click the image acquisition control on the first interface to acquire tire images. The acquired tire images must include at least one image of one wheel. When the system detects that the repair personnel have completed acquiring tire images, it invokes the intelligent system to inspect the acquired tire images, obtains the vehicle tire analysis results, and displays them on the corresponding interface. If the output analysis result fails, the tire images are highlighted in red to remind the repair personnel to re-acquire 1 to 3 tire images. The repair personnel can choose whether to accept anomalies in the analysis results displayed on the corresponding interface, and generate an anomaly inspection report based on the accepted target anomalies. Furthermore, the analysis results can be further processed to display the evidence chain information corresponding to the analysis results.
[0220] The technical solution provided by this invention displays a fifth interface containing anomaly title information when an input operation triggering the adoption analysis result is detected. For the displayed fifth interface, in response to the trigger operation on the anomaly title information, an anomaly inspection report is generated based on the anomaly corresponding to the triggered anomaly title information. This report assists maintenance personnel in inspecting the tires of the vehicle to be inspected, obtaining manual inspection results. These results are then cross-referenced with the analysis results of the vehicle to be inspected determined by the intelligent system, resulting in more accurate and reliable analysis results.
[0221] When performing vehicle tire inspection using the aforementioned information exchange method, it is possible to rely on... Figure 19 The interaction of the modules in the vehicle tire inspection system architecture diagram shown above achieves the vehicle tire inspection effect mentioned in the above embodiments.
[0222] See Figure 19 The vehicle tire inspection system includes a client layer, an access layer, a business capability interface layer, an inspection capability domain, a data capability domain, and external services.
[0223] The client layer, being the outermost layer of the vehicle tire inspection system architecture, is the interaction layer for users or maintenance personnel. It typically handles interface display, receiving user input, and processing basic interaction logic. The client layer also communicates with the backend service layer.
[0224] In this embodiment of the invention, the client layer includes an application or functional block for vehicle tire inspection, various display interfaces related to tire inspection, and a vehicle inspection linkage module corresponding to the tire inspection items. The client layer uses lightweight H5 to display interfaces such as tire image acquisition, asynchronous diagnosis, graded reporting, and evidence tracing; by embedding the corresponding system through WebView, the pre-inspection results are seamlessly written back to the work order, so that the vehicle tire inspection processing is integrated into the existing process rather than being an additional operation.
[0225] The access layer, located between the client layer and the business capability interface layer, serves as a front-end gateway for unified access and forwarding of all client traffic. In this embodiment of the invention, the access layer includes an HTTPS gateway for static resource publishing and API (Application Programming Interface) reverse proxying.
[0226] The business capability interface layer can be understood as an intermediate layer that encapsulates standardized business capabilities and provides services externally in the form of API interfaces. The business capability interface layer receives requests forwarded by the access layer and exposes reusable business function interfaces, achieving standardization and callability of business capabilities. In this embodiment of the invention, the business capabilities corresponding to the business capability interface layer may include six parts: asynchronous detection, report query, adoption service, behavior tracking, technician correction, and adoption package output.
[0227] The detection capability domain can be oriented towards vehicle tire inspection scenarios, encompassing the business boundary domain for all vehicle tire inspection, identification, and evaluation processes. The detection capability domain operates on a multimodal inference basis, completing parallel scheduling and vehicle report fusion. Through structured parsing, disease name verification, quality gating, and rule adjudication, the intelligent system output converges into stable, interpretable, and auditable analysis results. Rigid interception of blurred or tireless images is achieved, ensuring no low-confidence results are output. Furthermore, in re-shooting scenarios, the image fingerprint inheritance strategy strikes a balance between accuracy and computational efficiency.
[0228] In this embodiment of the invention, the detection capability domain includes: detection orchestration, re-image recognition, intelligent system invocation, result parsing, and prompts and constraints. Detection orchestration is used to schedule the detection of corresponding tire images by wheel and merge the analysis results of all tires. Re-image recognition is used to identify and detect the re-imaged tires. Intelligent system invocation is used to invoke the intelligent system to detect tire images. Result parsing is used for JSON parsing and field normalization. Result parsing includes at least: disease name verification, rules and quality gates, age calculation, and correction and inheritance. Prompts and constraints are used to determine prompt word engineering to constrain the analysis results output by the intelligent system.
[0229] The data capability domain provides various basic data services to meet the data requirements of the upper-layer detection capability domain. It stores at least vehicle anomaly inspection reports, tire images, and behavioral logs related to vehicle tire inspection. The data capability domain supports data traceability. External services provide intelligent system services and object storage services. That is, during vehicle tire inspection, the intelligent system of an external service can be invoked to analyze tire images. The intelligent system service and object storage service are replaceable, and the architecture is flexible enough to evolve.
[0230] The technical solution provided by this invention, through the multi-layer capability architecture of the vehicle tire inspection system, realizes the processing of tire image acquisition, image detection, analysis result output, and result adoption, thereby ensuring the accuracy and efficiency of vehicle tire inspection.
[0231] The following are embodiments of the information interaction device provided in this invention. This device and the information interaction methods in the above embodiments belong to the same inventive concept. For details not described in detail in the embodiments of the information interaction device, please refer to the embodiments of the above information interaction methods.
[0232] Figure 20 This is a schematic diagram of the structure of an information interaction device provided in an embodiment of the present invention. The device specifically includes: an image display module 510, an analysis result determination module 520, and an analysis result display module 530.
[0233] The image display module 510 is used to acquire and display multiple tire images through multiple image presentation areas on the first interface. The vehicle to be inspected includes multiple tires, and each tire corresponds to an image presentation area. The display position of the image presentation area on the first interface is related to the tire position of the multiple tires on the vehicle to be inspected. The tire acquisition perspectives corresponding to the multiple tire images acquired in the same image presentation area are different. The analysis result determination module 520 is used to respond to the first operation and perform multi-dimensional analysis on the multiple tire images based on the intelligent system to obtain the analysis results of the multiple tires. The analysis results include at least the anomalies of each tire, the analysis information of the anomalies, and the processing suggestion information. The analysis result display module 530 is used to display the analysis results.
[0234] The technical solution provided by this invention acquires and displays tire images of corresponding vehicle tires based on the image acquisition controls in each image presentation area of the first interface. This method allows for the formatted display of tire images, enabling users to clearly understand whether tire images of each vehicle tire have been acquired and whether the acquisition results meet preset requirements. Furthermore, each image presentation area corresponds to one vehicle tire. Therefore, when tire images are input into the intelligent system for processing, the intelligent system can clearly identify the vehicle tire corresponding to each tire image, thereby analyzing the associated tire images for each vehicle tire to obtain analysis results for each tire. Furthermore, multiple tire images of the same vehicle tire can be used by the intelligent system to verify the accuracy of the analysis results. Finally, when analyzing multiple tire images corresponding to each image presentation area based on the intelligent system, the accuracy of the analysis results for the tires belonging to the corresponding image presentation areas can be further verified by combining the driving mode of the vehicle to be inspected, achieving a comprehensive and targeted effect in tire analysis.
[0235] Based on the above technical solutions, optionally, displaying the first interface includes at least one of the following: receiving an input operation for tire detection and displaying the first interface; or receiving an input operation for tire detection and displaying a second interface including multiple vehicle type identifiers, wherein the vehicle type identifiers are related to the number of wheels of the vehicle; displaying the first interface based on a selection operation of the vehicle type identifiers, wherein the number of image display areas in the first interface is related to the number of wheels of the triggered vehicle type identifiers.
[0236] Based on the above technical solutions, optionally, the image display module includes: an image acquisition unit, including: a shooting interface display subunit, which displays the shooting interface in response to a trigger operation of the image acquisition control in the target image presentation area, wherein the first area of the shooting interface displays a real-time image of the vehicle tire, and the second area displays a reference image, which is used to indicate the tire acquisition angle of the tire image; and a tire image acquisition subunit, which is used in response to a second operation to acquire the tire image of the vehicle tire corresponding to the target image presentation area.
[0237] Based on the above technical solutions, optionally, in the shooting interface display subunit, the shooting interface display includes at least one of the following: displaying at least a portion of reference images in a first form in the second area of the shooting interface, the first form being used to indicate the reference sample corresponding to the tire image that has not yet been captured; and / or, displaying at least a portion of reference images in a second form in the second area of the shooting interface, the second form being used to characterize the reference sample of the tire image to be captured; and / or, in response to an event that a tire image already exists in the target image presentation area, displaying a reference image of an uncaptured viewpoint in the second area of the shooting interface.
[0238] Based on the above technical solutions, optionally, the image display module includes: a tire image display subunit, used to display the collected tire image in the target image display area; and to update the number of tire images of the vehicle tire in the vehicle schematic diagram and at the vehicle tire position according to the vehicle tire position corresponding to the target image display area; wherein the vehicle schematic diagram is adapted to the vehicle to be inspected.
[0239] Based on the above technical solutions, optionally, the device further includes: an image anomaly prompting module, used to display first prompting information on the tire image to prompt re-capture of the tire image in response to detecting that the tire image in the image presentation area does not meet preset detection conditions; and / or, in response to detecting that the tire image in the image presentation area does not meet preset detection conditions, to display a vehicle tire diagram corresponding to the vehicle tire position in a third form in a vehicle diagram according to the vehicle tire position corresponding to the image presentation area, the third form being used to prompt that the tire image corresponding to the vehicle tire position is abnormal.
[0240] Based on the above technical solutions, optionally, the analysis result determination module includes: an image analysis unit, used to analyze multiple tire images in each image presentation area based on the intelligent system in response to a first operation of analyzing the acquired tire images; and a third interface display unit, used to display a third interface including the analysis results in response to the completion of the analysis, wherein the analysis results are displayed in a preset format.
[0241] Based on the above technical solutions, optionally, the third interface display unit is used to display, in response to the completion of the analysis, the overall vehicle assessment information of the vehicle to be inspected, the urgency level indicator at the position of each vehicle tire diagram in the vehicle schematic diagram, the tire assessment information of each vehicle tire, and the handling suggestion information for abnormal tires in the third interface; wherein, the overall vehicle assessment information includes at least the tire abnormality description information of the first urgency level, the tire assessment information includes the health attribute of the vehicle tire, at least one abnormal item, the urgency level and confidence level of the abnormal item, and the handling suggestion information includes the solution for the abnormal tire and the urgency level.
[0242] Based on the above technical solutions, optionally, the device further includes: a fourth interface display module, used to display a fourth interface in response to a triggering operation on any anomaly, so as to display the evidence chain information of the triggered anomaly in the fourth interface; wherein the evidence chain information includes at least one of the following: conclusion information of the anomaly, analysis information that caused the anomaly, anomaly area annotation information of the anomaly in the tire image, and impact information of the anomaly on vehicle driving.
[0243] Based on the above technical solutions, optionally, the fourth interface further includes a first control representing the accuracy of the analysis results and a second control representing the deviation of the analysis results. The device further includes: a sample data acquisition module, comprising: a positive feedback data generation unit, used to generate positive feedback data based on the evidence chain information and the judgment information indicating the accuracy of the analysis results in response to a trigger operation on the first control; or, a negative feedback data generation unit, used to generate negative feedback data based on the evidence chain information and the judgment information indicating the deviation of the analysis results in response to a trigger operation on the second control; and a sample data generation unit, used to obtain sample data for calibrating the intelligent system based on the positive feedback data or the negative feedback data.
[0244] Based on the above technical solutions, optionally, the negative feedback data generation unit is used to display at least one error option in response to the triggering operation of the second control; and to generate the negative feedback data based on the selected error option, the evidence chain information, and the judgment information that the analysis result has a deviation in response to the triggering operation of at least one error option.
[0245] Based on the above technical solutions, optionally, the analysis results may also include tire specification information of the abnormal tire. The device further includes a target page redirection module, which is used to redirect to a target page in response to a trigger operation on the tire specification information of the abnormal tire, so as to display business details associated with the tire specification information of the abnormal tire on the target page.
[0246] Based on the above technical solutions, optionally, the device further includes: an anomaly inspection report generation module, used to display a fifth interface in response to detecting an input operation that triggers the adoption of the analysis results, to display anomaly item title information in the fifth interface, the anomaly item title information being related to anomalies in the vehicle tires in the analysis results; and to generate an anomaly inspection report based on the anomaly item corresponding to the triggered anomaly item title information in response to a trigger operation on the anomaly item title information, so as to inspect the vehicle tires of the vehicle to be inspected based on the anomaly inspection report.
[0247] Based on the above technical solutions, optionally, the device further includes: an image acquisition prompting module, used to display second prompting information about the tire to which the image presentation area belongs in the analysis results when the number of tire images in the image presentation area is less than a preset number threshold for any image presentation area. The second prompting information is used to prompt the user to acquire more tire images to continue obtaining analysis results; the preset number threshold is a threshold related to the number of tire acquisition angles.
[0248] The information interaction device provided in the embodiments of the present invention can execute the information interaction method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects for executing the information interaction method.
[0249] It is worth noting that in the embodiments of the above-mentioned information interaction device, the various units and modules included are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the scope of protection of the present invention.
[0250] Figure 21 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. Figure 21 A block diagram is shown of an exemplary electronic device 12 suitable for implementing embodiments of the present invention. Figure 21 The electronic device 12 shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments of the present invention.
[0251] like Figure 21 As shown, the electronic device 12 is represented in the form of a general-purpose computing device. The components of the electronic device 12 may include, but are not limited to: one or more processors or processing units 16, system memory 28, and bus 18 connecting different system components (including system memory 28 and processing unit 16).
[0252] Bus 18 represents one or more of several bus architectures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any of the various bus architectures. For example, these architectures include, but are not limited to, the Industry Standard Architecture (ISA) bus, the Micro Channel Architecture (MAC) bus, the Enhanced ISA bus, the Video Electronics Standards Association (VESA) local bus, and the Peripheral Component Interconnect (PCI) bus.
[0253] Electronic device 12 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by electronic device 12, including volatile and non-volatile media, removable and non-removable media.
[0254] System memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and / or cache memory 32. Electronic device 12 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, storage system 34 may be used to read and write non-removable, non-volatile magnetic media (… Figure 21 Not shown; usually referred to as a "hard drive"). Although Figure 21 As not shown, disk drives for reading and writing to removable non-volatile disks (e.g., "floppy disks") and optical disc drives for reading and writing to removable non-volatile optical discs (e.g., CD-ROMs, DVD-ROMs, or other optical media) may be provided. In these cases, each drive may be connected to bus 18 via one or more data media interfaces. System memory 28 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of the embodiments of the present invention.
[0255] A program / utility 40 having a set (at least one) of program modules 42 may be stored, for example, in system memory 28. Such program modules 42 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include an implementation of a network environment. Program modules 42 typically perform the functions and / or methods described in the embodiments of the present invention.
[0256] Electronic device 12 can also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), and with one or more devices that enable a user to interact with electronic device 12, and / or with any device that enables electronic device 12 to communicate with one or more other computing devices (e.g., network card, modem, etc.). This communication can be performed via input / output (I / O) interface 22. Furthermore, electronic device 12 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via network adapter 20. As shown, network adapter 20 communicates with other modules of electronic device 12 via bus 18. It should be understood that, although not shown in the figures, other hardware and / or software modules can be used in conjunction with electronic device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.
[0257] The processing unit 16 executes various functional applications and data processing by running programs stored in the system memory 28, such as implementing the information interaction method provided in the embodiments of the present invention. This method includes: acquiring and displaying multiple tire images through multiple image presentation areas of a first interface, wherein the vehicle to be inspected includes multiple vehicle tires, each vehicle tire corresponds to an image presentation area, the display position of the image presentation area in the first interface is related to the tire position of the multiple vehicle tires on the vehicle to be inspected, and the tire acquisition perspectives corresponding to the multiple tire images acquired in the same image presentation area are different; responding to a first operation, performing multi-dimensional analysis on the multiple tire images based on an intelligent system to obtain analysis results for the multiple vehicle tires; wherein the analysis results include at least anomalies for each vehicle tire, analysis information of the anomalies, and processing suggestion information; and displaying the analysis results.
[0258] Of course, those skilled in the art will understand that the processor can also implement the technical solutions of the information interaction method provided in any embodiment of the present invention.
[0259] This embodiment provides a computer-readable storage medium storing a computer program. When executed by a processor, the program implements the information interaction method steps provided in the foregoing embodiments of the present invention. The method includes: acquiring and displaying multiple tire images through multiple image presentation areas of a first interface, wherein the vehicle to be inspected includes multiple vehicle tires, each vehicle tire corresponds to an image presentation area, the display position of the image presentation area in the first interface is related to the tire position of the multiple vehicle tires on the vehicle to be inspected, and the tire acquisition perspectives corresponding to the multiple tire images acquired in the same image presentation area are different; responding to a first operation, performing multi-dimensional analysis on the multiple tire images based on an intelligent system to obtain analysis results for the multiple vehicle tires; wherein the analysis results include at least anomalies for each vehicle tire, analysis information of the anomalies, and processing suggestion information; and displaying the analysis results.
[0260] The computer storage medium of this invention can be any combination of one or more computer-readable media. A computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media (a non-exhaustive list) include: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this document, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.
[0261] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, capable of sending, propagating, or transmitting programs for use by or in connection with an instruction execution system, apparatus, or device.
[0262] Program code contained on a computer-readable medium may be transmitted using any suitable medium, including—but not limited to—wireless, wire, optical fiber, RF, etc., or any suitable combination thereof.
[0263] Computer program code for performing the operations of embodiments of the present invention can be written in one or more programming languages or a combination thereof. Programming languages include object-oriented programming languages—such as Java, Smalltalk, and C++—as well as conventional procedural programming languages—such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0264] Note that the above description is merely a preferred embodiment of the present invention and the technical principles employed. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and various obvious changes, readjustments, and substitutions can be made without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments, and may include many other equivalent embodiments without departing from the concept of the present invention, the scope of which is determined by the scope of the appended claims.
Claims
1. An information exchange method, characterized in that, include: Multiple tire images are collected and displayed through multiple image display areas on the first interface. The vehicle to be inspected includes multiple vehicle tires, and each vehicle tire corresponds to an image display area. The display position of the image display area on the first interface is related to the tire position of the multiple vehicle tires on the vehicle to be inspected. The tire acquisition angles corresponding to the multiple tire images collected in the same image display area are different. In response to the first operation, the intelligent system performs multi-dimensional analysis on the multiple tire images to obtain the analysis results of the multiple vehicle tires; wherein, the analysis results include at least the anomalies of each vehicle tire, the analysis information of the anomalies, and the processing suggestion information. The analysis results are presented.
2. The method according to claim 1, characterized in that, The first interface should include at least one of the following: Receive input for tire inspection and display the first interface; or, Receive input for tire detection and display a second interface including multiple vehicle type identifiers, wherein the vehicle type identifiers are related to the number of wheels of the vehicle; Based on the selection operation of the vehicle type identifier, the first interface is displayed, wherein the number of image display areas in the first interface is related to the number of wheels of the triggered vehicle type identifier.
3. The information interaction method according to claim 1, characterized in that, Before displaying multiple tire images in multiple image presentation areas of the first interface, the method further includes: In response to a trigger operation on the image acquisition control in the target image presentation area, a shooting interface is displayed, wherein the first area of the shooting interface displays a real-time image of the vehicle tires, and the second area displays a reference image, which is used to indicate the tire acquisition angle of the tire image. In response to the second operation, a tire image of the vehicle tire corresponding to the target image presentation area is acquired.
4. The information interaction method according to claim 3, characterized in that, The display shooting interface includes at least one of the following: At least a portion of the reference images are displayed in a first form in the second area of the shooting interface. The first form is used to indicate the reference sample corresponding to the tire image that has not yet been captured. And / or, At least a portion of the reference image is displayed in a second form in a second area of the shooting interface, the second form being used to characterize a reference sample of the tire image to be captured. And / or, In response to an event that a tire image already exists in the target image presentation area, a reference image of the uncaptured viewpoint is displayed in the second area of the shooting interface.
5. The information interaction method according to claim 3, characterized in that, Multiple tire images are displayed in multiple image presentation areas on the first interface, including: Display the captured tire image in the target image presentation area; Based on the vehicle tire position corresponding to the target image presentation area, the number of tire images of the vehicle tires in the vehicle schematic diagram is updated at the vehicle tire position; wherein, the vehicle schematic diagram is adapted to the vehicle to be inspected for tires.
6. The information interaction method according to claim 1, characterized in that, The method further includes: In response to the detection that the tire image in the image presentation area does not meet the preset detection conditions, a first prompt message is displayed on the tire image to prompt for retaking the tire image; and / or, In response to the detection that the tire image in the image presentation area does not meet the preset detection conditions, the vehicle tire diagram corresponding to the vehicle tire position is displayed in the vehicle diagram in a third form according to the vehicle tire position corresponding to the image presentation area. The third form is used to indicate that the tire image corresponding to the vehicle tire position is abnormal.
7. The information interaction method according to claim 1, characterized in that, In response to the first operation, the intelligent system performs multi-dimensional analysis on the multiple tire images to obtain the analysis results of the multiple vehicle tires, including: In response to the first operation of analyzing the acquired tire images, the intelligent system analyzes and processes multiple tire images in each image presentation area. In response to the completion of the analysis, a third interface is displayed, which includes the analysis results, and the analysis results are displayed in a preset format.
8. The information interaction method according to claim 7, characterized in that, Upon completion of the analysis, a third interface is displayed, including the analysis results: In response to the completion of the analysis, the third interface displays the overall vehicle assessment information of the vehicle to be inspected, displays an urgency indicator at the position of each vehicle tire diagram in the vehicle diagram, displays the tire assessment information of each vehicle tire, and provides handling suggestions for abnormal tires. The vehicle assessment information includes at least tire anomaly description information of the first urgency level. The tire assessment information includes the health attributes of the vehicle tires, at least one anomaly, the urgency level of the anomaly, and the confidence level. The processing suggestion information includes solutions for the abnormal tires and the urgency level.
9. The information interaction method according to claim 8, characterized in that, The method further includes: In response to a triggering operation on any anomaly, a fourth interface is displayed to show the evidence chain information of the triggered anomaly; wherein the evidence chain information includes at least one of the following: conclusion information of the anomaly, analysis information that caused the anomaly, anomaly region annotation information of the anomaly in the tire image, and impact information of the anomaly on vehicle driving.
10. The information interaction method according to claim 9, characterized in that, The fourth interface also includes a first control representing the accuracy of the analysis results and a second control representing the deviation of the analysis results. The method further includes: In response to the triggering operation of the first control, based on the evidence chain information and accurate judgment information from the analysis results, positive feedback data is generated; or, In response to the triggering operation of the second control, negative feedback data is generated based on the judgment information that there is a discrepancy between the evidence chain information and the analysis results; Based on the positive or negative feedback data, sample data for calibrating the intelligent system is obtained.
11. The information interaction method according to claim 10, characterized in that, In response to the triggering operation of the second control, based on the judgment information indicating a discrepancy between the evidence chain information and the analysis results, negative feedback data is generated, including: In response to a triggering operation on the second control, at least one error option is displayed; In response to a triggering operation for at least one error option, the negative feedback data is generated based on the selected error option, the chain of evidence information, and the judgment information that the analysis results are biased.
12. The information interaction method according to claim 1, characterized in that, The analysis results also include tire specification information for the abnormal tires, and the method further includes: In response to a triggering operation on the tire specification information of the abnormal tire, the user is redirected to a target page to display commercial details associated with the tire specification information of the abnormal tire.
13. The information interaction method according to claim 1, characterized in that, The method further includes: In response to the detection of an input operation that triggers the adoption of the analysis results, a fifth interface is displayed to show anomaly title information related to the anomalies of vehicle tires in the analysis results; In response to the triggering operation of the anomaly title information, an anomaly inspection report is generated based on the anomaly corresponding to the triggered anomaly title information, so as to inspect the vehicle tires of the vehicle to be inspected based on the anomaly inspection report.
14. The information interaction method according to claim 1, characterized in that, The method further includes: For any image presentation area, if the number of tire images in the image presentation area is less than a preset number threshold, a second prompt message for the tire to which the image presentation area belongs is displayed in the analysis results. The second prompt message is used to prompt the user to collect more tire images to continue obtaining analysis results. The preset number threshold is a threshold related to the number of tire acquisition angles.
15. An information interaction device, characterized in that, include: The image display module is used to collect and display multiple tire images through multiple image display areas of the first interface. The vehicle to be inspected includes multiple vehicle tires, and each vehicle tire corresponds to an image display area. The display position of the image display area in the first interface is related to the tire position of the multiple vehicle tires on the vehicle to be inspected. The tire acquisition angles corresponding to the multiple tire images collected in the same image display area are different. The analysis result determination module is used to respond to the first operation by performing multi-dimensional analysis on the multiple tire images based on the intelligent system to obtain the analysis results of the multiple vehicle tires; wherein, the analysis results include at least the anomalies of each vehicle tire, the analysis information of the anomalies, and the processing suggestion information; The analysis results display module is used to display the analysis results.
16. An electronic device, characterized in that, The electronic device includes: One or more processors; Storage device for storing one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the information interaction method as described in any one of claims 1-14.
17. A storage medium containing computer-executable instructions, characterized in that, The computer-executable instructions, when executed by a computer processor, are used to perform the information interaction method as described in any one of claims 1-14.
18. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the information interaction method as described in any one of claims 1-14.