Detection processing method and device for rental item

Abstract

The embodiment of the invention provides a detection processing method and device for a rental item, and the method comprises the steps: carrying out the detection processing of the rental item, the method comprises the following steps: after obtaining multi-modal data obtained by calling an augmented reality interface by a leasing user through a leasing subprogram to carry out data acquisition on a leasing item corresponding to a leasing order in a leasing state, carrying out damage identification and feature extraction according to the multi-modal data to obtain damage features of leasing item damage; detecting whether the lease item damage triggers a right condition associated to the maintenance deduction right of the lease order during order creation based on the damage characteristics, if the detection result is triggering, estimating the cost of damage maintenance according to the damage characteristics to obtain an estimated cost, and generating a right cancel-after-verification result including the estimated cost; therefore, the damage detection of the lease item and the right cancel-after-verification of the maintenance deduction right are realized.

Description

Technical Field

[0001] This document relates to the field of data processing technology, and in particular to a method and device for detecting and processing leased items. Background Art

[0002] Augmented reality (AR) is a technology that overlays virtual information on the real world. Computer-generated images, data, or other virtual elements can be added to the user's field of view in real time, providing richer information and experience than simply observing the real environment. With the development of the Internet, more and more services are provided online, and more and more data are also processed online. Integrating AR to enhance users' perception of service participation has become an important means of interaction between service providers and users. Summary of the Invention

[0003] One or more embodiments of this specification provide a method for detecting and processing leased items, comprising: obtaining multimodal data obtained by a lease user through a lease subroutine calling an augmented reality interface to collect data on the leased item corresponding to a lease order in a leased state. The multimodal data includes an image of the leased item and environmental perception data. Damage identification is performed based on the multimodal data to obtain damage to the leased item, and damage features of the damage to the leased item are extracted. Based on the damage features, it is detected whether the damage to the leased item triggers the rights and interests conditions of the repair exemption rights and interests associated with the lease order. The repair exemption rights and interests are associated with the lease order when the order is created. If the detection result is triggered, the cost of damage repair is estimated based on the damage features to obtain an estimated cost, and a rights and interests write-off result including the estimated cost is generated.

[0004] One or more embodiments of the present specification provide a detection and processing device for leased items, comprising: a data acquisition module, configured to acquire multimodal data obtained by a lease user through a lease subroutine calling an augmented reality interface to collect data on the leased item corresponding to a lease order in a leased state. The multimodal data includes an image of the leased item and environmental perception data. A feature extraction module, configured to perform damage identification based on the multimodal data to obtain damage to the leased item, and extract damage features of the damage to the leased item. A detection module, configured to detect whether the damage to the leased item triggers the rights and interests of the maintenance exemption associated with the lease order based on the damage features; the maintenance exemption is associated with the lease order when the order is created; if the detection result is triggered, a cost estimation module is run, and the cost estimation module is configured to perform cost estimation of damage repair based on the damage features to obtain an estimated cost, and generate a rights and interests write-off result including the estimated cost.

[0005] One or more embodiments of the present specification provide a detection and processing device for leased items, comprising: a processor; and a memory configured to store computer-executable instructions, wherein when the computer-executable instructions are executed, the processor is configured to: obtain multimodal data obtained by the lease user through a lease subroutine calling an augmented reality interface to collect data on the leased item corresponding to a lease order in a leased state. The multimodal data includes an image of the leased item and environmental perception data. Damage identification is performed based on the multimodal data to obtain damage to the leased item, and damage features of the damage to the leased item are extracted. Based on the damage features, it is detected whether the damage to the leased item triggers the rights and interests of the repair exemption benefit associated with the lease order. The repair exemption benefit is associated with the lease order when the order is created. If the detection result is triggered, the cost of damage repair is estimated based on the damage features to obtain an estimated cost, and a rights and interests write-off result including the estimated cost is generated.

[0006] One or more embodiments of the present specification provide a computer-readable storage medium for storing computer-executable instructions, which implement the following process when executed: obtaining multimodal data obtained by the leasing user through the leasing subroutine calling the augmented reality interface to collect data on the leased item corresponding to the leasing order in the leasing state. The multimodal data includes an image of the leased item and environmental perception data. Damage identification is performed based on the multimodal data to obtain damage to the leased item, and the damage characteristics of the damage to the leased item are extracted. Based on the damage characteristics, it is detected whether the damage to the leased item triggers the rights and interests of the maintenance exemption rights associated with the leasing order. The maintenance exemption rights are associated with the leasing order when the order is created. If the detection result is triggered, the cost of damage repair is estimated based on the damage characteristics to obtain an estimated cost, and a rights and interests write-off result including the estimated cost is generated. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] In order to more clearly illustrate one or more embodiments of this specification or technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or descriptions of the prior art. Obviously, the drawings described below are only some embodiments described in this specification. Those skilled in the art can derive other drawings based on these drawings without inventive effort. Figure 1 A schematic diagram of an implementation environment for a method for detecting and processing leased property provided in one or more embodiments of this specification; Figure 2 A processing flow chart of a method for detecting and processing leased property provided in one or more embodiments of this specification; Figure 3A flowchart of a detection and processing method for a leased object applied to a leased vehicle detection scenario provided by one or more embodiments of this specification; Figure 4 A processing flow chart of a detection method for a leased item applied to a leased item detection scenario provided by one or more embodiments of this specification; Figure 5 A schematic diagram of an embodiment of a detection and processing device for leased property provided in one or more embodiments of this specification; Figure 6 A schematic diagram of the structure of a detection and processing device for leased items provided in one or more embodiments of this specification. DETAILED DESCRIPTION

[0008] In order to enable those skilled in the art to better understand the technical solutions in one or more embodiments of this specification, the technical solutions in one or more embodiments of this specification will be clearly and completely described below in conjunction with the drawings in one or more embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this specification, not all of the embodiments. Based on one or more embodiments of this specification, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of this document.

[0009] The detection and processing method of the leased property provided in one or more embodiments of this specification can be applied to the implementation environment of the detection system of the leased property. Figure 1 , the implementation environment at least includes: a user terminal 101 and a server 102; The user terminal 101 is configured with an augmented reality interface and a multimodal sensor. When the augmented reality interface is called for data collection, multimodal data is collected through the multimodal sensor to obtain multimodal data. The user terminal 101 can specifically be a mobile phone, a personal computer, a tablet computer, an e-book reader, a device for information interaction based on VR (Virtual Reality, virtual reality technology), an in-vehicle terminal, an IoT device, a wearable smart device, a laptop computer, a desktop computer, etc. After acquiring the multimodal data, server 102 is configured to perform damage identification and feature extraction based on the multimodal data, obtain damage features of the leased item, perform damage inspection based on the damage features and the rights and interests conditions of the repair exemption benefits associated with the lease order, perform cost estimation to obtain estimated costs if the inspection passes, and generate a rights and interests write-off result including the estimated costs. Server 102 may be a single server, a server cluster consisting of multiple servers, or one or more cloud servers in a cloud computing platform. In addition, the implementation environment may also include a detection model 103; after acquiring the multimodal data uploaded by the user terminal 101, the server 102 inputs the multimodal data into the detection model 103 to perform damage identification, feature extraction, damage detection and cost estimation, and outputs the equity write-off result; In this implementation environment, after the server 102 obtains the multimodal data obtained by the leasing user through the leasing subroutine running on the user terminal 101 calling the augmented reality interface to collect data on the leased item corresponding to the leasing order in the leasing status, it first performs damage identification and feature extraction based on the multimodal data to obtain the damage characteristics of the damage to the leased item. Then, based on the damage characteristics, it detects whether the damage to the leased item triggers the rights and interests conditions of the repair exemption rights associated with the leasing order. If the detection result is triggered, the cost of damage repair is estimated according to the damage characteristics to obtain the estimated cost, and a rights and interests write-off result including the estimated cost is generated. In this way, damage detection of the damage to the leased item and rights and interests write-off of the repair exemption rights and interests are realized based on the multimodal data of the leased item.

[0010] One or more embodiments of a method for detecting and processing leased property provided in this specification are as follows: Reference Figure 2 The present embodiment provides a method for detecting and processing leased items, and the method specifically includes steps S202 to S208.

[0011] Step S202: obtaining multimodal data obtained by the leasing user through the leasing subroutine calling the augmented reality interface to collect data on the leased item corresponding to the leasing order in the leasing state.

[0012] In this embodiment, a rental user includes a user who rents items through a rental sub-program. The items rented by a rental user through a rental sub-program are considered rental items. The rental sub-program can be a sub-program within an application running on a user terminal, such as a rental sub-program within a payment application. The rental sub-program can also be a program function module or program component within an application. Furthermore, the rental sub-program can also be an application running independently on a user terminal, such as a rental program. That is, the rental sub-program can also be replaced by the rental program. The provider of the rental program can be a rental service provider or a payment service provider corresponding to a payment application. In this embodiment, the rental items can be displayed in the rental subprogram by connecting with multiple rental item providers, and users can select and rent rental items through the rental subprogram. For example, after connecting with multiple vehicle providers and obtaining vehicle information of rental vehicles provided by multiple vehicle providers, a rental vehicle list is generated based on the provider identification and vehicle information of each vehicle provider, and the rental vehicle list is displayed through the rental subprogram. The rental user can select and rent a rental vehicle from the rental vehicle list by accessing the rental subprogram. For another example, after connecting with multiple product providers and obtaining product information of rental products provided by multiple product providers, a rental product list is generated based on the provider identification and product information of each product provider, and the rental product list is displayed through the rental subprogram. The rental user can select and rent a rental product from the rental product list by accessing the rental subprogram. It should be noted that the vehicle rental subprogram can be used for vehicle rental, and the product rental subprogram can be used for product rental. Alternatively, the rental subprogram can also provide both vehicle rental and product rental, and the corresponding list can be displayed according to the rental category selected by the rental user.

[0013] To enhance the user's perception of leasing and improve the effectiveness of leasing management, this embodiment manages the leasing of items through leasing orders after the user has leased them. Specifically, after the user selects an item from the list of leased items and submits a leasing request, a leasing order is created based on the user and the selected item. Optionally, the leasing order remains in the leasing state until the user returns the item.

[0014] During specific implementation, the multimodal data obtained by the leasing user through the leasing subroutine calling the augmented reality interface to collect data on the leased items corresponding to the leasing order in the leasing status is obtained. Based on this, the leasing items are detected and processed based on the multimodal data to improve the effectiveness and accuracy of the detection and processing; and the image is displayed through augmented reality during the data collection process to improve the leasing user's perception of the collected multimodal data or images of the leased items.

[0015] During the specific implementation process, if the leased item is damaged while the leasing user is holding it, that is, the lease order is in the leased state, the leasing subroutine can collect data on the leased item corresponding to the lease order in the leased state to obtain multimodal data, and identify the damage to the leased item based on the multimodal data to improve the accuracy of the identified damage to the leased item.

[0016] In order to improve the effectiveness of data collection and the effectiveness of the obtained multimodal data, when the rental subroutine calls the augmented reality interface to collect data, the rental subroutine can call the augmented reality interface to guide data collection. In an optional implementation provided by this embodiment, the augmented reality interface uses the following method to collect data: The template display of the template is guided by the image collection of the rental property through the augmented reality page; If it is detected that the collected image matches the image collection guidance template, the multimodal sensor is called to perform multimodal data collection to obtain multimodal data.

[0017] Specifically, first, the template of the image acquisition guidance template of the leased item is displayed through the augmented reality page of the user terminal. The leasing user can adjust the terminal according to the image acquisition guidance template displayed on the augmented reality page, so that the acquisition image acquired by the acquisition component of the user terminal matches the image acquisition guidance template. If it is detected that the acquisition image matches the image acquisition guidance template, the multimodal sensor is called to perform multimodal data acquisition to obtain multimodal data.

[0018] For example, a template of an image acquisition guidance template for a leased item is displayed through an augmented reality page. If it is detected that the acquired image matches the image acquisition guidance template, the image acquisition component is called to acquire visible light images, the infrared acquisition component is called to acquire infrared radiation intensity, and the lidar system is called to acquire laser ranging distance.

[0019] The multimodal data in this embodiment includes data on the leased property in at least one dimension, obtained by collecting data from the leased property via at least one acquisition component. For example, the multimodal data may include images of the leased property collected by the image acquisition component and environmental perception data collected by the environmental perception component or environmental perception sensor. Optionally, the multimodal data includes images of the leased property and environmental perception data. The environmental perception data may include laser ranging distance and / or infrared radiation intensity. Optionally, the multimodal data includes at least one of the following: images of the leased property collected by the image acquisition component, infrared radiation intensity collected by an infrared sensor or infrared acquisition component, and laser ranging distance collected by a laser ranging (LiDAR) system.

[0020] In order to improve the validity of the obtained multimodal data during the display of the template for guiding the image acquisition of the leased property through the augmented reality page, in an optional implementation provided by this embodiment, the display of the template for guiding the image acquisition of the leased property through the augmented reality page can be implemented in the following manner: Acquire an initial image of the leased property captured by the image acquisition component, and perform region matching based on the initial image to obtain a capture region; The image acquisition guidance template corresponding to the acquisition area is read and displayed through the augmented reality page.

[0021] Specifically, first obtain the initial image of the leased property captured by the image capture component, then perform area matching based on the initial image to obtain the capture area of ​​the leased property, and then read the image capture guidance template corresponding to the capture area and display it through the augmented reality page. Among them, the image capture guidance template is used to guide the leased user to perform image capture according to the image capture guidance boundary; for example, guide the leased user to perform image capture by adjusting the distance or angle between the user terminal and the leased property. It should be noted that the image capture guidance template in this embodiment can be replaced with an acquisition guidance template, and accordingly, the features related to the image capture guidance template can be replaced with features related to the acquisition guidance template. For example, the image capture guidance template for image capture can be replaced with an acquisition guidance template for data capture.

[0022] For example, the initial image of the rental vehicle captured by the image acquisition component is obtained, and region matching is performed based on the initial image to obtain that the acquisition region is the tire region. The image acquisition guidance template corresponding to the tire region is read and displayed through the augmented reality page.

[0023] In addition, after acquiring the initial image of the leased property, damage identification and feature extraction can be performed on the initial image to obtain the initial damage features in the initial image. The image acquisition guidance template corresponding to the initial damage features and / or acquisition area can be read and displayed on an augmented reality page. The initial damage features can include damage length and / or damage area.

[0024] It should be noted that the above-mentioned data collection process can be implemented through a user terminal or through the cooperation between the user terminal and the server (leasing service platform). In the process of cooperation between the user terminal and the server, the user terminal captures an initial image of the leased property using an image acquisition component and then uploads the initial image to the server. The server obtains the initial image of the leased property uploaded by the user terminal, performs region matching based on the initial image to obtain a capture region and / or performs damage identification and feature extraction on the initial image to obtain initial damage features in the initial image. The server then reads the image capture guidance template corresponding to the capture region and / or initial damage features and returns it to the user terminal. The user terminal receives the image capture guidance template and displays it through an augmented reality page. In addition, after obtaining the initial image, the server may input the initial image into a template determination model to perform template determination, obtain an image capture guidance template, and send it to the user terminal. The template determination model may be a pre-trained model for template determination. During the template determination process, the template determination model may first perform region matching based on the initial image to obtain a capture region and / or perform damage identification and feature extraction on the initial image to obtain initial damage features in the initial image. Then, the server reads and outputs the image capture guidance template corresponding to the capture region and / or initial damage features.

[0025] In specific implementations, after a rental item is damaged or discovered, the rental user can use the rental subroutine to call the augmented reality interface to collect data on the rental item corresponding to the rental order in the rental state to obtain multimodal data. In order to enhance the rental user's perception and avoid identifying historical damage to the rental item as damage caused by the current rental user, this embodiment provides an optional implementation method. After obtaining the multimodal data of the rental item, the pre-stored image corresponding to the image acquisition guidance template for image acquisition is read, and the rental item image and the rental item parts in the pre-stored image are compared. If there is a discrepancy, the following step S204 is executed to perform damage identification based on the multimodal data to obtain the rental item damage and extract the damage characteristics of the rental item damage. Optionally, the pre-stored image can be read from the blockchain. In this embodiment, relevant data, such as pre-stored images, equity write-off records, etc., can be uploaded to the blockchain for storage to ensure that the data is not tampered with.

[0026] During the specific execution process, after obtaining the multimodal data of the leased property, the leased property image in the multimodal data and the pre-stored image corresponding to the image acquisition guidance template used to acquire the leased property image are compared. If they are consistent, it means that the leased property user has not caused damage to the leased property and no processing is required. If they are inconsistent, it means that the leased property user has caused damage to the leased property. Damage identification is then performed based on the multimodal data to obtain the damage to the leased property and the damage characteristics of the leased property are extracted.

[0027] In addition to obtaining multimodal data obtained by the leasing user through the leasing subroutine calling the augmented reality interface to collect data on the leased item corresponding to the leased order in the leased state when the leased item is damaged or damaged, it is also possible to obtain multimodal data obtained by the leasing user through the leasing subroutine calling the augmented reality interface to collect data on the leased item corresponding to the leased order in the leased state when the leased item is returned, or to obtain multimodal data obtained by the leasing user through the leasing subroutine calling the augmented reality interface to collect data on the leased item corresponding to the leased order in the to-be-returned state; wherein, if the leasing user submits a return request for the lease order but has not yet completed the return, the lease order is in the to-be-returned state; specifically, based on the leasing user's return request for the leased item, multimodal data obtained by the leasing user through the leasing subroutine calling the augmented reality interface to collect data on the leased item is obtained; in addition, the leased order in the to-be-returned state can be updated.

[0028] In addition, step S202 can be replaced by obtaining multimodal data obtained by the leasing user through the leasing subroutine calling the augmented reality interface to collect data on the leased item, or obtaining multimodal data obtained by the leasing user through the leasing subroutine calling the augmented reality interface to collect data on the leased item corresponding to the leasing order, and forming a new implementation method together with other processing processes provided in this embodiment.

[0029] Step S204: performing damage identification based on the multimodal data to obtain damage to the leased property, and extracting damage features of the damage to the leased property.

[0030] In specific implementation, after obtaining multimodal data including images of leased items and environmental perception data obtained by the lease user through calling the augmented reality interface to collect data on the leased items corresponding to the leased order in the leased status, damage identification is performed based on the multimodal data to obtain damage to the leased items, and damage features of the damage to the leased items are extracted. The following specifically describes the processes of obtaining damage to the leased items and extracting damage features of the damage to the leased items based on the multimodal data.

[0031] 1. Damage identification based on multimodal data to obtain damage to leased property In a specific implementation, in order to improve the accuracy of the obtained damage to the leased property, in an optional implementation provided in this embodiment, during the process of obtaining the damage to the leased property through damage identification based on multimodal data, the following operations are performed: Perform damage identification based on the leased item image to obtain the initial damage; The initial damage is effectively detected based on the environmental perception data, and the initial damage that passes the effective detection is determined as damage to the leased property.

[0032] During the specific implementation process, damage identification is performed based on the image of the leased property to obtain initial damage. In order to improve the accuracy of the determined damage to the leased property, the initial damage is effectively detected based on the environmental perception data, and the initial damage that passes the effective detection is determined as the damage to the leased property; for the initial image that fails the effective detection, no processing is required.

[0033] The environmental perception image in this embodiment may include laser ranging distance and infrared radiation intensity. Based on this, in the process of effectively detecting initial damage according to environmental perception data, it is possible to detect whether the height difference between the initial damaged area and the remaining area in the virtual model of the leased property obtained by model generation based on the laser ranging data meets the corresponding height condition, and / or, detect whether there is a temperature difference between the initial damaged area and the remaining area in the infrared thermal imaging image obtained by image generation based on the infrared radiation intensity; if so, it is determined that the effective detection of the initial damage has passed.

[0034] Specifically, stains on the leased property may be identified as damage to the leased property, but generally the height of the damage to the leased property will not change, while stains will cause the height to change. The change may be that the height of the damaged area of ​​the leased property is greater than the height of the remaining area. Therefore, for laser ranging data, a three-dimensional model of the leased property can be first generated based on the laser ranging data, and then the three-dimensional model can be tested to see whether there is a height difference between the initial damaged area and the remaining area and whether the height difference is positive (i.e., the height of the damaged area is greater than the height of the remaining area or whether there is a positive height difference between the initial damaged area and the remaining area); if so, it is determined that the height detection has failed; if not, it is determined The height detection passed; in addition to the laser ranging data, in different environments, the collected images of the leased objects may cause errors in damage identification due to the influence of weather, etc. Therefore, the environmental perception image may also include infrared radiation intensity. For the infrared radiation intensity, the image can be first generated according to the infrared radiation intensity to obtain infrared thermal imaging, and then it is detected whether there is a temperature difference between the initial damage area and the remaining area in the infrared thermal imaging; if so, it is determined that the temperature detection passed; if not, it is determined that the temperature detection failed; when the height detection passed and / or the temperature detection passed, it is determined that the effective detection of the initial damage passed, otherwise it is determined that the effective detection of the initial damage failed.

[0035] It should be noted that for some leased items, cleaning them after stains are caused will also cost a lot of time and money. Therefore, in this embodiment, the damage to the leased items may include not only structural damage or functional abnormality of the leased items caused by external or internal reasons, but also contamination of the leased items, such as stains. In the case where the damage to the leased items is contamination of the leased items, this embodiment provides an optional implementation. In the process of obtaining the damage to the leased items by performing damage identification based on multimodal data, contamination identification may be performed based on the leased item image in the multimodal data to obtain the contamination of the leased items. That is, obtaining the damage to the leased items by performing damage identification based on the multimodal data may also be replaced by obtaining the contamination of the leased items by performing contamination identification based on the leased item image in the multimodal data. The damage to the leased items in this embodiment may be replaced by contamination of the leased items, and correspondingly, the relevant features of the damage to the leased items may also be replaced by the relevant features of the contamination of the leased items, for example, the damage feature may be replaced by the contamination feature.

[0036] 2. Extracting Damage Characteristics of Leased Property In specific implementation, after damage identification is performed based on multimodal data to obtain damage to the leased property, the damage to the leased property is described by extracting damage features of the damage to the leased property, thereby improving the convenience of subsequent detection of whether the rights and interests conditions for repair exemption benefits are triggered; optionally, the damage features of the damage to the leased property in this embodiment include at least one of the following: damage location features obtained by damage location identification based on visible light images in multimodal data, damage length features obtained by damage length identification based on visible light images, damage material category features obtained by material category identification based on visible light images and infrared radiation intensity, and damage depth features obtained by depth identification based on visible light images and laser ranging distance. Specifically, in the process of extracting damage features of the damage to the leased property, damage location features can be obtained by damage location identification based on visible light images, material category features can be obtained by material category identification based on visible light images and infrared radiation intensity, damage length features can be obtained by damage length identification based on visible light images, and / or damage depth features can be obtained by depth identification based on visible light images and laser ranging distance.

[0037] It should be noted that the above description of damage characteristics is merely exemplary and may also be other characteristics obtained based on multimodal data identification, which may be configured according to actual needs and is not limited in this embodiment; and the above multimodal data is also merely exemplary. Multimodal data may include any one of visible light images, laser ranging data, and infrared radiation intensity, or a combination of any two or three, and may also include other data, which may be configured according to actual needs and is not limited in this embodiment.

[0038] In this embodiment, in order to improve the efficiency of damage feature extraction, in an optional implementation provided by this embodiment, the following operations may be performed during the process of extracting damage features of damage to the leased property: Identify the damaged parts of the leased property based on the image of the leased property; Match the damaged parts with the set of exempted parts in the repair exemption rights; When the parts are matched successfully, the damage features of the leased object are extracted based on the leased object image and environmental perception data.

[0039] Specifically, to improve the efficiency of damage detection, when extracting damage features of leased property damage, the first step is to detect whether the damaged location of the leased property matches the exempted location in the repair exemption benefit set. If so, it is preliminarily determined that damage detection can be performed based on the repair exemption benefit, and the damage features of the leased property damage are extracted based on the leased property image and environmental perception data. If not, it is determined that damage detection cannot be performed based on the repair exemption benefit, and no processing is performed or damage features of the leased property damage are extracted. The cost of damage repair is estimated based on the damage features to obtain an estimated cost, and a damage repair reminder including the estimated cost is generated. Optionally, the damage location is obtained based on leased property image recognition.

[0040] For example, to identify scratches on a rental vehicle, based on the visible light image of the rental vehicle, it is identified that the scratches are on the door of the rental vehicle, and it is detected whether the set of exempted parts in the repair exemption rights associated with the rental order corresponding to the rental vehicle includes the door; if so, it is determined that the part match is successful, and the damage length is identified based on the visible light image to obtain the scratch length, and the material category is identified based on the visible light image and infrared radiation intensity to obtain the damage material category feature, and / or, the depth is identified based on the visible light image and laser ranging distance to obtain the damage depth feature as the damage feature.

[0041] The above provides a method for first performing location matching on the damaged part. If the location matching is successful, damage features of the damaged leased item are extracted based on the leased item image and environmental perception data. In addition, after each damage feature is extracted, feature matching is performed on the damage feature with the corresponding repair exemption feature in the repair exemption benefit. If the feature match is successful, the next damage feature is extracted. If each damage feature is successfully matched, the entitlement condition for triggering the repair exemption benefit by the damage to the leased item is determined. In other words, the extraction of damage features of the damaged leased item and the detection of whether the damage to the leased item triggers the entitlement condition for the repair exemption benefit associated with the lease order based on the damage features can be executed cyclically. For example, damage site identification is performed based on visible light images in multimodal data to obtain damage site features; Match the damaged part characteristics with the set of exempted parts in the repair exemption rights; If the part matching is unsuccessful, confirm that the damage to the leased property does not trigger the conditions for the repair exemption benefit; When the parts are matched successfully, the damage length is identified based on the visible light image to obtain the damage length feature; Match the damage length characteristics with the exemption length threshold in the repair exemption benefit; If the length match fails, determine that the damage to the leased property does not trigger the conditions for the repair exemption benefit; When the length matching is successful, the material category is identified based on the visible light image and infrared radiation intensity to obtain the damaged material category features; Match the damaged material category characteristics with the exempted material category set in the repair exemption benefit; If the material category matching fails, confirm that the damage to the leased property does not trigger the conditions for the repair exemption benefit; When the material category is successfully matched, depth recognition is performed based on the visible light image and laser ranging distance to obtain the damage depth characteristics; Perform deep matching between the damage depth characteristics and the exemption depth threshold in the repair exemption rights; If the deep match is unsuccessful, determine that the damage to the leased property does not trigger the rights and interests conditions for the repair exemption rights; In the event of a successful deep match, the rights and interests conditions for damage to the leased property to trigger the repair exemption rights and interests will be determined.

[0042] The above uses the four damage characteristics of damage location characteristics, damage length characteristics, damage material category characteristics and damage depth characteristics as examples to illustrate the feature extraction and the detection of the rights and interests conditions for triggering the maintenance exemption rights. It should be noted that in the process of feature extraction, any one or more of them can be extracted according to actual needs for feature extraction, and in the process of detecting whether the rights and interests conditions for triggering the maintenance exemption rights can be selected for implementation according to actual needs; or, any combination of implementation methods can be carried out according to actual needs, and in the process of combining the above-provided implementation methods, the implementation methods can also be adaptively adjusted according to actual needs. Specifically, the four damage characteristics provided above can be combined according to actual needs. Correspondingly, the detection of whether the rights and interests conditions for the maintenance exemption rights are triggered is carried out by adding, deleting or adjusting features, for example, matching the damage part features with the set of exemption parts in the maintenance exemption rights; if the part matching is unsuccessful, determining that the damage to the leased property does not trigger the rights and interests conditions for the maintenance exemption rights; if the part matching is successful, the damage length features are obtained by identifying the damage length based on the visible light image; matching the damage length features with the exemption length threshold in the maintenance exemption rights; if the length matching is unsuccessful, determining that the damage to the leased property does not trigger the rights and interests conditions for the maintenance exemption rights; if the length matching is successful, determining that the damage to the leased property triggers the rights and interests conditions for the maintenance exemption rights.

[0043] In the process of extracting damage features of leased property damage, in addition to using the damage location as an access condition and extracting damage features based on multimodal data to obtain damage features when the damage location of the leased property successfully matches the set of exempted parts in the repair exemption benefit, the material category of the leased property can also be used as an access condition and extracting damage features based on multimodal data to obtain damage features when the material category of the leased property matches the exempted material category in the repair exemption benefit. In an optional implementation provided by this embodiment, taking leased goods as an example, the process of extracting damage features of leased property damage is implemented in the following manner: Identify the material category of the leased goods based on the visible light image and infrared radiation intensity of the leased goods; Check whether the product material category matches the exempted material category set in the repair exemption benefit; If so, the damage area characteristics are identified based on the visible light image.

[0044] Specifically, first, the material category is identified based on the visible light image and infrared radiation intensity of the leased product to obtain the material category of the product. If the material category of the product matches the set of exempted material categories in the maintenance exemption rights, that is, the set of exempted material categories contains the material category of the product, feature extraction is performed based on the multimodal data to obtain the damage characteristics of the damage to the product. In the process of extracting features based on the multimodal data to obtain the damage characteristics of the damage to the product, the damage area characteristics can be identified based on the visible light image. In addition to the damage area characteristics, the damage location characteristics, damage length characteristics and / or damage depth characteristics can also be obtained, which are not limited in this embodiment. If the material category of the product does not match the set of exempted material categories in the maintenance exemption rights, it is determined that the damage to the leased item has not triggered the rights and interests conditions of the maintenance exemption rights.

[0045] It should be noted that the process of extracting damage characteristics of leased property damage using the material category of the leased property as an access condition is similar to the above-mentioned process of extracting damage characteristics of leased property damage using the damaged location as an access condition. The relevant content in the above-mentioned process of extracting damage characteristics of leased property damage using the damaged location as an access condition can be combined with the process of extracting damage characteristics of leased property damage using the material category of the leased property as an access condition in any implementation method according to actual needs; for example, when it is detected that the damaged location of the leased property matches the set of exempted locations in the repair exemption rights, and the material category of the leased property matches the exempted material category in the repair exemption rights, feature extraction of the leased property damage is performed based on multimodal data to obtain damage characteristics.

[0046] It should also be noted that the damage characteristics may also include commodity material category characteristics. Correspondingly, the material category is identified based on the visible light image and infrared radiation intensity of the leased commodity to obtain the commodity material category characteristics; the commodity material category characteristics are matched with the set of exempted material categories in the repair exemption rights and interests. If the material category match is successful, it is determined that the damage to the leased item triggers the rights and interests conditions of the repair exemption rights and interests or the next feature match is executed; if the material category match is unsuccessful, it is determined that the damage to the leased item does not trigger the rights and interests conditions of the repair exemption rights and interests.

[0047] In addition to the above-mentioned method of extracting damage characteristics of leased property based on multimodal data, damage characteristics of leased property can also be extracted based on the leased property category and multimodal data; specifically, the leased property category is identified based on multimodal data to obtain the leased property category; the damage feature identifier corresponding to the leased property category is read, and the damage features corresponding to each damage feature identifier are extracted based on the damage feature identifier and multimodal data.

[0048] Alternatively, damage characteristics of the leased item can be extracted based on the material category and multimodal data. Specifically, the material category is first identified based on the multimodal data to obtain the leased item's material category. The corresponding damage characteristic identifier is then read. Based on the damage characteristic identifier and the multimodal data, the damage characteristics corresponding to each damage characteristic identifier are extracted. For example, the damage characteristic identifier corresponding to a leather leased item includes damage length and / or damage depth; the damage characteristic identifier corresponding to a cotton leased item includes damage area.

[0049] Step S206: detecting whether the damage to the leased item triggers a benefit condition of a repair exemption benefit associated with the lease order based on the damage characteristics.

[0050] During specific implementation, after damage identification is performed based on multimodal data to obtain damage to the leased property and damage features of the damage to the leased property are extracted, it is detected based on the damage features whether the damage to the leased property triggers the rights and interests conditions of the repair exemption rights and interests; during the specific execution process, it is detected based on the damage features whether the damage to the leased property triggers the rights and interests conditions of the repair exemption rights and interests associated with the lease order. Optionally, the repair exemption rights and interests are associated with the lease order when the order is created. Specifically, after obtaining the damage features, it is possible to first detect whether the lease order is associated with the repair exemption rights and interests. If so, it is detected based on the damage features whether the damage to the leased property triggers the rights and interests conditions of the repair exemption rights and interests. If not, the following related processes can be executed if the detection result is not triggered.

[0051] In this embodiment, in order to improve the lessee's perception of the leased property, the lessee may be exempted from paying for repairs for normal wear and tear of the leased property during use, or for damage to the leased property that does not significantly impact the leased property. In this embodiment, the lessee may be exempted from paying for repairs for damage to the leased property within a certain range through the use of a repair exemption benefit. In order to effectively manage the damage to the leased property for which the lessee is exempt from deductible, the rights and interests conditions of the repair exemption benefit can be configured to determine that the lessee is exempt from deductible for the damage to the leased property when the damage to the leased property triggers the rights and interests conditions; the rights and interests conditions in this embodiment include preset restrictions on the deductible damage to the leased property; for example, the rights and interests conditions of the repair exemption benefit are that a scratch smaller than 3 cm on the door of a vehicle is considered as deductible damage to the leased property, or that a stain smaller than 2 square centimeters on a leather product is considered as deductible damage to the leased property.

[0052] In order to enhance the user's perception of the rental service, the maintenance exemption rights may be issued to the rental user after the rental user rents the rental item, that is, the maintenance exemption rights may be associated with the rental order when the rental order is created; specifically, if it is detected that the rental user selects the rental item in the rental item list and submits the rental request, a rental order is created based on the rental user and the selected rental item, and the maintenance exemption rights corresponding to the rental item are associated with the rental order; for example, if the rental item is a rental vehicle, after the rental user creates a rental order for the rental vehicle, the maintenance exemption rights corresponding to the rental vehicle are associated with the rental order; for another example, if the rental item is a rental commodity, after the rental user creates a rental order for the rental commodity, the maintenance exemption rights corresponding to the rental commodity are associated with the rental order.

[0053] In actual applications, since the leased property belongs to the lease provider, whether the corresponding maintenance exemption rights can be associated with the lease order requires the lease provider to authorize the exemption rights; optionally, the lease provider can obtain the maintenance exemption rights by authorizing the exemption rights from the lease service provider. Specifically, in the process of obtaining the lease information provided by the lease provider, the rights and interests conditions are read according to the lease category provided by the lease provider, and the rights and interests conditions that match the lease provided by the lease provider are obtained and sent to the lease provider. If it is detected that the lease provider has authorized the exemption of rights based on the rights and interests conditions, the corresponding maintenance exemption rights of the lease provider are generated, and the maintenance exemption rights and interests are associated with the provider identification and / or lease information of the lease provider and stored; after a rental order for the lease provided by the lease provider is created, the maintenance exemption rights and interests are associated with the lease order based on the association between the provider identification and / or lease information and the maintenance exemption rights and interests; or, the provider identification and / or lease information of the lease provider are associated with the exemption of rights and interests authorization result of the rights and interests conditions and stored. After a rental order for the lease provided by the lease provider is created, the maintenance exemption rights and interests are generated and associated with the lease order based on the association between the provider identification and / or lease information and the exemption of rights and interests.

[0054] It should be noted that the rights and interests conditions can be provided by the leasing service provider, and the rights and interests conditions that match the leasing provider are sent to the leasing provider. After obtaining the rights and interests authorization result of the leasing provider based on the synchronization of the rights and interests conditions, the corresponding maintenance exemption rights and interests of the leasing provider are generated; optionally, the maintenance exemption rights and interests corresponding to the leasing providers of the same type are the same; for example, the maintenance exemption rights and interests corresponding to different vehicle providers are the same. In addition, the rights and interests conditions can also be provided by the leasing provider. Specifically, the lease information and / or rights and interests conditions provided by the leasing provider are obtained, and the maintenance exemption rights and interests corresponding to the leasing provider are generated according to the rights and interests conditions, and the maintenance exemption rights and interests are associated with the provider identification and / or lease information of the leasing provider and stored; optionally, the maintenance exemption rights and interests corresponding to the leasing provider are different. Alternatively, the leasing provider can provide different rights and interests conditions for different leases. Optionally, the maintenance exemption rights and interests corresponding to each lease provided by the leasing provider are different.

[0055] The repair exemption benefit in this embodiment can be replaced by the damage exemption benefit. Correspondingly, when the repair exemption benefit is replaced by the damage exemption benefit, the characteristics related to the repair exemption benefit can also be replaced by the characteristics related to the damage exemption benefit. In addition, the repair exemption benefit can also be replaced by the deductible guarantee. Correspondingly, the relevant characteristics of the repair exemption benefit can also be replaced by the relevant characteristics of the deductible guarantee. For example, the benefit condition can be replaced by the guarantee condition, which is not limited in this embodiment.

[0056] In specific implementation, whether damage to the leased item triggers the entitlement conditions of the repair exemption benefit associated with the lease order is detected based on the damage characteristics. If the detection result is triggered, the following step S208 is executed to estimate the cost of the damage repair based on the damage characteristics to obtain an estimated cost, and generate an entitlement write-off result including the estimated cost. In the process of detecting whether damage to the leased item triggers the entitlement conditions of the repair exemption benefit associated with the lease order based on the damage characteristics, the damage characteristics are matched with the corresponding repair exemption characteristics in the repair exemption benefit. If the match is successful, it is determined that the entitlement conditions of the repair exemption benefit are triggered. If the match is unsuccessful, it is determined that the entitlement conditions of the repair exemption benefit are not triggered. In an optional implementation manner provided by this embodiment, if the leased item is a leased vehicle and the damage characteristics include damage location characteristics and damage length characteristics, in the process of detecting whether damage to the leased item triggers the entitlement conditions of the repair exemption benefit associated with the lease order based on the damage characteristics, the following operations are performed: Read the maintenance exemption characteristics of the maintenance exemption benefit; Check whether the damaged part characteristics of the rental vehicle are in the exempted part set, and whether the damaged length characteristics are less than the exempted length threshold; if so, determine that the detection result is triggered.

[0057] Optionally, the repair exemption feature includes an exemption part set and an exemption length threshold. If the damage part feature is within the exemption part set, the part match is determined to be successful; otherwise, the part match is determined to be unsuccessful. If the damage length feature is less than the exemption length threshold, the length match is determined to be successful; otherwise, the length match is determined to be unsuccessful.

[0058] During the specific implementation process, if the damage part characteristics of the rental vehicle successfully match the parts of the exemption part set of the repair exemption rights, and the damage length characteristics successfully match the length of the exemption length threshold of the repair exemption rights, the detection result is determined to be triggered, otherwise the detection result is determined to be not triggered.

[0059] In another optional implementation provided by this embodiment, when the leased item is a rental commodity and the damage characteristics include damage area characteristics, in the process of detecting whether the damage to the leased item triggers the rights and interests conditions of the repair exemption rights associated with the rental order based on the damage characteristics, the following operations are performed: Read the exemption area threshold in the maintenance exemption benefit; When the damage area characteristic of the damage to the leased property is smaller than the exemption area threshold, the detection result is determined to be triggered.

[0060] Specifically, if the damage area characteristic of the damage to the leased property is smaller than the exemption area threshold in the repair exemption benefit, it is determined that the damage to the leased property triggers the benefit condition of the repair exemption benefit associated with the lease order.

[0061] In specific implementation, damage characteristics are used to detect whether damage to the leased item triggers the rights and interests of the repair exemption benefits associated with the lease order. If the detection result is not triggered, it means that the lessee cannot obtain a repair exemption for the damage to the leased item based on the repair exemption benefits, that is, the lessee cannot be exempted from compensation for the damage to the leased item. In this case, a cost estimate can be obtained based on the damage characteristics, and a repair suggestion can be generated based on the damage characteristics. A damage repair reminder containing the estimated cost and repair suggestion is generated. During the specific execution process, when generating maintenance suggestions based on damage characteristics, the corresponding maintenance suggestions can be queried based on the damage characteristics, and the service interface of the vehicle provider can be called with the damage characteristics as input parameters to generate maintenance suggestions, and the maintenance suggestions returned by the interface call can be obtained. In addition, maintenance suggestions can be generated according to a pre-configured maintenance suggestion generation method, or the damage characteristics can be input into a maintenance suggestion generation model to generate maintenance suggestions to obtain maintenance suggestions, or the damage characteristics and maintenance suggestion generation prompt words can be input into a large language model to generate maintenance suggestions to obtain maintenance suggestions; this embodiment is not limited here. Among them, the maintenance suggestion generation prompt words are used to instruct the large language model to generate maintenance suggestions based on the damage characteristics. The specific process of estimating costs based on damage characteristics to obtain estimated costs can refer to the relevant content of the following step S208.

[0062] It should be noted that in order to enhance the rental user's awareness of damage to the leased property, after a damage repair reminder is generated, the damage repair reminder and the damage location information of the damaged leased property can be returned to the rental user's user terminal, so that the damage to the leased property can be marked on the augmented reality page based on the damage location information, allowing the rental user to perceive the damage to the leased property based on the augmented reality page; in addition, the damage repair reminder can also be displayed based on the augmented reality page, allowing the rental user to perceive the specific information of the damage repair.

[0063] It should also be noted that in addition to returning damage repair reminders and damage location information of the leased item to the user terminal at the same time, the damage location information can also be determined after damage identification is performed to obtain damage to the leased item and returned to the user terminal, so that the damage to the leased item can be marked on the augmented reality page based on the damage location information, so that the rental user can perceive the damage to the leased item based on the augmented reality page.

[0064] If the detection result is not triggered, in order to improve the rental user's perception of the rental service and save the user's money, it is possible to detect whether the damage to the leased item triggers the maintenance guarantee item associated with the rental order based on the damage characteristics; if so, make a guarantee application (claim application); if not, do not process it or generate a damage repair reminder containing estimated costs and repair suggestions and return it to the user terminal.

[0065] In this embodiment, the maintenance guarantee item can be purchased by the leasing service provider from the insurance agency when creating a rental order and associated with the rental order. The maintenance guarantee item is provided by the insurance agency and, after purchasing the maintenance guarantee item for the leased item, is associated with the leased item's rental order. The maintenance guarantee item can be the policyholder of the leasing service provider and the leased item as the insured. Specifically, upon detecting that the leasing user has selected a leased item from the leased item list and submitted a rental request, the leasing service provider's service provider information and the leased item's leased item information are read, and the service provider information, leased item information, and insurance item information are sent to the insurance agency for insurance processing. Upon receiving the insurance participation information returned by the insurance agency after the insurance processing is completed, a rental order for the leasing user for the leased item is created, and the maintenance guarantee item is associated with the leasing order based on the insurance participation information. If the policyholder of the maintenance guarantee item is the leasing service provider, the leasing service provider pays the insurance premium. Optionally, the insurance item information includes insurance item information for the maintenance guarantee item that matches the leased item in the candidate insurance item list, or insurance item information for a pre-selected maintenance guarantee item.

[0066] In addition, the maintenance guarantee project can also be a project with the leasing user as the insured and the leased item as the insured; specifically, if it is detected that the leasing user selects the leased item in the leased item list and submits a lease request, the user information of the leasing user and the leased item information of the leased item are read, and the user information, leased item information and insurance item information are sent to the insurance agency for insurance processing, and the insurance participation information returned by the insurance agency after the insurance processing is completed is received, and a rental order for the leased item by the leasing user is created and the maintenance guarantee project is associated with the leasing order based on the insurance participation information; for example, if it is detected that the leasing user selects the leased item in the leased item list and the maintenance guarantee project in the candidate insurance project list, on the one hand, a rental order for the leased item by the leasing user is created, and on the other hand, insurance processing is performed based on the user information, leased item information and insurance item information to obtain insurance participation information; further, the maintenance guarantee project is associated with the leasing order based on the insurance participation information. In the case where the insured of the maintenance guarantee project is the leasing user, the leasing user can pay the insurance premium; that is, the maintenance guarantee project associated with the leasing order can be purchased by the leasing user; Alternatively, if the insured of the maintenance guarantee project is the leasing user, the leasing service provider may pay the insurance premium during the process of the insurance agency handling the insurance; that is, the maintenance guarantee project associated with the leasing order may be a gift from the leasing service provider to the leasing user.

[0067] During the specific process of applying for protection, protection application information containing at least damage characteristics and protection participation information for the repair protection item can be generated and sent to the protection agency providing the repair protection item for claim processing. During this process, it is also possible to not perform trigger detection for the repair protection item, and the protection agency can perform the trigger detection for the repair protection item. Specifically, if the detection result is not triggered, the protection participation information of the repair protection item associated with the rental order is read, and protection application information containing at least damage characteristics and protection participation information is generated and sent to the protection agency of the repair protection item; the protection agency detects whether the damage to the leased item triggers the repair protection item based on the damage characteristics; if so, the claim is processed; if not, a matching failure result is returned; the server can generate a damage repair reminder based on the matching failure result returned by the protection agency and return it to the user terminal.

[0068] It should be noted that if damage to the leased item is detected based on the damage characteristics, triggering the maintenance guarantee item associated with the lease order, a maintenance guarantee reminder will be generated based on the maintenance participation information and damage characteristics of the maintenance guarantee item and returned to the user terminal for display on the augmented reality page. In this way, the leasing user's perception of the lease service and maintenance guarantee item will be enhanced, and the maintenance guarantee item can be recommended.

[0069] In addition, the estimated cost can also be used as a damage feature of the damage to the leased property. Specifically, in the process of extracting the damage feature of the damage to the leased property in step S204, the first damage feature of the damage to the leased property can be first extracted, and then the feature estimation is performed based on the first damage feature to obtain the second damage feature; further, step S206 can be replaced by detecting whether the damage to the leased property triggers the rights and interests of the maintenance exemption rights associated with the lease order based on the damage feature including the first damage feature and the second damage feature. Correspondingly, step S208 can be replaced by, if the detection result is triggered, generating a rights and interests write-off result including the damage feature, and forming a new implementation method with other processing steps or implementation methods provided in this embodiment. Among them, the above-mentioned related content can be used to extract the first damage feature of the damage to the leased property, and the feature estimation is performed based on the first damage feature according to the implementation method provided in the following step S208 to obtain the second damage feature, which will not be repeated in this embodiment. Among them, the second damage feature includes the estimated cost.

[0070] Step S208: If the detection result is triggered, the cost of damage repair is estimated based on the damage characteristics to obtain an estimated cost, and an equity write-off result including the estimated cost is generated.

[0071] In specific implementation, if damage to the leased property is detected based on the damage characteristics, triggering the rights and interests conditions of the repair exemption rights associated with the lease order, the cost of damage repair is estimated based on the damage characteristics to obtain the estimated cost, and the rights and interests write-off result including the estimated cost is generated.

[0072] In an optional implementation provided by this embodiment, in the process of estimating the cost of damage repair based on damage characteristics to obtain an estimated cost, the damage characteristics are used as input parameters to call the service interface of the lease provider to estimate the cost; and the estimated cost returned by the interface call is obtained.

[0073] In another optional implementation provided by this embodiment, when estimating the cost of damage repair based on damage characteristics to obtain an estimated cost, the unit repair cost for the leased item is queried based on the material category of the leased item; and the repair cost for the leased item is estimated based on the unit repair cost and the damage area characteristics. Taking leased items as an example, when estimating the cost of damage repair based on damage characteristics to obtain an estimated cost, the unit repair cost for the item is queried based on the material category of the item; and the repair cost for the leased item is estimated based on the unit repair cost and the damage area characteristics.

[0074] It should be noted that the above provides two processes for obtaining estimated costs by cost estimation. In the specific implementation process, any one of the two implementation methods provided above can be selected for implementation according to actual needs; or, any combination of implementation methods can be carried out according to actual needs, and in the process of combining the implementation methods provided above, the implementation methods can also be adaptively adjusted according to actual needs. Specifically, features of the four implementation methods provided above can be added, deleted or adjusted according to actual needs. For example, in the process of obtaining estimated costs by estimating the cost of damage repair based on damage characteristics, the service interface of the lease provider is called with the damage characteristics as input parameters to perform cost estimation, and obtain the first estimated cost returned by the interface call; the unit repair cost of the leased item is queried according to the material category of the leased item, and the second estimated cost of the leased item repair is estimated based on the unit repair cost and the damage area characteristics; the larger one of the first estimated cost and the second estimated cost is determined as the estimated cost.

[0075] During specific implementation, based on the estimated costs, a rights and interests write-off result including the estimated costs is generated; in order to enhance the leasing user's awareness of repair exemptions or damage deductibles, the rights and interests write-off result is returned to the user terminal so that the rights and interests write-off result can be displayed through an augmented reality page.

[0076] In this embodiment, in order to improve the perception of the leasing user, whether it is a damage repair reminder, a benefit write-off result, or a repair guarantee reminder returned to the user terminal, it can be returned to the user terminal together with the damage location information of the damaged leased property, so that the damage mark and corresponding reminder or result of the damaged leased property can be displayed on the augmented reality page based on the damage location information, so that the leasing user can perceive the damage to the leased property based on the augmented reality page, as well as the handling method of the damage to the leased property.

[0077] It should be noted that this embodiment provides multiple implementation methods, such as multiple feature extraction methods for extracting damage features of leased property, multiple detection methods for detecting whether damage to leased property triggers the rights and interests conditions for repair exemption rights, and multiple cost estimation methods. In the specific implementation process, any one of them can be selected for implementation according to actual needs; or, any implementation methods can be combined according to actual needs. Specifically, different implementation methods of the same processing process can be combined, and different implementation methods of different processing processes can be combined. In the process of combining the above-mentioned implementation methods, the implementation methods can also be adaptively adjusted according to actual needs, such as adding, deleting or adjusting features. This embodiment does not limit this.

[0078] In this embodiment, in addition to collecting data on the leased items corresponding to the rental orders in the leased state, the rental service provider may also collect data on the leased items corresponding to the rental orders in the returned state for further testing. In an optional implementation provided by this embodiment, the following operations may also be performed: Acquire multimodal data of leased items obtained by the leasing service provider calling the augmented reality interface to collect data on leased items corresponding to leased orders in the returned state; If the target damage feature obtained through damage identification and feature extraction based on the multimodal data of the leased item shows that the benefit condition has not been triggered, the target damage feature is used to detect whether it triggers the maintenance guarantee item associated with the lease order; If so, generate guarantee application information including at least target damage characteristics and guarantee participation information of the maintenance guarantee project and send it to the guarantee organization of the maintenance guarantee project.

[0079] Optionally, the maintenance guarantee project is linked to the rental order after the rental service provider submits the guarantee project participation to the guarantee organization.

[0080] Specifically, if the leasing service provider or the leasing service provider's service user acquires multimodal data of the leased item corresponding to the returned leasing order by calling an augmented reality interface through a service terminal, damage identification is performed based on the multimodal data of the leased item to obtain target damage, and target damage features of the target damage are extracted. Based on the target damage features, it is detected whether the target damage triggers the rights and interests conditions of the repair exemption rights and interests associated with the leasing order; if the detection result is triggered, no processing is performed or the cost of damage repair is estimated based on the damage features to obtain an estimated cost, and a rights and interests write-off result including the estimated cost is generated and returned to the user terminal of the leasing user; Alternatively, if the detection result is triggered, it is also possible to detect whether the maintenance exemption benefit associated with the rental order is in a write-off status; if so, no action is taken; if not, the maintenance exemption benefit is written off, and the cost of the damage repair is estimated based on the damage characteristics to obtain an estimated cost. A benefit write-off result including the estimated cost is generated and returned to the user terminal of the renter; optionally, the maintenance exemption benefit associated with the rental order is marked as written off after the benefit write-off is performed; If the detection result is not triggered, generate protection application information containing at least the target damage characteristics and the protection participation information of the maintenance protection project associated with the rental order and send it to the protection agency of the maintenance protection project; or, detect whether the target damage triggers the maintenance protection project associated with the rental order based on the target damage characteristics; if so, generate protection application information containing at least the target damage characteristics and the protection participation information of the maintenance protection project and send it to the protection agency of the maintenance protection project; if not, generate a damage repair reminder and return it to the user terminal.

[0081] Alternatively, if the detection result is not triggered, it is also possible to detect whether the maintenance guarantee item associated with the rental order carries a write-off mark (write-off status mark or write-off number mark); if so, no processing is required; if not, the maintenance guarantee item is written off (it can be a maintenance guarantee item write-off or an update of the maintenance guarantee number), and a maintenance guarantee reminder is generated based on the maintenance participation information and damage characteristics of the maintenance guarantee item and returned to the user terminal.

[0082] It should be noted that for the leased items corresponding to the rental orders in the returned state, the leasing service provider may collect data for further testing, which is similar to the above-mentioned related processes; please refer to the above-mentioned related content, and this embodiment will not be repeated here.

[0083] The inspection and processing method for leased property provided in this embodiment may be executed by an inspection model; the inspection model may include a damage identification module, a feature extraction module, a trigger detection module, and a result generation module; Among them, the damage identification module identifies damage based on multimodal data to obtain damage to the leased property; the feature extraction module extracts the damage features of the leased property; the trigger detection module detects whether the damage to the leased property triggers the rights and interests of the repair exemption associated with the lease order based on the damage features; the result generation module estimates the cost of damage repair based on the damage features to obtain the estimated cost when the detection result of the trigger detection module is triggered, and generates a rights and interests write-off result including the estimated cost.

[0084] In addition, the detection model may also include a category recognition module, which identifies the category of the leased item based on multimodal data to obtain the category of the leased item; the category recognition module can be deployed before the feature extraction module. After the category recognition module obtains the category of the leased item, the feature extraction module can read the damage feature identifier corresponding to the category of the leased item, and extract the damage features corresponding to each damage feature identifier based on the damage feature identifier and multimodal data.

[0085] During the specific execution process, after obtaining the multimodal data obtained by the leasing user through the leasing subroutine calling the augmented reality interface to collect data on the leased items corresponding to the leasing order in the leasing status, the server inputs the multimodal data into the detection model for detection and processing to obtain the rights and interests write-off results, damage repair reminders or maintenance guarantee reminders.

[0086] It should be noted that the processing module in the detection model in this embodiment is merely exemplary, and other modules may be configured according to actual needs to execute the relevant processes in the above content, such as the image comparison module, which compares the image of the leased item with the pre-stored image corresponding to the image acquisition guidance template for image acquisition of the leased item; this embodiment will not be repeated here; and this embodiment does not limit the execution order between modules.

[0087] In addition, steps S206 to S208 can also be replaced by: if damage to the leased property is detected based on the damage characteristics, triggering the rights and interests conditions of the repair exemption rights associated with the lease order, the cost of damage repair is estimated according to the damage characteristics to obtain the estimated cost, and the rights and interests write-off result including the estimated cost is generated, and together with the other processing steps provided in this embodiment, a new implementation method is formed.

[0088] In summary, the detection and processing method for leased items provided in this embodiment obtains multimodal data obtained by the lease user through the lease subroutine calling the augmented reality interface to collect data on the leased items corresponding to the lease order during the detection and processing of the leased items. In this way, by introducing multimodal data, the comprehensiveness of the collected data is improved, and thus the accuracy of subsequent processing is improved; after obtaining the multimodal data, the pre-stored image corresponding to the image acquisition guidance template for image acquisition of the leased item in the multimodal data is read, and the leased item image and the leased item in the pre-stored image are compared; if they are consistent, no processing is performed; if they are inconsistent, subsequent processing is performed, thereby avoiding the determination of historical leased item damage by comparing the pre-stored images. The current leasing users lead to distrust among leasing users, and the perception of leasing users is improved; first, damage identification is performed based on multimodal data to obtain damage to the leased property, and feature extraction is performed based on the multimodal data to obtain damage features of the leased property damage, and then based on the damage features, it is detected whether the damage to the leased property triggers the rights and interests conditions of the repair exemption rights associated with the lease order; if so, the cost of damage repair is estimated based on the damage features to obtain the estimated cost, and the rights and interests write-off result including the estimated cost is generated and returned to the user terminal, so that the leasing users can perceive the cost savings and improve the leasing users' perception of the leasing service (leasing subroutine); by associating the repair exemption rights and interests with the lease order, the repair exemption rights and interests can be flexibly configured.

[0089] The following is an example of an application of a detection and processing method for leased items provided by this embodiment in a rental vehicle detection scenario to further illustrate the detection and processing method for leased items provided by this embodiment. Figure 3 As shown, the detection and processing method for leased objects applied to the rental vehicle detection scenario specifically includes the following steps.

[0090] Step S302: obtaining multimodal data obtained by the rental user through the rental subroutine calling the augmented reality interface to collect data on the rental vehicle corresponding to the rental order in the rental status.

[0091] Step S304 : Read the corresponding pre-stored image according to the visible light image in the multimodal data, and compare the vehicle area in the visible light image with the pre-stored image.

[0092] Step S306: If the comparison is inconsistent, damage identification is performed based on the visible light image to obtain vehicle damage.

[0093] Step S308 , generating a model based on the laser ranging distance in the multimodal data to obtain a three-dimensional vehicle model, and detecting whether there is a positive height difference between the initial damaged area and the remaining area in the three-dimensional vehicle model.

[0094] Step S310 : If there is no positive height difference, identify the characteristics of the damaged part of the vehicle in the rental vehicle based on the visible light image.

[0095] Step S312: Part matching is performed between the damaged part characteristics and the set of exempted parts in the repair exemption rights and interests associated with the rental order.

[0096] Step S314: When the part matching is successful, damage length identification is performed based on the visible light image to obtain damage length features.

[0097] Step S316: Match the damage length feature with the exemption length threshold in the repair exemption benefit.

[0098] Step S318: If the length matching is successful, the vehicle provider's service interface is called to perform cost estimation using the damage location feature and the damage length feature as input parameters.

[0099] In step S320 , the maintenance exemption benefit is written off, and a benefit writing-off result including estimated costs is generated and sent to the user terminal for display through an augmented reality page.

[0100] It should be noted that any one of steps S302 to step S320 or any combination of multiple steps can be combined with any one of steps S202 to step S208 to form a new implementation method according to the needs of implementation deployment; in addition, according to the needs of actual deployment, any one or multiple technical features can be selected from steps S302 to step S320 and combined with any one or multiple technical features provided by steps S202 to step S208 to form a new implementation method; or, any one or multiple technical features in steps S302 to step S320 can also be replaced by any one or multiple technical features provided by steps S202 to step S208 to form a new implementation method according to the needs of actual deployment, which will not be repeated here.

[0101] The following uses the application of the detection and processing method for leased items provided by this embodiment in the detection scenario of leased goods as an example to further illustrate the detection and processing method for leased items provided by this embodiment. Figure 4 As shown, the detection and processing method for leased items applied to the leased goods detection scenario specifically includes the following steps.

[0102] Step S402: obtaining multimodal data obtained by the rental user through the rental subroutine calling the augmented reality interface to collect data on the rental products corresponding to the rental order in the rental status.

[0103] Step S404 : Read the corresponding pre-stored image according to the visible light image in the multimodal data, and compare the commodity area in the visible light image with the pre-stored image.

[0104] Step S406: If the comparison is inconsistent, damage identification is performed based on the visible light image to obtain product damage.

[0105] Step S408 : performing material category recognition based on the visible light image and the infrared radiation intensity in the multimodal data to obtain the material category features of the rental product.

[0106] Step S410 : performing material category matching between the commodity material category characteristics and the set of exemption material categories in the maintenance exemption rights and interests associated with the rental order.

[0107] Step S412: If the material category is matched successfully, damage area recognition is performed based on the visible light image to obtain damage area characteristics of the product.

[0108] Step S414 , when the damage area characteristic is less than the exemption area threshold in the repair exemption benefit, the estimated cost of the rental product is calculated based on the damage area characteristic and the product material category characteristic.

[0109] Step S416 , performing rights verification on the maintenance exemption rights, and generating a rights verification result including estimated costs, and sending it to the user terminal for display through an augmented reality page.

[0110] It should be noted that any one of steps S402 to step S416 or any combination of multiple steps can be combined with any one of steps S202 to step S208 to form a new implementation method according to the needs of implementation deployment; in addition, according to the needs of actual deployment, any one or multiple technical features can be selected from steps S402 to step S416 and combined with any one or multiple technical features provided by steps S202 to step S208 to form a new implementation method; or, any one or multiple technical features in steps S402 to step S416 can also be replaced by any one or multiple technical features provided by steps S202 to step S208 to form a new implementation method according to the needs of actual deployment, which will not be repeated here.

[0111] An embodiment of a detection and processing device for leased items provided in this specification is as follows: In the above-mentioned embodiment, a method for detecting and processing a leased object is provided. Correspondingly, a device for detecting and processing a leased object is also provided, which will be described below with reference to the accompanying drawings.

[0112] Reference Figure 5 , which shows a schematic diagram of an embodiment of a detection and processing device for leased items provided in this embodiment.

[0113] Since the device embodiment corresponds to the method embodiment, the description is relatively simple. For the relevant parts, please refer to the corresponding description of the method embodiment provided above. The device embodiment described below is only illustrative.

[0114] This embodiment provides a detection and processing device for a leased item, the device comprising: The data acquisition module 502 is configured to acquire multimodal data obtained by the rental user through the rental subroutine calling the augmented reality interface to collect data on the rental item corresponding to the rental order in the rental status; the multimodal data includes images of the rental item and environmental perception data; A feature extraction module 504 is configured to perform damage identification based on the multimodal data to obtain damage to the leased property, and extract damage features of the damage to the leased property; A detection module 506 is configured to detect, based on the damage characteristics, whether the damage to the leased item triggers a condition of a repair exemption benefit associated with the lease order; the repair exemption benefit is associated with the lease order when the order is created; If the detection result is triggered, the cost estimation module 508 is run, and the cost estimation module 508 is configured to estimate the cost of damage repair according to the damage characteristics to obtain an estimated cost, and generate an equity write-off result including the estimated cost.

[0115] An embodiment of a detection and processing device for leased items provided in this specification is as follows: Corresponding to the above-described detection and processing method for leased property, based on the same technical concept, one or more embodiments of this specification further provide a detection and processing device for leased property, the detection and processing device for leased property being used to execute the above-described detection and processing method for leased property. Figure 6 A schematic diagram of the structure of a detection and processing device for leased items provided in one or more embodiments of this specification.

[0116] This embodiment provides a detection and processing device for leased items, including: like Figure 6 As shown, the leased property detection and processing device can vary significantly depending on its configuration or performance. It may include one or more processors 601 and memory 602. Memory 602 may store one or more applications or data. Memory 602 may be either ephemeral or persistent. The applications stored in memory 602 may include one or more modules (not shown), each of which may include a series of computer-executable instructions for the leased property detection and processing device. Furthermore, processor 601 may be configured to communicate with memory 602 to execute the series of computer-executable instructions in memory 602 on the leased property detection and processing device. The leased property detection and processing device may also include one or more power supplies 603, one or more wired or wireless network interfaces 604, one or more input / output interfaces 605, one or more keyboards 606, and the like.

[0117] In a specific embodiment, the detection and processing device for leased property includes a memory and one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs may include one or more modules, and each module may include a series of computer-executable instructions for the detection and processing device for leased property, and the one or more programs are configured to be executed by one or more processors, including computer-executable instructions for performing the following: Acquire multimodal data obtained by the leasing user through the leasing subroutine calling the augmented reality interface to collect data on the leased item corresponding to the leased order; the multimodal data includes an image of the leased item and environmental perception data; Performing damage identification based on the multimodal data to obtain damage to the leased property, and extracting damage features of the damage to the leased property; Detecting, based on the damage characteristics, whether the damage to the leased item triggers a condition for a repair exemption benefit associated with the lease order; the repair exemption benefit is associated with the lease order when the order is created; If the detection result is triggered, the cost of damage repair is estimated based on the damage characteristics to obtain an estimated cost, and an equity write-off result including the estimated cost is generated.

[0118] An embodiment of a computer-readable storage medium provided in this specification is as follows: Corresponding to the above-described method for detecting and processing leased items, based on the same technical concept, one or more embodiments of this specification further provide a computer-readable storage medium.

[0119] The computer-readable storage medium provided in this embodiment is used to store computer-executable instructions. When the computer-executable instructions are executed, the following process is implemented: Acquire multimodal data obtained by the leasing user through the leasing subroutine calling the augmented reality interface to collect data on the leased item corresponding to the leased order; the multimodal data includes an image of the leased item and environmental perception data; Performing damage identification based on the multimodal data to obtain damage to the leased property, and extracting damage features of the damage to the leased property; Detecting, based on the damage characteristics, whether the damage to the leased item triggers a condition for a repair exemption benefit associated with the lease order; the repair exemption benefit is associated with the lease order when the order is created; If the detection result is triggered, the cost of damage repair is estimated based on the damage characteristics to obtain an estimated cost, and an equity write-off result including the estimated cost is generated.

[0120] It should be noted that the embodiment of a computer-readable storage medium in this specification and the embodiment of a detection and processing method for leased items in this specification are based on the same inventive concept. Therefore, the specific implementation of this embodiment can refer to the implementation of the aforementioned corresponding method, and the repeated parts will not be repeated.

[0121] An embodiment of a computer program product provided in this specification is as follows: Corresponding to the above-described method for detecting and processing leased items, based on the same technical concept, one or more embodiments of this specification also provide a computer program product.

[0122] A computer program product comprising a computer program / instructions, which, when executed by a processor, implements the following steps: Acquire multimodal data obtained by the leasing user through the leasing subroutine calling the augmented reality interface to collect data on the leased item corresponding to the leased order; the multimodal data includes an image of the leased item and environmental perception data; Performing damage identification based on the multimodal data to obtain damage to the leased property, and extracting damage features of the damage to the leased property; Detecting, based on the damage characteristics, whether the damage to the leased item triggers a condition for a repair exemption benefit associated with the lease order; the repair exemption benefit is associated with the lease order when the order is created; If the detection result is triggered, the cost of damage repair is estimated based on the damage characteristics to obtain an estimated cost, and an equity write-off result including the estimated cost is generated.

[0123] It should be noted that the embodiment of a computer program product in this specification and the embodiment of a method for detecting and processing leased items in this specification are based on the same inventive concept. Therefore, the specific implementation of this embodiment can refer to the implementation of the aforementioned corresponding method, and the repeated parts will not be repeated.

[0124] The various embodiments in this specification are described in a progressive manner, and the same or similar parts between the various embodiments can be referred to each other. Each embodiment focuses on the differences from other embodiments. For example, the device embodiment, equipment embodiment and computer-readable storage medium embodiment are similar to the method embodiment, so the description is relatively simple. For relevant content in the device embodiment, equipment embodiment and computer-readable storage medium embodiment, please refer to the partial description of the method embodiment.

[0125] The foregoing description of this specification describes specific embodiments. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in an order different from that described in the embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order shown or the sequential order to achieve the desired results. In some embodiments, multiple answer generation and parallel processing are also possible or may be advantageous.

[0126] In the 1930s, technological improvements could be clearly distinguished as either hardware improvements (for example, improvements to circuit structures like diodes, transistors, and switches) or software improvements (improvements to process flows). However, with the advancement of technology, many process flow improvements today can be considered direct improvements to hardware circuit structures. Designers almost always create the corresponding hardware circuit structure by programming the improved process flow into the hardware circuit. Therefore, it cannot be said that a process flow improvement cannot be implemented using physical hardware modules. For example, a programmable logic device (PLD), such as a field programmable gate array (FPGA), is an integrated circuit whose logical function is determined by user programming. Designers can "integrate" a digital system on a PLD by programming it themselves, without having to hire a chip manufacturer to design and manufacture a dedicated integrated circuit chip. Moreover, nowadays, instead of manually fabricating integrated circuit chips, this programming is mostly performed using software called a "logic compiler." This is similar to the software compilers used during program development. Before compilation, the original code must be written in a specific programming language, called a Hardware Description Language (HDL). There are many types of HDL, including ABEL (Advanced Boolean Expression Language), AHDL (Altera Hardware Description Language), Confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), Lava, Lola, MyHDL, PALASM, and RHDL (Ruby Hardware Description Language). Currently, the most commonly used are VHDL (Very-High-Speed ​​Integrated Circuit Hardware Description Language) and Verilog. Those skilled in the art will also understand that simply by programming a method flow in one of these hardware description languages ​​and then programming it into an integrated circuit, a hardware circuit that implements the logic method flow can be easily obtained.

[0127] The controller can be implemented in any suitable manner. For example, the controller can take the form of a microprocessor or processor and a computer-readable medium storing computer-readable program code (e.g., software or firmware) executable by the (micro)processor, logic gates, switches, an application-specific integrated circuit (ASIC), a programmable logic controller, and an embedded microcontroller. Examples of controllers include, but are not limited to, the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20, and Silicone Labs C8051F320. The memory controller can also be implemented as part of the memory control logic. Those skilled in the art will also appreciate that, in addition to implementing the controller purely in computer-readable program code, the controller can also be implemented in the form of logic gates, switches, an application-specific integrated circuit, a programmable logic controller, an embedded microcontroller, etc. by logically programming the method steps. Therefore, such a controller can be considered a hardware component, and the means for implementing the various functions included therein can also be considered as structures within the hardware component. Alternatively, the means for implementing the various functions can be considered both a software module implementing the method and a structure within the hardware component.

[0128] The systems, devices, modules, or units described in the above embodiments may be implemented by computer chips or entities, or by products having certain functions. A typical implementation device is a computer. Specifically, the computer may be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smartphone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

[0129] For the convenience of description, the above devices are described as being divided into various units according to their functions. Of course, when implementing the embodiments of this specification, the functions of each unit can be implemented in the same or multiple software and / or hardware.

[0130] Those skilled in the art will appreciate that one or more embodiments of this specification may be provided as a method, system, or computer program product. Thus, one or more embodiments of this specification may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware. Furthermore, this specification may take the form of a computer program product implemented on one or more computer-readable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0131] This specification is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of this specification. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0132] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0133] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0134] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0135] Memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.

[0136] Computer-readable media includes both permanent and non-permanent, removable and non-removable media that can be implemented using any method or technology for information storage. The information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer-readable storage media include, but are not limited to, phase-change RAM (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic disk storage or other magnetic storage devices, or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media such as modulated data signals and carrier waves.

[0137] It should also be noted that the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, commodity, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, commodity, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising at least one ..." does not exclude the presence of additional identical elements in the process, method, commodity, or apparatus comprising the element.

[0138] One or more embodiments of this specification may be described in the general context of computer-executable instructions, such as program modules, executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, and the like that perform specific tasks or implement specific abstract data classes. One or more embodiments of this specification may also be practiced in distributed computing environments where tasks are performed by remote processing devices connected via a communications network. In distributed computing environments, program modules may be located in local and remote computer storage media, including storage devices.

[0139] The foregoing description is merely an example of the present invention and is not intended to limit the present invention. Persons skilled in the art will readily appreciate that various modifications and variations of the present invention are possible. Any modifications, equivalent substitutions, or improvements made within the spirit and principles of the present invention are intended to be included within the scope of the claims herein.

Claims

1. A method for detecting and processing leased property, comprising: Acquire multimodal data obtained by the leasing user through the leasing subroutine calling the augmented reality interface to collect data on the leasing items corresponding to the leasing order in the leasing status; The multimodal data includes images of the leased property and environmental perception data; Performing damage identification based on the multimodal data to obtain damage to the leased property, and extracting damage features of the damage to the leased property; Detecting, based on the damage characteristics, whether the damage to the leased item triggers a condition for a repair exemption benefit associated with the lease order; the repair exemption benefit is associated with the lease order when the order is created; If the detection result is triggered, the cost of damage repair is estimated based on the damage characteristics to obtain an estimated cost, and an equity write-off result including the estimated cost is generated.

2. The method for detecting and processing leased property according to claim 1, wherein the step of performing damage identification based on the multimodal data to obtain damage to the leased property comprises: Performing damage identification based on the image of the leased object to obtain initial damage; The initial damage is effectively detected according to the environmental perception data, and the initial damage that passes the effective detection is determined as the damage to the leased property.

3. The method for detecting and processing a leased property according to claim 2, wherein the step of effectively detecting the initial damage based on the environmental perception data comprises: Detecting whether the height difference between the initial damaged area and the remaining area in the virtual model of the leased property obtained by model generation based on the laser ranging distance meets the corresponding height condition, and detecting whether there is a temperature difference between the initial damaged area and the remaining area in the infrared thermal imaging image obtained by image generation based on the infrared radiation intensity; If so, determining that the effective detection of the initial damage has passed; The environmental perception data includes the laser ranging distance and the infrared radiation intensity.

4. The method for detecting and processing leased property according to claim 1, wherein the augmented reality interface collects data in the following manner: Performing a template display of an image acquisition guide template for the leased property through an augmented reality page; If it is detected that the captured image matches the image capture guidance template, the multimodal sensor is called to perform multimodal data capture to obtain the multimodal data.

5. The method for detecting and processing leased property according to claim 4, wherein the step of displaying a template of a guide template for image acquisition of the leased property through an augmented reality page comprises: Acquire an initial image of the leased property captured by an image capture component, and perform region matching based on the initial image to obtain a capture region; The image acquisition guidance template corresponding to the acquisition area is read and displayed through the augmented reality page.

6. The method for detecting and processing leased property according to claim 1, wherein extracting damage characteristics of the leased property comprises: identifying the damaged portion of the leased object according to the image of the leased object; Matching the damaged part with the set of exempted parts in the repair exemption rights; When the parts are matched successfully, damage features of the damage to the leased object are extracted based on the leased object image and the environmental perception data.

7. The inspection and processing method for leased property according to claim 1, wherein the maintenance exemption benefit is issued to the lessee after the lessee has leased the leased property; The maintenance exemption rights are obtained by the lessee of the leased property authorizing the exemption rights to the leasing service provider.

8. The method for detecting and processing a leased property according to claim 1, further comprising: Acquiring multimodal data of the leased item obtained by the leasing service provider calling an augmented reality interface to collect data on the leased item corresponding to the lease order in the returned state; If the target damage feature obtained by damage identification and feature extraction based on the multimodal data of the leased item does not trigger the benefit condition, detecting whether the target damage triggers the maintenance guarantee item associated with the lease order based on the target damage feature; If so, generating a guarantee application message including at least the target damage characteristics and the guarantee participation information of the maintenance guarantee project and sending the message to the guarantee organization of the maintenance guarantee project; Among them, the maintenance guarantee project is associated with the rental order after the rental service provider participates in the guarantee project with the guarantee agency.

9. The method for detecting and processing leased property according to claim 1, wherein the damage characteristics of the leased property include at least one of the following: The damage site features are obtained by performing damage site identification on the visible light image in the multimodal data, The damage length feature is obtained by performing damage length recognition on the visible light image. The damaged material category features are obtained by performing material category identification based on the visible light image and infrared radiation intensity. The damage depth feature is obtained by performing depth recognition based on the visible light image and the laser ranging distance.

10. The method for detecting and processing leased items according to claim 1, wherein detecting whether the damage to the leased item triggers a benefit condition of a repair exemption benefit associated with the lease order based on the damage characteristics comprises: Reading the maintenance exemption characteristics of the maintenance exemption benefit; Check whether the damage part characteristics of the rental vehicle match the exemption part set, and whether the damage length characteristics are less than the exemption length threshold; If so, the detection result is determined to be a trigger.

11. The method for detecting and processing leased property according to claim 10, wherein estimating the cost of damage repair based on the damage characteristics to obtain an estimated cost comprises: Using the damage characteristics as input, the service interface of the leased property provider is called to estimate the cost; Get the estimated cost returned by the interface call.

12. The method for detecting and processing a leased property according to claim 1, wherein extracting damage characteristics of the leased property comprises: Identify the material category of the leased product based on the visible light image and infrared radiation intensity of the leased product; Check whether the material category of the product matches the material category exempted in the repair exemption benefit; If so, identify damage area features based on the visible light image.

13. The method for detecting and processing leased property according to claim 12, wherein estimating the cost of damage repair based on the damage characteristics to obtain an estimated cost comprises: Query the unit repair cost for product repair based on the material category of the product; The repair cost of the leased product is estimated based on the unit repair cost and the damage area characteristics.

14. The method for detecting and processing leased items according to claim 1, after executing the step of acquiring multimodal data obtained by the lease user through a lease subroutine calling an augmented reality interface to collect data on the leased item corresponding to the leased order, and before executing the step of performing damage identification based on the multimodal data to obtain damage to the leased item and extracting damage features of the damage to the leased item, further comprising: Reading a pre-stored image corresponding to an image acquisition guide template for image acquisition, and comparing the leased property image with the leased property in the pre-stored image; If there is inconsistency, the steps of performing damage identification based on the multimodal data to obtain damage to the leased property and extracting damage features of the damage to the leased property are executed.

15. The method for detecting and processing leased items according to claim 1, wherein if the step of detecting whether the damage to the leased item triggers the rights and interests condition for the repair exemption rights and interests associated with the lease order based on the damage characteristics is not triggered, the following steps are executed: performing a cost estimate based on the damage characteristics to obtain an estimated cost, and generating a repair suggestion based on the damage characteristics; generating a damage repair reminder including the estimated cost and the repair recommendation; or, Detecting, based on the damage characteristics, whether the damage to the leased item triggers a maintenance guarantee item associated with the lease order; If so, generate guarantee application information including at least the damage characteristics and the guarantee participation information of the maintenance guarantee project and send it to the guarantee organization of the maintenance guarantee project.

16. The inspection and processing method for leased property according to claim 1, wherein the inspection and processing method for leased property is executed by an inspection model; the inspection model comprises a damage identification module, a feature extraction module, a trigger detection module, and a result generation module; in, The damage identification module performs damage identification based on the multimodal data to obtain damage to the leased property; The feature extraction module extracts damage features of the leased property; The trigger detection module detects, based on the damage characteristics, whether the damage to the leased item triggers a benefit condition of the repair exemption benefit associated with the lease order; The result generation module estimates the cost of damage repair according to the damage characteristics to obtain an estimated cost, and generates an equity write-off result including the estimated cost.

17. A detection and processing device for a leased item, comprising: A data acquisition module is configured to acquire multimodal data obtained by a rental user through a rental subroutine calling an augmented reality interface to collect data on a rental item corresponding to a rental order in a rental state; the multimodal data includes an image of the rental item and environmental perception data; a feature extraction module configured to perform damage identification based on the multimodal data to obtain damage to the leased property, and extract damage features of the damage to the leased property; a detection module configured to detect, based on the damage characteristics, whether the damage to the leased item triggers a condition of a repair exemption benefit associated with the lease order; the repair exemption benefit is associated with the lease order when the order is created; If the detection result is triggered, the cost estimation module is run, and the cost estimation module is configured to estimate the cost of damage repair according to the damage characteristics to obtain an estimated cost, and generate an equity write-off result including the estimated cost.

18. A detection and processing device for leased items, comprising: processor; and a memory configured to store computer-executable instructions that, when executed, cause the processor to: Acquire multimodal data obtained by the leasing user through the leasing subroutine calling the augmented reality interface to collect data on the leased item corresponding to the leased order; the multimodal data includes an image of the leased item and environmental perception data; Performing damage identification based on the multimodal data to obtain damage to the leased property, and extracting damage features of the damage to the leased property; Detecting, based on the damage characteristics, whether the damage to the leased item triggers a condition for a repair exemption benefit associated with the lease order; the repair exemption benefit is associated with the lease order when the order is created; If the detection result is triggered, the cost of damage repair is estimated based on the damage characteristics to obtain an estimated cost, and an equity write-off result including the estimated cost is generated.

19. A computer-readable storage medium for storing computer-executable instructions, wherein the computer-executable instructions implement the steps of the method of claim 1 when executed.

Images