An interaction method and related apparatus

Abstract

The application discloses an interaction method and related device, which are applied to the fields of interaction technology, intelligent vehicle technology and the like. The application can utilize a model to recognize an interface image obtained by information identification in the surrounding environment of a parking lot where a vehicle is located, and determine whether the interface obtained by the information identification is a payment interface, that is, whether the information identification is a parking payment identification. That is, the processing device can open the interface corresponding to the information identification for recognition through the information identification, so that the information identification is intelligently checked and analyzed, and the model can simultaneously recognize interfaces corresponding to multiple information identifications, can quickly filter out the required parking payment identification for the user in a complex environment, can improve the recognition efficiency, and further improve the efficiency of parking payment of the user. The above process can be automatically implemented, the efficiency of parking payment can be improved, the universality and convenience of the payment mode can be improved, and the user experience can be improved.

Description

Technical Field

[0001] This application relates to the fields of interactive technology and intelligent vehicle technology, and in particular to an interactive method and related device. Background Technology

[0002] In recent years, with the continuous improvement of residents' living standards, cars have become an indispensable part of people's lives. During car travel, parking in a parking lot and paying parking fees when leaving the parking lot are common business scenarios.

[0003] Currently, scanning parking payment QR codes is a common payment method for parking fees. In some solutions, users use electronic devices (such as mobile phones) to obtain QR codes in the parking lot's surrounding environment and scan them to pay. However, the surrounding environment of parking lots is rich and varied, potentially containing QR codes for different functions such as shopping mall information, commercial advertisements, and parking payment. This payment method does not validate the obtained QR codes, meaning the scanned QR code may not be the correct one for parking payment, leading to an inability to pay and a poor user experience. Summary of the Invention

[0004] This application provides an interaction method and related apparatus that can improve the effectiveness of information identifiers pushed to users, improve the efficiency of parking payment, enhance the universality and convenience of payment methods, and improve user experience.

[0005] Firstly, this application provides an interaction method for determining the validity of an information identifier. This method can be applied to a vehicle, for example, executed by the vehicle itself, or executed by a module within the vehicle (such as a processing device or a component within the processing device), where the module may include software and / or hardware modules. In other words, even when the method is executed by a processing device or a component within the processing device (such as a chip or module), it can still be considered as the method being applied to the vehicle. In some cases, the processing device includes a central processing unit (CPU), a microcontroller unit (MCU), etc. For example, the processing device may be a domain controller (DC), an electronic control unit (ECU), a vehicle integrated / integration unit (VIU), etc., where the domain controller includes an intelligent driving domain controller (such as a mobile data center), etc. For ease of description, the following explanation uses the processing device as the executing entity of this method; in actual implementation, the executing entity of this method may have other names.

[0006] The interaction method includes: after a first vehicle enters the parking lot, the processing device acquires at least one information identifier in the surrounding environment of the first vehicle. The processing device uses the first information identifier to obtain a first interface, wherein the first information identifier belongs to at least one information identifier. The processing device uses a first model to recognize the image of the first interface and obtains a first recognition result, wherein the first recognition result includes first indication information, which indicates whether the first interface is a payment interface, and the payment interface is used to pay the parking fee for the first vehicle in the parking lot.

[0007] The first model is an algorithm or data structure that can acquire patterns and rules in data, thereby enabling tasks such as data prediction, classification, and generation. In this embodiment, the model can be used to identify various elements in an image, such as controls, icons, and text. Image recognition through the model can quickly process large amounts of interface image data, improving recognition efficiency. Furthermore, unlike humans, the model is not affected by emotions or fatigue; it follows fixed rules and algorithms each time it performs a recognition task, ensuring consistency in the recognition results and improving accuracy. Optionally, the payment interface includes a title "Parking Payment," an information display area (e.g., displaying parking-related information such as parking start time, parking end time, parking duration, and outstanding parking fees), a license plate number input area (for entering the license plate number of the vehicle for which parking fees need to be paid), and a payment control. Clicking the payment control redirects the user to their corresponding payment software to pay the parking fees, thus making the payment interface usable for paying parking fees at the parking lot.

[0008] The surrounding environment of a parking lot contains numerous information signs, which, upon scanning, often present various interfaces. Because these signs don't directly display interfaces but rather act as links to other interfaces, it's often difficult for the human eye to quickly identify which signs support parking fees. When users try to pay for parking, they often have to try each sign individually to find the payment option, sometimes requiring multiple clicks and redirects on the corresponding interface before reaching the actual payment screen. This process is time-consuming and provides a poor user experience.

[0009] In the above solution, the processing device can use a model to identify images of interfaces obtained from information signs in the parking lot environment where the vehicle is located, and determine whether the interface obtained from the information sign is a payment interface, i.e., whether the information sign is a parking payment sign. In other words, the processing device can open the interface corresponding to the information sign for identification, thereby intelligently checking and analyzing the information sign. Moreover, the model can simultaneously identify interfaces corresponding to multiple information signs, quickly filtering out the required parking payment signs for users in complex environments, improving identification efficiency and thus improving the efficiency of parking payment for users. The above process can be automated, automatically sensing information signs in the surrounding environment and identifying and judging the directional interface. It can determine the validity of information signs outside the vehicle without relying on additional information (such as human operation information or information from cloud databases), improving the effectiveness of information signs subsequently pushed to users. In summary, the above solution can improve the efficiency of parking payment, enhance the universality and convenience of payment methods, and improve the user experience.

[0010] In one possible implementation of the first aspect, the processing device uses a first model to recognize an image of the first interface to obtain a first recognition result, including: the processing device acquiring a text prompt, inputting the text prompt and the image of the first interface into the first model, and obtaining the first recognition result. Optionally, the text prompt may be input by the user, or the text prompt may be preset in the storage data of the processing device, and the processing device may acquire the text prompt from the storage data of the processing device.

[0011] The text prompts are used to instruct the tasks or functions of the first model. For example, the text prompt could be "Based on the image of the first interface, find payment information (such as a payment interface) as much as possible, and determine whether the first interface is a valid payment interface." In this way, the processing device can use the first model to identify the image of the interface obtained from the information markers in the parking lot surrounding the vehicle, and determine whether the interface obtained from the information markers is a payment interface, that is, whether the information markers are parking payment markers.

[0012] In another possible implementation of the first aspect, the method further includes: when the first indication information indicates that the first interface is a payment interface, the processing device generates first information and a second information identifier, wherein the first information indicates that the first information identifier is a payment availability identifier for the parking lot, and the second information identifier is used to identify the payment interface. The processing device displays a second interface, which includes the second information identifier.

[0013] In the above embodiments, when the processing device determines that the first interface is a payment interface, it can record the first information identifier as a payment availability identifier for the parking lot, that is, the first information identifier is valid. Displaying the second interface allows users to easily access the payment interface and perform payment operations, thereby improving the efficiency of parking payment, enhancing the universality and convenience of the payment method, and improving the user experience.

[0014] Optionally, the first vehicle includes an interactive device, and the method further includes: the processing device outputting first information through the interactive device. The first information is output in at least one of the following methods: interface display, voice broadcast, etc.

[0015] In the above embodiments, the processing device can also output first information through an interactive device, allowing the user to intuitively perceive the first information and promptly understand whether the information identifier currently identified by the processing device is valid, thereby improving the user experience. In another possible embodiment of the first aspect, the method further includes: when the first indication information is used to indicate that the first interface is not a payment interface, the processing device generates second information, the second information being used to indicate that the first information identifier is a parking lot payment unavailable identifier.

[0016] In the above embodiments, when the processing device determines that the first interface is not a payment interface, it can record the first information identifier as a parking payment unavailable identifier, that is, the first information identifier is invalid. For example, for information identifiers of functions such as shopping mall introductions and commercial advertisements, the processing device can record the identifier as a parking payment unavailable identifier after recognition. In this way, the processing device can reduce the possibility of subsequently pushing invalid information identifiers to users, improve the effectiveness of information identifiers subsequently pushed to users, improve the efficiency of parking payment, enhance the universality and convenience of payment methods, and improve user experience.

[0017] Optionally, the first vehicle includes an interactive device, and the method further includes: the processing device outputting second information through the interactive device. The output of the second information may be performed via at least one of interface display, voice broadcast, etc.

[0018] In the above embodiments, the processing device can also output second information through an interactive device, so that the user can intuitively perceive the second information and the user can promptly understand whether the information identifier currently identified by the processing device is valid, thereby improving the user experience.

[0019] In another possible implementation of the first aspect, when the first indication information is used to indicate that the first interface is not a payment interface, the first identification result further includes first operation indication information, which is used to indicate that a first operation is performed on the first interface so that the first interface jumps to a jumpable interface of the first interface.

[0020] In the above embodiments, when the processing device determines that the first interface is not a payment interface, it can also generate operation instruction information. Performing the operation corresponding to the operation instruction information on the first interface can cause the first interface to jump to another interface. For example, the payment interface may be hidden among the jumpable interfaces of the first interface, and the processing device can find the payment interface by performing the operation corresponding to the operation instruction information. Thus, the above embodiments can improve the accuracy of the processing device in determining the validity of information identifiers, and can improve the validity of information identifiers subsequently pushed to the user.

[0021] In another possible implementation of the first aspect, the first operation instruction information includes a first position indication and a first indication identifier, and the method further includes: displaying the first indication identifier at a first position in the first interface indicated by the first position indication, the first indication identifier including a cursor. Optionally, the first position indication includes coordinates or coordinates corresponding to a control.

[0022] In the above implementation, a first indicator is displayed at a first location on the first interface so that the user can intuitively perceive where to perform the operation on the first interface and can promptly find the payment interface, thereby improving the user experience.

[0023] In yet another possible implementation of the first aspect, the first operation includes clicking and / or swiping a first position in the first interface.

[0024] In another possible implementation of the first aspect, the first interface has multiple jumpable interfaces, and the method further includes: using a first model to identify the image of the first jumpable interface to obtain a second identification result, the second identification result including second indication information, the second indication information being used to indicate whether the first jumpable interface is a payment interface, and the first jumpable interface belongs to multiple jumpable interfaces.

[0025] In the above embodiments, the processing device can use the first model to re-identify the image of the jumpable interface of the first interface and determine whether the jumpable interface of the first interface is a payment interface. If the payment interface is hidden in the jumpable interface of the first interface, the processing device can identify the image of the jumpable interface of the first interface to find the payment interface. This avoids the first information identifier being deemed invalid due to the payment interface being hidden in the jumpable interface of the first interface, thereby improving the accuracy of the processing device in determining the validity of the information identifier and enhancing the validity of the information identifier subsequently pushed to the user.

[0026] In another possible implementation of the first aspect, the method further includes: when the second indication information indicates that the first jumpable interface is a payment interface, the processing device generates third information and a third information identifier, the third information indicating that the first information identifier is a payment availability identifier for the parking lot, and the third information identifier identifying the payment interface. The processing device displays a third interface, which includes the third information identifier.

[0027] In the above embodiments, when the processing device determines that the first jumpable interface is a payment interface, it can record the first information identifier as a payment available identifier for the parking lot, that is, the first information identifier is valid. Displaying the third interface facilitates user identification and payment operation, improving parking payment efficiency, enhancing the universality and convenience of the payment method, and improving user experience.

[0028] In another possible implementation of the first aspect, when the second indication information is used to indicate that the first jumpable interface is not a payment interface, the second identification result further includes second operation indication information, which is used to indicate that a second operation is performed on the first jumpable interface so that the first jumpable interface jumps to the second jumpable interface, and the second jumpable interface belongs to multiple jumpable interfaces.

[0029] In the above embodiments, when the processing device determines that the first jumpable interface is not a payment interface, it can also generate operation instruction information. Performing the operation corresponding to the operation instruction information on the first jumpable interface can cause the first jumpable interface to jump to another jumpable interface. For example, the payment interface may be hidden among the jumpable interfaces of the first jumpable interface, and the processing device can find the payment interface by performing the operation corresponding to the operation instruction information. Thus, the above embodiments can improve the accuracy of the processing device in determining the validity of information identifiers, and can improve the validity of information identifiers subsequently pushed to the user.

[0030] In another possible implementation of the first aspect, when the second indication information is used to indicate that the first jumpable interface is not a payment interface, the second identification result further includes third operation indication information and fourth operation indication information. The third operation indication information is used to instruct the execution of a third operation on the first jumpable interface, causing the first jumpable interface to jump to the first interface. The fourth operation indication information is used to instruct the execution of a fourth operation on the first interface, causing the first interface to jump to a third jumpable interface, where the third jumpable interface belongs to multiple jumpable interfaces. The method further includes: the processing device using a first model to identify an image of the third jumpable interface to obtain a third identification result, the third identification result including third indication information, the third indication information being used to indicate whether the third jumpable interface is a payment interface.

[0031] In the above embodiments, the processing device can perform a third operation on the first jumpable interface to cause the first jumpable interface to revert to the first interface, and perform a fourth operation on the first interface to cause the first interface to jump to the third jumpable interface. Further, the processing device can use the first model to re-identify the image of the third jumpable interface to determine whether the third jumpable interface is a payment interface. If the payment interface is not a jumpable interface hidden within the first jumpable interface, i.e., the payment interface cannot be found via the route from the first interface to the first jumpable interface, the processing device can revert from the first jumpable interface to the first interface, jump from the first interface to the third jumpable interface, and search for the payment interface via the route from the first interface to the third jumpable interface. In this way, the processing device can avoid determining the first information identifier as invalid due to the payment interface being hidden in other routes within the jumpable interface of the first interface, thereby improving the accuracy and efficiency of the processing device in determining the validity of information identifiers and enhancing the validity of information identifiers subsequently pushed to the user. In another possible implementation of the first aspect, the method further includes: a processing device using a first model to identify an image of each of a plurality of jumpable interfaces, obtaining a plurality of identification results, each identification result corresponding to one of the plurality of jumpable interfaces, and indication information in each identification result used to indicate whether the jumpable interface corresponding to each identification result is a payment interface. If the indication information in each identification result is used to indicate that the jumpable interface corresponding to each identification result is not a payment interface, the processing device generates fourth information, the fourth information used to indicate that the first information identifies the parking lot as a payment unavailable identifier.

[0032] In the above embodiments, the processing device can use the first model to identify all jumpable interfaces of the first interface. If none of the jumpable interfaces is a payment interface, the first information identifier can be recorded as a payment unavailable identifier, i.e., the first information identifier is invalid. In this way, the processing device can use the first model to identify all jumpable interfaces of the first interface, which can improve the accuracy and comprehensiveness of the processing device's validity judgment of information identifiers, and can improve the validity of information identifiers subsequently pushed to users.

[0033] In another possible implementation of the first aspect, the first model includes a first sub-model and a second sub-model. The processing device uses the first model to recognize an image of the first interface and obtains a first recognition result, including: the processing device uses the first sub-model to recognize an image of the first interface and obtains text information of the first interface. The processing device obtains the location of the first vehicle and inputs the image of the first interface, the text information of the first interface, and the location of the first vehicle into the second sub-model to obtain the first recognition result.

[0034] Optionally, the text information on the first interface is used to obtain the location of the payment area corresponding to the first interface. In the above embodiment, when the processing device judges the validity of the information identifier, it can also use the location of the payment area corresponding to the first interface and the location of the first vehicle to assist in obtaining a more accurate recognition result. For example, the first interface is a payment interface, but the location of the payment area corresponding to the first interface is A, and the location of the first vehicle is B. Since A and B are different, the first indication information in the first recognition result is used to indicate that the first interface is not a payment interface. In this way, the above embodiment can improve the accuracy of judging the validity of the information identifier and improve the validity of the information identifier subsequently pushed to the user.

[0035] In another possible implementation of the first aspect, the method further includes: a processing device acquiring stored data corresponding to the location of the first vehicle, the stored data including a fourth information identifier. The processing device uses the fourth information identifier to obtain a fourth interface, identifies the image of the fourth interface using a first model, and obtains a fourth identification result, the fourth identification result including fourth indication information used to indicate whether the fourth interface is a payment interface. Based on the first identification result, the fourth identification result, the first information identifier, and the fourth information identifier, the processing device obtains a fifth information identifier, the fifth information identifier used to identify the payment interface. The processing device displays the fifth interface, the fifth interface including the fifth information identifier.

[0036] In the above embodiments, the processing device can use the first model to determine the validity of the fourth information identifier in the stored data, and combine the recognition result corresponding to the first information identifier (i.e., the first recognition result), the recognition result corresponding to the fourth information identifier (i.e., the fourth recognition result), the first information identifier, and the fourth information identifier to obtain the information identifier (i.e., the fifth information identifier) ​​pushed to the user, thereby improving the validity of the information identifier pushed to the user. Furthermore, in the above embodiments, the processing device can use the first model to determine the validity of the fourth information identifier in the stored data, that is, it can perform a secondary verification of the validity of the fourth information identifier in the stored data, thereby improving the accuracy of the validity determination of the information identifier in the stored data and improving the validity of the information identifier subsequently pushed to the user.

[0037] In another possible implementation of the first aspect, the method further includes: a processing device acquiring stored data corresponding to the location of a first vehicle, the stored data including a sixth information identifier and payment identifier information associated with the sixth information identifier, the payment identifier information being used to indicate whether at least one second vehicle has successfully paid for parking at a parking lot using the sixth information identifier. Based on a first identification result, the payment identifier information associated with the sixth information identifier, the first information identifier, and the sixth information identifier, the processing device obtains a seventh information identifier, the seventh information identifier being used to identify a payment interface. The processing device displays a sixth interface, the sixth interface including the seventh information identifier.

[0038] In the above embodiments, the processing device can combine the first identification result, the payment information related to the sixth information identifier in the stored data, the first information identifier, and the sixth information identifier to obtain the information identifier pushed to the user, thereby improving the effectiveness of the information identifier pushed to the user. For example, the indication information in the first identification result is used to indicate that the first interface is not a payment interface. There are 20 payment identifiers in the payment identifier information related to the sixth information identifier, of which 15 payment identifiers are used to indicate that the second vehicle successfully paid its parking fee in the parking lot using the sixth information identifier. In this case, it can be considered that the probability of the first vehicle successfully paying its parking fee in the parking lot using the sixth information identifier is very high, and the information identifier pushed to the user by the processing device can be this sixth information identifier.

[0039] In another possible implementation of the first aspect, the payment identifier information includes multiple payment identifiers, including a first payment identifier, which indicates that the second vehicle has successfully paid its parking fee at the parking lot using a sixth information identifier. If the ratio between the number of first payment identifiers and the number of multiple payment identifiers is greater than a proportional threshold, the seventh information identifier is the sixth information identifier.

[0040] For example, the proportion threshold is a pre-set probability threshold, such as 70% or 80%. When the ratio between the number of first payment identifiers and the number of multiple payment identifiers is greater than the proportion threshold, the probability of successfully paying the parking fee using the sixth information identifier is greater than the proportion threshold. At this time, it can be considered that the probability of the first vehicle successfully paying the parking fee in the parking lot using the sixth information identifier is very high, and the information identifier pushed to the user can be the sixth information identifier.

[0041] In another possible implementation of the first aspect, the method further includes: the processing device acquiring the parking fee standard and the parking duration of the first vehicle in the parking lot, and generating predicted payment information based on the parking fee standard and the parking duration of the first vehicle in the parking lot, the predicted payment information being used to indicate the predicted parking fee of the first vehicle in the parking lot.

[0042] In the above embodiments, the processing device can generate predictive payment information, making it easier for users to know their vehicle's parking fees in advance.

[0043] In another possible implementation of the first aspect, the first vehicle includes an interactive device, and the method further includes: a processing device outputting predicted payment information through the interactive device. The output method of the predicted payment information includes at least one of interface display, voice broadcast, etc.

[0044] The processing device can also output predicted payment information through interactive devices, allowing users to intuitively perceive the predicted payment information and know the parking fees of their own vehicles in advance, which can significantly improve the user experience.

[0045] In another possible implementation of the first aspect, the method further includes: the processing device using the first model to identify the payment interface to obtain a fifth identification result, the fifth identification result including fifth operation instruction information, the fifth operation instruction information being used to instruct the payment interface to perform a fifth operation, the fifth operation being used to pay the parking fee of the first vehicle in the parking lot.

[0046] In the above embodiments, the processing device can use the first model to output operation instruction information for paying the parking fee of the first vehicle in the parking lot, assisting the user in the payment operation, reducing the complexity of the user's payment operation, and significantly improving the user experience.

[0047] In another possible implementation of the first aspect, the fifth operation instruction information includes a second location indication and a second indication identifier. The method further includes: displaying the second indication identifier at a second location in the payment interface indicated by the second location indication, the second indication identifier including a cursor. The fifth operation includes at least one of the following: clicking the second location in the payment interface, sliding the second location in the payment interface, and entering information related to the identity of the first vehicle at the second location in the payment interface.

[0048] In another possible implementation of the first aspect, the method further includes: the processing device performing a fifth operation on the payment interface to obtain a seventh interface, the seventh interface being used to confirm payment of the parking fee for the first vehicle in the parking lot.

[0049] In the above embodiments, the processing device can perform a fifth operation on the payment interface to assist the user in making the payment. This reduces the complexity of the user's payment operation, eliminating the need for cumbersome operations. The user can complete the parking fee payment operation simply by confirming the payment, which improves the convenience of the user's parking payment operation and significantly enhances the user experience.

[0050] In another possible implementation of the first aspect, the method further includes: the processing device acquiring a second payment identifier, the second payment identifier indicating whether the first vehicle successfully paid the parking fee for the first vehicle in the parking lot using the first information identifier. The processing device sends the first information identifier and the second payment identifier to a server. Optionally, the processing device may also send either first information or second information to the server.

[0051] In the above embodiments, the first information identifier and the second payment identifier can be stored in the server's storage data, so that when other vehicles pay parking fees in the parking lot later, they can use the storage data in the server to obtain the information identifier pushed to the user, which can improve the effectiveness of the information identifier pushed to the user.

[0052] In another possible implementation of the first aspect, the method further includes: the processing device acquiring an image of the surrounding environment of the first vehicle, and detecting whether the first vehicle has entered the parking lot based on the image of the surrounding environment of the first vehicle.

[0053] In the above embodiments, the processing device can determine whether the first vehicle has entered the parking lot based on the surrounding environment image of the first vehicle. This allows the processing device to promptly identify the validity of information markers in the surrounding environment of the parking lot where the first vehicle is located after detecting that the first vehicle has entered the parking lot. This avoids invalid judgments caused by the processing device continuously acquiring information markers in the surrounding environment of the first vehicle, making this application more in line with the needs of the scenario and improving the user experience.

[0054] Secondly, this application provides another interaction method to assist users in making payments. This method can be executed by a vehicle. Optionally, when the method is executed by a processing device or a component (such as a chip or module) within the vehicle, it can be considered as the method being executed by the vehicle. Exemplarily, the processing device includes a central processing unit (CPU), a microcontroller unit (MCU), etc. For example, the processing device is a domain controller (DC), an electronic control unit (ECU), a vehicle integration unit (VIU), etc., where the domain controller includes an intelligent driving domain controller (such as a mobile data center), etc. For ease of description, the following explanation uses the processing device as the executing entity of this method; in actual implementation, the executing entity of this method can have other names.

[0055] The interaction method includes: the processing device acquiring an eighth information identifier; the processing device using the eighth information identifier to obtain a payment interface, which is used to pay the parking fee for the first vehicle in the parking lot; the processing device using a first model to recognize the payment interface to obtain a fifth recognition result, which includes fifth operation instruction information, which instructs the execution of a fifth operation on the payment interface, which is used to pay the parking fee for the first vehicle in the parking lot; the processing device executing the fifth operation on the payment interface to obtain a seventh interface, which is used to confirm payment of the parking fee for the first vehicle in the parking lot.

[0056] Based on the above scheme, the processing device can use the model to output operation instructions for paying parking fees in the parking lot, and perform corresponding operations on the payment interface based on the operation instructions to assist the user in making the payment. In other words, some operations in the payment process can be automated, which can reduce the complexity of the user's payment operation and significantly improve the user experience.

[0057] Optionally, the processing device performs the fifth operation on the payment interface according to the fifth operation instruction information to obtain the seventh interface.

[0058] In one possible implementation of the second aspect, the fifth operation instruction information includes a second location indication and a second indication identifier. The method further includes: displaying the second indication identifier at a second location in the payment interface indicated by the second location indication, the second indication identifier including a cursor. The fifth operation includes at least one of the following: clicking the second location in the payment interface, sliding the second location in the payment interface, and entering information related to the identity of the first vehicle at the second location in the payment interface.

[0059] In another possible implementation of the second aspect, the method further includes: after the first vehicle enters the parking lot, acquiring at least one information identifier in the surrounding environment of the first vehicle. The processing device uses the first information identifier to obtain a first interface, wherein the first information identifier belongs to at least one information identifier. The processing device uses a first model to recognize an image of the first interface to obtain a first recognition result, wherein the first recognition result includes first indication information, which is used to indicate whether the first interface is a payment interface.

[0060] In another possible implementation of the second aspect, recognizing the image of the first interface using a first model to obtain a first recognition result includes: acquiring a text prompt, inputting the text prompt and the image of the first interface into the first model, and obtaining the first recognition result. Optionally, the text prompt may be input by the user, or the text prompt may be preset in the storage data of the processing device, and the processing device may retrieve the text prompt from the storage data of the processing device.

[0061] In another possible implementation of the second aspect, the method further includes: when the first indication information indicates that the first interface is a payment interface, the processing device generates first information and a second information identifier, wherein the first information is used to indicate that the first information identifier is a payment availability identifier for the parking lot, and the second information identifier is the second information identifier. The processing device displays a second interface, which includes the second information identifier.

[0062] Optionally, the first vehicle includes an interactive device, and the method further includes: the processing device outputting first information through the interactive device. The first information is output in at least one of the following methods: interface display, voice broadcast, etc.

[0063] In another possible implementation of the second aspect, the method further includes: when the first indication information is used to indicate that the first interface is not a payment interface, the processing device generates second information, the second information being used to indicate that the first information is identified as a payment unavailable sign for the parking lot.

[0064] Optionally, the first vehicle includes an interactive device, and the method further includes: the processing device outputting second information through the interactive device. The output of the second information may be performed via at least one of interface display, voice broadcast, etc.

[0065] In another possible implementation of the second aspect, when the first indication information is used to indicate that the first interface is not a payment interface, the first identification result further includes first operation indication information, which is used to indicate that a first operation is performed on the first interface so that the first interface jumps to a jumpable interface of the first interface.

[0066] In another possible implementation of the second aspect, the first operation instruction information includes a first position indicator and a first indicator identifier. The method further includes: displaying the first indicator identifier at a first position in the first interface indicated by the first position indicator, the first indicator identifier including a cursor. Optionally, the first position indicator includes coordinates or coordinates corresponding to a control.

[0067] In another possible implementation of the second aspect, the first operation includes clicking and / or swiping a first position in the first interface.

[0068] In another possible implementation of the second aspect, the first interface has multiple jumpable interfaces, and the method further includes: using a first model to identify the image of the first jumpable interface to obtain a second identification result, the second identification result including second indication information, the second indication information being used to indicate whether the first jumpable interface is a payment interface, and the first jumpable interface belongs to multiple jumpable interfaces.

[0069] In another possible implementation of the second aspect, the method further includes: when the second indication information indicates that the first jumpable interface is a payment interface, the processing device generates third information and a third information identifier, the third information indicating that the first information identifier is a payment availability identifier for the parking lot, and the eighth information identifier being the third information identifier. The processing device displays a third interface, which includes the third information identifier.

[0070] In another possible implementation of the second aspect, when the second indication information is used to indicate that the first jumpable interface is not a payment interface, the second identification result also includes second operation indication information, which is used to indicate that a second operation is performed on the first jumpable interface so that the first jumpable interface jumps to the second jumpable interface, and the second jumpable interface belongs to multiple jumpable interfaces.

[0071] In another possible implementation of the second aspect, when the second indication information indicates that the first jumpable interface is not a payment interface, the second identification result further includes third operation indication information and fourth operation indication information. The third operation indication information indicates that a third operation is performed on the first jumpable interface to redirect it to the first interface. The fourth operation indication information indicates that a fourth operation is performed on the first interface to redirect it to the third jumpable interface, where the third jumpable interface belongs to multiple jumpable interfaces. The method further includes: the processing device using a first model to identify an image of the third jumpable interface to obtain a third identification result, the third identification result including third indication information indicating whether the third jumpable interface is a payment interface.

[0072] In another possible implementation of the second aspect, the method further includes: the processing device using a first model to identify the image of each of a plurality of jumpable interfaces, obtaining a plurality of identification results, each of the plurality of identification results corresponding to one of the plurality of jumpable interfaces, and indication information in each identification result used to indicate whether the jumpable interface corresponding to each identification result is a payment interface. If the indication information in each identification result is used to indicate that the jumpable interface corresponding to each identification result is not a payment interface, the processing device generates fourth information, the fourth information used to indicate that the first information identifies the parking lot as a payment unavailable identifier.

[0073] In another possible implementation of the second aspect, the first model includes a first sub-model and a second sub-model. The processing device uses the first model to recognize an image of the first interface and obtains a first recognition result, including: the processing device uses the first sub-model to recognize an image of the first interface and obtains text information of the first interface. The processing device obtains the location of the first vehicle and inputs the image of the first interface, the text information of the first interface, and the location of the first vehicle into the second sub-model to obtain the first recognition result.

[0074] In another possible implementation of the second aspect, the method further includes: a processing device acquiring stored data corresponding to the location of the first vehicle, the stored data including a fourth information identifier. The processing device uses the fourth information identifier to obtain a fourth interface, uses a first model to recognize the image of the fourth interface, and obtains a fourth recognition result, the fourth recognition result including fourth indication information used to indicate whether the fourth interface is a payment interface. Based on the first recognition result, the fourth recognition result, the first information identifier, and the fourth information identifier, the processing device obtains a fifth information identifier, the eighth information identifier being the fifth information identifier. The processing device displays the fifth interface, the fifth interface including the fifth information identifier.

[0075] In another possible implementation of the second aspect, the method further includes: a processing device acquiring stored data corresponding to the location of a first vehicle, the stored data including a sixth information identifier and payment identifier information associated with the sixth information identifier, the payment identifier information being used to indicate whether at least one second vehicle has successfully paid for parking at a parking lot using the sixth information identifier. Based on a first identification result, the payment identifier information associated with the sixth information identifier, the first information identifier, and the sixth information identifier, the processing device obtains a seventh information identifier, and an eighth information identifier is the seventh information identifier. The processing device displays a sixth interface, the sixth interface including the seventh information identifier.

[0076] In another possible implementation of the second aspect, the payment identifier information includes multiple payment identifiers, including a first payment identifier, which indicates that the second vehicle has successfully paid its parking fee at the parking lot using a sixth information identifier. If the ratio between the number of first payment identifiers and the number of multiple payment identifiers is greater than a proportional threshold, the seventh information identifier is the sixth information identifier.

[0077] In another possible implementation of the second aspect, the method further includes: the processing device acquiring the parking fee standard and the parking duration of the first vehicle in the parking lot, and generating predicted payment information based on the parking fee standard and the parking duration of the first vehicle in the parking lot, the predicted payment information being used to indicate the predicted parking fee of the first vehicle in the parking lot.

[0078] In another possible implementation of the second aspect, the first vehicle includes an interactive device, and the method further includes: a processing device outputting predicted payment information through the interactive device. The output method of the predicted payment information includes at least one of interface display, voice broadcast, etc.

[0079] In another possible implementation of the second aspect, the method further includes: the processing device acquiring a second payment identifier, the second payment identifier being used to indicate whether the first vehicle successfully paid the parking fee for the first vehicle in the parking lot using the first information identifier. The processing device sends the first information identifier and the second payment identifier to a server. Optionally, the processing device may also send first information or second information to the server. In yet another possible implementation of the second aspect, the method further includes: the processing device acquiring an image of the surrounding environment of the first vehicle, and detecting whether the first vehicle has entered the parking lot based on the image of the surrounding environment of the first vehicle.

[0080] Thirdly, this application provides a processing apparatus, which includes a transceiver unit configured to acquire at least one information identifier in the surrounding environment of a first vehicle after the first vehicle enters a parking lot. The processing apparatus further includes a processing unit configured to obtain a first interface using the first information identifier, wherein the first information identifier belongs to at least one information identifier. The processing unit is further configured to recognize an image of the first interface using a first model to obtain a first recognition result, the first recognition result including first indication information, the first indication information indicating whether the first interface is a payment interface, and the payment interface being used to pay the parking fee for the first vehicle in the parking lot.

[0081] In one possible implementation of the third aspect, the transceiver unit is further configured to acquire text prompts. The processing unit is further configured to input the text prompts and the image of the first interface into the first model to obtain a first recognition result.

[0082] In one possible implementation of the third aspect, the processing unit is further configured to generate first information and a second information identifier when the first indication information indicates that the first interface is a payment interface, wherein the first information is used to indicate that the first information identifier is a payment availability identifier for the parking lot, and the second information identifier is used to identify the payment interface. The processing device further includes a display unit for displaying a second interface, the second interface including the second information identifier.

[0083] Optionally, the processing unit is further configured to output first information via an interactive device. The output method of the first information includes at least one of interface display, voice broadcast, etc.

[0084] In another possible implementation of the third aspect, the processing unit is further configured to generate second information when the first indication information indicates that the first interface is not a payment interface, the second information being used to indicate that the first information is identified as a payment unavailable sign for the parking lot.

[0085] Optionally, the processing unit is further configured to output second information via an interactive device. The output method of the second information includes at least one of interface display, voice broadcast, etc.

[0086] In another possible implementation of the third aspect, when the first indication information is used to indicate that the first interface is not a payment interface, the first identification result also includes first operation indication information, which is used to indicate that a first operation is performed on the first interface so that the first interface jumps to a jumpable interface of the first interface.

[0087] In another possible implementation of the third aspect, the first operation instruction information includes a first position indication and a first instruction identifier, and the display unit is further configured to display the first instruction identifier at a first position in the first interface indicated by the first position indication, the first instruction identifier including a cursor.

[0088] In another possible implementation of the third aspect, the first operation includes clicking a first area of ​​the first interface and / or swiping the first interface.

[0089] In another possible implementation of the third aspect, the first interface has multiple jumpable interfaces, and the processing unit is further configured to use the first model to identify the image of the first jumpable interface and obtain a second identification result. The second identification result includes second indication information, which is used to indicate whether the first jumpable interface is a payment interface and the first jumpable interface belongs to multiple jumpable interfaces.

[0090] In another possible implementation of the third aspect, the processing unit is further configured to generate third information and a third information identifier when the second indication information indicates that the first jumpable interface is a payment interface. The third information is used to indicate that the first information identifier is a payment availability identifier for the parking lot, and the third information identifier is used to identify the payment interface. The display unit is further configured to display a third interface, which includes the third information identifier.

[0091] In another possible implementation of the third aspect, when the second indication information is used to indicate that the first jumpable interface is not a payment interface, the second identification result also includes second operation indication information, which is used to indicate that a second operation is performed on the first jumpable interface so that the first jumpable interface jumps to the second jumpable interface, and the second jumpable interface belongs to multiple jumpable interfaces.

[0092] In another possible implementation of the third aspect, when the second indication information indicates that the first jumpable interface is not a payment interface, the second identification result further includes third operation indication information and fourth operation indication information. The third operation indication information indicates that a third operation is performed on the first jumpable interface to redirect it to the first interface. The fourth operation indication information indicates that a fourth operation is performed on the first interface to redirect it to the third jumpable interface, where the third jumpable interface belongs to multiple jumpable interfaces. The processing unit is further configured to recognize the image of the third jumpable interface using the first model to obtain a third identification result, which includes the third indication information indicating whether the third jumpable interface is a payment interface.

[0093] In another possible implementation of the third aspect, the processing unit is further configured to use the first model to identify the image of each of the multiple jumpable interfaces, obtaining multiple identification results. Each identification result corresponds to one of the multiple jumpable interfaces, and the indication information in each identification result is used to indicate whether the jumpable interface corresponding to each identification result is a payment interface. The processing unit is further configured to generate fourth information if the indication information in each identification result indicates that the jumpable interface corresponding to each identification result is not a payment interface. The fourth information is used to indicate that the first information identifies the parking lot as a payment unavailable sign.

[0094] In another possible implementation of the third aspect, the first model includes a first sub-model and a second sub-model. The processing unit is further configured to use the first sub-model to recognize the image of the first interface and obtain the text information of the first interface. The transceiver unit is further configured to obtain the location of the first vehicle, and the processing unit is further configured to input the image of the first interface, the text information of the first interface, and the location of the first vehicle into the second sub-model to obtain a first recognition result.

[0095] In another possible implementation of the third aspect, the transceiver unit is further configured to acquire stored data corresponding to the location of the first vehicle, the stored data including a fourth information identifier. The processing unit is further configured to obtain a fourth interface using the fourth information identifier, recognize the image of the fourth interface using the first model, and obtain a fourth recognition result, the fourth recognition result including fourth indication information used to indicate whether the fourth interface is a payment interface. The processing unit is further configured to obtain a fifth information identifier based on the first recognition result, the fourth recognition result, the first information identifier, and the fourth information identifier, the fifth information identifier used to identify the payment interface. The display unit is further configured to display the fifth interface, the fifth interface including the fifth information identifier.

[0096] In another possible implementation of the third aspect, the transceiver unit is further configured to acquire stored data corresponding to the location of the first vehicle. The stored data includes a sixth information identifier and payment identifier information associated with the sixth information identifier. The payment identifier information is used to indicate whether at least one second vehicle has successfully paid its parking fee at the parking lot using the sixth information identifier. The processing unit is further configured to obtain a seventh information identifier based on the first identification result, the payment identifier information associated with the sixth information identifier, the first information identifier, and the sixth information identifier. The seventh information identifier is used to identify the payment interface. The display unit is further configured to display a sixth interface, which includes the seventh information identifier.

[0097] In another possible implementation of the third aspect, the payment identifier information includes multiple payment identifiers, including a first payment identifier, which indicates that the second vehicle has successfully paid its parking fee at the parking lot using the sixth information identifier. If the ratio between the number of first payment identifiers and the number of multiple payment identifiers is greater than a proportional threshold, the seventh information identifier is the sixth information identifier.

[0098] In another possible implementation of the third aspect, the transceiver unit is further configured to acquire the parking fee standard and the parking duration of the first vehicle in the parking lot. The processing unit is further configured to generate predicted payment information based on the parking fee standard and the parking duration of the first vehicle in the parking lot, the predicted payment information being used to indicate the predicted parking fee for the first vehicle in the parking lot.

[0099] In another possible implementation of the third aspect, the processing unit is further configured to use the first model to identify the payment interface to obtain a fifth identification result, the fifth identification result including fifth operation instruction information, the fifth operation instruction information being used to instruct the payment interface to perform a fifth operation, the fifth operation being used to pay the parking fee of the first vehicle in the parking lot.

[0100] In another possible implementation of the third aspect, the fifth operation instruction information includes a second location indication and a second indication identifier. The display unit is further configured to display the second indication identifier at a second location in the payment interface indicated by the second location indication. The second indication identifier includes a cursor. The fifth operation includes at least one of the following: clicking the second location in the payment interface, sliding the second location in the payment interface, or entering information related to the identity of the first vehicle at the second location in the payment interface.

[0101] In another possible implementation of the third aspect, the processing unit is further configured to perform a fifth operation on the payment interface to obtain a seventh interface, which is used to confirm payment of the parking fee for the first vehicle in the parking lot.

[0102] In another possible implementation of the third aspect, the transceiver unit is further configured to acquire a second payment identifier, which indicates whether the first vehicle has successfully paid its parking fee at the parking lot using the first information identifier. The transceiver unit is also configured to send the first information identifier and the second payment identifier to the server. Optionally, the processing unit may also be configured to send either first information or second information to the server.

[0103] In another possible implementation of the third aspect, the transceiver unit is further configured to acquire an image of the surrounding environment of the first vehicle, and the processing unit is further configured to detect whether the first vehicle has entered the parking lot based on the image of the surrounding environment of the first vehicle.

[0104] Fourthly, this application provides a processing apparatus, including a transceiver unit for acquiring an eighth information identifier. The processing apparatus further includes a processing unit for obtaining a payment interface using the eighth information identifier, the payment interface being used to pay the parking fee for a first vehicle in a parking lot. The processing unit is also used to identify the payment interface using a first model to obtain a fifth identification result, the fifth identification result including fifth operation instruction information, the fifth operation instruction information being used to instruct the payment interface to perform a fifth operation, the fifth operation being used to pay the parking fee for the first vehicle in the parking lot. The processing unit is also used to perform the fifth operation on the payment interface to obtain a seventh interface, the seventh interface being used to confirm payment of the parking fee for the first vehicle in the parking lot.

[0105] Optionally, the processing unit is also configured to perform a fifth operation on the payment interface according to the fifth operation instruction information to obtain a seventh interface.

[0106] In one possible implementation of the fourth aspect, the fifth operation instruction information includes a second location indication and a second indication identifier. The processing device further includes a display unit for displaying the second indication identifier at a second location in the payment interface indicated by the second location indication. The second indication identifier includes a cursor. The fifth operation includes at least one of the following: clicking the second location in the payment interface, sliding the second location in the payment interface, and entering information related to the identity of the first vehicle at the second location in the payment interface.

[0107] In another possible implementation of the fourth aspect, the transceiver unit is further configured to acquire at least one information identifier in the surrounding environment of the first vehicle after the first vehicle enters the parking lot. The processing unit is further configured to obtain a first interface using the first information identifier, wherein the first information identifier belongs to at least one information identifier. The processing unit is further configured to recognize the image of the first interface using a first model to obtain a first recognition result, wherein the first recognition result includes first indication information, the first indication information being used to indicate whether the first interface is a payment interface, and the payment interface being used to pay the parking fee for the first vehicle in the parking lot.

[0108] In another possible implementation of the fourth aspect, the transceiver unit is further configured to acquire text prompts, and the processing unit is further configured to input the text prompts and the image of the first interface into the first model to obtain a first recognition result.

[0109] In another possible implementation of the fourth aspect, the processing unit is further configured to generate first information and second information identifier when the first indication information indicates that the first interface is a payment interface, wherein the first information is used to indicate that the first information identifier is a payment availability identifier for the parking lot, and the second information identifier is the second information identifier. The processing device further includes a display unit configured to display a second interface, the second interface including the second information identifier.

[0110] Optionally, the processing unit is further configured to output first information via an interactive device. The output method of the first information includes at least one of interface display, voice broadcast, etc.

[0111] In another possible implementation of the fourth aspect, the processing unit is further configured to generate second information when the first indication information indicates that the first interface is not a payment interface, the second information indicating that the first information is identified as a payment unavailable sign for the parking lot.

[0112] Optionally, the processing unit is further configured to output second information via an interactive device. The output method of the second information includes at least one of interface display, voice broadcast, etc.

[0113] In another possible implementation of the fourth aspect, when the first indication information is used to indicate that the first interface is not a payment interface, the first identification result also includes first operation indication information, which is used to indicate that a first operation is performed on the first interface so that the first interface jumps to a jumpable interface of the first interface.

[0114] In another possible implementation of the fourth aspect, the first operation instruction information includes a first position indication and a first instruction identifier, and the display unit is further configured to display the first instruction identifier at a first position in the first interface indicated by the first position indication, the first instruction identifier including a cursor.

[0115] In yet another possible implementation of the fourth aspect, the first operation includes clicking and / or swiping a first position in the first interface.

[0116] In another possible implementation of the fourth aspect, the first interface has multiple jumpable interfaces, and the processing unit is further configured to use the first model to identify the image of the first jumpable interface and obtain a second identification result. The second identification result includes second indication information, which is used to indicate whether the first jumpable interface is a payment interface and the first jumpable interface belongs to multiple jumpable interfaces.

[0117] In another possible implementation of the fourth aspect, the processing unit is further configured to generate third information and a third information identifier when the second indication information indicates that the first jumpable interface is a payment interface. The third information is used to indicate that the first information identifier is a payment availability identifier for the parking lot, and the eighth information identifier is the third information identifier. The display unit is further configured to display a third interface, which includes the third information identifier.

[0118] In another possible implementation of the fourth aspect, when the second indication information is used to indicate that the first jumpable interface is not a payment interface, the second identification result also includes second operation indication information, which is used to indicate that a second operation is performed on the first jumpable interface so that the first jumpable interface jumps to the second jumpable interface, and the second jumpable interface belongs to multiple jumpable interfaces.

[0119] In another possible implementation of the fourth aspect, when the second indication information indicates that the first jumpable interface is not a payment interface, the second identification result further includes third operation indication information and fourth operation indication information. The third operation indication information indicates that a third operation is performed on the first jumpable interface to redirect it to the first interface. The fourth operation indication information indicates that a fourth operation is performed on the first interface to redirect it to the third jumpable interface, where the third jumpable interface belongs to multiple jumpable interfaces. The processing unit is further configured to recognize the image of the third jumpable interface using the first model to obtain a third identification result, which includes the third indication information indicating whether the third jumpable interface is a payment interface.

[0120] In another possible implementation of the fourth aspect, the processing unit is further configured to use the first model to identify the image of each of the multiple jumpable interfaces, obtaining multiple identification results. Each identification result corresponds to one of the multiple jumpable interfaces, and the indication information in each identification result is used to indicate whether the jumpable interface corresponding to each identification result is a payment interface. The processing unit is further configured to generate fourth information if the indication information in each identification result indicates that the jumpable interface corresponding to each identification result is not a payment interface. The fourth information is used to indicate that the first information identifies the parking lot as a payment unavailable sign.

[0121] In another possible implementation of the fourth aspect, the first model includes a first sub-model and a second sub-model. The processing unit is further configured to use the first sub-model to recognize the image of the first interface and obtain the text information of the first interface. The transceiver unit is further configured to obtain the location of the first vehicle, and the processing unit is further configured to input the image of the first interface, the text information of the first interface, and the location of the first vehicle into the second sub-model to obtain a first recognition result.

[0122] In another possible implementation of the fourth aspect, the transceiver unit is further configured to acquire stored data corresponding to the location of the first vehicle, the stored data including a fourth information identifier. The processing unit is further configured to obtain a fourth interface using the fourth information identifier, recognize the image of the fourth interface using the first model, and obtain a fourth recognition result, the fourth recognition result including fourth indication information used to indicate whether the fourth interface is a payment interface. The processing unit is further configured to obtain a fifth information identifier based on the first recognition result, the fourth recognition result, the first information identifier, and the fourth information identifier, the eighth information identifier being the fifth information identifier. The display unit is further configured to display the fifth interface, the fifth interface including the fifth information identifier.

[0123] In another possible implementation of the fourth aspect, the transceiver unit is further configured to acquire stored data corresponding to the location of the first vehicle. The stored data includes a sixth information identifier and payment identifier information associated with the sixth information identifier. The payment identifier information is used to indicate whether at least one second vehicle has successfully paid its parking fee at the parking lot using the sixth information identifier. The processing unit is further configured to obtain a seventh information identifier based on the first identification result, the payment identifier information associated with the sixth information identifier, the first information identifier, and the sixth information identifier. An eighth information identifier is obtained from the seventh information identifier. The display unit is further configured to display a sixth interface, which includes the seventh information identifier.

[0124] In another possible implementation of the fourth aspect, the payment identifier information includes multiple payment identifiers, including a first payment identifier, which indicates that the second vehicle has successfully paid its parking fee at the parking lot using the sixth information identifier. If the ratio between the number of first payment identifiers and the number of multiple payment identifiers is greater than a proportional threshold, the seventh information identifier is the sixth information identifier.

[0125] In another possible implementation of the fourth aspect, the transceiver unit is further configured to acquire the parking fee standard and the parking duration of the first vehicle in the parking lot. The processing unit is further configured to generate predicted payment information based on the parking fee standard and the parking duration of the first vehicle in the parking lot, the predicted payment information being used to indicate the predicted parking fee for the first vehicle in the parking lot.

[0126] In another possible implementation of the fourth aspect, the transceiver unit is further configured to acquire a second payment identifier, which indicates whether the first vehicle has successfully paid its parking fee at the parking lot using the first information identifier. The transceiver unit is also configured to send the first information identifier and the second payment identifier to the server. Optionally, the processing unit may also be configured to send either first information or second information to the server.

[0127] In another possible implementation of the fourth aspect, the transceiver unit is further configured to acquire an image of the surrounding environment of the first vehicle, and the processing unit is further configured to detect whether the first vehicle has entered the parking lot based on the image of the surrounding environment of the first vehicle.

[0128] Fifthly, embodiments of this application provide a computing device, the computing device including a processor and a memory, the memory storing a program, the processor executing the program stored in the memory to cause the computing device to implement the method described in any of the first or second aspects above.

[0129] Sixthly, this application provides a vehicle that includes the processing device described in the third aspect or the computing device described in the fifth aspect, and the vehicle is used to implement the method described in any of the first aspects; or, the vehicle includes the processing device described in the fourth aspect or the computing device described in the fifth aspect, and the vehicle is used to implement the method described in any of the second aspects.

[0130] In a seventh aspect, embodiments of this application provide a computer-readable storage medium for storing a computer program, the computer program including instructions for performing the methods described in any of the first or second aspects.

[0131] Eighthly, this application provides a computer program product including computer instructions that, when executed by a processing device, computing apparatus, or processor, cause the methods described in any of the first or second aspects to be implemented.

[0132] Ninthly, this application provides a chip including a processor for executing computer execution instructions to cause a device on which the chip is mounted to perform the methods described in any of the first or second aspects.

[0133] The solutions provided in the second to ninth aspects above are used to implement or cooperate with the methods provided in the first aspect above, and therefore can achieve the same or corresponding beneficial effects as the first aspect, which will not be elaborated here. Attached Figure Description

[0134] The accompanying drawings used in the description of the embodiments will be briefly introduced below.

[0135] Figure 1 This is a schematic diagram of the architecture of a UIAgent provided in an embodiment of this application;

[0136] Figure 2A This is a schematic diagram of the architecture of a processing system provided in an embodiment of this application;

[0137] Figure 2B This is a schematic diagram of the architecture of a vehicle provided in an embodiment of this application;

[0138] Figure 3 This is a schematic diagram of the location of components inside a vehicle provided in an embodiment of this application;

[0139] Figure 4 This is a schematic diagram of an interactive scenario provided in an embodiment of this application;

[0140] Figure 5 This is a flowchart illustrating an interaction method provided in an embodiment of this application;

[0141] Figure 6 This is a schematic diagram of a first interface provided in an embodiment of this application;

[0142] Figure 7 This is a schematic diagram of yet another first interface provided in an embodiment of this application;

[0143] Figure 8 This is a schematic diagram of yet another first interface provided in an embodiment of this application;

[0144] Figure 9 This is a schematic diagram of yet another first interface provided in an embodiment of this application;

[0145] Figure 10 This is a schematic diagram of yet another first interface provided in an embodiment of this application;

[0146] Figure 11 This is a schematic diagram of yet another first interface provided in an embodiment of this application;

[0147] Figure 12 This is a schematic diagram of a second interface provided in an embodiment of this application;

[0148] Figure 13 This is a schematic diagram of a jumpable interface provided in an embodiment of this application;

[0149] Figure 14 This is a schematic diagram of another jumpable interface provided in the embodiments of this application;

[0150] Figure 15 This is a schematic diagram of another jumpable interface provided in the embodiments of this application;

[0151] Figure 16 This is a schematic diagram of another jumpable interface provided in the embodiments of this application;

[0152] Figure 17 This is a schematic diagram of another jumpable interface provided in the embodiments of this application;

[0153] Figure 18This is a schematic diagram of another jumpable interface provided in the embodiments of this application;

[0154] Figure 19 This is a schematic diagram of another jumpable interface provided in the embodiments of this application;

[0155] Figure 20 This is a flowchart illustrating another interaction method provided in an embodiment of this application;

[0156] Figure 21 This is a schematic diagram of the structure of a processing device provided in an embodiment of this application;

[0157] Figure 22 This is a schematic diagram of the structure of another processing device provided in the embodiments of this application;

[0158] Figure 23 This is a schematic diagram of the structure of a computing device provided in an embodiment of this application. Detailed Implementation

[0159] For ease of understanding, the following examples illustrate some concepts related to the embodiments of this application for reference. As follows:

[0160] 1. A visual encoder is essentially a type of neural network whose core function is to convert visual data such as images or videos into fixed-dimensional feature vectors. These feature vectors can then be used for downstream tasks such as image classification, object detection, and image generation.

[0161] 2. Optical Character Recognition (OCR) Model: A model used to perform optical character recognition tasks. The OCR model is used to recognize the text content in an image and convert it into a computer-editable text format. In other words, the output of the OCR model is text information.

[0162] 3. A model is an algorithm or data structure that can extract patterns and rules from data, thereby enabling tasks such as prediction, classification, and generation of data. For example, neural network models, such as convolutional neural networks and recurrent neural networks, can recognize images and process natural language by performing multi-layer feature extraction and transformation on input data.

[0163] The model in this embodiment can be used to identify various elements in images, such as controls, icons, and text. By recognizing images through the model, large amounts of interface image data can be processed quickly. Moreover, unlike humans, the model is not affected by emotions or fatigue, and it performs recognition tasks according to fixed rules and algorithms each time, ensuring consistency in the recognition results. In addition to basic interface image element recognition, the model can also perform deeper intelligent analysis. For example, by combining natural language processing technology with the interface image recognition model, it can understand the text content on the interface image and analyze its semantic information, providing users with a more intelligent interactive experience. Furthermore, the model can predict user behavior and needs based on the layout of interface elements and user operation history, enabling personalized interface recommendations and optimizations.

[0164] In this application, the model can be a user interface agent (UIAgent), which is an agent implemented using multimodal large model technology. Based on image and text input, combined with user instructions, UIAgent can achieve the following functions: (1) It can understand image and text tasks and generate commands for the next operation. (2) It can use external tools to simulate human operation of the machine. (3) It can receive feedback from the external environment, execute multi-step operations step by step, and automatically complete complex tasks.

[0165] The following is combined with Figure 1 This application introduces the UIAgent technology provided. Combined with... Figure 1 The UIAgent comprises a plan model, an action model, and a visual encoder. The visual encoder takes as input either a screenshot of the vehicle's infotainment system screen or a screenshot of a virtual screen within the system. Based on the screenshot, the visual encoder obtains a feature vector. This feature vector is then input into the plan model.

[0166] The planning model performs planning or decision-making based on text prompts and feature vectors from screenshots, outputting strategies or methods. The text prompts indicate the task or function of the planning model; for example, the prompt might be, "Based on screenshots of the vehicle's infotainment system or virtual screen, locate payment information (such as a payment interface) as much as possible, and determine whether the screenshot is a valid payment interface."

[0167] After a strategy or method is input into the operation model, the operation model can output operation instructions. The vehicle's application programming interface (API) or tools in the vehicle system execute the corresponding operation based on the operation instructions, and an updated screenshot image will be displayed on the vehicle's screen or virtual screen.

[0168] The updated screenshot can be used as input data for the next visual encoder, thus repeating the process from visual encoder to planning model to operation model to vehicle API or tool, until the output of UIAgent is the desired result.

[0169] Optionally, UIAgent may also include a criticism model. After receiving the operation instruction information from the operation model, the criticism model can determine whether the operation instruction information is valid, such as whether the control indicated by the operation instruction information is valid. If the operation instruction information is determined to be valid, the operation instruction information is output to the vehicle system API or tool.

[0170] Optionally, the UIAgent may also include an OCR model. The OCR model acquires the feature vector of the screenshot image from the visual encoder and outputs the text information (e.g., text in the screenshot image) of the screenshot image based on the feature vector. Optionally, the OCR model may have a built-in visual encoder, so that the OCR model can obtain the text information of the screenshot image based on the screenshot image of the vehicle screen or virtual screen. The text information of the screenshot image output by the OCR model can be used as another input data for the planning model, thereby improving the accuracy of the planning model's planning or decision-making.

[0171] Optionally, the input data for the planning model may also include vehicle information, such as page parameters of screenshots of vehicle screens or virtual screens (e.g., page layout information, what information a certain area of ​​a webpage corresponds to, etc.) and / or the location of the vehicle (e.g., address text information converted from the vehicle's latitude and longitude information through reverse geocoding), thereby improving the accuracy of the planning model's planning or decision-making.

[0172] In some scenarios, the vehicle's infotainment screen or virtual screen needs to interact with the user. For example, the user needs to manually log in or register a personal account to make a payment. In this case, the infotainment screen or virtual screen can receive feedback, and based on this feedback, corresponding text prompts can be generated (e.g., "Please help me register a personal account, information is XXXX"). The planning model can then be used to assist the user in the registration process.

[0173] In one possible implementation, the image of the interface obtained using information identification is used as the perceptual input of the UIAgent (i.e., a screenshot of the vehicle screen or virtual screen is the image of the interface obtained using information identification). This is combined with text prompts (e.g., "Is this a payment interface?", "How to find the payment interface?", "Is this a valid parking payment QR code?") to enable the UIAgent to make a judgment (e.g., determining whether the current interface is a payment interface). For example, the UIAgent's output includes indication information indicating whether the current interface is a payment interface. Based on the UIAgent's understanding of the interface image content and the execution of the text prompts, the UIAgent can ultimately determine the validity of the information identification. The text prompts can be input by the user or pre-set in the vehicle system's stored data. The vehicle system can retrieve the text prompts from its stored data and input them into the UIAgent.

[0174] Optionally, the UIAgent can use the image of the interface obtained by using information identification as the perception input, and in conjunction with text prompts (e.g., "How to find the parking payment interface?"), the UIAgent can also make decisions (e.g., which area should be clicked to find the payment interface). For example, the output of the UIAgent may also include operation instruction information (e.g., to indicate which area should be clicked).

[0175] Optionally, in this application, UIAgent can find the payment interface corresponding to the information identifier by repeatedly executing the process from the visual encoder to the planning model to the operation model to the vehicle API or tool, or can determine that the information identifier cannot obtain a payment interface (i.e., invalid information identifier or unusable information identifier), thereby realizing the validity judgment of the information identifier.

[0176] Optionally, the UIAgent can use the image of the payment interface as its perception input, combined with text prompts (such as "I need to pay for parking, what should I do next?" or "Please fill in my license plate number"). The UIAgent can also make decisions (such as which area to click or what information to enter to complete the parking payment). For example, the UIAgent's output may also include operation instructions (such as indicating which area to click or information related to the vehicle's identity (such as the license plate number) to complete the parking payment), thereby assisting the user in the payment operation and reducing the complexity of the user's payment operation.

[0177] Scanning QR codes to pay parking fees is a common method. However, parking lots often contain a wealth of information, including QR codes for various purposes such as shopping mall information, commercial advertisements, and parking payment. Users often struggle to distinguish between different payment QR codes, resulting in a poor user experience in parking payment scenarios.

[0178] In view of this, this application provides an interaction method and related apparatus that can identify information markers in the parking lot surrounding the vehicle based on a model, determine the validity of information markers outside the vehicle, improve the validity of information markers subsequently pushed to the user, improve the efficiency of parking payment, enhance the universality and convenience of payment methods, and improve the user experience.

[0179] The following section provides an exemplary description of the systems and scenarios in which this application may be applied. It should be noted that the system architecture and business scenarios described in this application are for the purpose of more clearly illustrating the technical solutions of this application and do not constitute a limitation on the technical solutions provided in this application. Those skilled in the art will understand that, with the evolution of system architecture and the emergence of new business scenarios, the technical solutions provided in this application are equally applicable to similar technical problems.

[0180] Please see Figure 2A , Figure 2A This is a schematic diagram of the architecture of a processing system provided in this application, including a processing device 201 and a sensor 202. The processing device 201 is a device with data processing capabilities, which may include hardware modules with data processing capabilities and / or software modules with data processing capabilities. Examples are given below based on hardware implementation and software implementation respectively.

[0181] As an example of hardware implementation, the processing device 201 may include at least one processor, which is a circuit with processing capabilities. In one implementation, the processor may be a circuit with instruction read and execute capabilities, such as a central processing unit (CPU), microprocessor, microcontroller unit (MCU), graphics processing unit (GPU), or digital signal processor (DSP). In another implementation, the processor can implement certain functions through the logical relationships of hardware circuits, which may be fixed or reconfigurable. For example, the processor may be a hardware circuit implemented as an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as a field-programmable gate array (FPGA). In reconfigurable hardware circuits, the process of the processor loading a configuration document and configuring the hardware circuit can be understood as the process of the processor loading instructions to implement a response function. Furthermore, the processor can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), tensor processing unit (TPU), deep learning processing unit (DPU), etc. In some implementations, the processing device 201 includes at least one processor integrated as a system-on-chip (SOC), which is commonly referred to as an SOC by those skilled in the art. The SOC may include at least one processor, and when the SOC includes multiple processors, the types of processors can be different, such as including a CPU and an NPU. For example, the processing device 201 may also include one or more of the following: a handheld terminal, a wearable terminal, a vehicle, or a network device.

[0182] As an example of software implementation, processing device 201 may include software functional units. As another example of a software functional unit, processing device 201 may include computing instances, such as virtual machines, containers, and the cloud. A virtual machine is a computer system with complete hardware system functionality simulated by software and running in an isolated environment. A container is an isolated environment obtained by packaging applications and their dependencies. The cloud is a software platform using application virtualization technology, enabling one or more software applications to be developed and run in an independent virtualization environment. Optionally, the cloud may be deployed on a public cloud, private cloud, or hybrid cloud. As yet another example of a software functional unit, processing device 201 may include code that can run on a computing instance, wherein the computing instance may include at least one of a physical host (computing device), a virtual machine, and a container.

[0183] Sensor 202 is capable of acquiring information about the environment, which can be represented in the form of images, point clouds, fused data (e.g., depth images), video frames, etc. For example, the sensor may include vision-based sensors and / or radar-based sensors.

[0184] Vision sensors include image sensors (often called cameras) used to acquire image data, including images and videos. An image sensor may contain multiple photosensitive units that sense light signals and form images. Examples of photosensitive units include complementary metal-oxide-semiconductor (CMOS), charge-coupled devices (CCD), and Live MOS. Image sensors are typically classified based on the type of photosensitive units they contain. For example, an image sensor with CMOS photosensitive units is called a CMOS image sensor (CIS). A CIS may include one or more of the following: a color sensor, a monosensor, etc. A color sensor may include a red-green-blue channel sensor (RGB sensor). Taking cameras as an example, vision sensors may include monocular cameras, binocular cameras, time-of-flight (TOF) cameras, cameras in driver monitoring systems (DMS), or cameras in cockpit monitoring systems (CMS).

[0185] Radar sensors are used to detect objects using electromagnetic waves and obtain point cloud data. Based on the different detection signals emitted, radar sensors can be classified into millimeter-wave radar, centimeter-wave radar, ultrasonic radar, lidar, and other categories.

[0186] Optionally, the processing system may also include a display device 203. The display device 203 has interface display capabilities. The display device 203 may include one or more of the following: a physical screen (such as a central control screen), a projection system, a smart device, or a button panel. The projection system may include, for example, a light field screen, a head-up display (HUD), or other projection systems.

[0187] The above describes the various devices in the processing system. (Combined with...) Figure 2A It can be seen that there can be interconnections between multiple devices in the processing system. Figure 2A The example illustrates a device connection method. It should be understood that for two connected devices, such as sensor 202 and processing device 201, the connection method can be wired, wireless, or a combination of wired and wireless connections. This connection includes direct and / or indirect connections; for example, sensor 202 and processing device 201 may be indirectly connected through intermediate nodes, which may be one or more. For instance, processing device 201 is connected to sensor 202 and can receive sensor data sent by sensor 202 according to the connection line between them. As another example, display device 203 is connected to processing device 201, and display device 203 can receive content sent (or output) by processing device 201 through the connection line between them and display that content through an interface.

[0188] Optionally, the multiple devices included in the processing system can be set up independently, integrated together, or partially designed independently and partially integrated. For example, sensor 202 is integrated with processing device 201. Another example is that display device 203, sensor 202, and processing device 201 are integrated together. Yet another example is that sensor 202 and processing device 201 are integrated in one device, while display device 203 is integrated in another device. Yet another example is that sensor 202 and processing device 201 are integrated in device A, while display device 203 is located in device B, where device A and device B are different devices.

[0189] In some cases, at least a portion of the above systems can be installed inside the vehicle. The following section combines... Figure 2BA vehicle 20 is described, which includes a processing unit 201. Exemplarily, the processing unit 201 includes, but is not limited to, a mobile data center (MDC), a domain controller (DC), an electronic control unit (ECU), a vehicle integrated / integration unit (VIU), etc.

[0190] For example, the processing device 201 can process information about the surrounding environment of the vehicle 20. For instance, the processing device 201 can acquire at least one information identifier in the surrounding environment of the vehicle 20 and obtain a first interface using the first information identifier. The information identifier can carry information, such as an image or video, or a barcode or QR code. For example, the information identifier can carry information about a shopping mall, commercial advertisements, or a parking payment platform URL. When the information identifier carries a parking payment platform URL, the interface corresponding to the parking payment platform URL (which can be referred to as the payment interface for ease of description) can be obtained using the information identifier. By operating on this payment interface, the parking fee for the vehicle at the parking lot corresponding to the parking payment platform URL can be paid.

[0191] Optionally, the surrounding environment information of vehicle 20 is provided by sensor 202, or the surrounding environment information of vehicle 20 is obtained by processing device 201 based on the data collected by sensor 202. Optionally, the sensor 202 can be installed at the front, rear, door, or top of the vehicle, etc.

[0192] Sensor 202 has information acquisition capabilities, enabling it to collect environmental perception data. Optionally, the sensor data includes image data and / or point cloud data. Image data includes images of the surrounding environment of vehicle 20. Point cloud data includes point cloud data of targets around vehicle 20.

[0193] Optionally, vehicle 20 may also include a display device 203. The display device 203 has interface display capabilities. For example... Figure 3 A central control screen 2031 can be installed on the vehicle's center console. This screen is used to display the vehicle's driving route, payment interface, information icons, configuration information of vehicle functions, or play audio and video, etc. Besides the central control screen, other types of display devices 203 are also installed in the vehicle, such as... Figure 3Passengers in the front passenger seat and rear seats can interact with the vehicle through the display device 203. The display device 203 (including the central control screen 2031) can include one or more of the following: a physical screen, a projection system, a smart device, or a button panel. Projection systems include, for example, light field screens, head-up displays, or other projection systems. This application does not strictly limit the number or location of the display device 203 in the applicable scenario. Taking the application of this application in a vehicle as an example, the display device 203 can be located in front of the front passenger seat, on the headrest (or backrest) of the front seat, on the armrest of the seat, on the door, or on the top of the cabin.

[0194] Of course, vehicle 20 also includes devices that support vehicle movement and braking, such as a driving system and a braking system, which are not described in detail here. It should be understood that the types of vehicles shown here are only examples, and in specific implementations, vehicle 20 can be different types of vehicles such as cars, trucks, trains, buses, vans, and electric vehicles.

[0195] The vehicle architecture has been described above. The following is an exemplary description of the specific devices and scenarios in which this application is applied.

[0196] The following describes a scenario of interaction between vehicles and parking lots. Please refer to [link / reference]. Figure 4 , Figure 4 This is a schematic diagram of an interactive scenario provided in this application. Vehicle 20 is located in parking lot 30 and is about to leave parking lot 30. Vehicle 20 needs to pay the parking fee for parking lot 30. There is at least one information marker in the surrounding environment of parking lot 30 where vehicle 20 is located. Figure 3The following example illustrates the situation where two information markers (such as information marker 301 and information marker 302) exist in the environment surrounding the parking lot 30 where vehicle 20 is located. Sensor 202 in vehicle 20 acquires information about the environment surrounding the parking lot 30. Processing device 201 in vehicle 20 acquires this information from sensor 202 and obtains at least one information marker (such as information marker 301 and information marker 302) based on this information. Processing device 201 can use information marker 301 to obtain a first interface and use a first model to recognize the image of the first interface, obtaining a first recognition result. The first recognition result includes first indication information, which indicates whether the first interface is a payment interface, used to pay the parking fee for vehicle 20 in the parking lot. In other words, processing device 201 can use the first model to recognize the image of the interface obtained from information marker 301 in the environment surrounding the parking lot 30, determining whether the interface obtained from information marker 301 is a payment interface, i.e., determining whether information marker 301 is a parking payment marker. Similarly, the processing device 201 can also use the first model to identify the image of the interface obtained from the information sign 302 in the environment surrounding the parking lot 30, and determine whether the interface obtained from the information sign 302 is a payment interface, that is, determine whether the information sign 302 is a parking payment sign.

[0197] The first model is a model pre-trained based on training data; for example, the first model could be... Figure 1 The UIAgent shown is an example. For instance, the first model can make a judgment based on the image of the interface obtained from the information identifier (e.g., whether the current interface is a payment interface). For example, the output of the first model includes indication information, which is used to indicate whether the current interface is a payment interface, thereby realizing the validity judgment of the information identifier.

[0198] For another example, the first model can make decisions based on the image of the interface obtained from the information identification (e.g., which area should be clicked to find the payment interface). For example, the output of the first model also includes operation instruction information (e.g., to indicate which area should be clicked).

[0199] For another example, the first model can make decisions based on the image of the payment interface (e.g., which area to click or what information to enter to complete the parking payment, or, if I need to pay for parking, what should I do next?). For example, the output of UIAgent also includes operation instructions (e.g., indicating which area to click or information related to the vehicle's identity (such as the license plate number) to complete the parking payment), thereby assisting the user in making the payment and reducing the complexity of the user's payment operation.

[0200] The methods of the embodiments of this application will be described in detail below.

[0201] Please see Figure 5 , Figure 5 This is a flowchart illustrating an interaction method provided in an embodiment of this application. Optionally, this method can be applied to a vehicle, for example, to... Figure 2B The vehicle 20 shown can be executed by the processing unit 201 within the vehicle 20. For ease of description, the following description uses the processing unit as the executing entity.

[0202] like Figure 5 The interactive method shown may include one or more of steps S501 to S503.

[0203] Step S501: The processing device acquires at least one information identifier in the surrounding environment of the first vehicle.

[0204] A processing device is a device with data processing capabilities, including processors (such as chips and integrated circuits), chip systems (such as SOCs), devices integrating processors, smart terminals integrating multiple devices, and network devices. Among these, computing devices integrating processors include mobile data centers (MDCs), domain controllers (DCs), electronic control units (ECUs), and vehicle integrated / integration units (VIUs); smart terminals integrating multiple devices include handheld terminals, wearable terminals, and vehicles; and network devices include gateways (GWs).

[0205] Optionally, the processing device is located in the first vehicle. The first vehicle can be different types of vehicles such as automobiles, trucks, trains, buses, vans, and electric vehicles.

[0206] Information identifiers can carry information and can be images, graphics, or other identifiers used to guide interfaces, such as barcodes or QR codes. For example, information identifiers can be used to carry information about a shopping mall, commercial advertisements, or the URL of a parking payment platform. When an information identifier carries the URL of a parking payment platform, it provides access to the interface corresponding to that URL (which can be referred to as the payment interface for ease of description). Making a payment on this interface redirects to the corresponding payment software, allowing payment of parking fees at the parking lot corresponding to the parking payment platform's URL. In other words, the payment interface is used to pay for parking fees at the parking lot.

[0207] For example, the environment surrounding the first vehicle includes at least one information identifier, and the processing device can acquire at least one information identifier in the environment surrounding the first vehicle. Optionally, the first vehicle includes a sensor (e.g., a camera), which can collect sensor data (e.g., sensor data including images of the environment surrounding the first vehicle), and the processing device can acquire sensor data from the sensor through a connection with the sensor, and process the sensor data to obtain at least one information identifier in the environment surrounding the first vehicle.

[0208] In one possible implementation, the processing device acquires at least one information identifier in the surrounding environment of the first vehicle after the first vehicle enters the parking lot.

[0209] Optionally, the processing device can detect whether the first vehicle has entered the parking lot. For example, the processing device can acquire an image of the surrounding environment of the first vehicle and detect whether the first vehicle has entered the parking lot based on the image. For instance, the processing device can detect whether the first vehicle has entered the parking lot based on buildings, roads, signs, etc., in the image of the surrounding environment. Furthermore, if the processing device detects that a parking lot barrier is raised, a parking lot gate is open, a parking lot access control device is activated, or parking area markings are drawn on the ground based on the image of the surrounding environment, it can consider that the first vehicle has entered the parking lot.

[0210] Step S502: The processing device obtains the first interface using the first information identifier.

[0211] The first information identifier belongs to at least one information identifier. An information identifier can carry information, and the interface obtained using the information identifier may include the information carried by the information identifier.

[0212] Optionally, the first vehicle includes a screen, such as a main vehicle infotainment screen, a sub-screen window, or a background virtual screen, etc. The processing device can display an interface corresponding to the URL of the first information identifier, i.e., a first interface, through the screen. For example, the processing device can display the interface corresponding to the URL of the first information identifier through the main vehicle infotainment screen. Alternatively, the processing device can display the interface corresponding to the URL of the first information identifier through a sub-screen window.

[0213] The following is combined with Figure 6 , Figure 7 , Figure 8 , Figure 9 , Figure 10 and Figure 11 Several possible first interfaces obtained using the first information identifier are presented as examples.

[0214] like Figure 6As shown, the first interface includes interface 600, which may include controls 601 and 602. Control 601 is used to display information, such as displaying information about the XX Dance Art School's official WeChat account (i.e., "The XX Dance Art School's official WeChat account provides you with the latest news and online services"). Control 602 is used to select and follow the XX Dance Art School's official WeChat account, thereby using the functions and services provided by the XX Dance Art School's official WeChat account or receiving content pushed by XX Dance Art School (such as articles, news, videos, etc. published by the XX Dance Art School's official WeChat account).

[0215] like Figure 7 As shown, the first interface includes interface 700, which may include controls 701 and 702. Control 701 is used to display information, such as displaying information about the XX Shopping Mall's official WeChat account (i.e., "The XX Shopping Mall's official WeChat account provides you with the latest news and online services from XX Shopping Mall"). Control 702 is used to select and follow the XX Shopping Mall's official WeChat account, thereby using the functions and services provided by the XX Shopping Mall's official WeChat account or receiving content pushed by XX Shopping Mall (such as articles, news, videos, etc. published by the XX Shopping Mall's official WeChat account).

[0216] like Figure 8 As shown, the first interface includes interface 800, which may include a title "XX Scenic Area," control 801, control 802, and control 803. Control 801 is used to display information, such as the information about XX Scenic Area displayed in interface 800 (i.e., "Welcome to XX Scenic Area! Reply with [keyword] to learn how to enjoy XX Scenic Area, travel guides, food guides, accommodation guides, and transportation guides"). Control 802 is used to select the functional services provided by the XX Scenic Area's official WeChat account (such as virtual tours of XX Scenic Area and online ticket purchase). Control 803 is used to select the sub-services of the online ticket purchase function provided by the XX Scenic Area's official WeChat account (such as online ticket purchase, annual pass purchase, and ticket discount policies).

[0217] like Figure 9 As shown, the first interface includes interface 900, which may include a title "Parking Payment", control 901, and control 902. Control 901 is used to input information, such as the license plate number of the vehicle for which parking fees need to be paid in interface 900. Control 902 is used to select the functional services provided by interface 900 (such as querying payment).

[0218] like Figure 10As shown, the first interface includes interface 1000, which may include a title "Pay Parking Fee," controls 1001, 1002, 1003, and 1004. Control 1001 is used to display information, such as displaying parking lot information (i.e., the underground parking lot of A shopping mall in XX city, XX district). Control 1002 is used to input information, such as entering the license plate number of the vehicle for which parking fees need to be paid. Control 1003 is used to select to pay. Control 1004 is used to select the functional services provided by interface 1000 (such as payment records and contacting the parking lot).

[0219] like Figure 11 As shown, the first interface includes interface 1100, which may include controls 1101 and 1102. Control 1101 is used to display information, such as displaying commercial advertisements in interface 1100. Control 1102 is used to swipe right to pay parking fees (i.e., swipe interface 1100), thereby causing the first interface to jump to a jumpable interface of the first interface.

[0220] It should be understood that the number of controls in the first interface of the above example can be more or less (or even none).

[0221] Step S503: The processing device uses the first model to recognize the image of the first interface and obtains the first recognition result.

[0222] For example, the first model could be... Figure 1 The UIAgent shown.

[0223] In one possible implementation, the processing device can acquire text prompts, input the text prompts and an image of the first interface into a first model, and obtain a first recognition result. Optionally, the text prompts can be input by the user, or the text prompts can be preset in the storage data of the processing device, and the processing device can obtain the text prompts from the storage data of the processing device.

[0224] Text prompts are used to indicate the task or function of the first model. In one possible implementation, text prompts (e.g., "Is this a payment interface?", "How to find the payment interface?", "Is this a valid parking payment QR code?") enable the first model to make a judgment based on the image of the interface obtained from the information identifier (e.g., determining whether the current interface is a payment interface) and obtain the recognition result of the payment interface (i.e., the first recognition result). Here, the payment interface is a parking payment interface used to pay parking fees for vehicles in a parking lot.

[0225] The first identification result includes instruction information, which indicates whether the current interface is a payment interface, thereby realizing the validity judgment of the information identifier. It may also include operation instruction information, which indicates what operation needs to be performed on the first interface to find the payment interface.

[0226] The first identification result may have several possible outcomes, some of which are described below.

[0227] Case 1: The first identification result includes first indication information, which is used to indicate that the first interface is a payment interface.

[0228] In one possible implementation, when the first instruction information is used to indicate that the first interface is a payment interface, the processing device generates first information and second information identifiers.

[0229] Specifically, the first information is used to indicate that the first information identifier is a payment available identifier for the parking lot. That is, when the first information indicates that the first interface is a payment interface, the processing device records the first information identifier as a payment available identifier for the parking lot, meaning the first information identifier is valid. Combined with... Figure 9 The processing device uses a first model to recognize the image of interface 900 and obtains a first recognition result. The first indication information in the first recognition result indicates that interface 900 is a payment interface. The processing device generates first information, which indicates that the information identifier of interface 900 is a parking lot payment availability identifier. Optionally, the first vehicle includes an interactive device, and the processing device can output the first information through the interactive device. The output method of the first information includes at least one of interface display, voice broadcast, etc. For example, the interactive device includes a display device, and the processing device can transmit the first information to the display device and display the interface through the display device. This interface includes the first information, such as the parking lot name, parking payment interface, etc. For example, the first interface includes text information (e.g., "Information identifier of XXX parking lot detected, please confirm," or "Do you need me to perform the payment operation after you get in the car?").

[0230] The second information identifier is used to identify the payment interface. Optionally, the second information identifier can be the same as the first information identifier, and the second information identifier is the information identifier subsequently pushed to the user. Figure 9 The second information identifier can be used to identify the interface 900 (i.e., the payment interface).

[0231] Furthermore, the processing device displays a second interface, which includes a second information identifier. For example, the first vehicle includes a display device, such as... Figure 2B The display device 203 shown. The processing device can transmit a second interface to the display device, and the display device displays the second interface. Combined with... Figure 12 The second interface includes a second information identifier.

[0232] Case 2: The first identification result includes the first indication information, which is used to indicate that the first interface is not the payment interface.

[0233] In one possible implementation, if the first indication information indicates that the first interface is not a payment interface, the processing device generates second information. The second information indicates that the first information identifier is a parking payment unavailable identifier. That is, if the first indication information indicates that the first interface is not a payment interface, the processing device records the first information identifier as a parking payment unavailable identifier using the second information; that is, the first information identifier is invalid. For example, for information identifiers related to shopping mall introductions or commercial advertisements, the processing device can identify and record the identifier as a parking payment unavailable identifier. Combined with... Figure 6 The processing device uses the first model to recognize the image of interface 600 and obtains a first recognition result. The first indication information in the first recognition result is used to indicate that interface 600 is not a payment interface. Figure 7 The processing device uses the first model to recognize the image of the interface 700 and obtains a first recognition result. The first indication information in the first recognition result is used to indicate that the interface 700 is not a payment interface. Figure 8 The processing device uses a first model to recognize the image of interface 800 and obtains a first recognition result. The first indication information in the first recognition result indicates that interface 800 is not a payment interface. Optionally, the first vehicle includes an interactive device, and the processing device can output second information through the interactive device. The output method of the second information includes at least one of interface display, voice broadcast, etc. For example, the interactive device includes a display device, and the processing device can transmit the second information to the display device and display an interface including the second information through the display device.

[0234] Furthermore, the processing device displays the second information. Similarly, the processing device can transmit the second information to the display device, and the display device displays the second information.

[0235] In another possible implementation, when the first indication information indicates that the first interface is not a payment interface, the first identification result also includes first operation indication information. For example, the first operation indication information is used to instruct the execution of a first operation on the first interface, causing the first interface to jump to a jumpable interface of the first interface. That is, when the processing device determines that the first interface is not a payment interface, it can also generate operation indication information. Executing the operation corresponding to the operation indication information on the first interface can cause the first interface to jump to another interface. For example, the payment interface may be hidden within a jumpable interface of the first interface, and the processing device can find the payment interface by executing the operation corresponding to the operation indication information.

[0236] In one possible implementation, text prompts (e.g., "How do I find the parking payment interface?") enable the first model to make decisions based on the image of the interface obtained from the information identification (e.g., which area to click to find the payment interface). For example, the output of the first model may also include operation instruction information (e.g., indicating which area to click to find the payment interface).

[0237] Optionally, the first operation instruction information includes a first position indication and a first indication identifier. The processing device can display the first indication identifier at a first position in the first interface indicated by the first position indication. The first position indication includes coordinates or coordinates corresponding to a control, and the first indication identifier includes various types such as a highlighted box (e.g., a red box, a yellow box, etc.), a cursor, or a graphic. The display method of the first indication identifier includes static display, dynamic display, or gradient display.

[0238] For example, the first operation includes clicking and / or swiping a first position on the first interface. Optionally, the first operation also includes long-pressing a first position on the first interface. Furthermore, the processing device can perform the first operation on the first interface according to the first operation instruction information, that is, the operation of jumping to the jumpable interface can be automatically implemented without the user having to manually jump to the interface, which can significantly improve the user experience.

[0239] Optionally, the first operation instruction information may also include calling the corresponding vehicle-mounted API interface and outputting information that requires user confirmation (such as "Do you need help to perform the payment operation?").

[0240] The following is combined with Figure 13 Exemplary introduction Figure 7 The interface 700 shown is a jumpable interface. In conjunction with the preceding text, the processing device uses the first model to recognize the image of interface 700 and obtains a first recognition result. The first indication information in the first recognition result is used to indicate that interface 700 is not a payment interface. At this time, the first recognition result also includes first operation indication information, which is used to instruct the execution of a first operation on the first interface, for example, in conjunction with... Figure 13 The processing device displays a first indicator at the location of control 702 on interface 700 (i.e., the first location of the first interface includes the coordinates corresponding to control 702 on interface 700), and the first operation includes clicking control 702 on interface 700. After performing the first operation on interface 700, interface 700 jumps to a jumpable interface of interface 700, i.e., interface 1300. For example... Figure 13As shown, interface 1300 may include a title "XX Shopping Mall", controls 1301, 1302, 1303, and 1304. Control 1301 is used to display information, such as displaying information about XX Shopping Mall (i.e., "Welcome to follow XX Shopping Mall's official WeChat account"). Control 1302 is used to select the functional services provided by XX Shopping Mall's official WeChat account (such as a business hotline or parking payment). Control 1303 is used to select the sub-services of the parking payment function provided by XX Shopping Mall's official WeChat account (such as free 2 hours or paying parking fees). Control 1304 is used to slide interface 1300, thereby triggering an update of the content pushed by XX Shopping Mall's official WeChat account.

[0241] The following is combined with Figure 14 Exemplary introduction Figure 11 The interface 1100 shown is a jumpable interface. In conjunction with the preceding text, the processing device uses the first model to recognize the image of interface 1100 and obtains a first recognition result. The first indication information in the first recognition result is used to indicate that interface 1100 is not a payment interface. At this time, the first recognition result also includes first operation indication information, which is used to instruct the execution of a first operation on the first interface, for example, in conjunction with... Figure 14 The processing device displays a first indicator at the position of the control 1102 on the interface 1100 (i.e., the first position of the first interface includes the coordinates corresponding to the control 1102 on the interface 1100), and the first operation includes sliding the control 1102 on the interface 1100 to the right. Optionally, Figure 14 When the processing device displays the first indicator, it can do so dynamically, for example, by moving the first indicator from the left end to the right end of the control 1102. After performing the first operation on the interface 1100, the interface 1100 jumps to a jumpable interface, namely the interface 900.

[0242] Furthermore, the first interface contains multiple jumpable interfaces. The processing device can use the first model to identify the image of the first jumpable interface and obtain a second identification result. The first jumpable interface belongs to multiple jumpable interfaces. In other words, the processing device can use the first model again to identify the images of the jumpable interfaces of the first interface to determine whether the jumpable interface of the first interface is a payment interface.

[0243] Similar to Case 1 above, the second identification result includes second indication information. When the second indication information is used to indicate that the first jumpable interface is a payment interface, the processing device generates third information and a third information identifier.

[0244] The third piece of information indicates that the first information identifier is a payment-available identifier for the parking lot. In other words, when the second information indicates that the first accessible interface is the payment interface, the processing device records the first information identifier as a payment-available identifier for the parking lot using the third information, meaning the first information identifier is valid. Combined with... Figure 14 The processing device can use the first model to identify the jumpable interface of interface 1100, namely interface 900 (i.e., the first jumpable interface includes interface 900), and obtain a second identification result. The second indication information in the second identification result is used to indicate that interface 900 is a payment interface, and the processing device generates third information, which is used to indicate that the information identifier of interface 900 is a parking payment available identifier.

[0245] The third information identifier is used to identify the payment interface. Optionally, the third information identifier may be different from the first information identifier; the third information identifier is the information identifier subsequently pushed to the user. Figure 14 The third information identifier can be used to identify the interface 900 (i.e., the payment interface). Thus, if the payment interface is hidden in the jumpable interface of the first interface, the information identifier pushed to the user does not require the user to manually jump from the first interface to the payment interface, which can reduce the complexity of the user's payment operation and significantly improve the user experience.

[0246] Furthermore, the processing device displays a third interface, which includes a third information identifier. Similarly, the processing device can transmit the third interface to a display device, and the display device displays the third interface.

[0247] Similar to scenario 2 described above, the second identification result includes second indication information. When the second indication information indicates that the first accessible interface is not a payment interface, the processing device generates fifth information. This fifth information indicates that the first information identifier is a parking lot payment unavailable identifier. In other words, when the second indication information indicates that the first accessible interface is not a payment interface, the processing device records the first information identifier as a parking lot payment unavailable identifier using the fifth information; that is, the first information identifier is invalid.

[0248] Combination Figure 13 The processing device can use the first model to identify the jumpable interface of interface 700, namely interface 1300 (i.e., the first jumpable interface includes interface 1300), and obtain a second identification result. The second indication information in the second identification result is used to indicate that interface 1300 is not a payment interface. The processing device generates fifth information, which is used to indicate that the information identifier of interface 700 is a parking payment unavailable identifier.

[0249] Similarly, the second identification result includes second indication information. If the second indication information indicates that the first jumpable interface is not a payment interface, the second identification result also includes second operation indication information. This second operation indication information instructs the execution of a second operation on the first jumpable interface to redirect it to a second jumpable interface, which may belong to multiple jumpable interfaces. In other words, when the processing device determines that the first jumpable interface is not a payment interface, it can also generate operation indication information. Executing the operation corresponding to the operation indication information on the first jumpable interface can redirect it to another jumpable interface. For example, if the payment interface is hidden among the jumpable interfaces of the first jumpable interface, the processing device can find that payment interface by executing the operation corresponding to the operation indication information.

[0250] Similarly, the second operation instruction information includes a third position indication and a third indication identifier. The processing device can display the third indication identifier at a third position in the first jumpable interface indicated by the third position indication. The third indication identifier includes a cursor. Optionally, the third position indication includes coordinates or coordinates corresponding to a control.

[0251] For example, the second operation includes clicking on the first jumpable interface and / or swiping a third position in the first jumpable interface.

[0252] The following is combined with Figure 13 and Figure 15 Exemplary introduction Figure 7 The interface shown is another jumpable interface 700. (By...) Figure 13 As mentioned earlier, the processing device uses the first model to identify the jumpable interface of interface 700, namely interface 1300 (i.e., the first jumpable interface includes interface 1300). The second indication information in the obtained second identification result is used to indicate that interface 1300 is not a payment interface. At this time, the second identification result also includes second operation indication information, which is used to instruct the execution of a second operation on the first jumpable interface. For example, combined with... Figure 15 The processing device displays a third indicator at the location of control 1303 on interface 1300 (i.e., the third location in the first jumpable interface includes the coordinates corresponding to control 1303 on interface 1300), and the second operation includes clicking on "Pay Parking Fee" in control 1303 on interface 1300. Combined with... Figure 15 After performing the second operation on interface 1300, interface 1300 jumps to another jumpable interface of interface 700, namely interface 1500 (i.e., the second jumpable interface includes interface 1500). For example... Figure 15As shown, interface 1500 may include a title "Parking Information Confirmation," control 1501, and control 1502. Control 1501 is used to display information, such as commercial advertisements in interface 1500. Control 1502 is used to select the functional services provided by interface 1500 (such as entering license plate number for payment).

[0253] Furthermore, the processing device can use the first model to identify the image of the second jumpable interface and obtain the identification result corresponding to the second jumpable interface. The identification result corresponding to the second jumpable interface includes fifth indication information, which indicates whether the second jumpable interface is a payment interface. In other words, the processing device can use the first model again to identify the image of another jumpable interface of the first interface to determine whether the other jumpable interface of the first interface is a payment interface.

[0254] Similarly, the processing device uses the first model to identify the jumpable interface of interface 700, namely interface 1500 (i.e., the second jumpable interface includes interface 1500). The fifth indication information in the identification result corresponding to interface 1500 is used to indicate that interface 1500 is not a payment interface. At this time, the identification result corresponding to interface 1500 also includes sixth operation indication information, which is used to indicate the execution of a sixth operation on the second jumpable interface. Similarly, the sixth operation indication information includes a sixth position indication and a sixth indication identifier. The processing device can display the sixth indication identifier at the sixth position in the second jumpable interface indicated by the sixth position indication. The sixth indication identifier includes a cursor. Optionally, the sixth position indication includes coordinates or coordinates corresponding to a control. For example, combined with... Figure 16 The processing device displays a sixth indicator at the location of control 1502 on interface 1500 (i.e., the sixth location in the second jumpable interface, including the coordinates corresponding to control 1502 on interface 1500), and the sixth operation includes clicking control 1502 on interface 1500. Combined with... Figure 16 After performing the sixth operation on interface 1500, interface 1500 jumps to another jumpable interface of interface 700, namely interface 900.

[0255] Similarly, the processing device can use the first model to identify the jumpable interface of interface 700, namely interface 900, and obtain the identification result corresponding to interface 900. The identification result corresponding to interface 900 includes sixth indication information, which indicates whether interface 900 is a payment interface. In other words, the processing device can use the first model to identify the image of another jumpable interface of the first interface again, and determine whether this other jumpable interface of the first interface is a payment interface.

[0256] Optionally, when the second indication information indicates that the first jumpable interface is not a payment interface, the second identification result further includes third and fourth operation indication information. The third operation indication information instructs the execution of a third operation on the first jumpable interface to redirect it to the first interface. The fourth operation indication information instructs the execution of a fourth operation on the first interface to redirect it to the third jumpable interface, which is one of multiple jumpable interfaces. The third operation must be performed before the fourth operation; that is, the processing device first performs the third operation on the first jumpable interface to redirect it to the first interface, and then performs the fourth operation on the first interface to redirect it to the third jumpable interface. Optionally, the third and fourth operation indication information can be included in the same operation indication information. For example, the third operation indication information may instruct the execution of a third operation on the first jumpable interface to redirect it to the first interface, and may also instruct the execution of a fourth operation on the first interface to redirect it to the third jumpable interface.

[0257] Furthermore, the processing device uses the first model to identify the image of the third jumpable interface, obtaining a third identification result. The third identification result includes third indication information, which indicates whether the third jumpable interface is a payment interface. In other words, performing a third operation on the first jumpable interface causes it to revert to the first interface, and performing a fourth operation on the first interface causes it to jump to the third jumpable interface. Further, the processing device can use the first model again to identify the image of the third jumpable interface to determine whether it is a payment interface. If the payment interface is not a jumpable interface hidden within the first jumpable interface (i.e., the payment interface cannot be found via the route from the first interface to the first jumpable interface), the processing device can revert from the first jumpable interface to the first interface, jump from the first interface to the third jumpable interface, and use this route to find the payment interface.

[0258] Similarly, the third operation instruction information includes a fourth position indication and a fourth indication identifier. The processing device can display the fourth indication identifier at the fourth position in the first jumpable interface indicated by the fourth position indication. The fourth indication identifier includes a cursor. Optionally, the fourth position indication includes coordinates or coordinates corresponding to a control.

[0259] Similarly, the fourth operation instruction information includes a fifth position indication and a fifth indication identifier. The processing device can display the fifth indication identifier at the fifth position in the first interface indicated by the fifth position indication. The fifth indication identifier includes a cursor. Optionally, the fifth position indication includes coordinates or coordinates corresponding to a control.

[0260] For example, the third operation includes clicking on the first jumpable interface and / or swiping on a fourth location within the first jumpable interface. The fourth operation includes clicking on and / or swiping on a fifth location within the first interface.

[0261] Based on the preceding text, interface 1100 is not a payment interface. At this point, the first identification result also includes first operation instruction information, which instructs the execution of a first operation on the first interface. For example, the first operation includes clicking control 1101 in interface 1100. After performing the first operation on interface 1100, interface 1100 redirects to a jumpable interface, namely interface 1700 (i.e., the first jumpable interface includes interface 1700). For example... Figure 17 As shown, interface 1700 may include a title "Commercial Advertisement", control 1701, and control 1702. Control 1701 is used to display information, such as displaying a commercial advertisement in interface 1700. Control 1702 is used to return to the interface, such as returning to the previous interface of interface 1700, or returning to the main interface (e.g., the first interface).

[0262] Similarly, the processing device can use the first model to identify the jumpable interface of interface 1100, namely interface 1700, and obtain a second identification result corresponding to interface 1700. The second indication information in the second identification result is used to indicate that interface 1700 is not a payment interface. At this time, the second identification result also includes third operation indication information, which is used to instruct the third operation to be performed on interface 1700 so that interface 1700 jumps to interface 1100, for example, in combination with... Figure 17 The processing device displays a fourth indicator at the location of control 1702 on interface 1700 (i.e., the fourth location in the first jumpable interface includes the coordinates corresponding to control 1702 on interface 1700). The third operation includes clicking control 1702 on interface 1700 (i.e., the third operation includes clicking "back"). After performing the third operation on interface 1700, interface 1700 jumps to interface 1100. At this time, the second recognition result also includes fourth operation indication information, which is used to indicate the execution of the fourth operation on interface 1100, for example, in combination with... Figure 17 The processing device displays a fifth indicator at the position of control 1102 on interface 1100 (i.e., the fifth position in the first interface includes the coordinates corresponding to control 1102 on interface 1100). The fourth operation includes sliding control 1102 on interface 1100 to the right. After performing the first operation on interface 1100, interface 1100 jumps to a jumpable interface of interface 1100, i.e., interface 900.

[0263] The above explanation uses the example of returning from the first jumpable interface to the first interface. In actual use, any jumpable interface of the first interface can include a return control for returning to the interface, such as returning to the parent interface of the current jumpable interface, or returning to the main interface (e.g., the first interface). For example, if the current jumpable interface is not the payment interface, the processing device can perform a third operation to jump from the current jumpable interface to the parent interface of the current jumpable interface, or perform a third operation to jump from the current jumpable interface to the main interface (e.g., the first interface). After the processing device performs the third operation, it can perform a fourth operation to jump from the parent interface of the current jumpable interface to another jumpable interface (a different jumpable interface from the current one), or perform a fourth operation to jump from the first interface to another jumpable interface (a different jumpable interface from the current one), thereby finding the payment interface through the route from the first interface to other jumpable interfaces.

[0264] It should be understood that the aforementioned processing device uses the first model to identify the jumpable interface of the first interface and obtains operation instruction information. It then executes the operation corresponding to the operation instruction information to cause the jumpable interface of the first interface to jump to another jumpable interface. This process can be repeated multiple times until the output of the first model is the desired result. Optionally, the desired result includes instruction information in the output result indicating that a certain jumpable interface of the first interface is a payment interface.

[0265] Optionally, the required result includes indication information in each output result corresponding to each of the multiple jumpable interfaces of the first interface, used to indicate that the jumpable interface corresponding to the output result is not a payment interface. For example, the processing device uses the first model to identify the image of each of the multiple jumpable interfaces of the first interface, obtaining multiple identification results. Each identification result corresponds to one of the multiple jumpable interfaces, and the indication information in each identification result is used to indicate whether the jumpable interface corresponding to each identification result is a payment interface. Further, if the indication information in each identification result indicates that the jumpable interface corresponding to each identification result is not a payment interface, the processing device generates fourth information. The fourth information is used to indicate that the first information identifier is a payment unavailable identifier for the parking lot. In other words, the processing device can use the first model to identify all the jumpable interfaces of the first interface. If none of the jumpable interfaces are payment interfaces, the first information identifier can be recorded as a payment unavailable identifier, i.e., the first information identifier is invalid.

[0266] Optionally, the desired result includes the processing device repeatedly executing the above process a preset number of times to a threshold. For example, the first execution process is as follows: the processing device uses the first model to identify the first interface and obtains operation instruction information, then executes the operation corresponding to the operation instruction information to make the first interface jump to another jumpable interface of the first interface. The second execution process is as follows: the processing device uses the first model to identify a jumpable interface of the first interface and obtains operation instruction information, then executes the operation corresponding to the operation instruction information to make the jumpable interface of the first interface jump to another jumpable interface of the first interface. This continues until the number of times the processing device executes the process reaches the preset number of times to a threshold, at which point the execution of the process stops. The preset number of times to a threshold can be a pre-set threshold, such as 10 times, 15 times, etc. When the number of times the processing device executes the process reaches the preset number of times to a threshold, the processing device may consider that the possibility of a payment interface being among the jumpable interfaces of the first interface is very low, and the possibility of obtaining an information identifier corresponding to the first interface as a payment unavailable identifier is very high. Furthermore, when the number of times the processing device executes this process reaches a preset threshold, a sixth piece of information is generated. This sixth piece of information is used to indicate that the first information identifier is a payment unavailable identifier for the parking lot. In other words, when the number of times the processing device executes this process reaches the preset threshold, the processing device can record the first information identifier as a payment unavailable identifier, meaning the first information identifier is invalid.

[0267] Optionally, in the above embodiments, the processing device's validity identification of the first information identifier can be reflected on the screen of the first vehicle, such as a jump to the interface on the main screen of the vehicle's infotainment system, a jump to the interface on a window sub-screen, or a jump to the interface on a background virtual screen. Optionally, the processing device's validity identification of the first information identifier can be reflected in the access process of the underlying data stream.

[0268] In one possible implementation, the processing device uses a first model to recognize an image of the first interface, and may also use other information, such as the location of the first vehicle, to obtain a first recognition result. Exemplarily, the first model includes a first sub-model (such as...). Figure 1 The OCR model in the second sub-model (such as the OCR model in the second sub-model) Figure 1 In the planning model (within the first sub-model), the processing device uses the first sub-model to recognize the image of the first interface and obtain the text information of the first interface. Further, the processing device can obtain the location of the first vehicle and input the image of the first interface, the text information of the first interface, and the location of the first vehicle into the second sub-model to obtain the first recognition result.

[0269] Optionally, the first vehicle may include a location sensor for obtaining the location of the first vehicle (e.g., the latitude and longitude information of the first vehicle). The location sensor may include, for example, a Global Positioning System (GPS) or a BeiDou Navigation Satellite System (BDS). Further, the processing device may obtain the location of the first vehicle by converting its latitude and longitude information into address text information through reverse geocoding.

[0270] For example, combining Figure 10 The processing device uses the first sub-model to recognize the image of interface 1000 and obtain the text information of interface 1000 (such as "Pay parking fee", "Underground parking lot of A shopping mall in XX city XX district", "Go to pay", "Payment record", "Contact parking lot"). The processing device can obtain the location of the first vehicle (for example, the location of the first vehicle is B shopping mall in XX city XX district). At this time, the processing device inputs the text information of interface 1000, the image of interface 1000 and the location of the first vehicle into the second sub-model to obtain the first recognition result. Since the payment area location (underground parking lot of A shopping mall in XX city XX district) indicated by the text information of interface 1000 is different from the location of the first vehicle, the first indication information in the first recognition result is used to indicate that interface 1000 is not a payment interface.

[0271] In another possible implementation, the information identifier pushed to the user by the processing device can be combined with other information, such as stored data corresponding to the location of the first vehicle. The stored data includes information identifiers reported by at least one other vehicle at the location of the first vehicle. Optionally, the stored data can be stored in the cloud or on a server, and the processing device can access the stored data through a connection with the cloud or server. For example, the processing device can access the stored data corresponding to the location of the first vehicle, and the stored data includes a fourth information identifier. In one possible implementation, the processing device can combine the first and fourth information identifiers for judgment, historical user votes in the stored data, consistency verification of the results of both (i.e., the recognition result corresponding to the first information identifier and the recognition result corresponding to the fourth information identifier), and QR code timeliness judgment, etc., to obtain the final information identifier pushed to the user.

[0272] The above-mentioned judgment methods will be illustrated by examples below.

[0273] In one possible implementation, the processing device combines the first information identifier and the fourth information identifier to determine the final information identifier to be pushed to the user. For example, the processing device uses the fourth information identifier to obtain a fourth interface, uses a first model to recognize the image of the fourth interface, and obtains a fourth recognition result. The fourth recognition result includes fourth indication information, which indicates whether the fourth interface is a payment interface. In other words, the processing device can use the first model to recognize the image of the interface obtained from the fourth information identifier in the stored data, and determine whether the interface obtained from the fourth information identifier is a payment interface, i.e., whether the fourth information identifier is a parking payment identifier.

[0274] Furthermore, the processing device can obtain a fifth information identifier based on the first identification result, the fourth identification result, the first information identifier, and the fourth information identifier. This fifth information identifier is used to identify the payment interface. In other words, the processing device can combine the identification result corresponding to the first information identifier (i.e., the first identification result), the identification result corresponding to the fourth information identifier (i.e., the fourth identification result), the first information identifier, and the fourth information identifier to obtain the information identifier (i.e., the fifth information identifier) ​​pushed to the user, thereby improving the effectiveness of the information identifier pushed to the user. For example, the first indication information in the first identification result is used to indicate that the first interface is not a payment interface, the fourth indication information in the fourth identification result is used to indicate that the fourth interface is a payment interface, and the fifth information identifier obtained by the processing device is the same as the fourth information identifier.

[0275] The processing device displays a fifth interface, which includes a fifth information identifier. Similarly, the processing device can transmit the fifth interface to a display device, and the display device can display the fifth interface.

[0276] In another possible implementation, the processing device performs a consistency check on the results of the two (i.e., the recognition result corresponding to the first information identifier and the recognition result corresponding to the fourth information identifier) ​​to obtain the final information identifier to be pushed to the user. Referring to the aforementioned example, for instance, the first indication information in the first recognition result is used to indicate that the first interface is a payment interface, and the fourth indication information in the fourth recognition result is used to indicate that the fourth interface is a payment interface, and the first interface and the fourth interface are consistent, the fifth information identifier obtained by the processing device is the same as the first information identifier or the fourth information identifier.

[0277] In another possible implementation, the processing device determines the validity period of the QR code to obtain the final information identifier to be pushed to the user, which can improve the real-time performance and validity of the information identifier pushed to the user. Referring to the previous example, for instance, the processing device uses the first information identifier to obtain its corresponding validity period (e.g., January 1, XXXX to March 1, XXXX), and uses the fourth information identifier to obtain its corresponding validity period (e.g., January 1, XXXX to October 1, XXXX). If the processing device obtains the current time as May 13, XXXX, and the current time is not within the validity period of the first information identifier, then the first information identifier is invalid. Since the current time is within the validity period of the fourth information identifier, the fourth information identifier is valid. Therefore, the fifth information identifier obtained by the processing device is the same as the fourth information identifier.

[0278] In another possible implementation, the processing device obtains the final information identifier to be pushed to the user based on historical user votes in the stored data. For example, the stored data corresponding to the location of the first vehicle includes not only the information identifier but also payment identifier information associated with the information identifier. The payment identifier information is used to indicate whether at least one second vehicle successfully paid its parking fee at the parking lot using the sixth information identifier.

[0279] Furthermore, the processing device can obtain a seventh information identifier based on the first identification result, the payment identifier information related to the sixth information identifier, the first information identifier, and the sixth information identifier. This seventh information identifier is used to identify the payment interface. In other words, the processing device can combine the first identification result, the payment identifier information related to the sixth information identifier in the stored data, the first information identifier, and the sixth information identifier to obtain the information identifier pushed to the user (i.e., the seventh information identifier), thus improving the effectiveness of the information identifier pushed to the user. For example, the first identification result indicates that the first interface is not a payment interface, and there are 20 payment identifiers in the payment identifier information related to the sixth information identifier. Of these, 15 payment identifiers indicate that the second vehicle successfully paid its parking fee using the sixth information identifier, and 5 payment identifiers indicate that the second vehicle successfully paid its parking fee using the sixth information identifier, meaning the probability of successfully paying the parking fee using the sixth information identifier is 75%. In this case, it can be considered that the first vehicle has a very high probability of successfully paying its parking fee using this sixth information identifier, and the information identifier pushed to the user by the processing device can be this sixth information identifier; that is, the seventh information identifier is the same as the sixth information identifier. For example, the first identification result indicates that the first interface is a payment interface. Among the payment identifier information related to the sixth information identifier, there are 20 payment identifiers, 15 of which indicate that the second vehicle successfully paid its parking fee using the sixth information identifier. Furthermore, the interface obtained by the processing device using the sixth information identifier is consistent with the first interface. In this case, it can be considered that the probability of the first vehicle successfully paying its parking fee using the sixth information identifier is very high, and the seventh information identifier obtained by the processing device is the same as the sixth information identifier.

[0280] Optionally, the payment identifier information includes multiple payment identifiers, including a first payment identifier. If the ratio between the number of first payment identifiers and the number of multiple payment identifiers is greater than a proportional threshold, the seventh information identifier becomes the sixth information identifier, meaning the seventh information identifier is the same as the sixth information identifier. The first payment identifier is used to indicate that the second vehicle has successfully paid its parking fee using the sixth information identifier. The proportional threshold is a pre-set threshold, such as 70% or 80%. When the ratio between the number of first payment identifiers and the number of multiple payment identifiers is greater than the proportional threshold, meaning the probability of successfully paying the parking fee using the sixth information identifier is greater than the proportional threshold, it is considered that the first vehicle is highly likely to have successfully paid its parking fee using the sixth information identifier, and the information identifier pushed to the user can be the sixth information identifier. For example, if there are 100 payment identifiers, and 95 of them are used to indicate that the second vehicle has successfully paid its parking fee using the sixth information identifier, meaning the number of first payment identifiers is 95 and the ratio between the number of first payment identifiers and the number of multiple payment identifiers is 95%, and if the proportional threshold is 85%, then the seventh information identifier is the sixth information identifier.

[0281] The processing device displays a sixth interface, which includes a seventh information identifier. Similarly, the processing device can transmit the sixth interface to a display device, and the display device can display the sixth interface.

[0282] It should be noted that the methods used by the various processing devices in the above examples to obtain the final information identifier to be pushed to the user can be combined. For example, the processing device can obtain the final information identifier to be pushed to the user based on historical user votes and the timeliness of the QR code in the stored data. Of course, there are many other possible combinations in actual use, which will not be exemplified here.

[0283] In one possible implementation, the processing device can obtain the parking fee schedule. Optionally, the first vehicle includes sensors (e.g., a camera) that can collect sensor data (e.g., sensor data including images of the vehicle's surrounding environment). The processing device can acquire the sensor data from the sensors through a connection with the sensors and process the sensor data to obtain the parking fee schedule. For example, combined with... Figure 4The camera on vehicle 20 can capture images of the vehicle's surrounding environment. The processing device can acquire these images via a connection to the camera and process them to determine the parking fee. Alternatively, the processing device can obtain the location of the first vehicle and query shared data of the parking lot corresponding to that location via the internet. This shared data includes information about the parking lot, such as its type (e.g., surface parking, underground parking, multi-level parking), number of parking spaces, fee, and operating hours. Furthermore, the processing device can determine the parking fee based on the shared data of the parking lot corresponding to the first vehicle's location.

[0284] In another possible implementation, the processing device can obtain the parking time of the first vehicle in the parking lot. For example, when the first vehicle is detected to enter the parking lot (e.g., when the parking lot gate is detected to open), the processing device starts timing to obtain the entry time. When the first vehicle is detected to be about to leave the parking lot (e.g., when the vehicle is detected to change from stationary to moving in the parking space in the parking lot), the processing device stops timing to obtain the departure time. The time interval between the entry time and the departure time is the parking time of the first vehicle in the parking lot.

[0285] Furthermore, the processing device can generate predicted payment information based on the parking lot's charging standard and the parking duration of the first vehicle in the parking lot. The predicted payment information is used to indicate the predicted parking fee for the first vehicle in the parking lot. For example, if the charging standard is 5 yuan per hour and the first vehicle parks in the parking lot for 3 hours, then the predicted payment information indicates that the predicted parking fee for the first vehicle in the parking lot is 15 yuan.

[0286] Optionally, the first vehicle includes an interactive device, through which the processing unit can output predicted payment information. The output method of the predicted payment information includes at least one of interface display, voice broadcast, etc. For example, the interactive device includes a display device, and the processing unit can transmit the predicted payment information to the display device, displaying an interface that includes the predicted payment information. For example, in combination with... Figure 12 The second interface also includes predicted payment information (e.g., you have parked in XX parking lot for XX hours, and the estimated parking fee is XX yuan).

[0287] The foregoing described how the processing device uses the first model to identify whether the interface corresponding to the information identifier is a payment interface, i.e., to determine the validity of the information identifier. In other scenarios, the processing device can use the first model to assist users in paying parking fees.

[0288] In one possible implementation, text prompts (e.g., "I need to pay for parking, what should I do next?" or "Please fill in my license plate number") enable the first model to make decisions based on the image of the payment interface (e.g., which area to click or what information to enter to complete the parking payment). For example, the output of UIAgent may also include operation instructions (e.g., indicating which area to click or information related to the vehicle's identity (such as the license plate number) to complete the parking payment), thereby assisting the user in the payment operation and reducing the complexity of the user's payment process. Exemplarily, the processing device uses the first model to identify the payment interface and obtain a fifth identification result. The fifth identification result includes fifth operation instructions, which instruct the user to perform a fifth operation on the payment interface, and the fifth operation is used to pay the parking fee for the first vehicle in the parking lot. In other words, the processing device can use the first model to output operation instructions for paying the parking fee for the first vehicle in the parking lot, assisting the user in the payment operation.

[0289] Similarly, the fifth operation instruction information includes a second location indication and a second indication identifier. The processing device may also display the second indication identifier at the second location indicated by the second location indication on the payment interface. The second indication identifier includes a cursor. The fifth operation includes at least one of the following: clicking the second location on the payment interface, sliding the second location on the payment interface, or entering information related to the identity of the first vehicle at the second location on the payment interface. For example, the information related to the identity of the first vehicle includes the license plate number of the first vehicle. Another example is that the information related to the identity of the first vehicle includes the mobile phone number of the owner of the first vehicle.

[0290] Combining the preceding text and Figure 18 Interface 900 is the payment interface. The processing device uses the first model to identify interface 900 and obtains the fifth identification result. The fifth operation instruction information in the fifth identification result is used to instruct the fifth operation to be performed on the payment interface, such as combining... Figure 18 The processing device displays a second indicator at the location of control 901 on interface 900 (i.e., the second location in the payment interface including the coordinates corresponding to control 901 on interface 900). The fifth operation includes entering the vehicle's license plate number (i.e., XA123456) in control 901 on interface 900. After performing the fifth operation on interface 900, interface 900 jumps to a jumpable interface of interface 900, i.e., interface 1800. Figure 18 As shown, interface 1800 may include a title "Parking Payment", control 1801, and control 1802. Control 1801 is used to input information, such as the license plate number of the vehicle for which parking fees need to be paid (i.e., XA123456) in interface 1800. Control 1802 is used to select the functional services provided by interface 1800 (such as querying payment).

[0291] In one possible implementation, the processing device performs a fifth operation on the payment interface to obtain a seventh interface, which is used to confirm payment for the parking fee of the first vehicle in the parking lot. Optionally, the processing device can perform the fifth operation on the payment interface according to the fifth operation instruction information to obtain the seventh interface. That is to say, some operations in the payment process can be automatically implemented by the processing device without user intervention, which can reduce the complexity of the user's payment operation and significantly improve the user experience.

[0292] For example, combined Figure 18 and Figure 19 The payment interface includes interface 1800. The processing device displays a second indicator at the position of control 1802 on interface 1800 (i.e., the second position in the payment interface includes the coordinates corresponding to control 1802 on 1800). The fifth operation also includes clicking control 1802 on interface 1800. After performing the fifth operation on interface 1800, interface 1800 jumps to another jumpable interface of interface 900, namely interface 1900. Figure 19 As shown, interface 1900 may include a title "Parking Payment," controls 1901, 1902, and 1903. Control 1901 is used to input information, such as the license plate number of the vehicle for which parking fees need to be paid (i.e., XA123456). Control 1902 is used to select the functional services provided by interface 1900 (such as querying payment). Control 1903 is used to confirm payment, for example, to confirm payment for the parking fee of the first vehicle in the parking lot. In other words, the seventh interface includes interface 1900, which is used to confirm payment for the parking fee of the first vehicle in the parking lot.

[0293] Optionally, the user can use sensors (such as cameras, fingerprint sensors, touch screen sensors, etc.) on the processing device or the device on which the processing device is located to perform authentication methods such as payment password authentication, facial recognition authentication, and fingerprint recognition authentication to confirm payment on the seventh interface, thereby completing the payment operation for the parking fee of the first vehicle.

[0294] Optionally, in the above embodiments, the processing device assisting the user in paying parking fees can be reflected on the screen of the first vehicle, such as switching interfaces on the main screen of the vehicle's infotainment system, switching interfaces on a window sub-screen, switching interfaces on a background virtual screen, or filling in and confirming information related to the identity of the first vehicle (such as the license plate number). Optionally, in the above embodiments, the processing device assisting the user in paying parking fees can also be reflected in the access process of the underlying data stream.

[0295] In one possible implementation, the processing device may obtain information related to the first vehicle using a first information identifier to pay parking fees at a parking lot. For example, this information may include the payment result, such as whether the vehicle successfully paid the parking fees or failed to do so. As another example, this information may also include the vehicle's location. For instance, it might include information about the vehicle successfully paying parking fees at location C at parking lot D.

[0296] Further, the processing device sends a first information identifier and related information about the first vehicle using the first information identifier to pay the parking fee in the parking lot to the server. Correspondingly, the server receives the first information identifier and related information from the processing device. Optionally, the server can store the first information identifier and related information about the first vehicle using the first information identifier to pay the parking fee in the payment information associated with the first information identifier. For example, the payment information associated with the first information identifier includes the first vehicle successfully paying the parking fee in parking lot D at location C using the first information identifier. Optionally, the processing device can also send first information or second information to the server. The first information indicates that the first information identifier is a payment available identifier for the parking lot, and the second information indicates that the first information identifier is a payment unavailable identifier for the parking lot. This facilitates the server recording whether the received information identifier is valid, and allows other vehicles to obtain relevant information about the information identifier (such as the information identifier and its validity) from the server to pay for parking.

[0297] Similarly, when a third vehicle needs to pay parking fees at parking lot D from location C, the third vehicle can obtain the stored data corresponding to location C from the server. This stored data includes a first information identifier and payment information associated with that identifier. For example, the stored data for location C might include the first information identifier and the fact that the first vehicle successfully paid its parking fees at parking lot D using that identifier at location C. Therefore, the third vehicle can use the first information identifier to pay its parking fees at parking lot D.

[0298] It should be noted that the collection of all information in this application, such as the collection of all images and all payment results, requires the user's consent, and the storage, processing, or transmission of all data must comply with local laws and regulations.

[0299] exist Figure 5 In the illustrated embodiment, the processing device can use a model to identify images of interfaces obtained from information markers in the parking lot environment where the vehicle is located, and determine whether the interface obtained from the information markers is a payment interface, i.e., whether the information marker is a parking payment marker. In other words, the processing device can open the interface corresponding to the information marker for identification, thereby performing intelligent inspection and analysis of the information markers. Furthermore, the model can simultaneously identify interfaces corresponding to multiple information markers, enabling quick filtering of the required parking payment markers for users in complex environments, improving identification efficiency and thus improving the efficiency of parking payment for users. The above process can be automated, automatically sensing information markers in the surrounding environment and identifying and judging the directional interfaces. It can achieve the validity judgment of information markers outside the vehicle without relying on additional information (such as human operation information or information from cloud databases), improving the effectiveness of information markers subsequently pushed to users. In summary, the above solution can improve the efficiency of parking payment, enhance the universality and convenience of payment methods, and improve the user experience.

[0300] Please see Figure 20 , Figure 20 This is a flowchart illustrating another interaction method provided in an embodiment of this application. Optionally, this method can be applied to a vehicle, for example, to... Figure 2B The vehicle 20 shown can be executed by the processing unit 201 within the vehicle 20. For ease of description, the following description uses the processing unit as the executing entity. Any terms, logic, etc., not explained in the following description can be found in the description above.

[0301] like Figure 20 The interactive method shown may include one or more of steps S2001 to S2004.

[0302] Step S2001: The processing device acquires the eighth information identifier.

[0303] The eighth information identifier is used to identify the payment interface, which is used to pay the parking fee for the first vehicle in the parking lot. For example, in conjunction with the preceding text... Figure 9 The eighth information identifier can be used to identify the interface 900.

[0304] In some possible implementations, the processing device may obtain an eighth information identifier.

[0305] For example, when the first indication information is used to indicate that the first interface is a payment interface, a first information and a second information identifier are generated. The first information is used to indicate that the first information identifier is a payment available identifier for the parking lot, and the eighth information identifier is the second information identifier. That is, when the interface obtained by the processing device using the first information identifier is a payment interface, the processing device can generate the second information identifier, and the eighth information identifier is the second information identifier, so that the processing device can obtain the eighth information identifier.

[0306] For another example, when the second indication information is used to indicate that the first jumpable interface is a payment interface, the processing device generates third information and a third information identifier. The third information is used to indicate that the first information identifier is a payment availability identifier for the parking lot, and the eighth information identifier is the third information identifier. That is, when the first jumpable interface is a payment interface, the processing device can generate the third information identifier, and the eighth information identifier is the third information identifier, thereby the processing device can obtain the eighth information identifier.

[0307] As another example, the processing device obtains a fifth information identifier based on the first identification result, the fourth identification result, the first information identifier, and the fourth information identifier, and the eighth information identifier is the fifth information identifier, so that the processing device can obtain the eighth information identifier.

[0308] As another example, the processing device obtains a seventh information identifier based on the first identification result, the payment identifier information related to the sixth information identifier, the first information identifier, and the sixth information identifier, and the eighth information identifier is the seventh information identifier, so that the processing device can obtain the eighth information identifier.

[0309] For details, please refer to the relevant description in step S503 above.

[0310] Step S2002: The processing device obtains the payment interface using the eighth information identifier.

[0311] For example, in conjunction with the preceding text Figure 9 The processing device obtains interface 900 using the eighth information identifier.

[0312] Step S2003: The processing device uses the first model to identify the payment interface and obtains the fifth identification result.

[0313] The fifth identification result includes a fifth operation instruction, which instructs the user to perform a fifth operation on the payment interface. This fifth operation is used to pay the parking fee for the first vehicle in the parking lot. In other words, the processing device can use the first model to output operation instruction information for paying the parking fee for the first vehicle in the parking lot, assisting the user in making the payment.

[0314] The fifth operation instruction information includes a second position indication and a second instruction identifier. The processing device can display the second instruction identifier at the second position in the payment interface indicated by the second position indication. The second instruction identifier includes a cursor.

[0315] For example, the fifth operation includes at least one of the following: clicking a second location on the payment interface, sliding the second location on the payment interface, and entering information related to the identity of the first vehicle in the second location on the payment interface. For example, the information related to the identity of the first vehicle includes the license plate number of the first vehicle. Another example is that the information related to the identity of the first vehicle includes the mobile phone number of the owner of the first vehicle.

[0316] For details, please refer to the relevant description in step S503 above.

[0317] Step S2004: The processing device performs the fifth operation on the payment interface to obtain the seventh interface.

[0318] Optionally, the processing device performs the fifth operation on the payment interface according to the fifth operation instruction information to obtain the seventh interface.

[0319] The seventh screen is used to confirm payment for the parking fee of the first vehicle in the parking lot.

[0320] Optionally, the user can use sensors (such as cameras, fingerprint sensors, touch screen sensors, etc.) on the processing device or the device on which the processing device is located to perform authentication methods such as payment password authentication, facial recognition authentication, and fingerprint recognition authentication to confirm payment on the seventh interface, thereby completing the payment operation for the parking fee of the first vehicle.

[0321] For details, please refer to the relevant description in step S503 above.

[0322] exist Figure 20 In the illustrated embodiment, the processing device can use the model to output operation instructions for paying parking fees for vehicles in the parking lot, and perform corresponding operations on the payment interface based on the operation instructions to assist the user in making the payment. In other words, some operations in the payment process can be automated, which can reduce the complexity of the user's payment operation and significantly improve the user experience.

[0323] The methods of the embodiments of this application have been described in detail above. Below, some apparatuses for implementing the foregoing methods are described. It should be understood that the division of units in the apparatuses provided in the embodiments of this application is only a logical functional division; in actual implementation, they can be fully or partially integrated onto a single physical entity, or they can be physically separated.

[0324] Furthermore, the units or modules in the device can be implemented in the form of processor calling software. For example, the device includes a processor connected to a memory, which stores instructions. The processor calls the instructions stored in the memory to implement any of the above methods or to implement the functions of each unit of the device. The processor is, for example, a general-purpose processor, such as a central processing unit (CPU) or a microprocessor, and the memory is either internal or external to the device.

[0325] Alternatively, the units or modules in the device can be implemented in the form of hardware circuits. The functionality of some or all units can be achieved through the design of these hardware circuits, which can be understood as one or more processors. For example, in one implementation, the hardware circuit is an application-specific integrated circuit (ASIC), and the functionality of some or all of the above units is achieved through the design of the logical relationships between the components within the circuit. In another implementation, the hardware circuit can be implemented using a programmable logic device (PLD), such as a field-programmable gate array (FPGA). This PLD can include a large number of logic gates, and the connection relationships between these logic gates can be configured through configuration files to achieve the functionality of some or all of the above units. All units of the above device can be implemented entirely through processor-invoked software, entirely through hardware circuits, or partially through processor-invoked software with the remaining parts implemented through hardware circuits.

[0326] In this application embodiment, a processor is a circuit with signal processing capabilities. In one implementation, the processor can be a circuit with instruction read and execute capabilities, such as a central processing unit (CPU) or a digital signal processor (DSP). In another implementation, the processor can implement certain functions through the logical relationships of hardware circuits. These logical relationships are fixed or reconfigurable. For example, the processor is a hardware circuit implemented as an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as an FPGA. In a reconfigurable hardware circuit, the process of the processor loading a configuration document and configuring the hardware circuit can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units. Therefore, each unit in the device can be one or more processors (or processing circuits) configured to implement the above methods, such as a CPU, GPU, microprocessor, DSP, ASIC, FPGA, or a combination of at least two of these processor types.

[0327] Furthermore, the units or modules in the above devices can be integrated in whole or in part, or they can be implemented independently. In one implementation, these units or modules are integrated together as a system-on-a-chip (SOC). The SOC may include at least one processor for implementing any of the above methods or implementing the functions of the units in the device. The at least one processor may be of different types, such as CPU and FPGA.

[0328] Several possible devices are listed below.

[0329] Please see Figure 21 , Figure 21 This is a schematic diagram of the structure of a processing device provided in an embodiment of this application, namely processing device 210. Processing device 210 may include a transceiver unit 2101 and a processing unit 2102. Optionally, the processing device 210 may be a standalone device; for example, the processing device 210 may be a... Figure 2A or Figure 2B The processing device 201 is shown. Alternatively, the processing device 210 can also be a component in a standalone device (such as a node), such as a chip or integrated circuit. The processing device 210 is used to implement the aforementioned interaction method; for example, the processing device 210 is used to execute the aforementioned... Figure 5 The steps performed by the processing device in the interactive method shown.

[0330] The transceiver unit 2101 is used to perform one or more operations such as acquisition and reception, and the processing unit 2102 is used to perform one or more data processing, instruction execution and other related operations such as determination, adjustment, generation, decision-making and judgment.

[0331] In one possible implementation, the transceiver unit 2101 is used to acquire at least one information identifier in the surrounding environment of the first vehicle after the first vehicle enters the parking lot. The processing unit 2102 is used to obtain a first interface using the first information identifier, wherein the first information identifier belongs to at least one information identifier. The processing unit 2102 is further used to recognize the image of the first interface using a first model to obtain a first recognition result, wherein the first recognition result includes first indication information, which indicates whether the first interface is a payment interface, and the payment interface is used to pay the parking fee for the first vehicle in the parking lot.

[0332] In one possible implementation, the processing device 210 may further include a display unit 2103 for displaying an interface. For example, the display unit 2103 may display a second interface, which includes a second information identifier.

[0333] Furthermore, it also includes other operations for implementing interactive methods; relevant descriptions can be found in [link to relevant documentation]. Figure 5 The description of the illustrated embodiment, i.e., the specific operations performed by the processing device 210 described above, can also be found in [reference needed]. Figure 5 The descriptions in the illustrated embodiments will not be repeated here.

[0334] Please see Figure 22 , Figure 22 This is a schematic diagram of another processing device provided in this application embodiment, namely processing device 220. Processing device 220 may include a transceiver unit 2201 and a processing unit 2202. Optionally, the processing device 220 may be a standalone device; for example, the processing device 220 may be a... Figure 2A or Figure 2B The processing device 201 is shown. Alternatively, the processing device 220 can also be a component in a standalone device (such as a node), such as a chip or integrated circuit. The processing device 220 is used to implement the aforementioned interaction method; for example, the processing device 220 is used to execute the aforementioned... Figure 20 The steps performed by the processing device in the interactive method shown.

[0335] The transceiver unit 2201 is used to perform one or more operations such as acquisition and reception, and the processing unit 2202 is used to perform one or more data processing, instruction execution and other related operations such as determination, adjustment, generation, decision-making and judgment.

[0336] In one possible implementation, the transceiver unit 2201 is used to acquire an eighth information identifier. The processing unit 2202 is used to obtain a payment interface using the eighth information identifier, and the payment interface is used to pay the parking fee for the first vehicle in the parking lot. The processing unit 2202 is also used to identify the payment interface using a first model to obtain a fifth identification result, the fifth identification result including fifth operation instruction information, the fifth operation instruction information being used to instruct the payment interface to perform a fifth operation, the fifth operation being used to pay the parking fee for the first vehicle in the parking lot.

[0337] In one possible implementation, the processing device 220 may further include a display unit 2203 for displaying an interface. For example, the display unit 2203 may display a second interface, which includes a second information identifier.

[0338] Furthermore, it also includes other operations for implementing interactive methods; relevant descriptions can be found in [link to relevant documentation]. Figure 20 The description of the illustrated embodiment, i.e., the specific operations performed by the processing device 220 described above, can also be found in [reference needed]. Figure 20 The descriptions in the illustrated embodiments will not be repeated here.

[0339] Please see Figure 23 , Figure 23 This is a schematic diagram of the structure of a computing device provided in an embodiment of this application. A computing device is a device with processing capabilities. The device here can be a physical device, such as a host, or a virtual device, such as a virtual machine or a container.

[0340] like Figure 23 As shown, the computing device 230 includes a processor 2301, a memory 2302, and one or more programs, and may include a communication interface 2303. It should be understood that this application does not limit the number of processors and memories in the computing device 230.

[0341] Processor 2301 is a module that performs calculations and may include a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor (MP), a digital signal processor (DSP), a micro controller unit (MCU), or one or more integrated circuits for controlling the execution of programs in the above schemes.

[0342] Memory 2302 provides storage space, in which application data, user data, operating system, and computer programs can be optionally stored. Memory 2302 may include read-only memory (ROM) or other types of static storage devices capable of storing static information and instructions, random access memory (RAM) or other types of dynamic storage devices capable of storing information and instructions, or electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital universal optical discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but is not limited thereto.

[0343] The memory 2302 can exist independently and be connected to the processor 2301 via a bus. Alternatively, the memory 2302 can be integrated with the processor 2301.

[0344] The communication interface 2303 is used to provide information input or output to the at least one processor. And / or, the communication interface 2303 can be used to receive data transmitted externally and / or transmit data externally. The communication interface 2303 can be a wired link interface, such as an Ethernet cable, or a wireless link interface (Bluetooth, general wireless transmission, and other wireless communication technologies, etc.). Optionally, the communication interface 2303 may also include a transmitter (such as a radio frequency transmitter, antenna, etc.) or a receiver coupled to the interface.

[0345] In this embodiment, one or more programs are stored in the memory 2302 in the form of program code and configured to be executed by the processor 2301. The programs include those for implementing the aforementioned... Figure 5 The instructions for the steps executed by the processing device in the interactive method shown, or instructions for implementing the aforementioned steps, may be included. Figure 20 The instructions for the steps executed by the processing device in the illustrated interaction method. Specifically, memory 2302 stores executable instructions, and processor 2301 executes these executable instructions to implement the aforementioned steps. Figure 5 The method implemented by the processing device in the interactive method shown, that is, the memory 2302 stores the information for execution before... Figure 5 The instructions for the steps executed by the processing device in the illustrated interaction method. Alternatively, the processor 2301 executes the executable instructions to implement the aforementioned steps. Figure 20 The method implemented by the processing device in the interactive method shown, that is, the memory 2302 stores the method for executing the aforementioned Figure 20 The instructions for the steps executed by the processing device in the interactive method shown.

[0346] This application embodiment also provides a vehicle, which includes the aforementioned processing device 210 or the aforementioned computing device 230, and the vehicle is used to implement the aforementioned... Figure 5 The interaction method is shown. Alternatively, the vehicle includes the aforementioned processing device 220 or the aforementioned computing device 230, and the vehicle is used to implement the aforementioned... Figure 20 The interaction method shown.

[0347] This application also provides a chip, which includes a processor for executing computer execution instructions to cause a device on which the chip is mounted to perform the aforementioned functions. Figure 5 The interaction method shown or Figure 20 The interaction method shown.

[0348] This application also provides a computer program product containing computer instructions. The computer program product may be a software or program product containing computer instructions, capable of running on a computing device or stored on any usable medium. When the computer instructions are executed by a processor, the aforementioned interaction method is implemented, for example... Figure 5 The interaction method shown or Figure 20 The interaction method shown.

[0349] This application also provides a computer-readable storage medium. This computer-readable storage medium is used to store a computer program, the computer program including instructions for implementing the aforementioned interactive method, for example... Figure 5 The interaction method shown or Figure 20 The interaction method shown.

[0350] The computer-readable storage medium can be any available medium that can be stored in any device of a processing apparatus or computing device, or a data storage device such as a data center that contains one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium, or a semiconductor medium (e.g., a solid-state drive).

[0351] In this application, the terms "exemplary" or "for example" are used to indicate that something is an example, illustration, or description. Any embodiment or design described as "exemplary" or "for example" in this application should not be construed as being more preferred or advantageous than other embodiments or designs. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0352] In this application, "at least one" in the embodiments refers to one or more items, and "more than one" refers to two or more items. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or multiple items. For example, at least one of a, b, or c can represent: a, b, c, (a and b), (a and c), (b and c), or (a and b and c), where a, b, and c can be single or multiple. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship.

[0353] Furthermore, unless otherwise stated, the use of ordinal numbers such as "first" and "second" in the embodiments of this application is for distinguishing multiple objects and is not for limiting the order, sequence, priority or importance of multiple objects.

[0354] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware or by a program instructing related hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.

[0355] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the protection scope of the technical solutions of the embodiments of this application.

Claims

1. An interaction method, characterized in that, The method includes: After the first vehicle enters the parking lot, at least one information identifier in the surrounding environment of the first vehicle is obtained. A first interface is obtained using a first information identifier, wherein the first information identifier belongs to the at least one information identifier; The image of the first interface is identified using a first model to obtain a first identification result. The first identification result includes first indication information, which is used to indicate whether the first interface is a payment interface, and the payment interface is used to pay the parking fee of the first vehicle in the parking lot.

2. The method according to claim 1, characterized in that, The step of using the first model to recognize the image of the first interface and obtain a first recognition result includes: Get text hints; The text prompt and the image of the first interface are input into the first model to obtain the first recognition result.

3. The method according to claim 1 or 2, characterized in that, The method further includes: When the first indication information is used to indicate that the first interface is the payment interface, a first information and a second information identifier are generated. The first information is used to indicate that the first information identifier is a payment availability identifier for the parking lot, and the second information identifier is used to identify the payment interface. The second interface is displayed, and the second interface includes a second information identifier.

4. The method according to any one of claims 1-3, characterized in that, The method further includes: If the first indication information indicates that the first interface is not the payment interface, second information is generated, and the second information is used to indicate that the first information identifier is a payment unavailable identifier for the parking lot.

5. The method according to any one of claims 1-3, characterized in that, When the first indication information indicates that the first interface is not the payment interface, the first identification result further includes first operation indication information, which indicates that a first operation is performed on the first interface so that the first interface jumps to a jumpable interface of the first interface.

6. The method according to claim 5, characterized in that, The first operation instruction information includes a first location indication and a first indication identifier, and the method further includes: The first indicator is displayed at a first position in the first interface indicated by the first position indicator, and the first indicator includes a cursor.

7. The method according to claim 6, characterized in that, The first operation includes clicking and / or swiping a first position in the first interface.

8. The method according to any one of claims 4-7, characterized in that, The first interface has multiple jumpable interfaces, and the method further includes: The first model is used to identify the image of the first jumpable interface to obtain a second identification result. The second identification result includes second indication information, which is used to indicate whether the first jumpable interface is the payment interface. The first jumpable interface belongs to multiple jumpable interfaces.

9. The method according to claim 8, characterized in that, The method further includes: When the second indication information indicates that the first jumpable interface is the payment interface, third information and third information identifier are generated. The third information is used to indicate that the first information identifier is the payment availability identifier of the parking lot, and the third information identifier is used to identify the payment interface. The third interface is displayed, and the third interface includes a third information identifier.

10. The method according to claim 8 or 9, characterized in that, When the second indication information indicates that the first jumpable interface is not the payment interface, the second identification result also includes second operation indication information. The second operation indication information is used to indicate that a second operation is performed on the first jumpable interface so that the first jumpable interface jumps to the second jumpable interface, and the second jumpable interface belongs to multiple jumpable interfaces.

11. The method according to claim 8 or 9, characterized in that, The method further includes: When the second indication information indicates that the first jumpable interface is not the payment interface, the second identification result also includes a third operation indication information and a fourth operation indication information. The third operation indication information is used to indicate that a third operation is performed on the first jumpable interface so that the first jumpable interface jumps to the first interface. The fourth operation indication information is used to indicate that a fourth operation is performed on the first interface so that the first interface jumps to the third jumpable interface. The third jumpable interface belongs to multiple jumpable interfaces. The first model is used to identify the image of the third jumpable interface to obtain a third identification result. The third identification result includes third indication information, which is used to indicate whether the third jumpable interface is the payment interface.

12. The method according to any one of claims 8-10, characterized in that, The method further includes: The first model is used to identify the image of each of the multiple jumpable interfaces to obtain multiple identification results. Each of the multiple identification results corresponds to one of the multiple jumpable interfaces. The indication information in each identification result is used to indicate whether the jumpable interface corresponding to each identification result is the payment interface. If the indication information in each identification result is used to indicate that the jumpable interface corresponding to each identification result is not the payment interface, a fourth piece of information is generated. The fourth piece of information is used to indicate that the first information identifier is the payment unavailable identifier of the parking lot.

13. The method according to any one of claims 1-12, characterized in that, The first model includes a first sub-model and a second sub-model. The step of using the first model to identify the image of the first interface and obtain a first identification result includes: The first sub-model is used to identify the image of the first interface to obtain the text information of the first interface; Obtain the location of the first vehicle; The image of the first interface, the text information of the first interface, and the location of the first vehicle are input into the second sub-model to obtain the first recognition result.

14. The method according to any one of claims 1-13, characterized in that, The method further includes: Obtain the stored data corresponding to the location of the first vehicle, wherein the stored data includes a fourth information identifier; The fourth interface is obtained using the fourth information identifier; The first model is used to identify the image of the fourth interface to obtain a fourth identification result. The fourth identification result includes fourth indication information, which is used to indicate whether the fourth interface is the payment interface. Based on the first identification result, the fourth identification result, the first information identifier, and the fourth information identifier, a fifth information identifier is obtained, which is used to identify the payment interface; The fifth interface is displayed, and the fifth interface includes the fifth information identifier.

15. The method according to any one of claims 1-13, characterized in that, The method further includes: Obtain the storage data corresponding to the location of the first vehicle. The storage data includes a sixth information identifier and payment identifier information related to the sixth information identifier. The payment identifier information is used to indicate whether at least one second vehicle has successfully paid the parking fee of the second vehicle in the parking lot using the sixth information identifier. Based on the first identification result, the payment identification information related to the sixth information identifier, the first information identifier, and the sixth information identifier, a seventh information identifier is obtained, which is used to identify the payment interface. The sixth interface is displayed, which includes the seventh information identifier.

16. The method according to claim 15, characterized in that, The payment identifier information includes multiple payment identifiers, including a first payment identifier. The first payment identifier is used to indicate that the second vehicle has successfully paid the parking fee of the second vehicle in the parking lot using the sixth information identifier. If the ratio between the number of the first payment identifiers and the number of the multiple payment identifiers is greater than a proportional threshold, the seventh information identifier is the sixth information identifier.

17. The method according to any one of claims 1-16, characterized in that, The method further includes: Obtain the parking fee schedule and the parking duration of the first vehicle in the parking lot; Based on the parking lot's charging standards and the parking duration of the first vehicle in the parking lot, predicted payment information is generated, which is used to indicate the predicted parking cost of the first vehicle in the parking lot.

18. The method according to any one of claims 1-17, characterized in that, The method further includes: The payment interface is identified using the first model to obtain a fifth identification result. The fifth identification result includes a fifth operation instruction information, which is used to instruct the payment interface to perform a fifth operation, which is used to pay the parking fee of the first vehicle in the parking lot.

19. The method according to claim 18, characterized in that, The fifth operation instruction information includes a second location indication and a second indication identifier, and the method further includes: The second indicator is displayed at a second position in the payment interface indicated by the second position indicator. The second indicator includes a cursor. The fifth operation includes at least one of the following: Click the second location on the payment interface. Slide the second position on the payment interface. Enter information related to the identity of the first vehicle in the second location on the payment interface.

20. The method according to claim 18 or 19, characterized in that, The method further includes: The fifth operation is performed on the payment interface to obtain the seventh interface, which is used to confirm payment of the parking fee for the first vehicle in the parking lot.

21. A processing apparatus, characterized in that, The processing device includes: The transceiver unit is used to acquire at least one information identifier in the surrounding environment of the first vehicle after detecting that the first vehicle has entered the parking lot. Processing unit, used for: A first interface is obtained using a first information identifier, wherein the first information identifier belongs to the at least one information identifier; The image of the first interface is identified using a first model to obtain a first identification result. The first identification result includes first indication information, which is used to indicate whether the first interface is a payment interface, and the payment interface is used to pay the parking fee of the first vehicle in the parking lot.

22. A computing device, characterized in that, The computing device includes a processor and a memory, the memory storing a program, and the processor executing the program to cause the computing device to perform the method as described in any one of claims 1-20.

23. A vehicle, characterized in that, The vehicle includes the processing device as claimed in claim 21 or the computing device as claimed in claim 22, and the vehicle is used to implement the method as claimed in any one of claims 1-20.

24. A computer-readable storage medium, characterized in that, The computer-readable storage medium is used to store a computer program, the computer program including instructions for performing the method as described in any one of claims 1-20.

25. A computer program product, characterized in that, The computer program product includes instructions that, when executed by a processor, cause the method as described in any one of claims 1-20 to be implemented.

Images