Intelligent payment method and device based on image recognition and positioning technology

Abstract

The invention provides an intelligent payment method and device based on an image recognition and positioning technology, and relates to the field of artificial intelligence technology and financial science and technology, and the method comprises the steps: obtaining environment image data and vehicle positioning information uploaded by a vehicle; determining first merchant information through image recognition according to the environment image data; determining second merchant information within a set distance range of a current positioning position according to the vehicle positioning information; matching the first commercial tenant information with the second commercial tenant information, and determining a commercial tenant currently corresponding to the vehicle; and according to a payment request initiated by a merchant currently corresponding to the vehicle, issuing a to-be-paid order corresponding to the payment request to an intelligent payment system of the vehicle, and processing the payment according to payment data submitted by the intelligent payment system.

Description

Technical Field

[0001] The present invention relates to artificial intelligence technology and the field of financial technology, and in particular to an intelligent payment method and device based on image recognition and positioning technology. Background Art

[0002] This section is intended to provide a background or context to the embodiments of the invention recited in the claims. No admission is made that the description herein is prior art by inclusion in this section.

[0003] With the rapid economic development, the number of cars has gradually increased, and the volume of in-vehicle payment transactions related to cars has also increased. For example, paying for fuel will be the most common payment in the future, accounting for about 48% of the total in-vehicle payment transactions. However, traditional gas stations usually require drivers to get off the car and go to the checkout counter or use self-service equipment to check out, and may also require manual assistance from service personnel. It takes a long time from refueling to checkout, the labor cost is high, and it may also cause queues at gas stations, and the overall payment process is inefficient.

[0004] In summary, there is an urgent need for an intelligent payment technology solution that can overcome the above-mentioned defects and improve the efficiency of in-vehicle payment. Summary of the invention

[0005] In order to solve the problems existing in the prior art, the present invention proposes an intelligent payment method and device based on image recognition and positioning technology.

[0006] In a first aspect of an embodiment of the present invention, a smart payment method based on image recognition and positioning technology is proposed, comprising:

[0007] Obtain environmental image data and vehicle positioning information uploaded by the vehicle;

[0008] Determining first merchant information through image recognition according to the environmental image data;

[0009] Determine second merchant information within a set distance range of the current positioning position according to the vehicle positioning information;

[0010] Matching the first merchant information and the second merchant information to determine the merchant currently corresponding to the vehicle;

[0011] According to the payment request initiated by the merchant currently corresponding to the vehicle, the order to be paid corresponding to the payment request is sent to the intelligent payment system of the vehicle, and the payment is processed according to the payment data submitted by the intelligent payment system.

[0012] In a second aspect of an embodiment of the present invention, a smart payment method based on image recognition and positioning technology is proposed, including:

[0013] Obtain environmental image data and vehicle positioning information uploaded by the vehicle;

[0014] Determining first merchant information through image recognition according to the environmental image data;

[0015] Determine the second merchant information within a set distance range of the current positioning position according to the vehicle positioning information; wherein the transaction processing system matches the first merchant information and the second merchant information to determine the merchant currently corresponding to the vehicle; according to a payment request initiated by the merchant currently corresponding to the vehicle, send the order to be paid corresponding to the payment request to the intelligent payment system of the vehicle, and process the payment according to the payment data submitted by the intelligent payment system.

[0016] In a third aspect of an embodiment of the present invention, a smart payment method based on image recognition and positioning technology is proposed, including:

[0017] Matching the first merchant information and the second merchant information to determine the merchant currently corresponding to the vehicle; wherein the first merchant information and the second merchant information are determined by a vehicle equipment manufacturer system; the vehicle equipment manufacturer system obtains environmental image data and vehicle positioning information uploaded by the vehicle; determines the first merchant information through image recognition based on the environmental image data; and determines the second merchant information within a set distance range of the current positioning position based on the vehicle positioning information;

[0018] According to the payment request initiated by the merchant currently corresponding to the vehicle, the order to be paid corresponding to the payment request is sent to the intelligent payment system of the vehicle, and the payment is processed according to the payment data submitted by the intelligent payment system.

[0019] In a fourth aspect of the embodiment of the present invention, a smart payment device based on image recognition and positioning technology is proposed, including: a vehicle equipment manufacturer system and a transaction processing system; wherein,

[0020] Vehicle equipment manufacturer system, used to obtain environmental image data and vehicle positioning information uploaded by the vehicle;

[0021] Determining first merchant information through image recognition according to the environmental image data;

[0022] Determine second merchant information within a set distance range of the current positioning position according to the vehicle positioning information;

[0023] A transaction processing system, used to match the first merchant information with the second merchant information to determine the merchant currently corresponding to the vehicle;

[0024] According to the payment request initiated by the merchant currently corresponding to the vehicle, the order to be paid corresponding to the payment request is sent to the intelligent payment system of the vehicle, and the payment is processed according to the payment data submitted by the intelligent payment system.

[0025] In a fifth aspect of an embodiment of the present invention, a vehicle equipment manufacturer system is provided, including:

[0026] An information acquisition module is used to acquire environmental image data and vehicle positioning information uploaded by the vehicle;

[0027] An information analysis module, configured to determine first merchant information through image recognition according to the environmental image data;

[0028] Determine the second merchant information within a set distance range of the current positioning position according to the vehicle positioning information; wherein the transaction processing system matches the first merchant information and the second merchant information to determine the merchant currently corresponding to the vehicle; according to a payment request initiated by the merchant currently corresponding to the vehicle, send the order to be paid corresponding to the payment request to the intelligent payment system of the vehicle, and process the payment according to the payment data submitted by the intelligent payment system.

[0029] In a sixth aspect of an embodiment of the present invention, a transaction processing system is provided, including:

[0030] A merchant matching module is used to match the first merchant information and the second merchant information to determine the merchant currently corresponding to the vehicle; wherein the first merchant information and the second merchant information are determined by a vehicle equipment manufacturer system; the vehicle equipment manufacturer system obtains environmental image data and vehicle positioning information uploaded by the vehicle; determines the first merchant information through image recognition based on the environmental image data; and determines the second merchant information within a set distance range of the current positioning position based on the vehicle positioning information;

[0031] The transaction processing module is used to send the order to be paid corresponding to the payment request initiated by the merchant currently corresponding to the vehicle to the intelligent payment system of the vehicle, and process the payment according to the payment data submitted by the intelligent payment system.

[0032] In the seventh aspect of the embodiments of the present invention, a computer device is proposed, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, an intelligent payment method based on image recognition and positioning technology is implemented.

[0033] In an eighth aspect of an embodiment of the present invention, a computer-readable storage medium is proposed, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, an intelligent payment method based on image recognition and positioning technology is implemented.

[0034] In a ninth aspect of an embodiment of the present invention, a computer program product is proposed. The computer program product includes a computer program. When the computer program is executed by a processor, an intelligent payment method based on image recognition and positioning technology is implemented.

[0035] The intelligent payment method and device based on image recognition and positioning technology proposed in the present invention improve the acquisition of environmental image data and vehicle positioning information uploaded by the vehicle; determine the first merchant information through image recognition based on the environmental image data; determine the second merchant information within a set distance range of the current positioning position based on the vehicle positioning information; match the first merchant information and the second merchant information to determine the merchant currently corresponding to the vehicle; according to the payment request initiated by the merchant currently corresponding to the vehicle, send the order to be paid corresponding to the payment request to the intelligent payment system of the vehicle, and process the payment according to the payment data submitted by the intelligent payment system; the overall process uses image recognition technology and precise positioning service technology to intelligently lock the place, merchant, and bill, so that smart car customers can quickly complete in-vehicle payment, provide a more convenient and intelligent payment method, comprehensively improve the payment experience of smart car customers, reduce labor costs, improve the efficiency of in-vehicle payment, and provide strong technical support for in-vehicle payment scenarios. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0037] Figure 1 It is a flow chart of an intelligent payment method based on image recognition and positioning technology according to an embodiment of the present invention.

[0038] Figure 2 It is a flowchart of image recognition according to an embodiment of the present invention.

[0039] Figure 3 It is a schematic diagram of a process of processing positioning information according to an embodiment of the present invention.

[0040] Figure 4 It is a flowchart of image recognition according to a specific embodiment of the present invention.

[0041] Figure 5It is a schematic diagram of the payment processing flow of an embodiment of the present invention.

[0042] Figure 6 It is a flowchart of processing a three-party payment protocol according to an embodiment of the present invention.

[0043] Figure 7 The present invention is a schematic diagram of a transaction processing flow for automatically locating an order to be paid according to an embodiment of the present invention.

[0044] Figure 8 It is a schematic diagram of the processing flow when the vehicle equipment manufacturer system performs payment processing according to one embodiment of the present invention.

[0045] Fig. 9 It is a schematic diagram of the processing flow of a transaction processing system performing payment processing according to an embodiment of the present invention.

[0046] Fig.10 It is a schematic diagram of a payment processing flow of a specific embodiment of the present invention.

[0047] Fig.11 It is a schematic diagram of the architecture of a smart payment device based on image recognition and positioning technology according to an embodiment of the present invention.

[0048] Fig.12 It is a schematic diagram of the architecture of a vehicle equipment manufacturer system according to an embodiment of the present invention.

[0049] Fig.13 It is a schematic diagram of the transaction processing system architecture of an embodiment of the present invention.

[0050] Fig.14 It is a schematic diagram of the structure of a computer device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0051] The principles and spirit of the present invention will be described below with reference to several exemplary embodiments. It should be understood that these embodiments are provided only to enable those skilled in the art to better understand and implement the present invention, and are not intended to limit the scope of the present invention in any way. On the contrary, these embodiments are provided to make the present disclosure more thorough and complete, and to fully convey the scope of the present disclosure to those skilled in the art.

[0052] Those skilled in the art will appreciate that the embodiments of the present invention may be implemented as a system, device, apparatus, method or computer program product. Therefore, the present disclosure may be specifically implemented in the following forms, namely: complete hardware, complete software (including firmware, resident software, microcode, etc.), or a combination of hardware and software.

[0053] According to an embodiment of the present invention, an intelligent payment method and device based on image recognition and positioning technology are proposed, which relate to artificial intelligence technology and the field of financial technology.

[0054] The principle and spirit of the present invention are explained in detail below with reference to several representative embodiments of the present invention.

[0055] Figure 1 FIG. 1 is a flow chart of an intelligent payment method based on image recognition and positioning technology according to an embodiment of the present invention. Figure 1 As shown, the method includes:

[0056] S101, obtaining environmental image data and vehicle positioning information uploaded by the vehicle;

[0057] S102, determining first merchant information through image recognition according to the environmental image data;

[0058] S103, determining second merchant information within a set distance range of the current positioning position according to the vehicle positioning information;

[0059] S104, matching the first merchant information and the second merchant information to determine the merchant currently corresponding to the vehicle;

[0060] S105, according to the payment request initiated by the merchant currently corresponding to the vehicle, the order to be paid corresponding to the payment request is sent to the intelligent payment system of the vehicle, and the payment is processed according to the payment data submitted by the intelligent payment system.

[0061] In actual application scenarios, the intelligent payment method based on image recognition and positioning technology of the present invention has the following working principle: obtaining environmental image data and vehicle positioning information uploaded by the vehicle; determining the first merchant information through image recognition based on the environmental image data; determining the second merchant information within a set distance range of the current positioning position based on the vehicle positioning information; matching the first merchant information and the second merchant information to determine the merchant currently corresponding to the vehicle; according to the payment request initiated by the merchant currently corresponding to the vehicle, sending the order to be paid corresponding to the payment request to the intelligent payment system of the vehicle, and processing the payment according to the payment data submitted by the intelligent payment system; the overall process uses image recognition technology and precise positioning service technology to intelligently lock places, merchants, and bills, so that smart car customers can quickly complete in-vehicle payments, provide more convenient and intelligent payment methods, comprehensively improve the payment experience of smart car customers, reduce labor costs, and improve the efficiency of in-vehicle payments, providing strong technical support for in-vehicle payment scenarios.

[0062] In order to explain the above-mentioned intelligent payment method based on image recognition and positioning technology more clearly, each step is described in detail below.

[0063] S101, obtaining environmental image data and vehicle positioning information uploaded by the vehicle.

[0064] In one embodiment, the environmental image information may be captured by a vehicle-mounted camera, and the vehicle positioning information may be determined by a vehicle positioning system.

[0065] The environmental image data is a photo of the environment around the vehicle, which is captured and uploaded at a set time interval (for example, 10 seconds).

[0066] S102: Determine first merchant information through image recognition according to the environment image data.

[0067] If a merchant can be identified in a certain number of consecutive environmental images in chronological order, it can be considered that the vehicle is currently next to the merchant and the customer may place a payment order at the merchant.

[0068] In one embodiment, reference Figure 2 , the specific methods of image recognition include:

[0069] S201, preprocessing the environment image data to extract text image data and building image data;

[0070] S202, input the text image data and the building image data as input samples to an image recognition model, wherein the image recognition model aims to recognize text information and building information, outputs the text information and building information corresponding to the environment image data, and determines the first merchant information based on the text information and building information; wherein the first merchant information at least includes the merchant name.

[0071] S103: Determine second merchant information within a set distance range of the current positioning position according to the vehicle positioning information.

[0072] After performing image recognition on the environmental image data to obtain the first merchant information, positioning and identifying the second merchant information is performed. That is, if the first merchant information cannot be identified through image recognition, it is considered that the customer is not near any merchant and the customer will not generate a payment order.

[0073] In one embodiment, reference Figure 3 , the location information processing method includes:

[0074] S301, determining the longitude and latitude of the vehicle according to the vehicle positioning information;

[0075] S302, based on the longitude and latitude uploaded by the merchant when using the positioning service, determine the merchant within the set distance range of the longitude and latitude of the vehicle as the second merchant, and obtain the second merchant information; wherein the second merchant information at least includes the longitude and latitude uploaded by the merchant when using the positioning service, the merchant name, address and contact information.

[0076] In the actual application scenario, take the example of a customer driving a smart car to a gas station to refuel. The onboard camera of the smart car captures environmental information at a fixed time (for example, 10 seconds) and uploads the environmental information picture to the vehicle equipment manufacturer system. The vehicle equipment manufacturer system determines whether the environmental information is a gas station based on image recognition technology. If it is not a gas station, no processing is performed. If it is a gas station and it is determined to be a gas station twice in a row, the precise positioning service is called to locate the specific location of the vehicle, obtain the location information, and then call the transaction processing system to send a pre-judgment payment request. The specific information sent includes the smart car license plate number, environmental information, location information, etc.

[0077] The specific application scenarios are not limited to refueling, but can also be other payment scenarios.

[0078] Smart car service equipment manufacturers locate vehicles based on image recognition technology. Image recognition is an important field of artificial intelligence. It refers to the technology of using computers to process, analyze and understand images to identify targets and objects of various different patterns. Specifically, each image has its own characteristics. By classifying and extracting important features of the image, and effectively eliminating useless redundant features, key information is extracted, so that image recognition can be achieved. Reference Figure 4 , is a schematic diagram of the image recognition process of a specific embodiment. Image recognition includes four steps: image acquisition, image processing, image recognition, and output results.

[0079] Smart vehicle equipment manufacturers locate vehicle positions based on precise positioning services. Precise positioning services include Beidou navigation, GPS, LBS, etc., which obtain terminal users' location information through the radio communication network of telecommunications and mobile operators or external positioning methods.

[0080] S104: Match the first merchant information and the second merchant information to determine the merchant currently corresponding to the vehicle.

[0081] In one embodiment, the first merchant information is matched with the second merchant information in sequence, and the merchant information whose matching degree reaches a set matching threshold is selected as the merchant currently corresponding to the vehicle.

[0082] The merchant's file information should be consistent with the merchant information of precise positioning. The merchant must retain the latitude and longitude information and merchant information when the transaction processor creates the file. The smart vehicle equipment manufacturer shall submit the latitude and longitude information and merchant information when submitting the location information. If the latitude and longitude information and merchant information (merchant name, merchant address, merchant telephone number information, etc.) match, they are considered consistent if the matching degree reaches 90%.

[0083] S105, according to the payment request initiated by the merchant currently corresponding to the vehicle, the order to be paid corresponding to the payment request is sent to the intelligent payment system of the vehicle, and the payment is processed according to the payment data submitted by the intelligent payment system.

[0084] refer to Figure 5 , the specific payment processing process is:

[0085] S501, query whether the merchant currently corresponding to the vehicle has any order to be paid within a set time range; if so, send the order to be paid to the intelligent payment system of the vehicle.

[0086] For example, in the refueling scenario, if it is predicted that a customer may refuel, it is necessary to determine whether the merchant has orders to be paid within the next 2 minutes. If so, the customer will be prompted. If not, no prompt will be given. This time can be adjusted based on the statistics of refueling time consumption.

[0087] S502, after the order to be paid corresponding to the payment request is sent to the smart payment system of the vehicle, the smart payment system displays the order to be paid, and the customer manually confirms and enters the device number, product number or order number.

[0088] For example, in the refueling scenario, customers can manually enter the number of the gas gun. In other payment scenarios, they can enter the product number, order number, etc.

[0089] S503: Locate the order to be paid according to the order number, product number or device number, and complete corresponding payment processing.

[0090] In a specific embodiment, reference Figure 6 , the method further comprises:

[0091] S601, acquiring vehicle identity information while acquiring environmental image data and vehicle positioning information uploaded by the vehicle, wherein the vehicle identity information is bound to the smart payment system of the vehicle.

[0092] S602, constructing a three-party payment agreement among the smart payment system, the vehicle equipment manufacturer system and the transaction processing system corresponding to the vehicle identity information; wherein the vehicle equipment manufacturer system is used to analyze the environmental image data and the vehicle positioning information to determine the first merchant information and the second merchant information; the transaction processing system is used to determine the merchant currently corresponding to the vehicle, send the order to be paid initiated by the merchant to the vehicle's smart payment system, and process the corresponding payment data.

[0093] In actual application scenarios, vehicle identity information (license plate number) is the primary key to link transactions. If a customer uses this service, he / she needs to sign a three-party payment agreement with the transaction processor (intelligent payment system), vehicle equipment manufacturer (vehicle equipment manufacturer system), and transaction processor (transaction processing system), and store it in the transaction processor.

[0094] The agreement information includes filling in the vehicle equipment number, license plate number, and agreeing to accept smart payment services. After the customer signs the agreement, the transaction processor notifies the vehicle equipment manufacturer through an interface call, and the vehicle equipment manufacturer binds the license plate number with the vehicle camera device number based on the vehicle equipment number. The transaction processor pushes payment notification messages based on the license plate number.

[0095] For example, a customer signs a three-party payment agreement at a commercial bank among the customer, the vehicle equipment manufacturer, and the commercial bank; the transaction processor is not limited to a commercial bank, but can also be the payment processing system of other non-bank institutions.

[0096] S603, after obtaining the vehicle identity information, the first merchant information and the second merchant information pushed by the vehicle equipment manufacturer system, the transaction processing system determines whether there is a three-party payment agreement corresponding to the vehicle identity information based on the vehicle identity information. If so, the first merchant information and the second merchant information are analyzed; if not or the agreement status is abnormal, no processing is performed.

[0097] After receiving the information, the transaction processor queries the payment agreement based on the license plate number. If the payment agreement status is normal, the merchant profile information (latitude and longitude, merchant name, address, telephone number, etc.) is matched through environmental information and location information. If the match is successful, it is determined whether the merchant has any orders to be paid in the past 2 minutes. If so, the smart payment system message reminder function based on the smart car smart screen will prompt the customer "Are you refueling? Please click OK to complete the payment." After the customer clicks OK, he can manually enter the gas gun number to view the bill and complete the payment.

[0098] In another embodiment, in order to improve the processing efficiency of order payment, an automated processing method can also be implemented by analyzing environmental image data. Specifically, the environmental image data also includes: equipment images, product images or order images;

[0099] refer to Figure 7 The specific processing method is

[0100] S701, the vehicle equipment manufacturer system performs image recognition based on the equipment image, product image or order image, determines the equipment number, product number or order number, and uploads it to the transaction processing system;

[0101] S702, the transaction processing system locates the order to be paid according to the order number, product number or device number, and completes corresponding payment processing.

[0102] In actual application scenarios, the gun number is obtained through image recognition, thereby replacing the operation of manually inputting the gun number. When uploading information, the gun number can be sent to the transaction processing system, and the bill can be located through merchant information and gun number, thereby improving customer payment efficiency.

[0103] In one embodiment, for a vehicle equipment manufacturer system, the processing flow is as follows: Figure 8 As shown, including:

[0104] S801, obtaining environmental image data and vehicle positioning information uploaded by the vehicle;

[0105] S802, determining first merchant information through image recognition according to the environmental image data;

[0106] S803, determining the second merchant information within a set distance range of the current positioning position according to the vehicle positioning information; wherein the transaction processing system matches the first merchant information and the second merchant information to determine the merchant currently corresponding to the vehicle; according to the payment request initiated by the merchant currently corresponding to the vehicle, sending the order to be paid corresponding to the payment request to the intelligent payment system of the vehicle, and processing the payment according to the payment data submitted by the intelligent payment system.

[0107] In one embodiment, for a transaction processing system, the processing flow is as follows: Fig. 9 As shown, including:

[0108] S901, matching the first merchant information and the second merchant information to determine the merchant currently corresponding to the vehicle; wherein the first merchant information and the second merchant information are determined by a vehicle equipment manufacturer system; the vehicle equipment manufacturer system obtains environmental image data and vehicle positioning information uploaded by the vehicle; determines the first merchant information through image recognition based on the environmental image data; and determines the second merchant information within a set distance range of the current positioning position based on the vehicle positioning information;

[0109] S902, according to the payment request initiated by the merchant currently corresponding to the vehicle, the order to be paid corresponding to the payment request is sent to the intelligent payment system of the vehicle, and the payment is processed according to the payment data submitted by the intelligent payment system.

[0110] The present invention intelligently locks places, merchants, and bills based on image recognition technology and precise positioning service technology, making it convenient for smart car customers to quickly complete the payment of gas fees and other expenses; this solution provides a more convenient and intelligent payment method for smart car on-board payment, which can comprehensively improve the payment experience of smart car customers; at the same time, it also breaks through the traditional mode (ETC) of installing a camera on the B-end to guide payment through OCR recognition of license plates. The present invention realizes pre-judgment payment from the C-end and can be quickly expanded to various payment scenarios without the need for hardware modification on the B-end, and has strong promotion potential.

[0111] It should be noted that, although the operations of the method of the present invention are described in a specific order in the above embodiments and the accompanying drawings, this does not require or imply that the operations must be performed in the specific order, or that all the operations shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps.

[0112] In conjunction with a specific embodiment, the following describes the smart payment method based on image recognition and positioning technology of the present invention by taking a customer driving a smart car to refuel as an example.

[0113] refer to Fig.10 , in this scenario, it includes customers, smart car on-board equipment, smart car equipment manufacturer server (vehicle equipment manufacturer system), commercial bank server (payment processing system), and commercial bank client (smart payment system).

[0114] Smart car in-vehicle equipment: Involving in-vehicle cameras, in-vehicle positioning systems, and in-vehicle smart screens. In-vehicle cameras capture environmental information at any time and regularly (10s) upload screenshots of environmental information to the smart car equipment manufacturer's server; the in-vehicle positioning system is a device signal receiver that can locate the vehicle and obtain vehicle location information; the in-vehicle smart screen supports the installation of various application software and receives message reminders. Specifically, it supports customers to complete payments through commercial bank clients on the smart screen.

[0115] Smart car equipment manufacturer server: involves image recognition module and precise positioning service module. The image recognition module uses image recognition technology to identify and analyze the environmental information screenshot sent by the vehicle camera. If the environmental information is judged to be a gas station, the mental positioning service module is called to obtain the location information, and then the associated license plate number is searched through the vehicle camera device number. The commercial bank server is called to send the license plate number, environmental information, and location information for further pre-judgment and payment processing.

[0116] Commercial bank service end: involves payment processing module, which mainly receives pre-judgment payment requests (notifications from smart car equipment manufacturers), and then determines the acquiring merchant and whether the merchant has orders to be paid based on location information. If so, the front end is notified to remind the customer to make payment and process the customer's payment request.

[0117] Commercial bank client: Commercial bank application that supports the front-end prompting of customers’ pending payment information and guiding customers to complete payment.

[0118] like Fig.10 As shown, the specific process is:

[0119] S1001, the customer drives the smart car to the gas station to refuel.

[0120] S1002, the 360-degree camera on the smart car captures environmental information and sends environmental screenshots to the smart car equipment manufacturer's server at regular intervals (every 10 seconds).

[0121] Cameras can be arranged around the vehicle body, for example, 4 cameras can be arranged.

[0122] S1003, the smart car equipment manufacturer server determines the environment content through image recognition technology and determines it to be a gas station (env=1), and determines it to be a gas station (env=1) twice in a row.

[0123] Among them, the on-board 360-degree camera takes four pictures of the environment simultaneously each time, and uploads them to the server every 10 seconds. The server of the smart car equipment manufacturer receives the four pictures and calls the image recognition technology to analyze whether it is a gas station based on the fuel tank style matching. If a photo is identified as a gas station, and two consecutive photos are identified as a gas station, it is considered to be a gas station.

[0124] S1004, the smart car equipment manufacturer server calls the precise positioning service to obtain location information, including longitude and latitude (shopsite), merchant name (shopname), merchant address (shopaddress), merchant phone number (shopphone), etc.

[0125] If merchants use location services, they need to upload merchant information.

[0126] S1005, the smart car equipment manufacturer's server calls the commercial bank's server payment processing module to send a pre-judgment payment request, and uploads the license plate information (lic=001), gas station information (env=1) and location information.

[0127] S1006, the payment processing module of the commercial bank service end queries the payment agreement through the license plate information (lic=001), and does not process if there is no agreement or the agreement status is abnormal; if the agreement status is normal, continues processing.

[0128] S1007, the payment processing module of the commercial bank service end locates the acquiring merchant (shopcode=100) according to the environmental information category (env=1) and the location information.

[0129] S1008, the payment processing module of the commercial bank service end queries the merchant based on the acquiring merchant number (shopcode=100) whether there is any order to be paid within the past 2 minutes. If there is any order to be paid, the commercial bank client is called to send a message prompt.

[0130] S1009, the commercial bank client prompts the customer whether he needs to pay for refueling through the smart car smart screen message.

[0131] S1010, the customer confirms payment.

[0132] S1011, the commercial bank client guides the customer to enter the gas gun number (fnum=01), and the commercial bank client sends the gas gun number (fnum=01) to the commercial bank service end.

[0133] In other application scenarios, the gas gun number can be captured by the smart car's onboard 360-degree camera, and then identified through image recognition technology and uploaded to the commercial bank service end, thereby automatically locating the order to be paid without the need for manual input by the customer, improving payment efficiency and payment experience.

[0134] S1012, the commercial bank service end locates the bill to be paid through the gas gun number (fnum=01), and returns the order information to the commercial bank client.

[0135] S1013, the client displays the order information and guides the customer to complete the payment.

[0136] In the above process of refueling and completing payment, customers can complete refueling and payment of refueling orders without getting off the car, which effectively improves the convenience of in-vehicle payment and enables smart car customers to complete refueling and other fees without getting off the car. The overall process mainly starts from the C-end, based on image recognition technology and precise positioning service technology, intelligently locks the place, merchant, and bill, making it convenient for customers to pay quickly.

[0137] After introducing the method of the exemplary embodiment of the present invention, next, refer to Figures 11 to 13 A smart payment device based on image recognition and positioning technology according to an exemplary embodiment of the present invention is introduced.

[0138] The implementation of the smart payment device based on image recognition and positioning technology can refer to the implementation of the above method, and the repeated parts will not be repeated. The term "module" or "unit" used below can be a combination of software and / or hardware that implements a predetermined function. Although the device described in the following embodiments is preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceivable.

[0139] Based on the same inventive concept, the present invention also proposes a smart payment device based on image recognition and positioning technology, such as Fig.11 As shown, the device includes: a vehicle equipment manufacturer system 110, a transaction processing system 120 and a smart payment system 130; wherein,

[0140] The vehicle equipment manufacturer system 110 is used to obtain environmental image data and vehicle positioning information uploaded by the vehicle;

[0141] Determining first merchant information through image recognition according to the environmental image data;

[0142] Determine second merchant information within a set distance range of the current positioning position according to the vehicle positioning information;

[0143] The transaction processing system 120 is used to match the first merchant information with the second merchant information to determine the merchant currently corresponding to the vehicle;

[0144] According to the payment request initiated by the merchant currently corresponding to the vehicle, the order to be paid corresponding to the payment request is sent to the smart payment system 130 of the vehicle, and the payment is processed according to the payment data submitted by the smart payment system 130.

[0145] In one embodiment, the vehicle equipment manufacturer system 110 obtains environmental image data and vehicle positioning information uploaded by the vehicle, including:

[0146] Obtain environmental image data captured by the vehicle's onboard camera and vehicle positioning information collected by the vehicle positioning system; wherein the environmental image data is a photo of the environment around the vehicle, which is captured and uploaded at a set time interval.

[0147] In one embodiment, the vehicle equipment manufacturer system 110 determines the first merchant information through image recognition according to the environmental image data, including:

[0148] Preprocessing is performed according to the environmental image data to extract text image data and building image data;

[0149] The text image data and the building image data are taken as input samples and input into an image recognition model. The image recognition model aims to recognize the text information and the building information, outputs the text information and the building information corresponding to the environment image data, and determines the first merchant information based on the text information and the building information; wherein the first merchant information at least includes the merchant name.

[0150] In one embodiment, the vehicle equipment manufacturer system 110 determines the second merchant information within a set distance range of the current positioning position according to the vehicle positioning information, including:

[0151] Determine the latitude and longitude of the vehicle according to the vehicle positioning information;

[0152] Based on the longitude and latitude uploaded by the merchant when using the positioning service, the merchant within the set distance range of the vehicle's longitude and latitude is determined as the second merchant, and the second merchant information is obtained; wherein the second merchant information at least includes the longitude and latitude uploaded by the merchant when using the positioning service, the merchant name, address and contact information.

[0153] In one embodiment, the transaction processing system 120 matches the first merchant information with the second merchant information to determine the merchant currently corresponding to the vehicle, including:

[0154] The first merchant information is matched with the second merchant information in sequence, and the merchant information whose matching degree reaches a set matching threshold is selected as the merchant currently corresponding to the vehicle.

[0155] In one embodiment, the transaction processing system 120, according to the payment request initiated by the merchant currently corresponding to the vehicle, sends the order to be paid corresponding to the payment request to the smart payment system 130 of the vehicle, and processes the payment according to the payment data submitted by the smart payment system 130, including:

[0156] Check whether the merchant currently corresponding to the vehicle has any order to be paid within a set time range; if so, send the order to be paid to the smart payment system 130 of the vehicle.

[0157] In one embodiment, the transaction processing system 120, according to the payment request initiated by the merchant currently corresponding to the vehicle, sends the order to be paid corresponding to the payment request to the smart payment system 130 of the vehicle, and processes the payment according to the payment data submitted by the smart payment system 130, including:

[0158] After the order to be paid corresponding to the payment request is sent to the smart payment system 130 of the vehicle, the smart payment system 130 displays the order to be paid, and the customer manually confirms and enters the device number, product number or order number;

[0159] The order to be paid is located according to the order number, product number or device number, and the corresponding payment processing is completed.

[0160] In one embodiment, the vehicle equipment manufacturer system 110 is further configured to:

[0161] The vehicle identity information is obtained when the environmental image data and vehicle positioning information uploaded by the vehicle are obtained, wherein the vehicle identity information is bound to the smart payment system 130 of the vehicle.

[0162] In one embodiment, the transaction processing system 120 is further configured to:

[0163] A three-party payment agreement is established among the smart payment system 130, the vehicle equipment manufacturer system 110 and the transaction processing system 120 corresponding to the vehicle identity information; wherein the vehicle equipment manufacturer system 110 is used to analyze the environmental image data and the vehicle positioning information to determine the first merchant information and the second merchant information; the transaction processing system 120 is used to determine the merchant currently corresponding to the vehicle, send the order to be paid initiated by the merchant to the smart payment system 130 of the vehicle, and process the corresponding payment data.

[0164] In one embodiment, the transaction processing system 120 matches the first merchant information with the second merchant information to determine the merchant currently corresponding to the vehicle, including:

[0165] After obtaining the vehicle identity information, the first merchant information and the second merchant information pushed by the vehicle equipment manufacturer system 110, the transaction processing system 120 determines whether there is a three-party payment agreement corresponding to the vehicle identity information based on the vehicle identity information. If so, the first merchant information and the second merchant information are analyzed; if not or the agreement status is abnormal, no processing is performed.

[0166] In one embodiment, the environmental image data further includes: a device image, a product image, or an order image;

[0167] The vehicle equipment manufacturer system 110 is also used to perform image recognition based on the equipment image, product image or order image, determine the equipment number, product number or order number, and upload it to the transaction processing system 120;

[0168] The transaction processing system 120 is also used to locate the order to be paid according to the order number, product number or device number, and complete the corresponding payment processing.

[0169] In one embodiment, the present invention also proposes a vehicle equipment manufacturer system, such as Fig.12 As shown, including:

[0170] The information acquisition module 1110 is used to acquire the environmental image data and vehicle positioning information uploaded by the vehicle;

[0171] An information analysis module 1120, configured to determine first merchant information through image recognition according to the environmental image data;

[0172] The second merchant information within a set distance range of the current positioning position is determined according to the vehicle positioning information; wherein the transaction processing system 120 matches the first merchant information and the second merchant information to determine the merchant currently corresponding to the vehicle; according to a payment request initiated by the merchant currently corresponding to the vehicle, the order to be paid corresponding to the payment request is sent to the smart payment system 130 of the vehicle, and the payment is processed according to the payment data submitted by the smart payment system 130.

[0173] In one embodiment, the present invention also provides a transaction processing system, such as Fig.13 As shown, including:

[0174] The merchant matching module 1210 is used to match the first merchant information and the second merchant information to determine the merchant currently corresponding to the vehicle; wherein the first merchant information and the second merchant information are determined by the vehicle equipment manufacturer system 110; the vehicle equipment manufacturer system 110 obtains the environmental image data and the vehicle positioning information uploaded by the vehicle; determines the first merchant information through image recognition based on the environmental image data; and determines the second merchant information within a set distance range of the current positioning position based on the vehicle positioning information;

[0175] The transaction processing module 1220 is used to send the order to be paid corresponding to the payment request to the smart payment system 130 of the vehicle according to the payment request initiated by the merchant currently corresponding to the vehicle, and process the current payment according to the payment data submitted by the smart payment system 130.

[0176] It should be noted that although several modules of the smart payment device based on image recognition and positioning technology are mentioned in the above detailed description, this division is only exemplary and not mandatory. In fact, according to an embodiment of the present invention, the features and functions of two or more modules described above can be embodied in one module. Conversely, the features and functions of one module described above can be further divided into multiple modules for embodiment.

[0177] Based on the above invention concept, Fig.14As shown, the present invention also proposes a computer device 1400, including a memory 1410, a processor 1420, and a computer program 1430 stored in the memory 1410 and executable on the processor 1420, wherein the processor 1420 implements the aforementioned intelligent payment method based on image recognition and positioning technology when executing the computer program 1430.

[0178] Based on the aforementioned inventive concept, the present invention proposes a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the aforementioned intelligent payment method based on image recognition and positioning technology is implemented.

[0179] Based on the aforementioned inventive concept, the present invention proposes a computer program product, which includes a computer program. When the computer program is executed by a processor, an intelligent payment method based on image recognition and positioning technology is implemented.

[0180] The intelligent payment method and device based on image recognition and positioning technology proposed in the present invention improve the acquisition of environmental image data and vehicle positioning information uploaded by the vehicle; determine the first merchant information through image recognition based on the environmental image data; determine the second merchant information within a set distance range of the current positioning position based on the vehicle positioning information; match the first merchant information and the second merchant information to determine the merchant currently corresponding to the vehicle; according to the payment request initiated by the merchant currently corresponding to the vehicle, send the order to be paid corresponding to the payment request to the intelligent payment system of the vehicle, and process the payment according to the payment data submitted by the intelligent payment system; the overall process uses image recognition technology and precise positioning service technology to intelligently lock the place, merchant, and bill, so that smart car customers can quickly complete in-vehicle payment, provide a more convenient and intelligent payment method, comprehensively improve the payment experience of smart car customers, reduce labor costs, improve the efficiency of in-vehicle payment, and provide strong technical support for in-vehicle payment scenarios.

[0181] The acquisition, storage, use, and processing of data in the technical solution of this application comply with the relevant provisions of laws and regulations.

[0182] It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0183] The present invention is described with reference to flowcharts and / or block diagrams of methods and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0184] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0185] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0186] Finally, it should be noted that the above-described embodiments are only specific implementations of the present invention, which are used to illustrate the technical solutions of the present invention, rather than to limit them. The protection scope of the present invention is not limited thereto. Although the present invention is described in detail with reference to the above-described embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-described embodiments within the technical scope disclosed by the present invention, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. An intelligent payment method based on image recognition and positioning technology, characterized in that: include: Obtain environmental image data and vehicle positioning information uploaded by the vehicle; Determining first merchant information through image recognition according to the environmental image data; Determine second merchant information within a set distance range of the current positioning position according to the vehicle positioning information; Matching the first merchant information and the second merchant information to determine the merchant currently corresponding to the vehicle; According to the payment request initiated by the merchant currently corresponding to the vehicle, the order to be paid corresponding to the payment request is sent to the intelligent payment system of the vehicle, and the payment is processed according to the payment data submitted by the intelligent payment system.

2. The method according to claim 1, characterized in that Obtain environmental image data and vehicle positioning information uploaded by the vehicle, including: Obtain environmental image data captured by the vehicle's onboard camera and vehicle positioning information collected by the vehicle positioning system; wherein the environmental image data is a photo of the environment around the vehicle, which is captured and uploaded at a set time interval.

3. The method according to claim 1, characterized in that Determining first merchant information through image recognition according to the environmental image data includes: Preprocessing is performed according to the environmental image data to extract text image data and building image data; The text image data and the building image data are taken as input samples and input into an image recognition model. The image recognition model aims to recognize the text information and the building information, outputs the text information and the building information corresponding to the environment image data, and determines the first merchant information based on the text information and the building information; wherein the first merchant information at least includes the merchant name.

4. The method according to claim 1, characterized in that: Determining second merchant information within a set distance range of the current positioning position according to the vehicle positioning information includes: Determine the latitude and longitude of the vehicle according to the vehicle positioning information; Based on the longitude and latitude uploaded by the merchant when using the positioning service, the merchant within the set distance range of the vehicle's longitude and latitude is determined as the second merchant, and the second merchant information is obtained; wherein the second merchant information at least includes the longitude and latitude uploaded by the merchant when using the positioning service, the merchant name, address and contact information.

5. The method according to claim 1, characterized in that Matching the first merchant information and the second merchant information to determine the merchant currently corresponding to the vehicle includes: The first merchant information is matched with the second merchant information in sequence, and the merchant information whose matching degree reaches a set matching threshold is selected as the merchant currently corresponding to the vehicle.

6. The method according to claim 1, characterized in that According to the payment request initiated by the merchant currently corresponding to the vehicle, the order to be paid corresponding to the payment request is sent to the intelligent payment system of the vehicle, and the payment is processed according to the payment data submitted by the intelligent payment system, including: Check whether the merchant currently corresponding to the vehicle has any orders to be paid within a set time range; if so, send the orders to be paid to the smart payment system of the vehicle.

7. The method according to claim 1, characterized in that According to the payment request initiated by the merchant currently corresponding to the vehicle, the order to be paid corresponding to the payment request is sent to the intelligent payment system of the vehicle, and the payment is processed according to the payment data submitted by the intelligent payment system, including: After the order to be paid corresponding to the payment request is sent to the smart payment system of the vehicle, the smart payment system displays the order to be paid, and the customer manually confirms and enters the device number, product number or order number; The order to be paid is located according to the order number, product number or device number, and the corresponding payment processing is completed.

8. The method according to claim 1, characterized in that: The method further includes: The vehicle identity information is obtained when the environmental image data and vehicle positioning information uploaded by the vehicle are obtained, wherein the vehicle identity information is bound to the smart payment system of the vehicle.

9. The method according to claim 8, characterized in that The method further includes: A three-party payment agreement is established among the intelligent payment system, the vehicle equipment manufacturer system and the transaction processing system corresponding to the vehicle identity information; wherein the vehicle equipment manufacturer system is used to analyze the environmental image data and the vehicle positioning information to determine the first merchant information and the second merchant information; the transaction processing system is used to determine the merchant currently corresponding to the vehicle, send the pending payment order initiated by the merchant to the vehicle's intelligent payment system, and process the corresponding payment data.

10. The method according to claim 9, characterized in that Matching the first merchant information and the second merchant information to determine the merchant currently corresponding to the vehicle includes: After obtaining the vehicle identity information, the first merchant information and the second merchant information pushed by the vehicle equipment manufacturer system, the transaction processing system determines whether there is a three-party payment agreement corresponding to the vehicle identity information based on the vehicle identity information. If so, the first merchant information and the second merchant information are analyzed; if not or the agreement status is abnormal, no processing is performed.

11. The method according to claim 9, characterized in that The environmental image data also includes: equipment images, product images or order images; The method further includes: The vehicle equipment manufacturer system performs image recognition based on the equipment image, product image or order image, determines the equipment number, product number or order number, and uploads it to the transaction processing system; The transaction processing system locates the order to be paid according to the order number, product number or device number and completes the corresponding payment processing.

12. An intelligent payment method based on image recognition and positioning technology, characterized in that: include: Obtain environmental image data and vehicle positioning information uploaded by the vehicle; Determining first merchant information through image recognition according to the environmental image data; Determine the second merchant information within a set distance range of the current positioning position according to the vehicle positioning information; wherein the transaction processing system matches the first merchant information and the second merchant information to determine the merchant currently corresponding to the vehicle; according to a payment request initiated by the merchant currently corresponding to the vehicle, send the order to be paid corresponding to the payment request to the intelligent payment system of the vehicle, and process the payment according to the payment data submitted by the intelligent payment system.

13. An intelligent payment method based on image recognition and positioning technology, characterized in that: include: Matching the first merchant information and the second merchant information to determine the merchant currently corresponding to the vehicle; wherein the first merchant information and the second merchant information are determined by a vehicle equipment manufacturer system; the vehicle equipment manufacturer system obtains environmental image data and vehicle positioning information uploaded by the vehicle; determines the first merchant information through image recognition based on the environmental image data; and determines the second merchant information within a set distance range of the current positioning position based on the vehicle positioning information; According to the payment request initiated by the merchant currently corresponding to the vehicle, the order to be paid corresponding to the payment request is sent to the intelligent payment system of the vehicle, and the payment is processed according to the payment data submitted by the intelligent payment system.

14. An intelligent payment device based on image recognition and positioning technology, characterized in that: include: Vehicle equipment manufacturer systems, transaction processing systems and smart payment systems; among them, Vehicle equipment manufacturer system, used to obtain environmental image data and vehicle positioning information uploaded by the vehicle; Determining first merchant information through image recognition according to the environmental image data; Determine second merchant information within a set distance range of the current positioning position according to the vehicle positioning information; A transaction processing system, used to match the first merchant information with the second merchant information to determine the merchant currently corresponding to the vehicle; According to the payment request initiated by the merchant currently corresponding to the vehicle, the order to be paid corresponding to the payment request is sent to the intelligent payment system of the vehicle, and the payment is processed according to the payment data submitted by the intelligent payment system.

15. A vehicle equipment manufacturer system, characterized in that: include: An information acquisition module is used to acquire environmental image data and vehicle positioning information uploaded by the vehicle; An information analysis module, configured to determine first merchant information through image recognition according to the environmental image data; Determine the second merchant information within a set distance range of the current positioning position according to the vehicle positioning information; wherein the transaction processing system matches the first merchant information and the second merchant information to determine the merchant currently corresponding to the vehicle; according to a payment request initiated by the merchant currently corresponding to the vehicle, send the order to be paid corresponding to the payment request to the intelligent payment system of the vehicle, and process the payment according to the payment data submitted by the intelligent payment system.

16. A transaction processing system, characterized in that: include: A merchant matching module is used to match the first merchant information and the second merchant information to determine the merchant currently corresponding to the vehicle; wherein the first merchant information and the second merchant information are determined by the vehicle equipment manufacturer system; the vehicle equipment manufacturer system obtains the environmental image data and the vehicle positioning information uploaded by the vehicle; determines the first merchant information through image recognition based on the environmental image data; and determines the second merchant information within a set distance range of the current positioning position based on the vehicle positioning information; The transaction processing module is used to send the order to be paid corresponding to the payment request initiated by the merchant currently corresponding to the vehicle to the intelligent payment system of the vehicle, and process the payment according to the payment data submitted by the intelligent payment system.

17. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 13 is implemented.

18. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 13 is implemented.

Images