Parking fee payment method, device and equipment based on vehicle-mounted optical sensor and storage medium

Abstract

The invention discloses a parking fee payment method, device and equipment based on a vehicle-mounted optical sensor and a storage medium, and relates to the technical field of intelligent vehicles, and the method comprises the steps: obtaining vehicle information, including foresight radar information, foresight camera information and vehicle speed; when it is determined that the current payment mode is an intelligent mode, the current position of the vehicle is determined according to the foresight radar information and the foresight camera information; and when the vehicle speed is reduced to the preset speed and the current position of the vehicle enters the quick payment fare interval, the to-be-paid two-dimensional code information is obtained, payment interface display is performed based on the to-be-paid two-dimensional code information, a quick payment channel is realized only by calling vehicle-mounted facilities, no requirement on equipment of a parking lot is required, the compatibility is good, and the investment is low.

Description

Technical Field

[0001] The present application relates to the field of intelligent vehicle technology, and in particular to a parking fee payment method, device, equipment and storage medium based on a vehicle-mounted optical sensor. Background Art

[0002] The current common parking fee collection method is that users manually scan the QR code to pay the fee, and the parking lot will then release the user. This solution has many inconveniences, such as the difficulty of scanning the code in the car and the complexity of scanning the code on the mobile phone.

[0003] Based on this situation, the current solution mainly uses wireless communications to establish a password-free payment channel between the parking system and the cloud and the vehicle, such as ETC, NFC, Bluetooth, mobile communications, etc., but it requires the parking lot to build corresponding facilities and has high requirements for the intelligence of the parking lot.

[0004] The above contents are only used to assist in understanding the technical solution of the present application and do not constitute an admission that the above contents are prior art. Summary of the invention

[0005] The main purpose of this application is to provide a parking fee payment method, device, equipment and storage medium based on a vehicle-mounted optical sensor, aiming to solve the technical problem of parking fee payment.

[0006] To achieve the above purpose, the present application proposes a parking fee payment method based on a vehicle-mounted optical sensor, and the parking fee payment method based on a vehicle-mounted optical sensor includes:

[0007] Obtain vehicle information, including forward-looking radar information, forward-looking camera information, and vehicle speed;

[0008] When it is determined that the current payment mode is the smart mode, determining the current position of the vehicle according to the forward-looking radar information and the forward-looking camera information;

[0009] When the vehicle speed drops to a preset speed and the current position of the vehicle enters a quick payment pick-up fee interval, the QR code information to be paid is obtained, and a payment interface is displayed based on the QR code information to be paid.

[0010] In one embodiment, the step of displaying a payment interface based on the QR code information to be paid includes:

[0011] Obtain control of the payment application to activate the QR code scanning function and scan the QR code information to be paid;

[0012] After detecting that the payment application has completed the scan, the payment interface is displayed through the central control screen, and a payment prompt is given to complete the parking fee payment.

[0013] In one embodiment, the step of prompting for payment includes:

[0014] Prompting the user to enter a password through a first preset signal;

[0015] When it is detected that the user has completed the payment, prompting the user to complete the parking fee payment through a second preset signal;

[0016] When it is detected that payment has not been completed within the preset time, the user is prompted to complete payment through the mobile terminal through a third preset signal.

[0017] In one embodiment, the step of obtaining the QR code information to be paid includes:

[0018] Acquire a preset QR code image obtained by photographing the side environment of the vehicle at a preset acquisition speed by a vehicle body side camera device;

[0019] The preset QR code image is repaired to obtain a QR code image to be paid.

[0020] In one embodiment, the step of determining the current position of the vehicle according to the forward-looking radar information and the forward-looking camera information includes:

[0021] Obtaining distance information of obstacles in front of the vehicle identified by the forward-looking radar and information of the environment in front of the vehicle captured by the forward-looking camera;

[0022] The current position of the vehicle is determined according to the distance information and the environment information in front of the vehicle.

[0023] In one embodiment, after the step of determining the current position of the vehicle, the method further includes:

[0024] Get historical vehicle location information;

[0025] After marking the historical vehicle location information, a machine learning algorithm is trained to obtain a target model;

[0026] The target model is used to determine in real time whether the current position of the vehicle enters a quick payment vehicle pickup fee interval.

[0027] In one embodiment, when it is determined that the current payment mode is the smart mode, the step of determining the current location of the vehicle according to the vehicle information further includes:

[0028] When the current payment mode is a wake-up mode, receiving a user wake-up signal, and determining the current location of the vehicle according to the vehicle information;

[0029] When determining that the current position of the vehicle enters the quick payment pick-up fee interval, obtaining the QR code information to be paid, and completing the parking fee payment based on the QR code information to be paid, the steps include:

[0030] Get the QR code information to be paid;

[0031] Control the vehicle wallet application to activate the QR code scanning function, scan the QR code information to be paid, and complete the password-free payment of parking fees.

[0032] In addition, to achieve the above purpose, the present application also proposes a parking fee payment device based on a vehicle-mounted optical sensor, the device comprising:

[0033] An information acquisition module is used to acquire vehicle information, including forward-looking radar information, forward-looking camera information, and vehicle speed;

[0034] A position acquisition module, used to determine the current position of the vehicle according to the forward-looking radar information and the forward-looking camera information when the current payment mode is determined to be the smart mode;

[0035] The payment module is used to obtain the QR code information to be paid when the vehicle speed drops to a preset speed and the current position of the vehicle enters the quick payment vehicle pick-up fee interval, and display a payment interface based on the QR code information to be paid.

[0036] In addition, to achieve the above-mentioned purpose, the present application also proposes a parking fee payment device based on a vehicle-mounted optical sensor, the device comprising: a memory, a processor, and a computer program stored on the memory and executable on the processor, the computer program being configured to implement the steps of the parking fee payment method based on a vehicle-mounted optical sensor as described above.

[0037] In addition, to achieve the above-mentioned purpose, the present application also proposes a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by the processor, the steps of the parking fee payment method based on the vehicle-mounted optical sensor as described above are implemented.

[0038] In addition, to achieve the above objectives, the present application also provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, it implements the steps of the parking fee payment method based on the vehicle-mounted optical sensor as described above.

[0039] One or more technical solutions proposed in this application have at least the following technical effects:

[0040] Obtain vehicle information, including forward-looking radar information, forward-looking camera information and vehicle speed; when it is determined that the current payment mode is the smart mode, determine the current position of the vehicle according to the forward-looking radar information and the forward-looking camera information; when the vehicle speed drops to a preset speed and the current position of the vehicle enters the quick payment vehicle pick-up fee interval, obtain the QR code information to be paid, and display the payment interface based on the QR code information to be paid. Only the on-board facilities are called to realize the fast payment channel. There is no requirement for the equipment in the parking lot, with good compatibility and low investment. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0042] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0043] Figure 1 A flowchart of a parking fee payment method based on a vehicle-mounted optical sensor according to an embodiment of the present invention;

[0044] Figure 2 A structural block diagram of the first embodiment of the parking fee payment method based on the vehicle-mounted optical sensor of the present application;

[0045] Figure 3 A flow chart of the second embodiment of the parking fee payment method based on the vehicle-mounted optical sensor of the present application;

[0046] Figure 4 A flowchart of the third embodiment of the parking fee payment method based on the vehicle-mounted optical sensor of the present application is provided;

[0047] Figure 5 This is a schematic diagram of the module structure of a parking fee payment device based on a vehicle-mounted optical sensor according to an embodiment of the present application;

[0048] Figure 6 This is a schematic diagram of the device structure of the hardware operating environment involved in the parking fee payment method based on the vehicle-mounted optical sensor in the embodiment of the present application.

[0049] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0050] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0051] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0052] It should be noted that the execution subject of this embodiment can be a computing service device with data processing, network communication and program running functions, such as a tablet computer, a personal computer, a mobile phone, etc., or an electronic device capable of realizing the above functions, a parking fee payment device based on a vehicle-mounted optical sensor, etc. The following takes the parking fee payment device based on a vehicle-mounted optical sensor as an example to illustrate this embodiment and the following embodiments.

[0053] Based on this, the embodiment of the present application provides a parking fee payment method based on a vehicle-mounted optical sensor, referring to Figure 1 , Figure 1 This is a flow chart of the first embodiment of the parking fee payment device method based on the vehicle-mounted optical sensor of the present application.

[0054] In this embodiment, the parking fee payment device method based on the vehicle-mounted optical sensor includes steps S10 to S20:

[0055] Step S10, obtaining vehicle information, including forward-looking radar information, forward-looking camera information, and vehicle speed;

[0056] It should be noted that forward-looking radar is a sensor on a vehicle used to detect obstacles and objects ahead. It measures the distance to the object ahead by emitting radio waves and receiving their echoes.

[0057] The forward-looking camera is a visual sensor on the vehicle used to capture the road scene ahead. It can provide high-resolution images for identifying lane lines, traffic signs, pedestrians, vehicles, etc.

[0058] The vehicle speed information can be used to determine whether the vehicle has entered or left the parking lot, as well as the movement status within the parking lot.

[0059] like Figure 2 As shown, the IVI or other controller obtains the speed and acceleration signals transmitted by the speed and acceleration sensors, the positioning signal transmitted by the TBOX, and the brake pedal signal transmitted by the brake pedal; the front-view camera obtains the visual signal, the forward radar obtains the distance signal, and transmits the visual signal and the distance signal to the intelligent driving domain controller or other controllers, and then transmits them to the IVI controller to wake up the quick payment; the user can start the IVI operation through voice recognition and touch of the central control screen; the IVI sensor obtains the image of the QR code to be paid through the side camera of the car body, and the IVI has the authority to open the car payment APP. After the payment is completed or failed, it can be prompted by voice.

[0060] Step S20, when it is determined that the current payment mode is the smart mode, the current position of the vehicle is determined according to the forward-looking radar information and the forward-looking camera information;

[0061] In the specific implementation, the forward-looking radar identifies the distance of the obstacle ahead and returns a signal to the intelligent driving domain controller or other controllers. The forward-looking camera identifies the roadblock and environment ahead by shooting and returns a signal to the intelligent driving controller or other controllers.

[0062] It should be noted that this strategy proposes two payment modes, including smart mode and wake-up mode. In the smart mode, the on-board radar and optical camera will actively identify whether it has reached the parking payment area. The current radar and camera recognize the parking lot exit barrier and recognize that the vehicle speed is decreasing and is about to stop. That is, they are ready to quickly take multiple photos of the side image to identify the payment QR code, and actively open WeChat / Alipay or other payment function APP to scan the code and jump. The car owner only needs to enter the payment password on the car computer to leave the garage.

[0063] In a feasible implementation, step S30 may include steps A11 to A12:

[0064] Step A11: obtaining distance information of obstacles in front of the vehicle identified by the forward-looking radar and environmental information in front of the vehicle captured by the forward-looking camera device;

[0065] In a specific implementation, the forward-looking radar identifies the distance of the obstacle ahead and returns a signal to the intelligent driving domain controller or other controller.

[0066] The forward-looking camera identifies the road barrier and environment ahead by shooting, and returns signals to the intelligent driving controller or other controllers.

[0067] Step A12: Determine the current position of the vehicle based on the distance information and the environment information ahead of the vehicle.

[0068] In the specific implementation, the distance information obtained by the forward-looking radar is digitized and converted into the relative position of the vehicle and a specific landmark (such as a parking lot exit); the image captured by the forward-looking camera is analyzed, and image recognition technology is used to extract key features such as parking lines, guide arrows, and QR code logos; the distance data provided by the radar is combined with the environmental data provided by the camera, and data fusion is performed through the on-board computing system to improve the accuracy of position judgment.

[0069] The smart parking system can thus accurately know whether the vehicle has reached the payment area and automatically trigger the corresponding payment process, thus achieving a fast and hassle-free parking fee payment experience.

[0070] Furthermore, after the step of determining the current position of the vehicle, the method further includes:

[0071] Get historical vehicle location information;

[0072] After annotating the historical vehicle location information, the machine learning algorithm is trained to obtain the target model;

[0073] The target model is used to determine in real time whether the vehicle’s current location is within the quick payment range for vehicle pickup.

[0074] It should be noted that the final quick payment range can be determined by learning radar recognition distance and camera image recognition at different underground parking lot or ground parking lot exit locations.

[0075] It should be understood that data annotation tools, such as Labelme, are used to annotate the collected image data to identify and mark key elements such as vehicles, parking lines, guide arrows, and QR code logos.

[0076] The labeled dataset is divided into a training set and a test set, and the training set is used to train the machine learning model. This process may involve using deep learning algorithms, such as convolutional neural networks (CNNs), to process image data.

[0077] During the training process, the model will learn how to identify the vehicle's position from the environmental information in front of the vehicle, and how to determine whether the vehicle has entered the quick payment pick-up fee zone.

[0078] Step S30, when the vehicle speed drops to a preset speed and the current position of the vehicle enters the quick payment vehicle pick-up fee interval, the QR code information to be paid is obtained, and the payment interface is displayed based on the QR code information to be paid.

[0079] It should be noted that the QR code information to be paid is the payment QR code.

[0080] It should be understood that IVI determines whether it has reached the quick payment parking fee zone by obtaining the vehicle speed, brake pedal, positioning data, and the results returned by the front-view radar and the front-view camera. The positioning data can be memorized according to the owner's user habits, or learned using the locations where all owners trigger the function.

[0081] In the specific implementation, the side camera of the car body is called to extract the payment QR code, and WeChat / Alipay or other payment function APP is actively opened to scan the code and jump. The car owner only needs to enter the payment password on the car computer to leave the warehouse.

[0082] In a feasible implementation, step S30 may include steps A21 to A22:

[0083] Step A21: obtaining a preset QR code image obtained by the vehicle body side camera device photographing the side environment of the vehicle at a preset acquisition speed;

[0084] In a specific implementation, after reaching the section that needs to be identified, the camera takes pictures of the side environment at a speed of 3 pictures per second, and determines the range of the indicated parking fee payment code through text extraction.

[0085] A22: Perform repair processing based on the preset QR code image to obtain the QR code image to be paid.

[0086] It should be noted that the repair process can improve the recognition rate of the QR code by fusing multiple images, which may involve image alignment, feature point matching and image fusion algorithms.

[0087] In the specific implementation, after multiple photos are repaired, a clear QR code is saved and entered into the system.

[0088] The present embodiment provides a parking fee payment method based on a vehicle-mounted optical sensor, which obtains vehicle information, including forward-looking radar information, forward-looking camera information and vehicle speed; when it is determined that the current payment mode is the smart mode, the current position of the vehicle is determined according to the forward-looking radar information and the forward-looking camera information; when the vehicle speed drops to a preset speed and the current position of the vehicle enters the quick payment vehicle pick-up fee interval, the QR code information to be paid is obtained, and a payment interface is displayed based on the QR code information to be paid, and a combination is called to realize quick payment of parking fees, that is, the vehicle-mounted radar and optical camera are used to determine that the parking fee payment area has been reached, and then the side optical camera is used to take continuous photos. After image processing, clear QR code recognition information is extracted, and the vehicle-mounted WeChat / Alipay / Wallet APP is called for payment.

[0089] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar contents as those in the above-mentioned embodiment 1 can be referred to the above introduction, and will not be repeated in the following. Figure 3 , step S30, including steps S301-S302:

[0090] Step S301, obtaining a control payment application to activate a QR code scanning function and scan the QR code information to be paid;

[0091] In the specific implementation, IVI sends a signal to enable the payment APP to continuously scan the QR code returned by the vehicle body camera. After the code scanning is completed, a completion signal is returned to the vehicle body camera to stop shooting.

[0092] Step S302, after detecting that the payment application has completed the scan, the payment interface is displayed through the central control screen, and a payment prompt is given to complete the parking fee payment.

[0093] In the specific implementation, the payment APP jumps to the payment interface, and the IVI calls the set voice prompts the user to enter the password on the central control screen, or pops up a voice / text reminder of successful payment after using password-free payment.

[0094] In a feasible implementation, step S30 may include steps A31 to A33:

[0095] Step A31: Prompting the user to enter a password through a first preset signal;

[0096] It should be understood that the first preset signal may be a voice signal or a prompt message reminding the user to input a password.

[0097] Step A32: When it is detected that the user has completed the payment, prompt the user to complete the parking fee payment through a second preset signal;

[0098] It should be understood that the third preset signal may be a voice signal or a prompt message reminding the user that the payment is completed.

[0099] Step A33: When it is detected that the payment is not completed within the preset time, the user is prompted to complete the payment through the mobile terminal through a third preset signal.

[0100] It should be noted that if the scan is not completed within 1 minute, IVI ends the process and calls the voice function to prompt the user to pay manually with the mobile phone.

[0101] It should be understood that the third preset signal may be a voice signal or a prompt message to remind the user that the payment has failed.

[0102] This embodiment provides a parking fee payment method based on a vehicle-mounted optical sensor, which obtains and controls the payment application to activate the QR code scanning function and scans the QR code information to be paid; after detecting that the payment application has completed the scan, the payment interface is displayed through the central control screen, and a payment prompt is given to complete the parking fee payment. Through the integration of the vehicle-mounted system and the mobile payment application, the user can complete the payment without leaving the vehicle, thereby improving the efficiency and convenience of parking fee payment.

[0103] Based on the first and second embodiments of the present application, in the third embodiment of the present application, the same or similar contents as those in the above embodiments can be referred to the above introduction, and will not be described in detail later. Figure 4 , step S20, the parking fee payment method based on the vehicle-mounted optical sensor also includes steps S201 to S203:

[0104] Step S201, when the current payment mode is the wake-up mode, receiving a user wake-up signal and determining the current location of the vehicle according to the vehicle information;

[0105] It should be noted that in the wake-up mode, the on-board radar and optical camera will not actively identify whether it has arrived at the parking payment area. The car owner will wake up by voice or button when he is about to arrive at the corresponding area. After receiving the command, the vehicle control system will issue a task, call the side camera of the car body to extract the payment QR code, and actively open WeChat / Alipay or other payment function APP to scan the code and jump. The car owner only needs to enter the payment password on the car computer to leave the garage.

[0106] It should be understood that in wake-up mode, IVI can wake up the function through voice or central control, and record the location and return to the background after wake-up;

[0107] When determining that the current position of the vehicle enters the quick payment pick-up fee interval, obtaining the QR code information to be paid, and completing the parking fee payment based on the QR code information to be paid, the steps include:

[0108] Step S202, obtaining the QR code information to be paid;

[0109] It should be noted that the ability to recognize the relevant instruction text of irrelevant QR codes and payment QR codes can be improved by collecting photos of payment environments at different parking lot exits.

[0110] It should be understood that after IVI wakes up this function, it sends a signal to the camera on the side of the car body to wake up the photo extraction function, and at the same time wake up the QR code scanning function of the payment APP.

[0111] Step S203, control the vehicle wallet application to activate the QR code scanning function, scan the QR code information to be paid, and complete the password-free payment of parking fees.

[0112] It should be noted that the car wallet application is the car wallet APP, an in-vehicle payment software developed by the car manufacturer. It can store value through the car owner's active recharge from WeChat / Alipay / other channels, and can obtain greater permissions than WeChat / Alipay when making in-vehicle linkage payments. For example, it can pre-configure password-free payment in the APP, or use the main driver's monitoring camera to recognize facial consumption, etc.

[0113] In the specific implementation, a QR code scanning interface is displayed on the central control screen of the vehicle system, and the user or the system can use the vehicle camera to scan the QR code information to be paid. Once the QR code is successfully scanned and recognized, the system will complete the password-free payment of the parking fee.

[0114] This embodiment provides a parking fee payment method based on an on-board optical sensor, which can recognize the user's wake-up signal, accurately determine the vehicle's location, and complete the payment after recognizing the correct QR code. This integrated payment solution provides users with a convenient parking fee payment experience while improving the operational efficiency of the parking lot.

[0115] It should be noted that the above examples are only used to understand the present application and do not constitute a limitation on the parking fee payment method based on the vehicle-mounted optical sensor of the present application. More simple transformations based on this technical concept are all within the scope of protection of the present application.

[0116] This application also provides a parking fee payment device based on a vehicle-mounted optical sensor, please refer to Figure 5 , the parking fee payment device based on the vehicle-mounted optical sensor includes:

[0117] The information acquisition module 10 is used to acquire vehicle information, including forward-looking radar information, forward-looking camera information and vehicle speed;

[0118] A position acquisition module 20, for determining the current position of the vehicle according to the forward-looking radar information and the forward-looking camera information when the current payment mode is the smart mode;

[0119] The payment module 30 is used to obtain the QR code information to be paid when the vehicle speed drops to a preset speed and the current position of the vehicle enters the quick payment vehicle pick-up fee interval, and display a payment interface based on the QR code information to be paid.

[0120] The parking fee payment device based on the vehicle optical sensor provided by the present application adopts the parking fee payment method based on the vehicle optical sensor in the above embodiment, which can solve the technical problem of parking fee payment. Compared with the prior art, the beneficial effects of the parking fee payment device based on the vehicle optical sensor provided by the present application are the same as the beneficial effects of the parking fee payment method based on the vehicle optical sensor provided by the above embodiment, and the other technical features of the parking fee payment device based on the vehicle optical sensor are the same as the features disclosed in the above embodiment method, which will not be repeated here.

[0121] In one embodiment, the payment module 30 is further used to obtain and control the payment application to activate the QR code scanning function and scan the QR code information to be paid;

[0122] After detecting that the payment application has completed the scan, the payment interface is displayed through the central control screen, and prompts are given to complete the payment of the parking fee.

[0123] In one embodiment, the payment module 30 is further used to obtain a preset QR code image obtained by photographing the side environment of the vehicle at a preset acquisition speed by a vehicle body side camera device;

[0124] Repair the preset QR code image to obtain the QR code image to be paid.

[0125] In one embodiment, the payment module 30 is further configured to prompt the user to enter a password through a first preset signal;

[0126] When it is detected that the user has completed the payment, prompting the user to complete the parking fee payment through a second preset signal;

[0127] When it is detected that payment has not been completed within the preset time, the user is prompted to complete payment through the mobile terminal through a third preset signal.

[0128] In one embodiment, the position acquisition module 20 is further used to obtain the distance information of the obstacle in front of the vehicle identified by the forward-looking radar and the environment information in front of the vehicle captured by the forward-looking camera device;

[0129] The current position of the vehicle is determined based on the distance information and the environment in front of the vehicle.

[0130] In one embodiment, the position acquisition module 20 is also used to obtain historical vehicle position information;

[0131] After annotating the historical vehicle location information, the machine learning algorithm is trained to obtain the target model;

[0132] The target model is used to determine in real time whether the vehicle’s current location is within the quick payment range for vehicle pickup.

[0133] In one embodiment, the location acquisition module 20 is further used to receive a user wake-up signal when the current payment mode is a wake-up mode, and determine the current location of the vehicle according to the vehicle information;

[0134] When determining that the current position of the vehicle enters the quick payment pick-up fee range, obtaining the QR code information to be paid, and completing the steps of paying the parking fee based on the QR code information to be paid, including:

[0135] Get the QR code information to be paid;

[0136] Control the vehicle wallet application to activate the QR code scanning function, scan the QR code information to be paid, and complete the password-free payment of parking fees.

[0137] The present application provides a parking fee payment device based on a vehicle-mounted optical sensor, and the parking fee payment device based on the vehicle-mounted optical sensor includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the parking fee payment method based on the vehicle-mounted optical sensor in the above-mentioned embodiment one.

[0138] Reference below Figure 6, which shows a schematic diagram of the structure of a parking fee payment device based on a vehicle-mounted optical sensor suitable for implementing an embodiment of the present application. The parking fee payment device based on a vehicle-mounted optical sensor in the embodiment of the present application may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 6 The parking fee payment device based on the vehicle-mounted optical sensor shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0139] like Figure 6 As shown, the parking fee payment device based on the vehicle optical sensor may include a processing device 1001 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM: Read Only Memory) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM: Random Access Memory) 1004. In RAM1004, various programs and data required for the operation of the parking fee payment device based on the vehicle optical sensor are also stored. The processing device 1001, ROM1002, and RAM1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Typically, the following systems may be connected to the I / O interface 1006: input devices 1007 including, for example, a touch screen, a touchpad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; output devices 1008 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 1003 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 1009. The communication device 1009 may allow the parking fee payment device based on the vehicle-mounted optical sensor to communicate wirelessly or wired with other devices to exchange data. Although the figure shows a parking fee payment device based on the vehicle-mounted optical sensor with various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems may be implemented or have alternatively.

[0140] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0141] The parking fee payment device based on the vehicle optical sensor provided by the present application adopts the parking fee payment method based on the vehicle optical sensor in the above embodiment, which can solve the technical problem of parking fee payment. Compared with the prior art, the beneficial effects of the parking fee payment device based on the vehicle optical sensor provided by the present application are the same as the beneficial effects of the parking fee payment device method based on the vehicle optical sensor provided by the above embodiment, and the other technical features of the parking fee payment device based on the vehicle optical sensor are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0142] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0143] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0144] The present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, and the computer-readable program instructions are used to execute the parking fee payment method based on the vehicle-mounted optical sensor in the above-mentioned embodiment.

[0145] The computer-readable storage medium provided in the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination of the above.

[0146] The computer-readable storage medium may be included in the parking fee payment device based on the vehicle-mounted optical sensor; or may exist independently without being assembled into the parking fee payment device based on the vehicle-mounted optical sensor.

[0147] The above-mentioned computer-readable storage medium carries one or more programs. When the above-mentioned one or more programs are executed by the parking fee payment device based on the vehicle-mounted optical sensor, the parking fee payment device based on the vehicle-mounted optical sensor: obtains vehicle information, including forward-looking radar information, forward-looking camera information and vehicle speed; when it is determined that the current payment mode is the smart mode, determines the current position of the vehicle according to the forward-looking radar information and the forward-looking camera information; when the vehicle speed drops to a preset speed and the current position of the vehicle enters the quick payment pick-up fee interval, obtains the QR code information to be paid, and displays the payment interface based on the QR code information to be paid.

[0148] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0149] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0150] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0151] The readable storage medium provided in this application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned parking fee payment method based on the vehicle-mounted optical sensor, and can solve the technical problem of parking fee payment. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as the beneficial effects of the parking fee payment method based on the vehicle-mounted optical sensor provided in the above-mentioned embodiment, and will not be repeated here.

[0152] The present application also provides a computer program product, including a computer program, which implements the steps of the above-mentioned parking fee payment method based on the vehicle-mounted optical sensor when executed by a processor.

[0153] The computer program product provided by this application can solve the technical problem of parking fee payment. Compared with the prior art, the beneficial effects of the computer program product provided by this application are the same as the beneficial effects of the parking fee payment method based on the vehicle-mounted optical sensor provided in the above embodiment, which will not be repeated here.

[0154] The above descriptions are only some embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structural changes made using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect applications in other related technical fields are included in the patent protection scope of the present application.

Claims

1. A parking fee payment method based on a vehicle-mounted optical sensor, characterized in that: The parking fee payment method based on the vehicle-mounted optical sensor includes: Obtain vehicle information, including forward-looking radar information, forward-looking camera information, and vehicle speed; When it is determined that the current payment mode is the smart mode, determining the current position of the vehicle according to the forward-looking radar information and the forward-looking camera information; When the vehicle speed drops to a preset speed and the current position of the vehicle enters a quick payment pick-up fee interval, the QR code information to be paid is obtained, and a payment interface is displayed based on the QR code information to be paid.

2. The parking fee payment method based on the vehicle-mounted optical sensor as claimed in claim 1, characterized in that: The step of displaying a payment interface based on the QR code information to be paid includes: Obtain control of the payment application to activate the QR code scanning function and scan the QR code information to be paid; After detecting that the payment application has completed the scan, the payment interface is displayed through the central control screen, and a payment prompt is given to complete the parking fee payment.

3. The parking fee payment method based on the vehicle-mounted optical sensor as claimed in claim 2, characterized in that: The step of prompting for payment includes: Prompting the user to enter a password through a first preset signal; When it is detected that the user has completed the payment, prompting the user to complete the parking fee payment through a second preset signal; When it is detected that payment has not been completed within the preset time, the user is prompted to complete payment through the mobile terminal through a third preset signal.

4. The parking fee payment method based on the vehicle-mounted optical sensor as claimed in claim 1, characterized in that: The step of obtaining the QR code information to be paid includes: Acquire a preset QR code image obtained by photographing the side environment of the vehicle at a preset acquisition speed by a vehicle body side camera device; The preset QR code image is repaired to obtain a QR code image to be paid.

5. The parking fee payment method based on the vehicle-mounted optical sensor as claimed in claim 1, characterized in that: The step of determining the current position of the vehicle according to the forward-looking radar information and the forward-looking camera information comprises: Obtaining distance information of obstacles in front of the vehicle identified by the forward-looking radar and information of the environment in front of the vehicle captured by the forward-looking camera; The current position of the vehicle is determined according to the distance information and the environment information in front of the vehicle.

6. The parking fee payment method based on the vehicle-mounted optical sensor as claimed in claim 1, characterized in that: After the step of determining the current position of the vehicle, the method further includes: Get historical vehicle location information; After marking the historical vehicle location information, a machine learning algorithm is trained to obtain a target model; The target model is used to determine in real time whether the current position of the vehicle enters a quick payment vehicle pickup fee interval.

7. The parking fee payment method based on the vehicle-mounted optical sensor as claimed in claim 1, characterized in that: When it is determined that the current payment mode is the smart mode, the step of determining the current location of the vehicle according to the vehicle information further includes: When the current payment mode is a wake-up mode, receiving a user wake-up signal, and determining the current location of the vehicle according to the vehicle information; When determining that the current position of the vehicle enters the quick payment pick-up fee interval, obtaining the QR code information to be paid, and completing the parking fee payment based on the QR code information to be paid, the steps include: Get the QR code information to be paid; Control the vehicle wallet application to activate the QR code scanning function, scan the QR code information to be paid, and complete the password-free payment of parking fees.

8. A parking fee payment device based on a vehicle-mounted optical sensor, characterized in that: The device comprises: An information acquisition module is used to acquire vehicle information, including forward-looking radar information, forward-looking camera information, and vehicle speed; A position acquisition module, used to determine the current position of the vehicle according to the forward-looking radar information and the forward-looking camera information when the current payment mode is determined to be the smart mode; The payment module is used to obtain the QR code information to be paid when the vehicle speed drops to a preset speed and the current position of the vehicle enters the quick payment vehicle pick-up fee interval, and display a payment interface based on the QR code information to be paid.

9. A parking fee payment device based on a vehicle-mounted optical sensor, characterized in that: The device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the parking fee payment method based on the vehicle-mounted optical sensor as described in claims 1 to 7.

10. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the parking fee payment method based on a vehicle-mounted optical sensor as described in claims 1 to 7 are implemented.

Images