Riding fee determination method, processing device, vehicle and storage medium
By integrating facial recognition with footstep pressure analysis to determine passenger identities and fares, the method streamlines public transportation payments, addressing delays and safety concerns by enabling rapid and accurate contactless transactions.
Patent Information
- Application Number
- CN202311250321.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-09-25
- Publication Date
- 2025-03-28
AI Technical Summary
In public transportation, passengers often face delays and safety issues due to the need to queue for payment during peak hours or adverse weather conditions, especially when using cash or traditional card systems, which can lead to overcrowding and accidents.
A method that uses a combination of facial image recognition and footstep pressure information to quickly identify passengers and determine their fares, allowing for direct payment processing without the need for extensive user interaction.
This approach enhances payment speed and user experience by improving identification accuracy and enabling seamless, contactless payment processing, reducing congestion and safety risks.
Smart Images

Figure CN119722068A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of intelligent transportation technology, and in particular to a method for determining a fare, a processing device, a vehicle, and a storage medium. Background Art
[0002] With the increasing awareness of environmental protection and the rapid development of public transportation, more and more people choose to travel by public transportation. As mobile payment becomes more and more popular, people carry less and less cash. It is common to find that they do not have cash when traveling by public transportation. Transportation cards need to be purchased offline, so it is not very convenient.
[0003] In order to facilitate payment by passengers, many public transportation vehicles have begun to use mobile payment to collect fees. QR codes are set on public transportation vehicles, and passengers can pay by scanning the QR codes through Alipay or WeChat. However, during peak hours in the morning and evening or in bad weather such as rain or snow, there are many passengers on the bus. Whether paying by swiping a card or scanning a QR code, passengers need to queue up to pay in turns, which can easily cause a large number of passengers to be crowded at the door, and the passengers have to wait for a long time. Sometimes, there will even be trampling, which poses a safety problem. Summary of the invention
[0004] The embodiments of the present application provide a method for determining fares, a processing device, a vehicle, and a storage medium, which can effectively increase the payment speed of fares and enhance the user experience.
[0005] In a first aspect, an embodiment of the present application provides a method for determining a fare, which is applied to a public transportation vehicle, and the method includes:
[0006] Collecting a facial image of a first user and footstep pressure information of the first user;
[0007] sending the facial image of the first user and the footstep pressure information of the first user to a processing device, where the facial image of the first user and the footstep pressure information of the first user are used to identify the identity of the first user;
[0008] Determining the first user's riding information;
[0009] The riding information of the first user is sent to the processing device, and the riding information of the first user is used to determine the riding fare of the first user.
[0010] In the embodiment of the present application, the user's identity is identified through facial images and footstep pressure information, rather than determined only through facial recognition. This can effectively improve the accuracy of identification, and the fare can be determined based on the user's riding information, which facilitates payment. The operation is simple and convenient, does not require excessive user operation, and can enhance the user experience.
[0011] In a second aspect, an embodiment of the present application provides a method for determining a fare, the method comprising:
[0012] receiving a facial image of a first user and footstep pressure information of the first user from a public transportation vehicle;
[0013] identifying the identity of the first user according to the facial image of the first user and the footstep pressure information of the first user;
[0014] sending the identification result of the first user to the public transportation vehicle;
[0015] receiving the riding information of the first user from the public transportation vehicle;
[0016] The fare of the first user is determined according to the riding information of the first user.
[0017] In the embodiment of the present application, the user's identity is identified through facial images and footstep pressure information, rather than only through facial recognition. This can effectively improve the accuracy of identification, and the fare can be determined based on the user's riding information, which facilitates the subsequent direct deduction of the user's fare from the user's payment account, thereby increasing the charging speed. The operation is simple and convenient, does not require excessive user operation, and can enhance the user's experience.
[0018] In a third aspect, an embodiment of the present application provides a method for determining a fare, which is applied to a public transportation vehicle, and the method includes:
[0019] Collecting a facial image of a first user and footstep pressure information of the first user;
[0020] determining the identity of the first user according to the facial image of the first user and the footstep pressure information of the first user;
[0021] The ride fare of the first user is determined according to the ride information of the first user and the identity of the first user.
[0022] In a fourth aspect, an embodiment of the present application provides a processing device, the processing device comprising a communication unit and a processing unit, the communication unit being configured to:
[0023] sending the facial image of the first user and the footstep pressure information of the first user to a processing device, where the facial image of the first user and the footstep pressure information of the first user are used to identify the identity of the first user;
[0024] sending the first user's riding information to the processing device, where the first user's riding information is used to determine the first user's riding fare;
[0025] The processing unit is used for:
[0026] Collecting a facial image of a first user and footstep pressure information of the first user;
[0027] Determine the first user's riding information.
[0028] In a fifth aspect, an embodiment of the present application provides a processing device, wherein the processing device includes a communication unit and a processing unit, and the communication unit is used to:
[0029] receiving a facial image of a first user and footstep pressure information of the first user from a public transportation vehicle;
[0030] sending the identification result of the first user to the public transportation vehicle;
[0031] receiving the riding information of the first user from the public transportation vehicle;
[0032] The processing unit is used for:
[0033] identifying the identity of the first user according to the facial image of the first user and the footstep pressure information of the first user;
[0034] The fare of the first user is determined according to the riding information of the first user.
[0035] In a sixth aspect, an embodiment of the present application provides a vehicle, comprising a processor and a memory; the processor executes instructions stored in the memory so that the vehicle implements the method described in any one of the first aspects above.
[0036] Optionally, the vehicle further includes a communication interface for receiving and / or sending data, and / or for providing input and / or output for the processor.
[0037] It should be noted that the above embodiment is described by taking a processor (or general-purpose processor) that executes the method by calling a computer specification as an example. In the specific implementation process, the processor can also be a dedicated processor, in which case the computer instructions have been pre-loaded in the processor. Optionally, the processor can also include both a dedicated processor and a general-purpose processor.
[0038] Optionally, the processor and the memory may also be integrated into one device, that is, the processor and the memory may also be integrated together.
[0039] In the seventh aspect, an embodiment of the present application provides a computing device, which includes a processor and a memory; the processor executes instructions stored in the memory so that the vehicle implements the method described in any one of the second aspects above.
[0040] Optionally, the computing device further comprises a communication interface, wherein the communication interface is used to receive and / or send data, and / or the communication interface is used to provide input and / or output for the processor.
[0041] It should be noted that the above embodiment is described by taking a processor (or general-purpose processor) that executes the method by calling a computer specification as an example. In the specific implementation process, the processor can also be a dedicated processor, in which case the computer instructions have been pre-loaded in the processor. Optionally, the processor can also include both a dedicated processor and a general-purpose processor.
[0042] Optionally, the processor and the memory may also be integrated into one device, that is, the processor and the memory may also be integrated together.
[0043] In an eighth aspect, an embodiment of the present application provides a storage medium, which is a computer-readable storage medium, and in which instructions are stored. When the instructions are executed by a vehicle, the vehicle implements the method described in any one of the first aspects above.
[0044] In the ninth aspect, an embodiment of the present application provides a storage medium, which is a computer-readable storage medium, and in which instructions are stored. When the instructions are executed by a computing device, the computing device implements the method described in any one of the second aspects above.
[0045] In a tenth aspect, the present application provides a computer program product, which includes computer instructions. When the instructions are executed by a vehicle, the vehicle implements the method described in any one of the first aspects.
[0046] In an eleventh aspect, the present application provides a computer program product, which includes computer instructions. When the instructions are executed by a computing device, the computing device implements the method described in any one of the second aspects above.
[0047] Optionally, the computer program product may be a software installation package or an image file. When the aforementioned method is required, the computer program product may be obtained and executed on a computing device.
[0048] The beneficial effects of the technical solutions provided in the second to eleventh aspects of the present application can refer to the beneficial effects of the technical solution of the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0049] The following is a brief introduction to the drawings required for describing the embodiments.
[0050] Figure 1 It is a schematic diagram of the architecture of a fare payment system provided in an embodiment of the present application;
[0051] Figure 2 It is a flowchart of a method for determining a fare provided in an embodiment of the present application;
[0052] Figure 3 is a structural schematic diagram of a vehicle provided in an embodiment of the present application;
[0053] Figure 4 This is a flow chart of a user registering an identity through a first application provided in an embodiment of the present application;
[0054] Figure 5 It is a schematic diagram of an interface of a vehicle display screen provided in an embodiment of the present application;
[0055] Figure 6 This is a flow chart of a fare payment provided by an embodiment of the present application;
[0056] Figure 7 is a flow chart of a method for identifying a first user provided in an embodiment of the present application;
[0057] Figure 8 It is a flowchart of another method for determining the fare provided in an embodiment of the present application;
[0058] Fig. 9 is a structural schematic diagram of a processing device provided in an embodiment of the present application;
[0059] Fig.10 is a structural schematic diagram of another processing device provided in an embodiment of the present application;
[0060] Fig.11 is a structural schematic diagram of another vehicle provided in an embodiment of the present application;
[0061] Fig.12 It is a structural diagram of a computing device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0062] The embodiments of the present application are described in detail below with reference to the accompanying drawings.
[0063] The following is an introduction to the system architecture of the embodiment of the present application. It should be noted that the system architecture and business scenarios described in this application are intended to more clearly illustrate the technical solution of this application, and do not constitute a limitation on the technical solution provided by this application. It is known to those skilled in the art that with the evolution of the system architecture and the emergence of new business scenarios, the technical solution provided by this application is also applicable to similar technical problems.
[0064] See also Figure 1 , Figure 1 Schematic diagram of the architecture of a fare payment system provided in an embodiment of the present application. Figure 1 As shown, the fare payment system 10 includes a vehicle 101, a processing device 102 and a user device 103. The number of each device is only for illustration, for example, the number of the vehicle 101 may be one or more, and the number of the user device 103 may also be one or more.
[0065] Among them, vehicle 101 is a vehicle used for public transportation and can transport passengers. Exemplarily, vehicle 101 can be a public transportation vehicle such as a bus (electric bus), a taxi, a subway, a passenger ferry, a cable car, etc. A camera 1011 and a pressure sensor 1012 are set on vehicle 101. The number of cameras 1011 and pressure sensors 1012 can be one or more. Camera 1011 has an image acquisition function, which can acquire images of users in scenes such as getting on, riding, and getting off the bus, so as to determine the riding information of the user of vehicle 101 and the position of the user in the vehicle. Furthermore, camera 1011 can also have a face recognition function, which can perform face recognition on the user's image.
[0066] The pressure sensor 1012 is used to obtain the footstep pressure information of the user after getting on the vehicle, and the footstep pressure information is used to assist in identifying the identity of the user. The footstep pressure information may include one or more of the parameters such as the pressure distribution of both feet, the step length and the step frequency of walking. Exemplarily, the pressure sensor 1012 may be an array pressure sensor laid on the floor of the vehicle 101.
[0067] Optionally, the vehicle 101 may further include a display screen. The display screen has the function of presenting a picture. Optionally, the display screen may present an image acquired by the camera 1011. Exemplarily, the display screen may be a driver's central control screen of the vehicle 101 or a display screen of the vehicle 101.
[0068] Optionally, the vehicle 101 may also have a voice broadcast function. For example, the vehicle 101 may also include a broadcast, which is used to broadcast prompt information. Optionally, the prompt information may be sound, light, electricity or vibration.
[0069] The processing device 102 is a device with data processing capabilities. Exemplarily, the processing device 102 can be a physical device such as a server or a host, or a virtual device such as a virtual machine or a container. In another exemplary embodiment, the processing device 102 can be a cloud device, such as a single server in the cloud or a server cluster composed of multiple servers, or a local device, such as a single server locally or a server cluster composed of multiple servers. Optionally, the processing device 102 can identify the user's identity based on the user's facial image and the user's footstep pressure information, and the processing device 102 can calculate the ride fare based on the user's ride information.
[0070] Furthermore, the processing device 102 may also have communication capabilities. Exemplarily, the processing device 102 may receive the user's facial image, the user's footstep pressure information, and the user's riding information sent by the vehicle 101. The processing device 102 may also send the identity recognition result of the user's facial image and the user's riding fare to the vehicle 101. Optionally, the processing device 102 may also analyze and process the changes in the user's footstep pressure information in combination with relevant medical knowledge, and send the relevant analysis results to the user device 103 to remind the user of changes in the body, so as to prompt the user to go to the hospital in time to check the body condition.
[0071] Optionally, the processing device 102 may also have a storage capability. Exemplarily, the processing device 102 may store the user's identity information.
[0072] The user device 103 is a device that can interact with the user. Optionally, the user device 103 can be an independent device such as a handheld terminal, a desktop terminal, a wearable device, etc. When the user device 103 is a handheld terminal, it can be a mobile phone, a tablet computer, a computer (such as a laptop, a PDA, etc.), etc.
[0073] Among them, being able to interact with the user may include: outputting information to the user, and / or receiving information input by the user. Exemplarily, the user device 103 may present a registration window to the user, so that the user can register his identity using the user device 103. Exemplarily, the user device 103 may also present a bill to be paid to the user, so as to prompt the user to pay the user's ride fare.
[0074] Further, the user device 103 may also have a communication capability, and the user device 103 is connected to the processing device 102. Exemplarily, the user device 103 may communicate with the processing device 102, send information to the processing device and / or receive information from the processing device. Exemplarily, the user device 103 may send the user's registered identity information to the processing device 102, and the processing device 102 may send the user's bill to be paid to the user device 103.
[0075] Optionally, the vehicle 101 and the processing device 102 and the processing device 102 and the user equipment 103 can be directly connected through wired communication, such as tangible media such as metal wires and optical fibers, or can be indirectly connected through wireless communication, such as wireless LAN, Bluetooth and other intangible media.
[0076] Optionally, the vehicle 101 may perform some or all of the operations performed by the processing device 102. In other words, some or all of the operations performed by the processing device 102 may be performed by the vehicle 101 instead. Exemplarily, the vehicle 101 may include the processing device 102 and / or the processing device 102 may be integrated in the vehicle 101.
[0077] In an embodiment of the present application, when a first user rides in vehicle 101, vehicle 101 may collect a facial image of the first user and footstep pressure information of the first user, vehicle 101 sends the facial image of the first user and footstep pressure information of the first user to processing device 102, processing device 102 identifies the identity of the first user based on the facial image of the first user and footstep pressure information of the first user, vehicle 101 determines the riding information of the first user, vehicle 101 sends the riding information of the first user to processing device 102, processing device 102 determines the riding fare of the first user based on the riding information of the first user, and processing device 102 deducts the riding fare of the first user from the payment account of the first user in user device 103.
[0078] In an embodiment of the present application, the user's identity is identified by facial images and footstep pressure information, which can improve the accuracy of identification. The fare can be determined based on the user's travel information and the user's fare can be directly deducted from the user's payment account, which can increase the charging speed. The operation is simple and convenient, does not require excessive user operations, and can improve the user experience.
[0079] As a possible implementation, the fare payment system is also applicable to vehicles that charge a fee on a segmented basis. The processing device 102 can obtain the number of stations passed by the first user based on the first user's boarding and alighting stations, thereby determining the first user's fare. The processing device 102 deducts the first user's fare from the payment account in the first user's user device 103.
[0080] The following is an introduction to the method embodiments of the present application.
[0081] See also Figure 2 , Figure 2 is a flow chart of a method for determining a fare provided in an embodiment of the present application. Optionally, the method can be applied to a fare payment system, for example, the method can be applied to Figure 1 The fare payment system shown.
[0082] like Figure 2 The fare determination method shown may include multiple steps in steps S201-S207. It should be understood that for the convenience of description, this application describes the steps S201-S207 in this order, and is not intended to limit the execution to the above order. The embodiment of this application does not limit the execution order, execution time, execution number, etc. of the above one or more steps. Steps S201-S207 are as follows:
[0083] Step S201: The vehicle collects a facial image of a first user and footstep pressure information of the first user.
[0084] The vehicle may include a camera and a pressure sensor, through which the user's face image may be collected, and through which the user's footstep pressure information may be collected. The user's footstep pressure information may include one or more of the user's gait characteristic parameters such as the pressure distribution of the user's feet, the user's step length, and the user's step frequency. For example, the user's footstep pressure information may include one or more of the parameters such as the pressure distribution of the user's feet after getting on the vehicle, the walking step length, and the walking step frequency.
[0085] Exemplarily, the vehicle may be a public transportation vehicle such as a bus (electric bus), a taxi, a subway, a ferry, or a cable car.
[0086] See also Figure 3 , Figure 3 : is a structural schematic diagram of a vehicle provided in an embodiment of the present application. Cameras are installed at both the front and rear doors of the vehicle 101, and both the front and rear doors can allow users to get on and off the vehicle, which can improve traffic efficiency. Cameras A and C are used to collect facial images of users facing the doors from the outside of the vehicle. At this time, the collected facial images are usually facial images of users who are about to get on the vehicle. Cameras B and D are used to collect facial images of users facing the doors from the inside of the vehicle. At this time, the collected facial images are usually facial images of users who are about to get off the vehicle. Pressure sensors are laid on the floor inside the vehicle 101. When a user gets on or off the vehicle, the pressure sensors can measure the pressure information of the user's footsteps. Cameras E and F are used to obtain images of users / passengers inside the vehicle, which can be used to monitor the user / passenger situation inside the public transportation vehicle and the position of the user / passenger in the vehicle. The display screen can display the images of users / passengers inside the vehicle obtained by cameras E and F.
[0087] Step S202: The vehicle sends the facial image of the first user and the footstep pressure information of the first user to the processing device.
[0088] The processing device is a device with processing and communication capabilities. Optionally, the processing device can be integrated in a public transportation vehicle. Alternatively, the processing device can be integrated in the cloud, or called a server.
[0089] As a possible implementation, the processing device may be connected to the vehicle for communication, and the processing device may receive the facial image of the first user and the footstep pressure information of the first user sent by the vehicle.
[0090] Step S203: The processing device identifies the identity of the first user based on the facial image of the first user and the footstep pressure information of the first user. Specifically, the processing device can obtain the facial feature data and footstep pressure data of multiple users in advance, and respectively match the facial image of the first user and the footstep pressure of the first user obtained from the vehicle with the facial feature data and footstep pressure data of multiple users to determine whether there is a hit facial feature data and footstep pressure data. Here, a hit means that the two match each other, or the matching degree exceeds a preset threshold. The facial feature data and footstep pressure data correspond to the identity of the user. Therefore, when there is a hit facial feature data and footstep pressure data, the identity of the user corresponding to the hit facial feature data and footstep pressure data is the identity of the first user.
[0091] Furthermore, facial feature data is data that can indicate the facial features of a user, and may directly include the user's face, or may be facial features of a face recorded in the form of data.
[0092] As a possible implementation, the facial feature data of multiple users are pre-stored in the processing device. Optionally, the facial feature data may be obtained by processing the input facial image when the user is performing identity registration.
[0093] In a possible implementation, face matching and footstep pressure matching may be performed separately.
[0094] As an example of a face matching process, the processing device can obtain the face recognition data of the first user based on the face image of the first user, and the processing device matches the face recognition data of the first user with the face feature data of multiple users stored in advance, and obtains the matching degree with the face feature data of multiple users respectively, which is convenient for distinguishing as the first matching degree. The processing device can determine the multiple candidate users who are hit for the first time based on the first matching degree, for example, the matching degree of the face feature data of the candidate users with the face recognition data of the first user is greater than the first threshold, or greater than or equal to the first threshold. Among them, the first threshold is used to indicate the conditions that the matching degree of the features of the face image of the first user and the face images of multiple users needs to meet. Among them, the first threshold is predefined or predefined. For example, the first threshold can be a value higher than 60%, such as 75%, 80%, etc. By setting the first threshold, a face image that is closer to the face image of the first user can be screened out from the face images of multiple users, and the identity of the first user can be identified more accurately and quickly.
[0095] Exemplarily, features of facial images of five users, A, B, C, D and E, are pre-stored in the processing device. The processing device matches the facial image of the first user with the features of the facial images of the five users pre-stored to obtain a first matching degree of the facial images of the five users. For example, the first matching degree of user A is 68%, the first matching degree of user B is 55%, the first matching degree of user C is 76%, the first matching degree of user D is 98%, and the first matching degree of user E is 85%. The first threshold is 75%, so the users hit by the processing device are users C, D and E.
[0096] As a possible implementation, the footstep pressure information of the first user is used to assist in identifying the identity of the first user. Specifically, the pressure data of multiple users are pre-stored in the processing device. Optionally, the pressure data of multiple users in the processing device can be obtained after processing the input pressure data when the user registers their identity. For example, when registering their identity, the user can enter information such as weight and foot size, and this information can be associated with the user's pressure data and uploaded to the processing device. The processing device processes the footstep pressure information of the first user to obtain pressure-related values such as the first user's pressure data and gait characteristic parameters.
[0097] As a possible implementation, the processing device filters the footstep pressure information of the first user through the IMF filtering algorithm, and the processing device performs cluster analysis on the filtered data through the K-means algorithm to obtain the pressure distribution value of the first user's foot and the gait characteristic parameters of the first user, such as the start and end time of the footprint, the coordinate range of the footprint and the pressure data.
[0098] Specifically, the public transportation vehicle collects the original pressure data of each pressure sensor at a certain moment through the pressure sensor, and the processing device filters the original pressure data of each pressure sensor at a certain moment through the IMF filtering algorithm. The processing device performs cluster analysis on the filtered sole pressure data through the K-means algorithm to obtain the start and end time of the footprint (i.e., the start frame and the end frame), and the coordinate range and pressure data Pre[i,j] (i and j represent row and column coordinates, respectively) of the footprint.
[0099] The processing device performs cluster analysis on the filtered sole pressure data through the K-means algorithm, including: the processing device sequentially scans the footprint pressure data of each frame, maps the footprint pressure data to the image matrix, and performs binarization processing on the image matrix; the processing device marks and classifies the binary matrix based on the 8-neighborhood connected region marking algorithm, divides the footprint pressure data of each frame into different categories, calculates the geometric center of each category, and records the start time of each category of footprint; the processing device clusters and iterates each category according to the geometric center of each category and the set relevant threshold parameters, and separates and obtains the characteristics of each footprint. Among them, the relevant threshold parameters include the aforementioned category time intervals of foot length and foot width. The characteristics of each footprint include the start and end time of each step of the user (i.e., the start frame and the end frame), the coordinate range of the footprint, and the pressure data Pre[i,j] (i, j represent row and column coordinates respectively).
[0100] Furthermore, the processing device obtains gait characteristic parameters in the footprint sequence, and the gait characteristic parameters include single-step landing time, single-step air time, double-foot simultaneous landing time, etc.
[0101] Take the Nth step as an example to calculate the single-step landing time (denoted as T single_touc h), single-step vacancy time (denoted as T single_off ), the time when both feet touch the ground at the same time (recorded as T double_touc h) The formula is as follows:
[0102]
[0103] Among them, T N_start is the start time of step N, T N_End is the end time of step N, T N+1_start is the start time of step N+1, T N+2_start is the start time of step N+2, and Fs is the acquisition frequency.
[0104] Through the above implementation, the processing device can obtain the pressure value and pressure distribution of the sole of the user's foot at each moment after getting on the vehicle, including the start and end time of each step (i.e., the start frame and the end frame), the coordinate range of the footprint, i.e., the pressure data Pre[i,j] (i, j represent row and column coordinates, respectively), and gait characteristic parameters and other pressure-related values.
[0105] As an example of a footstep pressure matching processing process, the processing device identifies the identity of the first user based on the pressure data and gait characteristic parameters of the first user combined with the face recognition data of the first user. Exemplarily, the pressure distribution value of the first user's foot can be the pressure data of the first user. The processing device matches the pressure data and gait characteristic parameters of the first user and other pressure-related values with the pressure data of the user hit by the processing device, and obtains the matching degree with the pressure data of the user hit by the processing device, which is convenient for distinguishing and is called the second matching degree. The processing device obtains the third matching degree of the hit user through weight calculation based on the first matching degree and the second matching degree of the hit user, and the identity of the user with the highest third matching degree among the hit users is the identity of the first user.
[0106] Exemplarily, the weight of the first matching degree can be pre-set to 70%, and the weight of the second matching degree can be pre-set to 30%. If the users hit by the processing device are three users C, D and E, the first matching degree of user C is 76%, the first matching degree of user D is 98%, and the first matching degree of user E is 85%. The second matching degree of user C is 80%, the second matching degree of user D is 86%, and the second matching degree of user E is 95%. The processing device obtains the third matching degree of these three users through weight calculation, among which the third matching degree of user C is 77.2%, the third matching degree of user D is 94.4%, and the third matching degree of user E is 88%. The user with the highest third matching degree is user D, so the identity of the first user identified by the processing device is the identity of user D.
[0107] In this way, by adding relevant data of the footstep pressure information, the processing device can identify the identity of the first user in combination with the face recognition data, which can effectively improve the accuracy of recognition.
[0108] Furthermore, after the processing device identifies the identity of the first user, it can update the pressure data of the first user stored in the processing device, so that the current pressure data of the first user overwrites the pressure data of the first user pre-stored by the processing device. In this way, the pressure data of the user is updated in a timely manner, the influence of factors such as the user's weight on the pressure data is reduced, and the accuracy of identification is effectively improved.
[0109] Step S204: The processing device sends the identification result of the first user to the vehicle.
[0110] Among them, step S204 is an optional step.
[0111] The vehicle receives the identification result of the first user sent by the processing device.
[0112] The identification result of the first user may indicate that the identity of the first user is not registered or that the identity of the first user is registered. The registered identity of the first user means that the processing device contains the identity information of the first user, and the unregistered identity of the first user means that the processing device does not contain the identity information of the first user.
[0113] As a possible implementation, when the identification result of the first user indicates that the identity of the first user is not registered, the vehicle generates a first prompt message. The first prompt message is used to prompt the first user to register his identity. Optionally, the first prompt message includes a broadcast message. Exemplarily, the first prompt message may be sound, light, electricity, or vibration. For example, when the identification result of the first user indicates that the identity of the first user is not registered, the vehicle may automatically play "Please user / passenger register your identity" through the vehicle broadcast.
[0114] As a possible implementation, when the identification result of the first user indicates that the identity of the first user is not registered, the vehicle receives the first indication information sent by the processing device, and the vehicle generates the first prompt information in response to the first indication information. The first indication information is used to instruct the vehicle to generate the first prompt information, and the first prompt information is used to prompt the first user to register his identity.
[0115] As a possible implementation, the first user pays the fare in the first application, and the first prompt information is used to prompt the first user to register the identity in the first application. The first application is installed in the first user device, and the first user device is associated with the identity of the first user. Exemplarily, the first user device can be as follows: Figure 1 For the user device 103 shown, when the identification result of the first user indicates that the identity of the first user is not registered, the vehicle can automatically play "Please user / passenger install the first application to register the identity" through the vehicle broadcast.
[0116] See also Figure 4 , Figure 4 This is a flow chart of a user registering an identity through a first application provided by an embodiment of the present application. Figure 4As shown, the first user can click to install the first application, the first user device receives the click operation of the first user, installs the first application, the first user device calls the camera of the first user device through the first application to obtain the facial image of the first user, the first user can choose whether to agree to bind the payment account to automatically deduct the fare, that is, choose to click the option to agree to bind the payment account to automatically deduct the fare or choose to click the option to disagree to bind the payment account to automatically deduct the fare. If the first user chooses to click the option to agree to bind the payment account to automatically deduct the fare, the first user device receives the option clicked by the first user, and sends the facial image, payment account and other information of the first user to the processing device for encrypted storage. If the first user chooses to click the option to disagree to bind the payment account to automatically deduct the fare, the first user device receives the option clicked by the first user, and sends the facial image of the first user to the processing device for encrypted storage. In this way, the user can register his identity before getting on the bus, or he can register his identity in the bus after getting on the bus. This operation is convenient and quick and only needs to be done once. If the user agrees to bind the payment account to automatically deduct the fare, the user does not need to perform any other operations during the ride, which can increase the charging speed. In addition, the user does not need to register his identity again when riding other vehicles of the same type, which can effectively improve the user experience.
[0117] As a possible implementation, when the identification result of the first user indicates that the identity of the first user has been registered, the processing device may determine the credit record of the first user and send the credit record of the first user to the vehicle. The credit record of the first user may be reflected by the processing device determining whether the first user is a blacklist user. That is, the credit record of the first user may be that the first user is a blacklist user or that the first user is not a blacklist user. The blacklist user is a user who has not successfully paid the ride fare.
[0118] As a possible implementation, the vehicle includes a display module, and the vehicle receives the credit record of the first user. When the credit record of the first user indicates that the first user has unsuccessfully paid fares (i.e., the first user is a blacklisted user), the display module displays a first interface, and the vehicle receives a click operation of the driver of the vehicle on a clickable control corresponding to the first user. The vehicle generates a second prompt message in response to the click operation on the clickable control corresponding to the first user. The first interface includes a clickable control corresponding to the first user, and the second prompt message is used to prompt the first user to pay the fare that the first user has not paid. Exemplarily, the display module can be a central control screen or display screen inside the vehicle. In this way, by generating a prompt message to prompt the user to pay the fare that the user has not paid, the accuracy of the fare collected by the vehicle can be effectively guaranteed.
[0119] See also Figure 5 , Figure 5 is a schematic diagram of an interface of a vehicle display screen provided by an embodiment of the present application. For example, in the case where the credit record of the first user indicates that the first user has unsuccessfully paid the fare, such as Figure 5 As shown, the vehicle displays the real-time image of the first user in the vehicle acquired by the in-vehicle camera through the display screen, and the driver of the vehicle can click on the clickable control corresponding to the first user on the display screen, such as clicking Figure 5 The user has not paid the window in the vehicle. In response to the click operation on the clickable control corresponding to the first user, the vehicle can send a third indication message to the processing device to instruct the processing device to send a fourth prompt message to the first user device to remind the first user to pay the unpaid fare. After the processing device sends the fourth prompt message to the first user device for the first time, if the first user still fails to pay the fare, the vehicle can generate a third prompt message to prompt the first user to pay the unpaid fare. Among them, the third prompt message can be a broadcast, and the first time is pre-set, which can be 5 minutes, 10 minutes, etc. Exemplarily, the vehicle can automatically play "Please pay the unpaid fare for the first user / passenger" through the vehicle broadcast and / or the driver can make a voice prompt through the vehicle broadcast. In this way, when it is detected that the user has not paid the fare after a certain time, the credit record of the user can be updated, so that when the user takes the vehicle next time, the prompt message is generated to prompt the user to pay the unpaid fare, which can effectively ensure the accuracy of the vehicle's collection of fare.
[0120] Step S205: The vehicle obtains the first user's riding information.
[0121] As a possible implementation, the first user's riding information includes one or more of the vehicle identification, vehicle model, and the first user's riding time. Exemplarily, the first user's riding information includes "XXX vehicle", "single-ticket fare", "first user's riding time" and other information.
[0122] As another possible implementation, the first user's ride information also includes the first user's boarding station and the first user's alighting station. The first user's ride fare is related to the number of stations the first user passes through, and the number of stations the first user passes through is related to the first user's boarding station and the first user's alighting station. In other words, when the vehicle charges by section, the vehicle can obtain the first user's boarding station and alighting station through the face recognition cameras on the front and rear doors. The vehicle determines the number of stations the first user passes through based on the first user's boarding station and alighting station.
[0123] Step S206: The vehicle sends the first user's boarding information to the processing device.
[0124] The processing device receives the first user's riding information sent by the vehicle. In the case where the identification result of the first user indicates that the first user's identity is not registered, the first user's riding information is associated with the first user's face image. In this way, for an unregistered user, the vehicle will also obtain the user's riding information, which is convenient for calculating the user's riding fare.
[0125] Step S207: The processing device determines the fare of the first user based on the first user's riding information.
[0126] As a possible implementation, when the first user's riding information includes one or more of the vehicle identification, vehicle model, and the first user's riding time period, the processing device may determine the first user's riding fare based on the first user's riding information. Exemplarily, the first user's riding information includes information such as "XXX vehicle", "single-ticket fare", and "first user's riding time period", and the processing device may analyze the first user's riding information, for example, to obtain the fare corresponding to one ticket in the "single-ticket fare" corresponding to the "first user's riding time period", thereby obtaining the first user's riding fare.
[0127] As another possible implementation, the first user's riding information also includes the first user's boarding station and the first user's alighting station. The first user's riding fee is related to the number of stations the first user passes through. The processing device determines the first user's riding fee based on the number of stations the first user passes through. Among them, the number of stations the first user passes through is related to the first user's boarding station and the first user's alighting station. Exemplarily, the first user's riding information includes "A bus" and "segmented charging". The processing device obtains that the charging type of A bus is segmented charging. When the number of stations the user passes through is 1-5 stations, the charge is 1 yuan. When the number of stations the user passes through is 6-10 stations, the charge is 1.5 yuan. When the number of stations the user passes through is 11-20 stations, the charge is 2 yuan. When the number of stations the user passes through is 20-30 stations, the charge is 2.5 yuan. In the first user's riding information, the first user got on the bus at station B and got off at station C. The processing device can analyze that the number of stations the first user passed is 13 stations, which are between stations 11 and 20. The processing device determines that the first user's ride fare is 2 yuan. In this way, for vehicles with segmented charges, the ride fare can also be determined based on the user's riding information, which can improve the user experience.
[0128] Optionally, when the identity of the first user has been registered, the fare of the first user is associated with the identity information of the first user, and when the identity of the first user has not been registered, the fare of the first user is associated with the facial image of the first user. In this way, for an unregistered user, the fare of the user will also be calculated and associated with the facial image of the user. When the user successfully registers, the processing device can send the bill to be paid when the user was not registered before to the user device of the user. In this way, the accuracy of the fare collected by the vehicle can be effectively guaranteed.
[0129] As a possible implementation, when the identification result of the first user indicates that the identity of the first user has been registered, the processing device may deduct the first user's ride fare from the first user's payment account.
[0130] Specifically, when the identification result of the first user indicates that the identity of the first user has been registered and the first user agrees to bind the payment account to automatically deduct the fare, the processing device can directly deduct the fare of the first user from the payment account of the first user.
[0131] As a possible implementation, when the identification result of the first user indicates that the identity of the first user is not registered, the processing device sends a first indication message to the vehicle. The first indication message is used to instruct the vehicle to generate a first prompt message, and the first prompt message is used to prompt the first user to register his identity. Further, after the identity registration of the first user is successful, the first user's ride fee is deducted from the first user's payment account.
[0132] As a possible implementation, when the first user has not bound a payment account, the processing device sends the first user's to-be-paid bill to the first user device according to the first user's identity information.
[0133] Specifically, when the identification result of the first user indicates that the identity of the first user has been registered and the first user does not agree to automatically deduct the fare by binding the payment account, the processing device sends the first user's pending bill to the first user device according to the first user's identity information. Optionally, the processing device may send the first user's pending bill to the first application in the first user device. The first user's identity information may include the user's registered identity information.
[0134] As a possible implementation, the processing device may obtain the payment result of the first user's fare. The payment result of the first user is used to indicate whether the first user has paid the first user's fare. Optionally, the payment result may be a successful payment or a failed payment. Exemplarily, the processing device may obtain the deduction result of deducting the first user's fare from the first user's payment account. If the deduction is successful, the payment result of the first user's fare is a successful payment; if the deduction fails, the payment result of the first user's fare is a failed payment. In the event of a failed deduction, the processing device sends the first user's pending bill to be paid to the first user device. Optionally, the processing device may send the first user's pending bill to be paid to the first application in the first user device.
[0135] As another possible implementation, the processing device may obtain the payment result of the first user's to-be-paid bill through the first user device. If the payment result of the first user's to-be-paid bill is a successful payment, the payment result of the first user's fare is a successful payment. If the payment result of the first user's to-be-paid bill is a failed payment or the first user has not paid the first user's to-be-paid bill, the payment result of the first user's fare is a failed payment. The processing device may send the payment result of the first user's fare to the vehicle. The payment result of the first user is used to indicate whether the first user has paid the first user's fare.
[0136] As a possible implementation, the vehicle receives the payment result of the first user sent by the processing device and presents the payment result of the first user. Optionally, the vehicle may present the payment result of the first user through a display module. For example, the vehicle may display "XXX user's fare payment failed" on the driver's central control display screen. For example, Figure 5 The central display screen can display "This user has not paid" through a window. The driver can view the passenger's payment status in real time through the vehicle display screen and remind the driver of any abnormal situation through in-car broadcasting or other means.
[0137] As a possible implementation, when the payment result of the first user is a payment failure, the vehicle receives the second indication information sent by the processing device, and the vehicle generates a third prompt information in response to the second indication information. The second indication information is used to instruct the vehicle to prompt the first user to pay the first user's fare, and the third prompt information is used to prompt the first user to pay the first user's fare. The third prompt information can be a broadcast. Exemplarily, the vehicle can automatically play "Please first user / passenger pay your fare" through the vehicle broadcast and / or the driver can give a voice prompt through the vehicle broadcast.
[0138] As a possible implementation, after the processing device sends the second duration of the bill to be paid by the first user to the first user device, when the processing device detects that the first user has not successfully paid the first user's fare, the first user's credit record is updated. The first user's credit record indicates that the first user has unsuccessfully paid fare, for example, the first user is listed as a blacklisted user. The second duration is preset and can be 5 minutes, 10 minutes, etc.
[0139] For example, see Figure 6 , Figure 6 This is a flow chart of a fare payment provided by an embodiment of the present application. Figure 6 As shown, when the processing device detects that the vehicle is not charged by section, the processing device directly determines whether the first user agrees to bind the payment account to automatically deduct the fare based on the identity information of the first user. If the first user agrees, the processing device deducts the fare of the first user from the payment account of the first user, and the processing device determines whether the deduction is successful. If the deduction is successful, the processing device sends a successful deduction message to the first application in the first user's device. If the deduction fails or the first user does not agree to bind the payment account to automatically deduct the fare, the processing device sends a pending bill to the first user's device, and the processing device determines whether the pending bill is paid successfully. If the processing device detects that the first user has not paid the pending bill after sending the pending bill for the second time, the processing device updates the credit record of the first user to indicate that there is unpaid fare (or lists the first user as a blacklisted user). When the processing device detects that the vehicle is charged by section, the processing device determines whether the first user gets off the vehicle. When the first user is detected to get off the vehicle, the processing device obtains the boarding and alighting sites of the first user. The processing device determines whether the first user agrees to bind the payment account to automatically deduct the fare based on the identity information of the first user, and executes the above steps. In this way, users do not need to perform too much operation to determine the fare and payment-related operations. This is simple and convenient, and can increase the charging speed and enhance the user experience.
[0140] As a possible implementation, the processing device may also preliminarily analyze the physical health of the first user based on the obtained plantar pressure data and gait data of the first user in combination with relevant medical knowledge, and send the analysis result to the first user device. For example, if the processing device analyzes that the pressure data of the first user has increased significantly, it may send a message to the first user device saying "Your weight is abnormal, you can go to the hospital to check your physical health."
[0141] exist Figure 2In the illustrated embodiment, the user's identity is identified through facial images and footstep pressure information, which can improve the accuracy of identification, and the fare can be determined based on the user's riding information, so that the user's fare can be directly deducted from the user's payment account later, thereby increasing the charging speed. The operation is simple and convenient, does not require excessive user operations, and can improve the user experience.
[0142] above Figure 2 The embodiment shown includes multiple possible solutions. For ease of understanding, one possible solution is described below. It should be understood that Figure 7 For some of the terms, logic, etc. in the scheme shown, please refer to Figure 2 The embodiment shown.
[0143] See also Figure 7 , Figure 7 This is a flowchart of a method for identifying the identity of a first user provided in an embodiment of the present application.
[0144] The method is applied to a fare payment system, which includes a public transportation vehicle, a processing device and a first user device, such as Figure 1 The fare payment system 10 in the invention comprises the steps of:
[0145] S1: A camera of a public transportation vehicle obtains a facial image of a first user and the first user's boarding information, and sends the facial image of the first user and the first user's boarding information to a processing device.
[0146] The first user's riding information includes one or more of the public transportation vehicle identification, the public transportation vehicle model, and the first user's riding time. Optionally, the first user's riding information also includes the first user's boarding station and the first user's alighting station, the first user's riding fare is related to the number of stations the first user passes by, and the number of stations the first user passes by is related to the first user's boarding station and the first user's alighting station.
[0147] S2: The ground pressure sensor of the public transportation vehicle obtains the footstep pressure information of the first user and sends the footstep pressure information of the first user to the processing device.
[0148] The footstep pressure information of the first user may include one or more parameters such as pressure distribution of both feet of the first user after getting on the vehicle, walking step length, step frequency, etc.
[0149] S3: The processing device determines whether the first user is a registered user according to the facial image of the first user and the footstep pressure information of the first user.
[0150] That is, the processing device identifies the identity of the first user based on the face image of the first user and the footstep pressure information of the first user. The device result may indicate whether the first user is a registered user.
[0151] When the first user is a registered user, step S5 is executed, and when the first user is not a registered user, step S4 is executed.
[0152] S4: The public transportation vehicle generates a first prompt message to remind the user to register his / her identity.
[0153] For example, public transportation vehicles can automatically broadcast "Users / passengers, please register your identity" through vehicle broadcasting.
[0154] S5: The processing device determines whether the first user is a blacklist user (there is unpaid ride fare in the historical credit situation).
[0155] When the first user is a blacklist user, step S6 is executed.
[0156] S6: The public transportation vehicle presents an image of the first user in the vehicle on a display screen.
[0157] S7: The public transportation vehicle receives a click operation of the vehicle driver on the image of the first user, and sends a third indication message to the processing device, which is used to instruct the processing device to send a fourth prompt message to the first user device to remind the first user to pay the fare that the first user has not paid.
[0158] S8: If the first user does not pay the fare that the first user has not paid after sending the fourth reminder message for the first period of time, the public transportation vehicle generates a third reminder message to remind the first user to pay.
[0159] Optionally, the first duration is pre-set and may be 5 minutes, 10 minutes, etc.
[0160] In this way, by adding relevant data of the footstep pressure information, the processing device can identify the identity of the first user in combination with the face recognition data, which can effectively improve the accuracy of recognition.
[0161] above Figure 2 The embodiment shown includes multiple possible solutions. For ease of understanding, another possible solution is described below. It should be understood that Figure 8 For some of the terms, logic, etc. in the scheme shown, please refer to Figure 2 The embodiment shown.
[0162] See also Figure 8 , Figure 8 This is a flowchart of another method for determining fare provided in an embodiment of the present application.
[0163] The method is applied to public transport vehicles, e.g. Figure 1 The method comprises the steps of:
[0164] S1: The public transportation vehicle collects a facial image of a first user and footstep pressure information of the first user.
[0165] The footstep pressure information of the first user may include one or more parameters such as the pressure distribution of both feet of the first user after getting on the vehicle, the walking step length, the step frequency, etc.
[0166] S2: The public transportation vehicle determines the identity of the first user according to the facial image of the first user and the footstep pressure information of the first user.
[0167] Optionally, the public transportation vehicle can obtain the pressure distribution value of the first user's foot and the gait characteristic parameters of the first user based on the footstep pressure information of the first user. The public transportation vehicle can also obtain the face recognition data of the first user based on the face image of the first user, and determine the identity of the first user based on the pressure distribution value of the first user's foot and the gait characteristic parameters of the first user combined with the face recognition data of the first user to improve the accuracy of determining the user's identity. The specific process of determining the identity of the first user can refer to the above-mentioned related description.
[0168] S3: The public transportation vehicle determines the fare for the first user according to the riding information of the first user and the identity of the first user.
[0169] The first user's riding information includes one or more of the public transportation vehicle identification, the public transportation vehicle model, and the first user's riding time. Optionally, the first user's riding information also includes the first user's boarding station and the first user's alighting station. The first user's riding fee is related to the number of stations the first user passes through, and the number of stations the first user passes through is related to the first user's boarding station and the first user's alighting station. In this way, this method is also applicable to public transportation vehicles with segmented charges.
[0170] Optionally, after the public transportation vehicle determines the fare of the first user based on the first user's riding information and the first user's identity, if the first user's identity information includes the payment account bound to the first user, the public transportation vehicle can directly deduct the first user's fare from the payment account bound to the first user, as described above. In this way, the charging speed of public transportation vehicles can be effectively improved, and the operation is simple and convenient, without the need for excessive user operations, which can improve the user experience.
[0171] The method of the embodiment of the present application is described in detail above, and the device of the embodiment of the present application is provided below.
[0172] See also Fig. 9 , Fig. 9 90 is a schematic diagram of a processing device provided in an embodiment of the present application. The processing device 90 may include a communication unit 901 and a processing unit 902. The processing device 90 is applied to public transportation vehicles, such as Figure 1 The processing device 90 is used to implement the above-mentioned method for determining the fare, for example Figure 2 or Figure 8 The method for determining the fare in the illustrated embodiment.
[0173] It should be noted that the division of the above multiple units is only a logical division based on functions, and does not limit the specific structure of the processing device 90. In a specific implementation, some functional modules may be subdivided into more small functional modules, and some functional modules may be combined into one functional module.
[0174] In a possible implementation, the communication unit 901 is configured to:
[0175] Sending a facial image of a first user and footstep pressure information of the first user to a processing device, wherein the facial image of the first user and the footstep pressure information of the first user are used to identify the identity of the first user;
[0176] Sending the first user's riding information to the processing device, where the first user's riding information is used to determine the first user's riding fare;
[0177] The processing unit 902 is used for:
[0178] Collecting a facial image of a first user and footstep pressure information of the first user;
[0179] The first user's ride information is determined.
[0180] In a possible implementation manner, the first user's riding information includes one or more of an identification of a public transportation vehicle, a model of a public transportation vehicle, and a riding time period of the first user.
[0181] In a possible implementation, the first user's riding information also includes the first user's boarding station and the first user's alighting station, the first user's riding fare is related to the number of stations the first user passes through, and the number of stations the first user passes through is related to the first user's boarding station and the first user's alighting station.
[0182] In a possible implementation manner, the footstep pressure information includes one or more of foot pressure distribution, step length, and step frequency.
[0183] In a possible implementation, the identity of the first user is identified by the processing device based on the pressure distribution value of the first user's foot, the gait characteristic parameters of the first user, and the face recognition data of the first user; the pressure distribution value of the first user's foot and the gait characteristic parameters of the first user are obtained by the processing device based on the footstep pressure information of the first user; and the face recognition data of the first user is obtained by the processing device based on the face image of the first user.
[0184] In a possible implementation, the communication unit 901 is also used to receive an identification result of the first user's identity from a processing device, and the processing unit 902 is also used to generate a first prompt message when the identification result of the first user indicates that the first user's identity is not registered, and the first prompt message is used to prompt the first user to register his identity.
[0185] In a possible implementation, the first user pays the fare in the first application, the first prompt information is used to prompt the first user to register his identity in the first application, the first application is installed in the first user device, and the first user device is associated with the identity of the first user.
[0186] In one possible embodiment, the processing device further includes a display unit 903, and the communication unit 901 is also used to receive a payment result of a first user from the processing device, and the payment result of the first user is used to indicate whether the first user has paid the first user's fare, and the display unit 903 is used to present the payment result of the first user.
[0187] In one possible implementation, the communication unit 901 is also used to receive a credit record of a first user from a processing device, and the display unit 903 is also used to display a first interface when the credit record of the first user indicates that the first user has unsuccessfully paid fares, the first interface including clickable controls corresponding to the first user, and the processing unit 902 is also used to generate a second prompt message in response to a click operation on the clickable control corresponding to the first user, and the second prompt message is used to prompt the first user to pay the unpaid fares of the first user.
[0188] Optionally, the processing unit 902 is further configured to:
[0189] determining the identity of the first user based on the facial image of the first user and the footstep pressure information of the first user;
[0190] The ride fare of the first user is determined according to the ride information of the first user and the identity of the first user.
[0191] It should be noted that the above-mentioned units (communication unit 901 and processing unit 902) are used to execute the relevant steps of the above-mentioned method. For example, the communication unit 901 is used to execute the relevant contents of steps S202 and S206, and the processing unit 902 is used to execute the relevant contents of S201 and S205.
[0192] See also Fig.10 , Fig.10 1 is a schematic diagram of the structure of another processing device provided in an embodiment of the present application. The processing device 100 may include a communication unit 1001 and a processing unit 1002. The processing device 100 is used to implement the aforementioned method for determining the fare, for example Figure 2 or Figure 8 The method for determining the fare in the illustrated embodiment.
[0193] It should be noted that the division of the above multiple units is only a logical division based on functions, and does not limit the specific structure of the processing device 100. In a specific implementation, some functional modules may be subdivided into more small functional modules, and some functional modules may be combined into one functional module.
[0194] In a possible implementation, the communication unit 1001 is configured to:
[0195] receiving a facial image of a first user and footstep pressure information of the first user from a public transportation vehicle;
[0196] sending the identification result of the first user to the public transportation vehicle;
[0197] receiving riding information from a first user of a public transportation vehicle;
[0198] The processing unit 1002 is used for:
[0199] identifying the identity of the first user according to the facial image of the first user and the footstep pressure information of the first user;
[0200] The ride fare of the first user is determined according to the ride information of the first user.
[0201] In a possible implementation manner, the footstep pressure information includes one or more of foot pressure distribution, step length, and step frequency.
[0202] In a possible implementation, the processing unit 1002 is further configured to:
[0203] Obtaining face recognition data of the first user according to the face image of the first user;
[0204] Obtaining a pressure distribution value of a foot of the first user and a gait characteristic parameter of the first user according to the footstep pressure information of the first user;
[0205] The identity of the first user is identified based on the pressure distribution value of the first user's foot, the gait characteristic parameters of the first user, and the face recognition data of the first user.
[0206] In a possible implementation, the identification result of the first user is further used to indicate whether the identity of the first user has been registered, and the processing unit 1002 is further used to:
[0207] If the identity of the first user has been registered, deducting the first user's ride fare from the first user's payment account;
[0208] In the case where the identity of the first user is not registered, first indication information is sent to the public transportation vehicle, where the first indication information is used to instruct the first user to register his identity.
[0209] Furthermore, the processing unit 1002 is further configured to deduct the first user's ride fare from the first user's payment account after the first user's identity registration is successful.
[0210] In a possible implementation, the communication unit 1001 is also used to send a bill to be paid to the first user device when the deduction result of the first user is a deduction failure or the first user has not bound a payment account. The bill to be paid is used to instruct the first user to pay the first user's fare. The first user device is associated with the identity of the first user. The processing unit 1002 is also used to update the credit record of the first user when it is detected that the first user has not paid the first user's fare after sending the bill to be paid to the first user device for a second period of time. The credit record of the first user indicates that the first user has unsuccessfully paid fare.
[0211] It should be noted that the above-mentioned units (communication unit 1001 and processing unit 1002) are used to execute the relevant steps of the above-mentioned method. For example, the communication unit 1001 is used to execute the relevant content of step S204, and the processing unit 1002 is used to execute the relevant content of S203 and S207.
[0212] Fig.11 FIG. 1 is a schematic diagram of the structure of another vehicle provided in an embodiment of the present application. A vehicle is a device with processing capabilities.
[0213] like Fig.11 As shown, the vehicle 110 includes: a processor 1101 and a memory 1102 and one or more programs, and may include a communication interface 1103. It should be understood that the present application does not limit the number of processors and memories in the vehicle 110.
[0214] Processor 1101 is a module for performing calculations, and may include a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor (MP), a digital signal processor (DSP), a microcontroller unit (MCU), or one or more integrated circuits for controlling the execution of the above program.
[0215] The memory 1102 is used to provide a storage space, and the storage space can optionally store application data, user data, operating system, computer programs, etc. The memory 1102 may include a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, and may also be an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compact disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto.
[0216] The memory 1102 may exist independently and be connected to the processor 1101 via a bus. The memory 1102 may also be integrated with the processor 1101.
[0217] The communication interface 1103 is used to provide information input or output for the at least one processor. And / or, the communication interface 1103 can be used to receive data sent externally and / or send data to the outside. The communication interface 1103 can be a wired link interface including an Ethernet cable, etc., or a wireless link (Wi-Fi, Bluetooth, general wireless transmission and other wireless communication technologies, etc.) interface. Optionally, the communication interface 1103 can also include a transmitter (such as a radio frequency transmitter, an antenna, etc.) coupled to the interface, or a receiver, etc.
[0218] In the embodiment of the present application, the one or more programs are stored in the memory 1102 in the form of program codes and are configured to be executed by the processor 1101. The programs include instructions for implementing the steps in the above-mentioned method for determining the fare. Figure 2 That is, the memory 1102 stores executable instructions, and the processor 1101 executes the executable instructions to implement the aforementioned method for determining the fare, for example Figure 2 That is, the memory 1102 stores instructions for executing the fare determination method.
[0219] Alternatively, executable instructions are stored in the memory 1102, and the processor 1101 executes the executable instructions to respectively implement the functions of one or more units (or devices) in the communication unit and the processing unit in the aforementioned processing device 90, thereby realizing the method for determining the fare.
[0220] Fig.12 The figure shows a schematic diagram of the structure of a computing device provided in an embodiment of the present application. A computing device is a device with processing capabilities, and the device here can be a physical device, such as a server (such as a rack server), a host, etc., or a virtual device, such as a virtual machine, a container, etc.
[0221] like Fig.12 As shown, the computing device 120 includes: a processor 1201 and a memory 1202 and one or more programs, and may include a communication interface 1203. It should be understood that the present application does not limit the number of processors and memories in the computing device 120.
[0222] The processor 1201 is a module for performing calculations, and may include a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor (MP), a digital signal processor (DSP), a microcontroller unit (MCU), or one or more integrated circuits for controlling the execution of the above program.
[0223] The memory 1202 is used to provide a storage space, and the storage space can optionally store application data, user data, operating system, computer programs, etc. The memory 1202 may include a read-only memory ROM or other types of static storage devices that can store static information and instructions, a random access memory RAM or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory EEPROM, a read-only compact disc CD-ROM or other optical disc storage, an optical disc storage (including a compact disc, a laser disc, an optical disc, a digital versatile disc, a Blu-ray disc, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto.
[0224] The memory 1202 may exist independently and be connected to the processor 1201 via a bus. The memory 1202 may also be integrated with the processor 1201.
[0225] The communication interface 1203 is used to provide information input or output for the at least one processor. And / or, the communication interface 1203 can be used to receive data sent externally and / or send data to the outside. The communication interface 1203 can be a wired link interface including an Ethernet cable, etc., or a wireless link (Wi-Fi, Bluetooth, general wireless transmission and other wireless communication technologies, etc.) interface. Optionally, the communication interface 1203 can also include a transmitter (such as a radio frequency transmitter, antenna, etc.) coupled to the interface, or a receiver, etc.
[0226] In the embodiment of the present application, the one or more programs are stored in the memory 1202 in the form of program codes and are configured to be executed by the processor 1201. The programs include instructions for implementing the steps in the above-mentioned method for determining the fare. Figure 2 That is, the memory 1202 stores executable instructions, and the processor 1201 executes the executable instructions to implement the aforementioned method for determining the fare, for example Figure 2 That is, the memory 1202 stores instructions for executing the fare determination method.
[0227] Alternatively, executable instructions are stored in the memory 1202, and the processor 1201 executes the executable instructions to respectively implement the functions of one or more units (or devices) in the communication unit and the processing unit in the aforementioned processing device 100, thereby realizing the method for determining the fare.
[0228] The present application also provides a computer program product including instructions. The computer program product may be software or a program product including instructions that can be run on a computing device or stored in any available medium. The computer program instructions are used to implement the aforementioned method for determining the fare, for example Figure 2 A method for determining a fare in an embodiment of the present invention.
[0229] The present application also provides a storage medium, which is a computer-readable storage medium. The computer-readable storage medium includes instructions for implementing the aforementioned method for determining the fare, for example Figure 2 A method for determining a fare in an embodiment of the present invention.
[0230] The computer-readable storage medium may be any available medium that the processing device and the processing device can store, or a data storage device such as a data center that includes one or more available media. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state drive), etc.
[0231] In the embodiments of the present application, the words "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.
[0232] The "at least one" mentioned in the embodiments of the present application refers to one or more, and "plurality" refers to two or more. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b, or c can be represented by: a, b, c, (a and b), (a and c), (b and c), or (a and b and c), where a, b, c can be single or multiple. "And / or" describes the association relationship of associated objects, indicating that three relationships can exist. For example, A and / or B can be represented by: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the associated objects before and after are in an "or" relationship.
[0233] Furthermore, unless otherwise specified, the ordinal numbers such as "first" and "second" used in the embodiments of the present application are used to distinguish multiple objects, and are not used to limit the order, timing, priority or importance of multiple objects. For example, the first indication information and the second indication information are only for the convenience of description, and do not indicate the difference in the deployment order, importance, etc. of the first indication information and the second indication information.
[0234] Those skilled in the art will appreciate that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk, or an optical disk, etc.
[0235] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the protection scope of the technical solutions of the embodiments of the present invention.
Claims
1. A method for determining a fare, characterized in that: Applied to public transportation vehicles, the method comprises: Collecting a facial image of a first user and footstep pressure information of the first user; sending the facial image of the first user and the footstep pressure information of the first user to a processing device, where the facial image of the first user and the footstep pressure information of the first user are used to identify the identity of the first user; Determining the first user's riding information; The riding information of the first user is sent to the processing device, and the riding information of the first user is used to determine the riding fare of the first user.
2. The method according to claim 1, characterized in that The footstep pressure information includes one or more of foot pressure distribution, step length and step frequency.
3. The method according to claim 1, characterized in that The identity of the first user is identified by the processing device based on the pressure distribution value of the first user's foot, the gait characteristic parameters of the first user and the face recognition data of the first user; the pressure distribution value of the first user's foot and the gait characteristic parameters of the first user are obtained by the processing device based on the footstep pressure information of the first user; and the face recognition data of the first user is obtained by the processing device based on the face image of the first user.
4. The method according to claim 1, characterized in that: The riding information of the first user includes one or more of the identification of the public transportation vehicle, the model of the public transportation vehicle, and the riding time period of the first user.
5. The method according to claim 4, characterized in that The first user's riding information also includes the first user's boarding station and the first user's alighting station. The first user's riding fare is related to the number of stations passed by the first user, and the number of stations passed by the first user is related to the first user's boarding station and the first user's alighting station.
6. The method according to any one of claims 1 to 5, characterized in that: The method further comprises: receiving an identification result of the first user from the processing device; When the identification result of the first user indicates that the identity of the first user is not registered, first prompt information is generated, where the first prompt information is used to prompt the first user to register the identity.
7. The method according to any one of claims 1 to 5, characterized in that: The public transportation vehicle comprises a display module; the method further comprises: receiving a payment result of the first user from the processing device, the payment result of the first user being used to indicate whether the first user pays the ride fare of the first user; The payment result of the first user is presented through the display module.
8. The method according to any one of claims 1 to 5, characterized in that: The public transportation vehicle comprises a display module; the method further comprises: receiving a credit record of the first user from the processing device; In a case where the credit record of the first user indicates that the first user has unsuccessfully paid ride fares, displaying a first interface through a display module, the first interface including a clickable control corresponding to the first user; In response to a click operation on a clickable control corresponding to the first user, a second prompt message is generated, where the second prompt message is used to prompt the first user to pay the fare that the first user has not paid.
9. A method for determining a fare, characterized in that: The method comprises: receiving a facial image of a first user and footstep pressure information of the first user from a public transportation vehicle; identifying the identity of the first user according to the facial image of the first user and the footstep pressure information of the first user; sending the identification result of the first user to the public transportation vehicle; receiving the riding information of the first user from the public transportation vehicle; The fare of the first user is determined according to the riding information of the first user.
10. The method according to claim 9, characterized in that The footstep pressure information includes one or more of foot pressure distribution, step length and step frequency.
11. The method according to claim 9, characterized in that The identifying the identity of the first user according to the facial image of the first user and the footstep pressure information of the first user includes: Obtaining face recognition data of the first user according to the face image of the first user; Obtaining a pressure distribution value of a foot of the first user and a gait characteristic parameter of the first user according to the footstep pressure information of the first user; The identity of the first user is identified based on the pressure distribution value of the first user's foot, the gait characteristic parameters of the first user, and the face recognition data of the first user.
12. The method according to claim 9, characterized in that The identification result of the first user is also used to indicate whether the identity of the first user has been registered, and the method further includes: If the identity of the first user has been registered, deducting the first user's ride fare from the first user's payment account; In the case where the identity of the first user is not registered, first indication information is sent to the public transportation vehicle, where the first indication information is used to instruct the first user to register his identity.
13. The method according to claim 12, characterized in that The method further comprises: If the deduction result of the first user is a deduction failure or the first user has not bound a payment account, a bill to be paid is sent to the first user device, where the bill to be paid is used to instruct the first user to pay the first user's ride fare, and the first user device is associated with the identity of the first user; After sending the second duration of the bill to be paid to the first user device, when it is detected that the first user has not paid the first user's fare, the credit record of the first user is updated, and the credit record of the first user indicates that the first user has unsuccessfully paid fare.
14. A method for determining a fare, characterized in that: Applied to public transportation vehicles, the method comprises: Collecting a facial image of a first user and footstep pressure information of the first user; determining the identity of the first user according to the facial image of the first user and the footstep pressure information of the first user; The ride fare of the first user is determined according to the ride information of the first user and the identity of the first user.
15. A processing device, characterized in that: The processing device comprises a communication unit and a processing unit, and the processing device is used to implement the method of any one of claims 1-8 or claim 14, or to implement the method of any one of claims 9-13.
16. A vehicle, characterized in that: The vehicle comprises a processor and a memory, wherein a program is stored in the memory, and the program comprises instructions for executing the method according to any one of claims 1 to 8 or the method according to claim 14.
17. A computing device, characterized in that The computing device comprises a processor and a memory, wherein a program is stored in the memory, and the program comprises instructions for executing the method according to any one of claims 9 to 13.
18. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, and the storage medium is used to store a computer program, wherein the computer program includes instructions for executing the method according to any one of claims 1 to 14.