Ticket checking processing method, device, equipment and system for public transportation

Abstract

This specification provides a ticket checking processing method, device, equipment and system for public transportation, which can identify the user's identity by collecting the user's palm features, so as to quickly check the user entering the public transportation, and when leaving the station, by matching the user's palm features, the user can quickly check the exit ticket. The whole process does not require the user to carry other equipment, the operation is simple, the recognition speed is fast, and the ticket checking efficiency of public transportation is improved. In addition, by collecting palm features, it is possible to avoid the phenomenon that problems caused by face recognition affect the ticket checking efficiency, and collecting palm features does not require the user to take off the clothes they are wearing, which is convenient for operation. At the same time, based on the user's identity recognition results, the user's payment account can be obtained to realize online billing for the user's riding of public transportation, without the user having to buy tickets or scan codes, and there is no need to worry about client failures, which improves the user's travel efficiency.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and more particularly to a ticket checking processing method, device, equipment and system for public transportation. Background Art

[0002] With the implementation of energy conservation and emission reduction and green travel policies, public transportation is increasingly chosen by users as a means of travel. For example, subways are favored by more and more people for their efficiency and punctuality, and their passenger flow is also increasing. Some public transportation requires ticket inspection when entering or riding. Currently, ticket inspection is mostly done by swiping cards or scanning codes. During peak passenger flow, ticket inspection is easily blocked due to problems such as ticket purchase efficiency, card loss, network freeze, and mobile phone failure, resulting in long queues, which affects people's travel efficiency and experience. Summary of the invention

[0003] The purpose of the embodiments of this specification is to provide a ticket checking processing method, device, equipment and system for public transportation, thereby improving the ticket checking efficiency of public transportation.

[0004] In a first aspect, an embodiment of the present specification provides a ticket checking processing method for public transportation, which is applied to a local server of the public transportation, and the method includes:

[0005] Receive the palm features of the user collected by the palm feature collection device set in the ticket inspection device when the user enters the station, and send the palm features to the cloud server, so that the cloud server can identify the user based on the palm features;

[0006] After receiving the identity recognition success information returned by the cloud server, controlling the station entrance ticket inspection device to open the gate;

[0007] Receiving the user's exit palm features collected by the palm feature collection device provided in the exit ticket inspection device when the user exits the station;

[0008] The exit palm feature and the entry palm feature are matched. If the match is successful, the exit ticket checking device is controlled to open the gate, and the traffic billing result is calculated, and the traffic billing result is sent to the cloud server, so that the cloud server deducts the traffic fee according to the traffic billing result and the payment account corresponding to the user.

[0009] In a second aspect, an embodiment of the present specification provides a ticket checking processing method for public transportation, which is applied to a cloud server corresponding to the public transportation, and the method includes:

[0010] Receiving the palm features of the user entering the station uploaded by the local server corresponding to the public transportation vehicle when the user enters the station, wherein the palm features of the user entering the station are collected by the palm feature collection device set in the ticket inspection device when the user enters the station;

[0011] Matching the palm feature of the station entry with the user identity database, and if the match is successful, obtaining the payment account corresponding to the palm feature of the station entry;

[0012] After the match is successful, the identity recognition success information is returned to the local server, so that the local server controls the station entrance ticket inspection device to open the gate;

[0013] Receive the user's traffic billing result sent by the local server after the user exits the station, and deduct a corresponding amount from the payment account according to the traffic billing result.

[0014] In a third aspect, the present specification provides a ticket checking processing device for public transportation, which is applied to a local server of the public transportation, and the device includes:

[0015] The station entry information collection module is used to receive the station entry palm features of the user collected by the palm feature collection device set in the station entry ticket inspection device when the user enters the station, and send the station entry palm features to the cloud server, so that the cloud server can identify the station entry user based on the station entry palm features;

[0016] The station entrance ticket inspection module is used to control the station entrance ticket inspection device to open the gate after receiving the identity recognition success information returned by the cloud server;

[0017] The exit information collection module is used to receive the user's exit palm features collected by the palm feature collection device set in the exit ticket inspection device when the user exits the station;

[0018] The exit ticket checking and billing module is used to match the exit palm features with the entry palm features. If the match is successful, the exit ticket checking device is controlled to open the gate, and the traffic billing result is calculated, and the traffic billing result is sent to the cloud server, so that the cloud server deducts the traffic fee according to the traffic billing result and the payment account corresponding to the user.

[0019] In a fourth aspect, the present specification provides a ticket checking processing device for public transportation, which is applied to a cloud server corresponding to the public transportation, and the device includes:

[0020] The station entry information receiving module is used to receive the station entry palm features uploaded by the local server corresponding to the public transportation vehicle when the user enters the station, and the station entry palm features are collected by the palm feature collection device set in the station entry ticket inspection device when the user enters the station;

[0021] The station entry identity recognition module is used to match the station entry palm features with the user identity database, and if the match is successful, obtain the payment account corresponding to the station entry palm features;

[0022] An identity recognition result feedback module is used to return identity recognition success information to the local server after the match is successful, so that the local server controls the station entry ticket inspection device to open the gate;

[0023] The billing processing module is used to receive the user's traffic billing result sent by the local server after the user leaves the station, and deduct the corresponding amount from the payment account according to the traffic billing result.

[0024] In a fifth aspect, an embodiment of the present specification provides a ticket checking and processing device for public transportation, comprising at least one processor and a memory for storing processor executable instructions, wherein the processor implements the above-mentioned ticket checking and processing method for public transportation when executing the instructions.

[0025] In a sixth aspect, an embodiment of the present specification provides a ticket checking processing system for public transportation, the system comprising:

[0026] An entry ticket inspection device, an exit ticket inspection device, a local server and a cloud server, wherein the entry ticket inspection device is provided with a palm feature collection device, and the exit ticket inspection device is provided with a palm feature collection device;

[0027] The palm feature collection device is used to collect the palm features of the user when the user enters and exits the station, and upload the collected palm features to the local server;

[0028] The local server is used to send the received palm features to the cloud server when the user enters the station, and the cloud server performs identity recognition on the user entering the station based on the received palm features; the local server controls the station ticket inspection device to open the gate after the cloud server successfully recognizes the identity of the user entering the station;

[0029] The local server is also used to match the received palm features with the palm features collected by the ticket inspection device when the user exits the station. After a successful match, the user's billing result is calculated and sent to the cloud server. The cloud server deducts transportation fees based on the billing result and the user's corresponding payment account.

[0030] The ticket checking processing method, device, equipment and system for public transportation provided in this specification can identify the user's identity by collecting the user's palm features, so as to quickly check the user entering the public transportation, and when leaving the station, by matching the user's palm features, the user can quickly check the ticket for exiting the station. The whole process does not require the user to carry other equipment, the operation is simple, the recognition speed is fast, and the ticket checking efficiency of public transportation is improved. In addition, by collecting palm features, it is possible to avoid problems with face recognition caused by twins, similar faces or makeup, which in turn affects the ticket checking efficiency. In addition, collecting palm features does not require the user to take off the clothes they are wearing, which is convenient for operation. At the same time, based on the user's identity recognition results, the user's payment account can be obtained to realize online billing for the user's riding of public transportation, without the user having to buy tickets or scan codes, and there is no need to worry about client failures, which improves the user's travel efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] In order to more clearly illustrate the embodiments of this specification or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0032] Figure 1 It is a flowchart of an embodiment of a ticket checking method for public transportation provided in an embodiment of this specification;

[0033] Figure 2 This is a schematic diagram of a top view of a ticket checking device for a public transportation vehicle, which is an example of a scenario in this specification;

[0034] Figure 3 It is a structural diagram of the main view of a public transportation vehicle entrance ticket inspection device in a scenario example of this specification;

[0035] Figure 4 is a flowchart of a ticket checking method for public transportation in another embodiment of the present specification;

[0036] Figure 5 It is a schematic diagram of the module structure of an embodiment of a ticket checking and processing device for public transportation provided in this specification;

[0037] Figure 6 It is a schematic diagram of the module structure of another embodiment of the ticket checking and processing device for public transportation provided in this specification;

[0038] Figure 7It is a hardware structure block diagram of a ticket checking processing server for public transportation in one embodiment of this specification. DETAILED DESCRIPTION

[0039] In order to enable those skilled in the art to better understand the technical solutions in this specification, the technical solutions in the embodiments of this specification will be clearly and completely described below in conjunction with the drawings in the embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this specification, not all of the embodiments. Based on the embodiments in this specification, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of this specification.

[0040] Public transportation generally requires ticket inspection for entry and exit, which ensures safety and facilitates billing. With the development of computer Internet technology, users can check tickets by scanning codes or using smartphones, or purchase tickets through self-service ticket terminals and swipe tickets to enter the station. However, when the client network status is poor or the client fails, the ticket inspection time may be extended, affecting the efficiency of users entering the station.

[0041] The embodiments of this specification provide a ticket checking method for public transportation, which uses biometric identification technology based on palm features to achieve identity authentication, section billing, and quick settlement during the ticket checking process. When a user passes through the entrance, he needs to enter his palm information, and when the user exits the station, he only needs to wave his palm to complete the ticket checking and settlement. The entire process does not require the user to carry any peripheral hardware media, the operation is simple, and the recognition speed is fast. Compared with the existing ticket checking system, the ticket checking efficiency is greatly improved.

[0042] Figure 1 It is a flow chart of an embodiment of the ticket checking method for public transportation provided in the embodiment of this specification. Although this specification provides the method operation steps or device structure as shown in the following embodiments or drawings, more or fewer operation steps or module units after partial merger may be included in the method or device based on routine or no creative labor. In the steps or structures where there is no necessary causal relationship logically, the execution order of these steps or the module structure of the device is not limited to the execution order or module structure shown in the embodiments or drawings of this specification. When the method or module structure described is applied in an actual device, server or terminal product, it can be executed sequentially or in parallel according to the method or module structure shown in the embodiment or drawings (for example, a parallel processor or multi-threaded processing environment, or even a distributed processing, server cluster implementation environment).

[0043] The ticket checking processing method for public transportation provided in the embodiments of this specification can be applied to the local server of public transportation, such as: the local ticket checking server corresponding to the subway, the high-speed rail ticket checking server, the bus ticket checking server, the long-distance bus ticket checking server, the airport ticket checking server, etc. The scheme in the embodiments of this specification is particularly suitable for public transportation that needs to be charged by section. It can perform intelligent billing on the section where the user is riding based on the user's ticket checking information, and does not affect the ticket checking rate. Figure 1 As shown, the method may include the following steps:

[0044] Step 102: Receive the palm features of the user collected by the palm feature collection device provided in the ticket inspection device when the user enters the station, and send the palm features to the cloud server, so that the cloud server can identify the user based on the palm features.

[0045] In the specific implementation process, in the embodiments of this specification, a palm feature collection device can be set in the station entrance ticket inspection device of a public transportation vehicle, such as: a palm feature collection device is set at the entrance end of the arm of the subway station entrance channel gate, and the palm feature collection device can be used to collect the palm features of the user entering the station. In addition, a hand-shaped window can be made above the position where the palm feature collection device is set in the station entrance ticket inspection device to prompt the user to place the palm at this position to collect the palm features. The palm feature collection device can be connected to the local server via USB or network cable to upload the collected features to the local server.

[0046] In the embodiments of this specification, when a user takes public transportation, he / she first passes through the ticket inspection device for entry. When passing through the ticket inspection device, the user can place his / her palm on the palm feature collection device provided in the ticket inspection device according to the prompt. The palm feature collection device can collect the palm features of the user entering the station and send the collected palm features to the local server. After the local server receives the palm features collected by the palm feature collection device, it can send the received palm features to the cloud server. The cloud server can identify the user entering the station based on the palm features. The cloud server in the embodiments of this specification can be understood as a server that stores a lot of user identity information, which can generally be a platform or server with payment capabilities. The cloud server can have a database, which can store the palm features of different users and corresponding user information such as user name, payment account number, etc. After the cloud server receives the palm features of the entry uploaded by the local server, it can match the palm features of the entry with the data in the database, query the database whether the palm features and the user-related information bound to the palm features exist, obtain the information of the entry user, and thus realize the identity recognition of the entry user.

[0047] Step 104: After receiving the identity recognition success information returned by the cloud server, control the station entry ticket checking device to open the gate.

[0048] In the specific implementation process, if the cloud server queries the user information corresponding to the palm features sent by the local server, it can be considered that the identity recognition of the user entering the station has passed, and the identity recognition success information can be returned to the local server. After the local server receives the identity recognition success information returned by the cloud server, it can control the station ticket inspection device to open the gate to allow the user to enter, and realize fast and automatic ticket inspection for users entering the station. Users do not need to carry any hardware equipment, the operation is simple, the recognition speed is fast, and in special scenarios such as: infectious disease outbreak seasons, users wearing masks when traveling, users do not need to take off their masks when entering public transportation, and the user's identity can be quickly recognized, ensuring the safety of the user.

[0049] Step 106: Receive the user's exit palm features collected by the palm feature collection device provided in the exit ticket checking device when the user exits the station.

[0050] In the specific implementation process, many public transportation vehicles need to check tickets again when exiting the station to ensure that the section the user is riding is consistent with the section where the ticket is purchased, or to charge the section the user is riding. In the embodiment of this specification, a palm feature collection device can also be set in the exit ticket checking device to collect the palm features of the exiting user. Figure 2 1 is a schematic diagram of a top view of a ticket checking device for a public transportation vehicle, as an example of a scenario in this specification. Figure 2 As shown, the ticket inspection devices of general public transportation vehicles have gates. A palm feature collection device can be set at the entrance end of the gate arm of the public transportation vehicle entry ticket inspection device and the exit ticket inspection device. The specific position can be adjusted according to actual needs. The embodiments of this specification are not specifically limited. When the user arrives at the terminal station by public transportation, he can go through the exit ticket inspection device to check the ticket and exit. When passing through the exit ticket inspection device, the user can place the palm at the palm feature collection device in the exit ticket inspection device according to the prompt. The palm feature collection device can collect the exit palm features of the exit user and upload the collected exit palm features to the local server.

[0051] In some embodiments of the present specification, the palm feature collection device is any one of a palm print collection device, a fingerprint collection device, and a palm vein collection device. Accordingly, the entry palm feature and the exit palm feature are the user's palm print, fingerprint or palm vein feature.

[0052] In the specific implementation process, the palm feature acquisition device in the embodiment of this specification can be any one of a palm print acquisition device, a fingerprint acquisition device, and a palm vein acquisition device. The corresponding collected entry and exit palm features are the user's palm prints, fingerprints or palm vein features. By setting a palm feature acquisition device on the ticket inspection device, the user's features can be quickly collected, thereby quickly identifying the user's identity and improving the ticket inspection efficiency. Among them, the palm print can be understood as the fingerprint of the palm, and the fingerprint can generally be understood as the fingerprint on the finger. The palm vein is the blue vein that is faintly visible through the skin of the palm, including all the venous systems within the palm range. Palm vein recognition uses near-infrared rays to illuminate the palm, and the sensor senses the light reflected by the palm. The key is that the hemoglobin flowing into the venous red blood cells will absorb the near-infrared rays near the wavelength of 760nm, resulting in less reflection of the vein part, and a vein pattern will be generated on the image. In other words, vein recognition uses the strength of the reflected near-infrared rays to identify the location of the vein. Then, by comparing the read vein data with the pre-stored palm vein data, the user can be identified. In the embodiments of this specification, it is preferred to use a palm vein collection device to collect the user's palm vein characteristics. The collection of palm vein characteristics can be non-contact, which can avoid cross-infection in some special scenarios and is safer and healthier. In addition, the non-contact collection method can also ensure that the user's palm vein characteristics are not stolen, thereby ensuring the security of user information.

[0053] Step 108, match the exit palm feature with the entry palm feature. If the match is successful, control the exit ticket checking device to open the gate, calculate the traffic billing result, and send the traffic billing result to the cloud server, so that the cloud server deducts the traffic fee according to the traffic billing result and the payment account corresponding to the user.

[0054] In the specific implementation process, after receiving the exit palm features collected by the palm feature collection device set in the exit ticket inspection device, the local server can match the exit palm features with the entry palm features collected by the palm feature collection device set in the entry ticket inspection device. Specifically, after receiving the entry palm features collected by the palm feature collection device set in the entry ticket inspection device, the local server can store the entry palm features in the entry palm feature set or in the local database. When a user exits the station and the exit palm features of the exit user are collected, the collected exit palm features can be compared with the data in the entry palm feature set or in the local database. If the exit palm features are the same as a certain entry palm feature in the entry palm feature set or in the local database, it can be considered that the match is successful, that is, the exit user enters the station normally through ticket inspection. At this time, it can be considered that the user has passed the ticket inspection, and the exit ticket inspection device can be controlled to open the gate to allow the user to exit the station.

[0055] In addition, the local server can also perform traffic billing based on the station where the user enters and exits, calculate the traffic billing result corresponding to the user's riding section, and send the traffic billing result to the cloud server. The cloud server in the embodiment of this specification has a certain payment processing function. When the cloud server identifies the user, it can obtain user information, which may include the user's payment account. After receiving the traffic billing result uploaded by the local server, it can deduct traffic fees based on the traffic billing result and the payment account, such as deducting the amount corresponding to the traffic billing result from the user's payment account. After the billing is successful, the cloud server can return a prompt message of successful deduction to the local server and the user's client so that the local server and the user can check.

[0056] In addition, in some scenario examples, users may have purchased tickets for public transportation in advance and do not need to be charged. At this time, the cloud server can check and review the tickets. The itinerary ticket may include the departure address and destination address. When entering the station, the cloud server can obtain user information based on the collected user palm features, and then obtain the itinerary ticket purchased by the user, and compare whether the departure point of the itinerary ticket is the address where the ticket checking device is located. If so, the identity recognition is successful. When leaving the station, the local server can send the exit information to the cloud server after matching the exit palm features. The cloud server obtains user information based on the exit palm features uploaded by the local server, and then obtains the itinerary ticket purchased by the user, and checks and reviews the user to confirm whether the arrival address of the itinerary ticket is the address where the ticket checking device is located. If so, the ticket checking review information is returned to the local server, and the local server controls the exit ticket checking device to open the gate so that the user can exit the station.

[0057] The ticket checking processing method for public transportation provided in the embodiment of this specification can identify the user's identity by collecting the user's palm features, so as to quickly check the user entering the public transportation, and when leaving the station, by matching the user's palm features, the user can quickly check the ticket for exiting the station. The whole process does not require the user to carry other equipment, the operation is simple, the recognition speed is fast, and the ticket checking efficiency of public transportation is improved. In addition, by collecting palm features, it is possible to avoid problems with face recognition caused by twins, similar faces or makeup, which in turn affects the ticket checking efficiency. In addition, collecting palm features does not require the user to take off the clothes they are wearing, which is convenient for operation. At the same time, based on the user's identity recognition results, the user's payment account can be obtained to realize online billing for the user's riding of public transportation, without the user having to buy tickets or scan codes, and without worrying about client failures, which improves the user's travel efficiency.

[0058] In some embodiments of this specification, when receiving the palm features of the user collected by the palm feature collection device provided in the ticket inspection device when the user enters the station, the method further includes:

[0059] Receive the facial image features of the user collected by the facial image acquisition device set in the ticket inspection device for entering the station, and bind the facial image features with the palm features for entering the station, and upload the bound facial image features and the palm features for entering the station to the cloud server, so that the cloud server can identify the identity of the user entering the station based on the facial image features and the palm features for entering the station.

[0060] In the specific implementation process, many platforms currently use facial image features for real-name authentication. In some embodiments of this specification, a facial image acquisition device can be set in the station entrance ticket checking device. Figure 3 This is a schematic diagram of the structure of the main view of a public transportation vehicle entrance ticket inspection device in a scenario example of this specification, such as Figure 3 As shown, the facial image acquisition device can be set above the gate arm of the ticket inspection device and connected to the server through a network cable. When the user enters the station through the ticket inspection device, he can align his face with the facial image acquisition device according to the prompt, and at the same time, place his palm above the palm feature acquisition device to enter the facial image features and the palm features of entering the station. After the facial image acquisition device collects the facial image features, it can upload the collected features to the local server. Similarly, after the palm feature acquisition device collects the palm features of entering the station, it can also upload them to the local server. After the local server receives the facial image features and the palm features of entering the station, it can bind the facial image features and the palm features of entering the station, and upload the bound facial image features and palm features of entering the station to the cloud server. The cloud server can then identify the user entering the station based on the facial image features and the palm features of entering the station.

[0061] The cloud server can first detect whether there is a matching user between the two biometric information in the public transportation user information database. If not, the cloud server will obtain the user information that matches the facial image features based on the cloud real-name authentication database, and bind the two biometric information to the user information that matches the facial image features. If it is detected that the information bound to the two biometric information is inconsistent, that is, the same palm feature corresponds to different faces, it is determined to be a similar face, twins or plastic surgery face, and the user information bound to the palm feature can be used as the basis, and after notifying manual review, the information in the database is updated. If it is detected that the two biometric information matches the same user, the identity authentication is completed directly.

[0062] The embodiments of this specification combine facial image features and palm features to perform user identity recognition, utilize the real-name authentication function of the cloud server to quickly obtain user information, and then combine it with the user's palm features to avoid identity recognition errors or identity recognition failures due to similar faces, twins or plastic surgery faces, thereby improving the accuracy of identity recognition and further improving the accuracy of ticket checking.

[0063] In some scenario examples of this specification, the receiving of the facial image features of the user collected by the facial image collection device provided in the station entrance ticket inspection device includes:

[0064] After receiving the identity recognition failure information returned by the cloud server based on the palm features of the entry hand, the prompt information of collecting facial features is returned to the entry ticket inspection device;

[0065] Receive the user's facial image features collected by the facial image collection device set in the station entry ticket checking device.

[0066] In the specific implementation process, many platforms currently use facial image features for real-name authentication. If only palm features such as palm vein features are collected, the user's identity may not be identified. In some embodiments of this specification, the user's facial image features and palm features can be entered at the same time when the user enters the station for the first time, and the user information is bound. For example, when the user enters the palm features of the station through the palm feature collection device in the station ticket inspection device, and the local server uploads it to the cloud server for identity recognition, the cloud server does not query the user information corresponding to the station palm features, that is, the user identity recognition fails, which means that the user is taking the public transportation for the first time and has not entered the palm features and facial features. At this time, the cloud server can send a prompt message of identity recognition failure to the local server. After the local server receives the prompt message of identity recognition failure, it can return a prompt message that facial features need to be collected to the station ticket inspection device. At this time, the station ticket inspection device can prompt the user to enter facial features through voice or text, and the user can enter his own facial image features through the facial image feature collection device of the station ticket inspection device according to the prompt. After the local server receives the user's facial image features collected by the facial image acquisition device in the ticket inspection device at the station, it can bind the facial image features and the palm features of the person entering the station and send them to the cloud server. The cloud server can then identify the user based only on the facial image features, and bind the identified user information with the user's palm features of the person entering the station. Later, when the user enters the station, he or she only needs to enter the palm features, which speeds up data processing efficiency and improves the speed of entry.

[0067] The embodiments of this specification can bind the user's palm features for entering the station with the user information by recording the facial image features when the user enters the station for the first time. When checking tickets at the station later, only the palm features need to be recorded, which reduces the amount of data processing, speeds up data processing efficiency, and improves the speed of entering the station.

[0068] In some embodiments of this specification, a temperature detection module is provided in the palm feature collection device provided in the station entry ticket inspection device, and the method further includes:

[0069] Receiving the palm temperature of the user collected by the temperature detection module when the palm feature collection device provided in the station entry ticket inspection device collects the palm features of the user when the user enters the station;

[0070] Compare the palm temperature with a preset temperature threshold, and if the palm temperature is less than the preset temperature threshold, control the station entry ticket inspection device to open the gate after receiving the identity recognition success information returned by the cloud server;

[0071] If the palm temperature is greater than the preset temperature threshold, temperature abnormality information is returned to the station entry ticket checking device.

[0072] In the specific implementation process, in some special scenarios, it may be necessary to conduct health checks on users riding public transportation. In the embodiments of this specification, a temperature detection module can be set in the station entrance ticket inspection device, and the temperature detection module can be integrated in the palm feature collection device in the station entrance ticket inspection device. When the user enters the station through the station entrance ticket inspection device, the palm is placed on the palm feature collection device. When entering the station palm feature, the set temperature detection module can be used to collect the user's palm temperature at the same time. The local server can compare the collected palm temperature with the preset temperature threshold. If the palm temperature is less than the preset threshold, it is considered that the user's body temperature is fine, and a request for identity recognition can be sent to the cloud server. After the cloud server returns the identity recognition success information, the station entrance ticket inspection device can be controlled to open the gate to allow the user to enter the station. If the collected palm temperature is greater than the preset temperature threshold, the temperature abnormality information can be returned to the station entrance ticket inspection device, prompting the service personnel of the public transportation to handle it in time.

[0073] The embodiments of this specification collect the user's palm temperature while the user enters the palm features at the station, conduct a preliminary health check on the user, and improve the safety of riding in public transportation. During periods of high incidence of infectious diseases, the health of users entering the station can be checked at the same time as ticket checking, and the speed of ticket checking at the station in special circumstances can be improved.

[0074] In some embodiments of this specification, the method further includes:

[0075] Receive the deduction success prompt information returned by the cloud server, and delete the user information of the deduction user, wherein the user information includes: palm features for entering the station and palm features for leaving the station.

[0076] In the specific implementation process, after the cloud server successfully deducts the money based on the billing result, it returns a successful deduction prompt message to the local server. After receiving the successful deduction prompt message, the local server can delete the user information of the deduction user stored locally, so that only the user information after entering the station is saved in the local server, thereby speeding up the matching speed of subsequent exit users and improving ticket checking efficiency. Among them, the deleted user information may include the user's palm features when entering the station, the palm features when leaving the station, and may also include facial image features and temperature, etc., which can be determined according to the actual scenario.

[0077] In some embodiments of this specification, the received inbound palm features and outbound palm features are sent after the palm feature acquisition device uses directional filtering technology to extract features from the collected palm images, wherein the method of extracting features from the collected palm images using directional filtering technology includes:

[0078] Use a specified number of directional filters to calculate the enhanced pixel grayscale value of each pixel in the collected palm image;

[0079] The minimum value of the enhanced pixel grayscale value of each pixel point is obtained as the target grayscale value, and the target grayscale value is adjusted to a specified value range to obtain the features corresponding to each pixel point;

[0080] The method for calculating the enhanced pixel grayscale value of each pixel in the collected palm image by each directional filter includes:

[0081] Calculate the difference between the sum of the denoising grayscale values ​​of each pixel in the collected palm image that is one pixel apart in the vertical direction and the denoising grayscale value of the current pixel to obtain the denoising grayscale value of each pixel;

[0082] The average value of the denoised grayscale values ​​of two adjacent pixels is taken as the grayscale value of the enhanced pixel of the two adjacent pixels.

[0083] In a specific implementation process, the palm feature acquisition device in the embodiment of this specification can use the directional filtering technology to extract features from the collected palm image, obtain the incoming palm features and the outgoing palm features, and send the incoming palm features and the outgoing palm features to the local server, wherein the specific process of the directional filtering processing can be referred to as follows:

[0084] When using a directional filter, 8 or 16 5×5 filters can be used to extract multi-directional vein directions, that is, a specified number of directional filters are used to calculate the enhanced pixel grayscale value of each pixel in the collected palm image. The following formula can be used to calculate the enhanced pixel grayscale value of each pixel:

[0085] I e1 (i,j)=I o1 (i,j-2)+I o1 (i,j+2)-I o1 (i,j)

[0086] I e2 (i,j)=I o2 (i,j-2)+I o2 (i,j+2)-I o2 (i,j)

[0087] I e (i,j)=[I e1 (i,j)+I e2 (i,j)] / 2

[0088] Among them, I e1 (i, j) and I e2 (i, j) can represent the denoised grayscale value of two adjacent pixels, i represents the horizontal direction, j represents the vertical direction, (i, j) represents the coordinates of the pixel, I(i, j) represents the grayscale value of the pixel, and the grayscale value after denoising is I o (i,j),I e (i, j) represents the enhanced pixel grayscale value of two adjacent pixels. The above formula can be used to calculate the enhanced pixel grayscale value of two adjacent pixels in this direction using a directional filter. The same method can be used to calculate the enhanced pixel grayscale value of each pixel in other directions. The minimum value in each direction is selected as the target grayscale value, and the target grayscale value is adjusted and then specified in the value range to obtain the features corresponding to each pixel, and then the palm features are obtained. For example: take the minimum value of the enhanced pixel grayscale value corresponding to 8 or 16 directional filters, and adjust the enhanced image grayscale value to [0,255], as follows:

[0089]

[0090]

[0091] In the above formula, I' e (i, j) represents the target grayscale value of pixel (i, j), k represents the total number of directional filters, I f (i, j) represents the value after adjusting the target grayscale value.

[0092] Palm feature collection equipment is used to collect and extract palm features, identify the user's palm features, and send the identified palm features to the local server. Compared with transmitting the collected image data, the amount of data transmission is reduced. In addition, the collected biometric information is sent after extraction, avoiding the leakage of user information.

[0093] The embodiments of this specification use directional filtering to extract palm features, which can reduce interference from factors such as human posture and palm lines, improve the accuracy of palm feature extraction, and further improve the accuracy of identity recognition and ticket checking efficiency.

[0094] In addition, Gabor filtering may be used to enhance features and reduce interference. The specific selection may be made according to actual needs and is not specifically limited in the embodiments of this specification.

[0095] Figure 4 FIG. 1 is a flow chart of a method for processing ticket inspection for public transportation in another embodiment of the present specification. Figure 4 As shown, the embodiment of this specification can also provide a ticket checking processing method applied to a cloud server, such as Figure 4 As shown, the process of ticket checking by the cloud server may include:

[0096] Step 402: receiving the palm features of the user entering the station uploaded by the local server corresponding to the public transportation means when the user enters the station, wherein the palm features of the user entering the station are collected by the palm feature collection device provided in the ticket inspection device when the user enters the station;

[0097] Step 404: Match the palm feature of the station entry with the user identity database. If the match is successful, obtain the payment account corresponding to the palm feature of the station entry;

[0098] Step 406: after the match is successful, return the identity recognition success information to the local server, so that the local server controls the station entrance ticket inspection device to open the gate;

[0099] Step 408: Receive the user's traffic billing result sent by the local server after the user exits the station, and deduct a corresponding amount from the payment account according to the traffic billing result.

[0100] In the specific implementation process, the cloud server can be understood as a server that stores a lot of user identity information, which can generally be a platform or server with payment capabilities. The cloud server can have a database, which can store the palm features of different users and the corresponding user information such as user name, payment account, etc. When a user takes public transportation, he first passes through the station ticket inspection device for station ticket inspection. When passing through the station ticket inspection device, the user can place his palm at the palm feature collection device set in the station ticket inspection device according to the prompt. The palm feature collection device can collect the station palm features of the station user and send the collected station palm features to the local server. After the local server receives the station palm features collected by the palm feature collection device, it can send the received station palm features to the cloud server. The cloud server can match the received station palm features with the data in the user identity database (i.e., the database storing user information), query whether there is a station palm feature in the user identity database, and if so, obtain the user information corresponding to the station palm feature, and the user information can include the user's payment account. When the cloud server queries the user information corresponding to the palm features sent by the local server, it can be considered that the identity recognition of the user entering the station has passed, and the identity recognition success information can be returned to the local server. After the local server receives the identity recognition success information returned by the cloud server, it can control the station ticket inspection device to open the gate to allow the user to enter, and realize fast and automatic ticket inspection for users entering the station. Users do not need to carry any hardware equipment, the operation is simple, the recognition speed is fast, and in special scenarios such as: infectious disease outbreak seasons, users wearing masks when traveling, users do not need to take off their masks when entering public transportation, and the user's identity can be quickly recognized, ensuring the safety of the user.

[0101] When a user arrives at the terminal station by public transportation, he can go through the exit ticket inspection device to check in and exit. When passing through the exit ticket inspection device, the user can place his palm on the palm feature collection device in the exit ticket inspection device according to the prompt. The palm feature collection device can collect the exit palm features of the exiting user and upload the collected exit palm features to the local server. After receiving the exit palm features collected by the palm feature collection device set in the exit ticket inspection device, the local server can match the exit palm features with the entry palm features collected by the palm feature collection device set in the entry ticket inspection device, and after the match is successful, control the exit ticket inspection device to open the gate so that the user can exit. After the user exits the station, the local server can also perform traffic billing based on the station where the user enters and exits, calculate the traffic billing result corresponding to the user's riding section, and send the traffic billing result to the cloud server. After receiving the traffic billing results uploaded by the local server, the cloud server can deduct traffic fees based on the traffic billing results and the payment account, such as deducting the amount corresponding to the traffic billing results from the user's payment account, or sending the billing results to the user's terminal and deducting money after the user confirms. After the billing is successful, the cloud server can return a prompt message of successful deduction to the local server and the user's client so that the local server and the user can check.

[0102] The ticket checking processing method for public transportation provided in the embodiment of this specification can identify the user's identity by collecting the user's palm features, so as to quickly check the user entering the public transportation, and when leaving the station, by matching the user's palm features, the user can quickly check the ticket for exiting the station. The whole process does not require the user to carry other equipment, the operation is simple, the recognition speed is fast, and the ticket checking efficiency of public transportation is improved. In addition, by collecting palm features, it is possible to avoid problems with face recognition caused by twins, similar faces or makeup, which in turn affects the ticket checking efficiency. In addition, collecting palm features does not require the user to take off the clothes they are wearing, which is convenient for operation. At the same time, based on the user's identity recognition results, the user's payment account can be obtained to realize online billing for the user's riding of public transportation, without the user having to buy tickets or scan codes, and without worrying about client failures, which improves the user's travel efficiency.

[0103] In some embodiments of this specification, the method may further include:

[0104] Receiving mutually bound palm features and facial image features uploaded by the local server, wherein the facial image features are collected by a facial image acquisition device provided in the station entry ticket inspection device when the user enters the station;

[0105] The facial image features and the palm features of the entry hand are matched with a user identity database.

[0106] In the specific implementation process, many platforms currently use facial image features for real-name authentication. In some embodiments of this specification, a facial image acquisition device can be set in the ticket inspection device for entering the station. When the user passes through the ticket inspection device to enter the station, he can align his face with the facial image acquisition device according to the prompt, and at the same time, place his palm on the top of the palm feature acquisition device to enter the facial image features and the palm features of entering the station. After the local server receives the facial image features and the palm features of entering the station, it can bind the facial image features and the palm features of entering the station, and upload the bound facial image features and palm features of entering the station to the cloud server. The cloud server can then identify the user entering the station based on the facial image features and the palm features of entering the station.

[0107] In some embodiments of this specification, matching the facial image features and the palm features of the entry hand with the user identity database includes:

[0108] The facial image features and the palm features for entering the station are matched with the user identity database. If neither the facial image features nor the palm features for entering the station are matched to the corresponding user, the payment account corresponding to the facial image features is queried in the payment account database based on the facial image features, and the facial image features and the palm features for entering the station are bound to the payment account and stored in the user identity database.

[0109] In the specific implementation process, the cloud server can first detect whether there is a matching user in the two biometric information of facial image features and palm features for entering the station in the public transportation user information database. If neither of the two biometric information matches the user, it can be considered that the user is using the public transportation for the first time, and the user information matching the facial image features can be obtained based on the cloud real-name authentication database, and the two biometric information can be bound to the user information matching the facial image features. The real-name authentication database in the cloud server in the embodiment of this specification can be understood as a user identity database, which can store multiple user information that has undergone real-name authentication. Generally, real-name authentication uses face recognition, that is, the user's facial image features are bound to the user's identity information and account information.

[0110] In some scenario examples of this specification, matching the facial image features and the palm features of the entry hand with the user identity database includes:

[0111] The facial image features and the palm features for entering the station are matched with a user identity database. If the facial image features and the palm features for entering the station are matched to different users, the user matched with the palm features for entering the station shall prevail, and a review shall be notified. After the review is passed, the facial image features and the user matched with the palm features for entering the station shall be bound and the user identity database shall be updated.

[0112] In the specific implementation process, when the cloud server matches the two biometric information of facial image features and palm features with the user information in the database, if it detects that the information bound to the two biometric information is inconsistent, that is, the same palm features correspond to different faces, it will be determined as a similar face, twins or plastic surgery face, and the user information bound to the palm features can be used as the basis, and after notifying manual review, the information in the database will be updated. If it is detected that the two biometric information matches the same user, the identity authentication is completed directly.

[0113] The embodiments of this specification combine facial image features and palm features to perform user identity recognition, utilize the real-name authentication function of the cloud server to quickly obtain user information, and then combine it with the user's palm features to avoid identity recognition errors or identity recognition failures due to similar faces, twins or plastic surgery faces, thereby improving the accuracy of identity recognition and further improving the accuracy of ticket checking.

[0114] In some scenario examples of this specification, the receiving of mutually bound inbound palm features and facial image features uploaded by the local server includes:

[0115] If the palm feature of the entry user is matched with the user identity database and the match fails, the identity recognition failure information is returned to the local server, so that the local server controls the entry ticket inspection device to collect the facial image features of the entry user;

[0116] Receive the mutually bound inbound palm features and facial image features uploaded by the local server, and match the facial image features with the user identity database.

[0117] In the specific implementation process, many platforms currently use facial image features for real-name authentication. If only palm features such as palm vein features are collected, the user's identity may not be identified. When the user enters the palm features of the station through the palm feature collection device in the station ticket inspection device, and the local server uploads it to the cloud server for identity recognition, the cloud server does not query the user information corresponding to the palm features of the station, that is, the user's identity recognition fails, which means that the user is taking the public transportation for the first time and has not entered the palm features and facial features. At this time, the cloud server can send a prompt message of identity recognition failure to the local server. After receiving the prompt message of identity recognition failure, the local server can return a prompt message that facial features need to be collected to the station ticket inspection device. At this time, the station ticket inspection device can prompt the user to enter facial features through voice or text, and the user can enter his own facial image features through the facial image feature collection device of the station ticket inspection device according to the prompt. After the local server receives the user's facial image features collected by the facial image acquisition device in the ticket inspection device at the station, it can bind the facial image features and the palm features of the person entering the station and send them to the cloud server. The cloud server can then identify the user based only on the facial image features, and bind the identified user information with the user's palm features of the person entering the station. Later, when the user enters the station, he or she only needs to enter the palm features, which speeds up data processing efficiency and improves the speed of entry.

[0118] The embodiments of this specification can bind the user's palm features for entering the station with the user information by recording the facial image features when the user enters the station for the first time. When checking tickets at the station later, only the palm features need to be recorded, which reduces the amount of data processing, speeds up data processing efficiency, and improves the speed of entering the station.

[0119] The following takes the subway as a public transportation tool and the palm vein as a palm feature as an example to specifically introduce the process of ticket checking for public transportation tools in the embodiments of this specification:

[0120] The embodiments of this specification propose a multimodal identity recognition system and method applied to a subway ticket checking system, wherein the ticket checking system includes: a channel gate, a face scanning device (i.e., a face image acquisition device), a palm vein recognition module (i.e., a palm feature acquisition device), an infrared temperature measurement module (i.e., a temperature detection module), a server, and an instruction sign. The face scanning device is placed above the gate arm of the entry channel gate and is connected to the server via a network cable. The palm vein recognition module is built into the entrance end of the gate arm for entry and exit, and a hand-shaped window is made on the top, which is connected to the server via USB or a network cable. The infrared temperature measurement module is placed next to the palm vein module and is connected to the server via USB. The instruction sign stands in a conspicuous place above the gate arm to prompt and inform users of the collection and recognition of face scanning and palm vein information.

[0121] The ticket checking system includes two parts: entry and exit. The entry system consists of a gate, a face recognition device, a palm vein recognition and a temperature measurement module, and the exit system consists of a gate and a palm vein recognition module. The ticket checking method may include the following steps:

[0122] 1) When the user passes through the gate entrance, he / she extends his / her palm according to the prompt, and the palm vein recognition module and infrared temperature measurement module collect the palm vein information and palm temperature, and the face image information is collected through the face scanning device.

[0123] 2) Detect whether the palm temperature collected by the temperature measurement module is within the normal palm temperature threshold range of the human body. If it is within the threshold range, proceed to the next step of identification; otherwise, the user is judged to be at risk of disease and manual disease control is triggered.

[0124] 3) Confirm that the user's palm vein feature and facial feature information are collected correctly, and bind the two feature information, store them in the local server, and upload them to the cloud server from the local server.

[0125] 4) After the facial recognition device confirms the user's payment account through facial feature information, the gate opens.

[0126] 5) When the user passes through the gate exit, he / she extends his / her palm and the palm vein recognition module obtains the palm vein features.

[0127] 6) The palm vein features collected in step 5) are compared with the users in the local server. If the corresponding palm vein information is matched, the gate is opened for passage; if the match fails, a manual review is triggered.

[0128] 7) The local server calculates the fare based on the entry and exit information, and sends the amount information to the face recognition device or cloud server to realize transportation billing deduction.

[0129] 8) After the deduction is successful, the user information in the local server is deleted, so that only the user information after entering the station is saved in the local server, which speeds up the matching speed when leaving the station.

[0130] Among them, in step 1), if the user is not using it for the first time, the cloud server database already has the user's palm vein feature information and face information and is bound to the corresponding payment account. When entering the station, palm vein authentication can also be used directly without face scanning. Since palm vein recognition is faster than face recognition and users do not need to take off masks, glasses, etc., the ticket inspection speed is further improved.

[0131] The multimodal identity recognition method includes:

[0132] The local server first reads the palm temperature value collected by the temperature sensor and compares it with the palm temperature threshold (37.3℃). If the collected temperature is higher than the threshold, the user is judged to be at risk of disease and manual disease control is triggered; if the temperature is lower than the threshold, the user is judged to be normal and identity recognition is entered.

[0133] During the identity recognition process, the vein recognition module collects palm vein images and completes feature extraction, the face recognition device collects facial images and extracts facial feature information, and the local server reads the palm vein and facial feature information respectively. When the local server only reads the palm vein information, it needs to upload the information to the cloud server, which compares the palm vein information with the users in the database. If the corresponding user is matched, the identity recognition is successful; if the corresponding user is not matched, the face recognition device prompts the user to enter the facial information.

[0134] When entering the station, when the local server reads the palm vein and facial feature information, it binds the two types of biometric information of the user and uploads them to the cloud server in combination with the station information. At this time, the station gate opens and releases. The cloud server first detects whether there is a matching user for the two types of biometric information. If not, it binds the two types of biometric information to the payment account that matches the face; if it detects that the binding information is inconsistent with the input information, that is, the same palm vein corresponds to different faces, it is determined to be a similar face, twins or plastic surgery face, and the payment account bound to the palm vein is used as the basis, and after notifying manual review, the information in the database is updated; if the user is matched, the identity authentication is completed.

[0135] When exiting the station, when the local server reads the palm vein feature information, it compares the information with the data in the local server. If it matches the corresponding user, the gate will open and the local server will calculate the user's riding range and amount, and use the cloud server to complete the deduction. After the deduction is successful, the user information is deleted in the local server; if the local server does not match the corresponding user, it will notify manual review.

[0136] The solution provided by the embodiment of this specification includes two parts: entering the station and exiting the station. This method describes in detail the judgment logic and judgment criteria of various modes in the ticket checking process, and guarantees the recognition accuracy and recognition rate to the greatest extent. In addition, a biometric recognition technology combining palm vein and face recognition is adopted. When entering the station for the first time, the palm vein information is entered and bound to the face recognition result. When exiting the station, only the palm vein or face needs to be recognized. When the user takes the subway again, he can directly wave his hand for palm vein recognition without taking off the mask or glasses, which greatly improves the ticket checking efficiency. For similar faces, twins, plastic surgery or heavy makeup, etc., where the face is prone to misjudgment, the palm vein can be used as a feature for identification, which expands the scope of application of the system. During the high incidence of infectious diseases, this solution adds an infrared temperature measurement module to measure the temperature of the human palm while identifying the palm vein, which can be used as a preliminary screening for disease detection. Compared with the secondary temperature measurement in the existing subway, the ticket checking efficiency is further improved and the passage speed is accelerated. Compared with the palm vein access control system, this solution can not only perform identity recognition, but also bind the palm vein information with the face information to realize payment and deduction operations. When this solution is applied, there is no need for a separate palm vein entry operation. Instead, the entry and binding operation with the face information are completed when the user enters the station for the first time to check the ticket, which solves the problem of difficult entry and poor user experience in the access control recognition system.

[0137] In this specification, each embodiment of the above method is described in a progressive manner, and the same or similar parts between the embodiments can be referenced to each other, and each embodiment focuses on the differences from other embodiments. For relevant parts, refer to the partial description of the method embodiment.

[0138] Based on the above-mentioned ticket inspection processing method for public transportation, one or more embodiments of this specification also provide a device for ticket inspection processing for public transportation. The device may include a device (including a distributed system), software (application), module, plug-in, server, client, etc. using the method described in the embodiment of this specification and a device combined with necessary implementation hardware. Based on the same innovative concept, the device in one or more embodiments provided in the embodiment of this specification is as described in the following embodiments. Since the implementation scheme and method of the device to solve the problem are similar, the implementation of the specific device in the embodiment of this specification can refer to the implementation of the aforementioned method, and the repetitions will not be repeated. As used below, the term "unit" or "module" can implement a combination of software and / or hardware of predetermined functions. Although the device described in the following embodiments is preferably implemented in software, the implementation of hardware, or a combination of software and hardware is also possible and conceived.

[0139] Specifically, Figure 5 Schematic diagram of the module structure of an embodiment of a ticket checking and processing device for public transportation provided in this specification, such as Figure 5As shown, the device can be applied to the local server of the public transportation vehicle described above. The ticket checking processing device for public transportation vehicle provided in this specification may include:

[0140] The station entry information collection module 51 is used to receive the station entry palm features of the user collected by the palm feature collection device set in the station entry ticket inspection device when the user enters the station, and send the station entry palm features to the cloud server, so that the cloud server can identify the station entry user based on the station entry palm features;

[0141] The station entrance ticket inspection module 52 is used to control the station entrance ticket inspection device to open the gate after receiving the identity recognition success information returned by the cloud server;

[0142] The exit information collection module 53 is used to receive the user's exit palm features collected by the palm feature collection device set in the exit ticket inspection device when the user exits the station;

[0143] The exit ticket checking and billing module 54 is used to match the exit palm features with the entry palm features. If the match is successful, the exit ticket checking device is controlled to open the gate, and the traffic billing result is calculated, and the traffic billing result is sent to the cloud server, so that the cloud server deducts the traffic fee according to the traffic billing result and the payment account corresponding to the user.

[0144] Figure 6 FIG. 1 is a schematic diagram of a module structure of another embodiment of a ticket checking and processing device for public transportation provided in this specification. Figure 6 As shown, the device can be applied to the cloud server of the public transportation vehicle recorded above. The ticket checking processing device for public transportation vehicle provided in this specification may include:

[0145] The station entry information receiving module 61 is used to receive the station entry palm features uploaded by the local server corresponding to the public transportation when the user enters the station, and the station entry palm features are collected by the palm feature collection device set in the station entry ticket inspection device when the user enters the station;

[0146] The station entry identity recognition module 62 is used to match the station entry palm feature with the user identity database, and if the match is successful, obtain the payment account corresponding to the station entry palm feature;

[0147] The identity recognition result feedback module 63 is used to return the identity recognition success information to the local server after the match is successful, so that the local server controls the station entry ticket inspection device to open the gate;

[0148] The billing processing module 64 is used to receive the user's traffic billing result sent by the local server after the user leaves the station, and deduct the corresponding amount from the payment account according to the traffic billing result.

[0149] This specification embodiment

[0150] It should be noted that the above-mentioned device may also include other implementations according to the description of the corresponding method embodiment. The specific implementation methods can refer to the description of the corresponding method embodiment above, and will not be described one by one here.

[0151] The embodiment of the present specification also provides a ticket checking processing device for public transportation, comprising: at least one processor and a memory for storing processor executable instructions, wherein the processor executes the instructions to implement the ticket checking processing method for public transportation of the above embodiment, the method comprising:

[0152] Receive the palm features of the user collected by the palm feature collection device set in the ticket inspection device when the user enters the station, and send the palm features to the cloud server, so that the cloud server can identify the user based on the palm features;

[0153] After receiving the identity recognition success information returned by the cloud server, controlling the station entrance ticket inspection device to open the gate;

[0154] Receiving the user's exit palm features collected by the palm feature collection device provided in the exit ticket inspection device when the user exits the station;

[0155] The exit palm feature and the entry palm feature are matched. If the match is successful, the exit ticket checking device is controlled to open the gate, and the traffic billing result is calculated, and the traffic billing result is sent to the cloud server, so that the cloud server deducts the traffic fee according to the traffic billing result and the payment account corresponding to the user.

[0156] Or, receiving the palm features of the user entering the station uploaded by the local server corresponding to the public transportation means when the user enters the station, wherein the palm features of the user entering the station are collected by the palm feature collection device arranged in the ticket inspection device when the user enters the station;

[0157] Matching the palm feature of the station entry with the user identity database, and if the match is successful, obtaining the payment account corresponding to the palm feature of the station entry;

[0158] After the match is successful, the identity recognition success information is returned to the local server, so that the local server controls the station entrance ticket inspection device to open the gate;

[0159] Receive the user's traffic billing result sent by the local server after the user exits the station, and deduct a corresponding amount from the payment account according to the traffic billing result.

[0160] It should be noted that the above-mentioned device or system may also include other implementation modes according to the description of the method embodiment. The specific implementation modes may refer to the description of the relevant method embodiment, which will not be described one by one here.

[0161] Referring to the above-mentioned embodiments, the present specification provides a ticket checking processing system for public transportation, the system comprising:

[0162] An entry ticket inspection device, an exit ticket inspection device, a local server and a cloud server, wherein the entry ticket inspection device is provided with a palm feature collection device, and the exit ticket inspection device is provided with a palm feature collection device;

[0163] The palm feature collection device is used to collect the palm features of the user when the user enters and exits the station, and upload the collected palm features to the local server;

[0164] The local server is used to send the received palm features to the cloud server when the user enters the station, and the cloud server performs identity recognition on the user entering the station based on the received palm features; the local server controls the station ticket inspection device to open the gate after the cloud server successfully recognizes the identity of the user entering the station;

[0165] The local server is also used to match the received palm features with the palm features collected by the ticket inspection device when the user exits the station. After a successful match, the user's billing result is calculated and sent to the cloud server. The cloud server deducts transportation fees based on the billing result and the user's corresponding payment account.

[0166] In some embodiments, the station entry ticket checking device is further provided with a facial image acquisition device, which is used to acquire facial image features of the user when the user enters the station, and upload the acquired facial image features to the local server;

[0167] The local server sends the facial image features and the palm features received when the user enters the station to the cloud server, and the cloud server identifies the user entering the station based on the facial image features and the palm features.

[0168] In some embodiments, a temperature detection module is provided in the palm feature collection device in the station entry ticket checking device, and the temperature detection module is used to collect the user's entry temperature when the user enters the station, and upload the entry temperature to the local server.

[0169] In some embodiments, the palm feature acquisition device is specifically used to extract features from the collected palm image using directional filtering technology, and send the extracted palm features to the local server, wherein the method for extracting features from the collected palm image using directional filtering technology by the palm feature acquisition device includes:

[0170] Use a specified number of directional filters to calculate the enhanced pixel grayscale value of each pixel in the collected palm image;

[0171] The minimum value of the enhanced pixel grayscale value of each pixel point is obtained as the target grayscale value, and the target grayscale value is adjusted to a specified value range to obtain the features corresponding to each pixel point;

[0172] The method for calculating the enhanced pixel grayscale value of each pixel in the collected palm image by each directional filter includes:

[0173] Calculate the difference between the sum of the denoising grayscale values ​​of each pixel in the collected palm image that is one pixel apart in the vertical direction and the denoising grayscale value of the current pixel to obtain the denoising grayscale value of each pixel;

[0174] The average value of the denoised grayscale values ​​of two adjacent pixels is taken as the grayscale value of the enhanced pixel of the two adjacent pixels.

[0175] Among them, the specific use process of the entry ticket checking device, the exit ticket checking device, the local server and the cloud server, the palm feature acquisition device, the face image acquisition device and the temperature detection module can be referred to the records of the above embodiments and will not be repeated here.

[0176] The ticket inspection processing device, equipment and system for public transportation provided in this specification can also be used in a variety of data analysis and processing systems. The system or server or terminal or device can be a separate server, or it can include a server cluster, system (including distributed system), software (application), actual operation device, logic gate circuit device, quantum computer, etc. that uses one or more of the methods or one or more embodiments of the system or server or terminal or device of this specification and a terminal device combined with necessary implementation hardware. The detection system for checking the difference data may include at least one processor and a memory storing computer executable instructions, and the processor implements the steps of the method described in any one or more of the above embodiments when executing the instructions.

[0177] The method embodiments provided in the embodiments of this specification can be executed in a mobile terminal, a computer terminal, a server or a similar computing device. Taking running on a server as an example, Figure 71 is a hardware structure block diagram of a ticket checking processing server for public transportation in one embodiment of this specification. The computer terminal may be a ticket checking processing server for public transportation or a ticket checking processing device for public transportation in the above embodiment. Figure 7 The server 10 shown may include one or more (only one is shown in the figure) processors 100 (the processor 100 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA), a non-volatile memory 200 for storing data, and a transmission module 300 for communication functions. Those skilled in the art will understand that Figure 7 The structure shown is only for illustration and does not limit the structure of the above electronic device. Figure 7 More or fewer plug-ins shown in, for example, may also include other processing hardware, such as a database or multi-level cache, GPU, or have Figure 7 Different configurations shown.

[0178] The non-volatile memory 200 can be used to store software programs and modules of application software, such as the program instructions / modules corresponding to the ticket inspection processing method for public transportation in the embodiment of this specification. The processor 100 executes various functional applications and resource data updates by running the software programs and modules stored in the non-volatile memory 200. The non-volatile memory 200 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the non-volatile memory 200 may further include a memory remotely arranged relative to the processor 100, and these remote memories can be connected to the computer terminal via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0179] The transmission module 300 is used to receive or send data via a network. The specific example of the above network may include a wireless network provided by a communication provider of a computer terminal. In one example, the transmission module 300 includes a network adapter (Network Interface Controller, NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission module 300 can be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0180] The above is a description of a specific embodiment of the specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0181] The methods or devices described in the above embodiments provided in this specification can implement business logic through computer programs and record them on storage media, and the storage media can be read and executed by a computer to achieve the effects of the solutions described in the embodiments of this specification.

[0182] The storage medium may include a physical device for storing information, which is usually a medium that digitizes the information and then stores it in an electrical, magnetic or optical manner. The storage medium may include: a device that stores information in an electrical energy manner, such as various memories, such as RAM, ROM, etc.; a device that stores information in a magnetic energy manner, such as a hard disk, a floppy disk, a magnetic tape, a magnetic core memory, a magnetic bubble memory, a USB flash drive; a device that stores information in an optical manner, such as a CD or a DVD. Of course, there are other readable storage media, such as quantum memory, graphene memory, etc.

[0183] The above-mentioned ticket checking processing method or device for public transportation provided in the embodiments of this specification can be implemented by a processor in a computer executing corresponding program instructions, such as using the C++ language of the Windows operating system to implement it on a PC, a Linux system, or other systems such as Android and iOS system programming languages ​​to implement it on a smart terminal, as well as processing logic based on a quantum computer, etc.

[0184] The embodiments of this specification are not limited to complying with industry communication standards, standard computer resource data update and data storage rules, or the situations described in one or more embodiments of this specification. Certain industry standards or slightly modified implementation plans based on the implementation described in the custom method or embodiment can also achieve the same, equivalent or similar, or predictable implementation effects after deformation of the above-mentioned embodiments. The embodiments obtained by using these modified or deformed data acquisition, storage, judgment, processing methods, etc. can still fall within the scope of the optional implementation plans of the embodiments of this specification.

[0185] In the 1990s, improvements to a technology could be clearly distinguished as hardware improvements (for example, improvements to the circuit structure of diodes, transistors, switches, etc.) or software improvements (improvements to the method flow). However, with the development of technology, many improvements to the method flow today can be regarded as direct improvements to the hardware circuit structure. Designers almost always obtain the corresponding hardware circuit structure by programming the improved method flow into the hardware circuit. Therefore, it cannot be said that an improvement in a method flow cannot be implemented using a hardware entity module. For example, a programmable logic device (PLD) (such as a field programmable gate array (FPGA)) is such an integrated circuit whose logical function is determined by the user's programming of the device. Designers can "integrate" a digital system on a PLD by programming it themselves, without having to ask a chip manufacturer to design and produce a dedicated integrated circuit chip. Moreover, nowadays, instead of manually making integrated circuit chips, this kind of programming is mostly implemented by "logic compiler" software, which is similar to the software compiler used when developing and writing programs, and the original code before compilation must also be written in a specific programming language, which is called hardware description language (HDL). There is not only one HDL, but many kinds, such as ABEL (Advanced Boolean Expression Language), AHDL (Altera Hardware Description Language), Confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), Lava, Lola, MyHDL, PALASM, RHDL (Ruby Hardware Description Language), etc. The most commonly used ones are VHDL (Very-High-Speed ​​Integrated Circuit Hardware Description Language) and Verilog. Those skilled in the art should also know that it is only necessary to program the method flow slightly in the above-mentioned hardware description languages ​​and program it into the integrated circuit, and then it is easy to obtain the hardware circuit that implements the logic method flow.

[0186] The controller can be implemented in any appropriate manner, for example, the controller can take the form of a microprocessor or processor and a computer-readable medium storing a computer-readable program code (such as software or firmware) that can be executed by the (micro)processor, a logic gate, a switch, an application-specific integrated circuit (ASIC), a programmable logic controller, and an embedded microcontroller. Examples of controllers include, but are not limited to, the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20, and Silicone Labs C8051F320. The memory controller can also be implemented as part of the control logic of the memory. Those skilled in the art also know that in addition to implementing the controller in a purely computer-readable program code manner, the controller can be implemented in the form of a logic gate, a switch, an application-specific integrated circuit, a programmable logic controller, and an embedded microcontroller by logically programming the method steps. Therefore, this controller can be considered as a hardware component, and the devices included therein for implementing various functions can also be regarded as structures within the hardware component. Or even, the devices for implementing various functions can be regarded as both software modules for implementing the method and structures within the hardware component.

[0187] For the convenience of description, the above platforms and terminals are described by dividing them into various modules according to their functions. Of course, when implementing one or more of the present specification, the functions of each module can be implemented in the same or more software and / or hardware, or the module implementing the same function can be implemented by a combination of multiple sub-modules or sub-units, etc. The device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or plug-ins can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0188] These computer program instructions may also be loaded onto a computer or other programmable resource data updating device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions executed on the computer or other programmable device for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0189] Each embodiment in this specification is described in a progressive manner, and the same and similar parts between the embodiments can be referenced to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can refer to the partial description of the method embodiment. In the description of this specification, the description of the reference term "one embodiment", "some embodiments", "example", "specific example", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of this specification. In this specification, the schematic representation of the above terms does not necessarily target the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art can combine and combine the different embodiments or examples described in this specification and the features of different embodiments or examples without contradiction.

[0190] The above description is only an example of one or more embodiments of the present specification and is not intended to limit one or more embodiments of the present specification. For those skilled in the art, one or more embodiments of the present specification may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present specification shall be included in the scope of the claims.

Claims

1. A ticket checking processing method for public transportation, applied to a local server of the public transportation, the method comprising: Receive the palm features of the user collected by the palm feature collection device set in the ticket inspection device when the user enters the station, and send the palm features to the cloud server, so that the cloud server can identify the user based on the palm features; After receiving the identity recognition success information returned by the cloud server, controlling the station entrance ticket inspection device to open the gate; Receiving the user's exit palm features collected by the palm feature collection device provided in the exit ticket inspection device when the user exits the station; Matching the exit palm feature with the entry palm feature, if the match is successful, controlling the exit ticket inspection device to open the gate, and calculating the traffic billing result, and sending the traffic billing result to the cloud server, so that the cloud server deducts the traffic fee according to the traffic billing result and the payment account corresponding to the user; The palm feature of the station entry is sent after the palm feature acquisition device extracts features from the collected palm image using the directional filtering technology. The method of extracting features from the collected palm image using the directional filtering technology includes: Use a specified number of directional filters to calculate the enhanced pixel grayscale value of each pixel in the collected palm image; The minimum value of the enhanced pixel grayscale value of each pixel point is obtained as the target grayscale value, and the target grayscale value is adjusted to a specified value range to obtain the features corresponding to each pixel point.

2. The method according to claim 1, when receiving the palm features of the user collected by the palm feature collection device provided in the ticket inspection device when the user enters the station, the method further comprises: Receive the facial image features of the user collected by the facial image acquisition device set in the ticket inspection device for entering the station, and bind the facial image features with the palm features for entering the station, and upload the bound facial image features and the palm features for entering the station to the cloud server, so that the cloud server can identify the identity of the user entering the station based on the facial image features and the palm features for entering the station.

3. The method according to claim 2, wherein the step of receiving the facial image features of the user collected by the facial image collection device provided in the station entrance ticket inspection device comprises: After receiving the identity recognition failure information returned by the cloud server based on the palm features of the entry hand, the prompt information of collecting facial features is returned to the entry ticket inspection device; Receive the user's facial image features collected by the facial image collection device set in the station entry ticket checking device.

4. The method according to claim 1, wherein a temperature detection module is provided in the palm feature collection device provided in the station entry ticket inspection device, and the method further comprises: Receiving the palm temperature of the user collected by the temperature detection module when the palm feature collection device provided in the station entry ticket inspection device collects the palm features of the user when the user enters the station; Compare the palm temperature with a preset temperature threshold, and if the palm temperature is less than the preset temperature threshold, control the station entry ticket inspection device to open the gate after receiving the identity recognition success information returned by the cloud server; If the palm temperature is greater than the preset temperature threshold, temperature abnormality information is returned to the station entry ticket checking device.

5. The method of claim 1, further comprising: Receive the deduction success prompt information returned by the cloud server, and delete the user information of the deduction user, wherein the user information includes: palm features for entering the station and palm features for leaving the station.

6. According to the method of claim 1, the palm feature collection device is any one of a palm print collection device, a fingerprint collection device, and a palm vein collection device, and accordingly, the inbound palm feature and the outbound palm feature are the user's palm print, fingerprint, or palm vein feature.

7. The method according to claim 1, wherein the received outbound palm features are sent after the palm feature acquisition device extracts features from the acquired palm image using the directional filtering technology. in, The method of calculating the enhanced pixel grayscale value of each pixel in the collected palm image by each directional filter includes: Calculate the difference between the sum of the denoising grayscale values ​​of each pixel in the collected palm image that is one pixel apart in the vertical direction and the denoising grayscale value of the current pixel to obtain the denoising grayscale value of each pixel; The average value of the denoised grayscale values ​​of two adjacent pixels is taken as the grayscale value of the enhanced pixel of the two adjacent pixels.

8. A ticket checking processing method for public transportation, applied to a cloud server corresponding to the public transportation, the method comprising: Receiving the palm features of the user entering the station uploaded by the local server corresponding to the public transportation vehicle when the user enters the station, wherein the palm features of the user entering the station are collected by the palm feature collection device set in the ticket inspection device when the user enters the station; Matching the palm feature of the station entry with the user identity database, and if the match is successful, obtaining the payment account corresponding to the palm feature of the station entry; After the match is successful, the identity recognition success information is returned to the local server, so that the local server controls the station entrance ticket inspection device to open the gate; receiving the user's traffic billing result sent by the local server after the user exits the station, and deducting a corresponding amount from the payment account according to the traffic billing result; The palm feature of the station entry is sent after the palm feature acquisition device extracts features from the collected palm image using the directional filtering technology. The method of extracting features from the collected palm image using the directional filtering technology includes: Use a specified number of directional filters to calculate the enhanced pixel grayscale value of each pixel in the collected palm image; The minimum value of the enhanced pixel grayscale value of each pixel point is obtained as the target grayscale value, and the target grayscale value is adjusted to a specified value range to obtain the features corresponding to each pixel point.

9. The method of claim 8, further comprising: Receiving mutually bound palm features and facial image features uploaded by the local server, wherein the facial image features are collected by a facial image acquisition device provided in the station entry ticket inspection device when the user enters the station; The facial image features and the palm features of the entry hand are matched with a user identity database.

10. The method according to claim 9, wherein the receiving the mutually bound inbound palm features and facial image features uploaded by the local server comprises: If the palm feature of the entry user is matched with the user identity database and the match fails, the identity recognition failure information is returned to the local server, so that the local server controls the entry ticket inspection device to collect the facial image features of the entry user; Receive the mutually bound inbound palm features and facial image features uploaded by the local server, and match the facial image features with the user identity database.

11. The method according to claim 9, wherein matching the facial image features and the palm features of the inbound hand with a user identity database comprises: The facial image features and the palm features for entering the station are matched with the user identity database. If neither the facial image features nor the palm features for entering the station are matched to the corresponding user, the payment account corresponding to the facial image features is queried in the payment account database based on the facial image features, and the facial image features and the palm features for entering the station are bound to the payment account and stored in the user identity database.

12. The method according to claim 9, wherein matching the facial image features and the palm features of the inbound hand with a user identity database comprises: The facial image features and the palm features for entering the station are matched with a user identity database. If the facial image features and the palm features for entering the station are matched to different users, the user matched with the palm features for entering the station shall prevail, and a review shall be notified. After the review is passed, the facial image features and the user matched with the palm features for entering the station shall be bound and the user identity database shall be updated.

13. A ticket checking processing device for public transportation, applied to a local server of the public transportation, the device comprising: The station entry information collection module is used to receive the station entry palm features of the user collected by the palm feature collection device set in the station entry ticket inspection device when the user enters the station, and send the station entry palm features to the cloud server, so that the cloud server can identify the station entry user based on the station entry palm features; The station entrance ticket inspection module is used to control the station entrance ticket inspection device to open the gate after receiving the identity recognition success information returned by the cloud server; The exit information collection module is used to receive the user's exit palm features collected by the palm feature collection device set in the exit ticket inspection device when the user exits the station; The outbound ticketing and billing module is used to match the outbound palm features with the inbound palm features. If the match is successful, the outbound ticketing device is controlled to open the gate, and the traffic billing result is calculated, and the traffic billing result is sent to the cloud server, so that the cloud server deducts the traffic fee according to the traffic billing result and the payment account corresponding to the user; The palm feature of the station entry is sent after the palm feature acquisition device extracts features from the collected palm image using the directional filtering technology. The method of extracting features from the collected palm image using the directional filtering technology includes: Use a specified number of directional filters to calculate the enhanced pixel grayscale value of each pixel in the collected palm image; The minimum value of the enhanced pixel grayscale value of each pixel point is obtained as the target grayscale value, and the target grayscale value is adjusted to a specified value range to obtain the features corresponding to each pixel point.

14. A ticket checking processing device for public transportation, applied to a cloud server corresponding to the public transportation, the device comprising: The station entry information receiving module is used to receive the station entry palm features uploaded by the local server corresponding to the public transportation vehicle when the user enters the station, and the station entry palm features are collected by the palm feature collection device set in the station entry ticket inspection device when the user enters the station; The station entry identity recognition module is used to match the station entry palm features with the user identity database, and if the match is successful, obtain the payment account corresponding to the station entry palm features; An identity recognition result feedback module is used to return identity recognition success information to the local server after the match is successful, so that the local server controls the station entry ticket inspection device to open the gate; A billing processing module, used for receiving the traffic billing result of the user sent by the local server after the user leaves the station, and deducting a corresponding amount from the payment account according to the traffic billing result; The palm feature of the station entry is sent after the palm feature acquisition device extracts features from the collected palm image using the directional filtering technology. The method of extracting features from the collected palm image using the directional filtering technology includes: Use a specified number of directional filters to calculate the enhanced pixel grayscale value of each pixel in the collected palm image; The minimum value of the enhanced pixel grayscale value of each pixel point is obtained as the target grayscale value, and the target grayscale value is adjusted to a specified value range to obtain the features corresponding to each pixel point.

15. A ticket checking and processing device for public transportation, comprising: At least one processor and a memory for storing processor-executable instructions, wherein when the processor executes the instructions, the method according to any one of claims 1 to 7 or any one of claims 8 to 12 is implemented.

16. A ticket processing system for public transportation, the system comprising: An entry ticket inspection device, an exit ticket inspection device, a local server and a cloud server, wherein the entry ticket inspection device is provided with a palm feature collection device, and the exit ticket inspection device is provided with a palm feature collection device; The palm feature collection device is used to collect the palm features of the user when the user enters and exits the station, and upload the collected palm features to the local server; The local server is used to send the received palm features to the cloud server when the user enters the station, and the cloud server performs identity recognition on the user entering the station based on the received palm features; the local server controls the station ticket inspection device to open the gate after the cloud server successfully recognizes the identity of the user entering the station; The local server is also used to match the received palm features with the palm features collected by the ticket inspection device when the user exits the station. After the match is successful, the user's billing result is calculated and sent to the cloud server, and the cloud server deducts the transportation fee based on the billing result and the payment account corresponding to the user; The palm feature of the station entry is sent after the palm feature acquisition device extracts features from the collected palm image using the directional filtering technology. The method of extracting features from the collected palm image using the directional filtering technology includes: Use a specified number of directional filters to calculate the enhanced pixel grayscale value of each pixel in the collected palm image; The minimum value of the enhanced pixel grayscale value of each pixel point is obtained as the target grayscale value, and the target grayscale value is adjusted to a specified value range to obtain the features corresponding to each pixel point.

17. The system according to claim 16, wherein the station ticket inspection device is further provided with a facial image acquisition device, the facial image acquisition device is used to acquire facial image features of the user when the user enters the station, and upload the acquired facial image features to the local server; The palm feature collection device in the station entry ticket checking device is provided with a temperature detection module, and the temperature detection module is used to collect the user's entry temperature when the user enters the station, and upload the entry temperature to the local server.

18. The system according to claim 16, wherein the palm feature acquisition device is specifically used to extract features from the acquired palm image using the directional filtering technology, and send the extracted palm features to the local server, in, The method of calculating the enhanced pixel grayscale value of each pixel in the collected palm image by each directional filter includes: Calculate the difference between the sum of the denoising grayscale values ​​of each pixel in the collected palm image that is one pixel apart in the vertical direction and the denoising grayscale value of the current pixel to obtain the denoising grayscale value of each pixel; The average value of the denoised grayscale values ​​of two adjacent pixels is taken as the grayscale value of the enhanced pixel of the two adjacent pixels.

Images