Method and device for displaying passenger taking record, medium and product

Abstract

The invention discloses a method, equipment, medium and product for displaying a passenger taking record, and relates to the technical field of image recognition and data analysis, and the method comprises the steps: firstly collecting the face information and posture information of a passenger; passenger information is calculated according to the face information and the posture information, and a passenger information recognition result is obtained; then collecting riding data of the passenger; transmitting the passenger information identification result to a passenger identification database, and transmitting the riding data to a riding record database; and in response to a user query operation, displaying data stored in the passenger identification database and the riding record database to a user. The accuracy of passenger identity recognition and the reliability of the system are improved, the efficiency and the flexibility of data management are also improved, and the technical problem of inaccurate passenger taking recognition calculation is solved.

Description

Technical Field

[0001] The present application relates to the technical field of image recognition and data analysis, and in particular to methods, devices, media and products for displaying passenger travel records. Background Art

[0002] With the rapid development of intelligent transportation systems, accurately recording and displaying passenger riding information has become a key factor in improving user experience and optimizing vehicle management. Especially in the scenario of multiple people sharing a vehicle, how to accurately identify passengers and record their riding behavior has become a technical challenge that needs to be solved. Therefore, developing a universal and efficient passenger riding record system has become an important research direction in the field of intelligent transportation.

[0003] Currently, most vehicle management systems rely mainly on on-board sensors and GPS positioning to record vehicle usage. Some more advanced systems have begun to try to use on-board cameras for passenger identification. These systems usually use a single facial recognition technology to identify the passenger and combine it with vehicle driving data to generate a ride record. This data is usually stored in the vehicle system or cloud server for vehicle managers to view and analyze.

[0004] However, this system based on a single recognition method has some limitations. First, relying solely on facial recognition technology is easily affected by factors such as light and angle, resulting in recognition errors or recognition failures. Second, existing systems are often designed for specific brands or models, lack universality, and it is difficult to share and compare data between different types of vehicles. In addition, most systems only provide vehicle-based data query methods, which cannot meet the needs of users to view their own riding records from a personal perspective. These problems limit the application potential of passenger riding record systems in improving user experience and supporting personalized services. Summary of the invention

[0005] The main purpose of this application is to provide a method, device, medium and product for displaying passenger ride records, aiming to solve the technical problem of inaccurate passenger ride identification calculation.

[0006] To achieve the above purpose, the present application proposes a method for displaying passenger riding records, the method for displaying passenger riding records comprising:

[0007] Collect passengers' facial and body information;

[0008] Calculate the passenger information based on the facial information and the body information to obtain a passenger information recognition result;

[0009] Collecting the passenger's riding data;

[0010] Transmitting the passenger information identification result to a passenger identification database, and transmitting the ride data to a ride record database;

[0011] In response to a user query operation, the data stored in the passenger identification database and the ride record database are displayed to the user.

[0012] In one embodiment, the step of collecting the passenger's facial information and body information specifically includes:

[0013] Collecting first face information and first body posture information of each door position through a plurality of image acquisition devices arranged at each door;

[0014] The second face information and the second body information of each seat position are collected by using a plurality of image acquisition devices arranged in front of each seat;

[0015] The facial information includes the first facial information and the second facial information, and the body information includes the first body information and the second body information.

[0016] In one embodiment, the step of calculating the passenger information based on the facial information and the body information to obtain the passenger information recognition result specifically includes:

[0017] Performing weighted calculation on the first face information and the second face information respectively to obtain face recognition results for each seat;

[0018] Performing weighted calculation on the first posture information and the second posture information respectively to obtain a posture recognition result for each seat;

[0019] The face recognition result and the body recognition result of the same seat are weightedly calculated to obtain the passenger information recognition result of each seat.

[0020] In one embodiment, the step of transmitting the passenger information identification result to a passenger identification database and transmitting the ride data to a ride record database comprises:

[0021] Comparing the passenger identification result of each seat with a preset reference value;

[0022] When the passenger identification result is greater than or equal to the reference value, determining the passenger identification result as a valid passenger identification result;

[0023] In one embodiment, the step of transmitting the passenger information identification result to a passenger identification database and transmitting the ride data to a ride record database specifically includes:

[0024] querying the passenger identification database whether there is a valid passenger identification result matching the valid passenger identification result;

[0025] When the valid passenger identification result matching the valid passenger identification result does not exist in the passenger identification database, an identity identification code is assigned to the valid passenger identification result, and a new combination of the valid passenger identification and the identity identification code is added to the passenger identification database, and a new ride record is updated in the ride record database based on the corresponding ride data;

[0026] The riding record in the riding record database is a combination of the identity identification code, the vehicle frame number and the riding data.

[0027] In one embodiment, the step of querying the passenger identification database whether there is a valid passenger identification result matching the valid passenger identification result, then includes:

[0028] When the valid passenger identification result matching the valid passenger identification result exists in the passenger identification database, the new riding record is updated in the riding record database based on the corresponding riding data.

[0029] In one embodiment, in response to a user query operation, the step of displaying the data stored in the passenger identification database and the ride record database to the user specifically includes:

[0030] Detect user query operations;

[0031] When the identity identification code input by the user query operation is detected, all the riding records related to the identity identification code in the riding record database are displayed to the user;

[0032] When the vehicle frame number input by the user's query operation is detected, all the riding records related to the vehicle frame number in the riding record database are displayed to the user.

[0033] In addition, to achieve the above-mentioned purpose, the present application also proposes a device for displaying passenger ride records, the device comprising: a memory, a processor, and a computer program stored on the memory and executable on the processor, the computer program being configured to implement the steps of the method for displaying passenger ride records as described above.

[0034] In addition, to achieve the above-mentioned purpose, the present application also proposes a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by the processor, the steps of the method for displaying passenger ride records as described above are implemented.

[0035] In addition, to achieve the above-mentioned purpose, the present application also provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, it implements the steps of the method for displaying passenger riding records as described above.

[0036] One or more technical solutions proposed in this application have at least the following technical effects:

[0037] The present application first collects the facial information and body information of the passenger; calculates the passenger information based on the facial information and the body information to obtain the passenger information recognition result; then collects the passenger's riding data; transmits the passenger information recognition result to the passenger identification database, and transmits the riding data to the riding record database; in response to the user's query operation, displays the data stored in the passenger identification database and the riding record database to the user.

[0038] Specifically, the workflow of this solution is as follows: First, the system collects the facial and body information of the passenger, which may be achieved through the camera or other sensors installed in the car. Then, the system uses the collected information to calculate the passenger information and obtain the passenger information recognition result, that is, to determine the identity of the passenger. At the same time, the system also collects the passenger's riding data, such as boarding time, getting off time, riding location, etc. Then, the system transmits the passenger information recognition result to a special passenger identification database for storage, and transmits the riding data to the riding record database for storage. Finally, when the user performs a query operation, the system extracts relevant information from the two databases and displays the complete riding record to the user.

[0039] In this application, since a multi-dimensional passenger identification method combining facial information and body information is adopted, the characteristic information of passengers can be captured more comprehensively, which effectively solves the problem that a single identification method (such as using only facial recognition) is easily affected by environmental factors and leads to identification errors or failures, thereby achieving more accurate and stable passenger identification. Since the system adopts a separate passenger identification database and a ride record database, a large amount of passenger and ride data can be managed and stored more effectively, effectively solving the problems of complex data management and low query efficiency, thereby achieving fast and efficient data retrieval and display. Since the system supports responding to user query operations and can integrate and display the information in the two databases, it can provide users with comprehensive and detailed ride record information, effectively solving the problems of isolated information and incomplete display in traditional systems, thereby achieving a richer and more valuable user experience. In addition, the design of this solution does not depend on a specific vehicle brand or model, so it has good versatility and scalability, effectively solving the problems of poor compatibility of traditional systems and difficulty in sharing data between different vehicles, thereby achieving unified management of ride records across models and brands. This innovative design not only improves the accuracy of passenger identification and the reliability of the system, but also improves the efficiency and flexibility of data management, providing users with more accurate and convenient ride record services. At the same time, this method also provides vehicle managers with more comprehensive and detailed passenger usage data, which helps to optimize vehicle management strategies and improve operational efficiency. In general, this solution effectively improves the performance and functions of the passenger ride record system through innovative technical means, and provides new ideas and solutions for the development of intelligent transportation systems. It solves the technical problem of inaccurate passenger ride identification calculation. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0041] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0042] Figure 1 A flowchart diagram of the first embodiment of the method for displaying passenger travel records in this application;

[0043] Figure 2 A flowchart diagram of Embodiment 2 of the method for displaying passenger travel records of this application;

[0044] Figure 3A flowchart diagram of Embodiment 3 of the method for displaying passenger travel records of this application;

[0045] Figure 4 A schematic diagram of the device structure of the hardware operating environment involved in the method for displaying passenger ride records in an embodiment of the present application.

[0046] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0047] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0048] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0049] It should be noted that the execution subject of this embodiment can be a computing service device with data processing, network communication and program running functions, such as a tablet computer, a personal computer, a mobile phone, etc., or an electronic device capable of realizing the above functions, etc. The following takes the passenger riding record system as an example to illustrate this embodiment and the following embodiments.

[0050] Based on this, the embodiment of the present application provides a method for displaying passenger travel records, referring to Figure 1 , Figure 1 This is a flow chart showing a first embodiment of a method for recording passengers' travel history in this application.

[0051] In this embodiment, the method for displaying passenger travel records includes steps S10 to S50:

[0052] Step S10, collecting the passenger's facial information and body information;

[0053] Among them, facial information refers to the facial feature data of passengers obtained through image acquisition equipment, which is used to represent the facial features of passengers. Body information refers to the body posture and movement characteristics of passengers, which refers to the spatial position and motion state data of various parts of the passenger's body obtained through sensors or image analysis. Passengers refer to individuals riding in vehicles, which may include drivers and passengers. Acquisition refers to the process of obtaining and recording information through specific equipment or methods.

[0054] This step is usually performed when the passenger enters the vehicle or moves in the vehicle. Specifically, when the passenger enters the vehicle, the passenger riding record system will automatically start through the camera or other sensors installed in the vehicle to capture the passenger's facial image and full-body image. The system will continuously monitor the in-vehicle environment and update the passenger's facial and body information in real time. For facial information, the system will focus on capturing key facial feature points, such as the corners of the eyes, the tip of the nose, the corners of the mouth, etc. For body information, the system will record the passenger's height, body shape and other features. This information will be converted into digital data to provide a basis for subsequent passenger identification.

[0055] In some embodiments, the collection of passenger facial information and body information can be achieved in a variety of ways:

[0056] Optionally, a high-definition camera can be installed at the vehicle entrance. When a passenger enters the vehicle, the camera automatically captures the frontal face image and full-body image of the passenger. The system uses a facial detection algorithm to locate the face area and extract key facial feature points. At the same time, the body posture and movement characteristics of the passenger are analyzed by a posture estimation algorithm. This information is converted into a digital feature vector and stored together with a timestamp;

[0057] Optionally, depth cameras and infrared sensors can be installed at multiple locations in the car. The depth camera is used to capture the 3D facial structure and body contours of the passengers, while the infrared sensor is used to obtain thermal imaging data in low-light conditions. The system uses a multi-view fusion algorithm to integrate data from different sensors to generate more comprehensive and accurate facial and body information. This information will be continuously updated to adapt to the movement and posture changes of passengers in the car.

[0058] It is understandable that other methods can also be used to collect passenger information, such as using wearable devices or mobile phone apps to collect passengers' biometric data, which is not limited here.

[0059] Step S20, calculating the passenger information according to the facial information and the body information to obtain a passenger information recognition result;

[0060] Among them, passenger information calculation refers to the process of processing and analyzing the collected facial information and body information using computer algorithms. Passenger information recognition results refer to the passenger identity judgment obtained through calculation, which is used to determine the passenger's personal information or identity category. Acquisition refers to the process of obtaining a certain result through calculation or analysis.

[0061] This step is performed immediately after sufficient facial and body information is collected, usually within a short time after the passenger enters the vehicle. Specifically, the system first preprocesses the collected facial images and body information, including image enhancement, noise removal and other operations. Then, the system uses a special facial feature extraction algorithm to extract key features of the face, such as the position and shape information of the eyes, nose, mouth, etc. At the same time, the system analyzes the body information and extracts data such as height, body shape, and motion characteristics. Next, the system fuses the extracted facial features and body features to generate a comprehensive feature vector. This fused feature vector is then compared with the known passenger information stored in the system database. The comparison process may involve calculating the similarity or distance between feature vectors. The system will determine whether a matching passenger is found based on a preset threshold. If a matching known passenger is found, the system will return the passenger's identity information; if no match is found, the system may mark it as a new passenger and generate a unique identification. Finally, the system outputs the passenger information recognition result, including the passenger's identity (if it is a known passenger) or a new identification (if it is a new passenger).

[0062] In some embodiments, the calculation and identification of passenger information can be achieved in a variety of ways:

[0063] Optionally, a feature point matching method can be used. First, the system extracts key feature points from the face image, such as the corners of the eyes, the tip of the nose, the corners of the mouth, etc. At the same time, key bone points are extracted from the body information, such as shoulders, elbows, knees, etc. Then, the position information and relative relationship of these feature points are converted into a numerical vector. The system calculates the Euclidean distance or cosine similarity between this vector and the feature vectors of known passengers stored in the database. If a match with the smallest distance or the highest similarity that exceeds the preset threshold is found, the recognition is considered successful; otherwise, it is marked as an unknown passenger; optionally, a multi-feature fusion method can be used.

[0064] The system extracts various types of features from facial and body information, such as geometric features and texture features of the face, as well as contour features and motion features of the body. Each feature is matched separately to obtain multiple matching results. Then, the system combines these matching results using a weighted summation method to obtain a total similarity score. The system determines whether the recognition is successful based on this score and the preset threshold, and outputs the final recognition result. It is understandable that other methods can also be used to calculate and identify passenger information, such as using a rule-based method to determine the identity of the passenger based on predefined feature combination rules, which is not limited here.

[0065] Step S30, collecting the passenger's riding data;

[0066] Among them, ride data refers to information related to the behavior and status of passengers in the vehicle, which is used to record the passenger's riding situation. Collection refers to the process of obtaining and recording information through specific equipment or methods. Passengers refer to individuals riding in the vehicle. Ride data may include data on boarding time, alighting time, riding location, driving route, fare information, etc.

[0067] This step is performed continuously during the passenger's ride, from the time the passenger gets on the bus to the time the passenger gets off the bus. Specifically, the system will record the boarding time and location information when the passenger enters the vehicle. During the ride, the system may also continue to track the passenger's location changes, and may record whether the passenger changes seats or moves in the car. At the same time, the system will also record information such as the vehicle's route, speed, and stops. When the passenger gets off the bus, the system will record the time and location of the get-off. All of this data will be collected in real time and temporarily stored in the system's temporary storage, awaiting subsequent processing and storage.

[0068] In some embodiments, the collection of ride data can be achieved in a variety of ways:

[0069] Optionally, a vehicle-mounted sensor network can be used for data collection. First, pressure sensors are installed under each seat in the vehicle to detect whether the seat is occupied and the approximate weight of the passenger. Second, infrared sensors are installed at the doors to detect passengers getting on and off the vehicle. Then, the vehicle's built-in GPS system is used to record the driving route and stop location. Finally, the data is integrated through the vehicle's onboard computer to generate a complete ride record;

[0070] It is understandable that other methods can also be used to collect ride data, such as using in-car cameras and computer vision technology to track passengers' behavior and location, which is not limited here.

[0071] Step S40, transmitting the passenger information identification result to a passenger identification database, and transmitting the riding data to a riding record database;

[0072] Transmission refers to moving data from one place to another. The passenger identification database stores passenger identity information. The ride record database stores ride-related information.

[0073] This step is performed after the passenger information is identified and the ride data is collected. Specifically, the system formats the passenger information identification results and ride data separately, and then transmits them to the corresponding database through a secure connection. The system ensures the integrity and security of the data and uses encrypted transmission technology.

[0074] In some embodiments, data transmission and storage can be achieved in a variety of ways:

[0075] Optionally, real-time transmission and storage is adopted. The system immediately triggers data transmission, establishes an encrypted connection using SSL or TLS protocol, and packages the data and sends it to the database server;

[0076] Optionally, use batch transmission and storage. The system temporarily stores data locally, regularly transmits it in batches to the central data processing center, and then writes it to the database.

[0077] It is understandable that other methods may be used to achieve data transmission and storage, which are not limited here.

[0078] Step S50, in response to a user query operation, displaying the data stored in the passenger identification database and the riding record database to the user;

[0079] Among them, response refers to the system's processing of user operations. User query operations refer to data retrieval requests issued by users. Display refers to presenting data to users.

[0080] This step is performed when a user initiates a query request. Specifically, the system receives the query request, searches for relevant data in the two databases, associates and integrates the results, and then displays the information in an appropriate way based on the user's permissions and query purpose, while ensuring data accuracy and privacy protection.

[0081] In some embodiments, data query and display can be achieved in a variety of ways:

[0082] Optionally, use an interactive query interface. Provide a graphical interface to input conditions, perform database queries, and use visualization tools to display results;

[0083] Optionally, a report generation system is used. The user selects the report template and parameters, and the system extracts the data and generates a comprehensive report.

[0084] It is understandable that other methods may be used to query and display data, which are not limited here.

[0085] In general, the workflow of this solution is as follows: First, the system collects the facial and body information of the passenger, which may be achieved through the camera or other sensors installed in the car. Then, the system uses the collected information to calculate the passenger information and obtain the passenger information recognition result, that is, to determine the identity of the passenger. At the same time, the system also collects the passenger's riding data, such as boarding time, getting off time, riding location, etc. Then, the system transmits the passenger information recognition result to a special passenger identification database for storage, and transmits the riding data to the riding record database for storage. Finally, when the user performs a query operation, the system extracts relevant information from the two databases and displays the complete riding record to the user.

[0086] In this application, since a multi-dimensional passenger identification method combining facial information and body information is adopted, the characteristic information of passengers can be captured more comprehensively, effectively solving the problem that a single identification method (such as only using facial recognition) is easily affected by environmental factors and leads to identification errors or failures, thereby achieving more accurate and stable passenger identification. Since the system uses a separate passenger identification database and ride record database, it can more effectively manage and store a large amount of passenger and ride data, effectively solving the problems of complex data management and low query efficiency, thereby achieving fast and efficient data retrieval and display. Since the system supports responding to user query operations and can integrate and display the information in the two databases, it can provide users with comprehensive and detailed ride record information, effectively solving the problems of isolated information and incomplete display in traditional systems, thereby achieving a richer and more valuable user experience.

[0087] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar contents as those in the above-mentioned embodiment 1 can be referred to the above introduction, and will not be repeated in the following. Figure 2 Based on the first embodiment, this embodiment provides a more specific method for displaying passenger travel records, as follows:

[0088] Step S201, collecting first face information and first body information of each door position through a plurality of image acquisition devices arranged at each door;

[0089] This embodiment takes a five-seat vehicle and four cameras as an example, but the acquisition scheme is not limited to this. The subsequent steps are based on this scenario.

[0090] The first face information collected by the four cameras at the door is recorded as follows:

[0091] Left front door (driver's side): Camera_Left_Front_Door_Face;

[0092] Right front door (passenger side): Camera_Right_Front_Door_Face

[0093] Left back door: Camera_Left_Back_Door_Face;

[0094] Right back door: Camera_Right_Back_Door_Face.

[0095] The first posture information collected by the four cameras at the door is recorded as follows:

[0096] Left front door (driver's side): Camera_Left_Front_Door_Posture;

[0097] Right front door (passenger side): Camera_Right_Front_Door_Posture;

[0098] Left back door: Camera_Left_Back_Door_Posture;

[0099] Right back door: Camera_Right_Back_Door_Posture.

[0100] Among them, the image acquisition device refers to a device used to capture and record visual information, usually a camera. The door orientation refers to the position and direction of each door of the vehicle. The first face information refers to the facial feature data of the passenger captured by the camera at the door. The second body information is used to represent the data of the passenger's posture, movement and overall body state. Acquisition refers to the process of obtaining and recording data.

[0101] This step is performed when passengers enter or exit the vehicle. Specifically, the system forms a comprehensive monitoring network by installing multiple cameras at each door of the vehicle. When passengers approach or pass through the doors, these cameras will simultaneously capture the facial features and body posture of the passengers. For facial features, the system will record the position and shape of key points such as eyes, nose, mouth, and the overall outline of the face. For body posture information, the system will record the height, body shape, gait, and movement details of the passengers when entering and exiting the vehicle. This information will be processed and encoded in real time and associated with the corresponding door position information. The system will assign unique identifiers to the data collected by each camera, such as "Camera_Left_Front_Door_Face" and "Camera_Left_Front_Door_Posture" for subsequent data processing and analysis.

[0102] In some embodiments, the collection of passenger information at the door can be achieved in a variety of ways:

[0103] Optionally, use a depth camera and machine learning algorithm. First, install a high-resolution RGB-D camera at each door that can capture both color images and depth information. Second, use a real-time face detection algorithm to locate the passenger's face and extract key feature points and facial contours. Then, use a posture estimation algorithm to analyze the passenger's posture, including bone structure and action sequence. Finally, encode the extracted facial and posture information and store it together with the timestamp and door position information;

[0104] Optionally, a multi-angle camera array and image stitching technology are used. First, multiple small cameras are installed around each door to form a camera array with 360-degree coverage. Second, when a passenger is detected approaching, all cameras are activated simultaneously to capture the passenger's face and body from different angles. Then, an image stitching algorithm is used to synthesize the images from multiple angles into a comprehensive 3D model. Finally, detailed facial features and body information are extracted from this 3D model, and digitally processed and stored.

[0105] It is understandable that other methods can also be used to collect passenger information at the door, such as using a thermal imaging camera in combination with a conventional camera to accurately capture passenger information even in low-light environments, which is not limited here.

[0106] Step S202, collecting second face information and second body information of each seat position by using a plurality of image acquisition devices arranged in front of each seat;

[0107] The second face information collected by the four cameras in front of the seat is recorded as follows:

[0108] Left front seat (driver's seat): Camera_Left_Front_Seat_Face;

[0109] Right front seat (passenger seat): Camera_Right_Front_Seat_Face;

[0110] Left back seat: Camera_Left_Back_Seat_Face;

[0111] Right back seat: Camera_Right_Back_Seat_Face.

[0112] The second body posture information collected by the four cameras in front of the seat is recorded as follows:

[0113] Left front seat (driver's seat): Camera_Left_Front_Seat_Posture;

[0114] Right front seat (passenger seat): Camera_Right_Front_Seat_Posture;

[0115] Left back seat: Camera_Left_Back_Seat_Posture;

[0116] Right back seat: Camera_Right_Back_Seat_Posture.

[0117] The front of the seat refers to the area directly in front of each seat in the vehicle. The second face information refers to the facial feature data of the passenger captured by the camera in front of the seat. The second posture information refers to the posture and movement data of the passenger in the seat. The seat orientation is used to indicate the specific position of each seat in the vehicle.

[0118] This step is performed continuously while the passengers are in the vehicle. Specifically, the system installs special cameras in front of each seat, which can continuously monitor the passengers sitting in the seats. When the passengers sit down, the cameras will continuously capture the changes in the passengers' facial expressions, head movements, and upper body postures. The system will process these image data in real time, extract facial feature points, analyze expression changes, and record the passengers' sitting posture, hand movements and other body information. This information will be encoded and associated with the seat position, and the data of each camera will be given a unique identifier, such as "Camera_Left_Front_Seat_Face" and "Camera_Left_Front_Seat_Posture". The system will continue to update this information to reflect the changes in the passengers' status throughout the journey.

[0119] In some embodiments, the information of the passenger in front of the seat can be collected in a variety of ways:

[0120] Optionally, use infrared cameras and motion recognition algorithms. First, install an infrared camera in front of each seat to clearly capture passenger images under various lighting conditions. Second, use facial recognition algorithms to track passengers' facial features in real time, including eye and mouth movements and expression changes. Then, use posture estimation algorithms to analyze passengers' upper body movements, such as leaning forward, leaning back, turning their heads, etc. Finally, perform time series analysis on these data to generate a report on passengers' behavior patterns throughout the journey.

[0121] It is understandable that other methods can also be used to collect information about the passenger in front of the seat, such as using a deep learning algorithm to analyze long-term passenger behavior and predict possible abnormal situations, which is not limited here.

[0122] Step S203, performing weighted calculation on the first face information and the second face information respectively to obtain face recognition results for each seat;

[0123] For the face information transmitted by the eight cameras in the above steps of this embodiment, the face recognition result is obtained by weighted calculation. The specific calculation method given in this solution is as follows:

[0124] Assume that the constant coefficient corresponding to the facial information transmitted by the camera is (1≤n≤8), and the power coefficient is (1≤m≤8).

[0125] Use the formula to calculate the passenger's face recognition result:

[0126] F s =λ 1 *Camera_Left_Front_Door_Face^σ 1 +λ 2 *Camera_Right_Front_Door_Face^σ 2 +λ 3 *Camera_Left_Back_Door_Face^σ 3 +λ 4 *Camera_Right_Back_Door_Face^σ 4 +λ 5 *Camera_Left_Front_Seat_Posture^σ 5 +λ 6 *Camera_Right_Front_Seat_Posture^σ 6 +λ7 * Camera_Left_Back_Seat_Posture^σ 7 +λ 8 *Camera_Right_Back_Seat_Posture^σ 8 ; (1)

[0127] Where (1≤s≤5);

[0128] F 1 represents the face recognition result of the driver (left front seat) passenger, F 2 represents the face recognition result of the passenger in the front right seat, F 3 represents the face recognition result of the passenger in the left rear seat, F 4 represents the face recognition result of the passenger in the right rear seat, F 5 Indicates the face recognition result of the passenger in the middle rear seat.

[0129] Depending on the position of the passenger, the values ​​of λ and σ are different to distinguish different cameras.

[0130] The contribution of nm's facial information to different passenger positions.

[0131] The first face information refers to the face information collected by the camera at the door, and the second face information refers to the face information collected by the camera in front of the seat. The face recognition result is used to represent the recognition result of the passenger's facial features. Weighted calculation refers to assigning different weights to face information from different sources for calculation.

[0132] Specifically, this step is performed after obtaining the facial information collected by each camera of the vehicle. For each seat, the facial information from the door and the front of the seat is weighted using the above formula (1) to obtain the facial recognition result of the seat. The reliability and importance of the information collected by different cameras are considered during the calculation, and different weight coefficients are assigned. Through weighted calculation, the information of multiple cameras can be comprehensively utilized to improve the accuracy of facial recognition.

[0133] In some embodiments, the weighted calculation of the face information can be implemented in a variety of ways:

[0134] Optionally, the facial information collected by each camera is first preprocessed, including image enhancement, feature extraction, etc. Then, a weight coefficient is assigned to the facial information of each camera, and the weight coefficient can be determined according to factors such as camera position and image quality. Then, the facial information of each camera is multiplied by the corresponding weight coefficient and added to obtain weighted facial features. Finally, facial recognition is performed based on the weighted features to obtain facial recognition results for each seat.

[0135] It is understandable that other methods may be used to implement the weighted calculation of the facial information, which is not limited here.

[0136] Step S204, performing weighted calculation on the first posture information and the second posture information respectively to obtain a posture recognition result of each seat;

[0137] The posture information transmitted by the eight cameras is also weighted and calculated to obtain the posture recognition result.

[0138] Assume that the constant coefficient corresponding to the posture information transmitted by the camera is (1≤n≤8), and the power coefficient is (1≤m≤8).

[0139] The passenger's body recognition result is calculated using the formula:

[0140] P s =υ 1 *Camera_Left_Front_Door_Face^ν 1 +υ 2 *Camera_Right_Front_Door_Face^ν 2 +υ 3 *Camera_Left_Back_Door_Face^ν 3 +υ 4 *Camera_Right_Back_Door_Face^ν 4 +υ 5*Camera_Left_Front_Seat_Posture^ν 5 +υ 6 *Camera_Right_Front_Seat_Posture^ν 6 +υ 7 *Camera_Left_Back_Seat_Posture^ν 7 +υ 8 *Camera_Right_Back_Seat_Posture^ν 8 ; (2)

[0141] Where (1≤s≤5);

[0142] P 1 represents the body recognition result of the driver (left front seat) passenger, P 2 represents the body recognition result of the passenger in the front right seat, P 3 represents the body recognition result of the passenger in the left rear seat, P 4 represents the body recognition result of the passenger in the right rear seat, P 5 Indicates the body recognition result of the passenger in the middle seat of the rear row.

[0143] Depending on the position of the passenger, the values ​​of υ and ν are different to distinguish different cameras.

[0144] The contribution of nm's body information to different passenger positions.

[0145] The first posture information refers to the posture information collected by the camera at the door, and the second posture information refers to the posture information collected by the camera in front of the seat. The posture recognition result is used to represent the recognition result of the passenger's body posture. Weighted calculation refers to assigning different weights to posture information from different sources for calculation.

[0146] Specifically, this step is performed after obtaining the posture information collected by each camera of the vehicle. For each seat, the posture information from the door and the front of the seat is weighted by the above formula (2) to obtain the posture recognition result of the seat. The reliability and importance of the information collected by different cameras are considered during the calculation, and different weight coefficients are assigned. Through weighted calculation, the information of multiple cameras can be comprehensively utilized to improve the accuracy of posture recognition.

[0147] In some embodiments, the weighted calculation of the posture information can be implemented in a variety of ways:

[0148] Optionally, the body images collected by each camera are first preprocessed, such as denoising, posture estimation, etc. Then, a weight coefficient is assigned to the body information of each camera, and the weight can be determined according to factors such as camera viewing angle and image clarity. Then, the body characteristics of each camera are multiplied by the corresponding weight and added to obtain a weighted body representation. Finally, body recognition is performed based on the weighted representation to obtain the body recognition results of each seat.

[0149] It is understandable that other methods may be used to implement the weighted calculation of the posture information, which is not limited here.

[0150] Step S205, performing weighted calculation on the face recognition result and the body recognition result of the same seat to obtain the passenger information recognition result of each seat;

[0151] According to the calculated face recognition results and body recognition results, the passenger recognition results are obtained through weighted calculation. The weighted coefficients of the face recognition results and body recognition results are: Δ 1 , Δ 2 , where Δ 1 +Δ 2 =1.

[0152] Use the calculation formula:

[0153] Passenger s =Δ 1 F s +Δ 2 P s ; (3)

[0154] Where (1≤s≤5);

[0155] Passenger 1 Indicates the recognition result of the passenger in the driver's seat (left front seat), Passenger 2 Indicates the recognition result of the passenger in the front right seat, Passenger 3 Indicates the recognition result of the passenger in the left rear seat, Passenger 4 Indicates the recognition result of the passenger in the right rear seat, Passenger 5 Indicates the recognition result of the passenger in the middle rear seat.

[0156] The face recognition result indicates the face recognition result of each seat obtained in step S203, and the body recognition result indicates the body recognition result of each seat obtained in step S204. The passenger information recognition result is used to indicate the comprehensive recognition result of the passenger identity. Weighted calculation refers to assigning different weights to the face recognition result and the body recognition result for calculation.

[0157] Specifically, this step is performed after obtaining the face recognition results and body recognition results of each seat. For each seat, the face recognition results and body recognition results of the seat are weighted fused using the above formula (3) to obtain the passenger information recognition result of the seat. By comprehensively considering the features of both face and body, the accuracy and robustness of passenger identification can be improved.

[0158] In some embodiments, the weighted calculation can be implemented in a variety of ways:

[0159] Optionally, the face recognition result and the body recognition result are first normalized to make their numerical ranges consistent. Then, weight coefficients are assigned to the face recognition result and the body recognition result respectively, and the weight coefficients can be determined according to the actual application scenario and recognition reliability. Then, the weighted face recognition result and the body recognition result are added to obtain a fused feature vector. Finally, classification or matching is performed based on the fused feature vector to obtain the final passenger information recognition result.

[0160] It is understandable that the weighted calculation may also be implemented in other ways, which are not limited here.

[0161] Step S206, comparing the passenger identification result of each seat with a preset reference value;

[0162] When the value of Passenger is calculated s Less than the baseline value Passenger base , it is determined that there is no passenger at the corresponding seat.

[0163] Specifically, this step is performed after obtaining the passenger identification results of each seat. For each seat, the passenger identification result of the seat is compared with a preset reference value. This comparison process is intended to determine whether there is a passenger in the seat. The selection of the preset reference value needs to be determined based on a large amount of experimental data and actual application scenarios to achieve the best judgment effect. Through this comparison process, seats that may have passengers can be preliminarily screened out.

[0164] In some embodiments, the comparison process can be implemented in a variety of ways:

[0165] Optionally, the passenger identification result is first normalized so that its value range is between 0 and 1. Then a fixed reference value is set, such as 0.5. Then the normalized passenger identification result is compared with the reference value. If it is greater than or equal to the reference value, the seat is marked as "may have a passenger"; if it is less than the reference value, it is marked as "may not have a passenger". Finally, the comparison result is stored in a temporary array for subsequent processing.

[0166] Optionally, a dynamic threshold method is used for comparison. First, passenger identification result data is collected over a period of time. Then, statistical methods, such as Gaussian mixture model, are used to model these data to obtain the probability distribution of the two states of passenger presence and passenger absence. Then, based on these two distributions, the optimal reference value is dynamically calculated. Finally, the current passenger identification result is compared with this dynamic reference value to obtain a judgment result.

[0167] It is understandable that the comparison process may also be implemented in other ways, such as fuzzy logic judgment, machine learning classifier, etc., which are not limited here.

[0168] Step S207, when the passenger identification result is greater than or equal to the reference value, determining the passenger identification result as a valid passenger identification result;

[0169] When the value of Passenger is calculated s Greater than or equal to the benchmark value Passenger base When the corresponding calculated value Passenger is determined s Valid passenger identification result.

[0170] The valid passenger identification result refers to the identification result that is confirmed to be a real passenger. The reference value refers to the preset reference value used for comparison in step S206. Determination refers to marking the passenger identification result that meets the conditions as valid.

[0171] Specifically, this step is performed immediately after the comparison in step S206 is completed. For each seat, if the passenger identification result of the seat is greater than or equal to the preset reference value, the result is determined as a valid passenger identification result. The purpose of this step is to further screen out seats where passengers actually exist and eliminate possible misjudgments. The passenger identification results determined to be valid will be used for subsequent passenger information recording and analysis.

[0172] In some embodiments, the determination process can be implemented in a variety of ways:

[0173] Optionally, first create a new data structure for storing valid passenger identification results. Then traverse the comparison results in step S206, and for each result greater than or equal to the reference value, save its corresponding seat number and identification result into the new data structure. Then sort these valid results, for example, in descending order of the confidence of the identification result. Finally, a maximum number of valid results can be set, and only the results with the highest confidence are retained to improve the accuracy of the system.

[0174] Optionally, a multi-threshold method is used for determination. First, multiple different levels of benchmark values ​​are set, such as low, medium, and high. Then, the recognition result of each seat is subjected to multi-level judgment: if it is greater than the high-level benchmark value, it is directly determined to be valid; if it is between the medium and high levels, an additional time continuity check is performed (for example, multiple consecutive frames are within this range); if it is only greater than the low-level benchmark value, it is necessary to combine other sensor data (such as seat pressure sensors) for comprehensive judgment. Finally, based on the results of these multi-level judgments, the final valid passenger recognition result is determined.

[0175] In general, in this embodiment, since multiple image acquisition devices are used to collect the face and body information of passengers at the door and in front of the seat respectively, more comprehensive passenger feature data can be obtained from different angles and positions, effectively solving the problem of incomplete information and low recognition accuracy caused by single-view acquisition, thereby achieving more accurate and stable passenger identity recognition. Since the first face information and the second face information collected are weighted, and the first body information and the second body information are weighted, the information advantages collected at different positions can be fully utilized, effectively solving the problem that the single position acquisition may be blocked or limited by angle, thereby achieving more comprehensive and accurate face recognition results and body recognition results. Since the face recognition results and body recognition results of the same seat are weighted again, two different types of biological features of face and body can be comprehensively utilized, effectively solving the problem that a single feature is easily affected by environmental factors and leads to recognition errors, thereby achieving more reliable and robust passenger information recognition results. This multi-level and multi-dimensional weighted calculation method not only improves the accuracy of passenger identity recognition and the reliability of the system, but also enhances the adaptability of the recognition process to different environmental conditions, providing an innovative solution for passenger recognition technology in intelligent transportation systems.

[0176] Based on the first and second embodiments of the present application, in the third embodiment of the present application, the same or similar contents as those of the above-mentioned embodiments 1 and 2 can be referred to the above introduction, and will not be described in detail later. Figure 3 , this embodiment provides a method for storing and displaying riding data and passenger identification results, as follows:

[0177] Step S301, querying the passenger identification database to see whether there is a valid passenger identification result that matches the valid passenger identification result;

[0178] The passenger identification database refers to a database system that stores passenger identification information. The valid passenger identification result refers to the valid passenger information determined in step S207. Matching refers to comparing the similarity of two passenger identification results to determine whether they are the same passenger. Querying refers to searching for records that meet the conditions in the database.

[0179] Specifically, this step is performed after obtaining a valid passenger identification result. The system will access the passenger identification database and compare the newly obtained valid passenger identification result with the records stored in the database. The comparison process involves a feature matching algorithm to determine whether the new identification result matches a known passenger in the database. The purpose of this step is to determine whether the current passenger is a new passenger or a passenger with an existing record, in preparation for subsequent data processing and record updates.

[0180] In some embodiments, the query matching process can be implemented in a variety of ways:

[0181] Optionally, first convert the valid passenger recognition result into a feature vector. Then use the index structure to quickly retrieve similar records in the database. Then perform an exact match on the retrieved candidate records and calculate the Euclidean distance or cosine similarity between the feature vectors. Finally, set a similarity threshold. If the similarity between the most similar record and the current recognition result exceeds the threshold, it is determined to be a successful match; otherwise, it is determined to be a new passenger.

[0182] Optionally, a deep learning method is used for matching. First, a twin neural network is trained to learn the similarity measure of passenger features. Then the current valid passenger identification result and all records in the database are input into the network respectively. Then the network outputs the similarity score of each pair of features. Finally, the record with the highest similarity is selected. If its score exceeds the preset threshold, it is determined to be a successful match; otherwise, it is determined to be a new passenger.

[0183] It is understandable that other methods may be used to implement the query matching process, such as using local sensitive hashing (LSH) for fast approximate nearest neighbor search, or using graph neural networks to model the relationship between passengers, etc., which are not limited here.

[0184] Step S302, when there is no valid passenger identification result matching the valid passenger identification result in the passenger identification database, assigning an identity identification code to the valid passenger identification result, adding a new combination of the valid passenger identification and the identity identification code in the passenger identification database, and updating a new ride record in the ride record database based on the corresponding ride data;

[0185] The ID code is a code used to uniquely identify a passenger. The ride data refers to information related to the passenger's ride, such as boarding time, alighting time, and ride route. The ride record database refers to a database system that stores the passenger's ride history. A new ride record indicates detailed information about this ride.

[0186] Specifically, this step is executed when the query result in step S301 shows that there is no matching record in the database. The system will assign a unique ID code to the newly identified passenger and add the combination of the new passenger identification result and the ID code to the passenger identification database. At the same time, the system will create a new ride record in the ride record database based on the current ride data. The purpose of this step is to create a profile for the new passenger and start recording his ride history.

[0187] In some embodiments, the new passenger recording process can be implemented in a variety of ways:

[0188] Optionally, first generate a globally unique identification code, which can be a UID or a timestamp plus a random number. Then package the valid passenger identification result and the identification code into a data object. Then use the database transaction mechanism to insert a new passenger record in the passenger identification database and create a new ride record in the ride record database. Finally, perform a data integrity check to ensure the consistency of the records in the two databases.

[0189] Optionally, a distributed system architecture is used. First, the identity code is generated by a distributed ID generator. Then the new passenger data is sent to the message queue. Then different microservices handle the update of the passenger identification database and the creation of the ride record database respectively. Finally, distributed transactions are used to ensure the atomicity of all operations. If any step fails, a rollback operation is performed.

[0190] It is understandable that other methods can also be used to implement the new passenger recording process, such as using blockchain technology to ensure the immutability of data, or using a real-time stream processing framework for instant analysis and storage of data, etc., which are not limited here.

[0191] Step S303, when there is a valid passenger identification result matching the valid passenger identification result in the passenger identification database, based on the corresponding riding data, a new riding record is updated in the riding record database;

[0192] The ride record indicates the passenger's ride history information, including the number of rides, common routes, etc. Update means adding or modifying information based on the existing record. The new ride record indicates the detailed information of this ride and needs to be added to the passenger's historical record.

[0193] Specifically, this step is executed when the query result in step S301 shows that there is a matching record in the database. The system will update a new ride record for the known passenger in the ride record database based on the current ride data. The purpose of this step is to continuously accumulate the passenger's ride history and provide a basis for subsequent data analysis and personalized services. The update process needs to consider the consistency and integrity of the data to ensure that the newly added records are consistent with the passenger's historical records.

[0194] It is understandable that other methods can also be used to implement the ride record update process, such as using a graph database to model the passenger's riding behavior network, or using a machine learning algorithm to predict and analyze the passenger's riding pattern, etc., which are not limited here.

[0195] Step S304, detecting a user query operation;

[0196] Among them, user query operation refers to the information retrieval behavior of users through the system interface. Detection means that the system monitors and recognizes the user's input behavior. The operation input may include query conditions such as identity identification code and vehicle frame number.

[0197] Specifically, this step is performed continuously during the operation of the system. The system monitors the input area of ​​the user interface in real time and captures any possible query operations. This includes but is not limited to keyboard input, touch screen operation, voice commands, etc. The purpose of the detection is to respond to the user's query needs in a timely manner and prepare for subsequent data retrieval and display. The system needs to be able to distinguish different types of query operations, such as querying by identity identification code or querying by vehicle frame number.

[0198] In some embodiments, the detection of user query operations can be implemented in a variety of ways:

[0199] Optionally, first set up a dedicated query input box and query button in the user interface. Then, through the event monitoring mechanism, capture the text changes in the input box and the click events of the button. Then pre-process the input content, such as removing blank characters, converting uppercase and lowercase characters, etc. Finally, based on the format of the input content (such as the identity identification code is usually a fixed-length alphanumeric combination, and the vehicle frame number has a specific format), preliminarily determine the query type and prepare for subsequent query operations.

[0200] Optionally, natural language processing technology is used to implement intelligent query. First, a speech recognition module is integrated to allow users to query by voice. Then, the natural language understanding model is used to parse the user's query intent and key information. Then, the corresponding query fields are automatically filled according to the parsing results. Finally, before executing the query, the user is confirmed whether the query content understood by the system is correct. If not, the user is allowed to make corrections.

[0201] It is understandable that other methods may be used to detect user query operations, such as using machine learning algorithms to predict users' possible query needs, or automatically recommending common queries through user behavior analysis, etc., which are not limited here.

[0202] Step S305, when the identity identification code input by the user query operation is detected, all the riding records related to the identity identification code in the riding record database are displayed to the user;

[0203] The ID code refers to a code that uniquely identifies a passenger. The ride record database refers to a database system that stores all passenger ride histories. Display refers to presenting query results in a user-friendly manner. The relevant ride records refer to all historical ride information corresponding to the input ID code.

[0204] Specifically, this step is executed after the user enters the identification code and confirms the query operation. The system will retrieve all relevant ride records in the ride record database based on the input identification code. The retrieval results need to be processed and organized for easy understanding and analysis by users. The displayed content may include detailed information such as ride date, time, route, fare, and some statistical data such as total number of rides, accumulated mileage, etc. The system also needs to consider data privacy protection to ensure that relevant information is only displayed to authorized users.

[0205] In some embodiments, the query and display of ride records based on the identity identification code can be implemented in a variety of ways:

[0206] Optionally, first perform format verification and security checks on the input identity code to prevent attacks such as SQL injection. Then use index-optimized SQL queries to retrieve relevant records from the ride record database. Then clean and format the retrieval results to ensure data consistency and readability. Then use data visualization tools (such as ECharts) to generate charts to intuitively display information such as ride frequency and common routes. Finally, implement paging functionality to allow users to browse large amounts of historical records, and provide export functionality to support saving query results in Excel or PDF format.

[0207] It is understandable that other methods can also be used to implement the query and display of ride records based on identity identification codes, such as using NoSQL databases to improve query flexibility, or using machine learning algorithms to conduct in-depth analysis of ride patterns, etc., which are not limited here.

[0208] Step S306, when the vehicle frame number input by the user's query operation is detected, all the riding records related to the vehicle frame number in the riding record database are displayed to the user.

[0209] The vehicle frame number refers to the number that uniquely identifies the vehicle. The vehicle-related ride records refer to all passenger ride information associated with a specific vehicle. Display means presenting the query results in a structured and visual manner.

[0210] Specifically, this step is executed after detecting that the user has entered the vehicle frame number and confirmed the query operation. Based on the entered vehicle frame number, the system will retrieve all ride records related to the vehicle in the ride record database. These records may involve multiple different passengers. The retrieval results need to be summarized and classified so that managers or car owners can understand the use of the vehicle. The displayed content may include information such as the vehicle's operating hours, passenger capacity, driving routes, and some statistical data, such as average daily passenger capacity, peak usage rate, etc. The system also needs to consider the timeliness of the data to ensure that the information displayed is the latest and accurate.

[0211] In some embodiments, the query and display of ride records based on the vehicle frame number can be implemented in a variety of ways:

[0212] Optionally, firstly, the format of the input vehicle frame number is verified to ensure that it conforms to the standard format. Then, the distributed query technology is used to parallelly retrieve relevant records in the ride record database that may span multiple data centers. Then, the search results are aggregated and various statistical indicators are calculated, such as the average daily operating time, average number of passengers, etc. Finally, multi-dimensional data display is implemented, allowing users to analyze the use of vehicles from different perspectives such as time, space, and passenger type.

[0213] It is understandable that other methods can also be used to realize the query and display of ride records based on the vehicle frame number, such as using blockchain technology to ensure the non-tamperability of vehicle usage records, or using Internet of Things technology to monitor and display vehicle status in real time, etc., which are not limited here.

[0214] In general, in this embodiment, since the passenger identification database and the ride record database are stored separately and the association between the two is established through the identity code, the passenger information and ride record can be flexibly managed and updated, which effectively solves the problems of low data management efficiency and data redundancy, thereby realizing a more efficient and systematic data storage structure. Since a new identity code is automatically assigned and a new record is created when there is no matching result in the passenger identification database, the passenger information database can be dynamically expanded, which effectively solves the problem of poor adaptability of the system to new passengers, thereby realizing a more flexible and scalable passenger management mechanism. Since the records in the ride record database contain a combination of the identity code, the vehicle frame number and the ride data, the passenger's ride information can be fully recorded, which effectively solves the problem of incomplete ride record information in the traditional system, thereby realizing a more detailed and valuable ride data analysis basis. This data management method based on validity judgment, separate storage, dynamic expansion and comprehensive recording not only improves the data quality and management efficiency of the system, but also enhances the adaptability and data value of the system, and provides an innovative solution for passenger information management in intelligent transportation systems.

[0215] It should be noted that the above examples are only used to understand the present application and do not constitute a limitation on the method of displaying passenger travel records in the present application. More simple transformations based on this technical concept are all within the scope of protection of the present application.

[0216] The present application provides a device for displaying a passenger's ride record, the device for displaying a passenger's ride record comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method for displaying a passenger's ride record in the above-mentioned embodiment one.

[0217] Reference below Figure 4 , which shows a schematic diagram of the structure of a device suitable for implementing the embodiment of the present application to display the passenger's riding record. The device for displaying the passenger's riding record in the embodiment of the present application may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 4The device shown for displaying passenger travel records is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0218] like Figure 4 As shown, the device for displaying passenger riding records may include a processing device 1001 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM: Read Only Memory) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM: Random Access Memory) 1004. In RAM1004, various programs and data required for the operation of the device for displaying passenger riding records are also stored. The processing device 1001, ROM1002, and RAM1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD: Liquid Crystal Display), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the device for displaying passenger riding records to communicate with other devices wirelessly or by wire to exchange data. Although the figure shows a device for displaying passenger riding records with various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems can be implemented or have alternatively.

[0219] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0220] The device for displaying passenger riding records provided by the present application adopts the method for displaying passenger riding records in the above embodiment, which can solve the technical problem of inaccurate passenger riding identification calculation. Compared with the prior art, the beneficial effects of the device for displaying passenger riding records provided by the present application are the same as the beneficial effects of the method for displaying passenger riding records provided by the above embodiment, and other technical features in the device for displaying passenger riding records are the same as the features disclosed in the method of the previous embodiment, which will not be described in detail here.

[0221] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0222] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0223] The present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, and the computer-readable program instructions are used to execute the method for displaying passenger riding records in the above-mentioned embodiment.

[0224] The computer-readable storage medium provided in the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination of the above.

[0225] The computer-readable storage medium may be included in the device for displaying the passenger's riding record; or it may exist independently without being assembled into the device for displaying the passenger's riding record.

[0226] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0227] The readable storage medium provided by the present application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned method for displaying passenger riding records, and can solve the technical problem of inaccurate passenger riding identification calculation. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the present application are the same as the beneficial effects of the method for displaying passenger riding records provided by the above-mentioned embodiment, and will not be described in detail here.

[0228] The present application also provides a computer program product, including a computer program, which implements the steps of the method for displaying passenger riding records as described above when executed by a processor.

[0229] The computer program product provided by this application can solve the technical problem of inaccurate passenger identification calculation. Compared with the prior art, the beneficial effects of the computer program product provided by this application are the same as the beneficial effects of the method for displaying passenger riding records provided by the above embodiment, which will not be repeated here.

[0230] The above descriptions are only some embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structural changes made using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect applications in other related technical fields are included in the patent protection scope of the present application.

Claims

1. A method for displaying passenger riding records, characterized in that: The method for displaying passenger riding records comprises: Collect passengers' facial and body information; Calculate the passenger information based on the facial information and the body information to obtain a passenger information recognition result; Collecting the passenger's riding data; Transmitting the passenger information identification result to a passenger identification database, and transmitting the ride data to a ride record database; In response to a user query operation, the data stored in the passenger identification database and the ride record database are displayed to the user.

2. The method according to claim 1, characterized in that The step of collecting the passenger's facial information and body information specifically includes: Collecting first face information and first body posture information of each door position through a plurality of image acquisition devices arranged at each door; The second face information and the second body information of each seat position are collected by using a plurality of image acquisition devices arranged in front of each seat; The facial information includes the first facial information and the second facial information, and the body information includes the first body information and the second body information.

3. The method according to claim 2, characterized in that The step of calculating the passenger information according to the facial information and the body information to obtain the passenger information recognition result specifically includes: Performing weighted calculation on the first face information and the second face information respectively to obtain face recognition results for each seat; Performing weighted calculation on the first posture information and the second posture information respectively to obtain a posture recognition result for each seat; The face recognition result and the body recognition result of the same seat are weightedly calculated to obtain the passenger information recognition result of each seat.

4. The method according to claim 3, characterized in that The step of transmitting the passenger information identification result to the passenger identification database and transmitting the riding data to the riding record database comprises: Comparing the passenger identification result of each seat with a preset reference value; When the passenger identification result is greater than or equal to the reference value, the passenger identification result is determined to be a valid passenger identification result.

5. The method according to claim 4, characterized in that The step of transmitting the passenger information identification result to a passenger identification database and transmitting the riding data to a riding record database specifically includes: querying the passenger identification database whether there is a valid passenger identification result matching the valid passenger identification result; When there is no valid passenger identification result matching the valid passenger identification result in the passenger identification database, an identity identification code is assigned to the valid passenger identification result, and a new combination of the valid passenger identification and the identity identification code is added to the passenger identification database, and a new ride record is updated in the ride record database based on the corresponding ride data; The riding record in the riding record database is a combination of the identity identification code, the vehicle frame number and the riding data.

6. The method according to claim 5, characterized in that The step of querying the passenger identification database to see whether there is a valid passenger identification result matching the valid passenger identification result, then comprises: When the valid passenger identification result matching the valid passenger identification result exists in the passenger identification database, the new riding record is updated in the riding record database based on the corresponding riding data.

7. The method according to claim 6, characterized in that The step of displaying the data stored in the passenger identification database and the ride record database to the user in response to the user query operation specifically includes: Detect user query operations; When the identity identification code input by the user query operation is detected, all the riding records related to the identity identification code in the riding record database are displayed to the user; When the vehicle frame number input by the user's query operation is detected, all the riding records related to the vehicle frame number in the riding record database are displayed to the user.

8. A method and device for displaying passenger riding records, characterized in that: The device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the method for displaying a passenger's riding record according to any one of claims 1 to 7.

9. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the method for displaying a passenger's riding record as claimed in any one of claims 1 to 7 are implemented.

10. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the steps of the method for displaying a passenger's riding record according to any one of claims 1 to 7 are implemented.

Images