Trip information processing methods, systems, electronic devices and readable storage media
By working collaboratively between the vehicle-mounted system and the cloud server, and utilizing object detection and facial recognition technologies, the problems of low cost and accuracy in obtaining driver trip information have been solved, reducing the waste of communication resources and improving the accuracy of trip information.
Patent Information
- Application Number
- CN202310645617.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-06-02
- Publication Date
- 2025-12-02
- Estimated Expiration
- 2043-06-02
AI Technical Summary
In existing technologies, obtaining driver trip information suffers from issues of low cost and accuracy. Especially in short-distance transportation scenarios, frequent snapshots and uploads lead to excessively high costs for cloud servers and inaccurate trip information.
The vehicle's infotainment system detects images of the driver's seat using a target detection model. It then trains the model using a lightweight target detection algorithm and a facial image database to determine whether the trip has started, ended, or is in progress. Based on the determination results, the system sends trip information to the cloud server. The cloud server then performs facial recognition to confirm the target driver's trip information.
It reduces the waste of communication and cloud server resources, improves the accuracy of trip information, and especially avoids the inaccuracy caused by timed snapshots in short-distance driving scenarios, thus achieving low-cost and accurate trip information acquisition.
Smart Images

Figure CN116721406B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of driving data recording technology, and more specifically, to a trip information processing method, system, electronic device, and readable storage medium. Background Technology
[0002] With the rapid development of the logistics industry, freight companies are employing more and more drivers. In order to track driver attendance and track violations, it is necessary to process and analyze drivers' travel information.
[0003] Currently, there are two main methods for processing trip information. The first method involves installing a time clock in the vehicle, allowing drivers to clock in and out, thus recording the start and end times of each trip and the person clocking in. The second method involves periodically capturing photos of the driver in the driver's seat, identifying the driver, and calculating the trip details. This method uploads the captured images to a cloud server for identification, comparing the result with the previous identification. If they differ, the driver's previous trip is considered complete.
[0004] However, the first method described above is prone to drivers clocking in on behalf of others. The second method, for short-distance transportation scenarios, requires frequent photo captures and uploads of drivers; otherwise, accurate driver trip information cannot be obtained. However, frequent photo captures and uploads lead to excessively high costs for cloud servers. Therefore, finding a cost-effective and accurate way to obtain driver trip information is an urgent problem to be solved. Summary of the Invention
[0005] The purpose of this application is to address the shortcomings of the prior art by providing a method, apparatus, system, electronic device, and readable storage medium for processing trip information, thereby solving the problem of how to obtain drivers' trip information in a low-cost and accurate manner in the prior art.
[0006] To achieve the above objectives, the technical solutions adopted in the embodiments of this application are as follows:
[0007] In a first aspect, one embodiment of this application provides a trip information processing method applied to an in-vehicle infotainment system, the method comprising:
[0008] Obtain the current driver's seat image of the vehicle;
[0009] The current driver's seat image is input into a preset target detection model for detection, and the current detection result is output. The current detection result is used to indicate whether there is an object in the driver's seat.
[0010] The current detection result is compared with the previous detection result to obtain a trip determination result, which is used to indicate whether the trip has started, ended, not started, or is in progress.
[0011] Based on the trip determination result, the trip information and the current driver's seat image are sent to the cloud server. The trip information is used to indicate the start or end of the trip.
[0012] Optionally, before inputting the current driver's seat image into a preset target detection model for detection and outputting the current detection result, the method further includes:
[0013] The face target detection model is obtained by training the model based on a lightweight target detection algorithm and a pre-set face image information database.
[0014] Optionally, comparing the current detection result with the previous detection result to obtain the travel determination result includes:
[0015] If the current detection result indicates that there is an object in the driver's seat, and the previous detection result indicates that there is no object in the driver's seat, then the trip determination result is determined to be the start of the trip;
[0016] If the current detection result indicates that there is no object in the driver's seat, and the previous detection result indicates that there is an object in the driver's seat, then the trip determination result is determined to be the end of the trip;
[0017] If the current detection result indicates that there is an object in the driver's seat, and the previous detection result indicates that there is an object in the driver's seat, then the trip determination result is determined to be a trip in progress;
[0018] If the current detection result indicates that there is no object in the driver's seat, and the previous detection result indicates that there is no object in the driver's seat, then the trip determination result is determined to be that the trip has not started.
[0019] Optionally, sending the trip information and the current driver's seat image to the cloud server based on the trip determination result includes:
[0020] If the determination result is that the trip has started, then the first trip information is sent to the cloud server, and the first trip information is used to indicate that the trip has started;
[0021] If the determination result is that the trip has ended, then a second trip information is sent to the cloud server, which is used to indicate that the trip has ended.
[0022] Secondly, one embodiment of this application also provides a trip information processing method applied to a cloud server, the method comprising:
[0023] Receive trip information and current driver's seat image sent by the vehicle terminal, wherein the trip information is used to indicate the start or end of the trip;
[0024] Facial recognition is performed using multiple pre-stored driver information entries and the current driver's seat image to determine the target driver in the driver's seat image. The driver information includes: the driver's facial image and the driver's identifier.
[0025] Based on the trip information, the target trip information of the target driver is determined.
[0026] Optionally, the step of determining the target driver in the driver's seat image by performing facial recognition using multiple pre-stored driver information and the current driver's seat image includes:
[0027] The driver's facial image in the current driver image is compared with each driver image in the driver information to obtain a target driver's facial image that matches the current driver's seat image;
[0028] The driver corresponding to the facial image of the target driver is taken as the target driver.
[0029] Optionally, determining the target driver's target trip information based on the trip information includes:
[0030] If the trip information indicates the start of the trip, then the start time of the target driver's trip is determined based on the trip information or the current time;
[0031] If the trip information indicates the end of the trip, then the trip end time of the target driver is determined based on the trip information or the current time.
[0032] Thirdly, another embodiment of this application provides a trip information processing device, the device comprising:
[0033] The acquisition module is used to acquire the current driver's seat image of the vehicle;
[0034] The detection module is used to input the current driver's seat image into a preset target detection model for detection and output the current detection result, which is used to indicate whether there is an object in the driver's seat;
[0035] The comparison module is used to compare the current detection result with the previous detection result to obtain a trip determination result. The trip determination result is used to indicate whether the trip has started, the trip has ended, the trip has not started, or the trip is in progress.
[0036] The identification module is used to send trip information and the current driver's seat image to the cloud server based on the trip determination result. The trip information is used to indicate the start or end of the trip.
[0037] Fourthly, another embodiment of this application provides a trip information processing device, the device comprising:
[0038] The trip receiving module is used to receive trip information and the current driver's seat image sent by the vehicle terminal. The trip information is used to indicate the start or end of the trip.
[0039] A face recognition module is used to perform face recognition using multiple pre-stored driver information and the current driver's seat image to determine the target driver in the driver's seat image. The driver information includes: driver's facial image and driver's identifier.
[0040] The trip determination module is used to determine the target trip information of the target driver based on the trip information.
[0041] Fifthly, another embodiment of this application provides a trip information processing system, including a vehicle-mounted terminal and a cloud server;
[0042] The vehicle-mounted terminal is used to execute the steps of any of the methods described in the first aspect above, so as to send trip information and driver's seat image to the cloud server;
[0043] The server is used to execute any of the method steps described in the second aspect above to obtain the driver's target trip information.
[0044] In a sixth aspect, another embodiment of this application provides an electronic device, including: a memory and a processor, wherein the memory stores a computer program that can run on the processor, and when the processor executes the computer program, it implements the steps of the method described in the first or second aspect above.
[0045] In a seventh aspect, another embodiment of this application provides a readable storage medium storing a computer program, which, when executed by a processor, performs the steps of the method as described in the first or second aspect above.
[0046] The beneficial effects of the embodiments of this application include:
[0047] This application provides a method, apparatus, system, electronic device, and readable storage medium for processing trip information. At the vehicle-mounted terminal, a target detection model detects the presence of an object in the acquired driver's seat image. The current detection result is compared with the previous detection result to obtain a trip determination result, which in turn sends trip information to a cloud server. At the cloud server, the server receives the trip information and the current driver's seat image from the vehicle-mounted terminal. The trip information indicates the start or end of the trip. Facial recognition is performed using pre-stored driver information and the current driver's seat image to identify the target driver in the current driver's seat image. Based on the trip information, the target driver's trip information is determined. Specifically, at the vehicle-mounted terminal, the trip determination result triggers the sending of trip information and the driver's seat image to the cloud server, and the cloud server identifies the target driver in the driver's seat image to obtain the target driver's trip information. Compared with existing technologies that frequently send driver's seat images, this solution avoids wasting communication and cloud server resources, reduces implementation costs, and the driver's seat images are captured non-timed. For application scenarios that require obtaining short-distance driving trip information, this solution avoids the problem of inaccurate driver trip times caused by timed capture, thus improving the accuracy of the target driver's trip information. Attached Figure Description
[0048] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of this application and should not be regarded as a limitation of the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.
[0049] Figure 1 A flowchart of a trip information processing method provided in an embodiment of this application is shown;
[0050] Figure 2 A flowchart of another itinerary information processing method provided in an embodiment of this application is shown;
[0051] Figure 3 This paper shows a schematic diagram of the structure of a trip information processing device provided in an embodiment of this application;
[0052] Figure 4 This invention provides a schematic diagram of the structure of another trip information processing device according to an embodiment of the present application.
[0053] Figure 5 This paper illustrates a functional flowchart of a trip information processing system provided in an embodiment of this application.
[0054] Figure 6A schematic diagram of the structure of an electronic device provided in an embodiment of this application is shown. Detailed Implementation
[0055] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. It should be understood that the accompanying drawings in this application are for illustrative and descriptive purposes only and are not intended to limit the scope of protection of this application. Furthermore, it should be understood that the schematic drawings are not drawn to scale. The flowcharts used in this application illustrate operations implemented according to some embodiments of this application. It should be understood that the operations in the flowcharts may not be implemented in sequence, and steps without logical contextual relationships may be reversed or implemented simultaneously. In addition, those skilled in the art, guided by the content of this application, may add one or more other operations to the flowcharts, or remove one or more operations from the flowcharts.
[0056] Furthermore, the described embodiments are merely some, not all, of the embodiments of this application. The components of the embodiments of this application described and illustrated herein can typically be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of this application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely to illustrate selected embodiments of the application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without inventive effort are within the scope of protection of this application.
[0057] It should be noted that the term "comprising" will be used in the embodiments of this application to indicate the presence of the features declared thereafter, but does not exclude the addition of other features.
[0058] Example 1:
[0059] This invention provides a trip information processing method applied to an in-vehicle infotainment system. See [link to relevant documentation]. Figure 1 The flowchart shown is a method for processing travel information, including:
[0060] Step S101: Obtain the current driver's seat image of the vehicle.
[0061] Specifically, a Driver Monitor System (DMS) camera can be installed in the driver's seat of the vehicle. The DMS camera captures images of the driver's seat in real time and transmits them to the vehicle's onboard unit, which includes a processor, memory, and wireless transmission module. The onboard unit can acquire, store, process, and transmit the data sent by the onboard unit.
[0062] Step S102: Input the current driver's seat image into the preset target detection model for detection, and output the current detection result. The current detection result is used to indicate whether there is an object in the driver's seat.
[0063] Specifically, the face image information database is an image dataset used for computer vision training. The object detection model is a face object detection model trained based on a lightweight object detection algorithm and the aforementioned face image information database. Lightweight object detection algorithms such as Nanodet are used to train face object detection models, which are characterized by high speed, low cost, and high performance. After the in-vehicle terminal device acquires the current driver's seat image of the vehicle, it uses the face object detection model running on the in-vehicle terminal device to detect whether there is an object in the current driver's seat image. In this embodiment, this object is indicated as a person, and the detection result is used to indicate whether there is a person in the driver's seat.
[0064] Step S103: Compare the current detection result with the previous detection result to obtain a trip determination result. The trip determination result is used to indicate whether the trip has started, ended, not started, or is in progress.
[0065] Optionally, the vehicle-mounted terminal can execute the steps of this embodiment according to a preset cycle. In each cycle, the vehicle-mounted terminal can obtain a current detection result through step S102 and record the current detection result. Then, in the next cycle, the recorded current detection result is used as the previous detection result of the current detection result in the next cycle. For example, the vehicle-mounted terminal obtains a current detection result A through step S102 in cycle T. When entering cycle T+1, the vehicle-mounted terminal obtains a current detection result B through step S102. B is the previous detection result of A. By comparing A and B, the vehicle-mounted terminal can obtain a trip determination result. It should be understood that the vehicle-mounted terminal can obtain a trip determination result in each cycle.
[0066] Specifically, the current detection result and the previous detection result are used to indicate whether there is a person in the driver's seat. Comparing these two results yields a trip determination result, which indicates whether the trip has started, ended, not started, or is in progress. If the current detection result indicates that there is a person in the driver's seat, and the previous detection result indicates that there is no person in the driver's seat, the trip determination result is determined to be the start of the trip. If the current detection result indicates that there is no person in the driver's seat, and the previous detection result indicates that there is a person in the driver's seat, the trip determination result is determined to be the end of the trip. If the current detection result indicates that there is a person in the driver's seat, and the previous detection result indicates that there is a person in the driver's seat, the trip determination result is determined to be the in progress of the trip. If the current detection result indicates that there is no person in the driver's seat, and the previous detection result indicates that there is no person in the driver's seat, the trip determination result is determined to be the beginning of the trip.
[0067] Step S104: Based on the trip determination result, send the trip information and the current driver's seat image to the cloud server. The trip information is used to indicate the start or end of the trip.
[0068] Specifically, if the determination result indicates the start of the trip, first trip information is sent to the cloud server, indicating the start of the trip; if the determination result indicates the end of the trip, second trip information is sent to the cloud server, indicating the end of the trip. At this time, the in-vehicle terminal device sends the trip information and the current driver's seat image to the cloud server via a wireless network. The first trip information includes the trip start time and trip start flag, and the second trip information includes the trip end time and trip end flag.
[0069] This invention provides a method for processing trip information, specifically by acquiring a current driver's seat image of a vehicle; inputting the current driver's seat image into a preset target detection model for detection, and outputting a current detection result, which indicates whether an object exists in the driver's seat; comparing the current detection result with the previous detection result to obtain a trip determination result, which indicates whether the trip has started, ended, not started, or is in progress; and sending trip information and the current driver's seat image to a cloud server based on the trip determination result, whereby the trip information indicates whether the trip has started or ended. In this embodiment, sending the trip information and driver's seat image to the cloud server is triggered on the vehicle's infotainment system based on the trip determination result. Compared to existing technologies that require frequent acquisition and transmission of driver's seat images, this method avoids wasting communication and cloud server resources, reduces implementation costs, and eliminates the problem of delayed trip information transmission by sending the driver's seat image in a timely manner based on the trip determination result, as the driver's seat image is not captured periodically. This improves the accuracy of the target driver's trip information.
[0070] Example 2:
[0071] This invention provides another method for processing travel information, applied to a cloud server. Figure 2 A flowchart of another trip information processing method provided in an embodiment of this application is shown.
[0072] Step S301: Receive trip information and current driver's seat image sent by the vehicle terminal. The trip information is used to indicate the start or end of the trip.
[0073] Specifically, the vehicle-mounted terminal device includes a processor, memory, and wireless transmission module. This device can acquire, store, process, and transmit data sent by other vehicle-mounted devices. The cloud server receives trip information and the current driver's seat image; the trip information may include the time point and trip start or end markers.
[0074] Step S302: Perform facial recognition using multiple pre-stored driver information and the current driver's seat image to determine the target driver in the driver's seat image. The driver information includes: driver's facial image and driver's identifier.
[0075] Specifically, the driver information includes the driver's facial image and the driver's identifier. The driver's facial image in the driver's seat image is compared with the driver's facial images in each driver information to obtain the target driver's facial image that matches the current driver's seat image. The driver corresponding to the target driver's facial image is taken as the target driver.
[0076] Step S303: Determine the target trip information of the target driver based on the trip information.
[0077] Specifically, if the trip information indicates the start of the trip, the start time of the target driver's trip is determined based on the trip information or the current time; if the trip information indicates the end of the trip, the end time of the target driver's trip is determined based on the trip information or the current time.
[0078] Another trip information processing method provided in this embodiment of the invention specifically involves receiving trip information and a current driver's seat image sent by a vehicle-mounted terminal. The trip information indicates the start or end of a trip. Facial recognition is performed using pre-stored driver information and the current driver's seat image to determine the target driver in the driver's seat image. The driver information includes a driver's facial image and a driver's identifier. Based on the trip information, the target trip information of the target driver is determined. In this embodiment, the received driver's seat image is used for facial recognition via a cloud server to determine the target driver, achieving the effect of accurately obtaining the target driver's target trip information.
[0079] Example 3:
[0080] Reference Figure 3 The diagram shown is a structural schematic of a trip information processing device provided in Embodiment 3 of this application. The device includes: an acquisition module, a detection module, a comparison module, and an identification module; wherein,
[0081] The acquisition module 401 is used to acquire the current driver's seat image of the vehicle;
[0082] Detection module 402 is used to input the current driver's seat image into a preset target detection model for detection and output the current detection result, which is used to indicate whether there is an object in the driver's seat;
[0083] The comparison module 403 is used to compare the current detection result with the previous detection result to obtain a trip determination result. The trip determination result is used to indicate whether the trip has started, the trip has ended, the trip has not started, or the trip is in progress.
[0084] The identification module 404 is used to send trip information and the current driver's seat image to the cloud server based on the trip determination result. The trip information is used to indicate the start or end of the trip.
[0085] As an optional implementation, the detection module 402 is further configured to:
[0086] The face target detection model is obtained by training the model based on a lightweight target detection algorithm and a pre-set face image information database.
[0087] As an optional implementation, the comparison module 403 is specifically used for:
[0088] If the current detection result indicates that there is an object in the driver's seat, and the previous detection result indicates that there is no object in the driver's seat, then the trip determination result is determined to be the start of the trip;
[0089] If the current detection result indicates that there is no object in the driver's seat, and the previous detection result indicates that there is an object in the driver's seat, then the trip determination result is determined to be the end of the trip;
[0090] If the current detection result indicates that there is an object in the driver's seat, and the previous detection result indicates that there is an object in the driver's seat, then the trip determination result is determined to be a trip in progress;
[0091] If the current detection result indicates that there is no object in the driver's seat, and the previous detection result indicates that there is no object in the driver's seat, then the trip determination result is determined to be that the trip has not started.
[0092] As an optional implementation, the identification module 404 is specifically used for:
[0093] If the determination result is that the trip has started, then the first trip information is sent to the cloud server, and the first trip information is used to indicate that the trip has started;
[0094] If the determination result is that the trip has ended, then a second trip information is sent to the cloud server, which is used to indicate that the trip has ended.
[0095] The processing flow of each module in the device and the interaction flow between each module can be referred to the relevant descriptions in the above method embodiments, and will not be detailed here.
[0096] Example 4:
[0097] Reference Figure 4 The diagram shown is a structural schematic of another trip information processing device provided in Embodiment 4 of this application. The device includes: a trip receiving module, a face recognition module, and a trip determination module; wherein,
[0098] The trip receiving module 501 is used to receive trip information and the current driver's seat image sent by the vehicle terminal. The trip information is used to indicate the start or end of the trip.
[0099] The face recognition module 502 is used to perform face recognition by using multiple pre-stored driver information and the current driver seat image to determine the target driver in the driver seat image. The driver information includes: driver facial image and driver identification.
[0100] The trip determination module 503 is used to determine the target trip information of the target driver based on the trip information.
[0101] As an optional implementation, the receiving process module 501 is specifically used for:
[0102] Receive trip information and current driver's seat image sent by the vehicle terminal, wherein the trip information is used to indicate the start or end of the trip;
[0103] Facial recognition is performed using multiple pre-stored driver information entries and the current driver's seat image to determine the target driver in the driver's seat image. The driver information includes: the driver's facial image and the driver's identifier.
[0104] Based on the trip information, the target trip information of the target driver is determined.
[0105] As an optional implementation, the face recognition module 502 is specifically used for:
[0106] The driver's facial image in the current driver image is compared with each driver image in the driver information to obtain a target driver's facial image that matches the current driver's seat image;
[0107] The driver corresponding to the facial image of the target driver is taken as the target driver.
[0108] As an optional implementation, the trip determination module 503 is specifically used for:
[0109] If the trip information indicates the start of the trip, then the start time of the target driver's trip is determined based on the trip information or the current time;
[0110] If the trip information indicates the end of the trip, then the trip end time of the target driver is determined based on the trip information or the current time.
[0111] The processing flow of each module in the device and the interaction flow between each module can be referred to the relevant descriptions in the above method embodiments, and will not be detailed here.
[0112] Example 5:
[0113] Reference Figure 5As shown, this is a trip information processing system provided in Embodiment 5 of this application, including: a vehicle terminal and a cloud server;
[0114] The vehicle-mounted system is used to acquire the current driver's seat image; input the current driver's seat image into a preset target detection model for detection, and output the current detection result, which indicates whether there is an object in the driver's seat. The face target detection model is obtained by training the target detection algorithm on the vehicle-mounted system using processed face images, and is used to detect whether there is a person in the driver's seat; compare the current detection result with the previous detection result to obtain a trip determination result, which indicates whether the trip has started, ended, not started, or is in progress; based on the trip determination result, send trip information and the current driver's seat image to the cloud server, whereby the trip information indicates whether the trip has started or ended.
[0115] The cloud server is used to receive trip information and the current driver's seat image sent by the vehicle terminal. The trip information is used to indicate the start or end of the trip. The server performs facial recognition using multiple pre-stored driver information and the current driver's seat image to determine the target driver in the driver's seat image. The driver information includes: the driver's facial image and the driver's identifier. The server determines the target trip information of the target driver based on the trip information.
[0116] Example 6:
[0117] Figure 6 Please refer to the schematic diagram of the electronic device provided in the embodiments of this application. Figure 6 An electronic device includes: a memory 400 and a processor 500. The memory 400 stores a computer program that can run on the processor 500. When the processor 500 executes the computer program, it implements the steps of the above-mentioned trip information processing method.
[0118] Example 7:
[0119] This application also provides a readable storage medium storing a computer program, which, when run by a processor, executes the steps of the above-described process information processing method.
[0120] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems and devices described above can be referred to the corresponding processes in the method embodiments, and will not be repeated here. In the several embodiments provided in this application, it should be understood that the disclosed systems, devices, and methods can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods. Furthermore, multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed mutual coupling or direct coupling or communication connection can be through some communication interfaces; the indirect coupling or communication connection of devices or modules can be electrical, mechanical, or other forms.
[0121] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. If the functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this invention, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0122] The above are merely specific embodiments of this application, but the scope of protection of this application is not limited thereto. Any changes or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application.
Claims
1. A method for processing travel information, characterized in that, Applied to in-vehicle infotainment systems, the method includes: Obtain the current driver's seat image of the vehicle; The current driver's seat image is input into a preset target detection model for detection, and the current detection result is output. The current detection result is used to indicate whether there is an object in the driver's seat. The current detection result is compared with the previous detection result to obtain a trip determination result, which is used to indicate whether the trip has started, ended, not started, or is in progress. Based on the trip determination result, the trip information and the current driver's seat image are sent to the cloud server. The trip information is used to indicate the start or end of the trip.
2. The itinerary information processing method according to claim 1, characterized in that, Before inputting the current driver's seat image into a preset target detection model for detection and outputting the current detection result, the method further includes: The target detection model is obtained by training a model based on a lightweight target detection algorithm and a pre-set face image information database.
3. The itinerary information processing method according to claim 1, characterized in that, The step of comparing the current detection result with the previous detection result to obtain the travel determination result includes: If the current detection result indicates that there is an object in the driver's seat, and the previous detection result indicates that there is no object in the driver's seat, then the trip determination result is determined to be the start of the trip; If the current detection result indicates that there is no object in the driver's seat, and the previous detection result indicates that there is an object in the driver's seat, then the trip determination result is determined to be the end of the trip; If the current detection result indicates that there is an object in the driver's seat, and the previous detection result indicates that there is an object in the driver's seat, then the trip determination result is determined to be a trip in progress; If the current detection result indicates that there is no object in the driver's seat, and the previous detection result indicates that there is no object in the driver's seat, then the trip determination result is determined to be that the trip has not started.
4. The itinerary information processing method according to claim 1, characterized in that, The step of sending trip information and the current driver's seat image to the cloud server based on the trip determination result includes: If the determination result is that the trip has started, then the first trip information is sent to the cloud server, and the first trip information is used to indicate that the trip has started; If the determination result is that the trip has ended, then a second trip information is sent to the cloud server, which is used to indicate that the trip has ended.
5. A method for processing travel information, characterized in that, Applied to a cloud server, the method includes: The system receives trip information and a current driver's seat image sent by the vehicle's infotainment system. The trip information is used to indicate whether the trip has started or ended. The trip information is sent by the vehicle's infotainment system based on a trip determination result, which is obtained by comparing the current detection result with the previous detection result. This result indicates whether the trip has started, ended, not started, or is in progress. The current detection result is obtained by inputting the current driver's seat image of the vehicle into a preset target detection model for detection and outputting the current detection result. The current detection result indicates whether there is an object in the driver's seat. Facial recognition is performed using multiple pre-stored driver information entries and the current driver's seat image to determine the target driver in the driver's seat image. The driver information includes: the driver's facial image and the driver's identifier. Based on the trip information, the target trip information of the target driver is determined.
6. The itinerary information processing method according to claim 5, characterized in that, The step of determining the target driver in the driver's seat image by performing facial recognition using multiple pre-stored driver information and the current driver's seat image includes: The driver's facial image in the current driver image is compared with each driver image in the driver information to obtain a target driver's facial image that matches the current driver's seat image; The driver corresponding to the facial image of the target driver is taken as the target driver.
7. The itinerary information processing method according to claim 5, characterized in that, The step of determining the target driver's target trip information based on the trip information includes: If the trip information indicates the start of the trip, then the start time of the target driver's trip is determined based on the trip information or the current time; If the trip information indicates the end of the trip, then the trip end time of the target driver is determined based on the trip information or the current time.
8. A trip information processing system, characterized in that, This includes the vehicle-mounted infotainment system and cloud servers; The vehicle-mounted terminal is used to execute the steps of the method described in any one of claims 1-4, to send trip information and driver's seat image to the cloud server; The cloud server is used to execute the steps of the method according to any one of claims 5-7 to obtain the driver's target trip information.
9. An electronic device, characterized in that, include: The device includes a processor and a memory, the memory storing machine-readable instructions executable by the processor, which, when the electronic device is in operation, are executed by the processor to perform the steps of the trip information processing method as described in any one of claims 1-4 or 5-7.
10. A readable storage medium, characterized in that, The readable storage medium stores a computer program that, when executed by a processor, performs the steps of the trip information processing method as described in any one of claims 1-4 or 5-7.
Citation Information
Patent Citations
Driver identification based on face data
US20130073114A1