Task vehicle real-time monitoring method and device based on starting state

Abstract

The invention discloses a task vehicle real-time monitoring method and device based on a starting state, and the method comprises the steps: enabling a vehicle controller disposed on a task vehicle to upload the current positioning information to a vehicle task system, and generating a planned driving navigation path based on the current positioning information and a target address where a target task is located; issuing the planned driving navigation path and the target task to a vehicle controller of the task vehicle; establishing a first communication link with information of other task execution target vehicles executing the target task; real-time monitoring data acquisition is carried out; real-time positioning data and real-time speed data in the real-time monitoring data are shared with other target vehicles executing tasks; and carrying out driver fatigue analysis processing, and carrying out driver fatigue early warning processing based on a driver fatigue analysis result. In the embodiment of the invention, the driver can be reminded of fatigue driving in time, and meanwhile, the conditions of other vehicles executing the target task together can be known in time.

Description

Technical Field

[0001] The present invention relates to the technical field of data processing, and in particular to a method and device for real-time monitoring of a task vehicle based on a startup state. Background Art

[0002] Real-time vehicle monitoring technology is a method that uses advanced sensors, communications and data analysis technologies to continuously monitor and analyze the location, status, performance and driving behavior of vehicles. The background of this technology stems from the increasing demand for vehicle safety, efficiency and management. It enables the fields of fleet management, traffic management, vehicle safety and vehicle maintenance to obtain and analyze vehicle-related data in real time, thereby improving the efficiency of transportation, reducing the risk of accidents, reducing fuel consumption and reducing vehicle maintenance costs. At the same time, real-time vehicle monitoring technology also provides key data support for the development of intelligent transportation systems and autonomous driving technologies, helping to build a safer, smarter and more sustainable transportation system.

[0003] While real-time vehicle monitoring technology provides many benefits, it also has a series of potential technical drawbacks. First, there are privacy issues involved, because such monitoring covers sensitive information such as vehicle location and driver behavior, which may raise privacy concerns. Second, data security issues are also a challenge, because the system processes a large amount of sensitive data, with potential data leakage and hacker attacks. Third, initial cost issues, including the acquisition and installation of hardware, software, and communication services, may put a heavy pressure on the budget. In addition, data overload may lead to information confusion and inappropriate intervention. False alarms and driver resistance may reduce the actual benefits of the system, while technical failures may have a negative impact on normal operations. Finally, regulatory and legal issues also need to be considered, because there may be regulatory and legal restrictions on vehicle monitoring in some areas. Therefore, when adopting real-time vehicle monitoring technology, its advantages and disadvantages must be carefully weighed to ensure the effectiveness and legality of the system, and to address issues related to privacy, security, cost, data management, and regulatory compliance where possible. Summary of the invention

[0004] The purpose of the present invention is to overcome the shortcomings of the prior art. The present invention provides a real-time monitoring method and device for task vehicles based on the startup status, and performs corresponding processing on the vehicle side for the collected real-time monitoring data to ensure the privacy of the user. At the same time, the real-time position of the vehicle can be shared with other vehicles that perform the same target task together, so that the driver can be reminded of fatigue driving in time, and the status of other vehicles that perform the target task together can be understood in time.

[0005] In order to solve the above technical problems, an embodiment of the present invention provides a method for real-time monitoring of a task vehicle based on a startup state, the method comprising:

[0006] When the task vehicle is started, the vehicle controller arranged on the task vehicle uploads the current positioning information to the vehicle task system, and the vehicle task system generates a planned driving navigation path based on the current positioning information and the target address of the target task;

[0007] The vehicle task system sends the planned driving navigation path and the target task to the vehicle controller of the task vehicle, wherein the target task includes information of a target vehicle for executing the target task;

[0008] The vehicle controller on the task vehicle establishes a first communication link based on the target task and information of other target vehicles executing the target task;

[0009] The vehicle controller collects real-time monitoring data based on a plurality of sensor devices arranged on the task vehicle to obtain real-time monitoring data, wherein the real-time monitoring data includes real-time positioning data, real-time speed data and real-time driver status monitoring data;

[0010] Sharing the real-time positioning data and the real-time speed data in the real-time monitoring data with other target vehicles performing the mission based on the established first communication link;

[0011] A driver fatigue analysis process is performed based on the driver status monitoring data in the real-time monitoring data, and a driver fatigue warning process is performed based on the driver fatigue analysis result.

[0012] Optionally, the vehicle controller disposed on the task vehicle uploads the current positioning information to the vehicle task system, and the vehicle task system generates a planned driving navigation path based on the current positioning information and the target address of the target task, including:

[0013] The vehicle controller installed on the task vehicle starts the positioning system to perform positioning processing on the current location of the task vehicle to obtain current positioning information;

[0014] The vehicle controller uploads the current positioning information to the vehicle mission system based on a network transmission protocol, and the current positioning information is marked with the vehicle number of the mission vehicle;

[0015] The vehicle task system matches the corresponding target task according to the vehicle number included in the current positioning information, and the target task includes a target address;

[0016] The vehicle task system generates a planned driving navigation path according to the current positioning information and the target address of the target task.

[0017] Optionally, before the task vehicle is started, the method further includes:

[0018] The vehicle task system establishes a second communication link with the user terminal where the task management user is located based on identity authentication, and sends a vehicle management detailed list to the user terminal, the vehicle management detailed list including the vehicle number, whether the vehicle is in an idle state, and the time when the vehicle last executed the target task;

[0019] The vehicle task system receives a target task generated by the management user on the user terminal based on the vehicle management list, and selects a task vehicle to execute the target task from the target task;

[0020] The vehicle task system notifies a driver user corresponding to the task vehicle based on the task vehicle executing the target task.

[0021] Optionally, the vehicle task system receives the target task generated by the management user on the user terminal based on the vehicle management list operation, including:

[0022] The management user inputs a target task type on the user terminal, and selects vehicle numbers in an idle state in the vehicle management list according to the target task type;

[0023] According to the required number of vehicles input by the management user, the vehicles corresponding to the corresponding number of vehicle numbers are selected from the vehicle numbers in the idle state according to the idle time from the longest to the shortest as the target vehicles for executing the task;

[0024] The user terminal generates the target task according to the target task type, the target vehicle for executing the task and the target address operation, and sends the target task to the vehicle task system.

[0025] Optionally, the vehicle mission system sends the planned driving navigation path and the target mission to a vehicle controller of the mission vehicle, including:

[0026] The vehicle task system confirms the assigned task vehicle according to the vehicle number included in the planned driving navigation path;

[0027] The planned driving navigation path and the target task are sent to the vehicle controller of the confirmed task vehicle.

[0028] Optionally, the vehicle controller on the task vehicle establishes a first communication link based on the target task and information of other task target vehicles that execute the target task, including:

[0029] The vehicle controller of the task vehicle obtains information of other target vehicles for performing the task based on the target task, and establishes a communication link with the task vehicles corresponding to the other target vehicles for performing the task based on the vehicle task system.

[0030] Optionally, the vehicle controller collects real-time monitoring data based on a plurality of sensor devices arranged on the task vehicle to obtain real-time monitoring data, including:

[0031] The vehicle controller starts a plurality of sensor devices arranged on the task vehicle, wherein the plurality of sensor devices include a positioning sensor device, a speed sensor device and a video acquisition device;

[0032] The vehicle controller controls the positioning sensor device and the speed sensor device to collect positioning monitoring data and speed monitoring data according to a preset collection frequency, and at the same time controls the video collection device to adjust the video collection angle to collect video monitoring data of the driver on the task vehicle to obtain real-time monitoring data.

[0033] Optionally, the step of sharing the real-time positioning data and the real-time speed data in the real-time monitoring data with other target vehicles performing the mission based on the established first communication link includes:

[0034] The mission vehicle uploads the real-time positioning data and the real-time speed data in the real-time monitoring data to the vehicle mission system based on the first communication connection;

[0035] The vehicle mission system shares the received real-time positioning data and real-time speed data with other mission target vehicles based on the first communication connection.

[0036] Optionally, the performing driver fatigue analysis based on the driver status monitoring data in the real-time monitoring data, and performing driver fatigue warning based on the driver fatigue analysis result, includes:

[0037] Performing video frame extraction processing on the driver status monitoring data in the real-time monitoring data to form a video image frame sequence;

[0038] Inputting the video images in the video image frame sequence into the driver fatigue recognition model in order to perform recognition and analysis processing, and outputting the driver fatigue analysis result;

[0039] Performing driver fatigue warning processing based on the driver fatigue analysis result;

[0040] The driver fatigue recognition model is a convergent model trained by inputting video images of the driver's driving process marked by experts into a deep neural network model.

[0041] In addition, an embodiment of the present invention further provides a task vehicle real-time monitoring device based on the startup state, the device comprising:

[0042] Navigation planning module: used for uploading the current positioning information to the vehicle task system by the vehicle controller arranged on the task vehicle when the task vehicle is started, and the vehicle task system generates a planned driving navigation path based on the current positioning information and the target address of the target task;

[0043] Task sending module: used for the vehicle task system to send the planned driving navigation path and the target task to the vehicle controller of the task vehicle, wherein the target task includes information of the target vehicle for executing the target task;

[0044] Communication establishment module: used for the vehicle controller on the task vehicle to establish a first communication link with information of other task target vehicles executing the target task based on the target task;

[0045] Real-time monitoring module: used for the vehicle controller to collect real-time monitoring data based on a number of sensor devices installed on the task vehicle to obtain real-time monitoring data, which includes real-time positioning data, real-time speed data and real-time driver status monitoring data;

[0046] Sharing module: used for sharing the real-time positioning data and the real-time speed data in the real-time monitoring data with other target vehicles performing the mission based on the established first communication link;

[0047] Fatigue warning module: used to perform driver fatigue analysis based on the driver status monitoring data in the real-time monitoring data, and perform driver fatigue warning based on the driver fatigue analysis results.

[0048] In an embodiment of the present invention, the collected real-time monitoring data is processed accordingly on the vehicle side to ensure the privacy of the user. At the same time, the real-time location of the vehicle can be shared with other vehicles that perform the same target task together, so that the driver can be reminded of fatigue driving in time, and the status of other vehicles that perform the target task together can be understood in time. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0050] Figure 1is a flow chart of a method for real-time monitoring of a task vehicle based on a startup state in an embodiment of the present invention;

[0051] Figure 2 It is a schematic diagram of the structural composition of a task vehicle real-time monitoring device based on the startup state in an embodiment of the present invention. DETAILED DESCRIPTION

[0052] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0053] For example, see Figure 1 , Figure 1 It is a flowchart of a method for real-time monitoring of a task vehicle based on a startup state in an embodiment of the present invention.

[0054] like Figure 1 As shown, a method for real-time monitoring of a mission vehicle based on a startup state comprises:

[0055] S11: When the task vehicle is started, the vehicle controller installed on the task vehicle uploads the current positioning information to the vehicle task system, and the vehicle task system generates a planned driving navigation path based on the current positioning information and the target address of the target task;

[0056] In the specific implementation process of the present invention, the vehicle controller set on the task vehicle uploads the current positioning information to the vehicle task system, and the vehicle task system generates a planned driving navigation path based on the current positioning information and the target address of the target task, including: the vehicle controller set on the task vehicle starts the positioning system, performs positioning processing on the current location of the task vehicle, and obtains the current positioning information; the vehicle controller uploads the current positioning information to the vehicle task system based on the network transmission protocol, and the current positioning information is marked with the vehicle number of the task vehicle; the vehicle task system matches the corresponding target task according to the vehicle number contained in the current positioning information, and the target task contains a target address; the vehicle task system generates a planned driving navigation path according to the current positioning information and the target address of the target task.

[0057] Furthermore, before the task vehicle is started, it also includes: the vehicle task system establishes a second communication link with the user terminal where the task management user is located based on identity authentication, and sends a vehicle management list to the user terminal, the vehicle management list including the vehicle number, whether the vehicle is in an idle state, and the last time the vehicle executed the target task; the vehicle task system receives the target task generated by the management user on the user terminal based on the vehicle management list operation, and selects a task vehicle to execute the target task from the target task; the vehicle task system notifies the driver user corresponding to the task vehicle based on the task vehicle that executes the target task.

[0058] Furthermore, the vehicle task system receives a target task generated by the management user on the user terminal based on the vehicle management list operation, including: the management user inputs a target task type on the user terminal, and filters out vehicle numbers in an idle state in the vehicle management list according to the target task type; based on the required number of vehicles input by the management user, vehicles corresponding to a corresponding number of vehicle numbers are selected from the filtered idle vehicle numbers according to the idle time from long to short as target vehicles for executing the task; the user terminal generates the target task according to the target task type, the target vehicle for executing the task and the target address operation, and sends the target task to the vehicle task system.

[0059] Specifically, after the task vehicle is started, the vehicle controller installed on the task vehicle starts the positioning system, and then performs positioning processing through the positioning system, that is, the current location of the task vehicle is positioned and processed to obtain the current positioning information; after obtaining the current positioning information, the vehicle controller uploads the current positioning information to the vehicle task system through the network transmission protocol, wherein the current positioning information is marked with the vehicle number of the task vehicle.

[0060] After the vehicle task system receives the current positioning information, it needs to perform matching processing based on the vehicle number contained in the current positioning information to match the corresponding target task, where the target task also includes the target address, that is, the address where the target task is to be executed; finally, the vehicle task system can perform navigation path planning processing based on the current positioning information and the target address of the target task to generate a planned navigation path.

[0061] Before the task vehicle is started, the vehicle task system will establish a second communication link with the user terminal where the task management user is located based on identity authentication, and send a vehicle management details list to the user terminal, where the vehicle management list includes the vehicle number, whether the vehicle is idle, and the last time the vehicle executed the target task; in this way, the user can understand the status of the vehicles managed by the vehicle task system; then the vehicle task system receives the target task generated by the management user on the user terminal based on the vehicle management details list operation, where the task vehicle selected to execute the target task is selected in the target task; the vehicle task system notifies the driver user corresponding to the task vehicle of the task vehicle that executes the target task.

[0062] In the process of generating the target task, the management user inputs the target task type on the user terminal, and filters out the vehicle numbers in the idle state in the vehicle management details table according to the target task type; then, according to the required number of vehicles input by the management user, the vehicles corresponding to the corresponding number of vehicle numbers in the idle state are selected from the filtered out vehicle numbers according to the idle time from long to short as the target vehicles for executing the task; finally, the user terminal will generate the target task according to the target task type, the target vehicle for executing the task and the target address operation, and send the target task to the vehicle task system.

[0063] S12: The vehicle task system sends the planned driving navigation path and the target task to the vehicle controller of the task vehicle, wherein the target task includes information of a target vehicle for executing the target task;

[0064] During the specific implementation of the present invention, the vehicle task system sends the planned driving navigation path and the target task to the vehicle controller of the task vehicle, including: the vehicle task system confirms the task vehicle to be sent according to the vehicle number contained in the planned driving navigation path; and sends the planned driving navigation path and the target task to the vehicle controller of the confirmed and sent task vehicle.

[0065] Specifically, in the vehicle task system, the task vehicle to be issued is confirmed according to the vehicle number included in the planned driving navigation path; and then the planned driving navigation path and the target task are issued to the vehicle controller of the confirmed task vehicle.

[0066] S13: The vehicle controller on the task vehicle establishes a first communication link based on the target task and information of other target vehicles executing the target task;

[0067] In the specific implementation process of the present invention, the vehicle controller on the task vehicle establishes a first communication link based on the target task with the information of the remaining target vehicles executing the target task, including: the vehicle controller of the task vehicle obtains the information of the remaining target vehicles executing the target task based on the target task, and establishes a communication link with the task vehicles corresponding to the remaining target vehicles executing the target task based on the vehicle task system.

[0068] Specifically, the vehicle controller of the task vehicle obtains the information of other target vehicles performing the task through the target task, and then uses the vehicle task system as an intermediate node to establish a communication link with the task vehicles corresponding to the information of other target vehicles performing the task; in this way, the task vehicle will be able to share its location with other task vehicles performing the same target task, etc., so that some information between other vehicles performing the same target task can be shared in real time, and the situations between the task vehicles can be understood from each other.

[0069] S14: the vehicle controller collects real-time monitoring data based on a plurality of sensor devices arranged on the task vehicle to obtain real-time monitoring data, wherein the real-time monitoring data includes real-time positioning data, real-time speed data and real-time driver status monitoring data;

[0070] In the specific implementation process of the present invention, the vehicle controller performs real-time monitoring data collection based on a number of sensor devices installed on the task vehicle to obtain real-time monitoring data, including: the vehicle controller starts a number of sensor devices installed on the task vehicle, and the several sensor devices include a positioning sensor device, a speed sensor device and a video acquisition device; the vehicle controller controls the positioning sensor device and the speed sensor device to collect positioning monitoring data and speed monitoring data according to a preset acquisition frequency, and at the same time controls the video acquisition device to adjust the video acquisition angle to collect video monitoring data of the driver on the task vehicle to obtain real-time monitoring data.

[0071] Specifically, the vehicle controller will start several sensor devices installed on the task vehicle, wherein these sensor devices at least include a positioning sensor device, a speed sensor device and a video acquisition device; then the vehicle controller controls the positioning sensor device and the speed sensor device to collect and process the positioning monitoring data and the speed monitoring data according to a predetermined acquisition frequency, so as to obtain the corresponding positioning monitoring data and the speed monitoring data, and at the same time controls the video acquisition device to adjust the video acquisition angle to aim at the driver, and then collects video monitoring data of the driver on the task vehicle to obtain real-time monitoring video data, which is composed of the positioning monitoring data, the speed monitoring data and the real-time monitoring video data.

[0072] S15: sharing the real-time positioning data and the real-time speed data in the real-time monitoring data with other target vehicles performing the mission based on the established first communication link;

[0073] In the specific implementation process of the present invention, the real-time positioning data and real-time speed data in the real-time monitoring data are shared with other target vehicles performing the mission based on the established first communication link, including: the mission vehicle uploads the real-time positioning data and real-time speed data in the real-time monitoring data to the vehicle mission system based on the first communication connection; the vehicle mission system shares the received real-time positioning data and real-time speed data with other target vehicles performing the mission based on the first communication connection.

[0074] Specifically, the task vehicle will upload the real-time positioning data and real-time speed data in the real-time monitoring data to the vehicle task system according to the first communication connection; then the vehicle task system will share the received real-time positioning data and real-time speed data with the remaining target vehicles performing the task through the first communication link.

[0075] S16: Perform driver fatigue analysis based on the driver status monitoring data in the real-time monitoring data, and perform driver fatigue warning based on the driver fatigue analysis result.

[0076] In the specific implementation process of the present invention, the driver fatigue analysis is performed based on the driver status monitoring data in the real-time monitoring data, and the driver fatigue warning is performed based on the driver fatigue analysis result, including: performing video frame extraction processing on the driver status monitoring data in the real-time monitoring data to form a video image frame sequence; inputting the video images in the video image frame sequence into a driver fatigue recognition model in sequence for recognition and analysis, and outputting the driver fatigue analysis result; performing driver fatigue warning based on the driver fatigue analysis result; wherein the driver fatigue recognition model is a convergent model trained by inputting video images labeled by experts during the driver's driving process into a deep neural network model.

[0077] Specifically, it is first necessary to perform video frame extraction processing on the driver status monitoring data in the real-time monitoring data to form a video image frame sequence; then the video images in the video image frame sequence need to be sequentially input into the driver fatigue recognition model for recognition and analysis processing, and the driver fatigue analysis results need to be output; then after obtaining the driver fatigue analysis results, it is necessary to perform driver fatigue warning processing based on the driver fatigue analysis results; at the same time, the driver fatigue analysis results are fed back to the vehicle task system, wherein the driver fatigue recognition model is a convergent model trained by inputting video images of the driver's driving process marked by experts into a deep neural network model.

[0078] In an embodiment of the present invention, the collected real-time monitoring data is processed accordingly on the vehicle side to ensure the privacy of the user. At the same time, the real-time location of the vehicle can be shared with other vehicles that perform the same target task together, so that the driver can be reminded of fatigue driving in time, and the status of other vehicles that perform the target task together can be understood in time.

[0079] For example 2, please refer to Figure 2 , Figure 2 It is a schematic diagram of the structural composition of a task vehicle real-time monitoring device based on the startup state in an embodiment of the present invention.

[0080] like Figure 2 As shown, a real-time monitoring device for a task vehicle based on a startup state, the device comprises:

[0081] Navigation planning module 21: used for uploading the current positioning information to the vehicle task system by the vehicle controller arranged on the task vehicle when the task vehicle is started, and the vehicle task system generates a planned driving navigation path based on the current positioning information and the target address of the target task;

[0082] In the specific implementation process of the present invention, the vehicle controller set on the task vehicle uploads the current positioning information to the vehicle task system, and the vehicle task system generates a planned driving navigation path based on the current positioning information and the target address of the target task, including: the vehicle controller set on the task vehicle starts the positioning system, performs positioning processing on the current location of the task vehicle, and obtains the current positioning information; the vehicle controller uploads the current positioning information to the vehicle task system based on the network transmission protocol, and the current positioning information is marked with the vehicle number of the task vehicle; the vehicle task system matches the corresponding target task according to the vehicle number contained in the current positioning information, and the target task contains a target address; the vehicle task system generates a planned driving navigation path according to the current positioning information and the target address of the target task.

[0083] Furthermore, before the task vehicle is started, it also includes: the vehicle task system establishes a second communication link with the user terminal where the task management user is located based on identity authentication, and sends a vehicle management list to the user terminal, the vehicle management list including the vehicle number, whether the vehicle is in an idle state, and the last time the vehicle executed the target task; the vehicle task system receives the target task generated by the management user on the user terminal based on the vehicle management list operation, and selects a task vehicle to execute the target task from the target task; the vehicle task system notifies the driver user corresponding to the task vehicle based on the task vehicle that executes the target task.

[0084] Furthermore, the vehicle task system receives a target task generated by the management user on the user terminal based on the vehicle management list operation, including: the management user inputs a target task type on the user terminal, and filters out vehicle numbers in an idle state in the vehicle management list according to the target task type; based on the required number of vehicles input by the management user, vehicles corresponding to a corresponding number of vehicle numbers are selected from the filtered idle vehicle numbers according to the idle time from long to short as target vehicles for executing the task; the user terminal generates the target task according to the target task type, the target vehicle for executing the task and the target address operation, and sends the target task to the vehicle task system.

[0085] Specifically, after the task vehicle is started, the vehicle controller installed on the task vehicle starts the positioning system, and then performs positioning processing through the positioning system, that is, the current location of the task vehicle is positioned and processed to obtain the current positioning information; after obtaining the current positioning information, the vehicle controller uploads the current positioning information to the vehicle task system through the network transmission protocol, wherein the current positioning information is marked with the vehicle number of the task vehicle.

[0086] After the vehicle task system receives the current positioning information, it needs to perform matching processing based on the vehicle number contained in the current positioning information to match the corresponding target task, where the target task also includes the target address, that is, the address where the target task is to be executed; finally, the vehicle task system can perform navigation path planning processing based on the current positioning information and the target address of the target task to generate a planned navigation path.

[0087] Before the task vehicle is started, the vehicle task system will establish a second communication link with the user terminal where the task management user is located based on identity authentication, and send a vehicle management details list to the user terminal, where the vehicle management list includes the vehicle number, whether the vehicle is idle, and the last time the vehicle executed the target task; in this way, the user can understand the status of the vehicles managed by the vehicle task system; then the vehicle task system receives the target task generated by the management user on the user terminal based on the vehicle management details list operation, where the task vehicle selected to execute the target task is selected in the target task; the vehicle task system notifies the driver user corresponding to the task vehicle of the task vehicle that executes the target task.

[0088] In the process of generating the target task, the management user inputs the target task type on the user terminal, and filters out the vehicle numbers in the idle state in the vehicle management details table according to the target task type; then, according to the required number of vehicles input by the management user, the vehicles corresponding to the corresponding number of vehicle numbers in the idle state are selected from the filtered out vehicle numbers according to the idle time from long to short as the target vehicles for executing the task; finally, the user terminal will generate the target task according to the target task type, the target vehicle for executing the task and the target address operation, and send the target task to the vehicle task system.

[0089] Task sending module 22: used for the vehicle task system to send the planned driving navigation path and the target task to the vehicle controller of the task vehicle, wherein the target task includes information of the target vehicle for executing the target task;

[0090] During the specific implementation of the present invention, the vehicle task system sends the planned driving navigation path and the target task to the vehicle controller of the task vehicle, including: the vehicle task system confirms the task vehicle to be sent according to the vehicle number contained in the planned driving navigation path; and sends the planned driving navigation path and the target task to the vehicle controller of the confirmed and sent task vehicle.

[0091] Specifically, in the vehicle task system, the task vehicle to be issued is confirmed according to the vehicle number included in the planned driving navigation path; and then the planned driving navigation path and the target task are issued to the vehicle controller of the confirmed task vehicle.

[0092] Communication establishment module 23: used for the vehicle controller on the task vehicle to establish a first communication link with information of other task target vehicles that execute the target task based on the target task;

[0093] In the specific implementation process of the present invention, the vehicle controller on the task vehicle establishes a first communication link based on the target task with the information of the remaining target vehicles executing the target task, including: the vehicle controller of the task vehicle obtains the information of the remaining target vehicles executing the target task based on the target task, and establishes a communication link with the task vehicles corresponding to the remaining target vehicles executing the target task based on the vehicle task system.

[0094] Specifically, the vehicle controller of the task vehicle obtains the information of other target vehicles performing the task through the target task, and then uses the vehicle task system as an intermediate node to establish a communication link with the task vehicles corresponding to the information of other target vehicles performing the task; in this way, the task vehicle will be able to share its location with other task vehicles performing the same target task, etc., so that some information between other vehicles performing the same target task can be shared in real time, and the situations between the task vehicles can be understood from each other.

[0095] Real-time monitoring module 24: used for the vehicle controller to collect real-time monitoring data based on a number of sensor devices arranged on the task vehicle to obtain real-time monitoring data, wherein the real-time monitoring data includes real-time positioning data, real-time speed data and real-time driver status monitoring data;

[0096] In the specific implementation process of the present invention, the vehicle controller performs real-time monitoring data collection based on a number of sensor devices installed on the task vehicle to obtain real-time monitoring data, including: the vehicle controller starts a number of sensor devices installed on the task vehicle, and the several sensor devices include a positioning sensor device, a speed sensor device and a video acquisition device; the vehicle controller controls the positioning sensor device and the speed sensor device to collect positioning monitoring data and speed monitoring data according to a preset acquisition frequency, and at the same time controls the video acquisition device to adjust the video acquisition angle to collect video monitoring data of the driver on the task vehicle to obtain real-time monitoring data.

[0097] Specifically, the vehicle controller will start several sensor devices installed on the task vehicle, wherein these sensor devices at least include a positioning sensor device, a speed sensor device and a video acquisition device; then the vehicle controller controls the positioning sensor device and the speed sensor device to collect and process the positioning monitoring data and the speed monitoring data according to a predetermined acquisition frequency, so as to obtain the corresponding positioning monitoring data and the speed monitoring data, and at the same time controls the video acquisition device to adjust the video acquisition angle to aim at the driver, and then collects video monitoring data of the driver on the task vehicle to obtain real-time monitoring video data, which is composed of the positioning monitoring data, the speed monitoring data and the real-time monitoring video data.

[0098] Sharing module 25: used for sharing the real-time positioning data and the real-time speed data in the real-time monitoring data with other target vehicles performing the mission based on the established first communication link;

[0099] In the specific implementation process of the present invention, the real-time positioning data and real-time speed data in the real-time monitoring data are shared with other target vehicles performing the mission based on the established first communication link, including: the mission vehicle uploads the real-time positioning data and real-time speed data in the real-time monitoring data to the vehicle mission system based on the first communication connection; the vehicle mission system shares the received real-time positioning data and real-time speed data with other target vehicles performing the mission based on the first communication connection.

[0100] Specifically, the task vehicle will upload the real-time positioning data and real-time speed data in the real-time monitoring data to the vehicle task system according to the first communication connection; then the vehicle task system will share the received real-time positioning data and real-time speed data with the remaining target vehicles performing the task through the first communication link.

[0101] The fatigue warning module 26 is used to perform driver fatigue analysis based on the driver status monitoring data in the real-time monitoring data, and perform driver fatigue warning based on the driver fatigue analysis result.

[0102] In the specific implementation process of the present invention, the driver fatigue analysis is performed based on the driver status monitoring data in the real-time monitoring data, and the driver fatigue warning is performed based on the driver fatigue analysis result, including: performing video frame extraction processing on the driver status monitoring data in the real-time monitoring data to form a video image frame sequence; inputting the video images in the video image frame sequence into a driver fatigue recognition model in sequence for recognition and analysis, and outputting the driver fatigue analysis result; performing driver fatigue warning based on the driver fatigue analysis result; wherein the driver fatigue recognition model is a convergent model trained by inputting video images labeled by experts during the driver's driving process into a deep neural network model.

[0103] Specifically, it is first necessary to perform video frame extraction processing on the driver status monitoring data in the real-time monitoring data to form a video image frame sequence; then the video images in the video image frame sequence need to be sequentially input into the driver fatigue recognition model for recognition and analysis processing, and the driver fatigue analysis results need to be output; then after obtaining the driver fatigue analysis results, it is necessary to perform driver fatigue warning processing based on the driver fatigue analysis results; at the same time, the driver fatigue analysis results are fed back to the vehicle task system, wherein the driver fatigue recognition model is a convergent model trained by inputting video images of the driver's driving process marked by experts into a deep neural network model.

[0104] In an embodiment of the present invention, the collected real-time monitoring data is processed accordingly on the vehicle side to ensure the privacy of the user. At the same time, the real-time location of the vehicle can be shared with other vehicles that perform the same target task together, so that the driver can be reminded of fatigue driving in time, and the status of other vehicles that perform the target task together can be understood in time.

[0105] A person of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, and the storage medium may include: a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, etc.

[0106] In addition, the above is a detailed introduction to a method and device for real-time monitoring of a task vehicle based on the startup state provided in an embodiment of the present invention. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for a general technician in this field, according to the idea of ​​the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. A real-time monitoring method for a mission vehicle based on the startup state, characterized in that: The method comprises: When the task vehicle is started, the vehicle controller arranged on the task vehicle uploads the current positioning information to the vehicle task system, and the vehicle task system generates a planned driving navigation path based on the current positioning information and the target address of the target task; The vehicle task system sends the planned driving navigation path and the target task to the vehicle controller of the task vehicle, wherein the target task includes information of a target vehicle for executing the target task; The vehicle controller on the task vehicle establishes a first communication link based on the target task and information of other target vehicles executing the target task; The vehicle controller collects real-time monitoring data based on a plurality of sensor devices arranged on the task vehicle to obtain real-time monitoring data, wherein the real-time monitoring data includes real-time positioning data, real-time speed data and real-time driver status monitoring data; Sharing the real-time positioning data and the real-time speed data in the real-time monitoring data with other target vehicles performing the mission based on the established first communication link; A driver fatigue analysis process is performed based on the driver status monitoring data in the real-time monitoring data, and a driver fatigue warning process is performed based on the driver fatigue analysis result.

2. The real-time monitoring method for mission vehicles according to claim 1, characterized in that: The vehicle controller disposed on the task vehicle uploads the current positioning information to the vehicle task system, and the vehicle task system generates a planned driving navigation path based on the current positioning information and the target address of the target task, including: The vehicle controller installed on the task vehicle starts the positioning system to perform positioning processing on the current location of the task vehicle to obtain current positioning information; The vehicle controller uploads the current positioning information to the vehicle mission system based on a network transmission protocol, and the current positioning information is marked with the vehicle number of the mission vehicle; The vehicle task system matches the corresponding target task according to the vehicle number included in the current positioning information, and the target task includes a target address; The vehicle task system generates a planned driving navigation path according to the current positioning information and the target address of the target task.

3. The real-time monitoring method for mission vehicles according to claim 1, characterized in that: Before the task vehicle is started, it also includes: The vehicle task system establishes a second communication link with the user terminal where the task management user is located based on identity authentication, and sends a vehicle management detailed list to the user terminal, the vehicle management detailed list including the vehicle number, whether the vehicle is in an idle state, and the time when the vehicle last executed the target task; The vehicle task system receives a target task generated by the management user on the user terminal based on the vehicle management list, and selects a task vehicle to execute the target task from the target task; The vehicle task system notifies a driver user corresponding to the task vehicle based on the task vehicle executing the target task.

4. The real-time monitoring method for mission vehicles according to claim 3 is characterized in that: The vehicle task system receives the target task generated by the management user on the user terminal based on the vehicle management list operation, including: The management user inputs a target task type on the user terminal, and selects vehicle numbers in an idle state in the vehicle management list according to the target task type; According to the required number of vehicles input by the management user, the vehicles corresponding to the corresponding number of vehicle numbers are selected from the vehicle numbers in the idle state according to the idle time from the longest to the shortest as the target vehicles for executing the task; The user terminal generates the target task according to the target task type, the target vehicle for executing the task and the target address operation, and sends the target task to the vehicle task system.

5. The real-time monitoring method for mission vehicles according to claim 1, characterized in that: The vehicle task system sends the planned driving navigation path and the target task to the vehicle controller of the task vehicle, including: The vehicle task system confirms the assigned task vehicle according to the vehicle number included in the planned driving navigation path; The planned driving navigation path and the target task are sent to the vehicle controller of the confirmed task vehicle.

6. The real-time monitoring method for mission vehicles according to claim 1, characterized in that: The vehicle controller on the task vehicle establishes a first communication link based on the target task and information of other target vehicles executing the target task, including: The vehicle controller of the task vehicle obtains information of other target vehicles for performing the task based on the target task, and establishes a communication link with the task vehicles corresponding to the other target vehicles for performing the task based on the vehicle task system.

7. The real-time monitoring method for mission vehicles according to claim 1, characterized in that: The vehicle controller collects real-time monitoring data based on a number of sensor devices arranged on the task vehicle to obtain real-time monitoring data, including: The vehicle controller starts a plurality of sensor devices arranged on the task vehicle, wherein the plurality of sensor devices include a positioning sensor device, a speed sensor device and a video acquisition device; The vehicle controller controls the positioning sensor device and the speed sensor device to collect positioning monitoring data and speed monitoring data according to a preset collection frequency, and at the same time controls the video collection device to adjust the video collection angle to collect video monitoring data of the driver on the task vehicle to obtain real-time monitoring data.

8. The real-time monitoring method for mission vehicles according to claim 1, characterized in that: The method of sharing the real-time positioning data and the real-time speed data in the real-time monitoring data with other target vehicles for performing the mission based on the established first communication link includes: The mission vehicle uploads the real-time positioning data and the real-time speed data in the real-time monitoring data to the vehicle mission system based on the first communication connection; The vehicle mission system shares the received real-time positioning data and real-time speed data with other mission target vehicles based on the first communication link.

9. The real-time monitoring method for mission vehicles according to claim 1, characterized in that: The driver fatigue analysis is performed based on the driver status monitoring data in the real-time monitoring data, and the driver fatigue warning is performed based on the driver fatigue analysis result, including: Performing video frame extraction processing on the driver status monitoring data in the real-time monitoring data to form a video image frame sequence; Inputting the video images in the video image frame sequence into the driver fatigue recognition model in order to perform recognition and analysis processing, and outputting the driver fatigue analysis result; Performing driver fatigue warning processing based on the driver fatigue analysis result; The driver fatigue recognition model is a convergent model trained by inputting video images of the driver's driving process marked by experts into a deep neural network model.

10. A real-time monitoring device for a mission vehicle based on the startup status, characterized in that: The device comprises: Navigation planning module: used for uploading the current positioning information to the vehicle task system by the vehicle controller arranged on the task vehicle when the task vehicle is started, and the vehicle task system generates a planned driving navigation path based on the current positioning information and the target address of the target task; Task sending module: used for the vehicle task system to send the planned driving navigation path and the target task to the vehicle controller of the task vehicle, wherein the target task includes information of the target vehicle for executing the target task; Communication establishment module: used for the vehicle controller on the task vehicle to establish a first communication link with information of other task target vehicles executing the target task based on the target task; Real-time monitoring module: used for the vehicle controller to collect real-time monitoring data based on a number of sensor devices installed on the task vehicle to obtain real-time monitoring data, which includes real-time positioning data, real-time speed data and real-time driver status monitoring data; Sharing module: used for sharing the real-time positioning data and the real-time speed data in the real-time monitoring data with other target vehicles performing the mission based on the established first communication link; Fatigue warning module: used to perform driver fatigue analysis based on the driver status monitoring data in the real-time monitoring data, and perform driver fatigue warning based on the driver fatigue analysis results.

Images