Intelligent driving teaching method and device based on real-time driving condition

Abstract

The invention relates to the technical field of driving data analysis, and discloses an intelligent driving teaching method and device based on a real-time driving situation, and the method comprises the steps: collecting environment data of a driving environment where a driving training vehicle is located and first real-time driving data corresponding to the driving training vehicle; according to the environment data and the first real-time driving data, analyzing a current driving scene corresponding to the driving training vehicle; obtaining a driving teaching scheme corresponding to a student who currently operates the driving training vehicle; according to the driving teaching scheme, a real-time teaching scheme corresponding to the current driving scene is generated, and the real-time teaching scheme is used for guiding students to implement corresponding standard driving behaviors according to the current driving scene. Therefore, personalized driving teaching can be realized, and students can be helped to master the driving skills efficiently and quickly, so that the driving teaching flexibility and the driving teaching efficiency are improved.

Description

Technical Field

[0001] The present invention relates to the technical field of driving data analysis, and in particular to an intelligent driving teaching method and device based on real-time driving conditions. Background Art

[0002] At present, the existing driving training usually involves the instructor guiding students to learn driving skills according to a unified teaching plan, and mainly relies on the instructor to give students verbal guidance during the teaching process. However, the teaching plan used in this driving training method may not be suitable for every student, and it is difficult for the instructor to provide timely feedback on the student's driving performance during the driving training process, resulting in low driving teaching efficiency.

[0003] Therefore, it is particularly important to propose a technical solution that can realize personalized driving teaching to improve the flexibility of driving teaching and the efficiency of driving teaching. Summary of the invention

[0004] The present invention provides an intelligent driving teaching method and device based on real-time driving conditions, which can realize personalized driving teaching, thereby improving the flexibility and efficiency of driving teaching.

[0005] In order to solve the above technical problems, the first aspect of the present invention discloses an intelligent driving teaching method based on real-time driving conditions, the method comprising:

[0006] Collecting environmental data of the driving environment in which the driving training vehicle is located and first real-time driving data corresponding to the driving training vehicle;

[0007] Analyzing a current driving scenario corresponding to the driving training vehicle according to the environmental data and the first real-time driving data;

[0008] Obtaining a driving teaching plan corresponding to the student currently operating the driving training vehicle;

[0009] According to the driving teaching plan, a real-time teaching plan corresponding to the current driving scenario is generated; the real-time teaching plan is used to guide the student to implement corresponding standard driving behavior for the current driving scenario.

[0010] As an optional implementation, in the first aspect of the present invention, the collecting of environmental data of the driving environment in which the driving training vehicle is located includes:

[0011] Based on the sensor equipment corresponding to the driving training vehicle, environmental sensor data of the driving environment in which the driving training vehicle is located is collected; the sensor equipment includes an on-board sensor equipment and / or a roadside sensor equipment; the environmental sensor data includes first sensor data collected by the on-board sensor equipment and / or second sensor data collected by the roadside sensor data;

[0012] Based on the determined data fusion algorithm, performing a data fusion operation on the environmental sensor data to obtain environmental data of the driving environment;

[0013] Among them, the environmental data includes at least one of the road information where the driving training vehicle is located, the traffic information of the lane where the driving training vehicle is located, the adjacent object information of the target lane corresponding to the driving training vehicle, and the weather information of the driving environment; wherein the traffic information includes at least one of the traffic light information corresponding to the lane, the road condition information of the lane, the traffic flow information of the lane and the traffic event information of the lane; the target lane includes the lane where the driving training vehicle is located and / or the adjacent lane corresponding to the lane; the adjacent object information includes the position parameters of the adjacent objects and / or the movement parameters of the adjacent objects.

[0014] As an optional implementation, in the first aspect of the present invention, the first real-time driving data corresponding to the driving training vehicle includes the driving behavior data of the trainee and / or the vehicle travel data of the driving training vehicle;

[0015] Wherein, analyzing the current driving scene corresponding to the driving training vehicle according to the environmental data and the first real-time driving data includes:

[0016] Determining a driving area scene corresponding to the driving training vehicle according to the road information on which the driving training vehicle is located and the traffic information; and / or,

[0017] Determining the weather scene corresponding to the driving training vehicle according to the weather information; and / or,

[0018] Determining a driving road condition scenario of the driving training vehicle according to the first real-time driving data, the traffic information, and the adjacent object information;

[0019] The current driving scene includes at least one of the driving area scene, the weather scene and the driving road condition scene.

[0020] As an optional embodiment, in the first aspect of the present invention, the method further comprises:

[0021] Acquiring basic driving information of the trainee; the basic driving information includes at least one of driving learning experience, driving learning ability level, driving learning goals, driving habit information, trainee psychological quality and trainee physical information;

[0022] Wherein, generating a real-time teaching plan corresponding to the current driving scenario according to the driving teaching plan includes:

[0023] Determining a current driving training item of the driving training vehicle according to the current driving scenario;

[0024] Filtering out a matching teaching sub-scheme that matches the current driving scenario and / or the current driving training item from the driving teaching scheme;

[0025] According to the basic driving information, the matching teaching sub-scheme is adjusted to obtain a real-time teaching scheme for the current driving scene; the real-time teaching scheme includes at least one guidance instruction; each of the guidance instructions is a vehicle operation guidance instruction or an observation behavior guidance instruction.

[0026] As an optional implementation, in the first aspect of the present invention, after generating a real-time teaching scheme corresponding to the current driving scenario according to the driving teaching scheme, the method further includes:

[0027] Collecting second real-time driving data of the driving training vehicle regarding the real-time teaching plan;

[0028] analyzing the second real-time driving data to obtain the real-time driving behavior performed by the trainee;

[0029] Acquiring a driving evaluation standard; the driving evaluation standard includes a standard driving behavior corresponding to the real-time teaching program and / or an evaluation rule corresponding to the standard driving behavior;

[0030] According to the driving evaluation criteria and the current driving scenario, the real-time driving behavior is evaluated to obtain a driving evaluation result of the trainee with respect to the real-time teaching plan;

[0031] The driving assessment result of the trainee regarding the real-time teaching program includes a driving behavior assessment result and / or a driving risk assessment result.

[0032] As an optional implementation, in the first aspect of the present invention, after evaluating the real-time driving behavior according to the driving evaluation criteria and the current driving scenario and obtaining the student's driving evaluation result regarding the real-time teaching plan, the method further includes:

[0033] According to the driving behavior evaluation result, determining whether the real-time driving behavior meets a preset standard behavior condition;

[0034] When it is determined that the real-time driving behavior does not meet the standard behavior condition, generating a behavior warning message for the driving behavior evaluation result and / or deducting the score corresponding to the real-time driving behavior of the trainee in the current driving training; and / or,

[0035] According to the driving risk assessment result, determining whether the real-time driving behavior meets the pre-set safe driving conditions;

[0036] When it is determined that the real-time driving behavior does not meet the safe driving conditions, a safe driving intervention plan corresponding to the driving risk assessment result is generated; the safe driving intervention plan includes safe driving instruction information and / or emergency control parameters corresponding to the driving training vehicle.

[0037] As an optional implementation, in the first aspect of the present invention, after evaluating the real-time driving behavior according to the driving evaluation criteria and the current driving scenario and obtaining the student's driving evaluation result regarding the real-time teaching plan, the method further includes:

[0038] Generate a driving training report corresponding to the current driving training according to all the real-time teaching plans generated by the trainee in the current driving training and the driving evaluation results corresponding to each of the real-time teaching plans;

[0039] The driving training plan corresponding to the student is optimized according to the driving training report and the acquired basic driving information of the student.

[0040] The second aspect of the present invention discloses an intelligent driving teaching device based on real-time driving conditions, the device comprising:

[0041] A collection module, used to collect environmental data of the driving environment in which the driving training vehicle is located and first real-time driving data corresponding to the driving training vehicle;

[0042] An analysis module, configured to analyze a current driving scenario corresponding to the driving training vehicle according to the environmental data and the first real-time driving data;

[0043] An acquisition module, used to acquire a driving teaching plan corresponding to the student currently operating the driving training vehicle;

[0044] A generation module is used to generate a real-time teaching plan corresponding to the current driving scenario according to the driving teaching plan; the real-time teaching plan is used to guide the student to implement corresponding standard driving behavior for the current driving scenario.

[0045] As an optional implementation, in the second aspect of the present invention, the specific manner in which the acquisition module acquires environmental data of the driving environment in which the driving training vehicle is located includes:

[0046] Based on the sensor equipment corresponding to the driving training vehicle, environmental sensor data of the driving environment in which the driving training vehicle is located is collected; the sensor equipment includes an on-board sensor equipment and / or a roadside sensor equipment; the environmental sensor data includes first sensor data collected by the on-board sensor equipment and / or second sensor data collected by the roadside sensor data;

[0047] Based on the determined data fusion algorithm, performing a data fusion operation on the environmental sensor data to obtain environmental data of the driving environment;

[0048] Among them, the environmental data includes at least one of the road information where the driving training vehicle is located, the traffic information of the lane where the driving training vehicle is located, the adjacent object information of the target lane corresponding to the driving training vehicle, and the weather information of the driving environment; wherein the traffic information includes at least one of the traffic light information corresponding to the lane, the road condition information of the lane, the traffic flow information of the lane and the traffic event information of the lane; the target lane includes the lane where the driving training vehicle is located and / or the adjacent lane corresponding to the lane; the adjacent object information includes the position parameters of the adjacent objects and / or the movement parameters of the adjacent objects.

[0049] As an optional implementation, in the second aspect of the present invention, the first real-time driving data corresponding to the driving training vehicle includes the driving behavior data of the trainee and / or the vehicle travel data of the driving training vehicle;

[0050] The specific manner in which the analysis module analyzes the current driving scene corresponding to the driving training vehicle according to the environmental data and the first real-time driving data includes:

[0051] Determining a driving area scene corresponding to the driving training vehicle according to the road information on which the driving training vehicle is located and the traffic information; and / or,

[0052] Determining the weather scene corresponding to the driving training vehicle according to the weather information; and / or,

[0053] Determining a driving road condition scenario of the driving training vehicle according to the first real-time driving data, the traffic information, and the adjacent object information;

[0054] The current driving scene includes at least one of the driving area scene, the weather scene and the driving road condition scene.

[0055] As an optional implementation, in the second aspect of the present invention, the acquisition module is further used to acquire the basic driving information of the trainee; the basic driving information includes at least one of driving learning experience, driving learning ability level, driving learning goals, driving habit information, trainee psychological quality and trainee physical information;

[0056] The specific manner in which the generating module generates the real-time teaching scheme corresponding to the current driving scenario according to the driving teaching scheme includes:

[0057] Determining a current driving training item of the driving training vehicle according to the current driving scenario;

[0058] Filtering out a matching teaching sub-scheme that matches the current driving scenario and / or the current driving training item from the driving teaching scheme;

[0059] According to the basic driving information, the matching teaching sub-scheme is adjusted to obtain a real-time teaching scheme for the current driving scene; the real-time teaching scheme includes at least one guidance instruction; each of the guidance instructions is a vehicle operation guidance instruction or an observation behavior guidance instruction.

[0060] As an optional implementation, in the second aspect of the present invention, the acquisition module is further used to collect second real-time driving data of the driving training vehicle regarding the real-time teaching plan after the generation module generates a real-time teaching plan corresponding to the current driving scene according to the driving teaching plan;

[0061] The analysis module is further used to analyze the second real-time driving data to obtain the real-time driving behavior implemented by the trainee;

[0062] The acquisition module is further used to acquire a driving evaluation standard; the driving evaluation standard includes a standard driving behavior corresponding to the real-time teaching scheme and / or an evaluation rule corresponding to the standard driving behavior;

[0063] And, the device also includes:

[0064] An evaluation module, configured to evaluate the real-time driving behavior according to the driving evaluation criteria and the current driving scenario, and obtain a driving evaluation result of the trainee with respect to the real-time teaching plan;

[0065] The driving assessment result of the trainee regarding the real-time teaching program includes a driving behavior assessment result and / or a driving risk assessment result.

[0066] As an optional implementation, in the second aspect of the present invention, the device further includes a judgment module, wherein:

[0067] The judging module is configured to, after the evaluating module evaluates the real-time driving behavior according to the driving evaluation criteria and the current driving scenario and obtains the driving evaluation result of the trainee regarding the real-time teaching plan, determine whether the real-time driving behavior meets a preset standard behavior condition according to the driving behavior evaluation result;

[0068] The generating module is further configured to generate a behavior warning message for the driving behavior evaluation result and / or deduct a score corresponding to the real-time driving behavior of the trainee in the current driving training when the judging module judges that the real-time driving behavior does not meet the standard behavior condition; and / or,

[0069] The judgment module is further configured to, after the evaluation module evaluates the real-time driving behavior according to the driving evaluation criteria and the current driving scenario and obtains the student's driving evaluation result regarding the real-time teaching plan, determine whether the real-time driving behavior meets a preset safe driving condition according to the driving risk evaluation result;

[0070] The generation module is also used to generate a safe driving intervention plan corresponding to the driving risk assessment result when the judgment module determines that the real-time driving behavior does not meet the safe driving conditions; the safe driving intervention plan includes safe driving instruction information and / or emergency control parameters corresponding to the driving training vehicle.

[0071] As an optional implementation, in the second aspect of the present invention, the generating module is further configured to generate a driving training report corresponding to the current driving training according to all the real-time teaching schemes generated by the trainee in the current driving training and the driving evaluation result corresponding to each real-time teaching scheme, after the evaluating module evaluates the real-time driving behavior according to the driving evaluation criteria and the current driving scene to obtain the driving evaluation result of the trainee regarding the real-time teaching scheme;

[0072] And, the device also includes:

[0073] The optimization module is used to optimize the driving teaching plan corresponding to the student according to the driving training report and the acquired driving basic information of the student.

[0074] The third aspect of the present invention discloses another intelligent driving teaching device based on real-time driving conditions, the device comprising:

[0075] A memory storing executable program code;

[0076] a processor coupled to the memory;

[0077] The processor calls the executable program code stored in the memory to execute part or all of the steps of the intelligent driving teaching method based on real-time driving conditions disclosed in the first aspect of the present invention.

[0078] The fourth aspect of the present invention discloses a computer storage medium, which stores computer instructions. When the computer instructions are called, they are used to execute part or all of the steps of the intelligent driving teaching method based on real-time driving conditions disclosed in the first aspect of the present invention.

[0079] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:

[0080] The present invention collects environmental data of the driving environment in which a driving training vehicle is located and first real-time driving data corresponding to the driving training vehicle, and analyzes the current driving scene corresponding to the driving training vehicle based on the environmental data and the first real-time driving data, and then obtains the driving teaching plan corresponding to the trainee currently operating the driving training vehicle, and then generates a real-time teaching plan corresponding to the current driving scene based on the driving teaching plan, and the real-time teaching plan is used to guide the trainee to implement corresponding standard driving behaviors for the current driving scene. It can be seen that the implementation of the present invention can analyze the current driving scene of the driving training vehicle according to the collected environmental data of the driving environment of the driving training vehicle and the first real-time data corresponding to the driving training vehicle, and then generate a real-time teaching plan corresponding to the current driving scene according to the acquired driving teaching plan corresponding to the trainee. It can generate targeted real-time teaching plans for the current driving scene and the driving teaching plan corresponding to the trainee, thereby realizing the intelligent generation of personalized driving teaching plans, and then realizing personalized driving teaching, which is conducive to improving the adaptability of the real-time teaching plan to the current situation of the trainee, so as to more effectively guide the trainee to learn and implement the corresponding driving skills in the current situation, which is conducive to helping the trainee to master driving skills efficiently and quickly, thereby improving the pertinence and flexibility of driving teaching, and then helping to improve the efficiency of driving teaching and the accuracy of driving teaching. BRIEF DESCRIPTION OF THE DRAWINGS

[0081] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0082] Figure 1 It is a flow chart of an intelligent driving teaching method based on real-time driving conditions disclosed in an embodiment of the present invention;

[0083] Figure 2 It is a flow chart of another intelligent driving teaching method based on real-time driving conditions disclosed in an embodiment of the present invention;

[0084] Figure 3It is a structural schematic diagram of an intelligent driving teaching device based on real-time driving conditions disclosed in an embodiment of the present invention;

[0085] Figure 4 It is a schematic diagram of the system architecture of a driving training teaching system disclosed in an embodiment of the present invention;

[0086] Figure 5 It is a structural schematic diagram of another intelligent driving teaching device based on real-time driving conditions disclosed in an embodiment of the present invention;

[0087] Figure 6 It is a structural schematic diagram of another intelligent driving teaching device based on real-time driving conditions disclosed in an embodiment of the present invention. DETAILED DESCRIPTION

[0088] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0089] The terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish different objects rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, device, product or end including a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units that are not listed, or may optionally include other steps or units inherent to these processes, methods, products or ends.

[0090] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present invention. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0091] The present invention discloses an intelligent driving teaching method and device based on real-time driving conditions, which can analyze the current driving scene of the driving training vehicle according to the collected environmental data of the driving environment of the driving training vehicle and the first real-time data corresponding to the driving training vehicle, and then generate a real-time teaching plan corresponding to the current driving scene according to the driving teaching plan corresponding to the acquired trainee, and can generate a targeted real-time teaching plan for the current driving scene and the driving teaching plan corresponding to the trainee, thereby realizing the intelligent generation of personalized driving teaching plans, and then realizing personalized driving teaching, which is conducive to improving the degree of adaptation of the real-time teaching plan to the current scene of the trainee, so as to more effectively guide the trainee to learn and implement the corresponding driving skills in the current scene, which is conducive to helping the trainee to master driving skills efficiently and quickly, thereby improving the pertinence and flexibility of driving teaching, and thereby helping to improve the efficiency of driving teaching and the accuracy of driving teaching. The following are described in detail.

[0092] Embodiment 1

[0093] See also Figure 1 , Figure 1 : is a flow chart of an intelligent driving teaching method based on real-time driving conditions disclosed in an embodiment of the present invention. Figure 1 The described intelligent driving teaching method based on real-time driving conditions can be applied to an intelligent driving teaching device based on real-time driving conditions, which may include one of a driving teaching device, a driving teaching terminal, a driving teaching system and a server, wherein the server includes a cloud server or a local server, which is not limited in the embodiments of the present invention. The method can also be applied to a driving training vehicle and / or a control system corresponding to the driving training vehicle, which is not limited in the embodiments of the present invention. Figure 1 As shown, the intelligent driving teaching method based on real-time driving conditions may include the following operations:

[0094] 101. Collect environmental data of a driving environment in which a driving training vehicle is located and first real-time driving data corresponding to the driving training vehicle.

[0095] In an embodiment of the present invention, exemplarily, the driving environment may include an examination venue and / or a training venue corresponding to a driving-related examination, for example: a training venue for subject two and / or subject three of a driver's license examination, which is not limited in this embodiment of the present invention; optionally, the first real-time driving data corresponding to a driving training vehicle may include the student's driving behavior data and / or the vehicle driving data of the driving training vehicle, which is not limited in this embodiment of the present invention.

[0096] 102. Analyze a current driving scenario corresponding to the driving training vehicle based on the environmental data and the first real-time driving data.

[0097] 103. Obtain the driving teaching plan corresponding to the student currently operating the driving training vehicle.

[0098] In an embodiment of the present invention, optionally, the driving teaching plan corresponding to the student can be an initialized standard driving teaching plan or a personalized driving teaching plan corresponding to the student, which is not limited in the embodiment of the present invention; further optionally, the driving teaching plan may include at least one of a description of a standard driving process for any driving test item, a behavior description of at least one standard driving behavior, and guidance instructions for at least one standard driving behavior, which is not limited in the embodiment of the present invention; wherein, the standard driving process may include at least one standard driving behavior; wherein, the standard driving behavior may include standard vehicle operations (for example: standard control operations for driving training vehicles) and / or standard driving behaviors (for example: standard observation behaviors of students in different driving scenarios), which are not limited in the embodiment of the present invention.

[0099] It should be noted that step 103 has no sequence relationship with any of steps 101 to 102, that is, step 103 can occur before or after any of steps 101 to 102 or simultaneously with any of steps 101 to 102, and the embodiment of the present invention is not limited thereto.

[0100] 104. Generate a real-time teaching plan corresponding to the current driving scenario according to the driving teaching plan.

[0101] In an embodiment of the present invention, the real-time teaching plan is used to guide the trainee to implement corresponding standard driving behaviors for the current driving scenario; optionally, the real-time teaching plan can be one of the sub-plans of the above-mentioned standard teaching plan, or it can be a teaching plan obtained after optimizing or personalizing the above-mentioned standard teaching plan / one of the sub-plans of the above-mentioned standard teaching plan, which is not limited in the embodiment of the present invention.

[0102] It can be seen that the method described in the embodiment of the present invention can analyze the current driving scene of the driving training vehicle according to the collected environmental data of the driving environment of the driving training vehicle and the first real-time data corresponding to the driving training vehicle, and then generate a real-time teaching plan corresponding to the current driving scene according to the acquired driving teaching plan corresponding to the trainee. It can generate targeted real-time teaching plans for the current driving scene and the driving teaching plan corresponding to the trainee, thereby realizing the intelligent generation of personalized driving teaching plans, and then realizing personalized driving teaching, which is conducive to improving the adaptability of the real-time teaching plan to the current situation of the trainee, so as to more effectively guide the trainee to learn and implement the corresponding driving skills in the current situation, which is conducive to helping the trainee to master driving skills efficiently and quickly, thereby improving the pertinence and flexibility of driving teaching, and then helping to improve the efficiency of driving teaching and the accuracy of driving teaching.

[0103] In an optional embodiment, collecting environmental data of the driving environment in which the driving training vehicle is located may include the following operations:

[0104] Based on the sensor equipment corresponding to the driving training vehicle, environmental sensor data of the driving environment in which the driving training vehicle is located is collected; the sensor equipment includes an on-board sensor equipment and / or a roadside sensor equipment; the environmental sensor data includes first sensor data collected by the on-board sensor equipment and / or second sensor data collected by the roadside sensor data;

[0105] Based on the determined data fusion algorithm, a data fusion operation is performed on the environmental sensor data to obtain environmental data of the driving environment.

[0106] Optionally, the environmental data includes at least one of the road information where the driving training vehicle is located, the traffic information of the lane where the driving training vehicle is located, the adjacent object information of the target lane corresponding to the driving training vehicle, and the weather information of the driving environment; wherein the traffic information includes at least one of the traffic light information corresponding to the lane, the road condition information of the lane, the traffic flow information of the lane, and the traffic event information of the lane; the target lane includes the lane where the driving training vehicle is located and / or the adjacent lane corresponding to the lane; the adjacent object information includes the position parameters of the adjacent object and / or the movement parameters of the adjacent object. Wherein, illustratively, the adjacent object can be a vehicle or a pedestrian, which is not limited in the embodiments of the present invention.

[0107] Optionally, the vehicle-mounted sensing device may include at least one of a vehicle-mounted camera device, a vehicle-mounted radar device, a vehicle-mounted GPS (Global Positioning System) device, a LIDAR (Light Detection And Ranging) device, an IMU (Inertial Measurement Unit), and an ultrasonic sensor, which is not limited in the embodiment of the present invention.

[0108] Optionally, the roadside sensing equipment may include at least one of a traffic light, a roadside camera device, and a roadside radar device (eg, a millimeter wave radar, a lidar), which is not limited in the embodiment of the present invention.

[0109] Optionally, based on the roadside sensor device corresponding to the driving training vehicle, collecting the second sensor data of the driving environment in which the driving training vehicle is located may include the following operations:

[0110] Based on the roadside unit in the driving environment, the second sensor data collected by the roadside sensor equipment in the driving environment is sent to the on-board unit of the driving training vehicle through the vehicle networking technology module.

[0111] Among them, exemplarily, the vehicle networking technology module can be a V2X module. V2X, namely Vehicle to Everything, is a vehicle wireless communication technology used for vehicle to exchange information with the outside world.

[0112] Further optionally, the sensor data collected by the above-mentioned sensor equipment may include a combination of one or more of the following data: the GPS device can provide the real-time position and speed information of the driving training vehicle; the IMU can provide dynamic data such as the acceleration and angular velocity of the driving training vehicle; the camera device can capture image data of the driving training vehicle's surrounding environment, and the image data can be used to identify roads, detect traffic signs, etc.; the radar device / lidar device can provide the distance between the objects around the driving training vehicle and the driving training vehicle and / or the speed information of the objects around the driving training vehicle; the ultrasonic sensor can be used for close-range obstacle detection of the driving training vehicle; the V2X module can be used to detect roadside traffic events, traffic light information, map information, traffic participant information, etc., which is not limited to the embodiments of the present invention.

[0113] It can be seen that this optional embodiment can collect environmental sensor data of the driving environment of the driving training vehicle based on the sensor equipment corresponding to the driving training vehicle, and then fuse the environmental sensor data based on the data fusion algorithm to obtain environmental data of the driving environment. This can improve the flexibility and accuracy of collecting environmental sensor data, thereby improving the accuracy of the fused environmental data, which in turn is conducive to improving the accuracy of the analysis of the current driving scene of the driving training vehicle.

[0114] In this optional embodiment, optionally, based on the determined data fusion algorithm, performing a data fusion operation on the environmental sensor data to obtain environmental data of the driving environment may include:

[0115] Performing a preprocessing operation on the environmental sensor data to obtain preprocessed data; wherein the preprocessing operation may include a data cleaning operation and a time synchronization operation;

[0116] Performing a registration operation on the preprocessed data to obtain registered data; wherein the registration operation may include a spatial registration operation and a temporal registration operation;

[0117] Based on the fusion algorithm, a fusion operation is performed on the registration data to obtain the environmental data of the driving environment.

[0118] Among them, the data cleaning operation is used to remove noise and abnormal data, such as GPS signal drift, sensor failure data and other data; the time synchronization operation is used to align the data of different sensors according to the timestamp to ensure the consistency of the sensor data during data fusion; the spatial registration operation is used to map the data of different sensors to a unified coordinate system, for example, aligning LiDAR data and camera data to the coordinate system of the driving vehicle; the time registration is used to further refine the time alignment of different sensor data to ensure time consistency during data fusion.

[0119] Optionally, the fusion algorithm may include a Kalman filter and / or an extended Kalman filter, which is not limited in the embodiment of the present invention; wherein the Kalman filter may be used to fuse GPS and IMU data to improve the estimation accuracy of the vehicle position and speed, and the extended Kalman filter may be used for data fusion of nonlinear systems, for example: fusing radar and camera data to improve the accuracy of obstacle detection and tracking, which is not limited in the embodiment of the present invention. Among them, the extended Kalman filter specifically includes:

[0120] I. Prediction Step

[0121]

[0122]

[0123] II. Update Steps

[0124]

[0125]

[0126] P k =(IK k H k ) k-1

[0127] in, and denote the predicted and updated state estimates respectively; P k-1 and P k Represent the predicted and updated error covariance matrices respectively; F k represents the state transfer matrix, B k represents the control input matrix, Represents control input; Q k and Q k They represent the process noise covariance matrix and the observation noise covariance matrix respectively; K k represents the Kalman gain, z k represents the observed value, H k represents the observation matrix.

[0128] It can be seen that this optional embodiment can also obtain environmental data of the driving environment by performing preprocessing operations, data alignment operations and data fusion operations on the environmental sensor data in sequence, which can improve the processing accuracy of the environmental sensor data, is conducive to improving the accuracy of data fusion, and further helps to further improve the accuracy of the environmental data.

[0129] In this optional embodiment, optionally, collecting the first real-time driving data corresponding to the driving training vehicle may include the following operations:

[0130] Collect trainees’ driving behavior data based on the in-vehicle sensors of the driving training vehicles;

[0131] Based on the data collection interface of the driving training vehicle, the vehicle driving data of the driving training vehicle is collected.

[0132] Among them, the student's driving behavior data may include image data and / or sensor data, and the student's current driving behavior can be determined based on the driving behavior data, such as steering behavior, braking behavior, shifting behavior, observing rearview mirrors and other driving behaviors.

[0133] Optionally, the data acquisition interface may be an OBD (On Board Diagnostics) interface, which is not limited in the embodiments of the present invention; optionally, the vehicle driving data may include at least one of vehicle speed, vehicle gear, vehicle accelerator pedal data (e.g., accelerator force), vehicle brake pedal data (e.g., brake force), and vehicle steering data, and may also include other vehicle internal status data that can be detected by the OBD interface, which is not limited in the embodiments of the present invention.

[0134] It can be seen that this optional embodiment can also collect the driving behavior data of the trainees based on the in-vehicle sensors of the driving training vehicle, and collect the vehicle driving data of the driving training vehicle based on the data collection interface of the driving training vehicle, which can improve the collection flexibility and accuracy of real-time driving data, thereby facilitating improving the analysis accuracy of the current driving scene of the driving training vehicle.

[0135] In this optional embodiment, optionally, analyzing the current driving scene corresponding to the driving training vehicle according to the environmental data and the first real-time driving data may include the following operations:

[0136] Determine the driving area scene corresponding to the driving training vehicle according to the road information and traffic information of the driving training vehicle; and / or,

[0137] Determine the weather scene corresponding to the driving training vehicle based on the weather information; and / or,

[0138] A driving road condition scenario of the driving training vehicle is determined based on the first real-time driving data, traffic information, and adjacent object information.

[0139] The current driving scene includes at least one of a driving area scene, a weather scene, and a driving road condition scene.

[0140] Among them, illustratively, the driving area scene can be one of a traffic light area scene, a turning area scene, a straight area scene, and a lane change area scene, or it can be other area scenes, which is not limited in the embodiments of the present invention.

[0141] Exemplarily, the weather scene may be a clear weather scene or a bad weather scene (eg, a thunderstorm and gale weather scene, a foggy and hazy weather scene), or other weather scenes, which are not limited in the embodiments of the present invention.

[0142] Among them, exemplarily, the driving road condition scenario can be a complex road condition scenario (for example: a scene with heavy traffic, a scene with fast driving speeds of adjacent vehicles, a road congestion scene, a road construction scene, an intersection scene, a traffic accident scene) or a safe road condition scenario, or it can be other road condition scenarios, which are not limited in the embodiments of the present invention.

[0143] It can be seen that this optional embodiment can also determine the driving area scene based on road information and traffic information, determine the weather scene based on weather information, and determine the driving road condition scene based on the first real-time driving data, traffic information and adjacent object information, thereby improving the flexibility and accuracy in determining the current driving scene of the driving training vehicle, which is beneficial to improving the diversity and accuracy of the current driving scene, and further beneficial to improving the accuracy and pertinence of the generation of real-time teaching plans.

[0144] In another optional embodiment, the method may further include the following operations:

[0145] Obtain the student's basic driving information; wherein the basic driving information may include at least one of driving learning experience, driving learning ability level, driving learning goals, driving habit information, student psychological quality and student physical information.

[0146] The driving learning experience may include at least one of the cumulative time of the trainee's driving learning, the trainee's driving learning experience information, and the trainee's driving learning stage, which is not limited in the embodiment of the present invention.

[0147] Among them, the driving learning ability level can be used to indicate the student's learning speed and / or comprehension ability of driving skills; the higher the driving learning ability level, the faster the student's learning speed and / or comprehension ability of driving skills.

[0148] Among them, the student's physical information may include at least one of the student's gender information, student's age information, student's height information, student's body shape information, and student's vision information, which is not limited in the embodiment of the present invention.

[0149] Optionally, generating a real-time teaching plan corresponding to the current driving scenario according to the driving teaching plan may include the following operations:

[0150] Determine the current driving training items of the driving training vehicle according to the current driving scenario;

[0151] Selecting a matching teaching sub-scheme that matches the current driving scenario and / or the current driving training project from the driving teaching scheme;

[0152] According to the basic driving information, the teaching sub-scheme is adjusted and matched to obtain a real-time teaching scheme for the current driving scene; the real-time teaching scheme includes at least one guidance instruction; each guidance instruction is a vehicle operation guidance instruction or an observation behavior guidance instruction.

[0153] Among them, the current driving training project may include at least one of a traffic light project, a turning project, a straight-driving project, and a lane-changing project, or may be other driving training projects, which is not limited in the embodiment of the present invention.

[0154] Exemplarily, if the current driving scene includes a traffic light area scene and a bad weather scene, and the current driving training project determined includes a traffic light project, it is necessary to select a sub-program that matches the traffic light project and a sub-program that matches the bad weather scene (for example, a sub-program related to safe driving skills and precautions) from the driving teaching program as a matching teaching sub-program; then, based on the student's basic driving information, multiple sub-programs in the matching teaching sub-program are adjusted and integrated to obtain a real-time teaching program for the current driving scene. For example: if the student's driving learning experience is lower than the standard level, it is necessary to advance the preset time corresponding to the driving learning experience compared to the instruction output time in the driving teaching program (such as: output the corresponding guidance instruction 10 seconds in advance), and / or, set the number of repetitions corresponding to the driving learning experience to output the corresponding guidance instruction (such as: repeatedly output the guidance instruction 3 times); another exemplary, if the current driving scene includes a complex road scene, then select a matching teaching sub-program that matches the braking operation and steering operation in the complex road scene from the driving teaching program, which is not limited by the embodiment of the present invention.

[0155] Optionally, according to the basic driving information, the matching teaching sub-scheme is adjusted to obtain a real-time teaching scheme for the current driving scenario, which may include the following operations:

[0156] According to the vehicle parameters of the driving training vehicle and the basic driving information of the trainees, the teaching sub-plans are adjusted and matched to obtain a real-time teaching plan for the current driving scenario.

[0157] Among them, the vehicle parameters of the driving training vehicle may include at least one of the vehicle type (for example: C1 manual transmission model, C2 automatic transmission model, B2 large truck, etc.), the size of the vehicle's internal space, and the position of each operating component of the vehicle, which is not limited in the embodiment of the present invention. For example, if the trainee is a smaller woman and the driving training vehicle is a large truck, the trainee may need more time to operate the corresponding operating components (for example: handbrake), so as to adjust the time of outputting the guidance instructions according to the above situation. This can further improve the accuracy of generating real-time teaching plans.

[0158] It can be seen that this optional embodiment can determine the current driving training project of the driving training vehicle according to the current driving scene, and then screen out the matching teaching sub-program that matches the current driving scene and / or the current driving training project from the driving teaching plan, and then adjust the matching teaching sub-program according to the acquired basic driving information of the student to obtain a real-time teaching plan for the current driving scene, which can improve the screening accuracy of the teaching sub-program that matches the current driving scene and / or the current driving training project, and improve the adjustment accuracy of the matching teaching sub-program, thereby helping to improve the accuracy of the real-time teaching plan, and further help to further improve the adaptability of the real-time teaching plan to the current situation of the student, and then can more effectively guide the student to learn and implement the corresponding driving skills in the current situation, which helps to improve the efficiency of the student in mastering driving skills.

[0159] Embodiment 2

[0160] See also Figure 2 , Figure 2 : is a flow chart of an intelligent driving teaching method based on real-time driving conditions disclosed in an embodiment of the present invention. Figure 2 The described intelligent driving teaching method based on real-time driving conditions can be applied to an intelligent driving teaching device based on real-time driving conditions, which may include one of a driving teaching device, a driving teaching terminal, a driving teaching system and a server, wherein the server includes a cloud server or a local server, which is not limited in the embodiments of the present invention. The method can also be applied to a driving training vehicle and / or a control system corresponding to the driving training vehicle, which is not limited in the embodiments of the present invention. Figure 2 As shown, the intelligent driving teaching method based on real-time driving conditions may include the following operations:

[0161] 201. Collect environmental data of a driving environment in which a driving training vehicle is located and first real-time driving data corresponding to the driving training vehicle.

[0162] 202. Analyze a current driving scenario corresponding to the driving training vehicle based on the environmental data and the first real-time driving data.

[0163] 203. Obtain the driving teaching plan corresponding to the student currently operating the driving training vehicle.

[0164] 204. Generate a real-time teaching plan corresponding to the current driving scenario according to the driving teaching plan.

[0165] In the embodiment of the present invention, the real-time teaching scheme is used to guide the trainee to implement corresponding standard driving behaviors according to the current driving scenario.

[0166] 205. Collect the second real-time driving data of the driving training vehicle regarding the real-time teaching plan.

[0167] In an embodiment of the present invention, optionally, the second real-time driving data may include the trainee's teaching driving behavior data regarding the real-time teaching plan and / or the teaching vehicle driving data of the driving training vehicle regarding the real-time teaching plan, which is not limited in the embodiment of the present invention.

[0168] 206. Analyze the second real-time driving data to obtain the real-time driving behavior performed by the student.

[0169] 207. Obtain driving evaluation criteria.

[0170] In the embodiment of the present invention, the driving evaluation criteria may include the standard driving behavior corresponding to the real-time teaching scheme and / or the evaluation rules corresponding to the standard driving behavior. Optionally, the driving evaluation criteria may be obtained by screening a rule library storing a plurality of driving evaluation criteria, which is not limited in the embodiment of the present invention.

[0171] 208. Evaluate the real-time driving behavior according to the driving evaluation criteria and the current driving scenario, and obtain the student's driving evaluation results on the real-time teaching plan.

[0172] In an embodiment of the present invention, the driving assessment result of the trainee regarding the real-time teaching plan may include a driving behavior assessment result and / or a driving risk assessment result; optionally, the driving assessment result may also include a driving performance of the current driving training, which is not limited in the embodiment of the present invention.

[0173] In the embodiment of the present invention, for other detailed descriptions of steps 201 to 204, please refer to the detailed description of steps 101 to 104 in the first embodiment, which will not be described in detail in the embodiment of the present invention.

[0174] It can be seen that the method described in the embodiment of the present invention can analyze the current driving scene of the driving training vehicle according to the collected environmental data of the driving environment of the driving training vehicle and the first real-time data corresponding to the driving training vehicle, and then generate a real-time teaching plan corresponding to the current driving scene according to the acquired driving teaching plan corresponding to the trainee. It can generate targeted real-time teaching plans for the current driving scene and the driving teaching plan corresponding to the trainee, thereby realizing the intelligent generation of personalized driving teaching plans, and then realizing personalized driving teaching, which is conducive to improving the adaptability of the real-time teaching plan to the current situation of the trainee, so as to more effectively guide the trainee to learn and implement the corresponding driving skills in the current situation, which is conducive to helping the trainee to master driving skills efficiently and quickly, thereby improving the pertinence and flexibility of driving teaching, and then helping to improve the efficiency of driving teaching and the accuracy of driving teaching. In addition, after the real-time teaching plan is generated, the second real-time driving data of the driving training vehicle about the real-time teaching plan can be collected, and then the real-time driving behavior implemented by the trainee can be obtained by analyzing the second real-time driving data, and then the real-time driving behavior can be evaluated according to the acquired driving judgment standard and the current driving scene to obtain the driving evaluation result, which can improve the analysis accuracy of the second real-time driving data, thereby improving the accuracy and efficiency of determining the driving evaluation result, and then timely feedback accurate driving judgment results to the trainee, which is conducive to timely correction of the trainee's driving behavior.

[0175] In an optional embodiment, evaluating the real-time driving behavior according to the driving evaluation criteria and the current driving scenario to obtain the student's driving evaluation result on the real-time teaching plan may include the following operations:

[0176] According to the driving evaluation criteria, the real-time driving behavior is evaluated to obtain a driving behavior evaluation result; the driving behavior evaluation result is used to indicate the degree of matching between the real-time driving behavior and the driving evaluation criteria;

[0177] Analyze the driving risk information existing in the driving environment according to the current driving scenario; the driving risk information includes driving risk factors and risk indexes corresponding to the driving risk factors; the driving risk factors include at least one of weather risk factors, traffic flow risk factors and road condition risk factors;

[0178] According to the driving risk information, the real-time driving behavior is evaluated to obtain a driving risk evaluation result; the driving risk evaluation result is used to indicate the degree of danger of the real-time driving behavior under the influence of the driving environment.

[0179] Among them, the driving behavior evaluation result can be expressed by the behavior matching degree corresponding to the real-time driving behavior. If the value of the behavior matching degree is higher, it means that the degree of matching between the real-time driving behavior and the driving judgment standard is higher.

[0180] Among them, the risk index corresponding to the driving risk factor includes the index corresponding to each driving risk sub-factor, and each driving risk sub-factor is one of a weather risk factor, a traffic flow risk factor and a road condition risk factor; optionally, the driving risk assessment result may include a driving risk level and / or a risk level corresponding to each driving risk sub-factor, which is not limited in the embodiment of the present invention; further optionally, the driving risk level may be obtained by weighted averaging the index corresponding to each driving risk sub-factor to obtain a target risk index, and then determining it based on the target score index, and the risk level corresponding to each driving risk sub-factor may be determined by the index corresponding to the driving risk sub-factor, which is not limited in the embodiment of the present invention.

[0181] It can be seen that this optional embodiment can also evaluate the real-time driving behavior according to the driving judgment standard to obtain the driving behavior evaluation result, and can analyze the driving risk information existing in the driving environment according to the current driving scene, and then evaluate the real-time driving behavior according to the driving risk information to obtain the driving risk evaluation result, which can improve the flexibility of analyzing the real-time driving behavior, thereby facilitating the improvement of the flexibility and accuracy of the judgment of the real-time driving behavior, thereby facilitating the improvement of the accuracy and diversity of the driving evaluation results.

[0182] In another optional embodiment, after evaluating the real-time driving behavior according to the driving evaluation criteria and the current driving scenario and obtaining the student's driving evaluation result on the real-time teaching plan, the method may further include the following operations:

[0183] According to the driving behavior evaluation results, determine whether the real-time driving behavior meets the pre-set standard behavior conditions;

[0184] When it is determined that the real-time driving behavior does not meet the standard behavior conditions, a behavior warning message for the driving behavior evaluation result is generated and / or the score corresponding to the student's real-time driving behavior in the current driving training is deducted; and / or,

[0185] Based on the driving risk assessment results, determine whether the real-time driving behavior meets the pre-set safe driving conditions;

[0186] When it is determined that the real-time driving behavior does not meet the safe driving conditions, a safe driving intervention plan corresponding to the driving risk assessment result is generated; the safe driving intervention plan includes safe driving instruction information and / or emergency control parameters corresponding to the driving training vehicle.

[0187] Wherein, illustratively, the behavior warning information for the driving behavior evaluation result may be: when the trainee is turning too fast, the system will immediately prompt him to slow down; when the trainee's braking force is not enough, the system will suggest that he increase the braking force, which is not limited in the embodiment of the present invention; wherein, the above-mentioned operation of deducting points may specifically be to deduct the points corresponding to the real-time driving behavior from the student's driving performance in the current driving training.

[0188] Among them, optionally, the emergency control parameters corresponding to the driving training vehicle may include control parameters corresponding to the emergency intervention function of the ADAS system (Advanced Driving Assistance System) of the driving training vehicle regarding the driving risk assessment results; wherein the emergency intervention function may include an emergency braking function or an avoidance function, which is not limited in the embodiments of the present invention.

[0189] Among them, optionally, the above-mentioned behavior warning information and / or safe driving reminder information can be output to the trainee through a vehicle-mounted display or a voice assistant, which is not limited in the embodiment of the present invention.

[0190] Optionally, judging whether the real-time driving behavior meets a preset standard behavior condition based on the driving behavior evaluation result may include the following operations:

[0191] Determine whether the behavior matching degree is higher than or equal to the preset matching degree; when it is determined that the behavior matching degree is higher than or equal to the preset matching degree, determine that the real-time driving behavior meets the preset standard behavior conditions; when it is determined that the behavior matching degree is lower than the preset matching degree, determine that the real-time driving behavior does not meet the preset standard behavior conditions. This can improve the accuracy of judging whether the real-time driving behavior is standard, which is conducive to timely correcting the driving behavior of the students, and further helps to improve the efficiency of driving teaching.

[0192] Optionally, judging whether the real-time driving behavior meets the pre-set safe driving conditions based on the driving risk assessment result may include the following operations:

[0193] Determine whether the driving risk level is lower than or equal to a first preset risk level; when it is determined that the driving risk level is lower than or equal to the first preset risk level, determine that the real-time driving behavior meets the preset safe driving conditions; when it is determined that the driving risk level is higher than the first preset risk level, determine that the real-time driving behavior does not meet the preset safe driving conditions; or,

[0194] Determine whether the risk level corresponding to each driving risk sub-factor is lower than or equal to the second preset risk level corresponding to the driving risk sub-factor; when it is determined that the risk levels corresponding to all driving risk sub-factors are lower than or equal to the corresponding second preset risk level, determine that the real-time driving behavior meets the pre-set safe driving conditions; when it is determined that the risk level corresponding to any driving risk sub-factor is higher than the corresponding second preset risk level, determine that the real-time driving behavior does not meet the pre-set safe driving conditions.

[0195] This can improve the accuracy of judging whether real-time driving behavior is safe, which is beneficial to improving the safety of driving teaching and the timeliness of emergency response.

[0196] Further optionally, after determining that the real-time driving behavior does not meet the standard behavior conditions, the above-mentioned operation of determining whether the real-time driving behavior meets the pre-set safe driving conditions based on the driving risk assessment results may be performed, which is not limited in the embodiments of the present invention.

[0197] It can be seen that this optional embodiment can generate a behavioral warning message for the driving behavior evaluation result and / or deduct the score corresponding to the student's real-time driving behavior in the current driving training if it is judged that the real-time driving behavior does not meet the pre-set standard behavior conditions based on the driving behavior evaluation results, and generate a safe driving intervention plan corresponding to the driving risk assessment result if it is judged that the real-time driving behavior does not meet the pre-set safe driving conditions based on the driving risk assessment results, which can further improve the analysis accuracy and judgment accuracy of the real-time driving behavior, thereby facilitating the feedback of corresponding prompt information to the student when the student's driving behavior is not standardized, and facilitating timely correction of the student's driving behavior; and, in the event of an emergency or a safety hazard, timely feedback of corresponding handling measures to the student, which is conducive to reminding the student to pay attention to potential dangerous situations, improving the safety of the student's driving, and cultivating the student's safety driving awareness.

[0198] In another optional embodiment, after evaluating the real-time driving behavior according to the driving evaluation criteria and the current driving scenario and obtaining the student's driving evaluation result on the real-time teaching plan, the method may further include the following operations:

[0199] Generate a driving training report corresponding to the current driving training according to all real-time teaching plans generated by the trainee in the current driving training and the driving evaluation results corresponding to each real-time teaching plan;

[0200] According to the driving training report and the basic driving information of the students, the corresponding driving teaching plan for the students is optimized.

[0201] Optionally, all real-time teaching plans generated by the trainee in the current driving training and the driving evaluation results corresponding to each real-time teaching plan can be recorded through the on-board storage device of the driving training vehicle and / or the cloud storage terminal associated with the driving training vehicle, which is not limited to the embodiments of the present invention.

[0202] Optionally, the driving training report corresponding to the current driving training may include at least one of the trainee's driving behavior record, the trainee's driving operation record, the evaluation results for each driving behavior / driving operation, the trainee's problem analysis results in the current driving training, and improvement suggestions corresponding to the current driving training, which is not limited in the embodiment of the present invention.

[0203] It can be seen that this optional embodiment can generate a driving training report based on all real-time teaching plans generated by the trainee in the current driving training and the corresponding driving evaluation results, thereby realizing the intelligent generation of a driving training summary report, which is beneficial to help the trainee review the training process to improve his driving skills; and, based on the driving training report and the trainee's basic driving information, optimizing the trainee's corresponding driving teaching plan, which can improve the optimization accuracy of the driving teaching plan, thereby facilitating the provision of more targeted personalized teaching plans to the trainee, and facilitating the trainee to improve his driving skills more efficiently in the next driving learning.

[0204] In an embodiment of the present invention, for example, the intelligent driving teaching method based on real-time driving conditions can be applied to a driving training teaching system. For example, a system architecture diagram of a driving training teaching system can be shown as follows: Figure 4 As shown, Figure 4 1 is a schematic diagram of the system architecture of a driving training teaching system disclosed in an embodiment of the present invention, wherein the driving training teaching system may include an on-board sensing module, a data fusion processing module, a driving test data recording module, an active safety protection module, and a driving test teaching evaluation module;

[0205] Among them, the environmental sensor data of the driving environment in which the driving training vehicle is located and the driving behavior data and vehicle travel data corresponding to the driving training vehicle can be collected through the on-board perception module; the above data are fused and processed through the data fusion processing module to obtain the environmental data of the driving environment and the real-time driving data, and then the real-time teaching plan is generated based on the analysis of the fused data, and then the driving evaluation results of the real-time teaching plan are recorded through the driving test data recording module; if it is judged based on the driving evaluation results that the real-time driving behavior does not meet the standard behavior conditions or does not meet the safe driving conditions, a safe driving intervention plan is adopted through the active safety protection module; after the current driving training is completed, a driving training report is generated through the driving test teaching evaluation module, and the corresponding driving teaching plan for the trainees is optimized;

[0206] Optionally, the driving training teaching system may further include a roadside perception sharing module, that is, the environmental sensor data of the driving training vehicle's environment can be perceived by the vehicle-mounted perception module, and the data perceived by the roadside perception sharing module can also be acquired through the V2X system, thereby realizing the collection of sensor data from multiple data sources and improving the accuracy of the sensor data, which is not limited in the embodiments of the present invention.

[0207] Embodiment 3

[0208] See also Figure 4 , Figure 4 is a schematic diagram of the structure of an intelligent driving teaching device based on real-time driving conditions disclosed in an embodiment of the present invention. Figure 4 The described intelligent driving teaching device based on real-time driving conditions may include one of a driving teaching device, a driving teaching terminal, a driving teaching system and a server, wherein the server includes a cloud server or a local server, which is not limited in the embodiments of the present invention. The device may be applied to a driving training vehicle and / or a control system corresponding to the driving training vehicle, which is not limited in the embodiments of the present invention. Figure 4 As shown, the intelligent driving teaching device based on real-time driving conditions may include:

[0209] The collection module 301 is used to collect environmental data of the driving environment in which the driving training vehicle is located and first real-time driving data corresponding to the driving training vehicle;

[0210] An analysis module 302 is used to analyze a current driving scene corresponding to the driving training vehicle according to the environmental data and the first real-time driving data;

[0211] The acquisition module 303 is used to acquire the driving teaching plan corresponding to the student currently operating the driving training vehicle;

[0212] The generation module 304 is used to generate a real-time teaching plan corresponding to the current driving scenario according to the driving teaching plan; the real-time teaching plan is used to guide the trainee to implement the corresponding standard driving behavior for the current driving scenario.

[0213] It can be seen that the device described in the embodiment of the present invention can analyze the current driving scene of the driving training vehicle based on the collected environmental data of the driving environment of the driving training vehicle and the first real-time data corresponding to the driving training vehicle, and then generate a real-time teaching plan corresponding to the current driving scene based on the acquired driving teaching plan corresponding to the trainee. It can generate targeted real-time teaching plans for the current driving scene and the driving teaching plan corresponding to the trainee, thereby realizing the intelligent generation of personalized driving teaching plans, and then realizing personalized driving teaching, which is conducive to improving the adaptability of the real-time teaching plan to the current situation of the trainee, so as to more effectively guide the trainee to learn and implement the corresponding driving skills in the current situation, which is conducive to helping the trainee to master driving skills efficiently and quickly, thereby improving the pertinence and flexibility of driving teaching, and then helping to improve the efficiency of driving teaching and the accuracy of driving teaching.

[0214] In an optional embodiment, the specific manner in which the acquisition module 301 acquires the environmental data of the driving environment in which the driving training vehicle is located may include:

[0215] Based on the sensor equipment corresponding to the driving training vehicle, environmental sensor data of the driving environment in which the driving training vehicle is located is collected; the sensor equipment includes an on-board sensor equipment and / or a roadside sensor equipment; the environmental sensor data includes first sensor data collected by the on-board sensor equipment and / or second sensor data collected by the roadside sensor data;

[0216] Based on the determined data fusion algorithm, a data fusion operation is performed on the environmental sensor data to obtain environmental data of the driving environment;

[0217] Among them, the environmental data may include at least one of the road information where the driving training vehicle is located, the traffic information of the lane where the driving training vehicle is located, the adjacent object information of the target lane corresponding to the driving training vehicle, and the weather information of the driving environment; among them, the traffic information includes at least one of the traffic light information corresponding to the lane, the road condition information of the lane, the traffic flow information of the lane and the traffic event information of the lane; the target lane includes the lane where the driving training vehicle is located and / or the adjacent lane corresponding to the lane; the adjacent object information includes the position parameters of the adjacent object and / or the movement parameters of the adjacent object.

[0218] It can be seen that the device described in the implementation of this optional embodiment can collect environmental sensor data of the driving environment of the driving training vehicle based on the sensor equipment corresponding to the driving training vehicle, and then fuse the environmental sensor data based on the data fusion algorithm to obtain environmental data of the driving environment. This can improve the flexibility and accuracy of collecting environmental sensor data, thereby improving the accuracy of the fused environmental data, which is beneficial to improving the accuracy of the analysis of the current driving scene of the driving training vehicle.

[0219] In this optional embodiment, optionally, the first real-time driving data corresponding to the driving training vehicle may include the driving behavior data of the trainee and / or the vehicle travel data of the driving training vehicle;

[0220] The specific manner in which the analysis module 302 analyzes the current driving scene corresponding to the driving training vehicle according to the environmental data and the first real-time driving data may include:

[0221] Determine the driving area scene corresponding to the driving training vehicle according to the road information and traffic information of the driving training vehicle; and / or,

[0222] Determine the weather scene corresponding to the driving training vehicle based on the weather information; and / or,

[0223] Determine a driving road condition scenario of the driving training vehicle according to the first real-time driving data, traffic information, and adjacent object information;

[0224] The current driving scene includes at least one of a driving area scene, a weather scene, and a driving road condition scene.

[0225] It can be seen that the device described in the implementation of this optional embodiment can also determine the driving area scene based on road information and traffic information, determine the weather scene based on weather information, and determine the driving road condition scene based on the first real-time driving data, traffic information and adjacent object information, thereby improving the flexibility and accuracy of determining the current driving scene of the driving training vehicle, which is beneficial to improving the diversity and accuracy of the current driving scene, and further beneficial to improving the accuracy and pertinence of generating real-time teaching plans.

[0226] In another optional embodiment, the acquisition module 303 is further used to acquire the basic driving information of the trainee; the basic driving information includes at least one of driving learning experience, driving learning ability level, driving learning goals, driving habit information, psychological quality of the trainee and physical information of the trainee;

[0227] The specific method in which the generating module 304 generates a real-time teaching plan corresponding to the current driving scenario according to the driving teaching plan may include:

[0228] Determine the current driving training items of the driving training vehicle according to the current driving scenario;

[0229] Selecting a matching teaching sub-scheme that matches the current driving scenario and / or the current driving training project from the driving teaching scheme;

[0230] According to the basic driving information, the teaching sub-scheme is adjusted and matched to obtain a real-time teaching scheme for the current driving scene; the real-time teaching scheme includes at least one guidance instruction; each guidance instruction is a vehicle operation guidance instruction or an observation behavior guidance instruction.

[0231] It can be seen that the device described in the implementation of this optional embodiment can determine the current driving training project of the driving training vehicle according to the current driving scene, and then screen out the matching teaching sub-program that matches the current driving scene and / or the current driving training project from the driving teaching plan, and then adjust the matching teaching sub-program according to the acquired basic driving information of the student to obtain a real-time teaching plan for the current driving scene, which can improve the screening accuracy of the teaching sub-program that matches the current driving scene and / or the current driving training project, and improve the adjustment accuracy of the matching teaching sub-program, thereby helping to improve the accuracy of the real-time teaching plan, and then help to further improve the adaptability of the real-time teaching plan to the current situation of the student, and then can more effectively guide the student to learn and implement the corresponding driving skills in the current situation, which helps to improve the efficiency of the student in mastering driving skills.

[0232] In another optional embodiment, the acquisition module 301 is further configured to acquire second real-time driving data of the driving training vehicle related to the real-time teaching plan after the generation module 304 generates a real-time teaching plan corresponding to the current driving scene according to the driving teaching plan;

[0233] The analysis module 302 is further used to analyze the second real-time driving data to obtain the real-time driving behavior implemented by the trainee;

[0234] The acquisition module 303 is further used to acquire driving evaluation criteria; the driving evaluation criteria include standard driving behaviors corresponding to the real-time teaching scheme and / or evaluation rules corresponding to the standard driving behaviors;

[0235] And, if Figure 5 As shown, the device may also include:

[0236] An evaluation module 305 is used to evaluate the real-time driving behavior according to the driving evaluation criteria and the current driving scenario, and obtain the driving evaluation result of the trainee on the real-time teaching plan;

[0237] The student's driving assessment results regarding the real-time teaching plan include driving behavior assessment results and / or driving risk assessment results.

[0238] It can be seen that the device described in the implementation of this optional embodiment can collect the second real-time driving data of the driving training vehicle about the real-time teaching plan after generating the real-time teaching plan, and then obtain the real-time driving behavior implemented by the trainee by analyzing the second real-time driving data, and then evaluate the real-time driving behavior according to the acquired driving judgment standard and the current driving scene to obtain the driving evaluation result, which can improve the analysis accuracy of the second real-time driving data, thereby improving the determination accuracy and efficiency of the driving evaluation result, and then can promptly feedback the accurate driving judgment result to the trainee, which is conducive to timely correcting the trainee's driving behavior.

[0239] In this optional embodiment, optionally, as Figure 5 As shown, the device may further include a judgment module 306, wherein:

[0240] The judging module 306 is used to judge whether the real-time driving behavior meets the preset standard behavior condition according to the driving behavior evaluation result after the evaluation module 305 evaluates the real-time driving behavior according to the driving evaluation standard and the current driving scene and obtains the driving evaluation result of the trainee on the real-time teaching plan;

[0241] The generating module 304 is further configured to generate a behavior warning message for the driving behavior evaluation result and / or deduct a score corresponding to the real-time driving behavior of the trainee in the current driving training when the judging module 306 judges that the real-time driving behavior does not meet the standard behavior condition; and / or,

[0242] The judgment module 306 is further used to, after the evaluation module 305 evaluates the real-time driving behavior according to the driving evaluation criteria and the current driving scenario, and obtains the driving evaluation result of the trainee on the real-time teaching plan, determine whether the real-time driving behavior meets the pre-set safe driving conditions according to the driving risk evaluation result;

[0243] The generation module 304 is also used to generate a safe driving intervention plan corresponding to the driving risk assessment result when the judgment module 306 determines that the real-time driving behavior does not meet the safe driving conditions; the safe driving intervention plan includes safe driving instruction information and / or emergency control parameters corresponding to the driving training vehicle.

[0244] It can be seen that the device described in the implementation of this optional embodiment can also generate a behavioral warning message for the driving behavior evaluation result and / or deduct the score corresponding to the student's real-time driving behavior in the current driving training if it is judged that the real-time driving behavior does not meet the pre-set standard behavior conditions based on the driving behavior evaluation results, and generate a safe driving intervention plan corresponding to the driving risk assessment result if it is judged that the real-time driving behavior does not meet the pre-set safe driving conditions based on the driving risk assessment results, which can further improve the analysis accuracy and judgment accuracy of the real-time driving behavior, thereby facilitating the feedback of corresponding prompt information to the student when the student's driving behavior is not standardized, and facilitating timely correction of the student's driving behavior; and, in the event of an emergency or a safety hazard, timely feedback of corresponding handling measures to the student, which is conducive to reminding the student to pay attention to potential dangerous situations, improving the safety of the student's driving, and cultivating the student's safety driving awareness.

[0245] In this optional embodiment, optionally, the generating module 304 is further configured to generate a driving training report corresponding to the current driving training according to all real-time teaching schemes generated by the trainee in the current driving training and the driving evaluation results corresponding to each real-time teaching scheme after the evaluating module 305 evaluates the real-time driving behavior according to the driving evaluation criteria and the current driving scenario and obtains the driving evaluation results of the trainee on the real-time teaching scheme;

[0246] And, if Figure 5 As shown, the device may also include:

[0247] The optimization module 307 is used to optimize the driving teaching plan corresponding to the student according to the driving training report and the acquired driving basic information of the student.

[0248] It can be seen that the device described in the implementation of this optional embodiment can also generate a driving training report based on all real-time teaching plans generated by the trainee in the current driving training and the corresponding driving evaluation results, thereby realizing the intelligent generation of a driving training summary report, which is beneficial to help the trainee review the training process to improve driving skills; and, based on the driving training report and the trainee's basic driving information, optimizing the trainee's corresponding driving teaching plan, which can improve the optimization accuracy of the driving teaching plan, thereby facilitating the provision of more targeted personalized teaching plans to the trainee, and facilitating the trainee to improve his driving skills more efficiently in the next driving learning.

[0249] Embodiment 4

[0250] See also Figure 6 , Figure 6 is a structural diagram of another intelligent driving teaching device based on real-time driving conditions disclosed in an embodiment of the present invention. Figure 6 As shown, the intelligent driving teaching device based on real-time driving conditions may include:

[0251] A memory 401 storing executable program codes;

[0252] a processor 402 coupled to the memory 401;

[0253] The processor 402 calls the executable program code stored in the memory 401 to execute part or all of the steps in the intelligent driving teaching method based on real-time driving conditions described in the first embodiment of the present invention or the second embodiment of the present invention.

[0254] Embodiment 5

[0255] An embodiment of the present invention discloses a computer storage medium, which stores computer instructions. When the computer instructions are called, they are used to execute some or all of the steps in the intelligent driving teaching method based on real-time driving conditions described in Embodiment 1 or Embodiment 2 of the present invention.

[0256] Embodiment 6

[0257] An embodiment of the present invention discloses a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to enable a computer to execute some or all of the steps in the intelligent driving teaching method based on real-time driving conditions described in Example 1 or Example 2.

[0258] The device embodiments described above are only illustrative, wherein the modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, i.e., they may be located in one place, or they may be distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Those of ordinary skill in the art may understand and implement it without creative work.

[0259] Through the specific description of the above embodiments, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on such an understanding, the above technical solution can be essentially or partly contributed to the prior art in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, and the storage medium includes a read-only memory (ROM), a random access memory (RAM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a one-time programmable read-only memory (OTPROM), an electronically erasable rewritable read-only memory (EEPROM), a compact disc (CD-ROM) or other optical disc storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.

[0260] Finally, it should be noted that the intelligent driving teaching method and device based on real-time driving conditions disclosed in the embodiments of the present invention only disclose the preferred embodiments of the present invention, which are only used to illustrate the technical solution of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, it should be understood by those skilled in the art that the technical solutions described in the aforementioned embodiments can still be modified, or some of the technical features therein can be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. An intelligent driving teaching method based on real-time driving conditions, characterized in that: The method comprises: Collecting environmental data of the driving environment in which the driving training vehicle is located and first real-time driving data corresponding to the driving training vehicle; Analyzing a current driving scenario corresponding to the driving training vehicle according to the environmental data and the first real-time driving data; Obtaining a driving teaching plan corresponding to the student currently operating the driving training vehicle; According to the driving teaching plan, a real-time teaching plan corresponding to the current driving scenario is generated; the real-time teaching plan is used to guide the student to implement corresponding standard driving behavior for the current driving scenario.

2. The intelligent driving teaching method based on real-time driving conditions according to claim 1 is characterized in that: The environmental data of the driving environment in which the driving training vehicle is located is collected, including: Based on the sensor equipment corresponding to the driving training vehicle, environmental sensor data of the driving environment in which the driving training vehicle is located is collected; the sensor equipment includes an on-board sensor equipment and / or a roadside sensor equipment; the environmental sensor data includes first sensor data collected by the on-board sensor equipment and / or second sensor data collected by the roadside sensor data; Based on the determined data fusion algorithm, performing a data fusion operation on the environmental sensor data to obtain environmental data of the driving environment; Among them, the environmental data includes at least one of the road information where the driving training vehicle is located, the traffic information of the lane where the driving training vehicle is located, the adjacent object information of the target lane corresponding to the driving training vehicle, and the weather information of the driving environment; wherein the traffic information includes at least one of the traffic light information corresponding to the lane, the road condition information of the lane, the traffic flow information of the lane and the traffic event information of the lane; the target lane includes the lane where the driving training vehicle is located and / or the adjacent lane corresponding to the lane; the adjacent object information includes the position parameters of the adjacent objects and / or the movement parameters of the adjacent objects.

3. The intelligent driving teaching method based on real-time driving conditions according to claim 2 is characterized in that: The first real-time driving data corresponding to the driving training vehicle includes the driving behavior data of the trainee and / or the vehicle travel data of the driving training vehicle; Wherein, analyzing the current driving scene corresponding to the driving training vehicle according to the environmental data and the first real-time driving data includes: Determining a driving area scene corresponding to the driving training vehicle according to the road information on which the driving training vehicle is located and the traffic information; and / or, Determining the weather scene corresponding to the driving training vehicle according to the weather information; and / or, Determining a driving road condition scenario of the driving training vehicle according to the first real-time driving data, the traffic information, and the adjacent object information; The current driving scene includes at least one of the driving area scene, the weather scene and the driving road condition scene.

4. The intelligent driving teaching method based on real-time driving conditions according to claim 1 is characterized in that: The method further comprises: Acquiring basic driving information of the trainee; the basic driving information includes at least one of driving learning experience, driving learning ability level, driving learning goals, driving habit information, trainee psychological quality and trainee physical information; Wherein, generating a real-time teaching plan corresponding to the current driving scenario according to the driving teaching plan includes: Determining a current driving training item of the driving training vehicle according to the current driving scenario; Filtering out a matching teaching sub-scheme that matches the current driving scenario and / or the current driving training item from the driving teaching scheme; According to the basic driving information, the matching teaching sub-scheme is adjusted to obtain a real-time teaching scheme for the current driving scene; the real-time teaching scheme includes at least one guidance instruction; each of the guidance instructions is a vehicle operation guidance instruction or an observation behavior guidance instruction.

5. The intelligent driving teaching method based on real-time driving conditions according to any one of claims 1 to 4, characterized in that: After generating a real-time teaching plan corresponding to the current driving scenario according to the driving teaching plan, the method further includes: Collecting second real-time driving data of the driving training vehicle regarding the real-time teaching plan; analyzing the second real-time driving data to obtain the real-time driving behavior performed by the trainee; Acquiring a driving evaluation standard; the driving evaluation standard includes a standard driving behavior corresponding to the real-time teaching program and / or an evaluation rule corresponding to the standard driving behavior; According to the driving evaluation criteria and the current driving scenario, the real-time driving behavior is evaluated to obtain a driving evaluation result of the trainee with respect to the real-time teaching plan; The driving assessment result of the trainee regarding the real-time teaching program includes a driving behavior assessment result and / or a driving risk assessment result.

6. The intelligent driving teaching method based on real-time driving conditions according to claim 5 is characterized in that: After evaluating the real-time driving behavior according to the driving evaluation criteria and the current driving scenario and obtaining the student's driving evaluation result regarding the real-time teaching plan, the method further includes: According to the driving behavior evaluation result, determining whether the real-time driving behavior meets a preset standard behavior condition; When it is determined that the real-time driving behavior does not meet the standard behavior condition, generating a behavior warning message for the driving behavior evaluation result and / or deducting the score corresponding to the real-time driving behavior of the trainee in the current driving training; and / or, According to the driving risk assessment result, determining whether the real-time driving behavior meets the pre-set safe driving conditions; When it is determined that the real-time driving behavior does not meet the safe driving conditions, a safe driving intervention plan corresponding to the driving risk assessment result is generated; the safe driving intervention plan includes safe driving instruction information and / or emergency control parameters corresponding to the driving training vehicle.

7. The intelligent driving teaching method based on real-time driving conditions according to claim 5 is characterized in that: After evaluating the real-time driving behavior according to the driving evaluation criteria and the current driving scenario and obtaining the student's driving evaluation result regarding the real-time teaching plan, the method further includes: Generate a driving training report corresponding to the current driving training according to all the real-time teaching plans generated by the trainee in the current driving training and the driving evaluation results corresponding to each of the real-time teaching plans; The driving training plan corresponding to the student is optimized according to the driving training report and the acquired basic driving information of the student.

8. An intelligent driving teaching device based on real-time driving conditions, characterized in that: The device comprises: A collection module, used to collect environmental data of the driving environment in which the driving training vehicle is located and first real-time driving data corresponding to the driving training vehicle; An analysis module, configured to analyze a current driving scenario corresponding to the driving training vehicle according to the environmental data and the first real-time driving data; An acquisition module, used to acquire a driving teaching plan corresponding to the student currently operating the driving training vehicle; A generation module is used to generate a real-time teaching plan corresponding to the current driving scenario according to the driving teaching plan; the real-time teaching plan is used to guide the student to implement corresponding standard driving behavior for the current driving scenario.

9. An intelligent driving teaching device based on real-time driving conditions, characterized in that: The device comprises: A memory storing executable program code; a processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the intelligent driving teaching method based on real-time driving conditions as described in any one of claims 1-7.

10. A computer storage medium, characterized in that: The computer storage medium stores computer instructions, which, when called, are used to execute the intelligent driving teaching method based on real-time driving conditions as described in any one of claims 1-7.

Images