Intelligent auxiliary method and system for driving training

Abstract

The embodiment of the invention provides an intelligent auxiliary method and system for driving training, and can solve the problem that students are difficult to adapt to or correctly complete projects during examination or actual driving due to the fact that most driving training adopts a point location recording mode for teaching but the mode lacks flexibility and is easily influenced by multiple modes. The method comprises the following steps: acquiring vehicle moving state information of a target student in an inner road test driving training process; under the condition that the vehicle moving state information indicates that the trainee is about to arrive at a theoretical reference observation point for triggering the execution time of the next driving operation, acquiring actual driving posture information of the trainee, the theoretical reference observation point for triggering the execution opportunity of the next driving operation is a theoretical observation point for triggering the execution of the next driving operation action when the trainee learns the inner road test training item; and when the actual driving attitude information is not matched with the preset point observation attitude, generating a prompt message so as to assist the trainee in completing a training project.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a driving training intelligent assistance method and system. Background Art

[0002] In the training of driving test, the internal road test is an important part that students must master, including reverse parking, parallel parking, right-angle turning, fixed-point parking and starting on a ramp, etc. These test items usually require students to accurately control the vehicle's driving trajectory in a limited space and complete specific driving operations. At present, most driving training adopts the "point-remembering" method to teach, that is, to guide students to observe specific reference points inside and outside the car to determine when to turn, brake or adjust the position of the vehicle body. For example, when reversing into a garage, students may be taught to turn the steering wheel when the lower edge of the rearview mirror inside the car is aligned with a ground mark, while when parking sideways, they may need to take the next step when a corner of the window coincides with the sign pole next to it. The advantage of this method is that the operating steps can be standardized, and students can quickly become familiar with the test process through repeated practice, and accurately perform operations during the test to improve the pass rate. However, this method lacks flexibility and is easily affected by various methods, making it difficult for students to adapt or complete the project correctly during the test or actual driving. Summary of the invention

[0003] The embodiments of the present application provide an intelligent assistance method and system for driving training, which can solve the problem that most driving training adopts the "remembering points" method for teaching, but this method lacks flexibility and is easily affected by various methods, making it difficult for students to adapt to or correctly complete the project during exams or actual driving.

[0004] A first aspect of an embodiment of the present application provides a driving training intelligent assistance method, comprising:

[0005] Obtain the vehicle movement status information of the target student during the on-road test driving training;

[0006] When the vehicle movement status information indicates that a theoretical reference observation point for triggering the next driving operation execution timing is about to be reached, the actual driving posture information of the target student is obtained, and the theoretical reference observation point for triggering the next driving operation execution timing is a theoretical observation point for triggering the student to execute the next driving operation action when learning the internal road test training project, so that the vehicle can move according to a preset trajectory when reaching the theoretical observation point and receiving the next driving operation action to complete the training project;

[0007] In the case where the actual driving posture information does not match the preset point observation posture, a prompt message is generated to assist the trainee in completing the training program.

[0008] Optionally, when the actual driving posture information does not match the preset point observation posture, generating a prompt message to assist the trainee in completing the training program includes:

[0009] In the case where the actual driving posture information does not match the preset point observation posture, an observation posture correction prompt message is generated, and the preset point observation posture is a theoretical observation posture corresponding to the driving operation reference observation point when the driving operation is designed.

[0010] Optionally, also include:

[0011] After sending the generated observation posture correction prompt message, continuing to monitor the actual driving posture information of the target student;

[0012] When the actual driving posture information still does not match the observation posture at the preset point, the vehicle is controlled to stop or shut down.

[0013] Optionally, when the actual driving posture information does not match the preset point observation posture, generating a prompt message to assist the trainee in completing the training program includes:

[0014] In the case where the actual driving posture information does not match the preset point observation posture, a target reference observation point that matches the current actual driving posture is re-determined based on the acquired current actual driving posture information, and the target reference observation point is a new reference observation point that enables the vehicle to move close to the preset trajectory after reaching the target reference observation point and receiving the next driving operation action to complete the training project when the current actual driving posture is used as the observation posture;

[0015] The target reference observation point is used as a theoretical reference observation point update message to prompt the target student.

[0016] Optionally, also include:

[0017] When the target trainee completes the current training project, all target reference observation points generated by the trainee in the process of completing the current training project are used as teaching update content;

[0018] Only the teaching content of the current training program of the target student is updated according to the teaching update content.

[0019] Optionally, when the actual driving posture information does not match the preset point observation posture, generating a prompt message to assist the trainee in completing the training program includes:

[0020] In the case where the actual driving posture information does not match the observation posture at the preset point, re-determine the next driving operation update action that matches the current actual driving posture based on the acquired current actual driving posture information, and the next driving operation update action is a new driving operation action that enables the vehicle to move close to the preset trajectory after reaching the theoretical observation point and receiving the next driving operation update action, thereby completing the training project, when the current actual driving posture is used as the observation posture;

[0021] The next driving operation update action is used as a next driving operation action update message to prompt the trainee.

[0022] Optionally, also include:

[0023] When the target trainee completes the current training project, updating the driving operation actions generated by the trainee in the process of completing the current training project as teaching update content;

[0024] Only the teaching content of the current training program of the target student is updated according to the teaching update content.

[0025] A second aspect of an embodiment of the present application provides an intelligent auxiliary device for driving training, comprising:

[0026] The first acquisition unit is used to acquire the vehicle movement state information of the target student during the on-road test driving training;

[0027] A second acquisition unit is used to acquire the actual driving posture information of the target student when the vehicle movement state information indicates that a theoretical reference observation point for triggering the next driving operation execution timing is about to be reached, wherein the theoretical reference observation point for triggering the next driving operation execution timing is a theoretical observation point for triggering the next driving operation action when the student is learning the internal road test training item, so that the vehicle can move according to a preset trajectory to complete the training item when it reaches the theoretical observation point and receives the next driving operation action;

[0028] The auxiliary unit is used to generate a prompt message when the actual driving posture information does not match the observation posture at the preset point, so as to assist the trainee to complete the training project.

[0029] A third aspect of an embodiment of the present application provides an electronic system, including a memory and a processor, wherein the processor is configured to implement the steps of the above-mentioned intelligent assistance method for driving training when executing a computer program stored in the memory.

[0030] A fourth aspect of an embodiment of the present application provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of the above-mentioned driving training intelligent assistance method are implemented.

[0031] In summary, the driving training intelligent assistance method provided by the embodiment of the present application obtains the vehicle movement state information of the target student during the internal road test driving training; when the vehicle movement state information indicates that the theoretical reference observation point for triggering the next driving operation execution time is about to be reached, the actual driving posture information of the target student is obtained, and the theoretical reference observation point for triggering the next driving operation execution time is the theoretical observation point for triggering the next driving operation action when the student is learning the internal road test training project, so that the vehicle can move according to the preset trajectory when it reaches the theoretical observation point and receives the next driving operation action to complete the training project; when the actual driving posture information does not match the preset point observation posture, a prompt message is generated to assist the student to complete the training project. It can solve the reference point error problem caused by driving posture changes, so that students can accurately judge the operation timing in different situations. Through intelligent monitoring and real-time feedback, students can perform driving operations more accurately and avoid test failures caused by posture problems. Let students gradually get rid of the dependence on "remembering points", rely more on car sense, field of vision adjustment and other methods to drive, and improve their adaptability in complex road environments. Through automatic detection and prompts, instructor intervention is reduced, training efficiency is improved, and students can master standardized driving skills in a shorter time.

[0032] Correspondingly, the driving training intelligent auxiliary device, electronic system and computer-readable storage medium provided in the embodiments of the present invention also have the above-mentioned technical effects. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 A flowchart of a possible intelligent assistance method for driving training provided in an embodiment of the present application;

[0034] Figure 2 A schematic structural block diagram of a possible intelligent auxiliary device for driving training provided in an embodiment of the present application;

[0035] Figure 3 A schematic diagram of the hardware structure of a possible intelligent auxiliary device for driving training provided in an embodiment of the present application;

[0036] Figure 4 A schematic structural block diagram of a possible electronic system provided in an embodiment of the present application;

[0037] Figure 5 A schematic structural block diagram of a possible computer-readable storage medium provided for an embodiment of the present application. DETAILED DESCRIPTION

[0038] The embodiments of the present application provide an intelligent assistance method and system for driving training, which can solve the problem that most driving training adopts the "remembering points" method for teaching, but this method lacks flexibility and is easily affected by various methods, making it difficult for students to adapt to or correctly complete the project during exams or actual driving.

[0039] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices. The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments.

[0040] See also Figure 1 , which is a flow chart of a driving training intelligent assistance method provided in an embodiment of the present application, and may specifically include: S110-S130.

[0041] S110, obtaining vehicle movement status information of the target student during the on-road test driving training.

[0042] S120, when the vehicle movement status information indicates that the theoretical reference observation point for triggering the next driving operation execution timing is about to be reached, the actual driving posture information of the target student is obtained, and the theoretical reference observation point for triggering the next driving operation execution timing is the theoretical observation point for triggering the student to execute the next driving operation action when learning the internal road test training project, so that the vehicle can move according to the preset trajectory when reaching the theoretical observation point and receiving the next driving operation action to complete the training project.

[0043] S130, when the actual driving posture information does not match the preset point observation posture, generating a prompt message to assist the trainee to complete the training project.

[0044] It is understandable that this method aims to solve the problem that the reference point of the "point-keeping position" changes during the driving training of trainees due to different individual driving postures. Traditional driving training methods mainly rely on "point-keeping positions", that is, let trainees judge when to turn or stop by fixed visual reference points in the car. However, due to differences in trainees' driving postures, head angles, seat adjustment methods, etc., the same reference point may be offset in the field of vision of different trainees, resulting in errors in the timing of operation. This error will not only affect the pass rate of the driving test, but also reduce the trainees' ability to adapt to the real road environment. Therefore, this method proposes an intelligent assistance solution, which monitors the trainees' driving posture in real time and compares it with the preset theoretical observation points. When deviations are found, the system will provide timely prompts to help trainees adjust their postures, thereby optimizing the driving training effect, improving the pass rate of the test and actual driving ability.

[0045] For example, the vehicle's movement status information during the trainee's driving training can be collected in real time through on-board sensors, GPS devices, and cameras. The vehicle's movement status information mainly includes data such as position coordinates, speed, steering wheel angle, body tilt angle, and wheel trajectory. For example, in reverse parking training, the system can record when the vehicle enters the parking position through GPS and IMU sensors, and combine the steering wheel angle information to determine whether the trainee turns at the right time. In addition, the camera can also monitor external environmental information such as parking lines and reversing identification poles to calculate the trainee's current training progress and operation timing. Through these data, the system can accurately grasp the trainee's driving behavior and provide an accurate basis for the subsequent calculation of theoretical observation points.

[0046] Exemplarily, based on the vehicle driving status data and the standard driving teaching process, the system calculates the theoretical observation points that the trainee should refer to when performing each step of the operation. The theoretical observation points are determined based on standard driving techniques to ensure that when the trainee performs a certain operation (such as steering, braking, or returning to the right direction), the vehicle can drive correctly according to the preset trajectory. For example, during parallel parking, the theoretical observation point may be "when the rearview mirror is aligned with the marking line behind the parking space, you should start turning the steering wheel to the right", or "when the body of the car is at a 30-degree angle to the storage space, you should start to return the steering wheel to the right." This calculation process needs to combine the real-time trajectory of the vehicle, the environmental information of the training ground, and the standard requirements of the driving test to ensure that the best operation suggestions are provided. By calculating the theoretical reference observation points, the system can provide each student with consistent training standards, thereby reducing errors caused by personal driving habits.

[0047] Exemplarily, in order to accurately determine whether the trainee has correctly observed the theoretical reference point during the training process, this step obtains the trainee's real-time driving posture information through in-car cameras, head posture sensors, seat pressure sensors and other equipment. The camera can detect the trainee's head direction and eye gaze position, and analyze whether it is at the correct observation angle through artificial intelligence algorithms. In addition, the head posture sensor can record the trainee's head tilt angle in real time to determine whether he has the habit of leaning forward, leaning back or tilting his head. For example, if the trainee habitually leans forward to check the rearview mirror when reversing into the garage, the system can record the posture information and determine whether it affects the accuracy of the observation point. At the same time, the seat pressure sensor can monitor whether the trainee has excessive body tilt during driving to prevent driving judgment from being affected by bad posture. By obtaining the trainee's actual driving posture information, the system can analyze whether its observation method is consistent with the standard teaching requirements, and provide data support for subsequent error analysis and prompts.

[0048] Exemplarily, the deviation between the student's actual observation point and the theoretical observation point can be calculated to determine whether the student's driving posture affects the accuracy of the driving operation. The system first extracts the student's head angle, line of sight direction, and actual observation reference point, and then compares them with the preset theoretical observation point. If it is found that the student's head deviation exceeds a certain threshold (for example, the left or right deviation exceeds 10°, or the forward tilt causes the reference point parallax to exceed 5cm), the system will determine that its posture does not match. For example, when reversing into a garage, a student's head tilts too much to the left, causing the relative position of the parking line in the rearview mirror to change, thereby causing it to turn the steering wheel in advance or delay. Similarly, when parking in a side position, if the student lowers his head too much, he may mistakenly think that the rearview mirror is aligned with the parking line, resulting in a skewed parking position. Through such matching analysis, the system can effectively identify driving errors caused by student posture deviations and take corresponding corrective measures.

[0049] Exemplarily, when the system detects that the student's actual driving posture does not match the theoretical observation point, it will generate prompts in a variety of ways to remind the student to make adjustments. These prompts can be voice, visual or tactile feedback. For example, when the student's head leans forward too much, causing the reference point to deviate when reversing into the garage, the system will play a voice prompt: "Please lean back in the seat and maintain a normal sitting posture." If the student's head tilts to one side, resulting in an error in the side parking operation, the system may highlight the correct observation angle on the in-vehicle display and provide a text prompt of "Please keep your head centered." In addition, in some cases, the system can also provide physical feedback by means of seat vibration, such as when the student's head deflects beyond the set angle, the seat vibrates slightly to remind them to adjust their posture. This intelligent prompt system can provide corrective suggestions before the student operates, ensuring that they perform driving operations at the correct observation point, thereby effectively improving the quality of training and the pass rate of the test.

[0050] It is understandable that this can effectively improve the posture error problem of students in driving training and improve the accuracy and adaptability of driving training. First, this method can help students grasp the correct timing of test operations more accurately, reduce operational errors caused by posture deviations, and thus improve the pass rate of the test. Secondly, this method can improve the actual driving ability of students, so that they no longer rely too much on "remembering points", but master driving skills in a more intuitive way. In addition, through intelligent detection and feedback, students can adjust their driving posture in time during training, gradually develop correct driving habits, and avoid bad driving habits caused by long-term incorrect postures. Finally, this method can also improve the efficiency of driving training, reduce the repetitive guidance work of coaches, enable students to master driving skills faster and more accurately, and ultimately improve overall driving safety.

[0051] In summary, the intelligent auxiliary method for driving training provided in the above embodiment obtains the vehicle movement state information of the target student during the internal road test driving training; when the vehicle movement state information indicates that the theoretical reference observation point for triggering the next driving operation execution time is about to be reached, the actual driving posture information of the target student is obtained, and the theoretical reference observation point for triggering the next driving operation execution time is the theoretical observation point for triggering the next driving operation action when the student is learning the internal road test training project, so that the vehicle can move according to the preset trajectory when it reaches the theoretical observation point and receives the next driving operation action to complete the training project; when the actual driving posture information does not match the observation posture of the preset point, a prompt message is generated to assist the student to complete the training project. It can solve the reference point error problem caused by driving posture changes, so that students can accurately judge the operation timing in different situations. Through intelligent monitoring and real-time feedback, students can perform driving operations more accurately and avoid test failures caused by posture problems. Let students gradually get rid of the dependence on "remembering points" and drive more by relying on car sense, field of vision adjustment, etc., to improve their adaptability in complex road environments. Through automatic detection and prompts, instructor intervention is reduced, training efficiency is improved, and students can master standardized driving skills in a shorter time.

[0052] In one embodiment, when the actual driving posture information does not match the preset point observation posture, generating a prompt message to assist the trainee in completing the training program includes:

[0053] In the case where the actual driving posture information does not match the preset point observation posture, an observation posture correction prompt message is generated, and the preset point observation posture is a theoretical observation posture corresponding to the driving operation reference observation point when the driving operation is designed.

[0054] It is understandable that when it is detected that the trainee's actual driving posture does not match the preset observation posture, the system will generate an observation posture correction prompt message to guide the trainee to adjust his posture, so as to ensure that he performs the driving operation at the correct observation point. The preset observation posture refers to the standard theoretical observation posture that the trainee is required to maintain when designing the reference observation point for driving operations. For example, in scenes such as reversing into a garage and parallel parking, the correct head angle, eye sight direction, body position, etc. all belong to the category of theoretical observation posture.

[0055] In one embodiment, it also includes:

[0056] After sending the generated observation posture correction prompt message, continuing to monitor the actual driving posture information of the target student;

[0057] When the actual driving posture information still does not match the observation posture at the preset point, the vehicle is controlled to stop or shut down.

[0058] In one embodiment, when the actual driving posture information does not match the preset point observation posture, generating a prompt message to assist the trainee in completing the training program includes:

[0059] In the case where the actual driving posture information does not match the preset point observation posture, a target reference observation point that matches the current actual driving posture is re-determined based on the acquired current actual driving posture information, and the target reference observation point is a new reference observation point that enables the vehicle to move close to the preset trajectory after reaching the target reference observation point and receiving the next driving operation action to complete the training project when the current actual driving posture is used as the observation posture;

[0060] The target reference observation point is used as a theoretical reference observation point update message to prompt the target student.

[0061] It is understandable that when the system detects that the student's actual driving posture information does not match the preset observation posture, it will not only generate a prompt message to remind the student to adjust the posture, but also dynamically adjust the adaptive target reference observation point based on the current actual driving posture information, so that even if the student's posture deviates, it can operate according to the new observation point to minimize the impact of posture errors on driving training, thereby ensuring that the vehicle moves according to the preset trajectory and completes the training project.

[0062] Exemplarily, the system first obtains the trainee's actual driving posture information through on-board cameras, head posture sensors, seat pressure sensors and other devices, including: head angle (left and right offset, pitch angle), line of sight direction (whether it is correctly aligned with the theoretical observation point), body sitting posture (whether it is excessively tilted or leaning forward). Then, the system compares the trainee's actual driving posture with the preset theoretical observation posture, and calculates the angle deviation, line of sight offset and other data between the two. If the posture deviation exceeds the preset threshold (for example, the head offset exceeds 8°, or the line of sight is not aligned with the correct reference point by more than 10°), the system determines that the current posture does not match, which may affect the accuracy of the operation.

[0063] Exemplarily, when the system detects that the student's posture does not match the theoretical posture, and the student does not correct it immediately, the system will calculate a new target reference observation point based on the current driving posture information to adapt to the current student's observation method to ensure that the driving operation can still be completed smoothly. The calculation method may include: adjusting the projection mapping of the observation point: the system calculates the position of the new observation point based on the student's current head angle and line of sight direction. For example, if the student leans forward too much, causing the observation point to shift in his field of vision, the system recalculates the new observation point so that even if the student maintains the current posture, the operation can be performed at the new observation point to keep the vehicle running on the correct trajectory; correct the matching rule of the observation point: if the student's head shifts to the left, causing the reference point to change when reversing into the garage, the system will automatically adjust the new observation point so that when the student observes the new point from the current perspective, the timing of steering can still be guaranteed to be accurate. For example, originally in the correct posture, the steering wheel needs to be turned when the lower edge of the rearview mirror is aligned with the parking space marking, but if the student habitually tilts his head, the system recalculates the equivalent observation point based on the current posture. Calculate the impact on the vehicle trajectory and optimize the adjustment: Combined with the vehicle's real-time driving status, calculate whether the new observation point will affect the vehicle trajectory. For example, if the student tilts his head back when parking sideways, causing the position of the parking line observed by the rearview mirror to change, the system calculates whether the target parking angle needs to be adjusted appropriately to keep the final parking result in line with the standard.

[0064] Illustratively, after calculating the new target reference observation point, the system uses it as an updated theoretical observation point and prompts the trainees in various ways to operate according to the adjusted observation point, for example, voice prompt: "Your observation angle has been adjusted. Please perform operations after seeing the new reference point." or "Due to your head offset, the new observation point has been adapted. Please observe the new marking position in the rearview mirror."; In-vehicle display screen / AR assisted guidance: highlight the adjustment result of the current observation point on the in-vehicle screen to help trainees understand how to correctly use the new observation point for operation or in the AR display, mark the new observation point position through virtual projection to guide trainees to adjust their observation method.

[0065] Taking reversing into a parking space as an example, when students are reversing into a parking space, the system presets the observation point as "turn the steering wheel when the lower edge of the rearview mirror is aligned with the parking line". However, some students tend to lean forward, which causes the observed parking line position to deviate, which may cause them to turn the steering wheel earlier or later. Detect the student's forward leaning, record the head offset angle, and calculate a new equivalent observation point. Calculate a new reference point. For example, because the student leans forward 5cm, the system adjusts the new observation point to "turn the steering wheel when the door handle is aligned with the parking line". Provide voice + AR prompts to guide students to use the new observation point to complete the operation. In this way, it adapts to individual differences so that students can correctly complete reversing into a parking space even in different postures.

[0066] Taking parallel parking as an example, when a trainee is parking in a parallel position, the observation point set by the system is "start steering when the rearview mirror is aimed at the rear marking line". However, because a trainee tilted his head back, the position of the marking line in the rearview mirror changed, resulting in a deviation in the parking position. Detect the head tilt and calculate the deviation of the rearview mirror viewing angle. Calculate the new observation point and adjust it to "start steering when the bottom edge of the rearview mirror is offset from the rear marking line by a certain distance". Through voice + in-vehicle screen prompts, remind the trainee "please refer to the updated observation point for operation". In this way, the accuracy of the parallel parking operation is still guaranteed under the postures that different trainees are accustomed to, avoiding failures caused by different postures.

[0067] It is understandable that by recalculating a new observation point that matches the student's current posture, misoperation caused by individual differences can be avoided. Traditional training methods require students to operate according to fixed points, while this method can adapt to different postures, making it easier for students to get started. By accurately adjusting the observation point, even if the student's posture changes, it can ensure that they perform driving operations at the right time, thereby improving the pass rate of the test. According to the driving habits of different students, personalized observation point adjustment is provided to improve learning efficiency, reduce coach intervention, and improve training quality.

[0068] In one embodiment, it also includes:

[0069] When the target trainee completes the current training project, all target reference observation points generated by the trainee in the process of completing the current training project are used as teaching update content;

[0070] Only the teaching content of the current training program of the target student is updated according to the teaching update content.

[0071] It is understandable that by recording all the target reference observation points used by students when completing training projects, and updating the student-specific teaching content based on this, subsequent training will be more in line with their personal driving habits, reducing the adaptability problems caused by the fixed "remembering point" method. The personalized observation point suggestions are only displayed when the student logs in to the driving training system. Other students still use standard observation points for training and are not affected. Dynamically adapt but do not solidify wrong habits. If it is found that a student's personal observation point allows him to complete training in the short term, but may cause long-term driving errors (such as excessive deviation of the observation point), the system will not permanently store the observation point, but gradually guide the student to adjust to a more standard posture through prompts. Adaptive adjustment strategy. After each training, the system will re-evaluate whether the student's posture has changed. If the student gradually adjusts to a more standard driving posture, the system may restore the observation point he uses to a point closer to the standard point to ensure that he can adapt in a wider range of driving environments.

[0072] According to some embodiments, when the actual driving posture information does not match the preset point observation posture, generating a prompt message to assist the trainee in completing the training program includes:

[0073] In the case where the actual driving posture information does not match the observation posture at the preset point, re-determine the next driving operation update action that matches the current actual driving posture based on the acquired current actual driving posture information, and the next driving operation update action is a new driving operation action that enables the vehicle to move close to the preset trajectory after reaching the theoretical observation point and receiving the next driving operation update action, thereby completing the training project, when the current actual driving posture is used as the observation posture;

[0074] The next driving operation update action is used as a next driving operation action update message to prompt the trainee.

[0075] It is understandable that when the system detects that the student's actual driving posture information does not match the preset point observation posture, it will not only provide a prompt message to guide the student to adjust the posture, but also dynamically adjust the next driving operation based on the student's current actual driving posture. That is, the system will recalculate a next driving operation update action that adapts to the student's current observation method, so that even if the student's posture is deviated, the vehicle can still be adjusted by adjusting the operation method to approach the target driving path according to the preset trajectory, thereby completing the training project. The system will eventually use the adjusted operation action as an updated driving operation action and provide it to the student through a prompt message to guide him to perform adaptive driving operations.

[0076] For example, when the system detects that the trainee's observation point has changed and the trainee does not immediately adjust the posture, the system will not only suggest that the trainee change the posture, but will further calculate a new driving operation so that the trainee can successfully complete the driving task even if the current posture is maintained. The calculation method may include: dynamically adjusting the steering angle of the steering wheel. If the trainee's head is tilted to the left, resulting in a change in the observed reference point, which may cause the trainee to turn the steering wheel too early or too late, the system will adjust the steering angle recommendation. For example, when reversing into a garage, the standard operation is "turn the steering wheel with the rearview mirror aligned with the parking line", but if the trainee's perspective is offset, the system can be adjusted to "turn the steering wheel when the distance between the rear of the car and the garage line reaches a new matching value"; correct the throttle or brake control. If the trainee leans forward and causes the observation point to change, affecting the braking timing, for example, when the trainee lowers his head when parking at a fixed point on a slope, resulting in a parking position error, the system can adjust the recommended parking point. For example, the standard braking timing is adjusted to "brake 0.5s after the front marking enters the window reference area." Optimize the timing of returning the steering wheel to the correct position. When parking sideways or reversing into a garage, if the student's perspective deviation causes the wrong direction of return, the system will adjust the timing of the new direction of return based on the current posture. For example, if the student's angle deviation when observing the rearview mirror is +10°, the system can be adjusted to "turn the body angle 5° more inward than the standard return angle before returning to the correct position."

[0077] For example, after calculating the new driving operation that adapts to the trainee's posture, the system will immediately provide adaptive update messages, and guide the trainee to complete the driving action according to the new adjustment operation through voice, visual, vibration feedback, etc. For example, voice prompts (applicable to real-time operation adjustment): "Your observation angle has been adjusted, start steering a little later to ensure correct parking." Or "Because your head is tilted to the left, the new parking point has been updated. Please brake after the rear of the car enters the observation area."; In-vehicle display screen / AR auxiliary guidance (applicable to precise adjustment): Dynamically adjust the observation point and operation prompts on the in-vehicle screen. For example, when reversing into the garage, the system will mark the new steering wheel turning time and prompt "Please turn when the new marking is aligned." Or through the AR display system, project a new reference point in the car window or rearview mirror to guide the trainee to understand more intuitively when to operate; tactile feedback (seat or steering wheel vibration): When the trainee's operation needs to be adjusted, provide slight vibration feedback. For example, in parallel parking, if the trainee should return to the correct direction a little later, the steering wheel can vibrate slightly to prompt.

[0078] Taking the dynamic operation adjustment of reversing into a parking space as an example, the original standard operation of the trainee when reversing into a parking space is "start steering when the rearview mirror is aligned with the parking line". However, due to the habitual tilt of the trainee's head, the observed line appears in the rearview mirror in advance, resulting in premature steering and too small an angle for parking. Calculate the trainee's observation point deviation and calculate the timing of the new steering wheel operation. Voice prompt: "Please start steering after the vehicle further backs up 15cm." The new steering wheel operation point is displayed on the in-vehicle screen so that it can park correctly. As a result, the trainee can complete the correct reversing operation even if he maintains the original observation posture.

[0079] Taking the dynamic operation adjustment of side parking as an example, when a trainee was parking sideways, his head tilted forward, causing the observed parking line position to change, causing him to return to the center of the steering wheel too early, and the final parking position was skewed. The trainee's observation point error was calculated and the return timing was recalculated. The voice prompt: "Please reverse 10cm before returning the steering wheel to ensure correct parking." The in-vehicle display highlights the new return point and provides a vibration prompt. In this way, parking failures caused by observation angle deviation can be avoided and the trainee's adaptability can be improved.

[0080] It is understandable that by adjusting the operation timing, students can accurately perform driving tasks under different observation postures. The traditional method requires students to operate strictly according to fixed points, but this method can adapt to individual differences and improve driving flexibility. Combining voice, vision, and vibration feedback, students can more intuitively understand the adjusted operation mode and improve learning efficiency. By intelligently adjusting driving operations, students can master the correct operation in a short time and improve the pass rate of the test.

[0081] In one embodiment, it also includes:

[0082] When the target trainee completes the current training project, updating the driving operation actions generated by the trainee in the process of completing the current training project as teaching update content;

[0083] Only the teaching content of the current training program of the target student is updated according to the teaching update content.

[0084] See also Figure 2 , an embodiment of the intelligent auxiliary device for driving training in the embodiment of the present application may include:

[0085] The first acquisition unit 201 is used to acquire the vehicle movement state information of the target student during the on-road test driving training;

[0086] The second acquisition unit 202 is used to acquire the actual driving posture information of the target student when the vehicle movement state information indicates that the theoretical reference observation point for triggering the next driving operation execution timing is about to be reached, and the theoretical reference observation point for triggering the next driving operation execution timing is the theoretical observation point for triggering the next driving operation action when the student is learning the internal road test training project, so that the vehicle can move according to the preset trajectory when reaching the theoretical observation point and receiving the next driving operation action to complete the training project;

[0087] The auxiliary unit 203 is used to generate a prompt message when the actual driving posture information does not match the preset point observation posture, so as to assist the student to complete the training project.

[0088] In summary, the intelligent auxiliary device for driving training provided in the above embodiments obtains the vehicle movement state information of the target student during the internal road test driving training; when the vehicle movement state information indicates that the theoretical reference observation point for triggering the next driving operation execution time is about to be reached, the actual driving posture information of the target student is obtained, and the theoretical reference observation point for triggering the next driving operation execution time is the theoretical observation point for triggering the next driving operation action when the student is learning the internal road test training project, so that the vehicle can move according to the preset trajectory when it reaches the theoretical observation point and receives the next driving operation action to complete the training project; when the actual driving posture information does not match the observation posture of the preset point, a prompt message is generated to assist the student to complete the training project. It can solve the reference point error problem caused by driving posture changes, so that students can accurately judge the operation timing in different situations. Through intelligent monitoring and real-time feedback, students can perform driving operations more accurately and avoid test failures caused by posture problems. Let students gradually get rid of the dependence on "remembering points" and drive more by relying on car sense, field of vision adjustment, etc., to improve their adaptability in complex road environments. Through automatic detection and prompts, instructor intervention is reduced, training efficiency is improved, and students can master standardized driving skills in a shorter time.

[0089] above Figure 2 The intelligent driving training assistance device in the embodiment of the present application is described from the perspective of modular functional entities. The intelligent driving training assistance device in the embodiment of the present application is described in detail from the perspective of hardware processing. Figure 3 , an embodiment of the driving training intelligent auxiliary device 300 in the embodiment of the present application includes:

[0090] An input device 301, an output device 302, a processor 303 and a memory 304, wherein the number of the processor 303 can be one or more. Figure 3In some embodiments of the present application, the input device 301, the output device 302, the processor 303 and the memory 304 may be connected via a bus or other means, wherein: Figure 3 The example of connecting through bus is taken in the following.

[0091] Wherein, by calling the operation instructions stored in the memory 304, the processor 303 is used to execute the above method steps.

[0092] By calling the operation instructions stored in the memory 304, the processor 303 is also used to execute Figure 1 Any method in the corresponding embodiment.

[0093] See also Figure 4 , Figure 4 A schematic diagram of an electronic system according to an embodiment of the present application.

[0094] like Figure 4 As shown, an embodiment of the present application provides an electronic system, including a memory 410, a processor 420, and a computer program 411 stored in the memory 420 and executable on the processor 420. When the processor 420 executes the computer program 411, the above method steps are implemented.

[0095] In the specific implementation process, when the processor 420 executes the computer program 411, it can achieve Figure 1 Any implementation manner in the corresponding embodiments.

[0096] Since the electronic system introduced in this embodiment is a device used to implement a driving training intelligent assistance device in the embodiment of the present application, based on the method introduced in the embodiment of the present application, technical personnel in this field can understand the specific implementation method of the electronic system of this embodiment and its various variations. Therefore, how the electronic system implements the method in the embodiment of the present application is not introduced in detail here. As long as the equipment used by technical personnel in this field to implement the method in the embodiment of the present application is within the scope of protection of this application.

[0097] See also Figure 5 , Figure 5 A schematic diagram of an embodiment of a computer-readable storage medium provided in an embodiment of the present application.

[0098] like Figure 5 As shown, this embodiment provides a computer-readable storage medium 500 on which a computer program 511 is stored. When the computer program 511 is executed by a processor, the above method steps are implemented.

[0099] In the specific implementation process, when the computer program 511 is executed by the processor, it can achieve Figure 1Any implementation manner in the corresponding embodiments.

[0100] It should be noted that in the above embodiments, the description of each embodiment has its own emphasis, and for parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0101] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0102] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded computer, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0103] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0104] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0105] The present application also provides a computer program product, which includes computer software instructions. When the computer software instructions are executed on a processing device, the processing device is caused to execute the following Figure 1 The process in the driving training intelligent assistance method in the corresponding embodiment.

[0106] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website site, a computer, a server, or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server, or data center. The computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a server or a data center that includes one or more available media integrated. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state disk (SSD)), etc.

[0107] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0108] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0109] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0110] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0111] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), disk or optical disk and other media that can store program codes.

[0112] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A driving training intelligent assistance method, characterized in that: include: Obtain the vehicle movement status information of the target student during the on-road test driving training; When the vehicle movement status information indicates that a theoretical reference observation point for triggering the next driving operation execution timing is about to be reached, the actual driving posture information of the target student is obtained, and the theoretical reference observation point for triggering the next driving operation execution timing is a theoretical observation point for triggering the student to execute the next driving operation action when learning the internal road test training project, so that the vehicle can move according to a preset trajectory when reaching the theoretical observation point and receiving the next driving operation action to complete the training project; In the case where the actual driving posture information does not match the preset point observation posture, a prompt message is generated to assist the trainee in completing the training program.

2. The method according to claim 1, characterized in that When the actual driving posture information does not match the preset point observation posture, generating a prompt message to assist the trainee in completing the training project includes: In the case where the actual driving posture information does not match the preset point observation posture, an observation posture correction prompt message is generated, and the preset point observation posture is a theoretical observation posture corresponding to the driving operation reference observation point when the driving operation is designed.

3. The method according to claim 2, characterized in that Also includes: After sending the generated observation posture correction prompt message, continuing to monitor the actual driving posture information of the target student; When the actual driving posture information still does not match the observation posture at the preset point, the vehicle is controlled to stop or shut down.

4. The method according to claim 1, characterized in that: When the actual driving posture information does not match the preset point observation posture, generating a prompt message to assist the trainee in completing the training project includes: In the case where the actual driving posture information does not match the preset point observation posture, a target reference observation point that matches the current actual driving posture is re-determined based on the acquired current actual driving posture information, and the target reference observation point is a new reference observation point that enables the vehicle to move close to the preset trajectory after reaching the target reference observation point and receiving the next driving operation action to complete the training project when the current actual driving posture is used as the observation posture; The target reference observation point is used as a theoretical reference observation point update message to prompt the target student.

5. The method according to claim 4, characterized in that Also includes: When the target trainee completes the current training project, all target reference observation points generated by the trainee in the process of completing the current training project are used as teaching update content; Only the teaching content of the current training program of the target student is updated according to the teaching update content.

6. The method according to claim 1, characterized in that When the actual driving posture information does not match the preset point observation posture, generating a prompt message to assist the trainee in completing the training project includes: In the case where the actual driving posture information does not match the observation posture at the preset point, re-determine the next driving operation update action that matches the current actual driving posture based on the acquired current actual driving posture information, and the next driving operation update action is a new driving operation action that enables the vehicle to move close to the preset trajectory after reaching the theoretical observation point and receiving the next driving operation update action, thereby completing the training project, when the current actual driving posture is used as the observation posture; The next driving operation update action is used as a next driving operation action update message to prompt the trainee.

7. The method according to claim 6, characterized in that Also includes: When the target trainee completes the current training project, updating the driving operation actions generated by the trainee in the process of completing the current training project as teaching update content; Only the teaching content of the current training program of the target student is updated according to the teaching update content.

8. A driving training intelligent auxiliary device, characterized in that: include: The first acquisition unit is used to acquire the vehicle movement state information of the target student during the on-road test driving training; A second acquisition unit is used to acquire the actual driving posture information of the target student when the vehicle movement state information indicates that a theoretical reference observation point for triggering the next driving operation execution timing is about to be reached, wherein the theoretical reference observation point for triggering the next driving operation execution timing is a theoretical observation point for triggering the next driving operation action when the student is learning the internal road test training item, so that the vehicle can move according to a preset trajectory to complete the training item when it reaches the theoretical observation point and receives the next driving operation action; The auxiliary unit is used to generate a prompt message when the actual driving posture information does not match the observation posture at the preset point, so as to assist the trainee to complete the training project.

9. An electronic system, comprising a memory and a processor, characterized in that: The processor is used to implement the steps of the driving training intelligent assistance method according to any one of claims 1 to 7 when executing the computer program stored in the memory.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the driving training intelligent assistance method according to any one of claims 1 to 7 are implemented.

Images