Intelligent assistance method and system for driving training

Abstract

The embodiment of the application provides a driving training intelligent auxiliary method and system, which can solve the problem that most driving training adopts a "point recording" mode for teaching, but the mode lacks flexibility and is easily affected by various modes, so that students are difficult to adapt or correctly complete the project in the examination or actual driving. The method comprises the following steps: acquiring vehicle movement state information of a target student in an inner road test driving training process; in the case that the vehicle movement state information indicates that a theoretical reference observation point position that triggers a next driving operation execution opportunity is about to be reached, acquiring actual driving posture information of the student, the theoretical reference observation point position that triggers the next driving operation execution opportunity being a theoretical observation point position at which the student triggers a next driving operation action when learning an inner road test training project; and in the case that the actual driving posture information does not match a preset point position observation posture, generating a prompt message to assist the student to complete the training project.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to an intelligent assistance method and system for driving training. Background Technology

[0002] In driving test training, the on-road test is a crucial component that trainees must master, including maneuvers such as reversing into a parking space, parallel parking, right-angle turns, and hill starts. These tests typically require trainees to precisely control the vehicle's trajectory within a limited space to complete specific driving maneuvers. Currently, most driving training uses a "point-memorizing" method, instructing trainees to determine when to steer, brake, or adjust the vehicle's position by observing specific reference points inside and outside the car. For example, when reversing into a parking space, trainees might be taught to turn the steering wheel when the bottom edge of the rearview mirror aligns with a ground marker, while for parallel parking, they might be instructed to proceed when a corner of the window aligns with a nearby marker pole. The advantage of this method is that the operational steps are standardized, allowing trainees to quickly familiarize themselves with the test process through repeated practice and accurately execute the maneuvers during the actual test, thus improving the pass rate. However, this method lacks flexibility and is easily affected by various factors, making it difficult for trainees to adapt or correctly complete the maneuvers during the test or actual driving. Summary of the Invention

[0003] This application provides an intelligent driving training assistance method and system that can solve the problem that most driving training uses the "memorizing points" method for teaching. However, this method lacks flexibility and is easily affected by various factors, making it difficult for trainees to adapt or correctly complete the tasks during the test or actual driving.

[0004] The first aspect of this application provides a driving training intelligent assistance method, including:

[0005] Obtain vehicle movement status information of the target student during the on-road driving test training process;

[0006] When the vehicle movement status information indicates that it is about to reach the theoretical reference observation point that triggers the next driving operation, the actual driving posture information of the target student is obtained. The theoretical reference observation point that triggers the next driving operation is the theoretical observation point where the student triggers the next driving operation when learning the on-road test training project, so that the vehicle can move according to the preset trajectory to complete the training project when it reaches the theoretical observation point and receives the next driving operation.

[0007] If the actual driving posture information does not match the observation posture at the preset point, a prompt message is generated to assist the trainee in completing the training project.

[0008] Optionally, generating a prompt message when the actual driving posture information does not match the observation posture at the preset point, to assist the trainee in completing the training project, includes:

[0009] If the actual driving posture information does not match the observation posture at the preset point, an observation posture correction prompt message is generated. The preset point observation posture is the theoretical observation posture corresponding to the driving operation reference observation point.

[0010] Optional, also includes:

[0011] After issuing the generated observation posture correction prompt message, continue monitoring the actual driving posture information of the target student;

[0012] If the actual driving posture information still does not match the observation posture at the preset point, control the vehicle to stop or turn off the engine.

[0013] Optionally, generating a prompt message when the actual driving posture information does not match the observation posture at the preset point, to assist the trainee in completing the training project, includes:

[0014] If the actual driving posture information does not match the preset observation posture, a new target reference observation position that matches the current actual driving posture is determined based on the obtained current actual driving posture information. The target reference observation position is a new reference observation position that enables the vehicle to approach the preset trajectory and complete the training project after reaching the target reference observation position and receiving the next driving operation action when the current actual driving posture is used as the observation posture.

[0015] The target reference observation point is updated as the theoretical reference observation point, and the message is used to prompt the target student.

[0016] Optional, also includes:

[0017] If the target learner completes the current training project, the teaching update content is based on all target reference observation points generated by the learner during the completion of the current training project;

[0018] The teaching content for the current training program of the target learner will only be updated according to the teaching update content.

[0019] Optionally, generating a prompt message when the actual driving posture information does not match the observation posture at the preset point, to assist the trainee in completing the training project, includes:

[0020] If the actual driving posture information does not match the observation posture at the preset point, the next driving operation update action that matches the current actual driving posture is re-determined based on the obtained current actual driving posture information. The next driving operation update action is a new driving operation action that enables the vehicle to move close to the preset trajectory after reaching the theoretical observation point and receiving the next driving operation update action, so as to complete the training project, when the current actual driving posture is the observation posture.

[0021] The next driving operation update action is sent as a next driving operation update message to the trainee.

[0022] Optional, also includes:

[0023] If the target learner completes the current training program, all driving operation update actions generated by the learner during the completion of the current training program will be used as teaching update content.

[0024] The teaching content for the current training program of the target learner will only be updated according to the teaching update content.

[0025] A second aspect of this application provides a driver training intelligent assistance device, comprising:

[0026] The first acquisition unit is used to acquire vehicle movement status information of the target student during the on-road driving test training process;

[0027] The second acquisition unit is used to acquire the actual driving posture information of the target student when the vehicle movement status information indicates that the theoretical reference observation point for triggering the next driving operation is about to be reached. The theoretical reference observation point for triggering the next driving operation is the theoretical observation point for triggering the next driving operation when the student is learning the on-road test training project, so that the vehicle can move according to the preset trajectory to complete the training project when it reaches the theoretical observation point and receives the next driving operation.

[0028] The auxiliary unit is used to generate a prompt message when the actual driving posture information does not match the observation posture at the preset point, so as to assist the trainee in completing the training project.

[0029] A third aspect of this application provides an electronic system including a memory and a processor, wherein the processor is used to execute a computer program stored in the memory to implement the steps of the above-described intelligent driving training assistance method.

[0030] A fourth aspect of this application provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps of the above-described intelligent driving training assistance method.

[0031] In summary, the intelligent driving training assistance method provided in this application acquires vehicle movement status information of the target learner during on-road driving test training; when the vehicle movement status information indicates that the theoretical reference observation point for triggering the next driving operation is about to be reached, the method acquires the actual driving posture information of the target learner. The theoretical reference observation point for triggering the next driving operation is the theoretical observation point where the learner triggers the next driving operation action when learning the on-road driving test training item. This allows the vehicle to move along a preset trajectory to complete the training item when it reaches the theoretical observation point and receives the next driving operation action; if the actual driving posture information does not match the preset observation posture, a prompt message is generated to assist the learner in completing the training item. This solves the problem of reference point error caused by changes in driving posture, enabling learners to accurately judge the timing of operations in different situations. Through intelligent monitoring and real-time feedback, learners can execute driving operations more accurately, avoiding test failure due to posture problems. This allows learners to gradually break away from the dependence on "memorizing points" and rely more on vehicle feel, vision adjustment, and other methods to drive, improving their adaptability in complex road environments. By automatically detecting and prompting, instructor intervention is reduced, training efficiency is improved, and trainees can master standardized driving skills in a shorter time.

[0032] Correspondingly, the intelligent driving training assistance device, electronic system, and computer-readable storage medium provided in the embodiments of the present invention also have the above-mentioned technical effects. Attached Figure Description

[0033] Figure 1 A flowchart illustrating a possible intelligent driving training assistance method provided in an embodiment of this application;

[0034] Figure 2 A schematic structural block diagram of a possible intelligent driving training assistance device provided in the embodiments of this application;

[0035] Figure 3 A schematic diagram of the hardware structure of a possible intelligent driving training assistance device provided in this application embodiment;

[0036] Figure 4 A schematic structural block diagram of a possible electronic system provided for embodiments of this application;

[0037] Figure 5 This is a schematic structural block diagram of a possible computer-readable storage medium provided for embodiments of this application. Detailed Implementation

[0038] This application provides an intelligent driving training assistance method and system that can solve the problem that most driving training uses the "memorizing points" method for teaching. However, this method lacks flexibility and is easily affected by various factors, making it difficult for trainees to adapt or correctly complete the tasks during the test or actual driving.

[0039] The terms "first," "second," "third," "fourth," etc. (if present) in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments described herein can be implemented in a sequence other than that illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus. The technical solutions of the embodiments of this application will now be clearly and completely described in conjunction with the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them.

[0040] Please see Figure 1 The flowchart below shows a driving training intelligent assistance method provided in the embodiments of this application, which may specifically include: S110-S130.

[0041] S110, acquire vehicle movement status information of the target student during the on-road driving test training process.

[0042] S120, when the vehicle movement status information indicates that it is about to reach the theoretical reference observation point that triggers the next driving operation, the actual driving posture information of the target student is obtained. The theoretical reference observation point that triggers the next driving operation is the theoretical observation point where the student triggers the next driving operation when learning the on-road test training project, so that the vehicle can move along the preset trajectory to complete the training project when it reaches the theoretical observation point and receives the next driving operation.

[0043] S130, if the actual driving posture information does not match the observation posture at the preset point, a prompt message is generated to assist the trainee in completing the training project.

[0044] Understandably, this method aims to address the issue of shifting reference points during driving training due to individual differences in driving posture. Traditional driving training methods primarily rely on "reference points," where learners use fixed visual reference points inside the vehicle to determine when to turn or stop. However, due to differences in driving posture, head angle, and seat adjustment, the same reference point may shift in the field of vision of different learners, leading to errors in timing. This error not only affects the pass rate of driving tests but also reduces learners' adaptability in real-world road environments. Therefore, this method proposes an intelligent assistance scheme that monitors the learner's driving posture in real time and compares it with preset theoretical observation points. When a deviation is detected, the system provides timely prompts to help learners adjust their posture, thereby optimizing driving training effectiveness and improving test pass rates and actual driving skills.

[0045] For example, vehicle sensors, GPS devices, and cameras can be used to collect real-time information on the vehicle's movement during driving training. This movement information primarily includes data such as position coordinates, speed, steering wheel angle, vehicle tilt angle, and wheel trajectory. For instance, in reverse parking training, the system can use GPS and IMU sensors to record when the vehicle enters the parking position and, combined with steering wheel angle information, determine whether the trainee turned at the correct time. Furthermore, cameras can monitor external environmental information such as parking lines and reversing markers to calculate the trainee's current training progress and timing of actions. Through this data, the system can accurately grasp the trainee's driving behavior and provide a precise basis for subsequent calculations of theoretical observation points.

[0046] For example, based on vehicle driving status data and standard driving instruction procedures, the system calculates the theoretical observation points that trainees should refer to when performing each operation. These theoretical observation points are determined according to standard driving techniques to ensure that the vehicle can correctly follow a preset trajectory when the trainee performs an operation (such as turning the steering wheel, braking, or straightening the steering wheel). For instance, during parallel parking, the theoretical observation points might be "when the rearview mirror aligns with the line behind the parking space, you should start turning the steering wheel to the right," or "when the vehicle body is at a 30-degree angle to the parking space, you should start straightening the steering wheel." This calculation process requires combining the vehicle's real-time trajectory, environmental information of the training ground, and standard requirements of the driving test to ensure the provision of optimal operational suggestions. By calculating theoretical reference observation points, the system can provide a consistent training standard for each trainee, thereby reducing errors caused by individual driving habits.

[0047] For example, to accurately determine whether a trainee has correctly observed the theoretical reference points during training, this step uses devices such as an in-vehicle camera, head posture sensor, and seat pressure sensor to acquire the trainee's real-time driving posture information. The camera can detect the trainee's head direction and eye gaze position, and analyze whether they are at the correct observation angle using artificial intelligence algorithms. Furthermore, the head posture sensor can record the trainee's head tilt angle in real time, determining if they have a habit of leaning forward, backward, or tilting their head. For instance, if a trainee habitually leans forward to check the rearview mirror when reversing into a parking space, the system can record this posture information and determine whether it affects the accuracy of the observation point. Simultaneously, the seat pressure sensor can monitor whether the trainee exhibits excessive body tilt during driving, preventing poor posture from affecting driving judgment. By acquiring the trainee's actual driving posture information, the system can analyze whether their observation method is consistent with standard teaching requirements, providing data support for subsequent error analysis and prompts.

[0048] For example, the system can determine whether a student's driving posture affects the accuracy of their driving operation by calculating the deviation between their actual observation point and the theoretical observation point. The system first extracts the student's head angle, line of sight, and the actual reference point, then compares it with preset theoretical observation points. If the system finds that the student's head deviation exceeds a certain threshold (e.g., more than 10° to the left or right, or a forward tilt causing a reference point parallax exceeding 5cm), it will determine that their posture is mismatched. For instance, when reversing into a parking space, if a student tilts their head too far to the left, the relative position of the parking line in the rearview mirror changes, causing them to turn the steering wheel earlier or later. Similarly, when parallel parking, if the student looks down too much, they may mistakenly believe that the rearview mirror is aligned with the parking line, resulting in a misaligned parking position. Through this matching analysis, the system can effectively identify driving errors caused by student posture deviations and take corresponding corrective measures.

[0049] For example, when the system detects a mismatch between the student's actual driving posture and the theoretical observation point, it generates prompts in various ways to remind the student to adjust. These prompts can be voice, visual, or tactile feedback. For instance, if the student's head is tilted forward too much, causing a deviation in the reference point when reversing into a parking space, the system will play a voice prompt: "Please lean back in your seat and maintain a normal sitting posture." If the student's head is tilted to one side, causing an error in parallel parking, the system may highlight the correct observation angle on the in-vehicle display screen and provide a text prompt: "Please keep your head centered." In addition, in some cases, the system can also provide physical feedback using methods such as seat vibration. For example, when the student's head is tilted beyond a set angle, the seat vibrates slightly to remind them to adjust their posture. This intelligent prompting system can provide corrective suggestions before the student operates, ensuring that they drive from the correct observation point, thereby effectively improving training quality and test pass rates.

[0050] Understandably, this method can effectively improve the posture errors of learners during driving training, enhancing the accuracy and adaptability of the training. Firstly, it helps learners more accurately grasp the correct timing for test maneuvers, reducing operational errors caused by posture deviations and thus increasing the pass rate. Secondly, it improves learners' actual driving skills, reducing their over-reliance on memorizing reference points and allowing them to master driving techniques in a more intuitive way. Furthermore, through intelligent detection and feedback, learners can adjust their driving posture in a timely manner during training, gradually developing correct driving habits and avoiding bad driving habits caused by prolonged incorrect posture. Finally, this method can also improve the efficiency of driving training, reducing repetitive instruction from instructors, enabling learners to master driving skills faster and more accurately, ultimately improving overall driving safety.

[0051] In summary, the intelligent driving training assistance method provided in the above embodiments acquires vehicle movement status information of the target learner during on-road driving test training; when the vehicle movement status information indicates that the theoretical reference observation point for triggering the next driving operation is about to be reached, the method acquires the actual driving posture information of the target learner. The theoretical reference observation point for triggering the next driving operation is the theoretical observation point where the learner triggers the next driving operation action when learning the on-road driving test training item. This allows the vehicle to move along a preset trajectory to complete the training item when it reaches the theoretical observation point and receives the next driving operation action; if the actual driving posture information does not match the preset observation posture, a prompt message is generated to assist the learner in completing the training item. This solves the problem of reference point error caused by changes in driving posture, enabling learners to accurately judge the timing of operations in different situations. Through intelligent monitoring and real-time feedback, learners can execute driving operations more accurately, avoiding test failure due to posture problems. This allows learners to gradually get rid of the dependence on "memorizing points" and rely more on vehicle feel, vision adjustment, and other methods to drive, improving their adaptability in complex road environments. By automatically detecting and prompting, instructor intervention is reduced, training efficiency is improved, and trainees can master standardized driving skills in a shorter time.

[0052] In one embodiment, generating a prompt message when the actual driving posture information does not match the observation posture at a preset point, to assist the trainee in completing the training project, includes:

[0053] If the actual driving posture information does not match the observation posture at the preset point, an observation posture correction prompt message is generated. The preset point observation posture is the theoretical observation posture corresponding to the driving operation reference observation point.

[0054] Understandably, when the system detects a mismatch between the student's actual driving posture and the preset observation posture, it will generate an observation posture correction prompt message to guide the student to adjust their posture, thereby ensuring that they perform driving operations at the correct observation points. The preset observation posture refers to the standard theoretical observation posture that the student is required to maintain when designing the reference observation points for driving operations. For example, in scenarios such as reversing into a parking space or parallel parking, the correct head angle, eye line direction, and body position all fall under the category of theoretical observation posture.

[0055] In one embodiment, it further includes:

[0056] After issuing the generated observation posture correction prompt message, continue monitoring the actual driving posture information of the target student;

[0057] If the actual driving posture information still does not match the observation posture at the preset point, control the vehicle to stop or turn off the engine.

[0058] In one embodiment, generating a prompt message when the actual driving posture information does not match the observation posture at a preset point, to assist the trainee in completing the training project, includes:

[0059] If the actual driving posture information does not match the preset observation posture, a new target reference observation position that matches the current actual driving posture is determined based on the obtained current actual driving posture information. The target reference observation position is a new reference observation position that enables the vehicle to approach the preset trajectory and complete the training project after reaching the target reference observation position and receiving the next driving operation action when the current actual driving posture is used as the observation posture.

[0060] The target reference observation point is updated as the theoretical reference observation point, and the message is used to prompt the target student.

[0061] Understandably, when the system detects that the student's actual driving posture information does not match the preset observation posture, it will not only generate a prompt message to remind the student to adjust their posture, but also dynamically adjust the appropriate target reference observation point based on the current actual driving posture information. This allows the student to operate based on the new observation point even if their posture is deviated, minimizing the impact of posture error on driving training and ensuring that the vehicle moves along the preset trajectory to complete the training program.

[0062] For example, the system first acquires the student's actual driving posture information through devices such as an in-vehicle camera, head posture sensor, and seat pressure sensor. This includes: head angle (left and right offset, pitch angle), gaze direction (whether it is correctly aligned with the theoretical observation point), and body posture (whether it is excessively tilted or leaning forward). Then, the system compares the student's actual driving posture with the preset theoretical observation posture, calculating data such as the angle deviation and gaze offset. If the posture deviation exceeds a preset threshold (e.g., head offset exceeds 8°, or gaze is not aligned with the correct reference point by more than 10°), the system determines that the current posture is mismatched and may affect the accuracy of operation.

[0063] For example, when the system detects a mismatch between the student's posture and the theoretical posture, and the student does not immediately correct it, the system will calculate a new target reference observation point based on the current driving posture information to adapt to the student's current observation method, ensuring that the driving operation can still be completed smoothly. The calculation method may include: adjusting the projection mapping of the observation point: the system calculates the position of the new observation point based on the student's current head angle and line of sight. For example, if the student leans forward too much, causing the observation point to shift in their field of vision, the system recalculates a new observation point so that even if the student maintains their current posture, they can perform the operation at the new observation point, keeping the vehicle traveling along the correct trajectory; correcting the matching rules of the observation point: if the student's head shifts to the left, causing a change in the reference point when reversing into a parking space, the system automatically adjusts the new observation point so that when the student observes the new point from their current perspective, the timing of turning the steering wheel is still accurate. For example, normally, in the correct posture, the steering wheel should be turned when the lower edge of the rearview mirror aligns with the parking space markings, but if the student habitually tilts their head, the system recalculates the equivalent observation point based on the current posture. Calculate and optimize the impact on vehicle trajectory: Based on the vehicle's real-time driving status, calculate whether a new observation point will affect the vehicle trajectory. For example, if the student tilts their head back while parallel parking, causing a change in the position of the parking line observed in the rearview mirror, the system calculates whether the target parking angle needs to be adjusted appropriately to ensure that the final parking result meets the standard.

[0064] For example, after calculating the new target reference observation point, the system uses it as the updated theoretical observation point and prompts the trainee in various ways to operate according to the adjusted observation point. For instance, a voice prompt may say, "Your observation angle has been adjusted. Please perform the operation after seeing the new reference point," or "Due to your head shift, the new observation point has been adapted. Please observe the new marking position in the rearview mirror." In-vehicle display / AR-assisted guidance: The adjustment result of the current observation point is highlighted on the in-vehicle screen to help trainees understand how to correctly use the new observation point, or the new observation point position is marked through virtual projection in the AR display to guide trainees in adjusting their observation method.

[0065] Taking reversing into a parking space as an example, the system's preset observation point for trainees is "turning the steering wheel when the lower edge of the rearview mirror aligns with the parking line." However, some trainees, due to habitual forward leaning, may deviate from the observed parking line position, causing them to turn the steering wheel earlier or later. The system detects the trainee's forward lean, records the head offset angle, and calculates a new equivalent observation point. For example, if the trainee leans forward by 5cm, the system adjusts the new observation point to "turning the steering wheel when the door handle aligns with the parking line." Voice and AR prompts are provided to guide the trainee to complete the operation using the new observation point. This adapts to individual differences, enabling trainees to correctly reverse into a parking space even in different postures.

[0066] Taking parallel parking as an example, the system's preset observation point for students is "to start turning the steering wheel when the rearview mirror aligns with the rear marking line." However, if a student tilts their head back, the position of the marking line in the rearview mirror changes, causing a parking position deviation. The system detects head tilt and calculates the rearview mirror angle deviation. A new observation point is calculated and adjusted until "the lower edge of the rearview mirror is offset from the rear marking line by a certain distance" before starting to turn the steering wheel. The system then provides voice and in-vehicle screen prompts, reminding the student to "refer to the updated observation point for operation." This ensures the accuracy of parallel parking operations even with different student postures, avoiding failures due to different postures.

[0067] Understandably, by recalculating new observation points that match the student's current posture, errors caused by individual differences can be avoided. Traditional training methods require students to operate from fixed points, while this method can adapt to different postures, making it easier for students to learn. By precisely adjusting the observation points, even if the student's posture changes, it ensures that they perform driving operations at the correct time, improving the pass rate. Personalized observation point adjustments are provided for different students' driving habits, improving learning efficiency, reducing instructor intervention, and enhancing training quality.

[0068] In one embodiment, it further includes:

[0069] If the target learner completes the current training project, the teaching update content is based on all target reference observation points generated by the learner during the completion of the current training project;

[0070] The teaching content for the current training program of the target learner will only be updated according to the teaching update content.

[0071] Understandably, by recording all target reference observation points used by trainees when completing training programs and updating their personalized teaching content accordingly, subsequent training becomes more aligned with their individual driving habits, reducing adaptation problems caused by fixed "point memorization" methods. Personalized observation point suggestions are only displayed when the trainee logs into the driving training system. Other trainees continue to use standard observation points for training and are unaffected. Dynamic adaptation without solidifying incorrect habits: if a trainee's personal observation point, while allowing them to complete training in the short term, may lead to long-term driving errors (such as excessively deviated observation points), the system will not permanently store that observation point but will gradually guide the trainee towards a more standard posture through prompts. An adaptive adjustment strategy: after each training session, the system reassesses whether the trainee's posture has changed. If the trainee gradually adjusts to a more standard driving posture, the system may restore their used observation points to be closer to the standard points to ensure their adaptability in a wider range of driving environments.

[0072] According to some embodiments, generating a prompt message when the actual driving posture information does not match the observation posture at a preset point, in order to assist the trainee in completing the training project, includes:

[0073] If the actual driving posture information does not match the observation posture at the preset point, the next driving operation update action that matches the current actual driving posture is re-determined based on the obtained current actual driving posture information. The next driving operation update action is a new driving operation action that enables the vehicle to move close to the preset trajectory after reaching the theoretical observation point and receiving the next driving operation update action, so as to complete the training project, when the current actual driving posture is the observation posture.

[0074] The next driving operation update action is sent as a next driving operation update message to the trainee.

[0075] Understandably, when the system detects a mismatch between the student's actual driving posture and the preset observation posture, it will not only provide prompts to guide the student to adjust their posture, but also dynamically adjust the next driving operation based on the student's current actual driving posture. That is, the system will recalculate an updated next driving operation that adapts to the student's current observation method. This ensures that even with a deviation in the student's posture, the system can still adjust the operation to guide the vehicle along the preset trajectory towards the target driving path, thus completing the training exercise. The system will ultimately use this adjusted operation as the updated driving operation and provide it to the student through prompts to guide them in adaptive driving maneuvers.

[0076] For example, when the system detects a change in the student's observation point and the student does not immediately adjust their posture, the system will not merely suggest changing the posture, but will further calculate a new driving operation to ensure the student can successfully complete the driving task even while maintaining their current posture. The calculation method may include: dynamically adjusting the steering wheel angle. If the student's head tilts to the left, causing a change in the observed reference point and potentially leading to premature or delayed steering, the system will adjust the suggested steering angle. For example, when reversing into a parking space, the standard procedure is "align the rearview mirror with the parking line and turn the steering wheel," but if the student's perspective shifts, the system can adjust it to "turn the steering wheel when the distance between the rear of the vehicle and the parking line reaches a new matching value"; correcting throttle or brake control. If the student leans forward, causing a change in the observation point and affecting the braking timing, such as when the student lowers their head while parking on a slope, resulting in a parking position error, the system can adjust the suggested parking point. For example, the standard braking timing could be adjusted to "apply the brake 0.5 seconds after the preceding lane marking enters the window reference area." The system optimizes the timing of steering wheel return. When parallel parking or reversing into a parking space, if the student's viewing angle deviates and causes an incorrect steering wheel return, the system will adjust the timing of the new steering wheel return based on the current posture. For example, if the angle deviation when the student observes the rearview mirror is +10°, the system can adjust it to "turn the vehicle angle inward by 5° more than the standard steering wheel return angle before straightening the wheel."

[0077] For example, after calculating new driving maneuvers to suit the student's posture, the system immediately provides adaptive update messages, guiding the student to complete the driving maneuvers according to the new adjustments through voice, visual, and haptic feedback. For instance, voice prompts (for real-time adjustments): "Your observation angle has been adjusted. Start turning the steering wheel a little later to ensure correct parking." or "Because your head is tilted to the left, the new parking point has been updated. Please brake only after the rear of the vehicle enters the observation area."; In-vehicle display / AR-assisted guidance (for precise adjustments): The observation point and operation prompts are dynamically adjusted on the in-vehicle screen. For example, when reversing into a parking space, the system will mark the new steering wheel turning timing and prompt, "Please turn when the new markings are aligned." Or, through an AR display system, new reference points are projected into the windows or rearview mirrors to guide the student to more intuitively understand when to operate; Haptic feedback (seat or steering wheel vibration): When the student's operation needs adjustment, slight haptic feedback is provided. For example, in parallel parking, if the student should straighten the steering wheel a little later, the steering wheel can vibrate slightly as a prompt.

[0078] Taking the dynamic adjustment of reversing into a parking space as an example, the standard procedure for a student reversing into a parking space is to "start turning the steering wheel when the rearview mirror is aligned with the parking line." However, due to the student's habitual tilting of the head, the observed line appears in the rearview mirror prematurely, resulting in turning the steering wheel too early and entering the parking space at too small an angle. The deviation of the student's observation point is calculated, and the new steering wheel operation timing is determined. A voice prompt is given: "Please start turning the steering wheel after the vehicle has moved back another 15cm." The new steering wheel operation point is displayed on the in-vehicle screen, enabling the student to correctly enter the parking space. Thus, even if the student maintains the original observation posture, they can complete the correct reversing operation.

[0079] Taking the dynamic adjustment of parallel parking as an example, a student, while parallel parking, tilted their head forward, causing a change in the observed position of the parking markings. This led them to straighten the steering wheel too early, resulting in a misaligned parking position. The system calculates the error in the student's observation point and recalculates the timing for straightening the steering wheel. A voice prompt reads, "Please reverse another 10cm before straightening the steering wheel to ensure correct parking," and the new straightening point is highlighted on the in-vehicle display screen with a vibration alert. This avoids parking failures caused by observation angle deviations and improves the student's adaptability.

[0080] Understandably, by adjusting the timing of operations, this method enables trainees to accurately perform driving tasks from different observation positions. Traditional methods require trainees to operate strictly according to fixed points, but this method can adapt to individual differences and improve driving flexibility. Combining voice, visual, and vibration feedback allows trainees to more intuitively understand the adjusted operating methods, improving learning efficiency. Through intelligent adjustment of driving operations, trainees can master the correct operation in a short time, increasing the pass rate of the exam.

[0081] In one embodiment, it further includes:

[0082] If the target learner completes the current training program, all driving operation update actions generated by the learner during the completion of the current training program will be used as teaching update content.

[0083] The teaching content for the current training program of the target learner will only be updated according to the teaching update content.

[0084] Please see Figure 2 One embodiment of the intelligent driver training assistance device in this application may include:

[0085] The first acquisition unit 201 is used to acquire vehicle movement status information of the target student during the on-road driving test training process;

[0086] The second acquisition unit 202 is used to acquire the actual driving posture information of the target student when the vehicle movement status information indicates that the theoretical reference observation point for triggering the next driving operation is about to be reached. The theoretical reference observation point for triggering the next driving operation is the theoretical observation point for triggering the next driving operation when the student is learning the on-road test training project, so that the vehicle can move according to the preset trajectory to complete the training project when it reaches the theoretical observation point and receives the next driving operation.

[0087] The auxiliary unit 203 is used to generate a prompt message when the actual driving posture information does not match the observation posture at the preset point, so as to assist the trainee in completing the training project.

[0088] In summary, the intelligent driving training assistance device provided in the above embodiments acquires vehicle movement status information of the target learner during on-road driving test training; when the vehicle movement status information indicates that the theoretical reference observation point for triggering the next driving operation is about to be reached, it acquires the actual driving posture information of the target learner. The theoretical reference observation point for triggering the next driving operation is the theoretical observation point where the learner triggers the next driving operation action when learning the on-road test training item, so that the vehicle can move according to a preset trajectory to complete the training item when it reaches the theoretical observation point and receives the next driving operation action; when the actual driving posture information does not match the preset observation posture, a prompt message is generated to assist the learner in completing the training item. It can solve the reference point error problem caused by changes in driving posture, enabling learners to accurately judge the timing of operation in different situations. Through intelligent monitoring and real-time feedback, learners can execute driving operations more accurately and avoid test failure due to posture problems. It allows learners to gradually get rid of the dependence on "memorizing points" and rely more on vehicle feel, vision adjustment, and other methods to drive, improving their adaptability in complex road environments. By automatically detecting and prompting, instructor intervention is reduced, training efficiency is improved, and trainees can master standardized driving skills in a shorter time.

[0089] above Figure 2 The intelligent driving training assistance device in this application embodiment has been described from the perspective of modular functional entities. The following is a detailed description of the intelligent driving training assistance device in this application embodiment from the perspective of hardware processing. Please refer to [link / reference]. Figure 3 One embodiment of the intelligent driving training assistance device 300 in this application includes:

[0090] The system includes an input device 301, an output device 302, a processor 303, and a memory 304, wherein the number of processors 303 can be one or more. Figure 3Taking a processor 303 as an example. In some embodiments of this application, the input device 301, output device 302, processor 303, and memory 304 can be connected via a bus or other means, wherein... Figure 3 Taking the example of a connection between China and Israel via a bus.

[0091] Specifically, the processor 303 executes the above method steps by calling the operation instructions stored in the memory 304.

[0092] By calling the operation instructions stored in memory 304, processor 303 is also used to execute... Figure 1 Any of the methods in the corresponding embodiments.

[0093] Please see Figure 4 , Figure 4 A schematic diagram of an embodiment of the electronic system provided in this application.

[0094] like Figure 4 As shown, this application provides an electronic system including a memory 410, a processor 420, and a computer program 411 stored in the memory 420 and executable on the processor 420. When the processor 420 executes the computer program 411, it implements the above-described method steps.

[0095] In practical implementation, when the processor 420 executes the computer program 411, it can achieve... Figure 1 Any of the corresponding implementation methods in the embodiments.

[0096] Since the electronic system described in this embodiment is the equipment used to implement a driving training intelligent assistance device in the embodiments of this application, those skilled in the art can understand the specific implementation method and various variations of the electronic system in this embodiment based on the method described in the embodiments of this application. Therefore, how the electronic system implements the method in the embodiments of this application will not be described in detail here. Any equipment used by those skilled in the art to implement the method in the embodiments of this application falls within the scope of protection of this application.

[0097] Please see Figure 5 , Figure 5 This is a schematic diagram illustrating an embodiment of a computer-readable storage medium provided in this application.

[0098] like Figure 5 As shown, this embodiment provides a computer-readable storage medium 500 on which a computer program 511 is stored. When the computer program 511 is executed by a processor, it implements the above-described method steps.

[0099] In practical implementation, when the computer program 511 is executed by the processor, it can achieve the following: Figure 1Any of the corresponding implementation methods in the embodiments.

[0100] It should be noted that the descriptions of each embodiment in the above embodiments have different focuses. For parts that are not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.

[0101] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0102] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create a machine for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0103] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0104] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0105] This application also provides a computer program product, which includes computer software instructions that, when executed on a processing device, cause the processing device to perform actions such as... Figure 1 The process of the intelligent driving training assistance method in the corresponding embodiment.

[0106] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a server or data center that integrates one or more available media. The available medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk (SSD)).

[0107] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0108] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection between apparatuses or units through some interfaces, and may be electrical, mechanical, or other forms.

[0109] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0110] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0111] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0112] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A driving training intelligent assistance method, characterized in that, include: Obtain vehicle movement status information of the target student during the on-road driving test training process; When the vehicle movement status information indicates a theoretical reference observation point where the next driving operation is about to be triggered, the actual driving posture information of the target student is obtained. The theoretical reference observation point that triggers the next driving operation is the theoretical observation point where the target student triggers the next driving operation when learning the on-road test training project, so that the vehicle can move along a preset trajectory to complete the training project when it reaches the theoretical observation point and receives the next driving operation. If the actual driving posture information does not match the observation posture at the preset point, a prompt message is generated to assist the target learner in completing the training project. In cases where the actual driving posture information does not match the observation posture at the preset point, the next driving operation update action that matches the current actual driving posture is re-determined based on the obtained current actual driving posture information. The next driving operation update action is a new driving operation action that enables the vehicle to move close to the preset trajectory after reaching the theoretical observation point and receiving the next driving operation update action, thereby completing the training project, when the current actual driving posture is used as the observation posture. The next driving operation update action is presented as a next driving operation update message to the target student.

2. The method according to claim 1, characterized in that, When the actual driving posture information does not match the observation posture at the preset point, a prompt message is generated to assist the target learner in completing the training project, including: If the actual driving posture information does not match the observation posture at the preset point, an observation posture correction prompt message is generated. The preset point observation posture is the theoretical observation posture corresponding to the driving operation reference observation point.

3. The method according to claim 2, characterized in that, Also includes: After issuing the generated observation posture correction prompt message, continue to monitor the actual driving posture information of the target student; If the actual driving posture information still does not match the observation posture at the preset point, control the vehicle to stop or turn off the engine.

4. The method according to claim 1, characterized in that, When the actual driving posture information does not match the observation posture at the preset point, a prompt message is generated to assist the target learner in completing the training project, including: If the actual driving posture information does not match the preset observation posture, a new target reference observation position that matches the current actual driving posture is determined based on the obtained current actual driving posture information. The target reference observation position is a new reference observation position that enables the vehicle to approach the preset trajectory and complete the training project after reaching the target reference observation position and receiving the next driving operation action when the current actual driving posture is used as the observation posture. The target reference observation point is updated as the theoretical reference observation point, and the message is used to prompt the target student.

5. The method according to claim 4, characterized in that, Also includes: If the target learner completes the current training project, all target reference observation points generated by the target learner during the completion of the current training project will be used as teaching update content. The teaching content for the current training program of the target learner will only be updated according to the teaching update content.

6. The method according to claim 1, characterized in that, Also includes: If the target learner completes the current training program, all driving operation update actions generated by the target learner during the completion of the current training program are used as teaching update content. The teaching content for the current training program of the target learner will only be updated according to the teaching update content.

7. A driver training intelligent assistance device, characterized in that, The apparatus comprising the method as described in any one of claims 1 to 6, wherein the apparatus includes: The first acquisition unit is used to acquire vehicle movement status information of the target student during the on-road driving test training process; The second acquisition unit is used to acquire the actual driving posture information of the target student when the vehicle movement status information indicates that the theoretical reference observation point is about to trigger the next driving operation. The theoretical reference observation point that triggers the next driving operation is the theoretical observation point where the target student triggers the next driving operation when learning the road test training project, so that the vehicle can move according to the preset trajectory to complete the training project when it reaches the theoretical observation point and receives the next driving operation. The auxiliary unit is used to generate a prompt message when the actual driving posture information does not match the observation posture at the preset point, so as to assist the target trainee in completing the training project.

8. An electronic system comprising a memory and a processor, characterized in that, When the processor executes the computer program stored in the memory, it implements the steps of the intelligent driving training assistance method as described in any one of claims 1 to 6.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by the processor, it implements the steps of the intelligent driving training assistance method as described in any one of claims 1 to 6.

Images