A Cockpit-Based Adaptive Interactive Dynamic Scheduling Operation Method and System Based on Multi-Source Road Condition Perception

By identifying high-protrusion points through multi-source road condition perception and dynamically switching the computing power allocation between the driver and passenger seats, the problem of a single dimension of road condition perception in cockpit interaction is solved, achieving safe adaptation on bumpy roads and continuity of driving experience.

CN123114739APending Publication Date: 2026-11-17RIVOTEK TECH (JIANGSU) CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202611267998.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2026-08-20
Publication Date
2026-11-17

AI Technical Summary

Technical Problem

Current automotive cockpit technology has a single dimension of road condition perception, which cannot predict the risk of sudden changes in road conditions in advance. This results in a lack of linkage mechanism between the driver and passenger, leading to problems of over- or under-safety control.

Method used

By identifying road surface protrusions with a height difference greater than 1.5cm through multi-source road condition perception, the system determines bumpy and complex traffic scenarios and dynamically switches the computing power allocation between the driver and passenger. Combining close-range direct detection and long-range global coordinate mapping, it achieves safe adaptation to bumpy road sections.

Benefits of technology

It accurately identifies bumpy scenarios, avoids misjudgment of scenarios, proactively reduces unnecessary interaction resources for the driver, ensures sufficient computing power for the passenger, avoids repeated switching of scheduling strategies, and improves the continuity and safety of the driving experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN123114739A_ABST
    Figure CN123114739A_ABST
Patent Text Reader

Abstract

This invention discloses a method and system for dynamic scheduling and operation of dual-end adaptive interaction in a cockpit based on multi-source road condition perception, belonging to the field of automotive cockpit technology. The method includes S10: acquiring road condition data, as shown below: dividing the road condition data into I road condition data; I road condition data includes: collecting road conditions in front of the target vehicle, including collecting protruding points on the road surface in front of the target vehicle; calculating the height difference between each protruding point and the road surface, and setting a safety threshold based on the height difference, where the safety threshold is >1.5 cm. This invention identifies high protruding points on the road surface with a height difference greater than 1.5 cm, determines the entry / exit from complex traffic scenarios corresponding to bumpy roads based on the multi-dimensional changes in the spacing of high protruding points, and dynamically switches the 3:7 computing power allocation between the driver and passenger seats. Simultaneously, it tracks rising protrusions approaching the threshold in a 3-second cycle, automatically releasing the warning if no excessive protrusions are detected in three consecutive cycles, thus achieving safe adaptation of cockpit interaction on bumpy road sections.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of automotive cockpit technology, and in particular to a cockpit dual-end adaptive interactive dynamic scheduling operation method and system based on multi-source road condition perception. Background Technology

[0002] With the continuous development of automotive technology, users' demands for vehicle driving are increasing, and they are paying more and more attention to the comfort and convenience of the vehicle cabin.

[0003] Regarding research in this area, application CN202310099298.5 provides a vehicle cockpit interaction method and related equipment. This technical solution includes: acquiring driving mode judgment information of a target vehicle to determine a target driving mode, wherein the driving mode judgment information includes at least one of weather information and road condition information, and the road condition information includes road surface information and surrounding vehicle information; acquiring the driving status information of the target vehicle; and controlling the interaction state of the target vehicle based on the target driving mode and the driving status information. This technical solution improves the intelligence, practicality, and comfort of the vehicle cockpit, thereby enhancing the user experience.

[0004] Another application, CN120509113A, discloses a smart cockpit interaction method and system combining digital twins. This technical solution includes collecting multi-dimensional sensory data from the cockpit and constructing a hierarchical cockpit digital twin model; performing scenario analysis on the cockpit digital twin model, extracting driver state characteristics, predicting potential driver interaction needs, and combining these potential interaction needs with the current driving scenario to generate a multimodal interaction strategy set; and performing simulation evaluation on the multimodal interaction strategy set to obtain an interaction evaluation index set. This technical solution improves the interactive adaptability and safety reliability of the smart cockpit system in complex driving scenarios.

[0005] However, the road condition perception dimensions of the above-mentioned technical solutions are singular, relying solely on the vehicle's own speed and ADAS status to determine the scenario, without integrating roadside perception and real-time road condition data. This makes it impossible to predict the risk of sudden changes in road conditions in advance, resulting in a lack of linkage mechanism between the two ends (driver's end and passenger's end) for interactive scheduling. In complex road conditions, unnecessary entertainment pop-ups still appear in the driver's seat, distracting the driver's attention, while in smooth road conditions, the passenger's seat cannot run high-load applications due to insufficient computing power, which can easily lead to problems of over- or under-safety control. Summary of the Invention

[0006] In view of the problems existing in the field of automotive cockpit technology, the present invention is proposed.

[0007] Therefore, one of the objectives of this invention is to provide a method and system for dynamic scheduling and operation of dual-end adaptive interaction in the cockpit based on multi-source road condition perception. This method identifies high road surface protrusions with a height difference greater than 1.5cm, determines the entry / exit from complex traffic scenarios corresponding to bumpy sections based on the changes in the spacing of high protrusions in multiple dimensions, and dynamically switches the 3:7 computing power allocation between the driver and passenger seats. At the same time, it performs 3-second cycle tracking on rising protrusions that are close to the threshold. If there are no excessive protrusions for 3 consecutive cycles, the warning is automatically lifted, thus achieving safe adaptation of cockpit interaction on bumpy road sections.

[0008] To solve the above-mentioned technical problems, the present invention provides the following technical solution:

[0009] On the one hand, the present invention provides a cockpit dual-end adaptive interactive dynamic scheduling operation method based on multi-source road condition perception, characterized by including the following steps:

[0010] The cockpit dual-end adaptive interactive dynamic scheduling operation method based on multi-source road condition perception includes the following steps:

[0011] S10: Obtain traffic data, as shown below:

[0012] The traffic data is divided into traffic data I; traffic data I includes:

[0013] Collect road conditions in front of the target vehicle, including collecting protruding points on the road surface in front of the target vehicle;

[0014] For each of the collected protrusion points, calculate the height difference between each protrusion point and the road surface, and preset a safety threshold based on the height difference, wherein the safety threshold is >1.5 cm;

[0015] Among the collected protrusion points, the protrusion points with a height difference greater than the safety threshold are obtained. These protrusion points are regarded as high protrusion points. The arrangement characteristics of the high protrusion points on the road surface are obtained. The arrangement characteristics include the spacing between adjacent high protrusion points.

[0016] If the distance shows a decreasing trend, the target vehicle is considered to be in a bumpy state.

[0017] If the target vehicle is expected to be in a bumpy state, it is determined that the target vehicle is in a complex traffic scenario. If the target vehicle is determined to be in a complex traffic scenario, the cockpit interaction is dynamically scheduled. The dynamic scheduling includes allocating the computing power of the driver's side and the passenger's side of the target vehicle in a ratio of 3:7.

[0018] The traffic data in section II includes:

[0019] If the target vehicle is determined to be in a complex traffic scenario, the latest high convex point collected in real time by the target vehicle is used as the basis for relevant acquisition. The relevant acquisition includes acquiring the convex point that is greater than the safety threshold in front of the latest high convex point.

[0020] Among the convex points that are greater than the safety threshold, the distance between adjacent convex points is calculated based on the driving speed of the target vehicle.

[0021] S20: If the calculated distance shows an increasing trend, the bump amplitude of the target vehicle will show a decreasing trend.

[0022] S30: If the bump amplitude of the target vehicle is expected to decrease, the road surface is collected based on the latest convex point that is greater than the safety threshold. If no convex point that is greater than the safety threshold is collected for three consecutive time periods, it is determined that the target vehicle will leave the current complex traffic scene.

[0023] S40: If it is determined that the target vehicle will leave the current complex traffic scenario, new data on changes in road conditions will be collected.

[0024] On the other hand, the present invention provides a system for the cockpit dual-end adaptive interactive dynamic scheduling operation method based on multi-source road condition perception as described above, comprising:

[0025] The data acquisition module is used to acquire road condition data. The data acquisition module includes a differentiation unit, a collection unit, a dynamic scheduling unit, and a calculation unit.

[0026] The differentiation unit is used to differentiate the traffic data into traffic data I and traffic data II;

[0027] The acquisition unit is used to acquire road conditions in front of the target vehicle, including acquiring protruding points on the road surface in front of the target vehicle;

[0028] For each of the collected protrusion points, calculate the height difference between each protrusion point and the road surface, and preset a safety threshold based on the height difference, wherein the safety threshold is >1.5 cm;

[0029] Among the collected protrusion points, the protrusion points with a height difference greater than the safety threshold are obtained. These protrusion points are regarded as high protrusion points. The arrangement characteristics of the high protrusion points on the road surface are obtained. The arrangement characteristics include the spacing between adjacent high protrusion points.

[0030] The dynamic scheduling unit responds to the spacing; if the spacing shows a decreasing trend, it considers the target vehicle's driving to be in a bumpy state.

[0031] If the target vehicle is expected to be in a bumpy state, it is determined that the target vehicle is in a complex traffic scenario. If the target vehicle is determined to be in a complex traffic scenario, the cockpit interaction is dynamically scheduled. The dynamic scheduling includes allocating the computing power of the driver's side and the passenger's side of the target vehicle in a ratio of 3:7.

[0032] The computing unit responds to the dynamic scheduling unit and is used to perform relevant acquisition based on the latest high convex point collected in real time by the target vehicle when it is determined that the target vehicle is in a complex traffic scenario. The relevant acquisition includes acquiring the convex point that is greater than the safety threshold in front of the latest high convex point.

[0033] Among the convex points that are greater than the safety threshold, the distance between adjacent convex points is calculated based on the driving speed of the target vehicle.

[0034] The data update module responds to the calculation unit and is used to determine whether the target vehicle's bump amplitude is decreasing if the calculated distance shows an increasing trend.

[0035] If the target vehicle's bump amplitude is expected to decrease, the road surface will be collected based on the latest convex point that is greater than the safety threshold. If no convex point that is greater than the safety threshold is collected for three consecutive time periods, it will be determined that the target vehicle will leave the current complex traffic scene.

[0036] The data acquisition module is used to collect new data on changes in road conditions when it is determined that the target vehicle will leave the current complex traffic scenario.

[0037] An electronic device includes a processor, an input interface, an output interface, and a memory, wherein the processor, the input interface, the output interface, and the memory are interconnected, wherein the memory is used to store a computer program, the computer program including program instructions, and the processor is configured to invoke the program instructions to execute the method described above.

[0038] A computer-readable storage medium storing a computer program, the computer program including program instructions that, when executed by a processor, cause the processor to perform the method as described above.

[0039] Beneficial effects:

[0040] 1. This invention uses a three-level differentiated high convex point spacing calculation system, combined with the quantitative judgment logic of spacing shrinkage rate, to accurately identify road surface high convex points with a height difference of more than 1.5 cm, and predict continuous dense bumpy driving scenarios in advance. At the same time, through the dual verification mechanism of "shrinkage trend judgment → shrinkage rate quantitative verification", it effectively avoids scene misjudgment caused by single frame sensor error, and improves the reliability of scene recognition.

[0041] 2. Furthermore, this invention adopts a scheduling logic that links road condition data at different distances. After triggering a complex traffic scenario, the computing power allocation between the driver and passenger is adjusted to 3:7. This can proactively reduce the computing power consumption of unnecessary interactions on the driver's end in bumpy road sections. At the same time, this invention sets up a complete closed-loop logic of "scenario entry - scenario exit - return to normal": by using the judgment rule that no high convex starting point is collected for three consecutive cycles, the node where the vehicle leaves the complex bumpy scenario is accurately identified, and there will be no problem of scenario switching delay or repeated switching of scheduling strategies.

[0042] 3. At the same time, the present invention sets up an early warning and tracking mechanism, which issues a warning in advance for the high starting point of the climbing state that has not yet reached the bump threshold. It continuously tracks every 3 seconds and automatically removes the warning after confirming that the continuous stability and no risk have been confirmed. This completely avoids the sense of disjointed driving experience caused by meaningless switching of permissions and computing power. Attached Figure Description

[0043] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort. Wherein: Figure 1 This is a schematic diagram of the modular structure of the cockpit dual-end adaptive interactive dynamic scheduling and operation system based on multi-source road condition perception, according to an embodiment of the present invention. Figure 2 This is a schematic diagram of the method flow according to an embodiment of the present invention; Figure 3 This is a schematic diagram of the method flow for step S10 in an embodiment of the present invention;

[0044] The diagram is labeled as follows: 110 - Data acquisition module; 1101 - Differentiation unit; 1102 - Acquisition unit; 1103 - Dynamic scheduling unit; 1104 - Calculation unit; 120 - Data update module; 130 - Data acquisition module. Detailed Implementation

[0045] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the described embodiments of the present invention are within the scope of protection of the present invention.

[0046] Because existing technologies have a single dimension for road condition perception, they cannot predict the risk of sudden changes in road conditions in advance. This results in a lack of linkage mechanism between the two ends (driver and passenger), which can easily lead to problems of over- or under-safety control.

[0047] Based on this, the present invention proposes a cockpit dual-end adaptive interactive dynamic scheduling operation method and system based on multi-source road condition perception. It covers the full range of bump and protrusion identification from 5 meters close to ultra-long distance by adapting to three different road condition scenarios: close-range direct detection, dynamic time-series calculation, and long-range global coordinate mapping. The newly added early warning and tracking mechanism can identify potential road protrusion risks in advance, and reserve a reaction buffer for drivers and passengers without interfering with normal driving interaction. Ultimately, it achieves full-process adaptive control of "adapting to safety scheduling in advance before the bump arrives and smoothly restoring normal interaction after the bump subsides".

[0048] The present solution will be further described in detail below through embodiments and in conjunction with the accompanying drawings.

[0049] Reference Figures 1 to 3 This is one embodiment of the present invention, which provides a cockpit dual-end adaptive interactive dynamic scheduling operation method based on multi-source road condition perception, including the following steps:

[0050] S10: Obtain traffic data, as shown below:

[0051] Road condition data is divided into Road Condition I data (e.g., road condition data more than 5 meters ahead of the vehicle) and Road Condition II data (e.g., road condition data more than 60 meters ahead of the vehicle); Road Condition I data includes:

[0052] In one feasible implementation, the road condition data (Type I and Type II) can be defined according to different driving scenarios. For example, Road condition data (Type I) can be considered as short-distance road conditions (20-50 meters), which is suitable for congested urban roads, while Road condition data (Type II) can be considered as long-distance road conditions (70-150 meters), which is suitable for smooth highway roads.

[0053] Collect road conditions in front of the target vehicle, including collecting protruding points on the road surface in front of the target vehicle;

[0054] For protruding points and other obstacles, data can be collected using vehicle-mounted cameras;

[0055] For each of the collected protrusions, the height difference between each protrusion and the road surface is calculated. A safety threshold is preset based on the height difference. The safety threshold is >1.5 cm (if the protrusion is greater than 1.5 cm, it will cause a perceptible bump when the vehicle passes by).

[0056] In urban roads, road surfaces that arch due to high-temperature expansion are common. After repair, the raised edges are 4 to 5 centimeters higher than the normal road surface, and the fully arched area can reach more than 10 centimeters. Vehicles will experience obvious bouncing and bumping when passing over them.

[0057] Furthermore, road surface bumps and undulations, which affect the smoothness of driving, are considered road surface defects that require treatment if the difference in height between the peaks and valleys is more than 15mm (1.5 cm), as they will cause a perceptible bumpy feeling when the vehicle passes over them.

[0058] Besides urban roads, other roads may also experience camber. The specific camber depends on the road conditions on which vehicles travel.

[0059] Among the collected protrusion points, the protrusion points with a height difference greater than the safety threshold are identified. These protrusion points are considered as high protrusion points. The arrangement characteristics of the high protrusion points on the road surface are obtained. The arrangement characteristics include the spacing between adjacent high protrusion points (longitudinal spacing of the road surface).

[0060] If the distance shows a decreasing trend, it indicates that the target vehicle will be in a bumpy state while driving.

[0061] If the target vehicle is expected to be in a bumpy driving situation, it is determined that the target vehicle is in a complex traffic scenario. If the target vehicle is determined to be in a complex traffic scenario, the cockpit interaction is dynamically scheduled. Dynamic scheduling includes allocating the computing power of the target vehicle's driver and passenger ends in a 3:7 ratio.

[0062] In one feasible implementation, the driver's side is granted minimalist touch interaction permissions. The system automatically compresses high-frequency operations such as navigation and air conditioning into no more than three quick access points, blocks the launch permissions of entertainment applications such as videos and games, and transfers the passenger's navigation destination and music playlist to the driver's system with one click.

[0063] II. Road condition data includes:

[0064] If the target vehicle is determined to be in a complex traffic scenario, relevant acquisition is performed based on the latest high convex point collected in real time by the target vehicle. Relevant acquisition includes acquiring convex points that are greater than the safety threshold in front of the latest high convex point.

[0065] Among the convex points that exceed the safety threshold, the distance between adjacent convex points (longitudinal distance on the road surface) is calculated based on the target vehicle's speed, using the following formula:

[0066] ;

[0067] In the formula, Indicates the first The high convex starting point and the first +1 longitudinal spacing of the road surface between high convex points; unit: meters;

[0068] Indicates the first The longitudinal distance of the high protrusion point relative to the front of the current vehicle (target vehicle); the unit is meters, and it is directly output by the vehicle-mounted sensing sensor;

[0069] Indicates the first +1 longitudinal distance of the high convex starting point relative to the front of the current vehicle (target vehicle); in meters, directly output by the vehicle-mounted perception sensor;

[0070] This calculation formula, with the help of the depth detection capabilities of vehicle vision / LiDAR, directly outputs the absolute longitudinal distance difference between the two high convex points and the vehicle.

[0071] This calculation formula can be directly used to calculate the distance between adjacent high protrusion points in close-range road conditions within the range of 5 to 60 meters, and the output result accuracy can reach the centimeter level.

[0072] ;

[0073] In the formula, Indicates the first The high convex starting point and the first +1 longitudinal spacing of the road surface between high protrusion points; unit: meters;

[0074] This indicates that the vehicle (target vehicle) has passed the [number]th [location]. The moment of the high convex point; the unit is seconds, triggered and recorded by the suspension vibration sensor on the vehicle's CAN bus;

[0075] This indicates that the vehicle (target vehicle) has passed the [number]th [location]. +1 high convexity point moment; unit is seconds, triggered and recorded by the suspension vibration sensor on the vehicle's CAN bus;

[0076] Indicated at At any given moment, the vehicle's (target vehicle's) current real-time speed is measured in meters per second and can be directly read from the vehicle's wheel speed sensors.

[0077] The differential time element in the integral operation represents an infinitesimally small time segment during the vehicle's (target vehicle's) journey, measured in seconds.

[0078] It is to move the vehicle from arrive The complete driving time is broken down into countless consecutive, extremely short time slices, in each... Instantaneous speed of vehicles within the slice It can be approximated as a constant value. By continuously integrating the result of "instantaneous speed × differential time", the precise longitudinal distance between the two high convex starting points can be obtained to adapt to the scenario of small fluctuations in vehicle speed on bumpy road sections.

[0079] This calculation formula is adapted to dynamic calculation scenarios where the vehicle is in motion. It relies on the time difference between the vehicle passing two adjacent high protrusion points and combines the real-time vehicle speed to calculate the distance. It can be used as a supplement to the verification of sensor detection results.

[0080] In one feasible implementation, when the vehicle (target vehicle) travels between two high convex points, if the speed fluctuation is less than 5%, it can be approximated as uniform motion, and the calculation formula can be simplified to:

[0081] ;

[0082] in, This represents the average vehicle speed between two adjacent moments, expressed in meters per second.

[0083] , is the time difference between passing the two high points, in seconds.

[0084] It also includes calculations based on the following formula:

[0085] ;

[0086] In the formula, Indicates the first The high convex starting point and the first +1 longitudinal spacing of the road surface between high protrusion points; unit: meters;

[0087] Indicates the first The plane coordinates of the high convex point in the global geodetic coordinate system; the unit is meters, and it is obtained by fusion calculation of vehicle-mounted GNSS and sensing sensors;

[0088] Indicates the first +1 high convex point plane coordinates in the global geodetic coordinate system; unit is meters, obtained by fusion calculation of vehicle-mounted GNSS and sensing sensors;

[0089] This calculation formula is used to calculate the distance between adjacent high protrusion points in Class II long-distance road conditions of more than 60m, providing preloaded bumpy road condition data for subsequent vehicles passing through the same road segment.

[0090] The longitudinal distance between adjacent high protrusion points is obtained through the calculation logic of the two sets of calculation formulas. The first set is based on the difference calculation of the measured longitudinal distance from the high protrusion point to the front of the vehicle. The second set is based on the time interval of the vehicle passing through the two high protrusion points, and the distance is obtained by integrating the real-time speed in that interval. The two sets of results can be used to verify each other.

[0091] It should be noted that the unit of the spacing results in the above calculation formulas is uniformly meters. The automatic conversion of vehicle speed units has been completed during the calculation process. If the original wheel speed data is in km / h, the conversion relationship needs to be performed first, as follows:

[0092] 1km / h = 1000m / 3600s ≈ 0.2778m / s. Convert to international standard units before substituting into the calculation to avoid magnitude deviation.

[0093] The collected road condition data is divided into two categories for layered processing. First, high protrusions with a road surface height difference of >1.5cm are identified through Category I close-range road conditions. The trend of the distance between high protrusions decreasing is monitored to determine that the vehicle has entered a complex passage scenario corresponding to bumps, triggering a 3:7 computing power allocation strategy for the driver and passenger.

[0094] Subsequently, based on the real-time vehicle speed, the distance between high convex points at more distant locations is calculated using Class II long-distance road conditions. When the distance is subsequently detected to be increasing, it is determined that the bump intensity has decreased. Finally, the rule that no high convex points are identified for three consecutive cycles confirms that the vehicle has left the complex scene, and a new round of full road condition collection is restarted, forming a complete scene perception-scheduling-exit-restart closed loop.

[0095] Through a two-step road condition perception logic that is layered at near and far distances, the system first predicts the scenario that will trigger bumps and then adapts the scheduling accordingly. Then, it synchronously monitors subsequent road condition changes to complete the scenario exit verification. The entire closed-loop logic does not require additional hardware upgrades, which can avoid the risk of drivers being distracted on bumpy road sections from the source. The supplementary collection of road conditions at long distances can also obtain information on the distribution of subsequent bumps in advance, avoiding scheduling errors caused by misjudgments of local road conditions in a single segment.

[0096] In another feasible implementation scheme, in response to the above calculation formula, the acceleration data of the vehicle-mounted IMU inertial measurement unit can be introduced to correct the distance detection deviation caused by the vehicle pitch under bumpy conditions, and further improve the distance calculation accuracy from the centimeter level to the millimeter level.

[0097] In another feasible implementation, real-time traffic data from roadside RSUs can be accessed to obtain information on road surface damage and the distribution of continuous speed bumps in the 1km section ahead in advance. This eliminates the need to rely on onboard sensors for identification and allows for the direct preloading of scheduling strategies for bumpy scenarios, further improving response speed.

[0098] S20: Based on the calculated distance, if the distance shows an increasing trend, the bump amplitude of the target vehicle will show a decreasing trend.

[0099] In one feasible implementation, if the spacing shows a decreasing trend, the rate of shrinkage of the spacing between adjacent convex points is obtained, as shown below:

[0100] ;

[0101] In the formula, Indicates the relationship with the first The rate of contraction of the spacing corresponding to each high convex point; dimensionless, the larger the value, the faster the turbulence density increases.

[0102] Indicates the first -1 and the Longitudinal spacing of the road surface at each high protrusion point; unit: meters;

[0103] Indicates the first The high convex starting point and the first +1 longitudinal spacing of the road surface between high protrusion points; unit: meters;

[0104] This indicates the current real-time speed of the vehicle (target vehicle).

[0105] This indicates that the vehicle (target vehicle) has passed the [number]th [location]. The time difference from the point of origin of the high convexity to the current data collection time; unit: seconds;

[0106] when If the distance between the high convex points is ≤0, it is determined that there is no trend of the distance between the high convex points decreasing, and the vehicle is in a stable driving state.

[0107] When 0 < If the value is less than 0.3, the turbulence density is determined to be increasing slowly.

[0108] when If the value is ≥0.3, it is determined that the road is in a continuous and bumpy section.

[0109] This quantitative judgment mechanism can improve the prediction and response speed in continuous turbulence scenarios, while effectively avoiding scheduling mis-triggering caused by single-frame sensor detection errors, and greatly improving the robustness and scenario adaptation accuracy of cockpit interaction dynamic scheduling.

[0110] It should be noted that the current data collection time mentioned is the time when the vehicle-mounted sensing system completes the "first" data collection. The timestamp for the "+1 high convex point" full-element recognition is the moment when the vehicle-mounted camera / LiDAR completes the analysis of a frame of road condition image and successfully extracts the complete coordinates of the next high convex point with a height difference of more than 1.5cm.

[0111] At this moment, the wheel speed data and suspension vibration data from the vehicle's CAN bus will be synchronized and timestamped, serving as the time reference point for the formula calculation, ensuring... The value of the value perfectly matches the recognition rhythm of the high convex point, and there will be no time misalignment. Calculate the deviation to prevent the scheduling strategy from being triggered erroneously.

[0112] In one feasible implementation, this set of calculation formulas is based on the distance between adjacent high convex starting points obtained from the aforementioned two sets of calculation formulas. The formulas are substituted into the formulas to calculate the shrinkage rate of the distance, transforming the original qualitative judgment of "distance shrinkage trend" into a quantitative turbulence density change coefficient. This accurately distinguishes between different scenarios of slowly entering turbulence and suddenly entering dense turbulence, effectively filtering out pseudo-distance shrinkage signals caused by occasional errors of single-frame sensors, and significantly reducing the probability of scene misjudgment.

[0113] As an extension method, user driving profile data can be accessed to automatically adjust settings for novice drivers. The trigger threshold was set to 0.2, and for experienced drivers who frequently drive on highways, the threshold was raised to 0.4 to achieve personalized adaptation of the judgment logic.

[0114] S30: If the bump amplitude of the target vehicle is expected to decrease, the road surface will be collected based on the latest convex point that is greater than the safety threshold. If no convex point that is greater than the safety threshold is collected for three consecutive time periods, it will be determined that the target vehicle will leave the current complex traffic scene.

[0115] The time period includes a time period consisting of 6 data collections of the road surface every 2 seconds.

[0116] S40: If it is determined that the target vehicle will leave the current complex traffic scenario, new data will be collected on the changes in road conditions.

[0117] If it is determined that the target vehicle will leave the current complex traffic scenario, the computing power allocation between the driver and passenger sides of the target vehicle can be restored to a 5:5 ratio.

[0118] New data collection is performed to reflect changes in road conditions, as shown below:

[0119] After three consecutive time periods, if no convex point exceeding the safety threshold is collected, the convex point collected at the end of the last time period is used as the starting convex point for acquiring road condition data.

[0120] When the convex points of the road surface are obtained, the height difference between each convex point and the road surface is calculated.

[0121] If the height difference is less than the safety threshold, the target vehicle is considered to be in a bumpy state.

[0122] In this case, the computing power allocation between the driver and passenger ends will continue to be maintained at a 5:5 ratio.

[0123] In one feasible implementation, after confirming that the vehicle has left the complex traffic scenario, the road condition collection is restarted with the end of the previous detection cycle as the starting point. When the height of the newly identified protrusion is determined to be below the 1.5cm safety threshold, the vehicle is determined to have returned to a stable driving state.

[0124] This avoids issues such as misaligned starting points and missed detections of local bumps during the new round of road condition data collection after exiting a scene, achieving a seamless transition from bumpy to smooth scenes without any stuttering in scene switching logic.

[0125] In one feasible implementation, vibration acceleration data of the vehicle suspension can be introduced as an auxiliary judgment basis. When the suspension vibration acceleration is lower than 0.2g for 3 consecutive seconds, it can be directly confirmed that the vehicle has completely left the bumpy road section and the scene exit process is accelerated.

[0126] Based on the above, if the height difference is less than the safety threshold, the change in height difference is obtained. If the height difference shows an upward trend but is still not greater than the safety threshold, an early warning is issued, and the target vehicle is still considered to be in a bumpy state.

[0127] In one feasible implementation, for protrusions whose height does not exceed the 1.5cm safety threshold but are still on a continuous upward trend, the scheduling strategy for complex traffic scenarios is not directly triggered. Instead, a low-priority advance warning is issued to maintain the interaction permissions for normal driving.

[0128] This can alert the driver in advance of potential bumps and jolts, without directly triggering a switch in computing power and permissions due to minor bumps or upcoming road elevation changes, thus avoiding unnecessary scheduling interference that could affect the normal driver's operating experience.

[0129] Furthermore, after issuing an early warning, a tracking cycle is set, including tracking the change in height difference every 3 seconds. If the height difference does not exceed the safety threshold within 3 consecutive tracking cycles, and the average height difference between the protruding point and the road surface is the same, the early warning is lifted.

[0130] In one feasible implementation, after issuing an advance warning, the height change of the protrusion is continuously tracked every 3 seconds. When the height of the protrusion does not exceed the safety threshold for 3 consecutive cycles and the average height difference remains stable, the warning is automatically lifted.

[0131] This avoids warning prompts from obscuring the interactive interface for extended periods. At the same time, by continuously observing over multiple cycles, it filters out false signals of brief elevation increases, preventing the abrupt changes in warnings that repeatedly pop up and then disappear, thus ensuring a consistent driving experience.

[0132] Based on the above technical solution, this application can be extended in various ways, such as dynamic optimization and adaptation of electric drive energy consumption in bumpy scenarios:

[0133] After determining that the vehicle has entered a complex driving scenario with continuous bumps, the system works in conjunction with the vehicle's VCU electronic control unit to synchronously adjust the electric drive output strategy: the peak power reserved bandwidth originally used for rapid acceleration is dynamically allocated to the suspension CDC electromagnetic damping adjustment system, prioritizing the filtering of body vibration caused by bumps through the suspension, while limiting unnecessary power fluctuations in the electric drive, avoiding instantaneous high power consumption caused by the driver accidentally pressing the accelerator in bumpy conditions. This can reduce the vehicle's power consumption by about 8% on bumpy roads, indirectly improving the actual range performance of new energy vehicles.

[0134] It can also perform pre-aiming linkage adaptation of the vehicle's air suspension under bumpy conditions:

[0135] By using multi-source road condition sensing data on the distance and height of high bumps ahead, a pre-aiming adjustment command is sent to the air suspension controller in advance: 0.5 seconds before the vehicle reaches a high bump, the suspension travel is automatically increased to offset the height difference of the bump. This predictive active adjustment directly reduces the impact of bumps. At the same time, the suspension height adjustment rate is dynamically adjusted according to the density of high bumps to avoid the extra energy consumption caused by frequent suspension raising and lowering. Compared with the traditional solution that relies solely on the passive response of the vehicle body sensors, the vibration filtering efficiency can be improved by more than 35%.

[0136] Based on the above, this application identifies road surface protrusions with a height difference greater than 1.5cm, determines the entry / exit from the complex traffic scenario corresponding to bumpy sections based on the changes in the spacing of the protrusions in multiple dimensions, and dynamically switches the 3:7 computing power allocation between the driver and passenger seats. At the same time, it performs 3-second cycle tracking on rising protrusions that are close to the threshold. If there are no excessive protrusions for 3 consecutive cycles, the warning is automatically lifted, thus achieving safe adaptation of cockpit interaction on bumpy road sections.

[0137] This embodiment, in conjunction with the above-mentioned cockpit dual-end adaptive interactive dynamic scheduling operation method based on multi-source road condition perception, also proposes a working system applied to this method, as follows:

[0138] The data acquisition module 110 is used to acquire road condition data. The data acquisition module 110 includes a differentiation unit 1101, a collection unit 1102, a dynamic scheduling unit 1103, and a calculation unit 1104.

[0139] The differentiation unit 1101 is used to differentiate road condition data into road condition data I (e.g., road condition data with more than 5 meters in front of the vehicle) and road condition data II (e.g., road condition data with more than 60 meters in front of the vehicle).

[0140] The acquisition unit 1102 is used to acquire road conditions in front of the target vehicle, including acquiring protruding points on the road surface in front of the target vehicle;

[0141] For each of the collected protrusions, the height difference between each protrusion and the road surface is calculated. A safety threshold is preset based on the height difference. The safety threshold is >1.5 cm (if the protrusion is greater than 1.5 cm, it will cause a perceptible bump when the vehicle passes by).

[0142] Among the collected protrusion points, the protrusion points with a height difference greater than the safety threshold are selected. These protrusion points are regarded as high protrusion points. The arrangement characteristics of high protrusion points on the road surface are obtained. The arrangement characteristics include the spacing between adjacent high protrusion points.

[0143] The dynamic scheduling unit 1103 responds to the interval. If the interval shows a decreasing trend, it indicates that the target vehicle is in a bumpy state.

[0144] If the target vehicle is expected to be in a bumpy driving situation, it is determined that the target vehicle is in a complex traffic scenario. If the target vehicle is determined to be in a complex traffic scenario, the cockpit interaction is dynamically scheduled. Dynamic scheduling includes allocating the computing power of the target vehicle's driver and passenger ends in a 3:7 ratio.

[0145] The computing unit 1104 responds to the dynamic scheduling unit, which is used to perform relevant acquisition based on the latest high convex point collected in real time by the target vehicle when it is determined that the target vehicle is in a complex traffic scenario. The relevant acquisition includes acquiring the convex point that is greater than the safety threshold in front of the latest high convex point.

[0146] Among the convex points that are greater than the safety threshold, the distance between adjacent convex points is calculated based on the driving speed of the target vehicle.

[0147] The data update module 120 and the data update module response calculation unit are used to determine whether the target vehicle’s bump amplitude will decrease if the calculated distance shows an increasing trend.

[0148] If the target vehicle's bump amplitude is expected to decrease, the road surface will be collected based on the latest convex point that is greater than the safety threshold. If no convex point that is greater than the safety threshold is collected for three consecutive time periods, it will be determined that the target vehicle will leave the current complex traffic scene.

[0149] The data acquisition module 130 is used to collect new data on changes in road conditions when it is determined that the target vehicle will leave the current complex traffic scenario.

[0150] An electronic device includes a processor, an input interface, an output interface, and a memory, which are interconnected. The memory stores a computer program, which includes program instructions. The processor is configured to invoke the program instructions to execute the method described above.

[0151] A computer-readable storage medium storing a computer program, the computer program including program instructions that, when executed by a processor, cause the processor to perform the methods described above.

[0152] In summary, this invention, through multi-source road condition layered recognition, multi-dimensional high bump spacing cross-verification, and a quantified bump contraction rate determination mechanism, can accurately identify road bumps with a height difference exceeding 1.5 cm. It can predict complex traffic scenarios with continuous and dense bumps in advance, and automatically adjust the computing power of the driver and passenger to a 3:7 ratio after the scenario is triggered. On bumpy road sections, it actively reduces the proportion of unnecessary interactive resources for the driver and avoids the risk of driver distraction, while ensuring sufficient interactive computing power for the passenger. Subsequently, it can accurately determine whether the vehicle has left the complex scenario by using the rule of no high bump recognition for three consecutive cycles. Combined with a 3-second cycle tracking and warning mechanism for bumps approaching the safety threshold, it avoids the experience fragmentation problem of repeated switching of scheduling strategies and can reserve risk buffer space for passengers in advance, taking into account both driving safety and the overall passenger interaction experience.

[0153] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit it. Although the present invention has been described in detail with reference to preferred embodiments, those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention, and all such modifications or substitutions should be covered within the scope of the claims of the present invention.

Claims

1. A cockpit double-end adaptive interactive dynamic scheduling operation method based on multi-source road condition perception, characterized in that, Includes the following steps: S10: Obtain traffic data, as shown below: The traffic data is divided into I traffic data; The road condition data I includes: Collect road conditions in front of the target vehicle, including collecting protruding points on the road surface in front of the target vehicle; For each of the collected protrusion points, calculate the height difference between each protrusion point and the road surface, and preset a safety threshold based on the height difference, wherein the safety threshold is >1.5 cm; Among the collected protrusion points, the protrusion points with a height difference greater than the safety threshold are obtained. These protrusion points are regarded as high protrusion points. The arrangement characteristics of the high protrusion points on the road surface are obtained. The arrangement characteristics include the spacing between adjacent high protrusion points. If the distance shows a decreasing trend, the target vehicle is considered to be in a bumpy state. If the target vehicle is expected to be in a bumpy state, it is determined that the target vehicle is in a complex traffic scenario. If the target vehicle is determined to be in a complex traffic scenario, the cockpit interaction is dynamically scheduled. The dynamic scheduling includes allocating the computing power of the driver's side and the passenger's side of the target vehicle in a ratio of 3:

7. The traffic data in section II includes: If the target vehicle is determined to be in a complex traffic scenario, the latest high convex point collected in real time by the target vehicle is used as the basis for relevant acquisition. The relevant acquisition includes acquiring the convex point that is greater than the safety threshold in front of the latest high convex point. Among the convex points that are greater than the safety threshold, the distance between adjacent convex points is calculated based on the driving speed of the target vehicle. S20: If the calculated distance shows an increasing trend, the bump amplitude of the target vehicle will show a decreasing trend. S30: If the bump amplitude of the target vehicle is expected to decrease, the road surface is collected based on the latest convex point that is greater than the safety threshold. If no convex point that is greater than the safety threshold is collected for three consecutive time periods, it is determined that the target vehicle will leave the current complex traffic scene. S40: If it is determined that the target vehicle will leave the current complex traffic scenario, new data on changes in road conditions will be collected.

2. The multi-source road awareness based cockpit dual-end adaptive interaction dynamic scheduling operation method according to claim 1, wherein, In step S10, the distance between adjacent protruding points is calculated based on the target vehicle's speed, using the following formula: ; In the formula, represents the longitudinal distance of the road surface between the first high protrusion point and the first +1 high protrusion point. represents the longitudinal distance of the first high protrusion point relative to the vehicle head of the current vehicle; represents the first +1 longitudinal distance of the high protrusion point relative to the vehicle head of the current vehicle; ; In the formula, represents the longitudinal distance of the road surface between the first high protrusion point and the first +1 high protrusion point; Indicates that the vehicle has passed the first A moment of high convexity; Indicates that the vehicle has passed the first +1 moment of a high convex starting point; Indicated at At any given moment, the vehicle's (target vehicle's) current real-time speed.

3. The cockpit dual-end adaptive interactive dynamic scheduling operation method based on multi-source road condition perception as described in claim 2, characterized in that, It also includes calculations based on the following formula: ; In the formula, Indicates the first The high convex starting point and the first +1 longitudinal spacing of the road surface between high convex points; Indicates the first The planar coordinates of a high convex starting point in the global geodetic coordinate system; Indicates the first +1 high convex point plane coordinates in the global geodetic coordinate system.

4. The cockpit dual-end adaptive interactive dynamic scheduling operation method based on multi-source road condition perception as described in any one of claims 2 to 3, characterized in that, Based on the calculation results, if the spacing shows a decreasing trend, the shrinkage rate of the spacing between adjacent convex points is obtained, as shown below: ; In the formula, Indicates the relationship with the first The rate of contraction of the spacing corresponding to each high convex point; Indicates the first -1 and the Longitudinal spacing of the road surface at each high protrusion point; Indicates the first The high convex starting point and the first +1 longitudinal spacing of the road surface between high convex points; This indicates the current real-time speed of the vehicle (target vehicle). This indicates that the vehicle (target vehicle) has passed the [number]th [location]. The time difference between the high convex starting point and the current acquisition time.

5. The cockpit dual-end adaptive interactive dynamic scheduling operation method based on multi-source road condition perception as described in claim 1, characterized in that, In step S40, new data is collected on changes in road conditions, as shown below: After three consecutive time periods, if no convex point greater than the safety threshold is collected, the convex point collected at the end of the last time period is used as the starting convex point for acquiring road condition data. When the convex points of the road surface are obtained, the height difference between each convex point and the road surface is calculated; If the height difference is less than the safety threshold, then the target vehicle is considered to be traveling in a smooth state.

6. The cockpit dual-end adaptive interactive dynamic scheduling operation method based on multi-source road condition perception as described in claim 5, characterized in that, If the height difference is less than the safety threshold, the change in the height difference is obtained. If the height difference shows an upward trend but is still not greater than the safety threshold, an early warning is issued, and the target vehicle is still considered to be in a bumpy state.

7. The cockpit dual-end adaptive interactive dynamic scheduling operation method based on multi-source road condition perception as described in claim 6, characterized in that, After issuing an early warning, a tracking cycle is set, which includes tracking the change in the height difference every 3 seconds. If the height difference does not exceed the safety threshold within 3 consecutive tracking cycles, and the average height difference between the protruding point and the road surface is the same, the early warning is lifted.

8. A system applied to the cockpit dual-end adaptive interactive dynamic scheduling operation method based on multi-source road condition perception as described in claim 1, characterized in that, include: The data acquisition module is used to acquire road condition data. The data acquisition module includes a differentiation unit, a collection unit, a dynamic scheduling unit, and a calculation unit. The distinguishing unit is used to distinguish the traffic data into traffic data I and traffic data II; The acquisition unit is used to acquire road conditions in front of the target vehicle, including acquiring protruding points on the road surface in front of the target vehicle; For each of the collected protrusion points, calculate the height difference between each protrusion point and the road surface, and preset a safety threshold based on the height difference, wherein the safety threshold is >1.5 cm; Among the collected protrusion points, the protrusion points with a height difference greater than the safety threshold are obtained. These protrusion points are regarded as high protrusion points. The arrangement characteristics of the high protrusion points on the road surface are obtained. The arrangement characteristics include the spacing between adjacent high protrusion points. The dynamic scheduling unit responds to the spacing; if the spacing shows a decreasing trend, it considers the target vehicle's driving to be in a bumpy state. If the target vehicle is expected to be in a bumpy state, it is determined that the target vehicle is in a complex traffic scenario. If the target vehicle is determined to be in a complex traffic scenario, the cockpit interaction is dynamically scheduled. The dynamic scheduling includes allocating the computing power of the driver's side and the passenger's side of the target vehicle in a ratio of 3:

7. The computing unit responds to the dynamic scheduling unit and is used to perform relevant acquisition based on the latest high convex point collected in real time by the target vehicle when it is determined that the target vehicle is in a complex traffic scenario. The relevant acquisition includes acquiring the convex point that is greater than the safety threshold in front of the latest high convex point. Among the convex points that are greater than the safety threshold, the distance between adjacent convex points is calculated based on the driving speed of the target vehicle. The data update module responds to the calculation unit and is used to determine whether the target vehicle's bump amplitude is decreasing if the calculated distance shows an increasing trend. If the target vehicle's bump amplitude is expected to decrease, the road surface will be collected based on the latest convex point that is greater than the safety threshold. If no convex point that is greater than the safety threshold is collected for three consecutive time periods, it will be determined that the target vehicle will leave the current complex traffic scene. The data acquisition module is used to collect new data on changes in road conditions when it is determined that the target vehicle will leave the current complex traffic scenario.

9. An electronic device, characterized in that, The device includes a processor, an input interface, an output interface, and a memory, which are interconnected. The memory is used to store a computer program, which includes program instructions. The processor is configured to call the program instructions to perform the method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, the computer program including program instructions that, when executed by a processor, cause the processor to perform the method as described in any one of claims 1 to 7.

Citation Information

Patent Citations

  • Vehicle cabin interaction method and related equipment

    CN116080567A

  • Intelligent cabin interaction method and system combined with digital twinning

    CN120509113A