Man-machine interaction type digital automatic driving control method and device

Through the combination of human-computer interaction interface and sensor data, the control inconvenience of the autonomous driving system during manual intervention is solved, the digital closed loop of the vehicle is realized, and the implementation of autonomous driving technology is promoted and the safety improvement is improved.

CN118963331APending Publication Date: 2024-11-15BEIJING LINJIAQIAO TECHNOLOGY CO LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411050804.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-01
Publication Date
2024-11-15

AI Technical Summary

Technical Problem

The existing autonomous driving system cannot understand human operations simultaneously when human intervention is involved, and lacks human-computer interaction methods, which leads to inconvenient control and the inability to achieve a fully digital closed loop, hindering the implementation of autonomous driving technology.

Method used

Through the human-computer interaction interface, the driver can control the autonomous vehicle using buttons, buttons, knobs, etc., to realize the digital closed loop of the vehicle. Combined with sensor data and road condition inspection algorithms, the autonomous driving system makes decisions and drives, and when necessary, with the driver. Cooperate.

Benefits of technology

It realizes effective human-computer interaction between the autonomous driving system and the driver, promotes the implementation of autonomous driving technology, improves safety and response efficiency, and reduces losses in car accidents and ship accidents.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118963331A_ABST
    Figure CN118963331A_ABST
Patent Text Reader

Abstract

The invention discloses a man-machine interaction type digital automatic driving control method and device, and the method comprises the steps: firstly obtaining a driving mode of an automatic driving vehicle, and confirming the current control parameters of the vehicle; in the automatic driving mode, the sensor type and a data packet of the vehicle are obtained and transmitted to a CPU for operation through a CAN bus, data of the front road condition are obtained, meanwhile, a road condition checking algorithm is operated, whether protrusions and pits exist or not and whether obstacles exist on the road or not are detected, and real-time updating of the road condition is completed according to the road condition reporting standard; the current state information of the automatic driving vehicle and the current environment information of the automatic driving vehicle autonomously decide to drive. In the running process of the automatic driving vehicle (ship), a driver can control the automatic driving vehicle (ship) to run according to the running route (channel) and speed selected by the driver through keys, buttons and knobs, and man-machine interaction is better achieved; digitized man-machine co-driving is achieved, and the automatic technology is promoted to fall to the ground from the L3 level.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of autonomous driving control technology, and specifically to a human-machine interactive digital autonomous driving control method and device. Background Art

[0002] The indicator of autonomous driving technology in the testing phase is that the less human intervention, the better. The less human intervention, the higher the technical level of the autonomous driving system. From the beginning to now, the goal of the autonomous driving system is to handle all problems without human intervention.

[0003] The world's first L3 autonomous driving operating system, the current autonomous driving system is completely closed. When manual intervention is required, the traditional steering wheel, accelerator, brake, gear, etc. are still used.

[0004] First, this is inconsistent with the desire and habit of control that humans have had since the birth of the car;

[0005] Second, the autonomous driving system is intelligent. When humans intervene, the autonomous driving system cannot synchronously understand human operations. Currently, humans can only intervene through traditional operations. There are no human-computer interaction methods and devices that are adapted to the autonomous driving system. Human intervention forms a digital open loop.

[0006] Third, the long-tail problem of the autonomous driving system. The current autonomous driving system solves more than 99% of the problems, but the remaining 1% of problems hinder the implementation of autonomous driving technology. The fewer the remaining problems, the higher the cost of solving them; there is no timetable for the implementation of autonomous driving technology. At present, there is no detailed statement and definition of the details of L3 human-machine co-driving in the world.

[0007] Therefore, in order to solve the above problems, a human-machine interactive digital automatic driving control method and device are needed. Summary of the invention

[0008] The purpose of the present invention is to provide a human-machine interactive digital automatic driving control method and device. The present invention realizes the purpose of vehicle control by the driver through the human-machine interactive interface under the framework of the automatic driving system, realizes a fully digital closed loop of the driving process, and better ensures safety. During the driving process of the automatic driving vehicle (ship), the driver can control the automatic driving vehicle (ship) to drive according to the driving route (channel) and speed selected by the driver through keys, buttons, and knobs, so as to better realize human-machine interaction; realize digital human-machine co-driving, and promote the implementation of automatic driving technology from L3 level.

[0009] The present invention is achieved in that:

[0010] A human-machine interactive digital automatic driving control method is specifically performed in the following steps:

[0011] S1: firstly obtaining a driving mode of an autonomous driving vehicle or ship, wherein the driving mode includes an autonomous driving mode, a command mode, a manual driving mode or an emergency mode;

[0012] S2: Determine the current driving mode. If it is the automatic driving mode, detect the automatic driving mode knob signal or key signal and software configuration menu information to confirm the current control parameters of the vehicle or ship;

[0013] S3: In the automatic driving mode, the sensor type and data packet of the vehicle are obtained, and the data packets are transmitted to the CPU for calculation via the CAN bus, and the data of the road condition ahead is obtained and the road condition inspection algorithm is run at the same time to detect whether there are bumps, depressions, and obstacles on the road, and the real-time update of the road condition is completed according to the road condition reporting standard;

[0014] The road condition information is detected by indirect comparison method, including the height, left and right width data and area size of the potholes or bumps.

[0015] S4: In the automatic mode, when receiving the control command of the human-machine interface, the control command, the current state information of the automatic driving vehicle and the current environment information of the automatic driving vehicle are obtained, and the automatic driving system makes a decision to drive according to the signal level, vehicle sensor data, automatic driving system parameter settings and control logic; manual input command; the automatic driving system checks the sensor data and executes it if conditions allow, and abandons or queues it if conditions do not allow. When receiving the speed control signal of the speed control knob, the automatic driving system converts it into a control command and executes it immediately through the CAN bus.

[0016] S5: When no control command of the human-machine interaction interface is detected, the autonomous driving system makes autonomous driving decisions based on sensor data, a road condition check algorithm, current state information of the autonomous driving vehicle, and current environmental information of the autonomous driving vehicle;

[0017] S6: If the current driving mode is a manual driving mode, detect the current state information of the autonomous driving vehicle and the current environment information of the autonomous driving vehicle to confirm whether the mode knob is in manual mode, the vehicle is in takeover mode or is in parking state.

[0018] There are actually multiple options for driving operations such as driving lanes and driving routes. If the passenger is not satisfied with the choice of the autonomous driving system, the passenger can use the human-computer interaction interface to make a choice.

[0019] When used for autonomous driving vehicles, when a control instruction of the human-machine interaction interface is detected, the autonomous driving system is controlled according to the driving route instruction and speed instruction, including signals when there is no traffic congestion, signals when there is traffic congestion, and signals when encountering a situation;

[0020] Driving route instructions are divided into modular instructions and steering wheel turn signals;

[0021] Modular commands include left U-turn, left turn, left overtaking, left lane change, left arc (counterclockwise), straight ahead, right arc (clockwise), right lane change, right overtaking, right turn, right U-turn, reverse, route following, yield, do not yield;

[0022] The modular instructions include left U-turn, left turn, left overtaking, left lane change, left arc (counterclockwise), straight, right arc (clockwise), right lane change, right overtaking, right turn, right U-turn, and reverse. The automatic driving system allows execution under the current state information of the automatic driving vehicle and the current environmental information of the automatic driving vehicle. If the conditions do not allow, the execution is abandoned or queued for execution;

[0023] The steering wheel steering signal includes the steering signal detected on the mechanical transmission steering wheel, the steering signal of the wire-controlled steering wheel, and the steering signal of the hand-wheel steering wheel;

[0024] When the steering signal on the mechanical transmission steering wheel is detected, the automatic driving system detects the driving mode, the size of the steering signal, the current speed, the driving route, etc. to coordinate the driving speed or manually take over the speed control;

[0025] The steering signals of the wire-controlled steering wheel and the hand-wheel steering wheel of the automatic driving system must be converted into control commands in real time and executed by the actuator through the CAN bus;

[0026] The speed instructions include starting, accelerating, constant speed, decelerating, stopping, and speed synchronization;

[0027] When used for autonomous driving ships, when a control command from the human-computer interaction interface is detected, the autonomous driving system will be controlled according to its own logic based on the route command and speed command. These are divided into signals when there is no traffic congestion, signals when there is traffic congestion, and signals when encountering a situation.

[0028] Driving route instructions are divided into modular instructions and steering wheel turn signals.

[0029] Modular instructions include: left U-turn, left turn, left overtaking, left lane change, left arc (counterclockwise), straight go, right arc (clockwise), right lane change, right overtaking, right turn, right U-turn, reverse, route following, give way, and do not give way.

[0030] The modular instructions (left U-turn, left turn, left overtaking, left lane change, left arc (counterclockwise), straight go, right arc (clockwise), right lane change, right overtaking, right turn, right U-turn, reverse) are allowed to be executed by the autonomous driving system under the current status information of the autonomous driving vehicle and the current environmental information of the autonomous driving ship. If the conditions do not allow, the execution will be abandoned or queued for execution.

[0031] The rudder steering signal includes the steering signal detected on the mechanical transmission rudder and the steering signal of the wire-controlled rudder.

[0032] When the steering signal of the wire-controlled rudder is detected, the automatic driving system will coordinate driving speed or manually take over speed control according to the driving mode, the size of the steering signal, the current speed, the driving route, etc.

[0033] The steering signal of the wire-controlled rudder autopilot system must be converted into control instructions in real time and executed by the actuator through the CAN bus.

[0034] Speed ​​instructions include starting, accelerating, constant speed, decelerating, stopping, and speed synchronization.

[0035] There are actually multiple options for driving operations such as driving lanes and driving routes. If the passenger is not satisfied with the choice of the autonomous driving system, the passenger can use the human-computer interaction interface to make a choice.

[0036] When used in autonomous driving vehicles, when a control instruction of the human-computer interaction interface is detected, the autonomous driving system can display the instruction on the screen inside the vehicle, the screen outside the vehicle or the headlights, and coordinate the driving route with surrounding vehicles through V2X communication; manually driven vehicles equipped with a V2X communication module and a human-computer interaction interface can also display the instructions of the human-computer interaction interface on the screen inside the vehicle, the screen outside the vehicle or the headlights.

[0037] When used for autonomous ships, when a control instruction of the human-computer interaction interface is detected, the autonomous driving system can display the instruction on the screen inside the ship, the screen outside the ship or the ship lights, and coordinate the navigation route with surrounding ships through V2X communication, sound signals; manually driven ships equipped with a V2X communication module and a human-computer interaction interface can also display the instructions of the human-computer interaction interface on the screen inside the ship, the screen outside the ship or the ship lights.

[0038] Furthermore, the present invention provides a human-machine interactive digital automatic driving control device, comprising a shell, on which control buttons are arranged at intervals, a knob is arranged adjacent to the control buttons, a touch screen is fixedly arranged on one side of the shell, a network connection device is arranged adjacent to the touch screen, a speaker is arranged on the other side of the control button, and a CPU is fixedly arranged in the shell, the knob, control buttons, touch screen, network connection device and speaker are all connected to the CPU, and the CPU is also connected to an OBD interface via a connecting line.

[0039] There is at least one control button, which includes left U-turn, left turn, left overtaking, left lane change, left arc (counterclockwise), straight, right arc (clockwise), right lane change, right overtaking, right turn, right U-turn, reverse, give way, and do not give way. The knob is used to adjust acceleration and deceleration.

[0040] When used for an autonomous driving vehicle, the knob includes an autonomous driving mode knob, and the buttons include: autonomous driving mode, command mode, block mode, experience mode, learning mode, high-speed mode, city mode, national highway mode, mountain road mode, off-road mode, desert mode, rainy day mode, ice mode, snow mode, convoy mode, track mode, trailer mode, emergency mode, etc.;

[0041] The buttons include: speed control button, speed control knob, single-stage key, stop, parking within the lane line, parking outside the lane line, parking in a parking space, parking in a parking garage, and parking in a service area.

[0042] When used for autonomous driving of ships, the knobs or buttons include: autonomous driving modes include autonomous driving mode, command mode, experience mode, learning mode, fleet mode, towing mode, docking mode, offshore mode, etc.

[0043] The driving route interface includes: left U-turn, left turn, left overtaking, left lane change, left arc (counterclockwise), straight going, right arc (clockwise), right lane change, right overtaking, right turn, right U-turn, reverse, route following, cancel key, confirm key, give way, do not give way, and emergency stop button.

[0044] When used for autonomous driving ships, the buttons include: speed control button, speed control knob, single-stage key, stop, temporary stop (anchoring), and berth stop (mooring).

[0045] Furthermore, in the autonomous driving mode, the interaction between the autonomous driving system and the driver is completed through modular instructions such as left U-turn, left turn, left overtaking, left lane change, left arc (counterclockwise), straight going, right arc (clockwise), right lane change, right overtaking, right turn, right U-turn, and reversing) and a speed control knob. The original manual operation of the steering wheel (rudder) to control the direction and manual operation of the accelerator and brake (car, anchor, cable, etc.) to control the speed is converted to issuing control commands through keys, buttons, and knobs, completing the transition from manual operation to digital operation, laying the foundation for digital driving and allowing L3 autonomous driving to be implemented on a large scale. When used for autonomous driving vehicles, in response to the instructions of the human-computer interaction interface, the autonomous driving system can be connected to the road management department, traffic management department, 120, 119 in real time to complete road condition reporting, accident reporting, rescue of personnel, fire fighting, etc., thereby improving response efficiency, reducing losses and casualties from traffic accidents, etc.; when used for autonomous driving ships, in response to the instructions of the human-computer interaction interface, the autonomous driving system can be connected to the waterway management department, water transport management department, 120, 119, etc. in real time to complete road condition reporting, accident reporting, rescue of personnel, fire fighting, etc., thereby improving response efficiency, reducing losses and casualties from ship accidents.

[0046] Furthermore, the network connection device is a 4G DTU, which is connected to a server via the network connection device, and the server is connected to a smart terminal and a PC. The smart terminal is a smart phone or a tablet computer, and there is at least one smart terminal.

[0047] When used for autonomous driving vehicles, in response to the instructions of the human-computer interaction interface, the autonomous driving system can be connected to the road management department, traffic management department, 120, 119 in real time to complete road condition reporting, accident reporting, rescue of personnel, fire fighting, etc., thereby improving response efficiency, reducing losses and casualties from traffic accidents, etc.; when used for autonomous driving ships, in response to the instructions of the human-computer interaction interface, the autonomous driving system can be connected to the waterway management department, water transport management department, 120, 119, etc. in real time to complete road condition reporting, accident reporting, rescue of personnel, fire fighting, etc., thereby improving response efficiency, reducing losses and casualties from ship accidents.

[0048] The modular instructions of left U-turn, left turn, left overtaking, left lane change, left arc counterclockwise, straight going, right arc clockwise, right lane change, right overtaking, right turn, right U-turn, and reversing are the digital basic signals for vehicles and cabins to interact with each other on routes.

[0049] Modular instructions such as left U-turn, left turn, left overtaking, left lane change, left arc counterclockwise, straight going, right arc clockwise, right lane change, right overtaking, right turn, right U-turn, reversing, and speed control instructions can be used as light interaction signals for digital interaction between vehicles and cabins through light display, or displayed on the screen inside the vehicle or on the screen outside the vehicle.

[0050] When used for autonomous driving vehicles, the roads are numbered, the intersections in each direction are numbered, and the road driving is divided into normal driving areas, warning lines, warning areas, temporary parking areas, and parking spaces; when used for autonomous driving ships, the waterways are numbered, the waterway entrances in each direction are numbered, and the waterway driving is divided into normal driving areas, warning lines, warning areas, temporary parking areas, and berths.

[0051] Compared with the prior art, the present invention has the following beneficial effects:

[0052] 1. Realize the digitization of human-computer interaction in the autonomous driving system, and control the vehicle through keys, buttons, and knobs.

[0053] 2. Digitize the driving direction and speed control. The driving direction is divided into 12 buttons using modular thinking, including left U-turn, left turn, left overtaking, left lane change, left arc (counterclockwise), straight, right arc (clockwise), right lane change, right overtaking, right turn, right U-turn, reverse, give way, and do not give way. The buttons are executed when the conditions are met and not executed when the conditions are not met. The speed control uses an integrated concept, and acceleration and deceleration are completed by adjusting the speed knob and speed control buttons.

[0054] 3. Through the design of the first item, human-computer interaction between the autonomous driving system and the driver can be realized, and human-computer interactive co-driving can be realized in automatic mode.

[0055] 4. Realize the interaction between vehicles during manual driving, and the interaction between vehicles and surrounding pedestrians and non-motor vehicles: through lights, commands, voice, etc., left U-turn, left turn, left overtaking, left lane change, left arc (counterclockwise), straight driving, right arc (clockwise), right lane change, right overtaking, right turn, right U-turn, and reverse; acceleration, deceleration, constant speed, parking, speed value, giving way, not giving way, to achieve a fully digital closed loop.

[0056] 5. Use data from autonomous driving vehicle sensors, sanitation vehicle sensors, fixed-route vehicle sensors, etc. to check road conditions, report when thresholds are reached, and complete real-time reporting, updating, and subsequent processing of road conditions.

[0057] 6. When the automatic driving system encounters a situation during driving, you can use the combination key to operate it, and at the same time broadcast it to the vehicles behind to pay attention, so as to avoid multiple vehicle accidents caused by the vehicles behind not handling it in time; in an emergency, you can use the emergency stop button to stop the car with one click, and you can report the road conditions to the traffic management department for handling the situation.

[0058] This control method can also be used for autonomous ships. The difference is that a keyboard is needed to support the input of steering angle, driving speed, length of anchor chain, length of cable, and to complete left turn, left turn, left overtaking, left lane change, left arc (counterclockwise), straight driving, right arc (clockwise), right lane change, right overtaking, right turn, right U-turn, and reverse operation. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0060] Figure 1 It is a schematic diagram of the structure of the device of the present invention;

[0061] Figure 2 It is a system structure diagram of the present invention;

[0062] Figure 3 It is a road surface pit or bump area calculation diagram of the present invention;

[0063] Figure 4 is a flow chart of automobile driving data processing of the present invention;

[0064] Figure 5 is a flow chart of ship driving data processing of the present invention;

[0065] Among them, there are a housing 1, a connecting line 2, a control button 11, a knob 12, a touch display screen 3, a speaker 4, and a network connection device 5. DETAILED DESCRIPTION

[0066] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention. Therefore, the following detailed description of the embodiments of the present invention provided in the drawings is not intended to limit the scope of the invention claimed for protection, but merely represents the selected embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0067] See also Figure 1-Figure 5, a human-machine interactive digital automatic driving control method;

[0068] S1: firstly obtaining a driving mode of an autonomous driving vehicle or ship, wherein the driving mode includes an autonomous driving mode, a command mode, a manual driving mode or an emergency mode;

[0069] S2: Determine the current driving mode. If it is the automatic driving mode, detect the automatic driving mode knob signal or key signal and software configuration menu information to confirm the current control parameters of the vehicle or ship;

[0070] S3: In the automatic driving mode, the sensor type and data packet of the vehicle are obtained, and the data packets are transmitted to the CPU for calculation via the CAN bus, and the data of the road condition ahead is obtained and the road condition inspection algorithm is run at the same time to detect whether there are bumps, depressions, and obstacles on the road, and the real-time update of the road condition is completed according to the road condition reporting standard;

[0071] The road condition information is detected by indirect comparison method, including the height, left and right width data and area size of the potholes or bumps.

[0072] The height of the pothole or bump is calculated as follows: Figure 3 , the measured distance at position 1 (time 1) is distance d1, and the measured distance at position 2 (time 2) is distance d2. By comparing the distances, there is a pit at position 2, and an early warning can be issued when the vertical distance of the pit is greater than value X. The value of X can be set through the parameters of the autonomous driving system in conjunction with the driving speed range.

[0073] Calculation steps:

[0074] (Distance, height unit: millimeter (mm), area unit: square millimeter (symbol: mm 2 )). In the front and rear direction, (speed is expressed in S, kilometers per hour) measure angle A, measured angle A = laser radar measurement angle - vehicle body pitch angle correction

[0075] Parameters of X:

[0076] IF X>150, immediate warning.

[0077] S≤60,X=100

[0078] S≤90and S>60X=50

[0079] S≤120and S>90X=30

[0080] As shown in formula (1)-formula (2):

[0081] d3=d1-d2 Formula (1)

[0082] H3=cosA*d3 Formula (2)

[0083] IF H3>0, it is concave;

[0084] IF H3<0, it is convex;

[0085] IF ABS(H3)<30, ignore.

[0086] IF ABS(H3)<50and ABS(H3)≥30, obtain the speed S value for judgment.

[0087] IF ABS(H3)<100and ABS(H3)≥50, obtain the speed S value for judgment and take measures such as deceleration or steering acceleration and deceleration to avoid the vehicle.

[0088] IF ABS(H3)>150, issue warning, emergency stop or manual takeover, and report road conditions.

[0089] From the first time ABS(H3)>30, the occurrence position coordinate F1 is recorded, and when ABS(H3)<30, the end position coordinate F2 is recorded, and the before and after size F3 of the pit or protrusion is calculated.

[0090] F3=F1-F2.

[0091] In this embodiment, the left and right directions of the pothole or bump on the road are calculated:

[0092] (Speed ​​is expressed in S, kilometers per hour)

[0093] Measure angle B, which is the angle measured by the laser radar minus the angle correction of the vehicle body shaking left and right. Parameters of Y:

[0094] IF Y>150, immediate warning.

[0095] S≤60,Y=100

[0096] S≤90and S>60Y=50

[0097] S≤120and S>90Y=30

[0098] Tire inner width G, as shown in formula (3)-formula (4):

[0099] D6=d4-d5 Formula (3)

[0100] H4=cosA*d6 Formula (4)

[0101] IF H4>0, it is concave;

[0102] IF H4<0, it is convex;

[0103] IF ABS(H4)<30, ignore.

[0104] IF ABS(H4)<50and ABS(H3)≥30, obtain the speed S value for judgment.

[0105] IF ABS(H4)<100and ABS(H3)≥50, obtain the speed S value for judgment and take measures such as deceleration or steering acceleration and deceleration to avoid the vehicle.

[0106] IF ABS(H4)>150, issue warning, emergency stop or manual takeover, and report road conditions.

[0107] From the first time ABS(H4)>30, the left position coordinate F4 of the occurrence is recorded, and until ABS(H4)<30, the right position coordinate F5 of the end of recording is recorded, and the left and right sizes of the depression or protrusion are calculated.

[0108] F6=F4-F5.

[0109] IF F6≤G, when the road conditions permit, you can steer to avoid the vehicle; if steer is not possible, slow down and pass.

[0110] IF F6>G, slow down and avoid.

[0111] If H4>Y and F6>G and F3>200, make an emergency stop and notify the vehicle behind.

[0112] In this embodiment, the area of ​​the pothole or bump on the road surface is calculated; wherein K is a constant, which is the area coefficient compared with the rectangle.

[0113] Area J = F3*F6*K.

[0114] According to the road surface level and maintenance standards of highways, urban roads, etc., for example, when the area J reaches 400, the depth of H3, H4 or the set threshold is reached to report and apply for road surface maintenance. The specific standards to be formulated later can be used.

[0115] S4: In automatic mode, when a control instruction from the human-computer interaction interface is received, the control instruction, the current state information of the autonomous driving vehicle and the current environmental information of the autonomous driving vehicle are obtained, and the autonomous driving system makes driving decisions based on the signal level, vehicle sensor data, autonomous driving system parameter settings and control logic; manually input instructions; the autonomous driving system checks the sensor data and executes it if conditions permit, otherwise it will be abandoned or queued for execution; when the speed control signal from the speed control knob is received, the autonomous driving system converts it into a control instruction and executes it immediately through the CAN bus.

[0116] S5: When no control command of the human-machine interaction interface is detected, the autonomous driving system makes autonomous driving decisions based on sensor data, a road condition check algorithm, current state information of the autonomous driving vehicle, and current environmental information of the autonomous driving vehicle;

[0117] S6: If the current driving mode is a manual driving mode, detect the current state information of the autonomous driving vehicle and the current environment information of the autonomous driving vehicle to confirm whether the mode knob is in manual mode, the vehicle is in takeover mode or is in parking state.

[0118] There are actually multiple options for driving operations such as driving lanes and driving routes. If the passenger is not satisfied with the choice of the autonomous driving system, the passenger can use the human-computer interaction interface to make a choice.

[0119] When used for autonomous driving vehicles, in response to the instructions of the human-computer interaction interface, the autonomous driving system can be connected to the road management department, traffic management department, 120, 119 in real time to complete road condition reporting, accident reporting, rescue of personnel, fire fighting, etc., thereby improving response efficiency, reducing losses and casualties from traffic accidents, etc.; when used for autonomous driving ships, in response to the instructions of the human-computer interaction interface, the autonomous driving system can be connected to the waterway management department, water transport management department, 120, 119, etc. in real time to complete road condition reporting, accident reporting, rescue of personnel, fire fighting, etc., thereby improving response efficiency, reducing losses and casualties from ship accidents.

[0120] The modular instructions of left U-turn, left turn, left overtaking, left lane change, left arc counterclockwise, straight going, right arc clockwise, right lane change, right overtaking, right turn, right U-turn, and reversing are the digital basic signals for vehicles and cabins to interact with each other on routes.

[0121] Modular instructions such as left U-turn, left turn, left overtaking, left lane change, left arc counterclockwise, straight going, right arc clockwise, right lane change, right overtaking, right turn, right U-turn, reversing, and speed control instructions can be used as light interaction signals for digital interaction between vehicles and cabins through light display, or displayed on the screen inside the vehicle or on the screen outside the vehicle.

[0122] When used for autonomous driving vehicles, the roads are numbered, the intersections in each direction are numbered, and the road driving is divided into normal driving areas, warning lines, warning areas, temporary parking areas, and parking spaces; when used for autonomous driving ships, the waterways are numbered, the waterway entrances in each direction are numbered, and the waterway driving is divided into normal driving areas, warning lines, warning areas, temporary parking areas, and berths.

[0123] In this embodiment, the present invention provides a human-machine interactive digital automatic driving control device, including a shell, on which control buttons are arranged at intervals, a knob is arranged adjacent to the control button, a touch screen is fixedly arranged on one side of the shell, a network connection device is arranged adjacent to the touch screen, a speaker is arranged on the other side of the control button, and a CPU is fixedly arranged in the shell, the knob, control button, touch screen, network connection device and speaker are all connected to the CPU, and the CPU is also connected to an OBD interface via a connecting line.

[0124] There is at least one control button, which includes left U-turn, left turn, left overtaking, left lane change, left arc (counterclockwise), straight, right arc (clockwise), right lane change, right overtaking, right turn, right U-turn, reverse, give way, and do not give way. The knob is used to adjust acceleration and deceleration.

[0125] In this embodiment, the network connection device is a 4G DTU, which is connected to a server through the network connection device, and the server is connected to a smart terminal and a PC. The smart terminal is a smart phone or a tablet computer, and there is at least one smart terminal.

[0126] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A human-machine interactive digital automatic driving control method, characterized in that: Please follow the steps below: S1: firstly obtaining a driving mode of an autonomous driving vehicle or ship, wherein the driving mode includes an autonomous driving mode, a command mode, a manual driving mode or an emergency mode; S2: Determine the current driving mode. If it is the automatic driving mode, detect the automatic driving mode knob signal or key signal and software configuration menu information to confirm the current control parameters of the vehicle or ship; S3: In the automatic driving mode, the sensor type and data packet of the vehicle are obtained, and the data packets are transmitted to the CPU for calculation via the CAN bus, and the data of the road condition ahead is obtained and the road condition inspection algorithm is run at the same time to detect whether there are bumps, depressions, and obstacles on the road, and the real-time update of the road condition is completed according to the road condition reporting standard; S4: In the automatic mode, when a control command of the human-machine interaction interface is received, the control command, the current state information of the automatic driving vehicle and the ship, and the current environment information of the automatic driving vehicle and the ship are obtained, and the automatic driving system makes a driving decision based on the signal level, vehicle, ship, sensor data, automatic driving system parameter settings, and control logic; S5: When no control command of the human-machine interaction interface is detected, the autonomous driving system makes autonomous driving decisions based on sensor data, road condition inspection algorithm, current status information of the autonomous driving vehicle and ship, and current environmental information of the autonomous driving vehicle and ship; S6: When the autonomous driving system prompts that the vehicle needs to be taken over, the vehicle or ship can be taken over by operating the human-machine interaction interface; S7: If the current driving mode is the manual driving mode, the current state information of the autonomous driving vehicle and the current environment information of the autonomous driving vehicle (ship) are detected to confirm whether the mode knob is in manual mode, the vehicle or ship is taken over mode, or is in a parking, anchoring or berthing state.

2. A human-machine interactive digital automatic driving control method and device according to claim 1, characterized in that: In step S3, the road condition information is detected by an indirect comparison method, specifically including the height, left and right width data and area size of the pothole or bump on the road surface.

3. A human-machine interactive digital automatic driving control method and device according to claim 1, characterized in that: In step S4, the modular instructions are manually input; the automatic driving system checks the sensor data and executes it if conditions permit, otherwise it is abandoned or queued for execution; when receiving the speed control signal from the speed control knob, the automatic driving system converts it into a control instruction and executes it immediately through the CAN bus; When used for autonomous driving vehicles and ships, when a control command from a human-machine interface is detected, the autonomous driving system is controlled according to the route command and speed command, including signals when there is no traffic congestion, signals when there is traffic congestion, and signals when encountering a situation; Driving route instructions are divided into modular instructions and steering wheel turn signals; Modular commands include left U-turn, left turn, left overtaking, left lane change, left arc counterclockwise, straight ahead, right arc clockwise, right lane change, right overtaking, right turn, right U-turn, reverse, route following, yield, do not yield; The autonomous driving system checks the current state information of the autonomous driving vehicle and the current environment information of the autonomous driving vehicle to determine whether the conditions allow execution or whether the conditions do not allow abandonment of execution or queueing for execution; The steering wheel steering signal includes the steering signal detected on the mechanical transmission steering wheel, the steering signal of the wire-controlled steering wheel, and the steering signal of the hand-wheel steering wheel; When the steering signal on the mechanical transmission steering wheel is detected, the automatic driving system detects the driving mode, the size of the steering signal, the current speed, the driving route, etc. to coordinate the driving speed or manually take over the speed control; The steering signals of the wire-controlled steering wheel and the hand-wheel steering wheel of the automatic driving system must be converted into control commands in real time and executed by the actuator through the CAN bus; The speed instructions include starting, accelerating, constant speed, decelerating, stopping, and speed synchronization.

4. A human-machine interactive digital automatic driving control device, characterized in that: The invention comprises a shell, control buttons are arranged at intervals on the shell, a knob is arranged adjacent to the control buttons, a touch screen is fixedly arranged on one side of the shell, a network connection device is arranged adjacent to the touch screen, a speaker is arranged on the other side of the control buttons, a CPU is fixedly arranged in the shell, the knob, control buttons, touch screen, network connection device and speaker are all connected to the CPU, and the CPU is also connected to an OBD interface via a connecting line.

5. The human-machine interactive digital automatic driving control device according to claim 4, characterized in that: There is at least one control button, which includes left U-turn, left turn, left overtaking, left lane change, left arc counterclockwise, straight go, right arc clockwise, right lane change, right overtaking, right turn, right U-turn, reverse, combination key, speed control knob, give way button, and do not give way button.

6. The human-machine interactive digital automatic driving control device according to claim 4, characterized in that: The knob is used to adjust acceleration and deceleration.

7. The human-machine interactive digital automatic driving control device according to claim 4, characterized in that: The network connection device is a 4G DTU, which is connected to a server via the network connection device. The server is connected to a smart terminal and a PC. The smart terminal is a smart phone or a tablet computer, and there is at least one smart terminal.

8. The human-machine interactive fully digital automatic driving system control method according to claim 1, characterized in that: In the automatic driving mode, the interaction between the automatic driving system and the driver is completed through modular instructions such as left U-turn, left turn, left overtaking, left lane change, left arc counterclockwise, straight going, right arc clockwise, right lane change, right overtaking, right turn, right U-turn, reversing and adjusting the speed knob. The original manual operation of the steering wheel and rudder to control the direction, and manual operation of the throttle, brake, car, anchor and cable to control the speed is converted to issuing control commands through keys, buttons and knobs, completing the transition from manual operation to digital operation.

9. The human-machine interactive fully digital automatic driving system control method according to claim 1, characterized in that: When used for autonomous driving vehicles, in response to the instructions of the human-computer interaction interface, the autonomous driving system can be connected to the road management department, traffic management department, 120, 119 in real time to complete road condition reporting, accident reporting, rescue of personnel, fire fighting, etc., thereby improving response efficiency, reducing losses and casualties from traffic accidents, etc.; when used for autonomous driving ships, in response to the instructions of the human-computer interaction interface, the autonomous driving system can be connected to the waterway management department, water transport management department, 120, 119, etc. in real time to complete road condition reporting, accident reporting, rescue of personnel, fire fighting, etc., thereby improving response efficiency, reducing losses and casualties from ship accidents.

10. The human-machine interactive digital automatic driving control device according to claim 4, characterized in that: The modular instructions of left U-turn, left turn, left overtaking, left lane change, left arc counterclockwise, straight going, right arc clockwise, right lane change, right overtaking, right turn, right U-turn, and reversing are the digital basic signals for vehicles and cabins to interact with each other on routes.

11. The human-machine interactive digital automatic driving control device according to claim 4, characterized in that: Modular instructions such as left U-turn, left turn, left overtaking, left lane change, left arc counterclockwise, straight going, right arc clockwise, right lane change, right overtaking, right turn, right U-turn, reversing, and speed control instructions can be used as light interaction signals for digital interaction between vehicles and cabins through light display, or displayed on the screen inside the vehicle or on the screen outside the vehicle.

12. The human-machine interactive digital automatic driving control device according to claim 4, characterized in that: When used for autonomous driving vehicles, the roads are numbered, the intersections in each direction are numbered, and the road driving is divided into normal driving areas, warning lines, warning areas, temporary parking areas, and parking spaces; when used for autonomous driving ships, the waterways are numbered, the waterway entrances in each direction are numbered, and the waterway driving is divided into normal driving areas, warning lines, warning areas, temporary parking areas, and berths.

Citation Information

Cited By

  • Man-machine co-driving control method, device and equipment and storage medium

    CN120406413A