Fusion method of automatic driving control system and vehicle control system of agricultural machinery

By integrating the autonomous driving control system and the vehicle control system, the problem of many components and complex installation and debugging of the agricultural machinery autonomous driving system is solved, and more efficient and economical system operation is achieved, and the autonomous driving capability and maintainability of agricultural machinery is improved.

CN118938898APending Publication Date: 2024-11-12ZOOMLION HEAVY MASCH CO LTD +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410952182.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-16
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

The existing agricultural machinery autonomous driving system has many components, cumbersome installation and debugging, and poor integration, resulting in high economic costs and is not conducive to the promotion and application of industry safety technologies.

Method used

By integrating the autonomous driving control system with the vehicle control system, using hardware equipment such as human-computer interaction devices, wireless communication devices and controllers, the integration of the autonomous driving mode and the vehicle control mode is achieved, reducing hardware costs and communication delays, and improving the system Efficiency and maintainability.

Benefits of technology

It reduces the hardware cost of agricultural machinery, reduces the communication delay and disconnection risks between modules, improves the operating efficiency and maintainability of the system, and achieves higher economics and system stability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118938898A_ABST
    Figure CN118938898A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of agricultural machinery, in particular to a method for fusing an automatic driving control system and a whole vehicle control system of agricultural machinery, which comprises the following steps: in an automatic driving mode, a man-machine interaction device calls an automatic driving man-machine interaction module or a whole vehicle man-machine interaction module according to the operation of a user; the display main program obtains data input by a user based on the man-machine interaction device; under the condition that the display main program receives the vehicle real-time positioning information collected by the wireless communication device, the data input based on the CAN bus and the vehicle real-time positioning information are transmitted to a vehicle controller main program included in the controller; the vehicle controller main program calls an automatic driving control module to generate a motion control decision signal according to the input data and the vehicle real-time positioning information; and under the condition that the vehicle controller main program receives the machine and tool states, collected by the multiple machine and tool sensors, of the agricultural machine, the whole vehicle control module is called to control the whole vehicle in response to the motion control decision signal based on the machine and tool states.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of agricultural machinery, and specifically to a method and a computer program product for integrating an automatic driving control system based on agricultural machinery with a whole vehicle control system. Background Art

[0002] In order to solve the problems of difficult operation and high labor intensity of agricultural machinery, the demand for automatic driving systems suitable for agricultural machinery farming, management and harvesting operations is increasing. The automatic driving system of agricultural machinery first obtains the positioning data of the receiver through the navigation display screen for positioning and path planning. Then, in the navigation controller, the lateral position error and heading angle deviation of the current state are calculated in real time based on the acquired real-time positioning data and the saved planned path position data to generate motion control signals. Finally, the vehicle direction, gear and speed are adjusted and controlled through hardware communication with the electric steering wheel and vehicle controller, and the vehicle's driving trajectory and state are corrected in real time to realize the autonomous movement of agricultural machinery. Existing agricultural machinery automatic driving system products have many components, complicated installation and debugging, poor integration with agricultural machinery electronic control systems, high economic cost, and are not conducive to the promotion and application of industry safety technologies. Summary of the invention

[0003] The purpose of the embodiments of the present application is to provide a method and a computer program product for integrating an automatic driving control system based on agricultural machinery with a whole vehicle control system.

[0004] In order to achieve the above-mentioned purpose, the first aspect of the present application provides a method for integrating an automatic driving control system and a whole vehicle control system based on agricultural machinery, wherein the agricultural machinery includes a human-machine interaction device, a wireless communication device, a controller, and a plurality of implement sensors, the automatic driving system includes an automatic driving human-machine interaction module and an automatic driving control module, and the whole vehicle control system includes a whole vehicle human-machine interaction module and a whole vehicle control module, and the integration method includes:

[0005] In the automatic driving mode, the human-computer interaction device calls the automatic driving human-computer interaction module or the vehicle human-computer interaction module according to the user's operation;

[0006] The display main program included in the human-machine interaction device obtains data input by the user through the automatic driving human-machine interaction module or the whole vehicle human-machine interaction module based on the human-machine interaction device;

[0007] In the case where the display main program receives the vehicle real-time positioning information collected by the wireless communication device, the display main program transmits the data input based on the CAN bus and the vehicle real-time positioning information to the vehicle controller main program included in the controller;

[0008] The vehicle controller main program calls the automatic driving control module to generate motion control decision signals based on the input data and the vehicle's real-time positioning information;

[0009] When the vehicle controller main program receives the implement status of the agricultural machinery collected by multiple implement sensors, the vehicle controller main program calls the vehicle control module to control the whole vehicle based on the implement status in response to the motion control decision signal, so that the whole vehicle operation status of the agricultural machinery conforms to the whole vehicle operation status corresponding to the motion control decision signal.

[0010] In an embodiment of the present application, the input data includes first data input by a user based on an autonomous driving human-computer interaction module, the autonomous driving control module integrates a path planning algorithm and a motion control algorithm, and the vehicle controller main program calls the autonomous driving control module to generate a motion control decision signal based on the input data and the vehicle's real-time positioning information, including: calling the path planning algorithm based on the first data and the vehicle's real-time positioning information to generate planned path information; calling the motion control algorithm based on the first data, the planned path information and the vehicle's real-time positioning information to generate a motion control decision signal.

[0011] In an embodiment of the present application, the fusion method also includes: the vehicle controller main program sends the planned path information to the display main program based on the CAN bus; the display main program stores the received planned path information and displays the planned path information through the human-computer interaction device.

[0012] In an embodiment of the present application, the input data includes second data input by the user based on the human-computer interaction module of the whole vehicle, and the fusion method also includes: the vehicle controller main program calls the motion control algorithm to generate a motion control decision signal based on the second data, the first data, the planned path information and the real-time positioning information of the vehicle.

[0013] In the embodiment of the present application, the fusion method also includes: the vehicle controller main program determines the current driving area type of the vehicle according to the planned path information and the real-time positioning information of the vehicle. In the embodiment of the present application, the agricultural machinery also includes a steering device, a speed change device and a working device, and the vehicle control module integrates a vehicle control algorithm. When the vehicle controller main program receives the machine state of the agricultural machinery collected by multiple machine sensors, the vehicle controller main program calls the vehicle control module to control the whole vehicle in response to the motion control decision signal based on the machine state, including: when the current driving area type is a straight area, the steering device, the speed change device and the working device are controlled according to the planned path information, the real-time positioning information of the vehicle and the motion control decision signal; when the current driving area type is a non-straight area, the vehicle control algorithm is called according to the machine state to generate a vehicle control signal, so as to adjust the machine of the whole vehicle through the vehicle control signal, and the steering device and the speed change device are controlled according to the planned path information, the real-time positioning information of the vehicle and the motion control decision signal.

[0014] In an embodiment of the present application, the fusion method also includes: in the whole vehicle control mode, the human-computer interaction device calls the whole vehicle human-computer interaction module according to the user's operation; the display main program obtains the second data input by the user through the whole vehicle human-computer interaction module based on the human-computer interaction device; when the display main program receives the vehicle real-time positioning information collected by the wireless communication device, the display main program transmits the second data and the vehicle real-time positioning information to the vehicle controller main program included in the controller based on the CAN bus; the vehicle controller main program reads the local path planning information, and calls the automatic driving control module to generate a motion control decision signal according to the fourth data, the local path planning information and the vehicle real-time positioning information; when the vehicle controller main program receives the implement status of the agricultural machinery collected by multiple implement sensors, the vehicle controller main program calls the whole vehicle control module to control the whole vehicle based on the implement status in response to the motion control decision signal, so that the whole vehicle operation state of the agricultural machinery conforms to the whole vehicle operation state corresponding to the motion control decision signal.

[0015] In an embodiment of the present application, the autonomous driving control module is integrated with a motion control algorithm, the vehicle controller main program reads the local path planning information, and calls the autonomous driving control module to generate a motion control decision signal based on the fourth data, the local path planning information and the real-time positioning information of the vehicle, including: the vehicle controller main program calls the motion control algorithm to generate a motion control decision signal based on the second data, the local path planning information and the real-time positioning information of the vehicle.

[0016] In an embodiment of the present application, the fusion method also includes: the vehicle controller main program determines the current driving area type of the vehicle based on the local planned path information and the vehicle real-time positioning information.

[0017] In an embodiment of the present application, the agricultural machinery includes a speed transmission device, a steering device and a working device, and the vehicle control module integrates a vehicle control algorithm. When the vehicle controller main program receives the implement status of the agricultural machinery collected by multiple implement sensors, the vehicle controller main program calls the vehicle control module to control the whole vehicle in response to the motion control decision signal based on the implement status, including: when the current driving area type is a straight area, the steering device, the speed transmission device and the working device are controlled according to the local planned path information, the vehicle real-time positioning information and the motion control decision signal; when the current driving area type is a non-straight area, the vehicle control algorithm is called according to the implement status to generate a vehicle control signal, so as to adjust the implement of the vehicle through the vehicle control signal, and control the steering device and the speed transmission device according to the local planned path information, the vehicle real-time positioning information and the motion control decision signal.

[0018] A second aspect of the present application provides a computer program product, including a computer program, which, when executed by a processor, implements a method for integrating an automatic driving control system based on agricultural machinery with a whole vehicle control system according to any one of the above embodiments.

[0019] Through the above technical solution, the human-machine interaction device, wireless communication device, controller and other hardware equipment of agricultural machinery are fully utilized to integrate the automatic driving system with the vehicle control system. On the one hand, the hardware cost of agricultural machinery is reduced, and on the other hand, the communication delay and disconnection risk between the automatic driving human-machine interaction module, the automatic driving control module, the vehicle human-machine interaction module and the vehicle control module are reduced, and the operation efficiency and maintainability of the system are increased. While achieving the same function, it has higher economy and system stability.

[0020] Other features and advantages of the embodiments of the present application will be described in detail in the subsequent specific implementation section. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The accompanying drawings are used to provide a further understanding of the embodiments of the present application and constitute a part of the specification. Together with the following specific implementations, they are used to explain the embodiments of the present application, but do not constitute a limitation on the embodiments of the present application. In the accompanying drawings:

[0022] Figure 1 A schematic diagram of a flow chart of a method for integrating an automatic driving control system of agricultural machinery with a vehicle control system according to an embodiment of the present application is schematically shown;

[0023] Figure 2 The schematic diagram of the structure of an agricultural machinery according to an embodiment of the present application is shown;

[0024] Figure 3 A schematic diagram of a flow chart of another method for integrating an automatic driving control system of agricultural machinery with a vehicle control system according to an embodiment of the present application is shown;

[0025] Figure 4 A schematic diagram of a flow chart of another method for integrating an automatic driving control system of agricultural machinery with a vehicle control system according to an embodiment of the present application is shown;

[0026] Figure 5 The internal structure diagram of a computer device according to an embodiment of the present application is schematically shown. DETAILED DESCRIPTION

[0027] In order to make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the technical scheme in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. It should be understood that the specific implementation methods described herein are only used to illustrate and explain the embodiments of the present application, and are not used to limit the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0028] It should be noted that if the embodiments of the present application involve directional indications (such as up, down, left, right, front, back...), the directional indications are only used to explain the relative position relationship, movement status, etc. between the components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indication will also change accordingly.

[0029] In addition, if there are descriptions involving "first", "second", etc. in the embodiments of the present application, the descriptions of "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or suggesting their relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In addition, the technical solutions between the various embodiments can be combined with each other, but they must be based on the ability of ordinary technicians in the field to implement them. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such combination of technical solutions does not exist and is not within the scope of protection required by this application.

[0030] Figure 1 The flowchart of a method for integrating an automatic driving control system based on agricultural machinery with a vehicle control system according to an embodiment of the present application is schematically shown. Figure 1 As shown, an embodiment of the present application provides a method for integrating an automatic driving control system based on agricultural machinery with a whole vehicle control system, and the method may include the following steps.

[0031] Step 101, in the automatic driving mode, the human-computer interaction device calls the automatic driving human-computer interaction module or the vehicle human-computer interaction module according to the user's operation;

[0032] Step 102, the display main program included in the human-machine interaction device obtains data input by the user through the automatic driving human-machine interaction module or the whole vehicle human-machine interaction module based on the human-machine interaction device;

[0033] Step 103, when the display main program receives the vehicle real-time positioning information collected by the wireless communication device, the display main program transmits the data input based on the CAN bus and the vehicle real-time positioning information to the vehicle controller main program included in the controller;

[0034] Step 104, the vehicle controller main program calls the automatic driving control module to generate a motion control decision signal according to the input data and the vehicle real-time positioning information;

[0035] Step 105, when the vehicle controller main program receives the implement status of the agricultural machinery collected by multiple implement sensors, the vehicle controller main program calls the vehicle control module to control the whole vehicle in response to the motion control decision signal based on the implement status, so that the whole vehicle operation status of the agricultural machinery conforms to the whole vehicle operation status corresponding to the motion control decision signal.

[0036] The method shown in the embodiment of the present application is applied to Figure 2 A schematic diagram of an agricultural machinery structure according to an embodiment of the present application is shown in FIG. Figure 2 As shown, the agricultural machinery includes a human-machine interaction device, a wireless communication device, a controller and a plurality of implement sensors, the automatic driving system of the agricultural machinery includes an automatic driving human-machine interaction module and an automatic driving control module, and the whole vehicle control system of the agricultural machinery includes a whole vehicle human-machine interaction module and a whole vehicle control module. The automatic driving control system and the whole vehicle control system are embedded in the agricultural machinery. The human-machine interaction device may include a human-machine interaction interface for interacting with the user through the human-machine interaction interface, the human-machine interaction device may be embedded with a display main program, and call different modules included in each system through the display main program to execute relevant instructions. The wireless communication device may be used to obtain peripheral system data, for example, by obtaining Beidou data to determine the positioning information of the agricultural machinery, and the wireless communication device may transmit the collected peripheral system data through the CAN bus. The controller may include a vehicle controller main program, and the modules included in each system are called through the vehicle controller program to control the agricultural machinery as a whole vehicle. The multiple implement sensors included in the agricultural machinery may collect the operating parameters related to each implement of the agricultural machinery, and transmit them through the CAN bus, that is, the control main program may obtain the implement status of the agricultural machinery collected by the multiple implement sensors through the CAN bus.

[0037] In the automatic driving mode, the human-machine interaction device can call the automatic driving human-machine interaction module or the whole vehicle human-machine interaction module according to the user's operation based on the interactive interface, and the display main program included in the human-machine interaction device can obtain the data input by the user based on the human-machine interaction device through the automatic driving human-machine interaction module or the whole vehicle human-machine interaction module through the human-machine interaction device. For example, the user activates the automatic driving related interface through the interactive interface, and the human-machine interaction device can call the automatic driving human-machine interaction module at this time. After calling the automatic driving human-machine interaction module, the display main program can obtain the data input by the user based on the currently activated automatic driving human-machine interaction module. The display main program can also receive the real-time positioning information of the vehicle collected by the wireless communication device. When the display main program receives the real-time positioning information of the vehicle collected by the wireless communication device, the display main program can transmit the received user input data and vehicle real-time positioning information to the vehicle controller main program included in the controller based on the CAN bus. The vehicle controller main program can call the automatic driving control module included in the automatic driving system according to the received user input data and vehicle real-time positioning information to generate a motion control decision signal. The main program of the vehicle controller included in the controller can receive the implement status of the agricultural machinery collected by multiple implement sensors based on the CAN bus. When the vehicle controller main program receives the implement status of the agricultural machinery collected by multiple implement sensors, the vehicle controller main program can respond to the motion control decision signal based on the current implement status of the agricultural machinery by calling the vehicle control module included in the vehicle control system to control the agricultural machinery, so that the vehicle operation status of the agricultural machinery conforms to the vehicle operation status corresponding to the motion control decision signal.

[0038] In the above technical scheme, the human-machine interaction device calls the automatic driving human-machine interaction module or the whole vehicle human-machine interaction module to obtain the user's input data, and sends the input data to the controller through the CAN bus. The controller generates a motion control decision signal by calling the automatic driving control module, and controls the agricultural machinery by calling the whole vehicle control module in response to the control decision signal. By making full use of the existing human-machine interaction devices and controllers and other hardware equipment of the agricultural machinery, and integrating different modules included in different systems through hardware equipment, the agricultural machinery can complete automatic driving, making the installation and debugging of the agricultural machinery simpler, the data reliability higher, and the system stability better.

[0039] In one embodiment, the input data includes first data input by a user based on an autonomous driving human-computer interaction module, the autonomous driving control module integrates a path planning algorithm and a motion control algorithm, and the vehicle controller main program calls the autonomous driving control module to generate a motion control decision signal based on the input data and the vehicle's real-time positioning information, including: calling the path planning algorithm based on the first data and the vehicle's real-time positioning information to generate planned path information; calling the motion control algorithm based on the first data, the planned path information and the vehicle's real-time positioning information to generate a motion control decision signal.

[0040] When the agricultural machinery is in the automatic driving mode, when the human-machine interaction device calls the automatic driving human-machine interaction module according to the user's operation, the display main program can obtain the first data input by the user through the automatic driving human-machine interaction module based on the human-machine interaction device, and the automatic driving control module can be integrated with a path planning algorithm and a motion control algorithm. When the display main program receives the vehicle real-time positioning information collected by the wireless communication device and the first data input by the user, the display main program can give the CAN bus to transmit the first data input by the user and the vehicle real-time positioning information to the vehicle control main program. The vehicle control main program can call the path planning algorithm to generate the planned path information according to the first data input by the user and the vehicle real-time positioning information. After the vehicle controller main program generates the planned path information, it can also generate a motion control decision signal for the agricultural machinery by calling the motion control algorithm according to the first data, the generated planned path information and the vehicle real-time positioning information. For example, the first data input by the user can be various parameter data, or it can be a start button triggered by the human-machine interaction interface. Assuming that after the user selects the automatic driving related page through the human-computer interaction device, he can input the key point data of the path related to the automatic driving, and input the instruction to generate the path. The display main program can transmit the received first data and the real-time positioning information of the vehicle to the vehicle controller main program through the CAN bus. The vehicle controller main program can call the path planning algorithm contained in the automatic driving control module according to the received key point data and the real-time positioning information of the vehicle to generate the planned path information corresponding to the first data. The vehicle controller main program can also call the motion control algorithm integrated in the automatic driving control module according to the first data input by the user, the generated planned path information and the real-time positioning information of the vehicle to generate a motion control decision signal for agricultural machinery.

[0041] In one embodiment, the fusion method further includes: the vehicle controller main program sends the planned path information to the display main program based on the CAN bus; the display main program stores the received planned path information and displays the planned path information through the human-computer interaction device.

[0042] After the vehicle controller main program calls the path planning algorithm according to the first data and the real-time positioning information of the vehicle to generate planned path information, the vehicle controller main program can send the generated planned path information to the display main program based on the CAN bus. After receiving the planned path information sent by the vehicle controller, the display main program can store the planned path information and display the planned path information through the human-computer interaction device to facilitate users to view the planned path information.

[0043] In one embodiment, the input data includes second data input by the user based on the human-computer interaction module of the whole vehicle, and the fusion method also includes: the vehicle controller main program calls the motion control algorithm to generate a motion control decision signal based on the second data, the first data, the planned path information and the real-time positioning information of the vehicle.

[0044] When the agricultural machinery is in the automatic driving mode, and the human-machine interaction device calls the whole vehicle human-machine interaction module according to the user's operation, the display main program can also obtain the second data input by the user through the whole vehicle human-machine interaction module based on the human-machine interaction device, wherein the second data can be the data input by the user through the human-machine interaction module to set or adjust the relevant parameters of the agricultural machinery whole vehicle. For example, the agricultural machinery may include a steering device, a speed change device and a working device, and the second data may be setting data for the steering device and the speed change device, or a working instruction for the working device. For example, in the automatic driving mode, the user can select the whole vehicle setting interface through the human-machine interaction device, set or adjust the relevant parameters of the whole vehicle by inputting the second data, such as the driving speed of the whole vehicle, and can also issue a working instruction for the working device by inputting the second data, such as controlling the start of the fan. The display main program can send the received second data to the vehicle controller main program based on the CAN bus, and the vehicle controller main program calls the motion control algorithm to generate a motion control decision signal for the agricultural machinery according to the received second data, the first data, the generated planning path information and the real-time positioning information of the vehicle.

[0045] In one embodiment, the fusion method further includes: the vehicle controller main program determines the current driving area type of the vehicle according to the planned path information and the real-time positioning information of the vehicle.

[0046] In the automatic driving mode, after the vehicle controller main program generates the planned path information by calling the path planning algorithm based on the first data input by the user and the real-time positioning information of the vehicle transmitted by the display screen main program, the vehicle controller main program can determine the current driving area type of the vehicle based on the planned path information and the real-time positioning information of the vehicle, wherein the driving area type can include a straight driving area and a non-straight driving area.

[0047] In one embodiment, the agricultural machinery also includes a steering device, a speed transmission device and a working device, and the vehicle control module integrates a vehicle control algorithm. When the vehicle controller main program receives the implement status of the agricultural machinery collected by multiple implement sensors, the vehicle controller main program calls the vehicle control module to control the whole vehicle based on the implement status in response to the motion control decision signal, including: when the current driving area type is a straight area, the steering device, the speed transmission device and the working device are controlled according to the planned path information, the vehicle real-time positioning information and the motion control decision signal; when the current driving area type is a non-straight area, the vehicle control algorithm is called according to the implement status to generate a vehicle control signal, so as to adjust the implement of the vehicle through the vehicle control signal, and the steering device and the speed transmission device are controlled according to the planned path information, the vehicle real-time positioning information and the motion control decision signal.

[0048] The agricultural machinery may include a steering device and a speed change device for controlling the agricultural machinery to turn and change speed. The agricultural machinery may also include a working device for completing agricultural operations related to the agricultural machinery. The vehicle control module may be integrated with a vehicle control algorithm. The vehicle controller main program included in the controller may receive the machine status of the agricultural machinery collected by multiple machine sensors. The vehicle controller main program generates planning path information and motion control decision signals by calling the path planning algorithm and motion control algorithm integrated in the automatic driving module, and determines the current driving area type of the vehicle according to the generated planning path information and the received vehicle real-time positioning information. When it is determined that the current driving area type of the agricultural machinery is a straight-through area, the vehicle control main program may control the steering device and the speed change device of the agricultural machinery according to the planning path information, the vehicle real-time positioning information and the motion control decision signal, so that the agricultural machinery can operate according to the operating state corresponding to the motion control decision signal, and may also control the working device of the agricultural machinery through the control decision signal, so that the agricultural machinery completes work processing in the straight-through area, such as harvesting work. When the current driving area type of the agricultural machinery is a non-straight driving area, the vehicle control main program can call the vehicle control algorithm to generate a vehicle control signal according to the state of the equipment, so as to adjust the equipment of the whole vehicle through the vehicle control signal, wherein the adjusted equipment is the equipment that affects the driving of the whole vehicle. Since work processing is not allowed when the agricultural machinery is in the non-execution area, the vehicle control main program can control the steering device and the speed change device according to the planned path information, the real-time positioning information of the vehicle and the motion control decision signal in the non-straight driving area, so that the agricultural machinery meets the operating state corresponding to the motion control decision signal. If there is a working device that is not in a non-working posture at this time, the vehicle control main program can also adjust the working device to put the working device in a non-working posture. For example, in the automatic driving mode, the current driving area type of the agricultural machinery is a non-straight driving area. When the agricultural machinery is driving in the non-straight driving area, the equipment in the agricultural machinery that will affect the driving of the agricultural machinery needs to be in a preset state. For example, when the agricultural machinery is driving in the non-straight driving area, the cutting table of the agricultural machinery needs to be in a raised state. The vehicle control main program can receive the equipment status collected by multiple equipment sensors. The vehicle control main program can generate a whole vehicle control signal by calling the whole vehicle control algorithm to adjust the equipment of the whole vehicle through the whole vehicle control signal, so that the equipment that will affect the driving of the agricultural machinery is in a preset state. For example, assuming that the vehicle control main program determines that the current cutting table is not raised according to the equipment status, the vehicle control main program can call the whole vehicle control algorithm to generate a whole vehicle control signal for the cutting table, and adjust the cutting table through the whole vehicle control signal to adjust the cutting table to a raised state.At the same time, the vehicle control main program can also control the steering device and transmission device of the agricultural machinery according to the planned path information, the vehicle real-time positioning information and the motion control decision signal, so that the agricultural machinery can operate according to the operating state corresponding to the planned path information and the motion control decision signal.

[0049] In one embodiment, Figure 3 As shown, a schematic diagram of another method for integrating an automatic driving control system based on agricultural machinery with a vehicle control system according to an embodiment of the present application is shown. Figure 3 As shown, an embodiment of the present application provides another method for integrating an automatic driving control system based on agricultural machinery with a whole vehicle control system, and the method may include the following steps.

[0050] Step 301, in the vehicle control mode, the human-computer interaction device calls the vehicle human-computer interaction module according to the user's operation;

[0051] Step 302, displaying that the main program obtains second data input by the user through the vehicle human-computer interaction module based on the human-computer interaction device;

[0052] Step 303, when the display main program receives the vehicle real-time positioning information collected by the wireless communication device, the display main program transmits the second data and the vehicle real-time positioning information to the vehicle controller main program included in the controller based on the CAN bus;

[0053] Step 304, the vehicle controller main program reads the local path planning information, and calls the automatic driving control module to generate a motion control decision signal according to the fourth data, the local path planning information and the real-time positioning information of the vehicle;

[0054] Step 305, when the vehicle controller main program receives the implement status of the agricultural machinery collected by multiple implement sensors, the vehicle controller main program calls the vehicle control module to control the whole vehicle in response to the motion control decision signal based on the implement status, so that the whole vehicle operation status of the agricultural machinery conforms to the whole vehicle operation status corresponding to the motion control decision signal.

[0055] The agricultural machinery also includes a vehicle control mode. When the agricultural machinery is in the vehicle control mode, the human-machine interaction device can call the vehicle human-machine interaction module according to the user's operation based on the interactive interface included in the human-machine interaction device, and the display main program included in the human-machine interaction device can obtain the second data input by the user through the vehicle human-machine interaction module based on the human-machine interaction device through the human-machine interaction device. For example, the user activates the vehicle control related interface through the interactive interface, and the human-machine interaction device can call the vehicle human-machine interaction module at this time. After calling the vehicle human-machine interaction module, the display main program can obtain the second data related to the vehicle control input by the user based on the currently activated vehicle human-machine interaction module. The display main program can also receive the vehicle real-time positioning information collected by the wireless communication device. When the display main program receives the vehicle real-time positioning information collected by the wireless communication device, the display main program can transmit the received second data and the vehicle real-time positioning information to the vehicle controller main program included in the controller based on the CAN bus. The vehicle controller main program can read the local path planning information stored locally, and call the automatic driving control module to generate a motion control decision signal based on the local planning path information, the received second data and the vehicle real-time positioning information. The main program of the vehicle controller included in the controller can also receive the implement status of the agricultural machinery collected by multiple implement sensors based on the CAN bus. When the main program of the vehicle controller receives the implement status of the agricultural machinery collected by multiple implement sensors, the main program of the vehicle controller can respond to the motion control decision signal based on the current implement status of the agricultural machinery by calling the vehicle control module included in the vehicle control system to control the agricultural machinery, so that the vehicle operation status of the agricultural machinery conforms to the vehicle operation status corresponding to the motion control decision signal.

[0056] In one embodiment, the autonomous driving control module is integrated with a motion control algorithm, the vehicle controller main program reads the local path planning information, and calls the autonomous driving control module to generate a motion control decision signal based on the fourth data, the local path planning information and the vehicle real-time positioning information, including: the vehicle controller main program calls the motion control algorithm to generate a motion control decision signal based on the second data, the local path planning information and the vehicle real-time positioning information.

[0057] In the vehicle control mode, the display main program can obtain the second data input by the user based on the currently activated vehicle human-computer interaction module, wherein the second data can be data input by the user through the human-computer interaction module to set or adjust the relevant parameters of the agricultural machinery vehicle. For example, the agricultural machinery may include a steering device, a transmission device, and a working device, and the second data can be setting data for the steering device and the transmission device, or a working instruction for the working device. For example, assuming that the display main program receives the second data input by the user based on the vehicle human-computer interaction module, the relevant parameters of the vehicle are set or adjusted by inputting the second data, such as the driving speed of the vehicle, and the working instructions for the working device can also be issued by inputting the second data, such as controlling the start of the fan.

[0058] The display main program can transmit the second data received from the user through the human-computer interaction module of the whole vehicle based on the human-computer interaction device, and the real-time positioning information of the vehicle to the vehicle control main program based on the CAN bus. The vehicle control main program can read the local path planning information and call the motion control algorithm integrated in the automatic driving control module to generate a motion control decision signal based on the received second data, the real-time positioning information of the vehicle and the read local path planning information.

[0059] In one embodiment, the fusion method further includes: The fusion method further includes: The vehicle controller main program determines the current driving area type of the vehicle based on the local planned path information and the vehicle real-time positioning information.

[0060] In the whole vehicle control mode, the vehicle controller main program can also determine the vehicle's current driving area type based on the read local planning path information and the received vehicle real-time positioning information transmitted by the display main program via the CAN bus.

[0061] In one embodiment, the agricultural machinery includes a speed transmission device, a steering device and a working device, and the vehicle control module integrates a vehicle control algorithm. When the vehicle controller main program receives the implement status of the agricultural machinery collected by multiple implement sensors, the vehicle controller main program calls the vehicle control module to control the whole vehicle in response to the motion control decision signal based on the implement status, including: when the current driving area type is a straight area, the steering device, the speed transmission device and the working device are controlled according to the local planned path information, the vehicle real-time positioning information and the motion control decision signal; when the current driving area type is a non-straight area, the vehicle control algorithm is called according to the implement status to generate a vehicle control signal, so as to adjust the implement of the vehicle through the vehicle control signal, and control the steering device and the speed transmission device according to the local planned path information, the vehicle real-time positioning information and the motion control decision signal.

[0062] The agricultural machinery may also include a steering device and a speed change device for controlling the agricultural machinery to turn and change speed. The agricultural machinery may also include a working device for completing agricultural operations related to the agricultural machinery. The vehicle control module may be integrated with a vehicle control algorithm. The vehicle controller main program included in the controller may receive the machine status of the agricultural machinery collected by multiple machine sensors. In the vehicle control mode, the vehicle controller main program generates a motion control decision signal by calling the motion control algorithm after receiving the second input data and vehicle real-time positioning information sent by the display main program based on the CAN bus, and determines the current driving area type of the vehicle by reading the local planning path information and the vehicle real-time positioning information. The vehicle controller main program determines the current driving area type and the motion control decision signal. When the current driving area type of the agricultural machinery is a straight driving area, the vehicle control main program can control the steering device and the speed change device of the agricultural machinery according to the local planning path information, the vehicle real-time positioning information and the motion control decision signal, so that the agricultural machinery can operate according to the operating state corresponding to the motion control decision signal, and can also control the working device of the agricultural machinery through the control decision signal, so that the agricultural machinery completes the work instructions issued by the user in the straight driving area, such as the harvesting work of the agricultural machinery. When the current driving area type of the agricultural machinery is a non-straight driving area, the vehicle control main program can call the vehicle control algorithm to generate a vehicle control signal according to the state of the equipment, so as to adjust the equipment of the whole vehicle through the vehicle control signal, wherein the adjusted equipment is the equipment that affects the driving of the whole vehicle. This is because when the agricultural machinery is in the non-execution area, work processing is not allowed. Therefore, in the non-straight driving area, the vehicle control main program can control the steering device and the transmission device according to the local planned path information, the real-time positioning information of the vehicle and the motion control decision signal, so that the agricultural machinery meets the operating state corresponding to the motion control decision signal. For example, in the whole vehicle control mode, the vehicle controller main program determines that the current driving area type of the agricultural machinery is a non-straight driving area based on the local planned path information and the real-time positioning information of the vehicle. When the agricultural machinery is driving in the non-straight driving area, the equipment in the agricultural machinery that will affect the driving of the agricultural machinery needs to be in a preset state. For example, when the agricultural machinery is driving in the non-straight driving area, the cutting table of the agricultural machinery needs to be in a raised state. The vehicle control main program can receive the equipment status collected by multiple equipment sensors. The vehicle control main program can generate a whole vehicle control signal by calling the whole vehicle control algorithm to adjust the equipment of the whole vehicle through the whole vehicle control signal, so that the equipment that affects the driving of the agricultural machinery is in a preset state. For example, assuming that the vehicle control main program determines that the current cutting table is not raised based on the equipment status, the vehicle control main program can call the whole vehicle control algorithm to generate a whole vehicle control signal for the cutting table, and adjust the cutting table through the whole vehicle control signal to adjust the cutting table to a raised state.At the same time, the vehicle control main program can also control the steering device and transmission device of the agricultural machinery according to the local planned path information, the vehicle real-time positioning information and the motion control decision signal, so that the agricultural machinery can operate according to the operating state corresponding to the local planned path information and the motion control decision signal.

[0063] In one embodiment, Figure 4 As shown, a flow chart of another method for integrating an automatic driving control system based on agricultural machinery with a whole vehicle control system according to an embodiment of the present application is schematically shown. In the automatic driving mode, the human-machine interaction device can call the automatic driving human-machine interaction module according to the user's operation, and the display main program included in the human-machine interaction device can obtain the first data input by the user based on the automatic driving human-machine interaction module, and obtain the vehicle real-time positioning information from the wireless communication device based on the CAN bus. In the case where the human-machine interaction device calls the whole vehicle human-machine interaction module according to the user's operation, the display main program can obtain the second data input by the user through the whole vehicle human-machine interaction module based on the human-machine interaction device, and the display main program can send the received first data, second data and vehicle real-time positioning information to the vehicle controller main program included in the controller through the CAN bus. After receiving the first data, second data and vehicle real-time positioning information, the vehicle controller main program included in the controller can call the path planning algorithm integrated in the automatic driving control module to generate the planning path information according to the first data and the vehicle real-time positioning information. After the vehicle control main program generates the planned path information by calling the path planning algorithm, it can generate a motion control decision signal by calling the motion control algorithm integrated in the automatic driving control module according to the first data, the second data, the generated planned path information and the real-time positioning information of the vehicle. The vehicle controller main program can receive the implement status of the agricultural machinery collected by multiple implement sensors through the CAN bus. When the vehicle controller main program receives the implement status of the agricultural machinery collected by multiple implement sensors, the vehicle controller main program can control the agricultural machinery by calling the vehicle control module included in the vehicle control system in response to the motion control decision signal based on the current implement status of the agricultural machinery. The vehicle controller main program can call the vehicle control algorithm integrated in the vehicle control module to generate a corresponding vehicle control signal according to the motion control decision signal, the path planning information and the real-time positioning information of the vehicle, and adjust the implement of the vehicle according to the vehicle control signal, so that the vehicle operation state of the agricultural machinery conforms to the vehicle operation state corresponding to the motion control decision signal.

[0064] In the vehicle control mode, the human-machine interaction device can call the vehicle human-machine interaction module according to the user's operation, and the display main program included in the human-machine interaction device can obtain the second data input by the user based on the vehicle human-machine interaction module, and obtain the vehicle real-time positioning information from the wireless communication device based on the CAN bus. The display main program can transmit the received second data and the vehicle real-time positioning information to the vehicle controller main program included in the controller based on the CAN bus. The vehicle controller main program can read the local path planning information stored locally, and call the automatic driving control module to generate a motion control decision signal based on the local planning path information, the received second data and the vehicle real-time positioning information. The vehicle controller main program can receive the implement status of the agricultural machinery collected by multiple implement sensors through the CAN bus. When the vehicle controller main program receives the implement status of the agricultural machinery collected by multiple implement sensors, the vehicle controller main program can control the agricultural machinery based on the current implement status of the agricultural machinery in response to the motion control decision signal by calling the vehicle control module included in the vehicle control system. The vehicle controller main program can call the vehicle control algorithm integrated in the vehicle control module to generate a corresponding vehicle control signal based on the motion control decision signal, local path planning information and real-time vehicle positioning information, and adjust the implement of the vehicle according to the vehicle control signal, so that the vehicle operation status of the agricultural machinery conforms to the vehicle operation status corresponding to the motion control decision signal.

[0065] Through the scheme shown in the above embodiment, the human-machine interaction device, wireless communication device, controller and other hardware equipment of agricultural machinery are fully utilized to integrate the automatic driving system with the vehicle control system. On the one hand, the hardware cost of agricultural machinery is reduced, and on the other hand, the communication delay and disconnection risk between the automatic driving human-machine interaction module, the automatic driving control module, the vehicle human-machine interaction module and the vehicle control module are reduced, thereby increasing the operating efficiency and maintainability of the system. While achieving the same function, it has higher economy and system stability.

[0066] In one embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as follows: Figure 5As shown. The computer device includes a processor A01, a network interface A02, a memory (not shown in the figure) and a database (not shown in the figure) connected via a system bus. Among them, the processor A01 of the computer device is used to provide computing and control capabilities. The memory of the computer device includes an internal memory A03 and a non-volatile storage medium A04. The non-volatile storage medium A04 stores an operating system B01, a computer program B02 and a database (not shown in the figure). The internal memory A03 provides an environment for the operation of the operating system B01 and the computer program B02 in the non-volatile storage medium A04. The database of the computer device is used to store relevant data of agricultural machinery. The network interface A02 of the computer device is used to communicate with an external terminal through a network connection. When the computer program B02 is executed by the processor A01, a method for integrating an automatic driving control system based on agricultural machinery with a vehicle control system is implemented.

[0067] Figure 1 FIG. 1 is a flow chart of a method for integrating an automatic driving control system of agricultural machinery with a vehicle control system in one embodiment. It should be understood that although Figure 1 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figure 1 At least part of the steps may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least part of the sub-steps or stages of other steps.

[0068] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0069] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0070] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0071] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0072] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0073] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0074] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0075] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0076] The above are only embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included within the scope of the claims of the present application.

Claims

1. A method for integrating the automatic driving control system of agricultural machinery with the vehicle control system. It is characterized in that The agricultural machinery includes a human-machine interaction device, a wireless communication device, a controller, and a plurality of implement sensors; the automatic driving system includes an automatic driving human-machine interaction module and an automatic driving control module; the whole vehicle control system includes a whole vehicle human-machine interaction module and a whole vehicle control module; and the fusion method includes: In the automatic driving mode, the human-computer interaction device calls the automatic driving human-computer interaction module or the vehicle human-computer interaction module according to the user's operation; The display main program included in the human-computer interaction device obtains data input by the user through the automatic driving human-computer interaction module or the whole vehicle human-computer interaction module based on the human-computer interaction device; In the case where the display main program receives the vehicle real-time positioning information collected by the wireless communication device, the display main program transmits the input data and the vehicle real-time positioning information to the vehicle controller main program included in the controller based on the CAN bus; The vehicle controller main program calls the automatic driving control module to generate a motion control decision signal according to the input data and the real-time positioning information of the vehicle; When the vehicle controller main program receives the implement status of the agricultural machinery collected by multiple implement sensors, the vehicle controller main program calls the vehicle control module to control the whole vehicle based on the implement status in response to the motion control decision signal, so that the whole vehicle operation status of the agricultural machinery conforms to the whole vehicle operation status corresponding to the motion control decision signal.

2. According to claim 1, the method for integrating the automatic driving control system based on agricultural machinery with the vehicle control system, It is characterized in that The input data includes first data input by the user based on the automatic driving human-computer interaction module, the automatic driving control module integrates a path planning algorithm and a motion control algorithm, and the vehicle controller main program calls the automatic driving control module to generate a motion control decision signal according to the input data and the real-time positioning information of the vehicle, including: Calling a path planning algorithm according to the first data and the real-time positioning information of the vehicle to generate planned path information; A motion control algorithm is called according to the first data, the planned path information and the real-time positioning information of the vehicle to generate a motion control decision signal.

3. The method for integrating the automatic driving control system based on agricultural machinery with the vehicle control system according to claim 2, It is characterized in that The fusion method further comprises: The vehicle controller main program sends the planned path information to the display main program based on the CAN bus; The main display program stores the received planned path information and displays the planned path information through the human-computer interaction device.

4. The method for integrating the automatic driving control system based on agricultural machinery with the vehicle control system according to claim 2, It is characterized in that The input data includes second data input by the user based on the vehicle human-computer interaction module, and the fusion method further includes: The vehicle controller main program calls a motion control algorithm to generate a motion control decision signal according to the second data, the first data, the planned path information and the real-time positioning information of the vehicle.

5. The method for integrating the automatic driving control system based on agricultural machinery with the vehicle control system according to claim 2, It is characterized in that The fusion method further comprises: The vehicle controller main program determines the current driving area type of the vehicle according to the planned path information and the vehicle real-time positioning information.

6. The method for integrating the automatic driving control system based on agricultural machinery with the vehicle control system according to any one of claims 2 to 5, It is characterized in that The agricultural machinery further includes a steering device, a transmission device and a working device, the whole vehicle control module integrates a whole vehicle control algorithm, and when the vehicle controller main program receives the implement status of the agricultural machinery collected by multiple implement sensors, the vehicle controller main program calls the whole vehicle control module to control the whole vehicle in response to the motion control decision signal based on the implement status, including: When the current driving area type is a straight driving area, the steering device, the speed change device and the working device are controlled according to the planned path information, the real-time positioning information of the vehicle and the motion control decision signal; In the case where the current driving area type is a non-straight driving area, the vehicle control algorithm is called according to the equipment status to generate a vehicle control signal, so as to adjust the equipment of the vehicle through the vehicle control signal, and control the steering device and the transmission device according to the planned path information, the real-time positioning information of the vehicle and the motion control decision signal.

7. The method for integrating the automatic driving control system based on agricultural machinery with the vehicle control system according to claim 1, It is characterized in that The fusion method further comprises: In the vehicle control mode, the human-computer interaction device calls the vehicle human-computer interaction module according to the user's operation; The display main program acquires second data input by the user through the vehicle human-computer interaction module based on the human-computer interaction device; In the case where the display main program receives the vehicle real-time positioning information collected by the wireless communication device, the display main program transmits the second data and the vehicle real-time positioning information to the vehicle controller main program included in the controller based on the CAN bus; The vehicle controller main program reads the local path planning information, and calls the automatic driving control module to generate a motion control decision signal according to the fourth data, the local path planning information and the real-time positioning information of the vehicle; When the vehicle controller main program receives the implement status of the agricultural machinery collected by multiple implement sensors, the vehicle controller main program calls the vehicle control module to control the whole vehicle based on the implement status in response to the motion control decision signal, so that the whole vehicle operation status of the agricultural machinery conforms to the whole vehicle operation status corresponding to the motion control decision signal.

8. The method for integrating the automatic driving control system based on agricultural machinery with the vehicle control system according to claim 7, It is characterized in that The automatic driving control module is integrated with a motion control algorithm, the vehicle controller main program reads the local path planning information, and calls the automatic driving control module to generate a motion control decision signal according to the fourth data, the local path planning information and the real-time positioning information of the vehicle, including: The vehicle controller main program calls a motion control algorithm to generate a motion control decision signal according to the second data, the local path planning information and the vehicle real-time positioning information.

9. The method for integrating the automatic driving control system based on agricultural machinery with the vehicle control system according to claim 7, It is characterized in that The fusion method further comprises: The vehicle controller main program determines the current driving area type of the vehicle according to the local planned path information and the vehicle real-time positioning information.

10. The method for integrating the automatic driving control system based on agricultural machinery with the vehicle control system according to claim 8 or 9, It is characterized in that The agricultural machinery includes a transmission device, a steering device and a working device, the whole vehicle control module integrates a whole vehicle control algorithm, and when the vehicle controller main program receives the implement status of the agricultural machinery collected by multiple implement sensors, the vehicle controller main program calls the whole vehicle control module to control the whole vehicle in response to the motion control decision signal based on the implement status, including: When the current driving area type is a straight driving area, the steering device, the speed change device and the working device are controlled according to the local planned path information, the real-time positioning information of the vehicle and the motion control decision signal; In the case where the current driving area type is a non-straight-ahead area, the vehicle control algorithm is called according to the equipment status to generate a vehicle control signal, so as to adjust the equipment of the vehicle through the vehicle control signal, and control the steering device and the transmission device according to the local planned path information, the vehicle real-time positioning information and the motion control decision signal.

11. A computer program product comprising a computer program, It is characterized in that When the computer program is executed by a processor, the computer program implements a method for integrating an automatic driving control system based on agricultural machinery with a whole vehicle control system according to any one of claims 1 to 10.