Automatic steering system and automatic steering method
By obtaining and displaying standard driving line information and adjusting the setting driving line to be parallel to it, the problem of unclear position before the start of autonomous driving is solved, ensuring the accurate setting of driving line and the smooth switching of autonomous driving is ensured.
Patent Information
- Application Number
- JP2024201492
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-11-19
- Publication Date
- 2025-01-30
- Estimated Expiration
- 2040-12-02
AI Technical Summary
In the prior art, the position of the driving line is unknown before the start of autonomous driving, resulting in a set error and needs to be readjusted.
The automatic driving system obtains the direction and vehicle position information of the standard driving line, displays and adjusts the setting driving line to make it parallel to the standard driving line, and provides direction correction function to ensure that the automatic driving conditions are switched to automatic driving when the autonomous driving conditions are met.
It realizes accurate setting of driving lines, reduces repeated adjustments, and improves the reliability and efficiency of autonomous driving.
Smart Images

Figure 2025015767000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an automatic steering system and an automatic steering method for performing work in a farm field. [Background technology]
[0002] Conventionally, techniques for improving the work efficiency of combine harvesters have been considered. For example, Patent Document 1 proposes an agricultural work machine that includes a traveling machine body that can freely switch between manual traveling by manual steering and automatic traveling by automatic steering along a set traveling line that is set parallel to a reference traveling line, a changeover switch that can freely switch between manual traveling and automatic traveling, and a start point setting unit that sets the planar position of the traveling machine body at the time when the changeover switch is used to switch from manual traveling to automatic traveling as the start point of the set traveling line. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2017-123803 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, in the configuration proposed in Patent Document 1, the position of the set driving line cannot be known until automatic steering is started. Therefore, it may be discovered after automatic steering is started that the position of the set driving line is misaligned, and it may be necessary to reset the set driving line.
[0005] SUMMARY OF THE PRESENT DISCLOSURE In consideration of the above circumstances, an object of the present invention is to easily set a set driving line that is parallel to a reference driving line. [Means for solving the problem]
[0006] In order to solve the above problems, the automatic steering system of the present invention comprises a reference driving line acquisition unit that acquires a reference driving line indicating the direction of driving by automatic steering, a position information acquisition unit that repeatedly acquires position information indicating the position of the vehicle, a display control unit that, after acquiring the reference driving line, displays on a display unit a set driving line that is parallel to the reference driving line and passes through a reference point set based on the position of the vehicle indicated by the latest position information during driving by manual steering, and moves the set driving line in parallel to follow the movement of the vehicle, and a driving control unit that drives the vehicle by automatic steering along the set driving line, whose position is set based on an operation of switching from manual steering to automatic steering.
[0007] The display control unit may cause the display of the set driving line to differ depending on whether a condition necessary for starting automatic steering is satisfied or not.
[0008] The display control unit may display the outer edge of a working area for the host vehicle based on the set driving line before starting automatic steering.
[0009] The automatic steering system may be provided with a correction unit that corrects the direction of the reference driving line so that it is parallel to a straight line connecting the start point and end point of driving using automatic steering when the position of the vehicle is changed in a direction intersecting the set driving line while driving using automatic steering.
[0010] In addition, the automatic steering method of the present invention includes an information acquisition process for acquiring a reference driving line indicating the direction of driving by automatic steering and repeatedly acquiring position information indicating the position of the vehicle, a display control process for displaying a set driving line on a display unit that is parallel to the reference driving line and passes through a reference point set based on the position of the vehicle indicated by the latest position information after acquiring the reference driving line, while driving by manual steering, and moving the set driving line in parallel to the movement of the vehicle, and a driving control process for driving the vehicle by automatic steering along the set driving line, the position of which is set based on an operation of switching from manual steering to automatic steering. Effect of the Invention
[0011] According to the present invention, a set driving line that is parallel to a reference driving line can be easily set. [Brief description of the drawings]
[0012] [Figure 1] FIG. 2 is a left side view of a combine harvester according to one embodiment of the present invention. [Diagram 2] 1 is a plan view showing a schematic configuration of a combine harvester according to one embodiment of the present invention. FIG. [Diagram 3] 2 is a block diagram showing the electrical configuration of a combine harvester according to one embodiment of the present invention. FIG. [Figure 4] 2 is a block diagram showing a positioning unit and a base station according to an embodiment of the present invention; FIG. [Diagram 5] 4 is a flow diagram of control of a combine harvester according to one embodiment of the present invention. [Figure 6] FIG. 13 is a diagram showing a setting screen for a reference driving line according to an embodiment of the present invention. [Figure 7A] This is a figure that is displayed in the first area after the reference driving line is set. [Figure 7B] FIG. 11 is a diagram showing a second area after a reference driving line is set. [Figure 8A] This is a shape that is displayed in the first area during movement to the starting position. [Figure 8B] FIG. 13 shows a second region during movement to a starting position. [Figure 9] FIG. 13 is an enlarged view of a figure displayed in the first area during movement to the start position. [Figure 10] FIG. 13 is an enlarged view of a figure displayed in the first area during movement to the start position. [Figure 11] FIG. 13 is an enlarged view of a figure displayed in the first area after movement to the start position. [Figure 12A] This is a figure that is displayed in the first area when the automatic reaping start condition is satisfied. [Figure 12B] FIG. 11 is a diagram showing a second region when an automatic reaping start condition is satisfied. [Figure 13]11 is a flowchart showing a process according to a first modified example of an embodiment of the present invention. [Figure 14A] 13 is a diagram displayed in a first area of a setting screen according to a first modified example of an embodiment of the present invention. [Figure 14B] FIG. 11 is a diagram showing a second area of the setting screen according to a first modified example of the embodiment of the present invention. [Figure 15] 13 is a flow chart of a process according to a second modified example of an embodiment of the present invention. [Figure 16A] 13 is a diagram displayed in a first area of a setting screen according to a second modified example of an embodiment of the present invention. [Figure 16B] FIG. 11 is a diagram showing a second area of a setting screen according to a second modified example of the embodiment of the present invention. [Figure 17A] 13 is a diagram displayed in a first area of a setting screen according to a second modified example of an embodiment of the present invention. [Figure 17B] FIG. 11 is a diagram showing a second area of a setting screen according to a second modified example of the embodiment of the present invention. [Figure 18] 13 is a flow chart of a process according to a third modified example of an embodiment of the present invention. [Figure 19A] 13 is a diagram displayed in a first area of a setting screen according to a third modified example of an embodiment of the present invention. [Figure 19B] FIG. 13 is a diagram showing a second area of a setting screen according to a third modified example of an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0013] Hereinafter, a combine harvester 1 (an example of a work vehicle) according to one embodiment of the present invention will be described with reference to the drawings.
[0014] First, an overview of the combine harvester 1 will be described. Fig. 1 is a left side view of the combine harvester 1. Fig. 2 is a plan view showing a schematic configuration of the combine harvester 1. Fig. 3 is a block diagram showing the electrical configuration of the combine harvester 1. Fig. 4 is a block diagram showing a positioning unit 34 and a base station 39. In each drawing, U, Lo, L, R, Fr, and Rr respectively indicate up, down, left, right, front, and rear.
[0015] [Combine Overview] The combine harvester 1 has an automatic harvesting function that harvests stalks while driving with automatic steering. In the case of automatic steering, speed control can be automatic or manual. The combine harvester 1 can also be steered and controlled at speed manually.
[0016] As shown in FIG. 1, the combine harvester 1 includes a traveling section 2, a reaping section 3, a threshing section 4, a sorting section 5, a storage section 6, a straw waste processing section 7, a power section 8, and a steering section 9. The combine harvester 1 is a so-called head-threshing type combine harvester, and while traveling on the traveling section 2, threshes the stalks (harvested material) harvested by the reaping section 3 in the threshing section 4, sorts the grains in the sorting section 5, and stores them in the storage section 6. The combine harvester 1 also processes the straw waste after threshing in the straw waste processing section 7. The combine harvester 1 drives the traveling section 2, the reaping section 3, the threshing section 4, the sorting section 5, the storage section 6, and the straw waste processing section 7 by the power supplied from the power section 8. The present invention may be applied to a normal type combine harvester.
[0017] The running section 2 is provided below the machine frame 10. The reaping section 3 is provided in front of the machine frame 10. The threshing section 4, the sorting section 5, the storage section 6, the straw waste processing section 7, the power section 8, and the steering section 9 are provided above the machine frame 10. The reaping section 3, the threshing section 4, the sorting section 5, the storage section 6, the straw waste processing section 7, the power section 8, and the steering section 9 are provided on the machine frame 10. The main body section 12 includes the machine frame 10, the reaping section 3, the threshing section 4, the sorting section 5, the storage section 6, the straw waste processing section 7, the power section 8, and the steering section 9, and is supported by the running section 2. In other words, the combine harvester 1 is configured so that the running section 2 supports the main body section 12 and travels.
[0018] The traveling section 2 is equipped with a pair of left and right crawler-type traveling devices 11 provided below the machine frame 10. The crawler-type traveling devices 11 are connected to an engine 27 via a transmission (not shown) and rotate by the power generated by the engine 27. The rotational drive of the left and right crawler-type traveling devices 11 is independently controlled to move forward, backward, and turn.
[0019] The reaping unit 3 is provided in front of the traveling unit 2. The reaping unit 3 is provided so as to be movable between a lowered position at which the culms in the field H can be harvested and an elevated position at which the culms cannot be harvested. The reaping unit 3 includes a divider 13, a lifting device 14, a cutting device 15, and a conveying device 16. The divider 13 guides the culms in the field H to the lifting device 14. The lifting device 14 lifts the culms guided by the divider 13. The cutting device 15 cuts the culms lifted by the lifting device 14. The conveying device 16 is provided above the rear side of the cutting device 15 and on the left side of the main body 12, and conveys the culms cut by the cutting device 15 rearward.
[0020] The threshing unit 4 is provided behind the reaping unit 3 and on the left side of the main body unit 12. The threshing unit 4 includes a feed chain 18 and a threshing drum 19. The feed chain 18 transports the stew transported from the transport device 16 of the reaping unit 3 for threshing, and further transports the threshed stew, i.e., waste straw, to the straw waste processing unit 7. The threshing drum 19 threshes the stew transported by the feed chain 18.
[0021] The sorting section 5 is provided below the threshing section 4. The sorting section 5 is equipped with an oscillating sorting device 21, a wind sorting device 22, a grain conveying device (not shown), and a straw dust discharge device (not shown). The oscillating sorting device 21 sifts the threshed grains that have fallen from the threshing section 4 to separate them into grains, straw dust, etc. The wind sorting device 22 further separates the threshed grains sorted by the oscillating sorting device 21 into grains, straw dust, etc. by blowing air. The grain conveying device transports the grains sorted by the oscillating sorting device 21 and the wind sorting device 22 to the storage section 6. The straw dust discharge device discharges the straw dust, etc. sorted by the oscillating sorting device 21 and the wind sorting device 22 to the outside of the machine.
[0022] The storage section 6 is provided to the right of the threshing section 4. The storage section 6 includes a grain tank 24 and a discharge device 25. The grain tank 24 stores the grains transported from the sorting section 5. The discharge device 25 is composed of an auger or the like, and discharges the grains stored in the grain tank 24 to any desired location.
[0023] The straw waste processing section 7 is provided behind the threshing section 4. The straw waste processing section 7 is equipped with a straw waste conveying device (not shown) and a straw waste cutting device (not shown). The straw waste conveying device transports the straw transported from the feed chain 18 of the threshing section 4 to the straw waste cutting device. The straw waste cutting device cuts the straw transported by the straw waste conveying device and discharges it outside the machine.
[0024] The power unit 8 is provided above the front of the traveling unit 2. The power unit 8 includes an engine 27 that generates rotational power. The power unit 8 transmits the rotational power generated by the engine 27 to the traveling unit 2, the reaping unit 3, the threshing unit 4, the sorting unit 5, the storage unit 6, and the straw waste processing unit 7.
[0025] The control unit 9 is provided above the power unit 8. The control unit 9 includes a driver's seat 29, a terminal 30 (see FIG. 3) equipped with a touch panel, and a plurality of operating tools (not shown). The driver's seat 29 is provided, for example, on the right side of the main body 12 and includes a chair or the like on which an operator sits. The terminal 30 is provided in a position (for example, in front of the right or left of the operator) that allows the operator seated in the driver's seat 29 to operate it. The terminal 30 is a display unit 64 that displays images captured by the machine body camera 32, the fixed camera 43, and the aerial camera 57, which will be described later, and is also an operating unit 63 that accepts operations for the combine harvester 1. The plurality of operating tools are operated by the operator seated in the driver's seat 29 and include a handle for operating the combine harvester 1, an accelerator for adjusting the rotation speed of the engine 27 (the traveling speed of the combine harvester 1), an elevation switch for raising and lowering the reaping unit 3, and the like.
[0026] The combine harvester 1 is equipped with a machine body camera 32, a positioning unit 34, and an orientation measuring unit 33 (see Figures 2 and 3).
[0027] [Aircraft camera] The machine body camera 32 is provided, for example, on the upper front part of the control unit 9 and captures images of the field H.
[0028] [Positioning section] The positioning unit 34 acquires position information indicating the position of the combine harvester 1 by using a satellite positioning system such as GPS (Global Positioning System). The positioning unit 34 (see FIG. 3) includes a mobile communication device 35, a mobile GPS antenna 36, and a data receiving antenna 37. The mobile communication device 35 receives signals from GPS satellites via the mobile GPS antenna 36, and acquires the position information of the combine harvester 1 by calculating the position of the combine harvester 1 (strictly speaking, the position of the mobile GPS antenna 36) using the received signals. The mobile communication device 35 repeatedly acquires the position information at a predetermined time interval. The mobile GPS antenna 36 is provided, for example, on the left side of the control unit 9 and approximately in the center of the main body unit 12 in the left-right direction.
[0029] [Directional measurement section] The orientation measurement unit 33 is, for example, an angular velocity sensor (gyro sensor), a three-axis acceleration sensor, a geomagnetic sensor, or the like, and measures the orientation of the combine harvester 1 to obtain orientation information indicating the orientation of the combine harvester 1. The orientation measurement unit 33 repeatedly obtains the orientation information at a predetermined time interval.
[0030] [Base station] A base station 39 is installed on the ridges around the field H where the combine harvester 1 is to work. The base station 39 includes a fixed communication device 40, a fixed GPS antenna 41, a data transmission antenna 42, and a fixed camera 43. The fixed communication device 40 acquires position information of the base station 39 by communicating with a GPS satellite via the fixed GPS antenna 41. The fixed communication device 40 transmits correction information based on the position information of the base station 39 to the mobile communication device 35 via the data transmission antenna 42. The fixed camera 43 photographs the field H. The fixed communication device 40 acquires an image (field image) photographed by the fixed camera 43, and transmits the field image to the mobile communication device 35 via the data transmission antenna 42. The mobile communication device 35 of the positioning unit 34 receives the correction information and the field image transmitted from the fixed communication device 40 of the base station 39 via the data receiving antenna 37. The mobile communication device 35 corrects the position information of the combine harvester 1 based on the correction information. It is not necessary to install base station 39, and base station 39 does not have to correct the location information.
[0031] [Control device] The control device 45 includes a calculation unit 50, a storage unit 51, and a communication unit 52. The above-mentioned various components of the combine harvester 1 are connected to the control device 45 via a communication interface. The control device 45 controls the various components of the combine harvester 1 in response to input operations from an operator via the operation unit 9.
[0032] The storage unit 51 is, for example, a Read Only Memory (ROM), a Random Access Memory (RAM), a hard disk drive, a flash memory, etc., and stores programs and data for controlling the various components and functions of the combine harvester 1. The calculation unit 50 is, for example, a Central Processing Unit (CPU), and controls the various components and functions of the combine harvester 1 by executing calculation processing using the programs and data stored in the storage unit 51. Note that the control device 45 may be realized by an integrated circuit that does not use a program, instead of a processor that executes a program, etc.
[0033] The communication unit 52 performs wireless communication with a mobile terminal 53 carried by the worker. The mobile terminal 53 is, for example, a tablet equipped with a touch panel, and has a function of remotely controlling the combine harvester 1. The mobile terminal 53 is equipped with a mobile camera 54 that photographs the field H. The communication unit 52 also performs wireless communication with an aerial photography device 56 such as a drone. The aerial photography device 56 is equipped with an aerial photography camera 57 that photographs the field H. When the worker inputs an operation instruction to the aerial photography device 56 to the terminal 30 or the mobile terminal 53, the aerial photography device 56 operates according to the operation instruction transmitted from the communication unit 52. The aerial photography device 56 may perform wireless communication with the mobile terminal 53 instead of / in addition to the communication unit 52. The mobile terminal 53 and the aerial photography device 56 may be omitted.
[0034] [Device] The terminal 30 includes a calculation unit 60, a storage unit 61, a communication unit 62, an operation unit 63, and a display unit 64.
[0035] The storage unit 61 is, for example, a Read Only Memory (ROM), a Random Access Memory (RAM), a hard disk drive, a flash memory, etc., and stores programs and data for controlling various components and various functions of the terminal 30. The calculation unit 60 is, for example, a Central Processing Unit (CPU), and controls various components and various functions of the terminal 30 by executing calculation processing using the programs and data stored in the storage unit 61.
[0036] The communication unit 52 communicates with the control device 45 of the combine harvester 1. Information used for traveling of the combine harvester 1 is supplied to the control device 45 via the communication unit 62. In addition, information indicating the state of the combine harvester 1 is obtained from the control device 45 via the communication unit 62.
[0037] When an operator inputs a shooting instruction to the on-board camera 32 of the combine harvester 1, the fixed camera 43 of the base station 39, and the aerial camera 57 of the aerial photography device 56 to the terminal 30 or the mobile terminal 53 (hereinafter referred to as the terminal 30, etc.), the control device 45 controls the on-board camera 32, the fixed camera 43, and the aerial camera 57 to shoot the field H. The control device 45 displays the field images shot by the on-board camera 32, the fixed camera 43, and the aerial camera 57 on the terminal 30, etc. When an operator inputs a display instruction to the terminal 30, etc. for a field image shot by the mobile camera 54 of the mobile terminal 53, the control device 45 controls the mobile terminal 53 via the communication unit 52 to display the field image on the terminal 30, etc. Note that the field image does not have to be displayed.
[0038] Next, the control of the combine harvester 1 will be described in detail. Fig. 5 is a flow chart of the control of the combine harvester 1. Fig. 6 is a diagram showing a setting screen for the reference driving line BL. Fig. 7A is a diagram displayed in the first area A1 after the reference driving line BL is set.
[0039] The combine harvester 1 (see Figure 3) is equipped with an operation unit 63 that accepts operations, a display unit 64 that displays images, a reference driving line acquisition unit 71 that acquires a reference driving line BL that indicates the direction of driving by automatic steering, a position information acquisition unit 72 that acquires position information that indicates the position of the vehicle, a field information acquisition unit 74 that acquires field information that indicates the position of the outer edge of an unworked area in the field, a display control unit 75 that causes the display unit 64 to display the outer edge of the unworked area indicated by the field information and a set driving line SL that is parallel to the reference driving line BL and has as its reference point the position of the vehicle indicated by the latest position information, and a control device 45 (an example of a driving control unit) that causes the vehicle to drive by automatic steering along the set driving line SL at the time when the operation unit 63 accepts an operation to switch from manual steering to automatic steering.
[0040] The operation unit 63, the display unit 64, the reference driving line acquisition unit 71, the position information acquisition unit 72, the farm field information acquisition unit 74, and the display control unit 75 are functions realized by the calculation unit 60 of the terminal 30 executing calculation processing using the programs and data stored in the memory unit 61. The driving control unit is a function realized by the calculation unit 50 of the control device 45 executing calculation processing using the programs and data stored in the memory unit 51.
[0041] [Reference driving line acquisition section] The reference driving line BL is represented by a straight line connecting a start point A and an end point B (see FIG. 7A). When the operator operates the terminal 30 to set the start point A and the end point B (see FIG. 6) while manually steering the combine harvester 1 to drive and harvest uncut land H0 (an example of unworked land), the terminal 30 acquires position information of the start point A and the end point B, thereby setting the reference driving line BL. Alternatively, the operator may set the reference driving line BL by inputting the coordinates of the start point A and the end point B into the terminal 30.
[0042] [Location information acquisition unit, direction information acquisition unit, field information acquisition unit] The terminal 30 repeatedly acquires position information of the combine harvester 1 from the positioning unit 34 via the control device 45 of the combine harvester 1 at predetermined time intervals and stores the information in the memory unit 51 (an example of a position information acquisition unit 72). The terminal 30 also repeatedly acquires orientation information of the combine harvester 1 from the orientation measurement unit 33 at predetermined time intervals and stores the information in the memory unit 51 (an example of an orientation information acquisition unit 73). The terminal 30 also acquires field information including the positions of the outer edge of the field H and the outer edges of the uncut land H0 and the cut land H1 within the field H, and stores the information in the memory unit 51 (an example of a field information acquisition unit 74).
[0043] Specifically, the field H is manually mowed once, and the outer edge of the field H is indicated by position information acquired by the positioning unit 34 during the one revolution. Alternatively, the outer edge of the field H may be acquired by the operator specifying the outer edge of the field H on a map displayed on the terminal 30. The position information of the combine harvester 1 while traveling is updated at a predetermined time interval, and is stored in the memory unit 51 each time it is updated. The terminal 30 calculates the outer edge of the already-mowed land H1 from the route traveled by the combine harvester 1 in the field H (the history of the position information of the combine harvester 1) and the mowing width of the mowing unit 3, and calculates the outer edge of the unmowed land H0 from the outer edge of the field H and the outer edge of the already-mowed land H1.
[0044] [Display control section] The display control unit 75 causes the display unit 64 of the terminal 30 to display the outer edge of the uncut land H0 indicated by the field information. The display control unit 75 also causes the display unit 64 to display a set driving line SL that is parallel to the reference driving line BL and has as its reference point the position of the vehicle indicated by the latest position information. At this time, the display control unit 75 causes an icon that imitates the appearance of the combine harvester 1 from above to be displayed at the reference point of the set driving line SL. The display control unit 75 also changes the attitude of the icon according to the orientation indicated by the acquired orientation information.
[0045] [Drive control unit] In the automatic reaping operation, the control device 45 uses the position information and the direction information to automatically steer the traveling unit 2 to travel along a set traveling line SL described later. The control device 45 also controls the reaping unit 3, the threshing unit 4, the sorting unit 5, the storage unit 6, and the straw waste processing unit 7 to perform reaping of the culms, threshing of the culms after reaping, sorting of grains and straw waste, storage of the grains, processing of the straw, etc.
[0046] Next, the operation of the combine harvester 1 will be described. The combine harvester 1 is manually steered to move to a reaping start position on the uncut land H0. When the operator selects "obtain reference driving line" on a menu screen (not shown) displayed on the terminal 30 at the reaping start position, the terminal 30 starts the process shown in the flowchart of FIG. 5. In FIG. 5, steps S01 and S02 are an example of an information acquisition process. Steps S02 to S05 are an example of a display control process. Steps S06 to S10 are an example of a driving control process.
[0047] First, the terminal 30 acquires the field information and the reference travel line BL (step S01). The acquisition of the field information is as described above. The terminal 30 displays a setting screen for the reference travel line BL on the display unit 64 (see FIG. 6). On the setting screen, the terminal 30 displays a figure showing the outer edge of the uncut land H0, an icon of the combine harvester 1, a button B1 for setting a start point A of the reference travel line BL, and a button B2 for setting an end point B. The terminal 30 also updates the position and attitude of the icon according to changes in the position information and orientation information due to the movement of the combine harvester 1. The terminal 30 also calculates the outer edge of the already-cut land H1 from the position information and the cutting width of the cutting unit 3, and updates the boundary line between the already-cut land H1 and the uncut land H0. The operator performs cutting while moving the combine harvester 1 straight along the outer edge of the uncut land H0 by manual steering, and sets the start point A and the end point B by operating the buttons B1 and B2. The starting point A and the ending point B may be the first and last points of a straight line, or they may be two points along the way.
[0048] Once the start point A and end point B are set, the terminal 30 updates the setting screen (see FIG. 7A). Specifically, the terminal 30 displays the reference driving line BL as a line segment connecting the start point A and the end point B. FIG. 7B is a diagram showing the second area A2 after the reference driving line BL has been set. The terminal 30 displays a message indicating that the reference driving line BL has been set and prompting the user to move to the start position of automatic mowing. Note that the reference driving line BL may be acquired in parallel with the circular mowing for acquiring the field information described above.
[0049] Next, the terminal 30 executes acquisition of position information, acquisition of direction information, display of the set travel line SL, and display of the outer edge of the working area WA in parallel with the movement by manual steering (step S02). Specifically, when the operator starts the movement by manual steering, the terminal 30 displays a setting screen of the automatic reaping start position. FIG. 8A is a figure displayed in the first area A1 during the movement to the start position. FIG. 8B is a diagram showing the second area A2 during the movement to the start position. In the setting screen, the terminal 30 displays a figure showing the outer edge of the uncut land H0 and the cut land H1, an icon of the combine 1, a reference travel line BL, a set travel line SL, and the outer edge of the working area WA. The set travel line SL is a line segment that is parallel to the reference travel line BL and has the position of the combine 1 indicated by the latest position information as its reference point. Here, the reference point of the line segment is, for example, the moving GPS antenna 36 of the combine 1, but another point inside the combine 1 may be the reference point of the set travel line SL. The outer edge of the working area WA is shown by a line segment that is parallel to the reference travel line BL and passes through the left and right ends of the reaping unit 3. It is sufficient that at least the outer edge of the working area WA is displayed, but the entire working area WA may be displayed as a colored band-like figure.
[0050] The terminal 30 updates the position and attitude of the icon and the position of the set travel line SL according to the change in the position information and the orientation information due to the movement of the combine harvester 1. Figures 9 and 10 are enlarged views of the figure displayed in the first area A1 during the movement to the start position. Figure 11 is an enlarged view of the figure displayed in the first area A1 after the movement to the start position. Figures 9 to 11 show how the display of the icon and the set travel line SL changes as the combine harvester 1 moves. As shown in the figure, the set travel line SL moves in parallel (translational movement) with the change in the position of the icon. On the other hand, even if the attitude of the icon changes, the attitude of the set travel line SL does not change, and the attitude parallel to the reference travel line BL is maintained. The operator manually steers the combine harvester 1 so that the end of the working area WA (in this example, the left end) coincides with the outer edge of the uncut land H0. The operator also manually steers the combine harvester 1 so that the orientation of the icon coincides with the set travel line SL.
[0051] Next, the terminal 30 determines whether the vehicle speed of the combine 1 is equal to or lower than a threshold value (step S03). If it is determined that the vehicle speed is not equal to or lower than the threshold value (step S03: NO), the terminal 30 repeats the processing from step S02 onward. On the other hand, if it is determined that the vehicle speed is equal to or lower than the threshold value (step S03: YES), the terminal 30 determines whether or not the automatic steering start condition is satisfied (step S04). Note that step S03 may be omitted.
[0052] The automatic steering start conditions are, first, that the deviation of the direction of the combine harvester 1 from the set travel line SL is within a permissible value, and, second, that the state of each part of the combine harvester 1 (travel part 2, reaping part 3, threshing part 4, sorting part 5, storage part 6, straw waste processing part 7, power part 8) is normal. The state of each part of the combine harvester 1 is determined by the detection results of sensors (not shown) installed in each part.
[0053] When it is determined that the automatic steering start condition is not satisfied (step S04: NO), the terminal 30 repeats the processing from step S02 onward. On the other hand, when it is determined that the automatic steering start condition is satisfied (step S04: YES), the terminal 30 changes the display of the setting screen (step S05). Specifically, the terminal 30 changes the color of the set travel line SL and the working area WA from before the automatic steering start condition is satisfied. For example, before the automatic steering start condition is satisfied, the set travel line SL and the working area WA may be displayed in blue, and after the automatic steering start condition is satisfied, the set travel line SL and the working area WA may be displayed in red. Alternatively, the brightness of the display may be different before and after the automatic steering start condition is satisfied. Alternatively, after the automatic steering start condition is satisfied, the set travel line SL and the working area WA may be blinking.
[0054] Next, the terminal 30 judges whether or not an operation to start work by automatic steering has been performed (step S06). FIG. 12A is a figure displayed in the first area A1 when the automatic reaping start condition is satisfied. FIG. 12B is a diagram showing the second area A2 when the automatic reaping start condition is satisfied. Specifically, the terminal 30 displays a message indicating that preparations for automatic reaping have been completed and asking whether or not to start automatic reaping, and a button B3 for starting automatic reaping. If the button B3 is not operated, the terminal 30 judges that an operation to start work by automatic steering has not been performed (step S06: NO), and repeats the processing from step S02 onwards. On the other hand, if the button B3 has been operated, the terminal 30 judges that an operation to start work by automatic steering has been performed (step S06: YES), and starts work by automatic steering, i.e., automatic reaping work (step S07).
[0055] Next, the terminal 30 judges whether or not an operation to stop the work by automatic steering has been performed (step S08). Specifically, the terminal 30 displays a stop button (not shown) on the display unit 64. If the stop button has not been operated (step S08: NO), the terminal 30 repeats the process of step S08. On the other hand, if the stop button has been operated (step S08: YES), the terminal 30 stops the work by automatic steering, switches to manual steering (step S09), and judges whether or not an operation to end the operation has been performed (step S10). If it is determined that an operation to end the operation has not been performed (step S10: NO), the terminal 30 repeats the processes from step S02 onwards. On the other hand, if it is determined that an operation to end the operation has been performed (step S10: YES), the terminal 30 ends the control of the combine harvester 1.
[0056] The combine harvester 1 according to the present embodiment described above includes a display control unit 75 that displays on the display unit 64 the outer edge of the unworked land indicated by the field information and the set travel line SL that is parallel to the reference travel line BL and has the vehicle's position indicated by the latest position information as a reference point. With this configuration, the set travel line SL displayed during driving by manual steering moves following the movement of the vehicle. For example, by moving the combine harvester 1 so as to shift the set travel line SL to the right from the outer edge of the unmowed land H0 by approximately half the width of the already-mowed land H1, the left end of the reaping unit 3 can be aligned with the outer edge of the unmowed land H0. Thus, the combine harvester 1 according to the present embodiment can easily set the set travel line SL that is parallel to the reference travel line BL.
[0057] In addition, in the combine harvester 1 according to the present embodiment, the display control unit 75 displays the set travel line SL and the working area WA differently depending on whether the conditions required for starting automatic steering are satisfied or not. With this configuration, it is possible to visually determine whether automatic steering can be started.
[0058] In the combine harvester 1 according to the present embodiment, the display control unit 75 displays the outer edge of the working area WA of the vehicle based on the set driving line SL. With this configuration, the start position of the automatic steering can be set while checking the positional relationship between the working area WA and the unworked land.
[0059] The above embodiment may be modified as follows.
[0060] [First Modification] The following process may be added to the above embodiment. In the first modification, the following process is executed after step S05 in the above embodiment. FIG. 13 is a flow chart of the process according to the first modification. Steps S21 and S22 are an example of a display control process. FIG. 14A is a figure displayed in the first area A1 of the setting screen according to the first modification. FIG. 14B is a diagram showing the second area A2 of the setting screen according to the first modification. Following step S05, the terminal 30 determines whether the edge of the working area WA is misaligned with respect to the edge of the uncut land H0 indicated by the field information (step S21). In the example of FIG. 14A, an example is shown in which the left edge of the working area WA is misaligned to the right. The terminal 30 calculates the distance between the edge (in this example, the left edge) of the working area WA that is closer to the edge of the uncut land H0 and the edge of the uncut land H0, and if the calculated distance is equal to or greater than a threshold value, it determines that the edge of the working area WA is misaligned.
[0061] If it is determined that the outer edge of the working area WA is misaligned (step S21: YES), the terminal 30 displays information indicating the misalignment of the working area WA (step S22) and proceeds to processing in step S06. In this example, a message indicating that the working area WA is misaligned is displayed as the information indicating the misalignment of the working area WA. On the other hand, if it is determined that the outer edge of the working area WA is not misaligned (step S21: NO), the terminal 30 proceeds to processing in step S06. Step S06 and subsequent steps are the same as in the above embodiment.
[0062] According to this modified example, after the conditions necessary to start automatic steering are met, if the outer edge of the working area WA deviates from the outer edge of the unworked land indicated by the field information, information indicating the deviation of the working area WA is displayed, making it easier to recognize the deviation of the working area WA.
[0063] In addition, according to this modified example, after the display control unit 75 displays information indicating the deviation of the working area WA, if the operation unit 63 receives an operation to allow driving by automatic steering, the vehicle is driven by automatic steering along the set driving line SL, so that if the worker determines that the deviation of the working area WA is acceptable, driving by automatic steering can be started.
[0064] [Second modified example] The following process may be added to the above embodiment. In the second modification, the following process is executed after step S02 in the above embodiment. FIG. 15 is a flow chart of the process according to the second modification. Steps S31 to S33 are an example of a display control process. FIGS. 16A and 17A are figures displayed in the first area A1 of the setting screen according to the second modification. FIGS. 16B and 17B are diagrams showing the second area A2 of the setting screen according to the second modification. Following step S02, the terminal 30 displays the recommended driving line RL (step S31). The recommended driving line RL corresponds to the set driving line SL when, for example, the outer edge of the uncut land H0 and the outer edge of the working area WA (in this example, the left outer edge) overlap each other.
[0065] Next, the terminal 30 determines whether the set travel line SL overlaps with the recommended travel line RL (step S32). In the example of FIG. 16A, the set travel line SL does not overlap with the recommended travel line RL. In this case, the terminal 30 determines that the set travel line SL does not overlap with the recommended travel line RL (step S32: NO) and repeats the process of step S32. On the other hand, in the example of FIG. 17A, the set travel line SL overlaps with the recommended travel line RL. In this case, the terminal 30 determines that the set travel line SL overlaps with the recommended travel line RL (step S32: YES) and displays a message that the host vehicle has reached the recommended travel line RL. Steps from S03 onwards are the same as those in the above embodiment.
[0066] According to this modified example, a recommended driving line RL calculated from the outer edge of the unworked area and the working area WA of the vehicle is displayed, and when the set driving line SL overlaps with the recommended driving line RL, a message is displayed indicating that the vehicle has reached the recommended driving line RL. Therefore, by bringing the set driving line SL close to the recommended driving line RL, the start position of automatic steering can be easily set.
[0067] [Third Modification] The following process may be added to the above embodiment. In the third modified example, the following process is executed after step S07 in the above embodiment. FIG. 18 is a flow chart of the process according to the third modified example. Steps S41 to S46 are an example of a correction process. FIG. 19A is a figure displayed in the first area A1 of the setting screen according to the third modified example. FIG. 19B is a diagram showing the second area A2 of the setting screen according to the third modified example. Following step S07, the terminal 30 determines whether or not a path offset instruction has been received by the reception unit (step S41). Bus offset is a process of shifting the set driving line SL in parallel by a predetermined distance during driving by automatic steering (see FIG. 19A). If the bus offset instruction has not been received (step S41: NO), the terminal 30 proceeds to the process of step S08. On the other hand, if the bus offset instruction has been received (step S41: YES), the terminal 30 sends an instruction to the control device 45 to drive by shifting the set driving line SL in parallel by a predetermined distance (step S42).
[0068] Next, the terminal 30 judges whether or not an operation to stop the work by automatic steering has been performed (step S43). Specifically, the terminal 30 displays a stop button (not shown) on the display unit 64. If the stop button has not been operated (step S43: NO), the terminal 30 repeats the processing from step S41 onwards. On the other hand, if the stop button has been operated (step S43: YES), the terminal 30 stops the work, switches to manual steering (step S44), and judges whether or not an operation to correct the reference driving line BL has been performed (step S45). Specifically, a message asking whether or not to correct the reference driving line BL and a button B4 for correcting the reference driving line BL are displayed (see FIG. 19B). If the button B4 has not been operated, the terminal 30 judges that an operation to correct the reference driving line BL has not been performed (step S45: NO), and proceeds to the processing of step S10. On the other hand, when the button B4 is operated, the terminal 30 determines that an operation to correct the reference driving line BL has been performed (step S45: YES), corrects the direction of the reference driving line BL so that it is parallel to the straight line CL connecting the start point and end point of the previous driving by automatic steering (step S46), and proceeds to the processing of step S10. Note that the processing of step S45 may be omitted.
[0069] According to this modified example, when the position of the vehicle is changed in a direction intersecting the set driving line SL while driving under automatic steering, a correction unit 76 is provided which corrects the direction of the reference driving line BL so that it is parallel to a straight line CL connecting the start point and end point of driving under automatic steering, so that the direction of the reference driving line BL can be easily corrected.
[0070] In the above embodiment, an example is shown in which the working area WA is displayed in addition to the set driving line SL, but only the set driving line SL may be displayed, or the working area WA may be displayed instead of the set driving line SL.
[0071] In the first modified example, when the working area WA is misaligned, a message is displayed to inform the user that the working area WA is misaligned. In addition, the amount of misalignment of the working area WA may be displayed. This configuration makes it easier to correct the misalignment of the working area WA.
[0072] In the second modified example, an example was shown in which the set travel line SL and the recommended travel line RL were displayed, but in addition to this, the deviation amount between the set travel line SL and the recommended travel line RL may be displayed. With this configuration, the task of superimposing the set travel line SL on the recommended travel line RL becomes easy.
[0073] In the above embodiment, an example in which the present invention is applied to the combine harvester 1 has been shown, but the present invention may also be applied to a work vehicle other than the combine harvester 1, for example, a rice transplanter, a cultivator, or the like. [Explanation of symbols]
[0074] 1. Combine Harvester 45 Control device (driving control unit) 63 Operation section 64 Display section 71 Reference driving line acquisition unit 72 Location information acquisition unit 74 Farm Information Acquisition Department 75 Display control section 76 Correction section BL Reference Running Line SL set driving line WA Work Area RL Recommended driving line CL A straight line connecting the start and end points of driving under automatic steering
Claims
1. a reference driving line acquisition unit that acquires a reference driving line that indicates a direction of driving by automatic steering; a position information acquisition unit that repeatedly acquires position information indicating a position of the vehicle; a display control unit that, after acquiring the reference driving line, displays on a display unit a set driving line that is parallel to the reference driving line and passes through a reference point that is set based on the position of the vehicle indicated by the latest position information during driving by manual steering, and moves the set driving line in parallel to the movement of the vehicle; An automatic steering system comprising: a driving control unit that drives a vehicle by automatic steering along the set driving line, the position of which is set based on an operation of switching from manual steering to automatic steering.
2. The automatic steering system according to claim 1, characterized in that the display control unit changes the display of the set driving line depending on whether a condition necessary for starting automatic steering is satisfied or not.
3. 3. The automatic steering system according to claim 1, wherein the display control unit displays an outer edge of a working area of the host vehicle based on the set driving line before starting automatic steering.
4. The automatic steering system according to any one of claims 1 to 3, characterized in that it is provided with a correction unit that corrects the direction of the reference driving line so that it is parallel to a straight line connecting the start point and end point of driving by automatic steering when the position of the vehicle is changed in a direction intersecting the set driving line while driving by automatic steering.
5. an information acquisition step of acquiring a reference driving line indicating a direction of driving by automatic steering and repeatedly acquiring position information indicating a position of the vehicle; a display control process for displaying a set driving line that is parallel to the reference driving line and passes through a reference point that is set based on the position of the vehicle indicated by the latest position information on the vehicle during driving by manual steering after acquiring the reference driving line, and for moving the set driving line in parallel to the movement of the vehicle; and a driving control process for driving the vehicle by automatic steering along the set driving line, the position of which is set based on an operation of switching from manual steering to automatic steering.
Citation Information
Patent Citations
Agricultural implement
JP2017123803A
Work vehicle support system
JP2019136039A
Working vehicle cooperation system
JP2019141103A
Work vehicle
JP2019198244A
Work vehicle
JP2020000020A