Agricultural harvesting machine monitoring

Abstract

Systems and methods for monitoring the operation of an agricultural harvesting machine, comprising utilising an event based sensor mounted or otherwise associated with the agricultural harvesting machine to determine crop material parameter(s), e.g. length, straightness, etc. of crop material spread by a spreader tool of the machine. Operation of one or more operable components of the agricultural harvesting machine may be controlled in dependence on the determined crop material parameter(s), e.g. to improve material quality.

Description

TITLEAGRICULTURAL HARVESTING MACHINE MONITORINGCROSS-REFERENCE TO RELATED APPLICATIONS

[0001] Not applicable.FIELD

[0002] Embodiments of the present disclosure relate generally to systems and methods for monitoring operation of an agricultural harvesting machine, such as a combine harvester.BACKGROUND

[0003] Agricultural harvesters such as combine harvesters, or "combines", work to cut crop material from a field before separating the grain from the material other than grain (MOG) (referred to interchangeably as "residue") on board. Generally, the grain is transferred to a grain bin of the combine (where it may be temporarily stored) and the MOG is deposited back onto the field. A second operation may be performed to gather the deposited MOG, or the MOG may be used as a fertilizer for the soil in the field.

[0004] Where the MOG includes straw specifically, e.g. when harvesting grain (wheat, barley, etc.), the straw is usually discharged onto the field at the rear end of the combine, either in the form of a swath to be later taken up by a baler for further processing, or in chopped form over the width of the cutting path. The straw can be damaged during the threshing and separating process, and the extent of this damage largely depends on operational conditions of the combine, in addition to the properties of the crop itself. It is therefore important to consider the operational conditions of the combine when harvesting and its effect on the MOG, and specifically the straw quality.

[0005] It is therefore an aim of an embodiment or embodiments of the system to provide systems and methods to monitor properties of the crop material, e.g. straw, deposited by a spreader tool of a harvesting machine.BRIEF SUMMARY

[0006] In an aspect of the invention there is provided a system for monitoring the operation of an agricultural harvesting machine, the system comprising: an event based sensor; and one or more controllers, configured to receive sensor data from the event based sensor indicative of a measure of material present within a material flow from a spreader tool of the agricultural harvesting machine; analyse the sensor data to: identify one or more crop material components within the material flow; and determine a crop material parameter for the identified crop material component(s); and output one or more control signals for controlling operation of one or more operable components of or otherwise associated with the agricultural harvesting machine in dependence on the determined crop material parameter.

[0007] Advantageously, the present disclosure utilises an event based sensor for monitoring operation of the harvesting machine, and in particular identifying individual crop material pieces in the material deposited by the machine. The functionality of an event based sensor is particularly suited to such a use case as the data obtained therefrom can be used to accurately identify individual crop components as they move through a sensing region of the event based sensor. Parameters of the crop material components can then be determined, once identified in the sensor data, and used to infer a measure of, for example, a quality of the crop material components and hence the operation of operable components of the harvesting machine and their effect on the crop material quality.

[0008] When used herein and throughout the term "event based sensor" is intended to include a sensor having multiple individual sensing elements or pixels which are individually triggerable in dependence on one or more variations in the signal output associated with those elements. The one or more variations result from a change in the light incident on said sensing elements, resulting in a change in amplitude in the output signal of those sensing elements. By setting relevant thresholds for said variations, "events" can be triggered in dependence on a given change in incident light on said sensing elements. Such a change may indicate movement in the observed environment, for example. Such sensor types may also be referred to as a neuromorphic camera, a silicon retina or dynamic vision sensor.

[0009] When used herein and throughout the term "spreader tool" is intended to cover multiple different spreader tool types, including rotor based spreaders for distributing residue material over a desired distance, but also tools (e.g. tailboards) for distributing straw or other crop material in a swath or the like behind the machine.

[0010] The one or more controllers may be configured to apply a clustering process to the sensor data. The clustering process may be applied to the sensor data to identify and associate triggers at multiple sensing elements of the event based sensor. The one or more controllers may be configured to identify one or more material components in dependence on the associated sensing element triggers. This may, for example, include associating sensing element triggers which occur substantially simultaneously, and / or for sensing elements which trigger which are proximal to one another. For instance, the clustering process may comprise a timewise and / or location based clustering process to identify and associate the sensing elements triggered by a common material component.

[0011] The one or more controllers may be configured to determine a measure of a length associated with an identified material component. This may, for instance, comprise a count of the number of adjacent and associated sensing elements for a given material component. This may comprise a calculated distance, within the sensor data, between two or more associated sensing elements. The one or more controllers may be configured to compare the determined length with a threshold length. The threshold length may comprise a predetermined threshold length, which may be programmable, for example, to distinguish between different material component types in the monitored material flow. The one or more controllers may be configured to categorize the identified material component as a crop material component in dependence on the comparison of the determined length measure with the threshold length. In embodiments, the one or more controllers may be configured to categorize the identified material component as a straw material component in dependence on the determined length measure exceeding a predetermined straw threshold length.

[0012] The crop material parameter may comprise a measure of the length of the identified crop material component(s). The length of the identified crop material component(s) may advantageously provide an indication of an operational condition or function of, e.g. achopper tool, of the harvesting machine. The one or more controllers are configured to utilise a spatial relationship between the event based sensor and a spreading area of the spreader tool to obtain a measure of length for the crop material component which comprises an absolute measure of its length. In other embodiments, the system comprises a distance sensor and the one or more controllers may be configured to utilise distance data from the distance sensor and a length determined from the sensor data from the event based sensor to determine an absolute measure of the length of the crop material component. The distance sensor may comprise a transceiver type sensor, e.g. a LIDAR sensor, or a stereo based vision system configured for providing distance data for objects within the sensing region of the event based sensor.

[0013] The crop material parameter may comprise a measure of a relative length associated with the identified crop material component(s). The relative length may comprise a length measure comparable with an expected or average length measure determined across multiple identified crop material components. In this way, a uniformity of the crop material components can be quantified, again being indicative of an operating condition or function of the crop processing components, and specifically the chopper tool, of the agricultural harvesting machine.

[0014] The crop material parameter may comprise a measure of a shape or structure of the identified crop material component(s). The measure of a shape or structure of the component(s) may include quantifying a straightness of the identified crop material component(s). This can include a count of a number of bends or folds in the identified crop material component(s).

[0015] The crop material parameter may comprise a measure of a speed associated with the identified crop material component(s).

[0016] The one or more controllers may be configured to compare the determined crop material parameter with an expected crop material parameter. The expected crop material parameter may be dependent on one or more controllable operating conditions of a crop processing component of the agricultural harvesting machine. For instance, an expected speed of the crop material components may be dependent on an operating speed of crop processing apparatus of the harvesting machine. An expected length may be dependent on the operatingstatus of a chopper tool of the harvesting machine. The one or more controllers may be configured to generate and output the control signal for controlling the operable component(s) in dependence on the comparison.

[0017] The one or more controllers may be configured to control application of a filter to the output signals from individual sensing elements of the event based sensor, e.g. to remove triggers thereof due to background motion. For example, this may be due to the relative movement of the ground causing changes in the light incident on the sensing elements as the machine performs a task, or due to structural vibration and / or component motion during said tasks. Advantageously, applying one or more filters to the analogue output signal from the sensing elements may control the number of individual triggers to be processed by the event based sensor and / or one or more processing units associated therewith.

[0018] Additionally or alternatively, the one or more controllers may be configured to apply a filter to the sensor data. Where the processing capabilities of the controllers is high enough it may be possible to receive all triggers and apply said filter(s) digitally to remove or discard unwanted triggers.

[0019] The filter may comprise a threshold for a signal parameter associated with the sensing elements, which may include amplitude or rate of change of amplitude of the output signal. The threshold may be definable and / or be dependent on the agricultural task (to be) performed by the agricultural machine.

[0020] The filter may be dependent on a ground speed of the agricultural harvesting machine and / or an operational speed of one or more components of or associated with the machine.

[0021] The filter may comprise a mask applied to a sensing region of the sensor, e.g. to exclude regions of the sensing region which do not correspond to the spreader tool and / or a material flow associated therewith.

[0022] The one or more operable components of or otherwise associated with the agricultural harvesting machine may include a user interface. The one or more controllers may be configured to control output of an indicator indicative of the determined crop material parameter(s) via the user interface.

[0023] The user interface may comprise a display screen, which may be provided as part of a user terminal of the machine, e.g. in an operator cab of the machine. Additionally or alternatively, the user interface may be provided by a portable user device, e.g. one carried by a user / operator during operation of the machine. The portable user device may comprise a smartphone, tablet computer, laptop or the like.

[0024] The one or more controllers may be configured to control a forward speed of the agricultural harvesting machine in dependence on the determined crop material parameter(s). Advantageously, the forward speed of the machine may be utilised to control the feed speed of material into / through the agricultural harvesting machine, in turn controlling a load on the crop processing components thereof.

[0025] In embodiments, the component(s) of the agricultural harvesting machine may comprise a header for the machine. The one or more controllers may be configured for controlling an operational speed of elements of the header, a lift mechanism for the header for controlling an operational position or height of the header, and / or an operational state of the header in dependence on the crop material parameter(s).

[0026] In embodiments the component(s) of the agricultural harvesting machine may comprise a crop processing apparatus of the machine. The one or more controllers may be configured to adjust an operational speed of components of the crop processing apparatus to control the speed at which crop material is processed and moved through the agricultural harvesting machine in dependence on the crop material parameter(s).

[0027] The crop processing apparatus may include a chopper tool. The one or more controllers may be configured to control operation of the chopper tool in dependence on the crop material parameter(s), e.g. to adjust a cutting length of the crop material passing therethrough.

[0028] The event based sensor may be mounted or be mountable on the machine. For example, the sensor may be mounted or be mountable on the rear of the machine, or on an unloading auger of the machine, for example.

[0029] The one or more controllers may collectively comprise an input (e.g. an electronic input) for receiving one or more input signals. The one or more input signals maycomprise sensor data from the event based sensor. The one or more controllers may collectively comprise one or more processors (e.g. electronic processors) operable to execute computer readable instructions for controlling operational of the control system, for example, identify the crop material component(s) and / or determine the crop material parameter(s). The one or more processors may be operable to generate one or more control signals for controlling operation of the one or more operable components. The one or more controllers may collectively comprise an output (e.g. an electronic output) for outputting the one or more control signals.

[0030] A further aspect provides an agricultural machine comprising the system as described hereinabove. The agricultural machine may comprise a harvesting machine, such as a combine harvester.

[0031] A further aspect provides a method of monitoring the operation of an agricultural harvesting machine, comprising: receiving sensor data from an event based sensor mounted or otherwise associated with the agricultural harvesting machine, the sensor data being indicative of a measure of material present within a material flow from a spreader tool of the agricultural harvesting machine; analysing the sensor data to: identify one or more crop material components within the material flow; and determine a crop material parameter for the identified crop material component(s); and controlling operation of one or more operable components of the agricultural harvesting machine in dependence on the determined crop material parameter.

[0032] The method may comprise performing any one or more of the functionalities of the one or more controllers of the system described hereinabove.

[0033] A further aspect of the invention provides computer software comprising computer readable instructions which, when executed by one or more electronic processors, causes performance of a method in accordance with any aspect described herein.

[0034] A yet further aspect of the invention provides a computer readable medium having the computer software of the preceding aspect of the invention stored thereon.

[0035] Within the scope of this application it should be understood that the various aspects, embodiments, examples and alternatives set out herein, and individual features thereof may be taken independently or in any possible and compatible combination. Where features are described with reference to a single aspect or embodiment, it should be understood that suchfeatures are applicable to all aspects and embodiments unless otherwise stated or where such features are incompatible.BRIEF DESCRIPTION OF THE DRAWINGS

[0036] One or more embodiments of the invention / disclosure will now be described, by way of example only, with reference to the accompanying drawings, in which:

[0037] FIG. 1 is a schematic side cross-sectional view of an agricultural harvester embodying aspects of the present disclosure;

[0038] FIG. 2 is a schematic view of an embodiment of a system of the present disclosure;

[0039] FIG. 3 illustrates sensor data obtained by a sensing arrangement forming part of aspects of the present disclosure; and

[0040] FIG. 4 is an image of residue material obtained utilising a camera illustrating the operational use of embodiments discussed herein.DETAILED DESCRIPTION

[0041] The present disclosure relates to systems and methods for monitoring the operation of an agricultural harvesting machine, here a harvester 10. An event based sensor 30 is utilised to obtained sensor data which is indicative of a measure of material present within a material flow from a spreader tool 22 of the harvester 10. Controller(s) 102 is configured to analyse the sensor data to identify one or more crop material components, e.g. straw, within the material flow, and determine a crop material parameter for the identified crop material component(s). As discussed herein, this may include a parameter indicative of material quality, from which an operational efficiency or effectiveness of crop processing apparatus of the harvester 10 may be inferred. Operation of one or more operable components of or otherwise associated with the harvester 10 (e.g. a user interface 32 or components of the spreader tool 22, for instance) can be controlled based on determined parameters, in the manner discussed herein.Harvester

[0042] With reference to FIG. 1, an agricultural machine in the form of a harvester 10 is shown which embodies aspects of the present disclosure.

[0043] The harvester 10 is coupled to a header 12 which is operable, in use, to cut and gather a strip of crop material as the harvester 10 is driven across a field / area to be harvested during a harvesting operation. A conveyor section 14 conveys the cut crop material from the header 12 into a crop processing apparatus 16 operable to separate grain and non-grain (i.e. material other than grain (MOG) or residue material (used interchangeably herein)) as will be appreciated. It is noted here that apparatus for separating grain and non-grain material are well- known in the art and the present invention is not limited in this sense. The skilled person will appreciate that numerous different configurations for the crop processing apparatus may be used as appropriate. Clean grain separated from the cut crop material is collected in a grain bin 18, which may be periodically emptied, e.g. into a collection vehicle, storage container, etc. utilising unloading auger 20. The remaining non-grain material (MOG) / residue material is separately moved to a spreader tool 22 which is operable in use to eject the non-grain material or MOG from the rear of the harvester 10 and onto the ground. In Figure 1, this is represented by arrow 24 which illustrates the MOG being ejected rearwards from the harvester 10. The harvester 10 also includes a chopper tool 25 positioned between the crop processing apparatus 16 and the spreader tool 22 and operable, in use, to cut the residue material before it is spread by the spreader tool 22.

[0044] The harvester 10 also typically includes, amongst other features, an operator cab 26, wheels 28, engine (not shown) and a user interface in the form of a display terminal 32 provided within the operator cab 26.Event Based Sensor

[0045] As will be discussed in detail herein, the harvester 10 additionally includes a sensor in the form of an event based sensor 30. The sensor 30 is mounted to a rear of the harvester 10 in the illustrated embodiment, and has a field of view which encompasses an operating region of the spreader tool 22, specifically here the region of the working environment directly behind the harvester 10 into which material is spread by the spreader tool 22. Event based sensor 30 is used, by a control system 101 of the harvester 10, to identify materialcomponents in a material flow associated with the spreader tool 22 in the manner discussed herein.

[0046] Event based sensor 30 has multiple individual sensing elements (pixels) which are individually triggerable in dependence on one or more variations in the signal output associated with those elements. The one or more variations result from a change in the light incident on said sensing elements, resulting in a change in amplitude in the output signal of those sensing elements. By setting relevant thresholds for said variations, "events" can be triggered in dependence on a given change in incident light on said sensing elements. The variations can be used as an indication of movement in the observed environment, for example, by monitoring successive triggers of adjacent sensing elements, and inferring movement in the observed scene based thereon. In further arrangements the overall sensor output for a given time period may be used - e.g. forming of a histogram or heat map of triggers - to obtain a measure of an overview of a given process - e.g. shape / size of flowpath or material distribution, etc.

[0047] Operation of the event based sensor 30 may be controlled based on the given scenario. For instance a filter may be applied to the sensing elements to control at what magnitude of change / variation said sensing elements are triggered. This may be utilised to remove background events from the data. For instance, in the presently illustrated embodiment using the sensor 30 on the harvester 10 during a harvesting operation, motion of the ground with respect to the harvester 10 may otherwise trigger the sensing elements. Accordingly, a filter can be applied based on the ground speed of the harvester 10 to reduce or eliminate false triggers thereof. In alternative arrangements, the operational speed of the components of the harvester 10, e.g. a rotational speed of elements of the spreader tool 22, may be used to determine the filter to be applied to the sensor data to remove cyclical or repetitive motion from the scene - e.g. in order to identify anomalies or changes in that motion indicative of an operational issue.

[0048] In the present case, a clustering process may be applied to the sensor data. This clustering may be a timewise and / or location based clustering to identify triggers at multiple sensing elements which correlate to the same physical observation. For instance, data may be clustered timewise to identify (and optionally track movement of) individual material components (e.g. pieces of straw or other crop material) in the sensor data. In further examples,clustering may be applied in dependence on a determined flow velocity of material (e.g. as determined through application of an optical flow measurement of the sensor data) which may be used to indicate regions within the field of view of the sensor where material may be travelling at different speeds to other regions or compared with an expected flow parameter. Regions within the sensing area where no triggers are seen (in areas where they would be expected) may be indicative of a plugging of material or other fault preventing material flow in that region.System

[0049] FIG. 2 illustrates system 101 further. As shown, the system incorporates a control system 100 here having a single controller 102. The controller 102 includes an electronic processor 104, an electronic input 106 and electronic outputs 108, 110, 114. The processor 104 is operable to access a memory 112 of the controller 102 and execute instructions stored therein to perform the steps and functionality of the present invention, for example to output control signals 109, 111, 115 via the outputs 108, 110, 114 for controlling operation of operable components of the machine, including the chopper tool 25, for updating data stored on a remote server 34, e.g. a mapped representation of the crop parameter(s), or for controlling the display terminal 32, for example to provide an graphical indication to an operator of the harvester 10 illustrative of the determined crop parameter(s).

[0050] The processor 104 is operable to receive sensor data via input 106 which, in the illustrated embodiment, takes the form of input signals 105 received from the event based sensor 30. As described in detail herein, the event based sensor 30 has a sensing region rearward of the harvester 10, with the sensor data received from the sensor 30 being indicative of a measure of crop material present within the sensing region. Using this information, the processor 104 is operable to identify one or more crop material components within the material flow from the spreader tool 22. This may include application of a filter to the sensor data, and / or performance of a clustering process to extract data relating to individual crop material pieces from background data. As discussed herein, a filter may be applied to the sensing elements to control at what magnitude of change / variation said sensing elements are triggered. This may be utilised to remove background events from the data. For instance, in the presently illustrated embodiment using the sensor 30 on the harvester 10 during a harvesting operation, motion of the ground withrespect to the harvester 10 may otherwise trigger the sensing elements. Accordingly, a filter can be applied based on the ground speed of the harvester 10 to reduce or eliminate false triggers thereof. In alternative arrangements, the operational speed of the components of the harvester 10, e.g. a rotational speed of elements of the spreader tool 22, may be used to determine the filter to be applied to the sensor data set a trigger threshold which is related to an expected flow velocity for the crop material components.

[0051] A clustering process can be applied to the sensor data to identify sensing element triggers which relate to common crop material components. This clustering may be a timewise and / or location based clustering. For instance, data may be clustered timewise to identify (and preferably track movement of) individual material components (e.g. pieces of straw or other crop material) in the sensor data. Clustering may be applied in dependence on a determined flow velocity of material (e.g. as determined through application of an optical flow measurement of the sensor data) which may be used to indicate regions within the field of view of the sensor indicative of crop material being spread by the harvester 10.

[0052] For each of the identified crop material components, the processor 104 determines a crop material parameter in the manner described herein. Specifically, the processor 104 is analyse the sensor data received from the event based sensor 30 to determine crop material parameters which may include a measure of the length for one or multiple crop material components, e.g. looking for a uniformity of length of crop material components. The crop material parameters may include a measure of a shape and / or structure of the crop material components, optionally including a measure of the "straightness" of the crop material component, and / or a speed or trajectory of the crop material components as determined through an optical flow analysis of the sensor data for identified crop material components.

[0053] Advantageously, the sensor data can be used to determine a quality parameter for the crop material indicative of the operational effectiveness or efficiency of crop processing components of the harvester 10. For instance, a substantially consistent length of cut of the crop material components may be indicative of an acceptable operation of a chopper tool 25 of the harvester 10, that being providing chopped crop material with a consistent length for, e.g. a later baling process. Where the length of the identified crop material varies significantly, this could beindicative of a fault with the chopper tool, for example. A shape or structure of the crop material component may indicate a level of processing of the crop material by the harvester 10. A material piece having multiple bends, kinks etc. may indicate an over working of the crop material component by the machine which could be detrimental depending on what that crop material is to be used for. The speed, flow characteristics, etc. advantageously provide information relating to the location in the working environment where the material is spread. This in turn can be used to generate a measure of parameters relating to, e.g. a formed swath. In advantageous embodiments where the crop material is discharged by the spreader tool 22 to form a swath, the crop material parameter may be utilised to calculate a swath quality parameter which can be used, for example, to map the quality of the swath across an environment which may feed into subsequent operational planning.

[0054] Output 108 is operably coupled to chopper tool 25, or more specifically a local control unit for chopper tool 25. The control system 101 is operable to control operation of the chopper tool 25 in dependence on the determined crop material parameter(s), determined in the manner discussed herein. For instance, where the crop material parameter relates to a length of cut, or more specifically a measure of the uniformity of, or average length of cut for multiple crop material components, the control system may control, through generation and output of control signals 109, the chopper tool 25 to, for example, adjust an operational speed or frequency thereof to adjust a target cutting length for the crop material.

[0055] Output 110 is operably coupled to the display terminal 32 of the harvester 10. Here, the control system 101 is operable to control operation of the display terminal 32, e.g. through output of control signals 111 in order to display operational data to an operator of the harvester 10 relating to the operation of the control system 101. Specifically, the control system 101 may be operable to control the display terminal 32 to display to the operator a graphical representation of the crop material parameter(s) as determined by processor 104, sensor data from the event based sensor 30, image data obtained from a camera on the harvester 10, or other useful information. In some variants, the display terminal 32 may also be operable to receive a user input from the operator, and in such instances the output 110 may act as an input for receiving that user input at the processor 104. The user input may relate to a requested ortarget parameter, for example a desired length of cut for the crop material components, made by the operator of the harvester 10.

[0056] Output 114 is operably coupled to a database hosted on remote or cloud server 34. Here, the output 114 forms a communication module for communicating data offboard from the harvester 10. Alternatively, output 114 may utilise a communication module of the harvester 10 and may be operably connected to server 34 indirectly thereby. The control system 101 may utilise server 34 to store data relating to the determined crop material parameter(s), e.g. for later retrieval for operational planning of subsequent operations, e.g. a baling operation. In embodiments the control system 101 may be operably connected to a positioning module of the harvester 10, and the location of the harvester 10 within the environment may be linked to determined crop material parameters to generate a mapped environment containing data indicative of, e.g. a crop material quality across the environment.

[0057] In further examples, the control system 101 may be operable to control further operational components of the harvester. For instance, the control system 101 may be operably coupled to the spreader tool 22 for controlling operation thereof, e.g. where it is determined from the crop material parameters that an adjustment in the spread or distribution pattern provided by the tool 22 needs adjusting. The control system 101 may be operably coupled to crop processing apparatus 16 of the harvester 10, for adjusting a degree of processing applied to the crop material as it passes through the harvester 10. This may be performed, in dependence on crop material parameters relating to the shape or structure of the identified crop material components.Sensor Data

[0058] To be FIG. 3 illustrates a representation of sensor data obtained during operation of the harvester 10. Here, "triggered" sensing elements of the event based sensor 30 are shown indicative of movement in the region of the environment corresponding to the relevant pixel in the displayed sensor data. FIG. 4 illustrates a similar scene utilising a camera based system with residue material shown being spread behind the rear of a harvester 10. This is inherently noisy and near impossible to identify individual crop components from the image data alone.

[0059] As shown, through suitable processing of the sensor data via filters and the like, only those triggers in response to movement of crop material within the observed region is present in the generated representation. This removes background noise / triggers from the data enabling further features to be extracted from the data, including the crop material parameter(s) discussed herein.

[0060] In FIG. 3, a crop material component, C is highlighted. In the sensor data, this is represented as a substantially straight line of adjacent triggered sensing elements. From this, a crop material parameter in the form of a measure of the length of the identified material component can be computed. This can be a count of the number of adjacent sensing elements triggered determined to correspond to the crop material component. In an extension of this, a further sensing capability may be introduced with suitable data fusion thereof to obtain a measure of the distance of the crop material component from the event based sensor 30, this distance being used to compute an absolute length of the crop material component. The additional sensing capability may include a transceiver based system, such as LIDAR, for instance. As discussed, a relative length measure may be calculated, relating to the length of the identified crop material components across the sensor data, which may provide information relating to the uniformity of cut of the material by the chopper tool 25.

[0061] In a further variant, a crop material parameter in the form of a measure of the shape or structure of the crop material component may be computed. This may, for example, quantify a number of bends or kinks in a given material component. As discussed herein, this may be indicative of a level of crop processing provided by the harvester 10, and suitable control actions may be taken dependent thereon.

[0062] In a further variant, an optical flow analysis may be performed on the sensor data, from which it may be possible to extract flow parameters for any given identified crop material component, including a speed, direction or even mass of the material component (based on speed and length of the relevant component. The flow parameters may provide information relating to the trajectory of a crop material component, including thereby information relating to a resting location for any given material component in the working environment. This may be particularly beneficial to determine whether material discharged by the spreader tool 22 isforming a distribution, e.g. full spread pattern or swath operation, with desired characteristics, e.g. width and / or profile. Information on the resting location for given material components may also be linked to the mapped dataset stored at server 34.General

[0063] Any process descriptions or blocks in flow diagrams should be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps in the process, and alternate implementations are included within the scope of the embodiments in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present disclosure.

[0064] It will be appreciated that embodiments of the present invention can be realized in the form of hardware, software or a combination of hardware and software. Any such software may be stored in the form of volatile or non-volatile storage such as, for example, a storage device like a ROM, whether erasable or rewritable or not, or in the form of memory such as, for example, RAM, memory chips, device or integrated circuits or on an optically or magnetically readable medium such as, for example, a CD, DVD, magnetic disk or magnetic tape. It will be appreciated that the storage devices and storage media are embodiments of machine-readable storage that are suitable for storing a program or programs that, when executed, implement embodiments of the present invention. Accordingly, embodiments provide a program comprising code for implementing a system or method as set out herein and a machine readable storage storing such a program. Still further, embodiments of the present invention may be conveyed electronically via any medium such as a communication signal carried over a wired or wireless connection and embodiments suitably encompass the same.

[0065] All references cited herein are incorporated herein in their entireties. If there is a conflict between definitions herein and in an incorporated reference, the definition herein shall control.

Claims

CLAIMSWhat is claimed is:

1. A system for monitoring the operation of an agricultural harvesting machine, the system comprising: an event based sensor; and one or more controllers, configured to: receive sensor data from the event based sensor indicative of a measure of material present within a material flow from a spreader tool of the agricultural harvesting machine; analyse the sensor data to: identify one or more crop material components within the material flow; and determine a crop material parameter for the identified crop material component(s); and output one or more control signals for controlling operation of one or more operable components of or otherwise associated with the agricultural harvesting machine in dependence on the determined crop material parameter.

2. A system as claimed in claim 1, wherein the one or more controllers are configured to: apply a clustering process to the sensor data to identify and associate triggers at multiple sensing elements of the event based sensor; andidentify one or more material components in dependence on the associated sensing element triggers.

3. A system as claimed in claim 2, wherein the clustering process comprises a timewise and / or location based clustering process to identify and associate the sensing elements triggered by a common material component.

4. A system as claimed in claim 2 or claim 3, wherein the one or more controllers are configured to: determine a measure of a length associated with an identified material component; compare the determined length with a threshold length; and categorize the identified material component as a crop material component in dependence on the comparison.

5. A system as claimed in claim 4, wherein the one or more controllers are configured to categorize the identified material component as a straw material component in dependence on the determined length measure exceeding a predetermined straw threshold length.

6. A system as claimed in any preceding claim, wherein the crop material parameter comprises a measure of the length of the identified crop material component(s).

7. A system as claimed in claim 6, wherein the one or more controllers are configured to utilise a spatial relationship between the event based sensor and a spreading area of the spreader tool to obtain a measure of length for the crop material component which comprises an absolute measure of its length.

8. A system as claimed in claim 6, comprising a distance sensor; and wherein the one or more controllers are configured to utilise distance data from the distancesensor and a length determined from the sensor data from the event based sensor to determine an absolute measure of the length of the crop material component.

9. A system as claimed in claim 6, wherein the crop material parameter comprises a measure of a relative length associated with the crop material component(s); the relative length comprising a length measure comparable with an expected or average length measure determined across multiple identified crop material components.

10. A system of any preceding claim, wherein the crop material parameter comprises a measure of a shape or structure of the identified crop material component(s).

11. A system of claim 10, wherein the measure of a shape or structure of the component(s) comprises quantifying a straightness of the identified crop material component(s).

12. A system of any preceding claim, wherein the crop material parameter comprises a measure of a speed associated with the identified crop material component(s).

13. A system of any preceding claim, wherein the one or more controllers are configured to: compare the determined crop material parameter with an expected crop material parameter, the expected parameter being dependent on one or more controllable operating conditions of a crop processing component of the agricultural harvesting machine; and generate and output the control signal for controlling the operable component(s) in dependence on the comparison.

14. A system of any preceding claim configured to control application of a filter to the output signals from individual sensing elements of the event based sensor to remove triggers thereof due to background motion; optionally wherein the filteris dependent on a ground speed of the agricultural harvesting machine and / or an operational speed of one or more components of or associated with the machine.

15. A system of any preceding claim, wherein the one or more operable components of or otherwise associated with the agricultural harvesting machine includes a user interface; and wherein the one or more controllers are configured to control output of an indicator indicative of the determined crop material parameter(s) via the user interface.

16. A system of any preceding claim, wherein the one or more controllers are configured to control a forward speed of the agricultural harvesting machine in dependence on the determined crop material parameter(s).

17. A system of any preceding claim, wherein the component(s) of the agricultural harvesting machine comprises a header for the machine, and wherein the one or more controllers are configured for controlling an operational speed of elements of the header, a lift mechanism for the header for controlling an operational position or height of the header, and / or an operational state of the header in dependence on the crop material parameter(s).

18. A system of any preceding claim, wherein the component(s) of the agricultural harvesting machine comprises a crop processing apparatus of the machine, and wherein the one or more controllers are configured to adjust an operational speed of components of the crop processing apparatus to control the speed at which crop material is processed and moved through the agricultural harvesting machine in dependence on the crop material parameter(s).

19. A system of claim 18, wherein the crop processing apparatus comprises a chopper tool, and the one or more controllers are configured to control operation of the chopper tool in dependence on the crop material parameter(s).

20. An agricultural machine comprising the system of any preceding claim.

1. A method of monitoring the operation of an agricultural harvesting machine, comprising: receiving sensor data from an event based sensor mounted or otherwise associated with the agricultural harvesting machine, the sensor data being indicative of a measure of material present within a material flow from a spreader tool of the agricultural harvesting machine; analysing the sensor data to: identify one or more crop material components within the material flow; and determine a crop material parameter for the identified crop material component(s); and controlling operation of one or more operable components of the agricultural harvesting machine in dependence on the determined crop material parameter.

Images