METHOD FOR OBSERVING A WORK PROCESS OF AN AGRICULTURAL MACHINE, DIGITAL VIDEO SYSTEM, AND AGRICULTURAL MACHINE

The digital video system for agricultural machinery enables flexible, real-time monitoring and remote access by configuring multiple image playback areas and wireless transmission, addressing inefficiencies in existing systems and enhancing operational efficiency and safety.

JP7597746B2Active Publication Date: 2024-12-10GRIMME LANDMASCHINENFABRIK SE& CO KG
View PDF 17 Cites 0 Cited by

Patent Information

Application Number
JP2021576700
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-06-24
Filing Date
2020-06-24
Publication Date
2024-12-10
Estimated Expiration
2040-06-24

AI Technical Summary

Technical Problem

Existing agricultural machinery video systems require manual repositioning of cameras to display relevant machine areas, leading to inefficiencies and limited simultaneous viewing capabilities, especially in complex harvesting processes.

Method used

A digital video system with multiple image capture units, an Ethernet switch, and a display unit configured as a panel PC, allowing for configurable image playback areas and wireless transmission to mobile terminals, enabling simultaneous display and storage of multiple video streams with zoom and decelerated playback options.

Benefits of technology

Enhances monitoring of agricultural machinery processes by allowing operators to focus on critical areas, improving operational efficiency and safety by providing flexible, real-time, and remote access to machine operations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007597746000001
    Figure 0007597746000001
  • Figure 0007597746000002
    Figure 0007597746000002
  • Figure 0007597746000003
    Figure 0007597746000003
Patent Text Reader

Abstract

1. A method for observing a work process of processing and / or treating harvested material of an agricultural machine, in particular a harvester (2), the agricultural machine, in particular the harvester (2), having a digital video system with a plurality of digital image capture units (4), at least one display unit (3), and at least one network coupling element, preferably configured as a switch (7), the digital image capture units (4) being connected to the display unit (3) via the network coupling element, the image capture units (4) recording image data for a plurality of images, in particular a video stream, and at least one of the plurality of images, in particular the video stream, being at least partially reproduced in one of a plurality of configurable shapes, in particular in one or more image reproduction areas (19) of the display unit (3), in particular configured as a touchscreen, of an EDP unit, preferably configured as a panel PC (8). 2. A method for observing a work process of processing and / or treating harvested material of an agricultural machine, and an agricultural work machine having a digital video system.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a method for observing a work process of an agricultural machine, a digital video system for observing a work process of an agricultural machine, and an agricultural work machine.

[0002] Analog video systems have been used for many years as support systems for machine operators to observe the working processes of agricultural machines, in particular of towed or self-propelled harvesters for harvesting potatoes or beets, during the processing and / or treatment of the harvested product. A feature of such video systems is that the very video image captured by the camera associated with the monitor is always displayed on the monitor. Depending on the camera's positioning, machine parts that are not relevant to the driver are also displayed. If the user wants to display a larger image area, he or she must reposition the camera for this purpose, which is time-consuming. Furthermore, various manufacturers now offer video systems that can also be connected to one monitor and displayed simultaneously with up to four cameras. Even with these cameras, the respective cameras must be repositioned in order to observe the respective machine area in more detail.

[0003] Furthermore, EP 3 437 929 A1 discloses a vision system for vehicles in which an inset image of the field of view / field of view based on the driving situation of a relevant area located in the vicinity of the tractor is displayed on the operator's monitor.

[0004] In view of this background, the object of the present invention is to improve the monitoring of the work process of a harvester.

[0005] The above problem is solved by the subject matter of claims 1, 20 and 23. Advantageous embodiments of the invention can be seen from the dependent claims which refer to these claims and from the following description.

[0006] A method according to the invention for observing a work process of processing and / or treating a harvested product of an agricultural machine, in particular a harvester, in which the agricultural machine, in particular the harvester, has a digital video system with a number of digital image capture units, at least one display unit and at least one network coupling element, preferably configured as a switch, the image capture units being connected to the display unit via the network coupling element, in which the image capture units record image data, in particular for a number of images of a video stream. At least one of the images, in particular of the video stream, is reproduced at least partially in one of a number of configurable shapes, in particular comprising one or more image reproduction areas on a display unit, in particular configured as a touch screen, of an EDP unit, preferably configured as a panel PC. The image data is transmitted from the respective image capture units to the EDP unit via a switch, in particular via an Ethernet switch. The respective elements of the digital video system are connected in particular via a network cable (Ethernet cable). The physical connection between the image capture units and the at least one display unit is therefore performed indirectly via the EDP unit to which the display unit is connected or via the EDP unit having the display unit. A display unit therefore includes at least one display and associated electronics.

[0007] In this case, the image capture unit is directed at the working process of the machine for processing and / or treating the harvest, and thus in particular at machine elements such as a conveyor belt or a sorting stage (Fallstufe) that transports the harvest. Individual cameras may be directed, for example, at a separator for separating the harvest from contaminants such as stones or soil, or at the sorting stage. Digital image capture units may be directed, for example, at a collection area (bunker), a transfer area or a storage area of ​​the harvest. The image capture unit is in particular a digital video camera that outputs individual images, for example in RAW format, or also transmits a complete already compressed video stream to the system in MPEG or other video format. It is preferably a high-resolution camera with a sensor resolution of at least 1280x720 pixels, preferably at least 1280x800 pixels, in particular at least a 1.3 megapixel sensor, for example with at least 1280x1024 pixels (pixels).

[0008] It is also possible to provide data for an image of the video stream only as a difference from a previously transmitted image. These data are transferred, as described above, inter alia by cable connection to a network coupling element, preferably configured as an Ethernet switch, which transfers the data of the image capture unit via one or more network coupling elements to an EDP unit, preferably a panel PC, which processes the data. In the EDP unit, the data are provided according to a configuration for the display unit, which configuration can be predefined by the operator or can be predefined as standardized on the program side. The image data for the multiple images of the video stream are processed in the EDP unit so that they can be reproduced on a display unit, in particular configured as a touch screen, of the EDP unit, in particular configured as a panel PC, more particularly in a respective image reproduction area of ​​a defined shape. By shape is meant the arrangement of one or more image reproduction areas on the available screen of the display unit.

[0009] The connecting cable is in particular an Ethernet line, for example in the form of a 100BASE-TX or 1000BASE-TX line, which transmits a sufficient amount of data. The individual components of the video system, in particular the Ethernet switch and the EDP unit, are preferably equipped with Gigabit Ethernet interfaces in order to transmit the amount of data to be processed as efficiently as possible.

[0010] The reproduction areas of a shape can be configured to reproduce the same image, i.e. the same video stream. In total, preferably up to eight image reproduction areas can be displayed in a shape, i.e. up to eight video streams can be reproduced simultaneously. For this purpose, the EDP unit is provided, inter alia, with a corresponding high-performance graphics processor and / or microprocessor. Furthermore, the EDP unit has general means for storing and processing data, inter alia a main memory and a data memory, a controller, a network interface and, if necessary, a communication interface. Further possible details of the EDP unit are further described below in the respective developments according to the invention.

[0011] The configuration of the shape and image reproduction area is configured to be storable in the EDP unit and recallable accordingly, so that the visible area of ​​the display unit, preferably at least 12 inches in size, can be personally configured for a machine operator, service technician, or other operating personnel.

[0012] In one development of the invention, information about the type of machine can be transmitted via an interface with a machine control device, which can be connected to the switch and also to the EDP unit. This allows a corresponding shape to be preselected or provided, which can be preconfigured and stored. Standardized shapes can also be provided for unknown machine types that are not stored in the EDP unit. It is also possible to read out the individual shape configurations using a portable storage medium or to export them onto this storage medium via an interface provided in the EDP unit.

[0013] According to the invention, the operator can now display exactly the video image he wishes to see from a number of possible window arrangements, in particular with portrait and landscape displays on the display unit or its display. The machine operator can thus set different priorities for observing the work process, in particular in the case of different soil conditions. For example, in the case of heavy, wet soil conditions, areas of the harvester that are prone to clogging can be monitored in a targeted manner, whereas in the case of relatively fine, dry, light soil conditions, the emphasis can be placed, for example, on the separation of the harvested material into different lot sizes.

[0014] This focus allows operators to more quickly recognize critical machine conditions and then correct them, especially via a machine control device that is not connected to the digital video system, which makes it easier to retrofit digital video systems to existing machines.

[0015] The processes observed by the digital video system are in particular processes carried out "inside" the machine, and therefore are not image capture units directed only at the external environment of the machine, but at the machine elements which handle and process the harvest. Storage in the machine's bunker is also understood to be processing of the harvest.

[0016] Preferably, the images of one image capture unit of the multiple image capture units are simultaneously reproduced, at least partially, in multiple image reproduction areas of one shape, and multiple different interest areas of the image capture units can be predefined and reproduced in their own reproduction areas of this shape. Previously, a video stream could only be reproduced in one reproduction area of ​​the screen at any one time. Now, data is provided to at least two reproduction areas by simultaneously distributing (multicasting) data packets to multiple subscribers in the EDP unit. In this case, the video stream can be further processed in a further powerful image processing unit.

[0017] According to the invention, the definition of the area to be played back of the video stream can be performed during operation of the system using a touch screen or on the basis of a still image in a configuration mask. For example, as is known for mobile phones, a certain image area can be selected as an area of ​​interest by a gesture of one or two fingers, which image area as an area of ​​interest is then displayed, inter alia, in its own image playback area.

[0018] If the corresponding areas are to be displayed in the same image reproduction area, the system is technically configured to display the selected image area (area of ​​interest) in an enlarged manner. Thus, within the respective image reproduction area of ​​a shape, the image of the image capture unit (or the display of the image capture unit) can be zoomed. The selection of the area of ​​interest is then carried out with zooming in on the respective image area, in particular via a two-finger input. In this way, different video streams can be displayed in a targeted manner and enlarged area-by-area manner, if necessary, so that particularly critical working areas can be even better observed. For example, in the case of image capture towards the separation stage as a whole, the entrance and exit areas can be displayed in a targeted manner and enlarged manner in the same shape in a total of three image reproduction areas (overall view, entrance area, exit area).

[0019] Preferably, the images or image areas selected within the respective image reproduction areas can be stored in a memory unit, which may be present locally within the EDP unit, for example in the form of a volatile permanent memory, or may be a portable storage medium connectable via a corresponding interface of the EDP unit.

[0020] Furthermore, the system is preferably configured to display a selection menu on the corresponding image playback area via a touch screen input, via which the saving of the respectively displayed (particularly also zoomed and thus partially displayed) video stream can be initiated. Alternatively or additionally, this process can also be initiated via a general settings menu with any submenus.

[0021] Furthermore, the system is preferably configured to store two or more image reproduction areas, in particular all image reproduction areas, and the video streams displayed in these image reproduction areas simultaneously, preferably in an arrangement that is furthermore visible on the screen, in particular on a portable medium, so that the work processes that are performed simultaneously at different locations of the machine can be observed at the same time, even at a later time, without having to take care of the simultaneous parallel playback of separate video streams for this purpose. The EDP unit thus provides for a convenient creation of a common video stream based on the contents displayed on the display unit. By "portable medium" is understood a storage medium that is temporarily connectable to the EDP unit via a hardware interface, is not necessary for the operation of the EDP unit, and is used in particular only for data transfer, for example a USB stick. However, it may also be a cloud memory, preferably provided by the machine manufacturer and made available via the machine and / or tractor interfaces.

[0022] In particular, the observation and monitoring of the work process is improved if the images of the video stream of the image capture unit, which are preferably temporarily stored in a volatile or semi-permanent buffer memory, are played back at a slower rate in at least one image playback area, and in particular the same video stream is played back not or otherwise at a slower rate in another image playback area of ​​the same shape, either in full or zoomed. In this case, the incoming video stream is slowed down, in particular to 25% of the real time, and after a certain time, for example 4 seconds, the playback jumps to the current image at that time, after which the following video stream is played back again at a corresponding slower rate. This makes it possible to very well monitor particularly fast-moving, in particular rotating, machine parts.

[0023] In particular, the system is configured to play back a slowed down video stream within at least two image playback areas of a shape.

[0024] Preferably, the images of one or more image playback areas and / or image capture units, in particular configured as video streams, are transmitted wirelessly by a communication unit connected in particular via an additional switch, for example an Ethernet switch, to a remote, in particular mobile, terminal or user terminal. In addition to transmitting the images on a monitor or display unit in the tractor or self-propelled cabin, it is therefore possible to transmit video images to a mobile terminal. For this purpose, the terminal user preferably connects his mobile terminal to a WLAN provided via the communication unit of the machine. The terminal user can then cause, in a program started on the mobile terminal, to display an individual shape adapted to the terminal, with at least one video stream of one of the image capture units. Alternatively, the terminal user can access a web page of the digital video system, preferably hosted on the EDP unit, via which a shape, in particular configurable, for a remote, in particular mobile, user terminal is provided, in which the image playback area is preferably also predefined and / or configurable on the server side.

[0025] This makes it easy for example for the driver of the collection vehicle to display in the shape an image playback area showing a video stream of the bunker filling. In the case of a potato harvester, this also makes it possible to increase the working safety and comfort of the sorter working at the sorting table during harvesting by displaying to him a video image of the separator, which is not visible from the sorting table on the harvester. Any settings can then be made by the operator directly from the operating terminal of the sorting table, and the results of the adjustments can be directly visible on the mobile user terminal. The driver is thus freed from monitoring and control tasks and can thus concentrate on operating the harvester. For example, the farm manager can also check the functioning of the machine during harvesting without having to get on board. The playback on the remote, in particular mobile, user terminal is carried out without interfering with the playback on the display unit in the driver's cab.

[0026] Advantageously, the images of one or more image play areas, in particular all image play areas, of one shape are stored such that successive clips, preferably of a configurable length, are created or stored, with the size of the created clips being accordingly limited, preferably automatically named with a timestamp, allowing easy subsequent processing and viewing of individual clips created at specific, for example critical, moments.

[0027] It goes without saying that the above and below method steps can be realized by a computer program running in the main memory of the EDP unit, or even by several interrelated programs running on the same EDP unit or in the same or different memories of, for example, the CPU and GPU of the EDP unit.

[0028] Preferably, in the configuration step for the image reproduction area, one of at least 24 image capture units, in particular digital cameras, preferably up to 48 image capture units, which are connected to each other via a number of successively connected switches, is selected. If a corresponding port for at least one further switch is free on each switch, the system can be expanded by cascading the switches, in particular even later on in a simple manner. In order to avoid data bottlenecks on the transmission lines, the required bandwidth in the network of the digital video system is also preferably reduced by streaming only the cameras that are currently displayed in the active shape.

[0029] Preferably, upon deviation from normal operation detected by the machine control device, upon activation of a machine function and / or upon changing of machine settings via the operating terminal, a corresponding screen signal is imaged so as to be superimposed on the previous image reproduction area and / or at least one corresponding machine element is imaged so as to be reproduced in the image reproduction area. For this purpose, the shape can be changed automatically. In this case too, an interface with the machine control device is required, which is provided via an Ethernet switch, via a further Ethernet switch or also via a direct connection with the EDP unit. In particular, the respective screen signal can be reproduced in a shape configured exclusively for that screen signal. The operating terminal is typically located in the driver's cab, for example at the sorting table of a potato harvester.

[0030] Thus, preferably, an automatic switchover from one or more video streams to a shape configured for this purpose is performed when deviations from normal operation, when starting up machine functions and / or when changing machine settings. One or more image areas are then displayed in this shape, preferably in the form of an area of ​​interest of one or more video streams, so that the operating personnel are targetedly informed about possible critical situations and can initiate countermeasures or inspections on the basis of this notification. Preferably, a color highlighting is simultaneously performed, in particular in the case of deviations from normal operation or critical operating states, for example when individual areas are overloaded. In particular in the case of rapidly moving or rotating machine parts, the relevant video streams can also be played back at a slower rate in such shapes. According to the invention, it is also advantageous if such superimposed images or representations of shapes can be faded out again by a screen input, in particular in the form of a swiping movement, in order to return to the previous view or previous shape.

[0031] The video stream must be displayed with as little latency (delay) as possible from the camera lens to the display unit. A delay of less than 100 ms is desirable. Preferably, a predefined time is associated to each image for this purpose. For this purpose, at least some of the images can be time-stamped in one component to record the time in further components of the (digital video) system and / or the time of receiving a re-identifiable image is recorded in different components of the system, whereby if the time delay is too long, the corresponding image playback area is marked, e.g. blackened and / or marked with a red exclamation mark.

[0032] Preferably, animated graphics (e.g. a rotating gear) are inserted on the display unit, which is at the same time the operating unit, to make it clear that the system is working properly and is not in a stalled (frozen) state.

[0033] Advantageously, preferably before the settings can be implemented, a pop-up dialog is also opened first, which displays the active image replay area in a reduced form, in order to configure one of the image replay areas. This serves to review and check the desired changes to be implemented, in order not to configure another image replay area by mistake. Thus, vibrations, which frequently occur during farming work, do not or only to a lesser extent result in undesired inputs on a display unit configured as a touch screen.

[0034] According to a further advantageous embodiment of the invention, the shape has at least one, preferably up to eight, particularly rectangular, image reproduction areas, the arrangement of which is preferably suggested by means of algorithms available on the EDP unit depending on the size and shape and / or position of the selected area of ​​interest of the image capture unit in the crop stream of the harvested product. This is a simple optimization problem to implement when the operator wishes to leave the optimal utilization and arrangement of the available space to the system.

[0035] In the case of multiple shapes being present, it is advantageous for a further embodiment of the invention if the multiple shapes are automatically switched between, particularly at predefinable time intervals, in order to obtain a continuous view in multiple different machine areas.

[0036] Advantageously, furthermore, predefined shapes are used depending on the signals transmitted by the machine control device for the operating states of road travel, agricultural work and reverse travel. Thus, for example, when traveling on roads, a shape can be displayed that shows a view of the possible folding or lifting of machine parts, while when performing agricultural work, the desired work process is taken into account, which accordingly changes the flow of the crop. The same applies to the shape view when reverse travelling.

[0037] Advantageously, the images of the at least one image capture unit are also displayed as a web video stream via a remote connection, in particular with the resolution of the shape view or the refresh rate adapted to the connection bandwidth, for example signaled by the mobile terminal. In order to avoid disturbing the operating personnel, this system can also be realized on the EDP unit completely independent of the display on the display unit.

[0038] In particular, the system is not configured for machine control, i.e. the system does not intervene in the control of the machine but is used only for process monitoring.

[0039] The problem stated at the outset is also solved by a digital video system for observing a work process of processing and / or treating a harvested crop of an agricultural machine, in particular a harvester, which has a number of digital image capture units and at least one display unit configured as a touch screen of an EDP unit, in particular configured as a panel PC, the digital video system being provided with a network coupling element, preferably configured as a switch, in particular an Ethernet switch, and the image capture units being connected to the display unit via the network coupling element, the system being configured to carry out the method according to one of the preceding claims using one or more computer programs as described above.

[0040] For system scalability, the system is preferably provided with multiple network coupling elements in the form of (Ethernet) switches, with at least one image capture unit being connected to an EDP unit via the serially networked switches.

[0041] Preferably, when a camera is replaced, especially if it is an original part replacement, this is automatically recognized, configured and recommissioned by the system.

[0042] In particular, the transmission of the desired signals of the machine control can be improved if a switch which is directly connected to the EDP unit is connected to an interface for the CAN-BUS and / or a communication unit of the machine, or the CAN-BUS or a communication unit can be directly connected to the EDP unit if a corresponding interface is provided.

[0043] The object stated at the outset is also achieved by an agricultural working machine, in particular a harvester, which comprises the above-mentioned or below-mentioned video system.

[0044] Further advantages and details of the invention can be seen from the following description of the drawings. [Brief description of the drawings]

[0045] [Figure 1] FIG. 1 shows an object according to the invention in the form of a towed harvester. [Diagram 2] FIG. 2 shows components of the object according to the invention according to FIG. [Diagram 3] FIG. 2 shows a further object according to the invention. [Figure 4] FIG. 1 shows nine variations of shapes. [Diagram 5] 3 shows a diagram of program levels of a computer program enabling the method according to the invention; [Figure 6] FIG. 13 illustrates further shapes. [Figure 7] 7 is a corresponding composition view for the shape according to FIG. 6.

[0046] The individual technical features of the embodiments described below can also be combined with the features of the embodiments described above and with the features of the independent claims and any further claims to form the subject matter of the present invention. Wherever meaningful, elements having the same functional effect are provided with the same reference signs.

[0047] According to Fig. 1, the device according to the invention is configured as a harvester 2 which is towed by a tractor 1 and configured as a potato harvester. The EDP unit belonging to the harvester 2 according to the invention is arranged in the cab 5 of the tractor 1 together with a display unit 3 configured as a touch screen. This EDP unit is connected to a switch on the harvester side via an Ethernet cable (not shown). On the display unit 3, image data recorded by digital image capture units 4 are reproduced, which are here generally associated with the individual processing steps for the crop.

[0048] The image capture units 4 are digital cameras which typically transmit data in the system according to the invention via an Ethernet cable 6 to a switch 7 configured as an Ethernet switch. The data is then transmitted from the image capture units 4, preferably again via the Ethernet cable 6, to an EDP unit configured as a Panel PC 8. Optionally, a further Panel PC 8 can be connected, on whose display unit a series of configurable shapes can also be displayed. In a corresponding configuration program of the main Panel PC (master), it can then be selected which cameras are displayed on this main Panel PC and which cameras are displayed on subordinate optional Panel PCs (slaves, connected via data lines in the form of the dashed Ethernet cables 6).

[0049] An interface for the machine control is also provided in the form of a CAN-to-Ethernet gateway 9, which provides access to a WLAN and to a machine control unit 12 connected via a CAN-BUS line 11. In parallel to this, for example, access to a corresponding bus system can also be provided via an ISO-BUS line 13 (shown in dashed lines). In this case, the gateway 9 further comprises a corresponding ISO-BUS interface.

[0050] According to the embodiment of Fig. 2, the digital image capture unit 4 is connected to only one Ethernet switch 7, which is preferably arranged on the harvester side of the towed harvester 2, whereas the variant according to Fig. 3 has a total of four switches 7, of which the switch 7 at the top of the drawing is associated with the tractor 1, while the switch 7 directly connected to the digital image capture unit 4 is arranged on the side of the harvester 2. The dashed line 14 indicates the separation between the tractor 1 and the harvester 2, which are illustrated as boxes in the drawing.

[0051] Thus, the optical image capture unit 4, which is arranged at the switch 7 on the harvester side, which is on the right in FIG. 3, is connected via a total of four switches 7 to a master panel PC 8, which is on the left in the drawing, and to a further panel PC (slave) 8, which is located next to it on the right in the drawing. In this embodiment, an ISO-BUS interface 15 is further provided. Via the ISO-BUS interface 15, machine or control signals are received, which, depending on the type of signal, result in an automatic call of a shape for the attention of the machine operator, via which the video stream of the optical image capture unit 4 corresponding to the control signal is displayed on the display unit. The same applies to the CAN-to-Ethernet gateway 10. This is stored in the settings of the program executed on the EDP unit.

[0052] The router, which is connectable via the gateway 10, provides a WLAN connection 16 to a remote, mobile user terminal 17 on which the shapes can also be configured or called up via a web server running on the master panel PC 8. Furthermore, a diagnostic interface 18 and one or more further devices 20 transmitting control signals can be connected to the Ethernet switch 7 on the tractor side.

[0053] In one section of the configuration program, i.e. in the settings of the software program running on the master panel PC 8, it is possible to configure, for example, the nine shapes depicted in Fig. 4. Thus, one to eight image reproduction areas 19 can be provided with the video stream of the optical image processing unit 4.

[0054] In the example of Fig. 5, the corresponding levels of the computer program are shown for the example shown: At the top left is located a working view 21 for the respective shape, from which the individual image reproduction areas 19 can be processed according to box 22. Furthermore, input means on a touch screen are associated with the working view 21, via which the operator can reach a setting level 23, from which the shape management 24, the camera management 25, the sequence management 26, the web server management 27 and the user settings 28 can be reached.

[0055] In the shape management 24, shapes are configured. In the camera management 25, if present, settings of the image capture unit 4 can be carried out, for example settings of color, compression or resolution. The sequence management 26 allows the saving of the individual image playback areas 19 or the management of the individual video streams. In the web server management 27, the web page display for the individual shapes is configured accordingly, which makes it possible, among other things, to configure an access management, by which third parties can only log in to the web server of the EDP unit under password protection from a user terminal, preferably mobile, but at least remote from the harvester. Finally, in the user management 28, user profiles can be saved or called up. It is also possible to set whether the system should always start with the last used user profile or with a standard configuration.

[0056] According to the embodiment according to FIG. 6, a shape for playing back five video streams is formed on the basis of five image playback areas 19. The corresponding configuration screen of the shape can be called up directly by means of the correspondingly assigned icon 29. In FIG. 7, individual image playback areas 19 are also formed for the time being, which correspond to the image playback areas 19 of FIG. 6, albeit reduced in size. For example, the topmost image playback area 19 shows the reduced video stream of the top left image playback area of ​​FIG. 6, the image playback area 19 below this image playback area, which is located in the second row of FIG. 7, shows the second video stream from the left of the top row of FIG. 6, etc. The image playback areas 19 are assigned available optical image capture units 4 via a field 31 that can be operated via a finger. When tapping on this field or on the further field 31, a drop-down list is displayed, via which a camera known to the system can then be selected. The area of ​​the touch screen located at the bottom left of FIG. 7 includes a button for returning to the previous dialog (button 32), a help button 33, and an information button .

Claims

1. 1. A method for observing a work process of processing and / or treating a harvested product of an agricultural machine, in particular a harvester (2), by a machine operator, comprising: said agricultural machine, in particular said harvester (2), having a digital video system with a number of image capture units (4), at least one display unit (3) and at least one network coupling element, preferably configured as a switch (7), the image capture unit (4) is connected to the display unit (3) via the network coupling element; said image capture unit (4) being adapted to record image data for a plurality of images of a video stream, In particular, at least one of the images of the video stream is reproduced, at least in part, within a configurable shape or within one of a plurality of configurable shapes; said shape comprising one or more image reproduction areas (19) of said display unit (3) configured as a touch screen, in particular of an EDP unit configured as a Panel PC (8), the shape being an arrangement of one or more image reproduction areas on an available screen of the display unit; - in response to deviations from normal operation detected by the machine control device and / or when changing machine settings via the operating terminal, a corresponding screen signal is imaged so as to be superimposed on a previous image reproduction field and / or at least one corresponding machine element is imaged in the image reproduction field (19), method.

2. 2. The method according to claim 1, wherein a plurality of images of one of the plurality of image capture units (4) are simultaneously reproduced at least partially within a plurality of image reproduction areas (19) of a single shape.

3. 3. The method according to claim 2, wherein a plurality of different regions of interest of the image capture unit (4) are predefined and each are reproduced in their own image reproduction area (19).

4. 4. The method according to claim 2 or 3, wherein the image of the image capture unit (4) is zoomable within the image reproduction area (19) of each one of a shape, in particular via a two-finger input.

5. 5. Method according to any one of the preceding claims, characterized in that within each said image reproduction area (19) selected images or image areas are stored in a memory unit.

6. 6. The method according to claim 1, wherein images of the video stream of the image capture unit, preferably temporarily stored in a volatile or semi-permanent buffer memory, are played back at a reduced speed in at least one image playback area (19).

7. 7. The method according to claim 6, wherein the same video stream in another image reproduction area (19) of the same shape is not reproduced or is otherwise reproduced at a slower rate.

8. 8. Method according to claim 6 or 7, characterized in that in at least two image reproduction areas (19) a slowed-down video stream is reproduced.

9. 9. The method according to claim 1, wherein images, in particular configured as a video stream, of one or more image playback areas (19) and / or of the image capture unit (4) are transmitted wirelessly to a mobile terminal (17) by a communication unit connected in particular via an additional switch (7).

10. the images of one or more image reproduction areas (19) of one shape, in particular all image reproduction areas (19), are stored on a portable medium connected to said digital video system via a hardware interface, 10. Method according to any one of the preceding claims, wherein successive clips, preferably having a configurable length, are generated.

11. 11. The method according to claim 1, wherein in the configuration step for the image reproduction area (19), one of up to 24 image capture units (4) connected to one another via a plurality of tandemly connected switches (7) is selected.

12. 12. The method according to claim 1, wherein an automatic switchover from one or more video streams to a shape configured for this purpose is performed when deviations from normal operation and / or when machine settings are changed.

13. At least some of the images are time-stamped or recorded at different components of the digital video system at the time of receipt of each image; whereby if the time delay from the image capture unit (4) to the display unit (3) is too long, a corresponding image reproduction area (19) is marked; 13. The method according to any one of claims 1 to 12.

14. 14. The method according to claim 1, wherein, in order to configure one of the image playback areas (19), a pop-up dialog is first opened, which displays the active image playback area (19) in reduced form.

15. The shape has at least one image reproduction area (19), - the position of the image reproduction area (19) is proposed using algorithms available on the EDP unit depending on a selected area of ​​interest and / or the position of the image capture unit (4) in the crop stream.

15. The method according to any one of claims 1 to 14.

16. 16. The method of claim 1, comprising a plurality of shapes, the plurality of shapes being automatically switched at time intervals.

17. The method according to any one of claims 1 to 15, wherein the shapes are automatically switched between at predefinable time intervals.

18. 18. The method according to claim 1, wherein predefined shapes are used depending on the signals transmitted by the machine control device for the operating states road driving, farm work and reverse driving.

19. A method according to any one of claims 1 to 18, wherein specifically configurable shapes for remote user terminals (17) are provided via a web page of the digital video system, preferably hosted on the EDP unit.

20. The method of claim 19, wherein the image reproduction area (19) is configurable.

21. 21. The method according to any one of the preceding claims, wherein images of the at least one image capture unit (4) are displayed as a web video stream via a remote connection.

22. 22. The method according to claim 1, wherein the digital video system is used only for observing the work process and is not configured for machine control.

23. A digital video system for observing a work process of an agricultural machine, in particular a harvester (2), for processing and / or treating a harvested product, comprising: The digital video system comprises a number of digital image capture units (4), at least one display unit (3), in particular configured as a touch screen, of an EDP unit, in particular configured as a panel PC (8), and a network coupling element, preferably configured as a switch (7), the digital image capture unit (4) is connected to the display unit (3) via the network coupling element; The digital video system is adapted to carry out a method according to any one of claims 1 to 22. Digital video system.

24. A plurality of switches (7) are provided, At least one image capture unit (4) is connected to the EDP unit via the switch (7) which is serially networked.

24. The digital video system of claim 23.

25. Digital video system according to claim 23 or 24, characterized in that the switch (7) which is directly connected to the EDP unit is connected to an interface and / or communication unit for a CAN-BUS.

26. An agricultural working machine, in particular a harvester (2), provided with a digital video system according to one of claims 23 to 25.

Citation Information

Patent Citations

  • Multi-division picture display device

    JP1995077965A

  • Remote video image monitoring system

    JP2005175701A

  • Video distribution device

    JP2008017529A

  • Monitoring device and monitoring method

    JP2008148158A

  • Broadcast receiving device, method of controlling the same, and computer program of the same

    JP2010278757A