Method for observing working process of agricultural machine, digital video system and agricultural machine
Through the multi-image acquisition unit of the digital video system connected to the flat PC touch screen, the problems of inaccurate display and complex operation of the existing agricultural machine video surveillance system are solved, and the accurate monitoring of the internal processing and processing process of agricultural machines is realized. Flexible monitoring is adapted to different ground conditions, and the operator's work efficiency and safety are improved.
Patent Information
- Application Number
- CN202510706621.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2019-06-24
- Filing Date
- 2020-06-24
- Publication Date
- 2025-08-15
AI Technical Summary
The video surveillance system of existing agricultural machines is difficult to accurately display the key areas of the machine's processing and processing of crops, and the operation is complex and cannot meet the flexible monitoring needs under different ground conditions.
Using a digital video system, multiple digital image acquisition units are used to connect to the tablet PC touch screen display unit, transmit image data through an Ethernet switch, and support multiple configurable image reproduction areas, allowing the operator to adjust the display content as needed, and select the area of interest for enlargement or storage through touch screen and gesture operations.
It realizes accurate monitoring of the internal processing and processing process of agricultural machines, improves operators' work efficiency and safety, adapts to monitoring needs under different ground conditions, and simplifies system expansion and integration.
Smart Images

Figure CN120476828A_ABST
Abstract
Description
[0001] This application is a divisional application of the international application entering the Chinese national phase, with the application date of June 24, 2020, the international application number: PCT / EP2020 / 067760, the national application number: 202080046757.8, and the name: "Method for observing the working process of agricultural machinery, digital video system and agricultural machinery". Technical Field
[0002] The present invention relates to a method for observing a working process of an agricultural machine, a digital video system for observing a working process of an agricultural machine, and an agricultural working machine. Background Art
[0003] For many years, analog video systems have been used as assistance systems for machine operators to monitor the working processes of agricultural machines, particularly trailed or self-propelled harvesters, preferably those used for digging potatoes or sugar beets, when processing and / or handling harvested crops. These video systems are characterized by always accurately displaying the video image captured by the camera associated with the monitor on the monitor. Depending on the camera's positioning, machine parts that are not important to the operator are also displayed. If the user wishes to display a larger portion of the image, the camera must be laboriously repositioned. Furthermore, various manufacturers offer video systems that allow up to four cameras to be connected to each monitor and can then display them simultaneously. These cameras also allow for more precise viewing of the corresponding machine area by repositioning the camera.
[0004] Furthermore, EP 3 437 929 A1 discloses a visualization system for a vehicle, in which a field of view determined by the driving situation in the relevant area around the tractor is faded in on the operator's monitor. Summary of the Invention
[0005] Against this background, the object of the present invention is to improve the monitoring of the working process of a harvester.
[0006] This object is achieved by the subject matter of claims 1, 20 and 23. Advantageous embodiments of the invention can be gathered from the dependent claims which are based on the aforementioned claims and from the following description.
[0007] In a method according to the present invention for observing the working process of an agricultural machine, particularly a harvester, for handling and / or processing harvested crops, the agricultural machine includes a digital video system comprising: a plurality of digital image acquisition units; at least one display unit; and a network coupling element, preferably in the form of a switch, via which the image acquisition units are connected to the display unit. The image acquisition units record image data, particularly images of a video stream. At least one image of the image, particularly of the video stream, is at least partially reproduced in one of a plurality of configurable formats, comprising one or more image reproduction areas on a display unit, preferably in the form of a touchscreen, of an EDV unit, preferably in the form of a tablet PC. The image data is transmitted from the respective image acquisition unit to the EDV unit via a switch, particularly an Ethernet switch. The respective elements of the digital video system are connected, particularly via a network cable (Ethernet cable). The physical connection between the image acquisition unit and the at least one display unit is thus indirectly via the EDV unit, to which the display unit is connected or which has a display unit. The display unit thus includes at least one display and associated electronics.
[0008] In this case, the image acquisition unit is directed at the machine's operating process of handling and / or processing the harvested crop, and thus in particular at machine components such as conveyor belts, drop mechanisms, etc., that transport the harvested crop. Similarly, individual cameras can be directed, for example, at a separation device for separating the harvested crop from foreign matter, such as stones or soil, or at a drop mechanism. Similarly, digital image acquisition units can be directed, for example, at a harvested crop collection area (silo), a harvested crop transfer area, or a harvested crop receiving area. The image acquisition unit is particularly a digital video camera that outputs individual images, for example in RAW format, or transmits a complete, compressed video stream to the system in MPEG or another video format. Preferably, it is a high-resolution camera with a sensor resolution of at least 1280×720 pixels, preferably at least 1280×800 pixels, in particular a 1.3 megapixel sensor, for example at least 1280×1024 pixels (pixels).
[0009] The data of the video stream image can also exist only as a deviation from the previously transmitted image. As described above, the data are forwarded, in particular in the form of a cable connection, to a network coupling element, preferably in the form of an Ethernet switch, which forwards the data of the image acquisition unit via one or more network coupling elements to an EDV unit that processes the data, preferably to a tablet PC. There, the data are provided according to the configuration of the display unit, wherein the configuration can be pre-set in a standardized manner by the operator or also on the program side. The image data of the image of the video stream are processed in the EDV unit so that the image data can be reproduced on a display unit, in particular in the form of a touch screen, of the EDV unit, in particular in the form of a tablet PC, more precisely in a corresponding image reproduction area of a defined shape. The arrangement of one or more image reproduction areas on the provided screen plane of the display unit is referred to as a shape.
[0010] The connecting cable is in particular an Ethernet line, for example in the form of a 100BASE-TX or 1000BASE-TX line, via which sufficient data volumes can be transmitted. The individual components of the video system, in particular the Ethernet switch and the EDV unit, are preferably equipped with Gigabit Ethernet interfaces in order to transmit the data volumes to be processed as efficiently as possible.
[0011] The reproduction areas of a shape can be configured so that they reproduce the same image, i.e., the same video stream. Preferably, up to eight image reproduction areas can be displayed in a shape, which means that up to eight video streams can be reproduced simultaneously. To this end, the EDV unit is particularly equipped with a correspondingly powerful graphics and / or microprocessor. Furthermore, the EDV unit has conventional mechanisms for storing and processing data, in particular work and data memories, a controller, a network interface, and possibly a communication interface. Further possible details of the EDV unit are described below in corresponding improvements according to the invention.
[0012] The configuration of the shape and image reproduction area can be stored in the EDV unit and made retrievable in a corresponding manner so that the preferably at least 12-inch visible area of the display unit can be individually configured for machine operators, service technicians or other operating personnel.
[0013] In a further development of the invention, information about the machine type can be transmitted via an interface of the machine control unit, which can also be connected to the switch and also to the EDV unit. This then results in the preselection or provision of corresponding shapes, which can be stored in a preconfigured manner. Similarly, standardized shapes can be provided for unknown machine types not stored in the EDV unit. It is also possible to input individual shape configurations via an interface present in the EDV unit and with the aid of a portable storage medium, or to output them to the storage medium.
[0014] According to the present invention, the operator now has the ability to display the video image precisely as desired, from a variety of possible window configurations, particularly those with both portrait and landscape formats on the display unit or its monitor. This allows the machine operator to prioritize different aspects of the work process, particularly under varying ground conditions. For example, under thick, wet ground conditions, the harvester's areas prone to blockage can be monitored in a targeted manner, while under fine, dry, and thin ground conditions, greater emphasis can be placed on separating the harvested crop into different batch sizes.
[0015] By setting this emphasis, the operator can more quickly identify critical machine states and then eliminate them via a machine control that is not connected to the digital video system, in particular. This makes it easier to retrofit digital video systems into existing machines.
[0016] The processes observed by the digital video system are particularly those occurring "inside" the machine; thus, the image acquisition unit is not directed at the environment outside the machine, but rather at the machine elements that handle and process the harvested crop. Storage in the machine's silo is also considered harvest processing.
[0017] Preferably, the image of one of the image acquisition units is reproduced at least partially simultaneously in multiple image reproduction areas of a shape, wherein different regions of interest of the image acquisition unit are predefined and can each be reproduced in its own reproduction area. Previously, a video stream could only be reproduced in one reproduction area of the screen. By simultaneously sending data packets to multiple participants in the EDV unit (multicast), data is now available only for at least two reproduction areas. The video stream can then be further processed in another high-performance image processing unit.
[0018] According to the present invention, the area of the video stream to be reproduced can be defined during system operation via the touch screen or in a configuration mask based on a still image. For example, an image area can be selected as a region of interest using a one- or two-finger gesture, as is known from mobile phones. This image area is then displayed accordingly, particularly in its own image reproduction area.
[0019] If the corresponding parts are to be displayed in the same image reproduction area, the system is technically designed to display the selected image part (region of interest) in an enlarged manner. Thus, the image of the image acquisition unit (or its display) can be zoomed within the corresponding image reproduction area of the shape. The selection of the region of interest is then accompanied by an enlargement of the corresponding image part, in particular via a two-finger input. This allows for a targeted and, if necessary, partially enlarged display of different video streams, allowing for a better view of particularly critical working areas. Thus, for example, in the case of image acquisition that is oriented overall towards separate levels, the input and output areas can be specifically enlarged and displayed in the same shape, thus displaying a total of three image reproduction areas (overall view, input area, output area) in an enlarged manner.
[0020] Preferably, the image or image portion selected in the corresponding image reproduction area can be stored in a storage unit. The storage unit can be located locally in the EDV unit, for example in the form of a volatile permanent memory, or it can be a portable storage medium that can be connected via a corresponding interface of the EDV unit.
[0021] Furthermore, the system is preferably configured such that a selection menu is displayed via a touchscreen input on the corresponding image reproduction area, via which the storage of the corresponding displayed (especially also zoomed and thus partially displayed) video stream can be initiated. Alternatively or additionally, the process can also be initiated via a general settings menu with possible submenus.
[0022] Furthermore, the system is preferably configured such that two or more image reproduction areas, in particular all image reproduction areas and the video streams displayed in said image reproduction areas, are stored simultaneously, preferably also in an arrangement visible on the screen, in particular on a portable medium, so that work processes occurring at different parts of the machine can also be observed simultaneously subsequently without having to pay attention to the simultaneous playback of separate video streams side by side. The EDV unit thus provides for the convenient creation of a common video stream based on the content displayed on the display unit. "Portable medium" is understood to be a storage medium that can be temporarily connected to the EDV unit via a hardware interface, which is not required for the operation of the EDV unit and is in particular only used for data transmission. For example, in this case it is a USB stick. Of course, it can also be a cloud storage, which is preferably provided by the machine manufacturer and made available via an interface of the machine and / or tractor.
[0023] The observation and monitoring of the working process is particularly improved when images of a video stream of the image acquisition unit, temporarily stored in a preferably volatile or semi-permanent buffer memory, are reproduced at a slowed rate in at least one image reproduction area. In particular, the same video stream is reproduced in its entirety or in a scaled form, either without slowing down or with a different slowing down, in another image reproduction area of the same shape. The incoming video stream is slowed down to 25% of real time, after a predeterminable time, for example, four seconds, the reproduction jumps to the current image, and the subsequent video stream is then reproduced again at a corresponding slowed rate. This allows for particularly effective monitoring of fast-moving, in particular rotating, machine parts.
[0024] In particular, the system is designed to reproduce the slowed-down video stream in at least two image reproduction areas of a shape.
[0025] Preferably, images of one or more image reproduction areas and / or image acquisition units, particularly in the form of video streams, are transmitted wirelessly to a remote, particularly mobile, terminal or user terminal via a communication unit, particularly connected via an additional switch, such as an Ethernet switch. In addition to transmitting images to a monitor or display unit in the tractor or vehicle owner's cab, video images can also be transmitted to a mobile terminal. To this end, the terminal user connects their mobile terminal, preferably to a WLAN provided via the machine communication unit. The terminal user can then, in a program launched on the mobile terminal, display at least one video stream from one of the multiple image acquisition units, displaying a specific image adapted for the terminal. Alternatively, the terminal user can access a website for the digital video system, preferably hosted on the EDV unit, which provides specially configurable images for the remote, particularly mobile, user terminal. The image reproduction areas are preferably also predefined and / or configurable on the server.
[0026] For example, for the driver of a dump truck, a video stream showing the filling of the silo can be displayed in a single image. Similarly, in the case of a potato harvester, this improves work safety and comfort for harvesters working at the harvesting station by allowing them to see a video image of the separating equipment, which is not visible from the harvesting station. Possible settings can then be made by the operator directly at the harvesting station operator terminal, with the results of the adjustments being visible directly on the mobile user terminal. This frees the driver from monitoring and adjustment tasks and allows them to focus on driving the harvester. Similarly, for example, a farm operator can check the machine's functionality during harvesting without having to climb onto it. The remote, especially mobile, user terminal displays the display without interfering with the display on the driver's console.
[0027] The images of one or more image reconstruction areas of a shape, in particular all image reconstruction areas, are advantageously stored so that successively successive segments of preferably adjustable length are generated or stored. The resulting limitation of the size of the generated segments simplifies subsequent processing and review of the individual segments generated at specific, for example, critical, points in time, which are preferably automatically provided with named time stamps.
[0028] It goes without saying that the method steps described above and below can be implemented by means of a computer program running in the working memory of the EDV unit. It can also be implemented as multiple nested programs running on the same EDV unit or on the same or different memories of the EDV units, such as the CPU and GPU.
[0029] Preferably, during the configuration step of the image reproduction area, one of up to at least 24 image acquisition units, in particular digital cameras, and preferably up to a maximum of 48 image acquisition units, is selected, which are interconnected via a plurality of switches connected in series. By cascading switches, in particular by opening corresponding ports on a respective switch for at least one further switch, the system can be expanded, and in particular, the system can be expanded easily at a later time. To avoid data bottlenecks on the transmission lines, the bandwidth required in the network of the digital video system is preferably reduced by streaming only the cameras displayed in the currently active form.
[0030] Preferably, upon detection of deviations from normal operation by the machine control, activation of machine functions, and / or changes to machine settings via the operator terminal, the corresponding image screen signal and / or at least one associated machine element is re-imaged in the image reproduction area, superimposed on the previous image reproduction area. The form can be switched automatically for this purpose. The method requires an interface to the machine control, which is also provided via an Ethernet switch, another Ethernet switch, or a direct connection to the EDV unit. The corresponding image screen signal can, in particular, be reproduced in a form configured only for the image screen signal. The operator terminal is typically located in the driver's cab or, for example, at the picking deck of a potato digger.
[0031] Thus, in the event of deviations from normal operation, activation of machine functions, and / or changes to machine settings, a switch is automatically made from one or more video streams to a configuration configured for this purpose. In this configuration, one or more image sections are then preferably displayed in the form of regions of interest from one or more video streams, so that the operator is specifically informed of possible critical situations and can take countermeasures or checks based on these. Preferably, color highlighting is also performed, particularly in the event of deviations from normal operation or in critical operating states, such as when individual areas are overloaded. In particular, in the event of rapidly moving or rotating machine parts, a slowed-down reproduction of the relevant video streams can also be performed in this configuration. It is also advantageous according to the invention that this superposition or display of the configuration can be faded out again by a screen input, particularly in the form of a sliding movement, in order to return to the previous view or previous configuration.
[0032] The video stream must be displayed with the lowest possible latency (delay) from the camera lens to the display unit. A latency of <100 milliseconds is desirable. For this purpose, a time is preferably associated with each image. For this purpose, at least a number of images at one component can be time-stamped, and the time at another component of the (digital video) system and / or the time of receipt of a recognizable image can be recorded at a different component of the system. In this way, if the time delay is too great, the corresponding image reproduction area can be identified, for example by being rendered black and / or having a red exclamation mark.
[0033] An animated graphic (eg a rotating gear) is preferably displayed on the display unit which is also the operating unit in order to indicate that the system is functioning normally and is not in a stopped state (frozen).
[0034] Similarly, when configuring one of the image display areas, a pop-up dialog box is advantageously opened first, which displays the active image display area in a reduced form, preferably before any configuration can be performed. This serves to ensure and check the desired and intended changes, so as not to accidentally configure another image display area. Consequently, vibrations typically occurring during field work will not lead to, or will only lead to a limited number of, unintended inputs on the display unit designed as a touchscreen.
[0035] According to another advantageous embodiment of the present invention, the shape has at least one and preferably up to eight, in particular rectangular, image reconstruction areas. The arrangement of the image reconstruction areas is preferably suggested by an algorithm available on the EDV unit, depending on the shape and size of the selected region of interest and / or the position of the image acquisition unit in the harvested crop stream. This is a simple optimization problem for optimal utilization and arrangement of the available surface, if the operator wishes to leave this optimization problem to the system.
[0036] In the case of a plurality of shapes, a further embodiment of the invention is advantageous if the shapes are switched automatically, in particular in predefinable time intervals, in order to observe different machine areas sequentially.
[0037] Advantageously, predefined shapes are also used based on the signals transmitted by the machine control for the operating states road travel, field work, and reverse travel. Thus, for example, when traveling on the road, a shape can be displayed that shows a possible machine part to be folded or removed, while when working on the field, the desired work process that changes the crop flow can be taken into account accordingly. A similar statement applies to the shape display when reversing.
[0038] The images of the at least one image acquisition unit are advantageously also displayed as a network video stream via a remote connection, in particular with the resolution or repetition rate of the shape view being adapted to the connection bandwidth reported, for example, by the mobile terminal device. The system can also be implemented on the EDV unit completely independently of the display on the display unit to avoid disturbing the operator.
[0039] In particular, the system is not designed for machine control, ie, the system does not intervene in the control of the machine, but is only used to monitor the process.
[0040] The object set forth at the outset is also achieved by a digital video system for observing the working process of an agricultural machine, in particular a harvester, handling and / or processing harvested crops. The video system comprises a plurality of digital image acquisition units and at least one display unit, in particular a touchscreen, of an EDV unit, in particular a tablet PC, and an adapter system having a network coupling element, preferably in the form of a switch, in particular an Ethernet switch, via which the image acquisition units are connected to the display unit. The system is designed to carry out the method according to any of the preceding claims, which is carried out as described above with the aid of one or more computer programs.
[0041] For the scalability of the system, the system is preferably provided with a plurality of network coupling elements in the form of (Ethernet) switches, wherein at least one image acquisition unit is connected to the EDV unit via the serially networked switches.
[0042] When a camera is replaced, it is preferably automatically detected by the system, configured, and put back into operation, in particular when it involves an original component replacement.
[0043] The transmission of the desired signals from the machine control unit can be improved in particular if the switch connected directly to the EDV unit is connected to an interface for the CAN bus and / or the machine's communication unit. Alternatively, the CAN bus or the communication unit can also be directly integrated into the EDV unit if the EDV unit is equipped with a corresponding interface.
[0044] Likewise, the object stated at the outset is achieved by an agricultural work machine, in particular a harvester, which has a video system as described above or below. BRIEF DESCRIPTION OF THE DRAWINGS
[0045] Further advantages and details of the present invention can be found in the following description of the drawings. Schematically shown:
[0046] Figure 1 The subject according to the invention is shown in the form of a trailed harvester,
[0047] Figure 2 Show the basis Figure 1 components of the subject according to the invention,
[0048] Figure 3 Another subject according to the invention is shown,
[0049] Figure 4 Nine variations of the shape are shown,
[0050] Figure 5 shows the program hierarchy of a computer program implementing the method according to the invention,
[0051] Figure 6 Show another shape,
[0052] Figure 7 Show the basis Figure 6 The configuration view to which the shape belongs. DETAILED DESCRIPTION
[0053] The individual technical features of the embodiments described below can also be combined with the features of the above embodiments and the independent claims and any other claims to form the subject matter of the present invention. Whenever it makes sense, elements that function in the same way are provided with the same reference numerals.
[0054] according to Figure 1 The device according to the present invention is designed as a harvester 2 towed by a tractor 1 and configured as a potato digger. An EDV unit belonging to harvester 2 according to the present invention and a display unit 3 configured as a touchscreen are located in the driver's cab 5 of tractor 1. The EDV unit is connected to a switch on the harvester via an Ethernet cable (not shown). Image data recorded by a digital image acquisition unit 4, schematically associated with the various processing stages for harvesting the crop, is reproduced on the display unit 3.
[0055] Image acquisition unit 4 is a digital camera, which, in the system according to the present invention, typically transmits data via an Ethernet cable 6 to a switch 7 designed as an Ethernet switch. From there, the data is then preferably transmitted via an Ethernet cable 6 to an EDV unit designed as a tablet PC 8. Optionally, another tablet PC 8 can be connected, on whose display unit a series of configurable shapes can also be displayed. In the associated configuration program of the master tablet PC (master), it is then possible to select which camera is displayed on the master tablet PC and which camera is displayed on a lower-level, optional tablet PC (slave), connected via a data line in the form of a dashed Ethernet cable 6.
[0056] Likewise, there is an interface for machine control in the form of a CAN to Ethernet gateway 9. This provides access to WLAN and to machine control unit 12 connected via CAN-BUS line 11. Parallel to this, for example, corresponding bus systems can also be accessed via ISO-BUS line 13 (shown in dashed lines). In this case, gateway 9 also includes a corresponding ISOBUS interface.
[0057] However, according to Figure 2 In the embodiment, the digital image acquisition unit 4 is combined with only one Ethernet switch 7, which is preferably arranged on the harvester side in the trailed harvester 2. Figure 3The embodiment variant has a total of four switches 7, of which the upper switch in the figure is associated with the tractor 1, while the switch 7 directly connected to the digital image acquisition unit 4 is arranged on the side of the harvester 2. The dashed line 14 represents the separation of the two tractor 1 and harvester 2 shown as boxes in the figure.
[0058] Therefore, in Figure 4 The optical image acquisition unit 4 at the switch 7 on the right side of the harvester is connected via a total of four switches 7 to the master tablet PC 8 on the left side of the figure and another tablet PC (slave) 8 next to it on the right side of the figure. In addition, an ISO-BUS interface 15 is present in the embodiment. Machine signals or control signals are received via the ISO-BUS interface, which automatically call a shape that attracts the attention of the machine driver depending on the type of signal, and the video stream of the optical image acquisition unit 4 associated with the control signal is displayed on the display unit via the shape. The same applies to the CAN to the Ethernet gateway 10. The CAN is stored in the settings of the program running on the EDV unit.
[0059] A WLAN connection 16 can be provided via a router integrated into gateway 10 to remote and mobile user terminals 17, where profiles can also be configured or called up via a web server running on a control tablet PC. Additionally, a diagnostic interface 18 and one or more other devices 20 for transmitting control signals are connected to the tractor-side Ethernet switch 7.
[0060] In the configuration program section, that is, in the settings of the software program running on the master tablet PC 8, for example, Figure 4 Thus, between one and eight image reproduction areas 19 can be equipped with a video stream of the optical image processing unit 4 .
[0061] exist Figure 5 The hierarchy of the associated computer program is shown for the exemplary embodiment shown. At the top left, there is a working view 21 of the corresponding shape, from which the individual image reproduction areas 19 can be processed according to a block 22. Furthermore, working view 21 is associated with input options on the touch screen, via which the operator reaches a settings level 23, from which one can reach a shape manager 24, a camera manager 25, a sequence manager 26, a network server manager 27, and a user settings 28.
[0062] The shapes are configured in the shape management device 24. In the camera management device 25, the settings already existing for the image acquisition unit 4, such as color design, compression or resolution, can be implemented. The sequence management device 26 enables the storage of the individual image reproduction segments 19 or the management of the individual video streams. The website display for the individual shapes is configured accordingly in the network server management device 27, via which in particular an access management device can be configured, with the help of which a third party can log in to the network server of the EDV unit only in a password-protected manner from a user terminal device that is preferably mobile, but at least remote from the harvester. Finally, user profiles can be stored or called up in the user management device 28. It can also be set whether the system always starts with the last used user profile or with a standard configuration.
[0063] According to Figure 6 In the embodiment of FIG, the shape is used to reproduce five video streams according to five image reproduction areas 19. By means of the corresponding occupied icon 29, the associated configuration surface of the shape can be directly called. Figure 7 , first of all forms its own image reproduction area 19, which, although reduced in size, corresponds otherwise to Figure 6 For example, the top image reproduction area 19 is displayed in a reduced size. Figure 6 Video stream of the image reproduction area in the upper left corner, Figure 7 The image reproduction area 19 below the image reproduction area in the second row is displayed above the row according to Figure 6 From the left the second video stream and so on. The image reproduction area 4 is occupied with the available optical image acquisition unit 4 via the area 31 that can be operated by the finger. Clicking on this area or another area 31 displays a drop-down list via which the cameras known in the system can then be selected. Figure 7 The lower left area contains a button for jumping back to the previous dialog box (button 32), a help button 33, and an information button 34.
Claims
1. A method for observing a working process of an agricultural machine, in particular a harvester (2), for handling and / or processing harvested crops, the agricultural machine having a digital video system, the digital video system having: a plurality of digital image acquisition units (4); at least one display unit (3); and at least one network coupling element, preferably in the form of a switch (7), the image acquisition unit (4) being connected to the display unit (3) via the network coupling element, wherein the image acquisition unit (4) records image data, in particular of an image of a video stream, and reproduces at least partially an image, in particular of an image of the video stream, in one of a plurality of configurable shapes, the shape comprising one or more image reproduction areas (19) of the display unit (3), in particular in the form of a touch screen, of an EDV unit, preferably in the form of a tablet PC (8), using a preset shape according to the signals transmitted by the machine control device for operating states, road driving, field work and reverse driving.
2. The method according to claim 1, characterized in that The image of one of the image acquisition units (4) is reproduced at least partially simultaneously in a plurality of image reproduction areas (19) of a shape, in particular, different regions of interest of the image acquisition unit (4) are predefined and are reproduced in their own image reproduction area (19).
3. The method according to claim 2, characterized in that The image of the image acquisition unit (4) can be zoomed within a corresponding image reproduction area (19) of the shape, in particular via two-finger input.
4. The method according to any one of the preceding claims, characterized in that The images or image parts selected within the corresponding image reproduction area (19) are stored in a storage unit.
5. The method according to any one of the preceding claims, characterized in that In at least one image reproduction area (19), images of a video stream of an image acquisition unit, which are temporarily stored in a preferably volatile or semi-permanent buffer memory, are reproduced at a reduced speed, in particular, wherein the same video stream is reproduced without reduction or in a different manner in another image reproduction area (19) of the same shape.
6. The method according to claim 5, characterized in that The slowed-down video stream is reproduced in at least two image reproduction areas (19).
7. The method according to any one of the preceding claims, characterized in that Images, in particular in the form of a video stream, of one or more image reproduction areas (19) and / or image acquisition units (4) are transmitted wirelessly to a mobile terminal (17) by means of a communication unit, in particular connected via an additional switch (7).
8. The method according to any one of the preceding claims, characterized in that Images of one or more image reproduction areas (19), in particular all image reproduction areas (19), of a shape are stored on a particularly portable medium which is connected to the system via a hardware interface, wherein respectively successive segments of preferably adjustable length are formed.
9. The method according to any one of the preceding claims, characterized in that In a configuration step for an image reconstruction area (19), one is selected from up to at least 24 image acquisition units (4) that are connected to one another via a plurality of switches (7) connected in series.
10. The method according to any one of the preceding claims, characterized in that In response to deviations from normal operation detected by the machine control, activation of machine functions and / or changes to machine settings via an operator terminal, corresponding image screen signals and / or at least one relevant machine element are imaged in an image reproduction area (19) in a manner superimposed on a previous image reproduction area.
11. The method according to any one of the preceding claims, characterized in that In the event of deviations from normal operation, activation of machine functions and / or changes in machine settings, there is an automatic switch from one or more video streams to the shape configured for this purpose.
12. The method according to any one of the preceding claims, characterized in that At least a number of the images are time stamped, or the time when the corresponding images are received at different parts of the system is recorded, so as to identify the relevant image reproduction area (19) in the event of excessive time delay.
13. The method according to any one of the preceding claims, characterized in that In order to configure one of the image reproduction areas (19), a pop-up dialog box is first opened, which displays the active image reproduction area (19) in a reduced form.
14. The method according to any one of the preceding claims, characterized in that The shape has at least one and preferably up to eight, in particular rectangular, image reproduction areas (19), wherein the image reproduction areas are preferably set according to the selected region of interest and / or the position of the image acquisition unit (4) in the crop stream by means of an algorithm available on the EDV unit.
15. A method according to any one of the preceding claims, provided with a plurality of shapes, characterised in that The shape is switched in particular automatically at predefinable time intervals.
16. Method, in particular according to any one of the preceding claims, characterized in that A particularly configurable form factor for a remote user terminal device (17) is provided via a website of the digital video system, preferably hosted on the EDV unit, wherein the image reproduction area (19) can preferably be configured.
17. The method according to any one of the preceding claims, characterized in that The images of at least one image acquisition unit (4) are displayed as a website video stream via a remote connection.
18. Method according to any one of the preceding claims, characterized in that The system is not intended for controlling machinery.
19. A digital video system for observing the working process of an agricultural machine, in particular a harvester (2), in handling and / or processing harvested crops, the video system comprising: a plurality of digital image acquisition units (4); at least one display unit (3), in particular configured as a touch screen, of an EDV unit, in particular configured as a tablet PC (8); and a network coupling element, preferably configured as a switch (7), via which the image acquisition unit (4) is connected to the display unit (3), wherein the system is configured to perform a method according to any one of the preceding claims.
20. The digital video system according to claim 19, wherein: A plurality of switches (7) are provided, wherein at least one image acquisition unit (4) is connected to the EDV unit via the switches (7) which are networked in series.
21. The digital video system according to claim 19 or 20, characterized in that The switch (7) directly connected to the EDV unit is connected to an interface for a CAN bus and / or a communication unit.
22. An agricultural working machine, in particular a harvester (2), characterized in that A digital video system according to any one of the preceding claims 19 to 21 is provided.
Citation Information
Patent Citations
Visual system with visual field / view area display depending on the driving situation
EP3437929A1