Display system and method for displaying manufacturer-specific information about a machine

Abstract

The invention relates to a computer-aided display system (1) for displaying manufacturer-specific information (7) about a machine, in particular an agricultural machine, wherein the display system (1) is provided and configured to be at least connectable by signalling to an optical recording unit (3), which is configured to record images (4), and to obtain at least one image (4) from the recording unit (3), wherein the display system (1) has a computing unit (5) and a data processing program (13) that can be executed by the computing unit (5) for processing the at least one recorded image (4), wherein the invention is characterised in that manufacturer-specific components (6) of the machine (2) can be recognised in the at least one recorded image (4) by the computing unit (5), wherein manufacturer-specific information (7) can be assigned to the manufacturer-specific components (6) and the assigned manufacturer-specific information (7) can be displayed.

Description

[0001] DISPLAY SYSTEM AND METHOD FOR DISPLAYING MANUFACTURER-SPECIFIC INFORMATION OF A MACHINE

[0002] The present invention relates to a computer-aided display system for displaying manufacturer-specific information of a machine, in particular an agricultural machine, wherein the display system is provided and designed to be connectable, at least in terms of signal technology, to an optical recording unit which is configured to record images and to receive at least one image from the recording unit, wherein the display system has a computing unit and a data processing program executable by the computing unit for processing the at least one recorded image, according to the preamble of the present patent claim 1. Likewise, the present invention relates to a method for displaying manufacturer-specific information having the features of patent claim 19 and to a device having a computer-aided display system having the features of patent claim 20.

[0003] Display systems are known from the prior art which are able to retrieve or retrieve certain stored information by detecting optoelectronically readable codes, such as QR codes, barcodes or the like, and are able to assign or are assigned accordingly.

[0004] Especially when using such codes on machines, especially agricultural machinery, the codes attached to the machine are exposed to strong environmental influences and are therefore subject to a certain amount of wear, so that after an extended period of time, these optoelectronically readable codes become unreadable. These codes can also be lost, become illegible due to contamination, or similar factors. Especially in the field of agricultural machinery, especially for soil cultivation, many parts of the machine are subject to wear, so a considerable number of different optoelectronically readable codes are necessary.

[0005] The object of the present invention is therefore to be able to retrieve and display manufacturer-specific information by means of optical recognition of the respective component.

[0006] The underlying problem is solved by a computer-aided display system having the features of patent claim 1 and by a method having the features of patent claim 19 and by a device having the features of patent claim A core idea of ​​the present invention is to provide a computer-aided display system for displaying manufacturer-specific information of a machine, in particular an agricultural machine, wherein the display system is provided and designed to be connectable at least in terms of signal technology to an optical recording unit which is set up to record images and to receive at least one image from the recording unit, wherein the display system has a computing unit and a data processing program which can be executed by the computing unit for processing the at least one recorded image.According to the invention, it is provided that one or more manufacturer-specific components of the machine can be recognized in the at least one recorded image by the computing unit, wherein manufacturer-specific information can preferably be assigned to the manufacturer-specific components and, more preferably, the assigned manufacturer-specific information can be displayed.

[0007] The term "processing unit" can be understood here as meaning that the corresponding data processing program can be executed by the processing unit and the captured image can be processed accordingly. The processing unit can have one or more processors, for example, a CPU or GPU. Furthermore, a memory unit can be provided in which the corresponding data processing program is stored and can be retrieved or accessed from it.

[0008] Furthermore, the term "component" can be understood to mean that one or more components are or can be recognized from the captured image, depending on the nature of the captured image. It is understood that if no corresponding machine is depicted in the image, no corresponding components of the machine are recognizable either. The captured image can be understood as an image in which a machine is recognizable, in particular a manufacturer-specific machine. The components of the machine can correspond to image sections of the image at the respective locations of the components in the image.

[0009] The image sections therefore refer to a specific part or parts of the machine depicted in the image. An image section can also be understood as a component or one of the components of the machine. An image section can be a part of the captured image, whereby, with regard to the machine, the image section then corresponds to a component of the machine. The term "manufacturer-specific" means that only machines or machine parts / components that are assigned to a single and specific manufacturer or producer are recognized, and the corresponding information can be provided accordingly.

[0010] According to a preferred embodiment, it can be provided that the at least one recorded image can be a static image, a series of images, or a continuously recorded image. A static image is a single image, such as can be photographed using a camera or the like. A static image can limit the amount of data, so that faster recognition is possible. An image series can be several images taken one after the other, for example to capture different views of a component, which can mean better recognition of the corresponding image section. It is also conceivable that several images have been taken, each of which can depict different components, i.e. image sections or components, of the machine. In this way, several components or parts can be recognized.A continuously recorded image can, for example, be a video, which corresponds to a rapid, consecutive capture of images. This allows multiple components to be detected in succession and corresponding information to be displayed.

[0011] According to a particularly preferred embodiment, it can be provided that the recognition of the manufacturer-specific components is independent of the recognition of an optoelectronically readable code. An optoelectronically readable code is a code that can be optically detected and evaluated by an electronic device. An optoelectronically readable code can be, for example, a barcode, a QR code, or the like.

[0012] According to preferred embodiments, the corresponding component(s) of the machine in the captured image can be determined in various ways. Particularly preferably, only components in the captured image are detected.

[0013] For example, it is stated that a component can be identified by pattern recognition and / or outline recognition and / or object recognition or the like. To further identify which part / component it is, the recognition should be compared with a reference so that it can be determined which actual component it is. For example, the references can be stored or storable in a reference database so that they can be accessed by the computing unit and the data can be processed accordingly.

[0014] According to a further preferred embodiment, the manufacturer-specific information can be stored and / or stored in at least one database and can be retrieved from the at least one database. Preferably, the at least one database can be stored and / or stored in a storage medium.

[0015] It can be planned that all manufacturer-specific information is stored, or can be stored, in a single database. This can reduce the administrative burden associated with multiple databases.

[0016] However, it is also conceivable that the manufacturer-specific information is stored in multiple databases. Each database can be focused on one or more machines, allowing for smaller databases with shorter access times.

[0017] Particularly preferably, the database is a manufacturer-specific database. This may mean that the database only contains data from one and only manufacturer or data assigned to that manufacturer. Further preferably, it may be provided that the database is provided or can be provided by that manufacturer. Furthermore, it may be conceivable that only the manufacturer has the authority to make changes to the database, i.e., more specifically, to the manufacturer-specific information.

[0018] According to a further preferred embodiment, it can be provided that the at least one database can be updated, changed and / or deleted with regard to the manufacturer-specific information.

[0019] This is advantageous when machines no longer exist, new machines need to be added, or machines can be built in a different way.

[0020] According to a further preferred embodiment, it can be provided that authentication is required to retrieve the manufacturer-specific information from the database. This necessary authentication can be used to determine whether a user is authorized to access the database or not. This describes a security aspect.

[0021] Furthermore, authentication can be used to determine whether retrieving the manufacturer-specific information from the database is denied or permitted and / or to what extent the manufacturer-specific information can be retrieved.

[0022] For example, users can have different roles, such as an end customer, a customer service representative, a sales representative, or the like. It is advantageous if, for example, a customer service representative has access to more manufacturer-specific information than an end customer.

[0023] According to a further preferred embodiment, it can be provided that, in order to display the manufacturer-specific information, an input of a serial number and / or a specifying information can be provided before or after the recognition of the manufacturer-specific components in order to be able to correctly assign the manufacturer-specific information.

[0024] The serial number is the serial number of the machine being viewed or to be viewed, i.e. the machine that is shown or is to be shown in the image.

[0025] A specifying statement may, for example, be a selection of a plurality of machines, or an indication of what type of machine it is, or the like.

[0026] The serial number and / or the specifying information can be entered using an input terminal which can be connected to the display system at least in terms of signals, or by providing corresponding signals from the input terminal to the display system.

[0027] Entering the serial number and / or the specifying information before recognizing the manufacturer-specific image sections can have the advantage of limiting the number of possible components and thus accelerating recognition.

[0028] Entering the serial number and / or the specifying information after identifying the manufacturer-specific components can have the advantage that, in the event that several similar parts / components have been identified and it is now unclear which is the corresponding correct component, it can now be specified which is the correct component.

[0029] According to a further preferred embodiment, it can be provided that the display system is connectable to a display unit which is configured to display the associated manufacturer-specific information through the display unit.

[0030] The display unit can be a screen, a display, a monitor, a touch-sensitive screen, or the like.

[0031] The display unit is preferably intended and designed to display the manufacturer-specific information.

[0032] According to a further preferred embodiment, it can be provided that only the associated manufacturer-specific information can be displayed by means of the display unit.

[0033] This means that at least one captured image is not included in the display, and only the manufacturer-specific information can be shown on the display unit. This allows the display to be reduced to the essentials, ensuring the clearest possible presentation of the manufacturer-specific information.

[0034] Alternatively, according to one embodiment, it can be provided that the at least one recorded image with the associated manufacturer-specific information can be displayed by means of the display unit.

[0035] This allows a user to be provided with visual feedback indicating which component or part the corresponding manufacturer-specific information is being displayed for. Likewise, if multiple components have been detected, appropriate visual feedback can be provided indicating which component or part the manufacturer-specific information can be displayed for.

[0036] According to a further embodiment, it can be provided that the detected manufacturer-specific components, to which manufacturer-specific information is assigned, are visually highlighted. This makes it possible to visually display which components were detected in the at least one captured image and thus also to display whether any components were detected at all. The user can also be visually informed whether the corresponding part or component has been detected or not, so that in case of doubt, the user must take another picture of the machine or part from a different position.

[0037] A component can be visually highlighted, for example, by surrounding it with a border, for example, a clearly visible line. Furthermore, the image section could be outlined in a corresponding color, preferably in a color that is not present in the image or is present only in a small part. Furthermore, the component can be filled with color, whereby the color fill can have a transparent component. Furthermore, the component can be displayed flashing or pulsating.

[0038] According to a further preferred embodiment, it can be provided that the associated manufacturer-specific information can be displayed by means of a user input on a visually highlighted component.

[0039] It is conceivable that the detected components can be displayed in at least one captured image, allowing the user to select which of the detected components the manufacturer-specific information should be displayed for. This is particularly helpful when more than one component is detected.

[0040] This allows for a clear presentation of the image and the manufacturer-specific information.

[0041] The corresponding component can be selected by a corresponding user input. In the case of a touch-sensitive screen, this can be, for example, a tapping, pressing, or swiping motion. It would also be conceivable for a consecutive number to be displayed for numbering purposes for each image section, so that a selection can be made on the input terminal, for example a keyboard, i.e., for example, by pressing the corresponding number. Instead of numbers, other characters such as letters, special characters, or the like can also be conceivable. According to a further preferred embodiment, it can be provided that only the at least one recorded image and the associated manufacturer-specific information can be displayed.

[0042] Likewise, according to a further preferred embodiment, it could be conceivable that only recognized image sections and the associated manufacturer-specific information can be displayed.

[0043] This allows for a clearer presentation.

[0044] According to a further preferred embodiment, it can be provided that the associated manufacturer-specific information, preferably in the at least one recorded image, can be displayed in such a way that it is visually associated with the manufacturer-specific components.

[0045] A visual association can make it easier for the user to see that manufacturer-specific information is displayed for a displayed or selected component and that the manufacturer-specific information belongs precisely to this component. Such a visual association can be implemented, for example, using an information box, which can be designed similarly to a speech bubble, a drop-down menu, a marker, such as an arrow, or the like.

[0046] According to a further preferred embodiment, it can be provided that the manufacturer-specific information comprises one from the group: article number, material information, purchase information, setting information, documentation information, and any combination thereof. The article number can make it easier for the user to order the part or component. Material information can, for example, be information about how the part itself is designed or constructed. Purchase information can contain information about where the part can be purchased, for example where the nearest dealer is located, or the like. Documentation information can, for example, contain information about the use of the component, for example information from the operating instructions. Setting information can indicate how the component is adapted or configured for a particular area of ​​application or location of use.should be set to achieve the best possible processing. Specific options regarding manufacturer-specific information are presented purely as examples.

[0047] With regard to setting information, it may be intended, for example, to obtain detailed information on how to adjust components for the current intended application. This could include, for example, the speed of a fan, settings related to the type of seed, adaptation to soil conditions (e.g., penetration depth), planting spacing, soil penetration depth of tines and hoes, spring hardness of tines, nozzle settings for a field sprayer, and the like.

[0048] According to a further preferred embodiment, it can be provided that, based on the detected components, it is also possible to determine the degree of wear of the associated component.

[0049] The degree of wear can be understood as the extent to which the part or component is worn overall. It is also conceivable to indicate which part of the component is worn, so that it can be replaced. This can be helpful for components with one or more wear components.

[0050] According to a further embodiment, it can be provided that a user input can be used to select which of the manufacturer-specific information is to be displayed. The user input can be performed both before and after the manufacturer-specific information is displayed.

[0051] To facilitate the location of components of the machine, it can preferably be provided that the computer-aided display system is configured to detect a reference point on the machine and to determine a relative position of the display system to the machine. Preferably, the relative position of the display system to the machine can be determined by detecting a reference point. Preferably, the display system is configured to output instructions, messages, and / or the like, which serve to provide a position of the component based on the reference point and / or to guide a person from the reference point to the position of a sought-after component.

[0052] Preferably, the display system can be configured such that the component being sought can be specified by means of the display system. Preferably, the display system can be configured such that the component being sought can be specified by means of a user input on the display system. The user input can be, for example, a haptic input, such as tapping, swiping, operating an input console, and / or the like, and / or an acoustic user input, such as a voice command and / or the like.

[0053] Preferably, the display system is configured to recognize the manufacturer-specific component and additionally indicate the position of the component and / or guide a person from the reference point to the position of the component. This allows a person to easily and quickly locate the component and then identify it using the display system.

[0054] Preferably, the display system is configured to output the information as navigation instructions. Such navigation instructions can be used to guide a person from the reference point to the position of the component.

[0055] This can be advantageous for assisting a person in locating a component of an agricultural machine. Using the reference point, the starting position can be reliably determined, and based on this, the path to the component can be provided in the form of appropriate instructions. Especially with complex agricultural machines comprising many components, locating a specific component can be made more reliable and faster.

[0056] According to one embodiment, it can be provided that the display system is configured to detect a movement of the display system along the machine after detecting the reference point and preferably to detect the relative positions of the display system to the machine that change according to the movement, and to adapt the generated indications depending on the detected movement, e.g., to detail them, or to update them.

[0057] Advantageously, the person can move together with the display system, taking into account the issued instructions, starting from the reference point in the direction of the component, wherein the issued instructions can preferably be updated step by step according to the movement and / or incorrect movements of the person can be detected and corrected by issuing correspondingly updated instructions.

[0058] Preferably, the instructions may include: graphic instructions, preferably arrow symbols, displayed by the display system and / or acoustic navigation commands issued by the display system; and / or switching on, controlled by the display system, a machine light that illuminates a portion of the machine comprising the component.

[0059] The display system can be configured to output appropriate control signals to the machine to control the lighting. This requires that the area where the component is located also has appropriate controllable lighting, which can be activated, for example, in a flashing mode or in a specific color to indicate to the person the area within which the component is located.

[0060] According to a further embodiment, the display system can be configured to detect a reference point marked by a graphic code, electromagnetic code, and / or optoelectronically readable code, for example, a QR code, barcode, and / or RFID code. Alternatively or additionally, it may be conceivable that a component detected by the display system can represent a reference point. Preferably, the distances and / or relative positions of components or specific components are known. It should be noted that the component can be detected without such a code.

[0061] Preferably, the display system, preferably the recording unit, can be configured to record the code.

[0062] According to a further embodiment, the display system can be configured to determine at least one of several reference points of the agricultural machine in response to the detected code; and / or to determine an identifier, e.g., a serial number, of the agricultural machine, and to determine an equipment configuration of the agricultural machine and / or position data for components of the agricultural machine based on the determined identifier.

[0063] This is particularly advantageous when several different reference points are present on the machine, each marked with a code. The instructions, in particular the navigation instructions, can then be determined from the position data and / or the location of the reference point. According to a further preferred embodiment, the display system can be configured to display a section of a 3D model of the machine comprising the reference point and / or the recorded image on the display system in response to the detected reference point.

[0064] Alternatively or additionally, the display system is configured to detect a movement of the display system along the machine and to display the detected sections of the machine, along which the display system was moved, virtually in real time as corresponding sections of the 3D model and / or the recorded image by means of the display system, preferably the display unit. Preferably, it can be provided that the 3D model moves virtually, preferably smoothly, in accordance with the detected movement, and / or that a moving display of the 3D model is produced that is adapted to the detected real movement of the display system along the agricultural machine.

[0065] The display system can be configured to display the instructions, in particular navigation instructions intended to guide a person from the reference point to a position of the component on the machine, in addition to the displayed model and / or image, for example, as an overlay or next to the displayed model or image. This further improves the user's orientation and findability of the component.

[0066] The display system can comprise a sensor device for detecting movements and / or the position of the display system, for example comprising and / or formed from an acceleration sensor, a position sensor, such as a GPS sensor, and / or a gyroscope or the like. Smartphones or tablet computers known from practice are generally equipped with such sensor devices today, as well as with corresponding application programming interfaces (so-called APIs) for detecting and processing position and / or movement data from such smartphones or tablet computers. Such sensors and / or APIs can be used here to detect the movement of the display system, so that its position relative to the reference point and / or relative to the position of the component to be changed can be continuously determined and updated.

[0067] According to one embodiment, it can be provided that position data is stored for different components of the machine, which preferably indicate their position on the machine relative to one or more reference points, and the display system is configured to access this position data. According to one embodiment, it can be provided that the display system is configured to output status information, depending on a current position of the display system relative to the detected reference point, which indicates whether the component has been reached and / or whether the display system is in the vicinity of the component.

[0068] According to one embodiment, it can be provided that the display system is configured to display at least one of the following information of the component: information on the conversion, replacement, maintenance, or configuration adjustment of the component.

[0069] According to one embodiment, it can be provided that the display system is configured to determine the component of the machine based on a user input, in particular when the recognition of the component is not clear and / or problems occur when recognizing the component.

[0070] According to one embodiment, it can be provided that the display system is at least partially designed as a smartphone, laptop, operating terminal and / or tablet computer and / or at least comprises these.

[0071] According to one embodiment, it can be provided that the machine, preferably the agricultural machine, is an agricultural distribution machine, comprising a plurality of distribution elements arranged on a distribution linkage, wherein the component is preferably a component of the distribution machine; or is a soil cultivation machine, comprising a soil cultivation tool, wherein the component is preferably a component of the soil cultivation tool.

[0072] According to a further embodiment, it can be provided that the display system is set up to display further information on the manufacturer-specific component, wherein the information is preferably provided from a digital and / or digitized reference work. The reference work is not provided in a printed version, but in a digital (i.e., electronic) version, which can be displayed, for example, by means of the display unit and / or on an additional display element. The reference work can be or include a digital spare parts catalog, e.g. in the form of a 3D spare parts catalog, in which spare parts are preferably displayed using a visualization of a 3D model, and / or a digital operating manual. The reference work has a plurality of sections, wherein at least one section is assigned to each machine component or component.It is conceivable that the additional information, preferably the reference work, is stored and / or can be stored in addition to the manufacturer-specific information or as part of the manufacturer-specific information, preferably in the database and / or another internal and / or external database.

[0073] Preferably, the display system can be configured to detect a position of the display system relative to the machine.

[0074] Preferably, the display system is configured to perform at least one or more of the following: a) access the reference work, preferably by means of the computing unit, which has a plurality of sections, wherein at least one section is assigned to each manufacturer-specific component; b) access a digital 3D model of the machine and / or the components, preferably by means of the computing unit; c) in response to a recognized manufacturer-specific component, display a section of the 3D model and / or the recorded image, preferably by means of the display unit, wherein the section comprises at least the recognized manufacturer-specific component; and d) in response to recognition of the component, display the at least one section of the reference work assigned to the recognized component or a reference thereto, preferably by means of the display unit.

[0075] The display system is preferably configured to: a) detect a reference point on the machine, preferably a reference point marked by a graphic code (1b), for example a QR code or barcode, and / or to detect a component as a reference point; and / or b) display a section of the 3D model comprising the reference point in response to a detected reference point.

[0076] Preferably, the display system is configured to detect a movement of the display system along the machine starting from the reference point, wherein, preferably starting from the section of the 3D model comprising the reference point, a movement of the 3D model corresponding to the detected movement is displayed, preferably on the display unit. Preferably, the display system, more preferably the display unit, is configured so that the displayed section of the 3D model can be enlarged using a zoom function to enlarge machine areas and / or a component.

[0077] According to a further preferred embodiment, it can be provided that a reference point of the agricultural machine can be entered or detected by means of the input terminal, and the display system is designed to access and display a 3D model assigned to the reference point in response to an entered and / or detected reference point, preferably together with at least one of the following information or a reference thereto: a serial number, an equipment configuration, an indication of the machine type, and a parts list of the agricultural machine.

[0078] Preferably, it can be provided that the at least one displayed section of the reference work and / or reference thereto: a) comprises a section of a digital spare parts catalog and / or a reference thereto; and / or b) comprises a section of a digital operating manual and / or a reference thereto, wherein the section of the digital operating manual comprises at least one of the following information: operating instructions, setting instructions, and service instructions for the recognized component.

[0079] Further preferably, the display system can be configured to process an ordering process via data communication, preferably via radio communication, with an ordering system, e.g., a business resource planning system, ERP system, or which is available or can be brought into contact with it. Preferably, the display system is configured to query ordering information, e.g., price and / or delivery time information, for the recognized component from the ordering system and display it on the display unit and / or to trigger an ordering process for the spare part via the ordering system in response to a selection of a spare part, preferably by means of a user input, relating to the recognized component.

[0080] The underlying problem is also solved by a method for displaying manufacturer-specific information, comprising the method steps: a) providing a computer-aided display system; b) capturing an image; c) detecting manufacturer-specific components and assigning manufacturer-specific information to the manufacturer-specific components; d) displaying the manufacturer-specific information.

[0081] The method preferably comprises detecting a reference point on the machine using the display system, preferably according to one embodiment. The method preferably comprises generating instructions, preferably navigation instructions, using the display system, wherein the instructions serve to guide the person from the reference point to a position of the component on the machine.

[0082] The method is preferably a computer-implemented method. The method serves to assist a person in changing a component of an agricultural machine. The method comprises detecting a reference point on the agricultural machine using the display unit. The method further comprises generating instructions, preferably navigation instructions, using the display system, wherein the instructions serve to guide the person from the reference point to a position of the component on the agricultural machine to be changed.

[0083] The method optionally further comprises determining the component of the agricultural machine to be changed by means of an input on the display system.

[0084] The method may further comprise detecting a movement of the display system by means of the display system, wherein the movement is a movement along the agricultural machine after detecting the reference point. The output navigation instructions are adapted and / or updated depending on the detected movement.

[0085] Alternatively or cumulatively, the method for displaying information about a machine component of an agricultural machine can be provided from a digital and / or digitized reference work, preferably from a digital spare parts catalog or from a digital operating manual. The method preferably comprises selecting a sub-area of ​​an agricultural machine using the display system, which is located in the immediate vicinity of the agricultural machine.

[0086] Preferably, in response to the selected sub-area of ​​the agricultural machine, the displaying on the display system of a section of a 3D model of the agricultural machine comprising the selected sub-area, wherein the section comprises at least one selectable machine component, and a machine component is selected from the displayed section of the 3D model by detecting a user input on the display system and, in response to the selection, the displaying on the display system of at least one section of the reference work associated with the selected machine component or a reference thereto.

[0087] The task is also solved by a device with a computer-aided display system.

[0088] Particularly preferably, the device may be a mobile device.

[0089] Preferably, the device may be a mobile terminal, for example a mobile phone, a smartphone, a tablet, a laptop, or the like.

[0090] The device preferably comprises the optical recording unit, the display unit, and the input terminal. It is also conceivable for the storage medium with the at least one database to be arranged within the device, whereby it can also be arranged externally or remotely from the device and connectable to the device via a data connection, either wirelessly or wired.

[0091] According to another preferred embodiment, it may be provided that the components can be recognized using machine learning. For example, it may be provided that the image sections can be recognized using deep learning.

[0092] Preferably, it may also be provided that a method for generating training data for detecting components in an image may be provided.

[0093] It is conceivable that generating the training data involves a three-dimensional capture of the component. Furthermore, generating two-dimensional images of the captured component is advantageous.

[0094] The machine could, for example, be an agricultural machine. Examples of agricultural machines include self-propelled or trailed machines, such as field sprayers, seed drills, and soil tillage machines such as disc harrows, cultivators, harrows, and hoes. Other agricultural machines are also conceivable.

[0095] For the purposes of the application, features disclosed in conjunction with other features may also be considered as disclosed independently. All features disclosed for the system, method, and device may be used in a corresponding manner with each other.

[0096] Further advantageous embodiments emerge from the subclaims.

[0097] Further objects, advantages, and benefits of the present invention will become apparent from the following description taken in conjunction with the accompanying drawings, in which:

[0098] Figure 1 shows the computer-aided display system in a preferred embodiment;

[0099] Figure 2 shows the computer-aided display system and a device with the computer-aided display system in an application;

[0100] Figure 3 Detecting a reference point;

[0101] Figure 4 Representation of navigation instructions;

[0102] Figure 5 Display of an excerpt from a reference catalogue.

[0103] In the figures, identical components are designated by the same reference symbols, although in some figures the reference symbols may be omitted for the sake of clarity.

[0104] Figure 1 shows a purely schematic representation of a computer-aided display system 1, which will be explained using the schematic diagram. Dashed lines in this case represent signaling connections, i.e., for the exchange of data between the respective components.

[0105] It is shown that the computer-aided display system 1 comprises a computing unit 5, wherein a data processing program 13 can be executed by the computing unit 5 for processing at least one recorded image 4.

[0106] The image 4 is recorded by an optical recording unit 3, which is connected to the display system 1, at least in terms of signaling, so that the image 4 recorded by the recording unit 3 can be transmitted to the display system 1 and processed there. According to the invention, the computing unit 5 with the data processing program 13 can recognize manufacturer-specific components 6 in the recorded image 4.

[0107] To assign manufacturer-specific information 7 to detected components 6, one or more databases 8, which can be stored or stored, for example, in a storage medium 9, can be provided, wherein the manufacturer-specific information is stored in the at least one database 8. For this purpose, the display system 1 is connected to the at least one database 8 via signaling and can retrieve the corresponding information from the database 8.

[0108] To retrieve the manufacturer-specific information, it may be provided that appropriate authentication 11 is provided in order to ensure that only authorized users can access the database 8.

[0109] Further preferably, an input terminal 10 can be signal-connected to the display unit 1 to enable user input. An input terminal 10 can, for example, be a keyboard, a touch-sensitive input device, or the like.

[0110] The display system 1 can also preferably be signal-connected to a display unit 12 in order to be able to display the associated manufacturer-specific information to the user. For this purpose, the display system 1 can transmit the at least one recorded image 4 and / or the manufacturer-specific information 7 to the display unit 12.

[0111] Figure 2 shows the computer-aided display system 1 or a device 100 with the computer-aided display system 1, wherein a machine 2 is shown, at least partially, and of which at least one image 4 is created, which is referred to as recorded image 4.

[0112] As can be seen, the recorded image 4 and the manufacturer-specific information 7 are displayed by means of the display unit 12. It is also possible to see which components 6 have been detected, which in this case are preferably visually highlighted by a border. Figure 2 shows that two components 6 have been detected. By means of a user input, for example tapping the touch-sensitive screen of the display unit 12, a selection can be made as to which manufacturer-specific information 7 should be displayed, for example by tapping the corresponding image section 6. The manufacturer-specific information 7 is preferably only displayed after selection.

[0113] Preferably, the manufacturer-specific information 7 assigned to a component 6 can be visually assigned to the component 6.

[0114] The display system 1 is preferably configured to detect a reference point 14. The reference point 14 or its position is marked in this case by a graphic code 15, for example a QR code, which is shown as an example in Figure 3. The reference point 14 defines a predefined reference position with respect to the machine 2 as the starting position, relative to which the position of the component 6 can be determined or stored. The display system 1 is configured to detect the code 15 by the code 15 being read by the recording unit 3, for example by a camera. For this purpose, the display system 1 should be brought into the immediate vicinity of the reference point 14, preferably the code 15. By detecting the reference point 14, the position of the display system 1 relative to the machine 2 is known.

[0115] Furthermore, the display system 1 can be configured to generate instructions 16, preferably navigation instructions 16, which serve to guide a person P from the reference point 14 to a position of the component 6 of the agricultural machine 1. The navigation instructions 16 can comprise graphic navigation symbols, e.g., arrow symbols, which indicate the direction in which the person P should move to reach the position of the component 6. This is illustrated in Figure 4.

[0116] Preferably, the display system 1 is configured to detect a movement of the display system 1 along the machine 2 after detecting the reference point 2. This allows a movement of the person P carrying the display system 1 to be detected. The display system 1 is configured to determine the current position of the person P or the display system 1 and preferably also to update it. Depending on this, the output navigation instructions are adapted and / or updated depending on the detected movement.

[0117] The display system 1 is configured to detect a movement of the display system 1 along the machine 2 after detecting a reference point 14 and to adapt or update the generated information 16 depending on the detected movement. To detect the movement, the display system 1 is configured to evaluate data from an acceleration sensor and / or the gyroscope of the display system 1. Based on this data, a relative position of the display system 1 relative to the machine 2 can be determined, and in particular, a movement of the display system 1 relative to and along the machine 2 can be determined.

[0118] An optional embodiment provides that, in response to the detected reference point 14, a section 17 of a 3D model 18 of the machine 2 comprising the reference point 14 can be displayed on the display system 1, for example the display unit 12. Furthermore, the detected sections of the machine 2, along which the display system 1 is moved, are displayed quasi in real time as corresponding sections 17 of the 3D model 18 on the display system 1, preferably in such a way that the 3D model 18 moves virtually according to the detected movement, preferably moves smoothly, and / or that a moving display of the 3D model is produced that is adapted to the detected real movement of the display system 1 along the machine 2.

[0119] The display system 1 is configured to output status information, depending on a current position of the display system 1 relative to the detected reference point 14, indicating whether the component 6 has been reached by the person P and / or whether the display system 1 is located in the vicinity of the component 6. If the person reaches the location where the component 6 is located, this location can be indicated by highlighting the person P.

[0120] Preferably, the reference point 14 is arranged at a fixed, externally accessible location of the machine 2. The reference point 14 is located here, purely by way of example, at the front area of ​​a frame.

[0121] The machine 2 can be visualized using the 3D model 18. The digital 3D model is used to help a person P select component 6 for which he or she would like to display information from a spare parts catalog or operating manual.

[0122] The display system 1 is configured to display manufacturer-specific information on components 6 of the machine 2, preferably from a digital reference work, preferably from a digital spare parts catalog or from a digital operating manual.

[0123] The display system 1 is configured to access the reference work, which has a plurality of sections, with at least one section being assigned to each component 6. The display system 1 is further configured to access the digital 3D model 18 of the machine 2. For this purpose, the reference work and the digital 3D model 18 can be stored in a data memory of the display system 1, and / or the display system 1 is configured to access one or more external data servers that provide this data via remote data retrieval.

[0124] Code 15 simultaneously encodes an identifier of machine 2, by which machine 2 can be uniquely identified. The identifier can be a serial number of machine 2. Alternatively, the user can be prompted to enter the serial number manually. Using the identifier, the 3D model 18 associated with machine 2 can be determined, which corresponds to the specific configuration of the machine 1 in question.

[0125] Preferably, the display system 1 is configured to display the recorded image 4 by means of the display unit 12 and / or the associated 3D model 18.

[0126] Preferably, the reference point 14 is assigned a corresponding reference point in the 3D model 18. The display system 1 is configured to display a section of the 3D model 18 comprising the reference point 14 in response to a reference point 14 detected by the display system 1.

[0127] This is illustrated by way of example in Figure 5. For example, person P would like to display information from a spare parts catalog for component 6.

[0128] If the person P is located near the desired component 6, the component 6 can be recognized by the display system 1, preferably the computing unit 5. In response, the display system 1 is configured to display a section 20 of the reference work 19, which can be associated with the recognized component 6, or a reference thereto, by means of the display unit 12.

[0129] Preferably, a section of a 3D spare parts catalog from the manufacturer-specific information 7 can be displayed, preferably by a corresponding selection from the manufacturer-specific information 7. This can be displayed, for example, in a 3D exploded view, wherein the individual parts or spare parts are identified by reference symbols. The person can also display ordering information for the spare parts of component 6, e.g., order numbers, and initiate ordering processes. To process an ordering process, the display system 1 is connected to an ordering system, e.g., a business resource planning system, ERP system, via data communication, preferably via radio communication. Current ordering information for component 6, e.g., price and / or delivery time information, can be retrieved from the ordering system and displayed on the display unit 12.

[0130] All features disclosed in the application documents are claimed as essential to the invention, provided that they are new, individually or in combination, compared to the prior art.

[0131] List of reference symbols

[0132] 1 display system

[0133] 2 machines

[0134] 3 optical recording unit

[0135] 4 captured image

[0136] 5 Computing unit

[0137] 6 Component / part

[0138] 7 manufacturer-specific information

[0139] 8 Database

[0140] 9 Storage medium

[0141] 10 Input terminal

[0142] 11 Authentication

[0143] 12 Display unit

[0144] 13 Data processing program

[0145] 14 Reference point

[0146] 15 graphic code

[0147] 16 Note / Navigation note

[0148] 17 Excerpt

[0149] 18 3D model

[0150] 19 Reference work

[0151] 20 Section of the Reference Work

[0152] 100 device

[0153] P Person

Claims

Patent claims 1. Computer-aided display system (1) for displaying manufacturer-specific information (7) of a machine (2), in particular an agricultural machine, wherein the display system (1) is provided and designed to be connectable, at least in terms of signal technology, to an optical recording unit (3) which is configured to record images (4) and to receive at least one image (4) from the recording unit (3), wherein the display system (1) has a computing unit (5) and a data processing program (13) executable by the computing unit (5) for processing the at least one recorded image (4), characterized in that manufacturer-specific components (6) of the machine (2) can be recognized in the at least one recorded image (4) by the computing unit (5),wherein the manufacturer-specific components (6) can each be assigned manufacturer-specific information (7) and the assigned manufacturer-specific information (7) can be displayed., 2. Computer-aided display system (1) according to claim 1, characterized in that the recognition of the manufacturer-specific components (6) is free from recognition of an optoelectronically readable code, for example a barcode, a QR code, or the like.

3. Computer-aided display system (1) according to claim 1 or 2, characterized in that the manufacturer-specific information (7) is stored and / or can be stored in at least one database (8) and can be retrieved from the at least one database (8), wherein the at least one database (8) is stored and / or can be stored in an external and / or internal storage medium (9).

4. Computer-aided display system (1) according to claim 3, characterized in that the at least one database (8) can be updated, changed and / or deleted with regard to the manufacturer-specific information (7).

5. Computer-aided display system (1) according to claim 3 or 4, characterized in that an authentication (11) is necessary to retrieve the manufacturer-specific information (7) from the database, wherein the authentication (11) determines whether the retrieval of the manufacturer-specific information (7) from the database (8) is denied or permitted and / or to what extent the manufacturer-specific information (7) is accessible.

6. Computer-aided display system (1) according to one of claims 1 to 5, characterized in that for displaying the manufacturer-specific information (7), an input of a serial number and / or a specifying information can be provided before or after the recognition of the manufacturer-specific components (6) in order to be able to correctly assign the manufacturer-specific information (7).

7. Computer-aided display system (1) according to one of claims 1 to 6, characterized in that the display system (1) can be connected to a display unit (12) which is configured to display the associated manufacturer-specific information (7).

8. Computer-aided display system (1) according to claim 7, characterized in that only the associated manufacturer-specific information (7) can be displayed by means of the display unit (12).

9. Computer-aided display system (1) according to claim 7, characterized in that the at least one recorded image (4) with the associated manufacturer-specific information (7) can be displayed by means of the display unit (12).

10. Computer-aided display system (1) according to claim 9, characterized in that the recognized manufacturer-specific components (6), to which manufacturer-specific information (7) is assigned, can be visually highlighted.

11. Computer-aided display system (1) according to claim 10, characterized in that the associated manufacturer-specific information (7) can be displayed by means of a user input on a visually highlighted component (6).

12. Computer-aided display system (1) according to one of claims 9 to 11, characterized in that only the at least one recorded image (4) and the associated manufacturer-specific information (7) can be displayed.

13. Computer-aided display system (1) according to one of claims 9 to 12, characterized in that the associated manufacturer-specific information (7) in which can be displayed on at least one recorded image (4) in such a way that they are visually assigned to the manufacturer-specific components (6).

14. Computer-aided display system (1) according to one of claims 1 to 13, characterized in that the at least one recorded image (4) is a fixed image, a series of images or a continuously recorded image.

15. Computer-aided display system (1) according to one of claims 1 to 14, characterized in that the manufacturer-specific information (7) comprises one of the group: article number, material information, purchase information, setting information, documentation information, and any combination thereof.

16. Computer-aided display system (1) according to claim 15, characterized in that it is possible to select which of the manufacturer-specific information (7) is to be displayed by means of a user input.

17. Computer-aided display system (1) according to one of claims 1 to 16, characterized in that the computer-aided display system (1) is set up to detect a reference point on the machine (2) and to determine the relative position of the display system (1) to the machine (2), wherein preferably the display system (1) is set up to generate instructions which serve to provide a position of a sought-after component starting from the reference point and / or to guide a person starting from the reference point to the position of the sought-after component.

18. Computer-aided display system (1) according to one of claims 1 to 17, characterized in that the display system (1) is configured to perform at least one or more of: a) accessing a reference work comprising a plurality of sections, wherein at least one section is assigned to each manufacturer-specific component, b) preferably by means of the computing unit, accessing a digital 3D model of the machine (2) and / or the manufacturer-specific components; c) in response to a recognized manufacturer-specific component, displaying a section of the 3D model, wherein the section comprises at least the recognized manufacturer-specific component, and (d) in response to detection of the component, display the at least one section of the reference work associated with the detected component or a reference thereto.

19. A method for displaying manufacturer-specific information (7), comprising the method steps: a) providing a computer-aided display system (1), preferably a computer-aided display system (1) according to one of claims 1 to 18; b) recording an image (4); c) recognizing manufacturer-specific components (6) and assigning manufacturer-specific information (7) to the manufacturer-specific components (6); d) displaying the manufacturer-specific information (7).

20. Device (100) with a computer-aided display system (1) according to one of claims 1 to 18.

21. Device (100) according to claim 20, characterized in that the device (100) is a mobile device.

Images