VISUALIZATION OF QUALITY INFORMATION

Description

[0001] The invention relates to a method and a device for displaying quality information of an object and a use for displaying quality information of an object.

[0002] In the manufacture or production of objects, especially flat steel, it is well known that continuous quality monitoring is required. Therefore, the manufactured or produced object, especially the so-called strip in flat steel production, is inspected by trained observers or users in so-called inspection stations and downgraded accordingly in the event of quality problems (defects). It is known that users can be supported by inspection systems that can detect and classify quality defects in real time.

[0003] EP 3 009 833 A1 discloses an in-process defect inspection using augmented reality. It describes an arrangement for optical defect inspection of at least one component during the component manufacturing process. The arrangement comprises a defect detection unit, by means of which the detected defect information is superimposed on the component in real time and can be made visible to the user with the aid of a visualization unit. All necessary defect information is available to the user in real time in the component image displayed by the visualization unit.

[0004] US 2016 / 0321841 A1 discloses an augmented reality system with a transparent display so that a user can view an object in real life.

[0005] US 2013 / 0293580 A1 discloses a system and method for selecting targets in an augmented reality environment using see-through glasses.

[0006] It has been shown that the user's view of the object to be assessed with regard to quality information cannot be replaced by a fully automated representation, since the conversion of the component into a component image can result in the loss of information that is no longer available for an assessment with regard to quality information.

[0007] The object of the present invention is therefore to provide an improved possibility of assessing the quality of an object.

[0008] This object is achieved according to the subject matter of the independent patent claims. Advantageous embodiments can be found in the dependent claims and the description.

[0009] The invention is based on the basic idea that the user can see, at least partially in one viewing direction and without having to move their head, both the real object and the quality information determined by an inspection system and assigned to the part of the object actually viewed by the user. The basic idea is that there is no need to constantly switch views between a display and a real object. Quality information from one or more inspection systems or model-based quality information can be shown using the display, whereby what the user actually sees is determined in order to adapt the quality information to the part of the object actually seen by the user. The user can see the real object together with the quality information assigned to the actual object or the part of the object to be seen without changing their viewing direction.

[0010] The invention provides a method for displaying quality information about an object. In the method, the quality information is displayed to a user. A relative movement occurs between the display and the object. The user actually sees at least a portion of the object, and what the user actually sees is determined. The quality information is adapted to what the user actually sees, such that the quality information can appear directly on the object via the display. This allows the quality information to be displayed in the correct position on the object to be assessed, and the position of the quality information can be continuously corrected by synchronizing the determination of what the user actually sees. The quality information on the display can remain constant relative to the moving object.

[0011] The quality information shown on the display can be synchronized with the part of the object that the user sees, in particular by means of a control device. The control device can have a computer, a microprocessor and / or command and / or data processing hardware that can process the signals from an inspection system in order to be able to show them on the display. The control device can be connected to the display wirelessly or with a cable. The control device can be connected directly or indirectly to an inspection system that automatically determines quality information, whereby the connection between the control device and the inspection system can be wireless or with a cable. The inspection system can in particular be a system that optically determines quality information.For a moving object, the speed and / or movement data of the object can be communicated to the control device via an input or a measured value directly or indirectly detected by the control device. Especially with a display that is stationary relative to the object, synchronization can be easily achieved using the object's speed.

[0012] The control device can be used to synchronize the display and the part of the object that the user sees.

[0013] For the purposes of this description, the term "quality information" includes all information that can be clearly assigned to a position on the object and thus visualized, such as visible defects such as flatness deviations, surface roughness, cracks, hole-like defects, abnormalities in texture, color or gloss, as well as model results.

[0014] The above description of the term "quality information" reveals that "quality information" can be more than a single measured value. Quality information can, for example, also include data determined for the position by one or more measurement and / or inspection systems, whereby the data can also be combined to form new, model-based quality information, which is described above as a model result. In addition to a description of the quality of a position on the object, the term "quality information" can also include or be information that provides clues or conclusions about the system used to process the object. For example, defects that periodically occur on the object can allow conclusions to be drawn about an error or damage in a process step during the processing of the object, for example, during rolling using a damaged roller.The quality information thus allows conclusions to be drawn that the system may be defective during a processing step, particularly with regard to a roller. Process speeds, particularly the object speed, can also be adjusted during processing if critical damage to the object is observed. Furthermore, the quality information can contain or be information about whether an error due to the last process step—performed immediately before the object was observed or inspected—led to a certain quality or defect, or whether the object already exhibited a corresponding quality at the corresponding position before the last process step.

[0015] The term "quality information" thus encompasses not only any information about a position on the object with respect to a property of that position, but also tuples or combinations of information. The quality information can be used, partially or completely, to draw conclusions about possible defects in a system performing a processing step on the object. The quality information can be preprocessed, summarized, postprocessed, and / or further processed, so that the quality information can be modified and / or combined information from a user and / or one or more measurement and inspection systems. The quality information can, in particular, comprise one or more alphanumeric character strings.

[0016] An "object" within the meaning of the description encompasses any type of product to be produced or manufactured, in particular moving objects that, for example, also experience movement through or during their production. An object can, in particular, be web-shaped, as occurs, for example, in the production of webs of metal, paper, cardboard, foil, textile, and / or fabric. The object can comprise a body, in particular a planar body. For example, the object can be a sheet metal, in particular a metal sheet, most preferably a steel sheet. The object can also be a body that is moved during production, in particular a rolled or formed body, in particular a steel slab, a steel billet, or a steel beam.

[0017] The term "relative movement" in the sense of the description particularly encompasses a movement that occurs between the display and the object. The display can be worn by a user who can hold or wear the display, particularly in the direction of view toward the object, particularly in the form of glasses. The display can be a fixed display relative to the moving object, in particular being fixed to a device associated with a movement of the object. The display can be arranged as a monitor or screen on an inspection stand above the object to be inspected. The display can also be a projection that occurs in the direction of view on the object to be inspected. A display, in the sense of the description, is also understood to mean a head-up display that is arranged on the object, particularly a moving object.

[0018] The term "relative movement between display and object" as used in this description includes any form of movement between display and object, whereby, in particular, when the object is moved, the display may remain essentially at rest relative to the user.

[0019] If the objective is to determine what the user actually sees, this is understood in the context of the description to mean that it is possible to determine what is visibly available to the user for observation or inspection in the vicinity or adjacent to the user. By essentially simply synchronizing the path speed with the display, the quality information that can be displayed on the display can be adjusted, and the quality information can be assigned to the actual visible object or a portion of the visible object.

[0020] According to the present invention, a user input is recorded, which is then assigned as quality information to the actual viewed portion of the object. This allows the user to assign quality information to the actual viewed portion of the object using the input during the manufacture or creation of the object. The quality information can be logged.

[0021] In a preferred embodiment, the user's input, which can be assigned as quality information to the actual viewed portion of the object, is processed using a tracking sensor system. The sensor system can be an optical, magnetic, electrical, or mechanical sensor with which the position, orientation, and / or movement of the user can be detected. Detection can be achieved, for example, by sensors attached to the user, such as gyro sensors, or by one or more cameras directed at the user (optical tracking). In particular, the sensor system can detect the movement of the user's head, an arm, a hand, and / or an eye.

[0022] In a preferred embodiment, the user input, which can be assigned as quality information to the real observer in the partial area of the object, is made by means of an acoustic input. An acoustic sensor can be used for this purpose. The acoustic sensor can be connected to a speech recognition and voice control system. The acoustic sensor can be a sound transducer, in particular a microphone, as is known from the prior art. Using the speech recognition and voice control system connected to the acoustic sensor, the user can make inputs as are known in principle in other fields.

[0023] In a preferred embodiment, the displayed quality information is confirmed, denied, and / or changed by the user's input. This allows for particularly effective quality assurance, as the quality information from one or more inspection systems is made available to the user, with the display being able to be precise. The user can then, in turn, verify or falsify the quality information, which is provided precisely based on the actual observation of the object.

[0024] According to the present invention, new quality information can be added to the object via the input, or the object or sub-areas of the object can be evaluated. The new quality information can be additional quality information that was not displayed to the user. The new quality information can also be used to react to a state of the object or a sub-area of the object that is not displayed to the user. The input can be used to react flexibly to a state of the object or a sub-area of the object, even though the quality information is not displayed to the user. The user's experience when viewing the object is taken into account by allowing them freedom in entering and evaluating the object or sub-area of the object and in adding quality information.

[0025] The invention also provides a device for displaying quality information about an object, wherein the device has a display that allows relative movement between the object and the display. The quality information can be displayed to a user on the display. The display is adapted for real detection of at least a partial area of the object. The adaptation is carried out in particular in such a way that the user is given the opportunity to actually detect the object without changing the viewing angle. Furthermore, a control device is provided that is designed to display associated quality information depending on what the user actually sees. The phrase "depending on what the user actually sees" is to be understood in such a way that a local and position-dependent display is displayed on the object itself, allowing the user to view the display and the object itself.

[0026] In a preferred embodiment, a tracking sensor system is provided, which can be used to input quality information. The control device is designed to assign the quality information to the actual viewed portion. This provides a simple way to allow the user to enter information without having to take their eyes off the object to be inspected and the quality information assigned to the object to be inspected on the display. Tracking sensors offer the possibility of allowing the user to input variable information. The user can also generate new quality information and assign it to the object in the correct position, or evaluate the object or portions of the object.

[0027] According to the present invention, a storage device is provided for a location-dependent assignment of quality information of the object. This allows the quality to be assigned depending on the actual object, so that, for example, a partial area of the object can be discarded, while another area can be identified as an area of high quality.

[0028] The invention also provides a use for displaying quality information about an object using a display that allows relative movement between the object and the display. The display used is a display that allows at least a view of the object, which is synonymous with "freeing up." The position of the object in space relative to the display is detected and used to assign the quality information.

[0029] The statements in the description regarding the aspects of the method, the device, and the use are to be viewed as complementary to one another. Individual aspects of the method can be used for the device and / or the use. The individual aspects of the method, the device, and the use are not mutually exclusive.

[0030] The invention is explained in more detail below with reference to drawings which show embodiments of the invention.

[0031] Showing: Fig. 1 a device according to the invention in a highly schematic representation; Fig.2 a device according to the invention according to a further embodiment; and Fig. 3 a device according to the invention in yet another embodiment.

[0032] Fig. 1 shows a device for displaying quality information of an object 1. The device has a display 2. In the Fig. 1 In the embodiment shown, the object 1 is shown as a belt to be inspected, in which the object 1 allows movement relative to the stationary display 2. The display 2 is essentially stationary relative to an inspection stand which is located to the right of the display 2 in Fig. 1 is located, and the object 1 can move beneath the display 2 in the direction indicated by the arrow. Quality information, such as surface roughness, can be displayed to a user on the display 2. The quality information is determined by an inspection system 4 arranged upstream of the inspection stand. The display 2 is arranged such that the display 2 is adapted for the actual detection of at least a partial area of the object 1. A control device 3 of the apparatus, which is connected to the display 2, is designed to display the associated quality information depending on what the user actually sees on the display 2. If the object 1 moves, the display 2 changes so that the quality information is shown in the correct position relative to the inspected object 1 arranged beneath it. The position of the quality information changes with the movement of the object 1.For example, in the case of the object 1 represented as a band, synchronization with the movement of the band can be achieved by means of the control device 3, so that the position of the quality information remains constant relative to the moving object 1.

[0033] The Fig. 2 shows in a highly schematic representation a projection of the quality information onto the real object 1. The display 2 is in the embodiment of the Fig. 2 thus essentially a projector that is connected to the control device 3.

[0034] In the Fig. 3 In the highly schematically illustrated embodiment, the display 2 is designed as a device similar to glasses, so that the user is able to view the object 1, but the glasses-like display 2 also displays quality information. By determining the position of the display 2 designed as glasses, the precise and positional representation of the quality information on the real object 1 is possible. Fig. 3 In the embodiment shown, the connection between the control device 3 and the display 2 is wireless by means of a suitable radio technology.

Claims

1. Method carried out by a device for representing quality information of a web-shaped object (1) moving during manufacture, - wherein the quality information comprises a description of the quality of a position on the object, and - wherein the device comprises a display (2) which permits a relative movement between object (1) and display (2), the display (2) being designed as a display held or carried by the user or as a display which is fixed relative to the moving object, and - wherein the quality information is displayed to a user on the display, characterized in that - the user can see the real object together with the quality information which is assigned to the real object to be seen or to the at least partial area to be seen without changing the viewing direction, and - depending on what the user actually sees, an associated quality information is displayed by a control device (3) of the device, wherein the associated quality information is displayed directly on the object by means of the display, wherein the position of the object in space relative to the display is detected and is used for an assignment of the quality information, and wherein the position of the quality information is continuously corrected by synchronization, and - wherein an input of the user is detected by a sensor system of the device, the input being assigned as quality information to the real viewed partial area of the object (1), wherein a new quality information is added to the object (1) by means of the input, and - wherein the device has a memory device for a location-dependent assignment of quality information to the object (1), and wherein the new quality information is an additional quality information which was not displayed to the user.

2. Method according to claim 1, characterized in that the input is made by means of a tracking sensor system.

3. Method according to claim 1, characterized in that the input is made acoustically.

4. Method according to any one of claims 1 to 3, characterized in that the input confirms, denies and / or changes the displayed quality information.

5. Method according to any one of claims 1 to 4, characterized in that the quality information also comprises or is information that provides indications or conclusions about the equipment with which the object (1) is processed.

6. Device for displaying quality information of a web-shaped object (1) moving during manufacture, - wherein the quality information comprises a description of the quality of a position on the object and - the device has a display (2) which permits a relative movement between object (1) and display (2), the display (2) being designed as a display held or carried by the user or as a display which is fixed relative to the moving object, and on which the quality information can be displayed to a user, characterized in that the user can see the real object together with the quality information, which is assigned to the real object to be seen or to the at least partial area to be seen, without changing the viewing direction, and - the device has a control device (3) which is designed to display an associated quality information as a function of what the user actually sees, the associated quality information being displayed directly on the object by means of the display, - wherein the position of the object in space relative to the display is detected and is used for an assignment of the quality information and, - wherein the position of the associated quality information is continuously corrected by synchronization, and - an input of the user is detected by a sensor system of the device, the input being assigned as quality information to the real observed partial area of the object (1), - wherein a new quality information is added to the object (1) by means of the input, and - the device has a memory device for a location-dependent assignment of quality information to the object (1), wherein the new quality information is an additional quality information which was not displayed to the user.

7. Device according to claim 6, characterized in that the sensor system is a tracking sensor system with which the new quality information can be entered.

8. Device according to claim 6, wherein the web-like object may comprise webs of metal, paper, cardboard, foil, textile and / or fabric which undergo movement by or during their manufacture.