Method and control unit for carrying out service work on a passenger transport system

Abstract

A method for carrying out service work on a passenger transport system (14) is proposed. The method comprises: receiving image data (BD) of a scene (12) with a component (16) of the passenger transport system (14); determining which component (16) of the passenger transport system (14) is involved, with reference to a digital doppelgänger of the passenger transport system (14); determining at least one property of the component (16) with reference to the doppelgänger data (DD) of the digital doppelgänger; generating a display signal (AZ) for an optical display (30) in such a way that the property of the component (16) is visually assigned to said component; comparing the component (16) represented by the image data (BD) with the digital representation of the component (16) with reference to the image data (BD) and the doppelgänger data (DD); and determining whether the component (16) is or is not to be exchanged.

Description

[0001] Method and control unit for performing service work on a passenger transport system

[0002] The present invention relates to a method and a control unit for carrying out service work on a passenger transport system which is designed as an elevator, escalator or moving walkway.

[0003] Passenger transport systems of the aforementioned type are used to transport people or loads on or within buildings, for example, between different height levels or within a constant height. For example, escalators, also known as moving walkways, and elevators are used to transport people from one floor to another within a building. Moving walkways can be used to transport people within a floor on a horizontal plane or on a slightly inclined plane.

[0004] Passenger transport systems typically comprise multiple assemblies, each composed of individual components. When performing service work on passenger transport systems, the assemblies, particularly the components, may be inspected and replaced if necessary. For this purpose, the responsible service personnel require extensive knowledge of the respective passenger transport system, particularly the corresponding assemblies and components, and of how the components are to be replaced and / or assembled. The technical complexity of such passenger transport systems can also result in service personnel performing work iteratively if the components responsible for a malfunction could not be clearly identified in advance.In particular, service personnel should know which components of the passenger transport system should be inspected and after which period of operation, when and / or why the relevant components should be replaced, how to recognize that the relevant components need to be replaced, and, if replacement is necessary, how the relevant components should be replaced. This requires extensive training and, in some cases, years of experience before service personnel are able to perform the relevant service work.

[0005] Furthermore, it is known to adapt a passenger transport system during production to customer requirements and the conditions of the destination, which is also referred to as "order picking." For example, EP 3 724 118 B1 describes the order picking of a passenger transport system using a digital twin.

[0006] There may be a need, among other things, for a method for carrying out service work on a passenger transport system more simply and stringently, which contributes to the service work being carried out easily, precisely and / or with little learning effort by the service personnel applying the method.

[0007] Such a need can be met by the subject matter according to the independent patent claims. Advantageous embodiments are explained both in the dependent claims and in the following description.

[0008] According to a first aspect, a method for performing service work on a passenger transport system configured as an elevator, escalator, or moving walkway is described. The method comprises: receiving image data representative of an image showing a scene with a component of the passenger transport system; determining which component of the passenger transport system is involved based on doppelganger data of a digital doppelganger of the passenger transport system, which has a digital representation of the component; determining at least one property of the component based on the doppelganger data; generating a display signal for an optical display such that, in response to receiving the display signal, the optical display optically displays the property of the component such that, when viewing the scene using the optical display, the property can be recognized as being assigned to the component;Comparing the component represented by the image data with the digital representation of the component based on the image data and the duplicate data; determining whether the component should be replaced based on the comparison; generating an enable signal representative of not replacing the component if the comparison indicates that the component should not be replaced; and generating a replacement signal representative of not replacing the component if the comparison indicates that the component should be replaced.

[0009] According to a second aspect, a control unit for a service device for performing service work on the passenger transport system is described. The control unit comprises: a memory unit for storing the image data representative of the image showing the scene with the component of the passenger transport system, and the doppelganger data of the digital doppelganger of the passenger transport system, which comprises the digital representation of the component; and a processor communicatively coupled to the memory unit and configured to execute the method implemented in a program described above and below. The program stored in the memory unit with the implemented method can be retrieved by the processor for execution.

[0010] It should be noted that some of the possible features and advantages of the invention are described herein with reference to the different aspects and to different embodiments of the aspects. In particular, possible features and advantages of the invention are described partly with reference to embodiments of the method and partly with reference to embodiments of the control unit. A person skilled in the art will recognize that the features described for individual embodiments can be suitably transferred to other embodiments and / or other aspects, and features can be suitably combined, adapted, and / or exchanged to arrive at further embodiments of the invention.

[0011] The method can be processed, for example, by means of the control unit of the service device. Preferably, the method can be computer-implemented and / or carried out partially or fully automatically, for example with the aid of the control unit. In particular, the control unit can receive the image data, determine which component of the passenger transport system is involved, determine the property, generate the display signal, the release signal, and the replacement signal, perform the comparison, and determine whether the component should be replaced. The service device can, for example, be augmented reality (AR) glasses, a mobile phone, a tablet, or a laptop belonging to service personnel performing the service work. The image data can, for example, be generated by a camera that captures the scene, sent to the control unit, and received by the control unit.The camera can be, for example, a camera on the service device and / or a CCD camera. The optical display can be a display on the service device.

[0012] The fact that the optical display visually represents the property of the component in such a way that the property is assigned to the component means, for example, that the optical display visually represents the property of the component in such a way that the property is assigned to the component when the scene is viewed. The fact that the optical display visually represents the property of the component in such a way that the property is assigned to the component when the scene is viewed means, in particular for all optical displays except for AR glasses, that the scene is shown on the corresponding display and that the property is additionally shown on the display in such a way that it is assigned to the component, for example, superimposed on the component. In these cases, the display signal must therefore be generated in such a way that it also contains image information about the scene. In contrast, in the case of AR glasses as an optical display, the lenses of the AR glasses correspond to the display of the AR glasses.In this case, the display is largely transparent, allowing the scene to be viewed through the lenses of the AR glasses and not having to be artificially displayed on the lenses. Accordingly, in the case of AR glasses as a visual display, the display signal does not need to contain any information about the scene. The fact that the visual display visually represents the component's property in such a way that the property is assigned to the component when viewing the scene means, in the case of AR glasses as a visual display, in particular that the service personnel view the real scene through the lenses of the AR glasses, and that the property is displayed on the lenses in such a way that it is assigned to the component, for example, superimposed on the component. Such an overlay can be, for example, a red border around the component, a text field with an arrow pointing at the component, and the like. The digital doppelganger can also be referred to as a digital twin.The digital doppelganger is represented by a corresponding digital data set, for example referred to as the doppelganger data. The doppelganger data can be stored in the memory unit and retrieved by the processor as needed. The digital doppelganger, in particular the doppelganger data, can be generated and stored, for example, as described in the prior art cited at the outset. Alternatively, other methods known from the prior art can also be used to create the digital doppelganger or the doppelganger data. The digital doppelganger, in particular the doppelganger data, has digital representations of target states of a plurality of components and assemblies of the passenger transport system and thus the properties of the components, wherein each assembly consists of two or more of the components.Ideally, the digital doppelganger has digital representations and thus the properties of all components of the passenger transport system, which are available digitally in the form of the doppelganger data. The property of the component can, for example, relate to an external shape of the component. For example, the external shape of the component can be specified by at least one and / or possibly additional properties of the component. For example, the external shape can be specified by one or more contours of the component, whereby the contours can be specified as properties of the component and as part of the doppelganger data.

[0013] Comparing the component represented by the image data with the digital representation of the component based on the duplicate data can, in particular, result in the detection of one or more differences between the corresponding real component and the digital representation of the component. Comparing the component represented by the image data with the digital representation of the component based on the duplicate data is performed automatically. This automatic comparison can be performed using a conventionally programmed algorithm. Alternatively, the automatic comparison can be performed using artificial intelligence and / or machine learning.For example, the AI ​​can be trained using a large number of image data representing images with components and a large number of digital representations of the components to recognize the components based on the image data and compare them with the corresponding digital representations. The training data, in particular the image data, for training the AI ​​can be created, for example, using a program for creating the digital doppelganger. In particular, a large number of digital doppelgangers can be created in which one or more components are defective and / or worn and need to be replaced.From these "faulty" or "worn out" digital doppelgangers, especially components, the image data showing the supposedly faulty and / or worn out component(s) can then be generated to train the artificial intelligence, so that after training the artificial intelligence is able to recognize, based on the received image data and the digital doppelganger, whether the component(s) should be replaced or not.

[0014] According to one embodiment, when comparing the component represented by the image data with the digital representation of the component, a deviation of the component represented by the image data from the digital representation is determined, wherein it is determined that the component should be replaced if the deviation fulfills a predetermined condition, and wherein it is determined that the component should not be replaced if the deviation does not fulfill the predetermined condition. This makes it easy to determine whether the component should be replaced or not. For example, the deviation can be determined in the form of a distance and / or as a numerical value, and the condition can be met if the distance or the numerical value is greater than a predetermined threshold value. The distance can in principle be determined using any suitable mathematical distance function and / or metric.

[0015] According to one embodiment, the property of the component determined based on the duplicate data relates to a desired state of the component. An actual state of the component is determined based on the image data. When comparing the image represented by the image data with the digital representation of the component, the actual state is compared with the desired state. This can contribute to a particularly precise and / or reliable determination of whether the component should be replaced or not.

[0016] According to one embodiment, the property of the component relates to a contour of the component, and the display signal is generated such that the optical display, in response to receiving the display signal, displays the contour superimposed on the component. This can contribute to a particularly intuitive perception of the component by service personnel.

[0017] According to one embodiment, the property of the component can refer to current and / or stored operating data. The operating data is collected during operation of the passenger transport system and can be provided with a time stamp and stored in conjunction with the associated digital doppelganger. At least one property of the component can be determined from the operating data and stored in association with the component. Examples include the operating data of a frequency converter or drive motor of the passenger transport system, whose visual appearance hardly changes over its service life and whose condition (efficiency) can be determined, for example, by recording power consumption and power output. The display signal is thus generated taking this operating data into account.

[0018] According to one embodiment, the method further comprises: generating a provision signal depending on the replacement signal if the comparison shows that the component is to be replaced, wherein the provision signal is representative of the component; and sending the provision signal to a provision device configured to procure the component from a warehouse and to provide it at a removal station. This makes it possible to automatically provide a new component, with which the component of the passenger transport system is to be replaced, to the service personnel. The fact that the provision signal is generated depending on the replacement signal can, in the simplest case, mean that the replacement signal is used as the provision signal. This is possible if the provision device is capable of correctly interpreting the replacement signal.Otherwise, the provision signal can be generated depending on the exchange signal, wherein the provision signal is generated in a format that can be correctly interpreted by the provision device and that contains the same information content as the exchange signal, namely which component is involved and whether the component is to be exchanged or not. The provision device can, for example, comprise a storage robot that is configured to automatically retrieve the component from the warehouse in response to receiving the provision signal and to provide it at a removal station.

[0019] According to one embodiment, if the comparison indicates that the component should be replaced, at least one assistance for replacing the component is determined, and the display signal is generated such that the determined assistance is indicated via the visual display. This can help service personnel replace the component professionally and efficiently. Alternatively or additionally, the assistance can be output acoustically, for example, via a loudspeaker of the service device.

[0020] According to one embodiment, if the comparison shows that the component should be replaced, the method further comprises: receiving replacement data representative of an actual replacement process in which the component is replaced; checking whether the actual replacement process corresponds to a predetermined replacement process assigned to the component based on the replacement data; and generating a first warning signal if the monitored replacement process deviates from the predetermined replacement process. In other words, in response to the detection that the component should be replaced, the replacement process can be monitored. The replacement process can be monitored, for example, using one or more sensors, for example optical sensors and / or, for example, the service device. For example, the actual replacement process can be recorded using the camera of the service device.During this monitoring, these sensors generate the replacement data. The replacement data can then, for example, be sent to and received by the control unit. If the actual replacement process does not deviate from the specified replacement process, the first warning signal need not be generated. In this case, a confirmation signal can optionally be generated which represents that the actual replacement process does not deviate from the specified replacement process. The replacement process can, for example, comprise one or more work steps necessary to replace the component. Each of the work steps can comprise one or more actions of a robot, in particular one or more actuators of the robot, and / or one or more manual steps to be performed by the service personnel.

[0021] According to one embodiment, if the component is replaced, the method further comprises: detecting at least one actual parameter value associated with the replacement of the component; checking whether the detected actual parameter value corresponds to a corresponding parameter setpoint; and generating a second warning signal if the detected actual parameter value does not correspond to the corresponding parameter setpoint. If the actual parameter value corresponds to the corresponding parameter setpoint, the generation of the second warning signal can be omitted. Optionally, in this case, a confirmation signal can be generated that is representative of the fact that the actual parameter value corresponds to the corresponding parameter setpoint. The actual parameter value can also be referred to as the actual value of a parameter. The parameter associated with the replacement of the component can, for example, be a physical quantity that is important when replacing the component.For example, the parameter can refer to a torque with which a screw or nut used to fasten the component should be tightened. Alternatively, the parameter can refer to a quantity of a fluid and / or lubricant that should be introduced into the component or that should be used during assembly of the component. Optionally, two or more of the actual parameter values ​​of one or more of the parameters can be determined and checked against corresponding parameter setpoints. Optionally, the actual parameter value can be saved in conjunction with the digital doppelganger, regardless of whether the actual parameter value corresponds to the parameter setpoint or not. This makes it possible to subsequently determine the actual parameter value using the doppelganger data, at least shortly after it has been saved.According to one embodiment, the method further comprises: determining a remaining service life of the component based on the comparison if the comparison indicates that the component should not be replaced; and generating the release signal such that the release signal is representative of the remaining service life. This allows the service personnel not only to be informed that the component should not be replaced at this time, but also to be informed immediately when the component is expected to be replaced, namely after the determined remaining service life has expired.

[0022] Embodiments of the invention are described below with reference to the accompanying drawings, wherein neither the drawings nor the description are to be construed as limiting the invention.

[0023] Figure 1 shows an example of an image showing a scene with a passenger transport system according to an embodiment of the present invention.

[0024] Figure 2 shows a block diagram illustrating a function of a control unit for performing service work on the passenger transport system, according to an embodiment of the present invention.

[0025] Figure 3 shows a flowchart of an embodiment of a method for performing service work on the passenger transport system, according to an embodiment of the present invention.

[0026] The figures are merely schematic and not to scale. Identical reference numerals designate identical or equivalent features in the various figures. Figure 1 shows an example of an image 10 depicting a scene 12 with a passenger transport system 14 according to an embodiment of the present invention. The passenger transport system 14 is suitable for transporting persons, for example, in buildings between different height levels or within a constant height level. The passenger transport system 14 can be, for example, an escalator, in particular an moving staircase, an elevator system, or a moving walkway. The passenger transport system 14 can consist of several assemblies, each of which is composed of several components, wherein one of the components, namely component 16, is highlighted in Figure 1 for illustrative purposes.The component 16 can, for example, be a wearing part of the passenger transport system 1, for example a comb plate, a step roller, a step, a chain, in particular a drive chain, etc. The image 10 can be a three-dimensional image.

[0027] Figure 2 shows a block diagram illustrating a function of a control unit 20 for performing service work on the passenger transport system 14, according to one embodiment of the present invention. The control unit 20 can, for example, be a component of a service device used by service personnel (not shown) who are entrusted with performing the service work. The service device can, for example, be augmented reality (AR) glasses, a mobile phone, a tablet, or a laptop used by service personnel performing the service work.

[0028] The control unit 20 has a storage unit 24 for storing image data BD representative of the image 10 showing the scene 12 with the component 16 of the passenger transport system 14, and doppelganger data DD of a digital doppelganger of the passenger transport system 14, which has a digital representation of the component 16. The control unit 20 further has a processor 22 communicatively coupled to the storage unit 24 and configured to execute the method explained with reference to Figure 3.

[0029] For this purpose, the control unit 20 communicates with an optical display 30, with one or more sensors 32, optionally with a database 34 and optionally with a provisioning device 36. The optical display 30, one or more of the sensors 32 and optionally the database 34 can be further components of the service device.

[0030] The optical display 30 can, for example, be a display of the service device.

[0031] The control unit 20 is designed to generate a display signal AZ, a release signal FS, an exchange signal AS, optionally a first warning signal WS1, optionally a second warning signal WS2, and optionally a provision signal BS. The control unit 20 is particularly designed to send the display signal AZ to the visual display 30. Optionally, the control unit 20 can also send the release signal FS, the exchange signal AS, and / or one or both of the warning signals WS1, WS2 to the visual display 30. Alternatively or additionally, the control unit 20 can be designed to send the release signal FS, the exchange signal AS, and / or one or both of the warning signals WS1, WS2 to another display device, for example, to another visual display (not shown) or to an acoustic display device (not shown).

[0032] The control unit 20 is further configured to receive image data BD, doppelganger data DD of a digital doppelganger, and / or optionally, exchange data AD relating to an actual exchange of the component 16. The image data BD and / or the exchange data AD can be generated, for example, by one or more of the sensors 32. The doppelganger data DD can be stored in the database 34 and retrieved by the processor 22 as needed. Alternatively or additionally, the doppelganger data DD can be stored in the memory unit 24. The doppelganger data DD comprise extensive information relating to the passenger transport system 14, in particular relating to the assemblies and components of the passenger transport system 14, for example as described in the prior art EP 3 724 118 B1 cited at the outset.If the image 10 is a 3D image, the image data BD may include depth information in addition to the information required to control the pixels of the optical display 30.

[0033] For example, the image data BD can have depth information for each pixel, which is representative of how far an object shown in the pixel is from the corresponding camera that recorded the image 10. The digital doppelganger can also be referred to as a digital twin. The digital doppelganger is represented by a corresponding digital data set, in particular the doppelganger data DD. The digital doppelganger can, for example, be generated and stored as described in the prior art EP 3 724 118 B1 mentioned at the outset. Alternatively, other methods known from the prior art can also be used to create the digital doppelganger and thus the doppelganger data DD. The digital doppelganger has digital representations of target states of a plurality of components 16 and assemblies of the passenger transport system, wherein each assembly consists of two or more of the components 16.Ideally, the digital doppelganger comprises digital representations of all components 16 of the passenger transport system 14. Furthermore, the doppelganger data DD comprise properties of the components 16. The properties can, for example, relate to external shapes of the components 16. For example, the external shape of the component 16 can be predetermined by at least one and / or optionally further properties of the component 16. For example, the external shape can be predetermined by one or more contours of the component 16, wherein the contours can be stored as properties of the component 16 and as part of the digital doppelganger in the form of the doppelganger data DD.

[0034] Figure 3 shows a flowchart of an exemplary embodiment of a method for performing service work on the passenger transport system 14, according to one embodiment of the present invention. The method can be executed, for example, using the control unit 20.

[0035] In a step S2, the image data BD can be received that is representative of the image 10 that shows the scene 12 with the component 16 of the passenger transport system 14. The image data BD can be generated by the sensors 32 and received by the control unit 20. For this purpose, the sensors 32 can, for example, have a camera that captures the scene 12. The camera can, for example, be a camera of the service device and / or a CCD camera. In a step S4, it can be determined, for example by means of the control unit 20, which component 16 of the passenger transport system 14 is involved, in particular based on the digital doppelganger of the passenger transport system 14, which has a digital representation of the component 16, and / or in particular by means of an appropriately trained AI.

[0036] In a step S6, at least one of the properties of the component 16 can be determined based on the doppelganger data DD, for example by means of the control unit 20. In particular, the property can be stored as part of the doppelganger data DD. The property of the component 16 determined based on the doppelganger data DD can, for example, relate to a desired state of the component 16. An actual state of the component 16 can then be determined based on the image data BD. Subsequently, when comparing the component 16 represented by the image data BD with the digital representation of the component 16, the actual state can be compared with the desired state. In particular, the property of the component 16 can, for example, relate to a contour of the component 16. In this case, the display signal AZ can be generated such that the optical display 30, in response to receiving the display signal AZ, displays the contour superimposed on the component 16.

[0037] In a step S8, the display signal AZ for the optical display 30 can be generated such that the optical display 30, in response to receiving the display signal AZ, optically displays the property of the component 16 such that, when viewing the scene 12 using the optical display 30, the property can be recognized as being assigned to the component 16. The fact that the optical display 30 optically displays the property of the component 16 such that the property is assigned to the component 16 means, for example, that the optical display 30 optically displays the property of the component 16 such that the property is superimposed on the component 16.The fact that the optical display 30 visually represents the property of the component 16 in such a way that when the scene 12 is viewed, the property is assigned to the component 16 means, in particular for all optical displays except for AR glasses, that the scene 12 is shown on the corresponding display and that, in addition, the property is shown on the display in such a way that it is assigned to the component 16, for example, superimposed on the component 16. Thus, in these cases, the display signal AZ must be generated in such a way that it also contains image information about the scene 12. The property of the component 16 can, for example, be stored together with one, two or more further properties of the component 16, for example in the form of a component model data set of the component 16, wherein the component model data set can be part of the doppelganger data DD.

[0038] In contrast, in the case of AR glasses as optical display 30, the lenses of the AR glasses correspond to the display of the AR glasses. In this case, the display is largely transparent, so that the scene 12 can be viewed through the lenses of the AR glasses and does not have to be artificially displayed on the lenses. Accordingly, in the case of AR glasses as optical display 30, the display signal AZ does not have to contain any information about the scene 12. The fact that the optical display 30 optically represents the property of the component 16 in such a way that when viewing the scene 12, the property is assigned to the component 16 means, in the case of AR glasses as optical display 30, in particular that the service personnel view the real scene through the lenses of the AR glasses and that the property is displayed on the lenses in such a way that it is assigned to the component 16, for example, is superimposed on the component 16.

[0039] In a step S10, the component 16 represented by the image data BD can be compared with the digital representation of the component 16, in particular based on the image data BD and on the digital doppelganger, in particular based on the doppelganger data DD. Comparing the component 16 represented by the image data BD with the digital representation of the component 16 based on the digital doppelganger data can, in particular, involve finding one or more differences between the corresponding real component 16 and the digital representation of the component 16. For example, when comparing the component 16 represented by the image data BD with the digital representation of the component 16, a deviation of the component 16 represented by the image data BD from the digital representation can be determined.In particular, it can be determined that component 16 should be replaced if the deviation fulfills a predefined condition, and that the component should not be replaced if the deviation does not fulfill the predefined condition. For example, the deviation can be determined in the form of a distance and / or as a numerical value, and the condition can be met if the distance or the numerical value is greater than a predefined threshold value. The threshold value can also be referred to as a limit value, in particular as a dimensional limit value. The distance can generally be determined using any suitable mathematical distance function and / or metric.

[0040] The comparison of the component 16 represented by the image data BD with the digital representation of the component 16 based on the doppelganger data DD occurs automatically. This automatic comparison can be performed using a conventionally programmed algorithm. Alternatively, the automatic comparison can be performed using artificial intelligence (AI) and / or machine learning. For example, the AI ​​can be trained using a large number of image data BD representing images 10 with components 16 and a large number of digital representations of the components 16 to recognize the components 16 based on the image data BD and to compare them with the corresponding digital representations. The training data, in particular the image data BD, for training the corresponding AI can be created, for example, using a program for creating the digital doppelganger.In particular, a plurality of digital doppelgangers can be created in which one or more components 16 are faulty and / or worn and need to be replaced. From these "faulty" or "worn" digital doppelgangers, in particular components 16, the image data BD can then be generated for training the artificial intelligence, showing the supposedly faulty and / or worn component(s) 16. After training, the AI ​​is able to determine, based on the received image data BD and the digital doppelganger, whether the component(s) 16 need to be replaced or not.

[0041] In a step S12, it can be determined whether component 16 should be replaced or not, in particular depending on the comparison performed in step S10. If the comparison shows that component 16 should not be replaced, the method can continue in a step S14. If the comparison shows that component 16 should be replaced, the method can continue in a step S18. In step S14, the enable signal FS can be generated. The enable signal FS is representative of the fact that component 16 should not be replaced.

[0042] In an optional step S16, a remaining service life of the component 16 can be determined based on the comparison. Subsequently, the release signal FS can be generated such that the release signal FS is representative of the determined remaining service life of the component 16. The remaining service life of the component 16 can be determined, for example, using a lookup table in which properties of typical wear and / or aging phenomena of the component are assigned corresponding remaining service lives. Such lookup tables can be determined in advance, for example, empirically and stored in the memory unit 24 and / or the database 34, optionally as part of the duplicate data DD. Operating data stored in the duplicate data DD, in particular operating data provided with time information, can also be used to determine the remaining service life.

[0043] In step S 18, the replacement signal AS can be generated, which is representative of the fact that the component 16 is to be replaced.

[0044] In an optional step S20, the provision signal BS can be generated depending on the exchange signal AS, wherein the provision signal BS is representative of the component 16 to be exchanged. Furthermore, in step S20, the provision signal BS can be sent to a provision device (not shown) that is designed to retrieve the component 16 from a warehouse and provide it at a removal station (not shown). The fact that the provision signal BS is generated depending on the exchange signal AS can, in the simplest case, mean that the exchange signal AS is used as the provision signal BS. This is possible if the provision device 36 is capable of correctly interpreting the exchange signal AS.Otherwise, the provision signal BS can be generated depending on the exchange signal AS, wherein the provision signal BS is generated in a format that can be correctly interpreted by the provision device 36 and that contains the same information content as the exchange signal AS, namely which component 16 is involved and that the component 16 is to be exchanged. The provision device 36 can, for example, comprise a storage robot that is configured to automatically retrieve the component 16 from the warehouse and provide it at the removal station in response to receiving the provision signal BS.

[0045] Optionally, a maintenance appointment for replacing the component 16 with corresponding material provision can be planned parallel to step S20, wherein the component 16 can then be provided at the removal station at the maintenance appointment, for example by means of the provision device 36.

[0046] In an optional step S22, at least one assistance for replacing the component 16 can be determined, and the display signal AS can be generated such that the determined assistance is displayed via the optical display 30. Alternatively or additionally, the assistance can be output acoustically, for example, via a loudspeaker of the service device. If the component 16 is actually replaced, one or more properties of the new component 16 can be stored as part of the duplicate data DD, so that the digital duplicate is up to date.

[0047] In an optional step S24, in response to the detection that the component 16 is to be replaced, a replacement process can be monitored, during which the component 16 is replaced. In particular, the replacement process can be monitored in real time. The replacement process can, for example, comprise one or more work steps required to replace the component 16. Each of the work steps can comprise one or more actions of a robot, in particular one or more actuators of the robot, and / or one or more manual steps to be performed by the service personnel.Optionally, after the replacement of the component 16, the passenger transport system 14 and in particular the renewed component 16 can be checked, for example by again capturing the passenger transport system 1, for example by means of the sensors 32, and by subsequently comparing the corresponding image(s) 10 with the digital doppelganger using the image data BD and the doppelganger data DD, for example by means of AI.

[0048] The replacement process can be monitored, for example, using one or more of the sensors 32, for example, optical sensors and / or, for example, the service device. For example, the actual replacement process can be recorded using the camera of the service device. During this monitoring, these sensors 32 generate the replacement data AD. The replacement data AD can then, for example, be sent to and received by the control unit 20. Thus, in step S24, the replacement data AD can be received that is representative of the actual replacement process in which the component 16 is actually replaced. The replacement data AD can include further image data and / or video data.

[0049] Subsequently, the replacement data AD can be used to check whether the actual replacement process corresponds to a specified replacement process assigned to component 16. Furthermore, a first warning signal WS1 can be generated if the monitored replacement process deviates from the specified replacement process. If the actual replacement process does not deviate from the specified replacement process, the first warning signal WS1 can be omitted. Optionally, a confirmation signal can be generated in this case, which is representative of the fact that the actual replacement process does not deviate from the specified replacement process.

[0050] In an optional step S26, at least one actual parameter value associated with the replacement of component 16 can be detected. Furthermore, in step S26, it can be checked whether the detected actual parameter value corresponds to a corresponding parameter setpoint. Furthermore, in step S26, a second warning signal WS2 can be generated if the detected actual parameter value does not correspond to the corresponding parameter setpoint. If the actual parameter value corresponds to the corresponding parameter setpoint, the second warning signal WS2 can be omitted. Optionally, in this case, a confirmation signal can be generated that represents that the actual parameter value corresponds to the corresponding parameter setpoint.

[0051] The actual parameter value can also be referred to as the actual value of a parameter. The parameter associated with the replacement of component 16 can, for example, be a physical quantity that is important when replacing component 16. For example, the parameter can refer to a torque with which a screw or nut used to fasten component 16 should be tightened. Alternatively, the parameter can refer to a quantity of a fluid and / or lubricant that should be introduced into component 16 or that should be used during assembly of component 16. Optionally, two or more of the actual parameter values ​​of one or more of the parameters can be determined and checked against corresponding parameter setpoints.Optionally, the actual parameter value can be saved in conjunction with the digital doppelganger, for example, in the form of the doppelganger data DD, regardless of whether the actual parameter value corresponds to the parameter setpoint or not. This allows the actual parameter value to be subsequently determined using the digital doppelganger.

[0052] Optionally, a fault analysis can then be performed to optimize future service work. The fault analysis can relate to maintenance processes that are too cumbersome or to errors in the procurement or logistics system. During this fault analysis, the AI, or in other words, the AI ​​module, can suggest appropriate measures.

[0053] The aforementioned steps can be processed in a system comprising hardware and / or software, wherein at least one of the aforementioned service devices, in other words user devices, is available to the service personnel as hardware. The service device(s) and / or the components explained with reference to Figure 2 can exchange data via known data interfaces, for example, wired and / or wireless, with one, two, or more additional platforms, for example, with a central computer, with a computer network, and / or the cloud.

[0054] Finally, it should be noted that terms such as "having," "comprising," etc., do not exclude other elements or steps, and terms such as "a" or "an" do not exclude a plurality. Furthermore, it should be noted that features or steps described with reference to one of the above embodiments may also be used in combination with other features or steps of other embodiments described above. Reference signs in the claims are not to be considered as limitations.

[0055] - TI -

[0056] List of reference symbols

[0057] 10 images

[0058] 12 Scene

[0059] 14 passenger transport system

[0060] 16 component

[0061] 20 Control unit

[0062] 22 processors

[0063] 24 storage units

[0064] 30 optical display

[0065] 32 sensors

[0066] 34 Database

[0067] 36 Provisioning device

[0068] BD image data

[0069] DD Doppelganger Data

[0070] AZ display signal

[0071] FS release signal

[0072] AS exchange signal

[0073] BS readiness signal

[0074] AD exchange data

[0075] WS1 first warning signal

[0076] WS2 second warning signal

[0077] S2 - S24 Steps two to twenty-six

Claims

Patent claims 1. A method for carrying out service work on a passenger transport system (14) which is designed as a lift, escalator or moving walkway, the method comprising: Receiving image data (BD) representative of an image (10) showing a scene (12) with a component (16) of the passenger transport system (14); Determining which component (16) of the passenger transport system (14) is involved, based on duplicate data (DD) of a digital duplicate of the passenger transport system (14) which has a digital representation of the component (16); Determining at least one property of the component (16) based on the duplicate data (DD); Generating a display signal (AZ) for an optical display (30) such that the optical display (30), in response to receiving the display signal (AZ), optically displays the property of the component (16) such that when viewing the scene (12) by means of the optical display (30), the property can be recognized as being assigned to the component (16); Comparing the component (16) represented by the image data (BD) with the digital representation of the component (16) based on the image data (BD) and the duplicate data (DD); Determining whether the component (16) should be replaced depending on the comparison; Generating an enable signal (FS) representative of the fact that the component (16) should not be replaced if the comparison shows that the component (16) should not be replaced; and Generating a replacement signal (AS) that is representative of the fact that the component (16) is to be replaced if the comparison shows that the component (16) is to be replaced.

2. Method according to claim 1, wherein in the comparison of the component (16) represented by the image data (BD) with the digital representation of the component (16), a deviation of the component (16) represented by the image data (BD) from the digital representation is determined, it is determined that the component (16) should be replaced if the deviation fulfills a predetermined condition, and it is determined that the component (16) should not be replaced if the deviation does not fulfill the predetermined condition.

3. Method according to one of the preceding claims, wherein the property of the component (16) which is determined on the basis of the duplicate data (DD) relates to a desired state of the component (16), an actual state of the component (16) is determined on the basis of the image data (BD), and when comparing the image represented by the image data (BD) with the digital representation of the component (16), the actual state is compared with the desired state.

4. Method according to one of the preceding claims, wherein the property of the component (16) relates to a contour of the component (16), and the display signal (AZ) is generated such that the optical display (30) displays the contour superimposed on the component (16) in response to receiving the display signal (AZ).

5. Method according to one of the preceding claims, wherein the property of the component (16) relates to current and / or stored operating data, and the display signal (AZ) is generated taking these operating data into account.

6. Method according to one of the preceding claims, further comprising: Generating a provision signal (BS) depending on the replacement signal if the comparison shows that the component (16) is to be replaced, wherein the provision signal (BS) is representative of the component (16); and Sending the provision signal (BS) to a provision device (38) which is designed to obtain the component (16) from a warehouse and to provide it at a removal station.

7. Method according to one of the preceding claims, wherein, if the comparison shows that the component (16) is to be replaced, at least one assistance for replacing the component (16) is determined, and the display signal (AZ) is generated such that the determined assistance is displayed by means of the optical display (30).

8. Method according to one of the preceding claims, further comprising, if the comparison shows that the component (16) should be replaced: Receiving replacement data (AD) representative of an actual replacement process in which the component (16) is replaced; Checking whether the actual replacement process corresponds to a predetermined replacement process assigned to the component (16) using the replacement data (AD); and Generating a first warning signal (WS1) when the monitored exchange process deviates from the specified exchange process.

9. Method according to one of the preceding claims, further comprising, if the component (16) is replaced: detecting at least one actual parameter value associated with the replacement of the component (16); Check whether the recorded parameter actual value corresponds to a corresponding parameter setpoint; and Generate a second warning signal (WS) if the detected parameter actual value does not correspond to the corresponding parameter setpoint.

10. Method according to one of the preceding claims, further comprising: Determining a remaining service life of the component (16) depending on the comparison if the comparison shows that the component (16) should not be replaced; and Generating the release signal (FS) such that the release signal (FS) is representative of the remaining service life.

11. Control unit (20) for a service device for carrying out service work on a passenger transport system (14) which is designed as a lift, escalator or moving walkway, the control unit (20) comprising: a storage unit (24) for storing image data (BD) which are representative of an image (10) which shows a scene (12) with a component (16) of the Passenger transport system (14), characterized in that in the memory unit (24) doppelganger data (DD) of a digital doppelganger of the passenger transport system (14) can be stored, which have a digital representation of the component (16); that the control unit (20) has a processor (22) which is connected to the Memory unit (24) is communicatively coupled and is designed to process the method implemented in a program according to one of the preceding claims 1 to 10; and that the program stored in the memory unit (24) with the implemented method according to one of the preceding claims 1 to 10 can be called up by the processor (22) for processing.

Images