Method and manufacturing assistance device for producing a passenger transport system, and control unit for the manufacturing assistance device

Abstract

A method for manufacturing a passenger transport system is proposed. The method involves receiving initial image data (BD1) representative of a first image (10) depicting a first scene (12) with at least one first component (14) of the passenger transport system; determining which second component (24) of the passenger transport system is to be next attached to the first component (14) using duplicate data (DD) of a digital duplicate of the passenger transport system; and generating a display signal (AZ) for an optical display (30) such that, in response to receiving the display signal (AZ), the optical display (30) optically represents the second component (24) in such a way that, when viewing the first scene (12) using the optical display (30), the second component (24) is recognizably attached to the first component (14).

Description

[0001] The present invention relates to a method and a production assistance device for manufacturing a passenger transport system which is designed as an escalator, moving walkway or elevator and a control unit for the production assistance device for manufacturing the passenger transport system.

[0002] Passenger transport systems are used to transport people or loads on or within buildings, for example, between different height levels or within a constant height. Passenger transport systems within the meaning of this document include escalators, moving walkways, and elevators. For example, escalators, also known as moving walkways, and elevators are used to transport people from one floor to another within a building. Moving walkways can be used to transport people within a floor on a horizontal plane or on a slightly inclined plane.

[0003] When manufacturing passenger transport systems, these are typically constructed from individual components that can be assembled manually, at least in part. For this, the responsible production personnel require extensive knowledge of the respective passenger transport system, particularly of the relevant components and how the components are to be arranged, and especially how they are to be assembled. The production personnel should know which components should be arranged where and how they should be arranged one after the other. This requires extensive training and, in some cases, years of experience before the production personnel are able to perform the corresponding manufacturing work—in other words, assembly work.

[0004] Furthermore, it is known to adapt a passenger transport system during production to customer requirements and the characteristics of the destination, which is also referred to as "order picking." For example, EP 3 724 118 B1 describes the order picking of a passenger transport system using a digital twin.

[0005] There may be a need, among other things, for a method for manufacturing a passenger transport system that helps ensure that the production of a passenger transport system can be carried out by the production personnel easily, precisely and / or with little learning effort.

[0006] Such a need can be met by the subject matter according to the independent patent claims. Advantageous embodiments are explained both in the dependent claims and in the following description.

[0007] According to a first aspect, a method for manufacturing a passenger transport system configured as an escalator, moving walkway, or elevator is described. The method is carried out using a suitable manufacturing assistance device and comprises: receiving first image data representative of a first image showing a first scene with at least a first component of the passenger transport system; determining which second component of the passenger transport system is to be arranged next on the first component based on doppelganger data of a digital doppelganger of the passenger transport system; and generating a display signal for an optical display such that, in response to receiving the display signal, the optical display optically displays the second component such that, when viewing the first scene using the optical display, the second component can be recognized as being arranged on the first component.

[0008] According to a second aspect, a control unit for the production assistance device for manufacturing the passenger transport system configured as an escalator, moving walkway, or elevator is described. The control unit comprises: a storage unit for storing the first image data representative of the first image showing the first scene with at least the first component of the passenger transport system, and the doppelganger data of the digital doppelganger of the passenger transport system; and a processor communicatively coupled to the storage unit and configured to execute the method described above and below, implemented in a program.

[0009] According to a third aspect, the manufacturing assistance device for manufacturing the passenger transport system which is designed as an escalator, moving walkway or elevator is described.The production assistance device comprises: at least one sensor for capturing first image data representative of a first image showing a first scene with at least a first component of the passenger transport system; an optical display configured to optically display a second component in response to receiving a display signal such that, when viewing the first scene using the optical display, the second component can be recognized as being arranged on the first component; and the control unit described above and below, which is communicatively coupled to the sensor and the optical display and configured to receive the image data from the sensor, generate the display signal, and send the display signal to the optical display.

[0010] It should be noted that some of the possible features and advantages of the invention are described herein with reference to the different aspects and to different embodiments of the aspects. In particular, possible features and advantages of the invention are described partly with reference to embodiments of the method, partly with reference to embodiments of the control unit, and partly with reference to embodiments of the manufacturing assistance device. A person skilled in the art will recognize that the features described for individual embodiments can be suitably transferred to other embodiments and / or other aspects, and features can be suitably combined, adapted, and / or exchanged to arrive at further embodiments of the invention.

[0011] The method can be executed, for example, by the control unit of the production assistance device. In particular, the method can be computer-implemented and / or executed automatically. The production assistance device can be, for example, augmented reality glasses (AR glasses), a mobile phone, a tablet, or a laptop belonging to the production personnel performing the service work. The first image data can be generated, for example, by a sensor, in particular by a camera that captures the relevant scenes, sent to the control unit, and received by the control unit. The camera can be, for example, a camera of the production assistance device and / or a CCD camera. The optical display can be a display of the production assistance device.The display signal can in particular be generated in such a way that when viewing the scene by means of the optical display, the second component can be recognized as being arranged as intended on the first component.

[0012] The digital doppelganger can also be referred to as a digital twin. The digital doppelganger is represented by a corresponding digital data set, for example referred to as the doppelganger data. The doppelganger data can be stored in the memory unit and retrieved by the processor as needed. The digital doppelganger, in particular the doppelganger data, can be generated and stored, for example, as described in the prior art cited at the beginning. Alternatively, other methods known from the prior art can also be used to create the digital doppelganger or the doppelganger data. The digital doppelganger, in particular the doppelganger data, has digital representations of target states of a large number of components of the passenger transport system and thus the properties of the components.Ideally, the digital doppelganger has digital representations and thus the properties of all components of the passenger transport system, which are available digitally in the form of the doppelganger data.

[0013] For the purposes of this application, a component of the passenger transport system can be understood as any material that is permanently bonded to the passenger transport system during its manufacture. A lubricant, such as oil or lubricating grease, can therefore also be understood as a component of the passenger transport system for the purposes of this application. The "first component" can be any component of the passenger transport system that, at the beginning of the process, is already arranged at a production station where the passenger transport system is assembled. At the beginning of production, the first component can be a base component, in other words an assembly base, on and / or at which the rest of the passenger transport system is constructed or arranged. During production, the "first component" can be any component of the passenger transport system that is already arranged on the base component.Accordingly, the "second component" is always the component of the passenger transport system that is attached to the "first component" during the process. Accordingly, the process can be executed consecutively during the production of the passenger transport system until the passenger transport system is completed, with a different component of the passenger transport system being the "second component" during each process run.

[0014] In other words, the characteristics "first component" and "second component" are not to be understood numerically. Instead, the "first component" represents the assembly resulting from the assembly process, and the "second component" represents the component to be attached to the first component. The "first component" and the "second component" can also be pre-assembled assemblies.

[0015] According to one embodiment, after determining which second component of the passenger transport system is to be arranged next on the first component, the method comprises: receiving second image data representative of a second image showing a second scene with the first component and the second component; checking whether the second component is arranged as intended on the first component based on the second image data and the doppelganger data; generating an enable signal representative of the second component being arranged as intended on the first component if the checking shows that the second component is arranged as intended on the first component; and generating a warning signal representative of the second component not being arranged as intended on the first component if the checking shows that the second component is not arranged as intended on the first component.The first image data can be generated, for example, by means of a sensor, in particular by means of a camera that captures the corresponding scenes, sent to the control unit and received by the control unit.

[0016] The check to determine whether the second component is arranged as intended on the first component based on the second image data and the doppelganger data can be carried out automatically using an appropriately programmed algorithm and / or using an appropriately trained artificial intelligence. The check to determine whether the second component is arranged as intended on the first component can, in particular, comprise finding one or more differences between an actual state of the first component and the second component arranged thereon, represented by the second scene, and the corresponding digital representations of the components of the digital doppelganger arranged next to one another. The associated comparison of the actual state represented by the second image data with the target state given by the digital doppelganger takes place automatically. This automatic comparison can be carried out using the algorithm.Alternatively, the automatic comparison can be performed using artificial intelligence (AI) and / or machine learning. For example, the AI ​​can be trained using a large number of image data representing images with components and a large number of digital representations of the components. It can recognize the components based on the image data and determine which components should be arranged where next. The training data, in particular the image data for training the AI, can be created, for example, using a program for creating the digital doppelganger. In particular, a large number of digital doppelgangers can be created in different production states, each of which is missing one or more components.From these "unfinished" digital doppelgangers, in particular from the corresponding components arranged next to one another, the image data for the images can then be generated to train the artificial intelligence, so that after training, the artificial intelligence is able to recognize, based on the received image data and the digital doppelganger, which component should be mounted where next.

[0017] The release signal and / or the warning signal can be sent to an output unit, which outputs the corresponding information, namely whether the second component is arranged as intended on the first component or not. The output unit can, for example, have the visual display and / or an acoustic output unit, e.g. a loudspeaker. Thus, in the case of the warning signal, the visual display can indicate that the second component is not arranged as intended on the first component. In addition, the warning signal can be representative of a deviation between the actual arrangement of the second component and the intended arrangement of the second component. In this case, the visual display can indicate where the error in the arrangement of the second component lies.

[0018] According to one embodiment, after receiving the first image data, the method further comprises: determining at which first interface of the first component the second component is to be arranged; and generating the display signal such that the optical display, in response to receiving the display signal, optically highlights the determined first interface. For example, the display signal can initially be generated such that the determined first interface of the first component is optically highlighted first, and then such that the second component is recognizable as being arranged on the first component.The display signal can thus be a signal that is generated permanently or at periodic intervals and transmitted to the optical display. The display signal is representative of different information to be displayed at different times and, accordingly, triggers different reactions and thus different displays on the optical display. The first interface is the location on the first component where the second component is to be positioned.

[0019] According to one embodiment, after receiving the first image data, the method further comprises: determining with which second interface of the second component the second component is to be arranged on the first component; and generating the display signal such that the optical display, in response to receiving the display signal, optically highlights the determined second interface. For example, the display signal can initially be generated such that the determined first interface of the first component is optically highlighted first, such that the second component is additionally displayed, and such that the second interface of the second component is optically highlighted, and thereafter such that the second component can be recognized as being arranged on the first component. The second interface is the location on the second component with which the second component is to be arranged on the first component.

[0020] According to one embodiment, after receiving the first image data, the method further comprises: determining at least one aid for arranging the second component on the first component, and generating the display signal such that the determined aid is displayed by means of the optical display. The aid can, for example, be representative of which fastening means, for example a screw, a rivet, or a weld seam, and / or which aids, in particular which tool, are required for arranging the second component on the first component. The aid can, for example, be representative of how the aid is to be used.For example, in the case of a screw and a corresponding nut as fastening devices, assistance can be displayed indicating which open-end wrench, socket wrench and / or ratchet nut should be used to tighten the screw or nut, and / or with what force, i.e. with what torque, the screw or nut should be tightened. In the case of an elevator system as a passenger transport system that is manufactured, in particular assembled, in a building, the aid can be a laser projector, for example, by means of which the intended position of the components to be arranged can be projected onto walls in the corresponding elevator shaft. The assistance can alternatively or additionally contain information that is important for the manufacture of the passenger transport system.For example, in the case of the elevator system as a passenger transport system, the assistance can include a height indication representative of the current height of the production personnel. For example, the production assistance device, in particular the optical display, can include a height sensor that generates a height signal representative of the height at which the production personnel are located, and the height can be displayed during the assistance. The assistance can be encoded in assistance data representative of the assistance. The assistance data can be stored, for example, on the memory unit of the control unit of the production assistance device or in a database accessible by the control unit.

[0021] According to one embodiment, the determination of which second component of the passenger transport system is to be arranged next on the first component is carried out based on a predefined production plan. Thus, based on the digital doppelganger, in particular based on the doppelganger data, and based on the predefined production plan, it can be determined which second component of the passenger transport system is to be arranged next on the first component. Optionally, the doppelganger data can contain the predefined production plan, in particular corresponding production plan data. For example, in the doppelganger data, the digital representations of the components can be assigned when, where, how, and / or in what order the components are to be arranged next to one another in order to be able to manufacture the passenger transport system.

[0022] According to one embodiment, the method further comprises, after determining which second component of the passenger transport system is to be arranged next on the first component, generating a provision signal representative of the second component after determining which second component of the passenger transport system is to be arranged next on the first component; and sending the provision signal to a provision device configured to procure the second component from a warehouse and to provide it at a removal station before receiving the second image data. This makes it possible to automatically provide the second component, which is to be arranged on the first component of the passenger transport system, to the production personnel.The provisioning device can, for example, comprise a storage robot configured to automatically retrieve the component from the warehouse and provide it at a removal station in response to receiving the provision signal. If there are multiple removal stations at which the components for the passenger transport system are provided, it can optionally be determined at which of the removal stations the second component is to be provided. The corresponding removal station can, for example, be determined in such a way that the distance traveled by the production personnel to remove the second component from the removal station and arrange it properly on the first component is as short as possible.

[0023] According to one embodiment, the optical display optically represents the second component in such a way that, when the scene is viewed using the optical display, the second component can be recognized as being arranged on the first component, by generating the display signal in such a way that the optical display represents the second component superimposed on the first component. The fact that the optical display optically represents the second component in such a way that, when the scene is viewed, it is arranged on the first component means, in particular for all optical displays except for AR glasses, that the first scene is represented with the first component on the corresponding display and that, in addition, the second component is displayed in such a way that it is superimposed on the first component. Thus, in these cases, the display signal must be generated in such a way that it also contains image information about the first scene.

[0024] According to one embodiment, the optical display comprises at least one lens of AR glasses that is transparent, allowing the first scene to be viewed through the lens of the AR glasses. The display signal is generated such that the second component is displayed on the lenses in such a way that, when viewing the first scene through the lenses, the second component is superimposed on the first component.

[0025] According to one embodiment, the manufacturing assistance device is designed as AR glasses with two transparent lenses through which the first scene can be viewed, and at least one of the lenses is used as the optical display.

[0026] Embodiments of the invention are described below with reference to the accompanying drawings, wherein neither the drawings nor the description are to be construed as limiting the invention. Figure 1shows an example of a first image showing a first scene with a first component of a passenger transport system, according to an embodiment of the present invention. Figure 2 shows an optical display on which the first component and a second component of the passenger transport system are displayed, according to an embodiment of the present invention. Figure 3 shows an example of a second image showing a second scene with the first component and the second component arranged thereon, according to an embodiment of the present invention. Figure 4 shows a block diagram illustrating a function of a control unit for a manufacturing assistance device for manufacturing the passenger transport system, according to an embodiment of the present invention. Figure 5 shows a manufacturing assistance device for manufacturing the passenger transport system according to an embodiment of the present invention. Figure 6shows a flowchart of an embodiment of a method for manufacturing the passenger transport system which is designed as an escalator, moving walkway or elevator, according to an embodiment of the present invention.

[0027] The figures are merely schematic and not to scale. The same reference numerals designate the same or equivalent features in the various figures.

[0028] Figure 1 shows an example of a first image 10 showing a first scene 12 with a first component 14 of a passenger transport system (not shown), according to an embodiment of the present invention. In particular, the first scene 12 shows the first component 14 arranged at a manufacturing station for manufacturing the passenger transport system.

[0029] The passenger transport system is suitable for transporting people, for example, between different height levels in buildings or within a constant height level. The passenger transport system can be, for example, an escalator, in particular an moving staircase, an elevator system, or a moving walkway.

[0030] The passenger transport system is composed of several components, whereby Figure 1as an example of one of the components, namely the first component 14. For the purposes of this application, a "component" of the passenger transport system can be understood as any material that is permanently connected to the passenger transport system during its manufacture, for example, a metal part, a plastic part, a composite material part, a fastener, etc. However, for the purposes of this application, a lubricant, for example, an oil or lubricating grease, can also be understood as a component of the passenger transport system.

[0031] The first component 14 can be any component of the passenger transport system that is present at the beginning of the process with reference to Figure 6explained method is already arranged at the production site where the passenger transport system is assembled. At the beginning of production, the first component 14 can be a base component, in other words, an assembly base, on and / or at which the rest of the passenger transport system is constructed or arranged. During production, the "first component" can be any component of the passenger transport system that is already arranged on the base component.

[0032] Figure 2 shows an optical display 20 of a production assistance device (in Figure 2 not shown), on which the first component 14 and a second component 24 of the passenger transport system are displayed, according to an embodiment of the present invention. In particular, the optical display 20 shows the first scene 12 with the first and second components 14, 24. The production assistance device can, for example, be augmented reality (AR) glasses 54 (see Figure 5), a mobile phone, a tablet or a laptop belonging to the manufacturing personnel performing the manufacturing work.

[0033] The second component 24 can be any component of the passenger transport system that is to be arranged on the first component 14. Accordingly, the "second component" is always the component of the passenger transport system that is to be arranged in the course of the Figure 6 explained method is arranged on the "first component".

[0034] For example, the second component 24 is shown on the optical display 20 in such a way that, when viewing the first scene 12 using the optical display 20, the second component 24 can be recognized as being arranged on the first component 14. In particular, the components 14, 24 can be shown on the optical display 20 in such a way that, when viewing the first scene 12 using the optical display 20, the second component 24 can be recognized as being arranged as intended on the first component 14. For example, the optical display 20 can show the second component 24 superimposed on the first component 14. Preferably, the second component 24 is optically highlighted, for example by keeping its outlines or surfaces in a highlighting color.

[0035] Optionally, a first interface 22 of the first component 14 can be displayed, in particular visually highlighted, by means of the optical display 20. The first interface 22 is the location on the first component 14 at which the second component 24 is to be arranged. Alternatively or additionally, a second interface 26 of the second component 24 can be displayed, in particular visually highlighted, by means of the optical display 20. The second interface 26 is the location on the second component 24 at which the second component 24 is to be arranged on the first component 14.

[0036] It should be noted that the first scene 12 refers to reality, in which initially only the first component 14 is arranged, and that the second component 24 is initially represented exclusively by means of the optical display 20, but is not arranged on the first component 14 in reality.

[0037] Figure 3shows an example of a second image 30 showing a second scene 32 with the first component 14 and the second component 24 arranged thereon, according to an embodiment of the present invention. The second image 30 was taken after the second component 24 was arranged on the first component 14. Accordingly, the second scene 32 corresponds to reality, wherein at this point in time the second component 24 is already arranged on the first component 14, preferably as previously displayed by means of the optical display 20.

[0038] Figure 4 shows a block diagram illustrating a function of a control unit 40 for the production assistance device for manufacturing the passenger transport system, according to an embodiment of the present invention. The control unit 40 can, for example, be a component of the production assistance device of the production personnel (not shown) entrusted with carrying out the production work.

[0039] The control unit 40 has a storage unit 52 for storing first image data BD1, which are representative of the first image 10, which shows the first scene 12 with the first component 14, optionally second image data BD2, which are representative of the second image 30, which shows the second scene 32 with the first component 14 and the second component 24 arranged thereon, and doppelganger data DD of a digital doppelganger of the passenger transport system 14, which has, among other things, digital representations of the first and second components 14, 24. The control unit 40 further has a processor 50, which is communicatively coupled to the storage unit 52 and which is designed to Figure 6 to process the procedures explained, whereby the procedure is logically implemented in a program.

[0040] For this purpose, the control unit 40 communicates with the optical display 20, with one or more sensors 42, optionally with a database 44, and optionally with a provisioning device 46. The optical display 20, one or more of the sensors 42, and optionally the database 44 can be additional components of the production assistance device. The optical display 20 can, for example, be a display of the production assistance device.

[0041] The control unit 40 is designed to generate a display signal AZ, optionally a release signal FS, optionally a warning signal WS, and optionally a provision signal BS. The control unit 40 is particularly designed to send the display signal AZ to the optical display 20. Optionally, the control unit 40 can also send the release signal FS and / or the warning signal WS to the optical display 20. Alternatively or additionally, the control unit 40 can be designed to send the release signal FS and / or the warning signal WS to another display device, for example to another optical display (not shown) or to an acoustic display device (not shown).

[0042] The control unit 40 is further configured to receive the first image data BD1, optionally the second image data BD2, and / or the doppelganger data DD. The image data BD1, BD2 can be generated, for example, by one or more of the sensors 42. The doppelganger data DD can be stored in the database 44 and retrieved by the processor 22 as needed. Alternatively or additionally, the doppelganger data DD can be stored in the memory unit 52. The doppelganger data DD comprise extensive information about the passenger transport system, in particular about the components of the passenger transport system, for example as described in the prior art EP 3 724 118 B1 cited at the beginning. If the images 10, 30 are 3D recordings, the image data BD1, BD2 can contain depth information in addition to the information required to control the pixels of the optical display 20.For example, the image data BD1, BD2 may contain depth information for each pixel that is representative of how far an object shown in the pixel is from the corresponding sensor, in particular the corresponding camera, that captured the image data BD1, BD2.

[0043] The digital doppelganger can also be referred to as a digital twin. The digital doppelganger is represented by a corresponding digital data set, in particular the doppelganger data DD. The digital doppelganger can, for example, be generated and stored as described in the prior art cited at the beginning. Alternatively, other methods known from the prior art can also be used to create the digital doppelganger and thus the doppelganger data DD. The digital doppelganger has digital representations of a large number of components 14, 24 of the passenger transport system arranged next to one another. Ideally, the digital doppelganger has digital representations of all components 14, 24 of the passenger transport system and also includes information on how the components 14, 24 are and / or are arranged next to one another. Furthermore, the doppelganger data DD can have properties of the components 14, 24.The properties can, for example, relate to external shapes of the components 14, 24. For example, the external shapes of the components 14, 24 can be specified by at least one and / or optionally further properties of the corresponding component 14, 24. For example, the external shapes can be specified by one or more contours of the corresponding component 14, 24, wherein the contours can be stored as properties of the corresponding component 14, 24 and as part of the digital doppelganger in the form of the doppelganger data DD.

[0044] The control unit 40 can further be configured to send the provision signal BS to a provision device 46. The provision device 46 can be configured to retrieve the second component 24 from a warehouse (not shown) and to provide it at a removal station (not shown). The provision device can, for example, comprise a storage robot configured to automatically retrieve the second component 24 from the warehouse and provide it at the removal station in response to receiving the provision signal BS.

[0045] Figure 5shows one of the possible production assistance devices 54 for manufacturing the passenger transport system according to an embodiment of the present invention. The production assistance device 54 has at least one of the sensors 42, for example the camera, the optical display 20, and the control unit 40. The sensor 42 serves to capture the first image data BD1, which is representative of the first image 10 showing the first scene 12 with the first component 14 of the passenger transport system, and optionally the second image data BD2, which is representative of the second image 30 showing the second scene 32 with the first component 14 and the second component 24 arranged thereon.The optical display 20 is designed such that, in response to receiving a display signal AZ, it optically displays the second component 24 such that, when viewing the first scene 12 by means of the optical display 20, the second component 24 can be recognized as being arranged on the first component 14, as shown by way of example in . Figure 2 shown. The control unit 40 is communicatively coupled to the sensor 42 and the optical display 20 and is configured to receive the image data BD1, BD2 from the sensor 42, generate the display signal AZ, and transmit the display signal AZ to the optical display 20.

[0046] In this embodiment, the production assistance device 54 is embodied as AR (augmented reality) glasses. The AR glasses have two transparent lenses 56 through which the first or second scene 12, 32 can be viewed. The fact that the lenses 56 are transparent can mean, for example, that they are so transparent that the surroundings of the production assistance device 54 (the AR glasses) can be viewed through the lenses 56. The lenses 56 can thus be tinted, anti-reflective, and / or provided with one or more optical filters, and yet still be considered transparent within the meaning of this application.

[0047] At least one of the lenses 56 can be used as the optical display 20. Thus, in the case of AR glasses as the optical display 20, the lenses 56 of the AR glasses correspond to the display of the optical display 20. In this case, the display is at least substantially transparent, so that the scenes 12, 32 can be viewed through the lenses 56 of the production assistance device 54 and do not need to be artificially displayed on the lenses 56. Accordingly, in the case of AR glasses as the optical display 20, the display signal AZ does not need to contain any information about the scenes 12, 32.The fact that the optical display 30 optically represents the components 14, 24 in such a way that when viewing the first scene 12 the second component 24 is arranged on the first component 14 means, in the case of AR glasses as the optical display 20, in particular that the production personnel view the first component 14 through the lenses 56 of the AR glasses and that the second component 24 is displayed on the lenses 56 in such a way that it is arranged on the first component 14, for example superimposed on the first component 14.

[0048] In all other of the aforementioned production assistance devices 54, the components 14, 24 can be optically displayed by means of the optical display 20 such that, when viewing the scene 12 on the optical display 20, the second component 24 is arranged on the first component 14, wherein the first component 14 is displayed on the corresponding display by means of the optical display 20 and wherein, in addition, the second component 24 is displayed on the display such that it is arranged on the first component 14, for example, superimposed on the first component 14. Thus, in these cases, the display signal AZ must be generated such that it also includes image information about the scene 12. This image information is contained, for example, in the first image data BD 1.

[0049] Figure 6shows a flowchart of an exemplary embodiment of a method for manufacturing the passenger transport system according to an embodiment of the present invention. The method is executed using one of the aforementioned manufacturing assistance devices 54, for example, using AR glasses and in particular using the control unit 40.

[0050] In a step S2, the first image data BD1 can be received, which are representative of the first image 10 showing the first scene 12 with the first component 14 of the passenger transport system. The first image data BD1 can be generated by the sensors 42 and received by the control unit 40. For this purpose, the sensors 42 can, for example, comprise the camera that captures the first scene 12. The camera can, for example, be the camera of the production assistance device 54 and / or a CCD camera.

[0051] In a step S4, it can be determined, for example by means of the control unit 40, which second component 24 of the passenger transport system is to be arranged next on the first component 14, in particular based on the doppelganger data DD of the digital doppelganger of the passenger transport system. Optionally, step S4 can be performed using an appropriately trained artificial intelligence (AI).

[0052] Optionally, the determination of which second component 24 is to be arranged next on the first component 14 is carried out based on a predefined production plan. Thus, based on the digital doppelganger, in particular based on the doppelganger data DD, and based on the predefined production plan, it can be determined which second component 24 of the passenger transport system is to be arranged next on the first component 14. Optionally, the doppelganger data DD can contain the predefined production plan, in particular corresponding production plan data. For example, the production plan in the doppelganger data DD can be used to assign to the digital representations of the components 14, 24 when, where, how and / or in what order the components 14, 24 are to be arranged next to one another in order to be able to manufacture the passenger transport system.

[0053] In an optional step S6, it can be determined at which first interface 22 of the first component 14 the second component 24 is to be arranged. The first interface 22 is the location of the first component 14 at which the second component 24 is to be arranged.

[0054] In an optional step S8, it can be determined with which second interface 26 of the second component 24 the second component 24 is to be arranged on the first component 14. The second interface is the location of the second component 24 with which the second component 24 is to be arranged on the first component 14.

[0055] In an optional step S10, assistance for arranging the second component 14 on the first component 24 can be determined. The assistance can, for example, be representative of which fastening means, for example a screw, a rivet or a weld seam, and / or which aids, in particular which tool, are required for arranging the second component 24 on the first component 14. The assistance can, for example, be representative of how the aid is to be used. For example, in the case of a screw and a corresponding screw nut as the fastening means, assistance can be displayed which open-end wrench, which socket wrench and / or which nut of a ratchet should be used to tighten the screw or the screw nut, and / or with which force, i.e. with which torque, the screw or the screw nut should be tightened.

[0056] In the case of an elevator system as a passenger transport system that is manufactured, in particular assembled, in a building, the aid can be, for example, a laser projector, by means of which a correct position of the components 14, 24 to be arranged can be projected onto walls in the corresponding elevator shaft. The assistance can alternatively or additionally comprise information that is important for the production of the passenger transport system. For example, in the case of the elevator system as a passenger transport system, the assistance can comprise a height indication that is representative of the height at which the production personnel are currently located. For example, the production assistance device 56, in particular the optical display 20, can comprise a height sensor that generates a height signal that is representative of the height at which the production personnel are located, and the height can be displayed as part of the assistance.The assistance can be encoded in assistance data representative of the assistance. The assistance data can be stored, for example, on the memory unit 52 of the control unit 40 of the production assistance device 56 or in the database 44, which can be accessed by the control unit 40. The assistance data can be determined in advance, for example empirically and / or, for example, by a manufacturer of the passenger transport system, and stored in the memory unit 52 and / or the database 44.

[0057] In an optional step S12, after determining which second component 24 of the passenger transport system is to be arranged next on the first component 14, the provision signal BS can be generated, which is representative of the second component 24. The provision device 36 can, for example, comprise a storage robot, which is configured to automatically retrieve the component 16 from the warehouse and provide it at the removal station in response to receiving the provision signal BS.

[0058] If the optional step S12 is processed, the provision signal BS can be sent to the provision device 46 in a step S14. The provision device 46 is designed to procure the second component 24 from the warehouse and to provide it at the removal station. If there are multiple removal stations at which the components 14, 24 for the passenger transport system can be provided, it can optionally be determined in step S14 at which of the removal stations the second component 24 is to be provided. The corresponding removal station can be determined, for example, in such a way that the path to be traveled by the production personnel in order to remove the second component 24 from the removal station and arrange it as intended on the first component 14 is as short as possible.

[0059] In a step S 16, the display signal AZ for the optical display 20 can be generated such that the optical display 20, in response to receiving the display signal AZ, optically displays the second component 24 such that, when viewing the first scene 12 by means of the optical display 20, the second component 24 can be recognized as being arranged on the first component 14. The display signal AZ can, in particular, be generated such that, when viewing the first scene 12 by means of the optical display 20, the second component 24 can be recognized as being arranged as intended on the first component 14.

[0060] If it is determined in step S6 at which first interface 22 of the first component 14 the second component 24 is to be arranged, the display signal AZ can be generated such that the optical display 20, in response to receiving the display signal AZ, optically highlights the determined first interface 22. For example, the display signal AZ can initially be generated such that the determined first interface 22 of the first component 14 is optically highlighted first, and then such that the second component 24 can be recognized as being arranged on the first component 14.The display signal AZ can thus be a signal that is generated permanently or at periodic intervals and transmitted to the optical display 20, wherein the display signal AZ is representative of correspondingly different information to be displayed at different times and accordingly causes different reactions and thus different displays of the optical display 20.

[0061] If it is determined in step S8 with which second interface 26 of the second component 24 the second component 24 is to be arranged on the first component 14, the display signal AZ can be generated such that the optical display 20, in response to receiving the display signal AZ, visually highlights the determined second interface 26. For example, the display signal AZ can initially be generated such that the determined first interface 22 of the first component 14 is visually highlighted first, that the second component 24 is additionally displayed and that the second interface 26 of the second component 24 is visually highlighted, and that the second component 24 can then be recognized as being arranged on the first component 14.

[0062] If the assistance for arranging the second component 24 on the first component 14 is determined in step S 10, the display signal AZ can be generated such that the optical display 20 displays the determined assistance in response to receiving the display signal AZ.

[0063] In a step S18, the second image data BD2 can be received, which are representative of the second image 30, which shows the second scene 32 with the first component 14 and the second component 24 arranged thereon, wherein the second component 24 has been temporarily arranged on the first component 24, in particular by the production personnel, alternatively by means of a robot and / or robot arm. The second image data BD2 can be generated by the sensors 42 and received by the control unit 40.

[0064] In an optional step S20, which can be executed, for example, after step S18 has been executed, the second image data BD2 and the duplicate data DD can be used to check whether the second component 24 is arranged as intended on the first component 14. If this check reveals that the second component 24 is arranged as intended on the first component 14, a step S22 can be executed. If this check reveals that the second component 24 is not arranged as intended on the first component 14, a step S24 can be executed.

[0065] The check as to whether the second component 24 is arranged as intended on the first component 14 can be carried out automatically using the second image data BD2 and the doppelganger data DD by means of an appropriately programmed algorithm and / or by means of an appropriately trained artificial intelligence. The check as to whether the second component 24 is arranged as intended on the first component 14 can be carried out in particular by finding one or more differences between an actual state of the first component 14 represented by the second scene 32 and the second component 24 arranged thereon and the corresponding digital representations of the components 14, 24 of the digital doppelganger arranged next to one another. The associated comparison of the actual state represented by the second image data BD2 with the desired state given by the digital doppelganger takes place automatically.This automatic comparison can be performed using the algorithm. Alternatively, the automatic comparison can be performed using artificial intelligence (AI) and / or machine learning. For example, the AI ​​can be trained using a large number of historical image data representing images of components of the passenger transport system and a large number of digital representations of the components, in particular in the form of the digital doppelganger, to recognize the components based on the image data and to determine which components should be arranged where next. The training data, in particular the image data, for training the AI ​​can be created, for example, using a program for creating the digital doppelganger. In particular, a large number of digital doppelgangers can be created in different production states, each of which is missing one or more components.From these "unfinished" digital doppelgangers, in particular from the corresponding components arranged next to one another, the image data for the images can then be generated to train the artificial intelligence, so that after training, the artificial intelligence is able to recognize, based on the received image data and the digital doppelganger, which component should be mounted where next.

[0066] In step S22, the release signal FS can be generated, which is representative of the fact that the second component 24 is arranged on the first component 14 as intended.

[0067] In step S24, the warning signal WS can be generated, which is representative of the fact that the second component 24 is not arranged as intended on the first component 14.

[0068] The release signal FS and / or the warning signal WS can be sent to an output unit, which outputs the corresponding information, namely whether the second component 24 is arranged as intended on the first component 14 or not. The output unit can, for example, have the optical display 20 and / or an acoustic output unit, for example a loudspeaker. Thus, in the case of the warning signal WS, the optical display 20 can indicate that the second component 24 is not arranged as intended on the first component 14. In addition, the warning signal WS can be representative of a deviation between the actual arrangement of the second component 24 and the intended arrangement of the second component 24. In this case, the display signal AZ can be generated such that the optical display 20 indicates where the error in the arrangement of the second component 24 lies.

[0069] For the purposes of this application, a "component" of the passenger transport system can be understood as any material that is permanently bonded to the passenger transport system during its manufacture. A lubricant, such as oil or lubricating grease, can thus also be understood as a component of the passenger transport system for the purposes of this application. The "first component 14" can be any component of the passenger transport system that is already located at the production location where the passenger transport system is assembled at the beginning of the process. At the beginning of production, the first component 14 can thus be a base component, in other words, an assembly base, on and / or at which the rest of the passenger transport system, in particular the second component 24, is constructed or arranged. During production, the "first component 14" can be any component of the passenger transport system that is already arranged on the base component.Accordingly, the "second component 24" is always the component of the passenger transport system that is arranged on the "first component 14" during the process. Accordingly, the process can be executed consecutively during the production of the passenger transport system until the passenger transport system is completed, with a different component of the passenger transport system being the "second component 24" during each run of the process, which is to be arranged on an already arranged "first component 14" of the passenger transport system.

[0070] Optionally, an error analysis can then be performed to optimize future production work. The error analysis can relate to overly cumbersome production processes or errors in the procurement or logistics system. During this error analysis, the AI—in other words, the AI ​​module—can suggest appropriate measures.

[0071] The aforementioned steps can be processed in a system comprising hardware and / or software, wherein at least one of the aforementioned production assistance devices 56, in other words user devices, is available as hardware for the production personnel. The production assistance device(s) 56 and / or the Figure 4 The components explained can exchange data with one, two or more other platforms via known data interfaces, for example wired and / or wireless, for example with a central computer, with a computer network and / or the cloud.

[0072] Finally, it should be noted that terms such as "having," "comprising," etc., do not exclude other elements or steps, and terms such as "a" or "an" do not exclude a plurality. Furthermore, it should be noted that features or steps described with reference to one of the above embodiments may also be used in combination with other features or steps of other embodiments described above. Reference signs in the claims are not to be considered as limitations.

Claims

1. Method for manufacturing a passenger transport system configured as an escalator, moving walkway, or elevator, wherein the method is carried out by means of a manufacturing assistance device; the method comprising: receiving first image data (BD1) representative of a first image (10) showing a first scene (12) with at least one first component (14) of the passenger transport system; determining which second component (24) of the passenger transport system is to be arranged next on the first component (14) based on doppelganger data (DD) of a digital doppelganger of the passenger transport system; and generating a display signal (AZ) for an optical display (30) such that the optical display (30), in response to receiving the display signal (AZ), optically displays the second component (24) such that when viewing the first scene (12) by means of the optical display (30), the second component (24) can be recognized as being arranged on the first component (14).

2. The method according to claim 1, after determining which second component (24) of the passenger transport system is to be arranged next on the first component (14), further comprising: receiving second image data (BD2) representative of a second image (30) showing a second scene (32) with the first component (14) and the second component (24); checking whether the second component (24) is arranged as intended on the first component (14) based on the second image data (BD2) and the doppelganger data (DD); generating an enable signal (FS) representative of the second component (24) being arranged as intended on the first component (14) if the check shows that the second component (24) is arranged as intended on the first component (14);and generating a warning signal (WS) representative of the fact that the second component (24) is not arranged as intended on the first component (14) if the checking shows that the second component (24) is not arranged as intended on the first component (14); 3. The method according to any one of the preceding claims, further comprising, after receiving the first image data (BD1): determining at which first interface (22) of the first component (14) the second component (24) is to be arranged; and generating the display signal (AZ) such that the optical display (30) optically highlights the determined first interface (22) in response to receiving the display signal (AZ).

4. Method according to one of the preceding claims, further comprising, after receiving the first image data (BD1): determining with which second interface (26) of the second component (24) the second component (24) is to be arranged on the first component (14); and generating the display signal (AZ) such that the optical display (30) optically highlights the determined second interface (26) in response to receiving the display signal (AZ).

5. Method according to one of the preceding claims, further comprising, after receiving the first image data (BD1): determining at least one assistance for arranging the second component (24) on the first component (14), and generating the display signal (AZ) such that the determined assistance is displayed by means of the optical display (30).

6. Method according to one of the preceding claims, wherein the determination of which second component (24) of the passenger transport system is to be arranged next on the first component (14) is carried out on the basis of a predetermined production plan.

7. The method according to any one of the preceding claims, further comprising: generating a provision signal (BS) representative of the second component (24) after determining which second component (24) of the passenger transport system is to be arranged next on the first component (14); and sending the provision signal (BS) to a provision device (38) configured to retrieve the second component (24) from a warehouse and provide it at a removal station before receiving the second image data (BD2).

8. Method according to one of the preceding claims, wherein the optical display optically represents the second component (24) in such a way that when viewing the first scene (12) by means of the optical display (30), the second component (24) can be recognized as being arranged on the first component (14) by generating the display signal (AZ) in such a way that the optical display (20) represents the second component (24) superimposed on the first component (14).

9. The method according to claim 8, wherein the optical display (20) comprises at least one lens (56) of AR glasses (54) which is transparent so that the first scene can be viewed through the lens (56) of the AR glasses (54), and the display signal (AS) is generated such that the second component (24) is displayed on the lenses (56) such that when the first scene is viewed through the lenses (56), the second component (24) is shown superimposed on the first component (14).

10. A control unit (40) for a production assistance device for manufacturing a passenger transport system configured as an escalator, moving walkway, or elevator, the control unit (40) comprising: a memory unit (52) for storing first image data (BD1) representative of a first image (10) showing a first scene (12) with at least one first component (14) of the passenger transport system, and doppelganger data (DD) of a digital doppelganger of the passenger transport system; and a processor (22) communicatively coupled to the memory unit (24) and configured to execute the method implemented in a program according to one of the preceding claims.

11. A production assistance device for manufacturing a passenger transport system designed as an escalator, moving walkway, or elevator, the production assistance device (22) comprising: at least one sensor (42) for capturing first image data (BD1) representative of a first image (10) showing a first scene (12) with at least one first component (14) of the passenger transport system; an optical display (20) configured to optically display a second component (24) in response to receiving a display signal (AZ) such that, when viewing the first scene (12), the second component (24) can be recognized as being arranged on the first component (14) by means of the optical display (30);and a control unit (40) according to claim 10, which is communicatively coupled to the sensor (42) and the optical display (20) and which is designed to receive the image data (BD1) from the sensor (42), to generate the display signal (AZ) and to send the display signal (AZ) to the optical display (20); 12. The manufacturing assistance device according to claim 11, wherein the manufacturing assistance device is designed as AR glasses (54) with two transparent lenses (56) through which the first scene (12) can be viewed, and at least one of the lenses (56) is used as the optical display (20).

Images