METHOD AND DEVICE FOR VISUALIZING SPARE PARTS

Description

[0001] The present invention relates to a method and a device for visualizing spare parts. Furthermore, the invention relates to a computer program product configured to execute, implement, or control the method according to the invention, as well as to a computer-readable medium having such a computer program product stored thereon.

[0002] Products such as complex machines can consist of a multitude of individual components. For example, due to wear or damage, it may become necessary to replace components. This typically requires reliably identifying the identity, function, and / or other characteristic properties of a component to be replaced in order to then replace it with an equivalent spare part.

[0003] The following example of a repair of a passenger transport system such as an elevator, escalator, or moving walkway will explain the tasks and problems that can arise when replacing components. However, similar tasks and problems can also arise when replacing components in other complex products, for example, during the repair of a motor vehicle or similar.

[0004] In the event of a defect in a passenger transport system, a maintenance technician must generally visit the system to determine how to repair the defect. If the maintenance technician determines that a component needs to be replaced, they are faced with the task of determining the component's identity, function, and / or other characteristics in order to order a suitable replacement part. This can be difficult in individual cases, as the maintenance technician is required to service a variety of differently designed passenger transport systems, possibly from different manufacturers, and these passenger transport systems may contain diverse components.

[0005] Traditionally, maintenance technicians can access component lists or catalogs, for example, provided by component or spare part manufacturers, in which the components are characterized. Such component lists often specify identification numbers, functions, and / or dimensions of a component or a corresponding spare part. Sometimes, images or photos of components or spare parts are also shown in the component lists or catalogs.

[0006] However, experience shows that in some cases it can be difficult for a maintenance technician to correctly identify the component to be replaced in order to order a suitable replacement part. In particular, components with different functions or other properties can appear very similar. Despite the visual similarity, connections, dimensions, attachments, and similar details may differ.

[0007] This can lead to the maintenance technician accidentally selecting and ordering the wrong spare part from the component list. Only when attempting to install this component as a spare part in the defective elevator system does he or she realize that the defective component was incorrectly identified and therefore the spare part cannot be installed. This can, in particular, delay the repair of the defective passenger transport system and / or significantly increase the cost of maintenance or repair.

[0008] US 20180218540 A1 describes a simulation method for setting up an object in a building using a 3D model that is created and displayed for the object by a mobile device, whereby the data required for creating the 3D model can be obtained from a database.

[0009] There may be a need, among other things, for a method and apparatus that can facilitate a maintenance technician's ability to reliably identify a component to be replaced or to identify a suitable replacement part. Furthermore, there may be a need for a computer program product that can be used to perform, implement, or control such a method, as well as for a computer-readable medium with such a computer program product stored thereon.

[0010] Such a need can be met by the subject matter according to one of the independent claims. Advantageous embodiments are defined in the dependent claims and the following description.

[0011] According to a first aspect of the invention, a method for visualizing spare parts is proposed according to claim 1.

[0012] According to a second aspect of the invention, a mobile device with a processor and a screen is proposed, wherein the mobile device is configured to execute, control or implement the method according to an embodiment of the first aspect of the invention.

[0013] According to a third aspect of the invention, a computer program product is proposed which has computer-readable instructions which, when executed on a processor-controlled mobile device, cause the device to execute, control or implement the method according to an embodiment of the first aspect of the invention.

[0014] According to a fourth aspect of the invention, a computer-readable medium is proposed on which a computer program product according to an embodiment of the third aspect of the invention is stored.

[0015] Possible features and advantages of embodiments of the invention may be considered, among other things and without limiting the invention, to be based on ideas and findings described below.

[0016] In brief, one idea underlying the present invention can be seen in the use of possibilities offered by modern processor-controlled mobile devices such as intelligent mobile phones (smartphones) or portable computers (laptops, netbooks, etc.), for example to assist a maintenance technician in identifying a suitable spare part for a component to be replaced. The mobile device is initially used to display a list of possible spare parts on the screen of the mobile device, similar to a conventional parts list or catalog. From this list, the maintenance technician can then select a specific spare part that they believe, for example, can replace a defective component. Additional information about this specific spare part can then be downloaded from an external server serving as an information source.This information includes, in particular, 3D data relating to visually recognizable properties of the specific spare part. Based on this 3D data, the specific spare part can then be displayed in perspective in a manner that is easy for the maintenance technician to interpret. The perspective representation is initially visualized from an initial viewing angle. To enable the maintenance technician to view the selected specific spare part not only from one viewing angle, but also to vary this viewing angle, it is further provided to monitor the current orientation of the mobile device itself and to interpret a change in this orientation as an indication that the maintenance technician wishes to view the spare part from an angle corresponding to the changed orientation of the mobile device.Accordingly, in response to a change in the orientation of the mobile device, the spare part can be displayed in a different perspective that corresponds to the changed orientation. The maintenance technician can thus easily and intuitively inspect the selected spare part from different angles on the mobile device screen and, if necessary, compare its visually recognizable properties with the actual component to be replaced. Only when they are certain, for example, that the selected spare part is sufficiently identical to the component to be replaced in all visually recognizable properties can they order the spare part. The risk of ordering the wrong component and thus the effort required to repair a machine requiring maintenance can be minimized.

[0017] Possible designs and details of the individual procedural steps of the presented procedure are explained below.

[0018] The described method can be implemented, for example, using a computer program product or an application ("app") on a processor-controlled mobile device. The mobile device could be the maintenance technician's smartphone, for example. After starting the program, various preliminary queries can be performed, for example, to determine which or what type of passenger transport system the maintenance technician is currently working on. This can be used, among other things, to determine which spare parts might be needed for a specific maintenance case.

[0019] A list of possible spare parts can then be created. This list of possible spare parts can, for example, be a subset of a very large number of different spare parts. The list can contain various information for each possible spare part. The information can be provided in written form and / or in the form of images or pictograms. For example, the list can contain an associated name or an associated identification (ID) in the form of a sequence of characters and / or numbers for each possible spare part. Furthermore, properties of the spare part can be described in writing. Preferably, the spare part is also represented visually, for example in the form of a photo, a drawing, a pictogram, a circuit diagram or similar. The data for the list of possible spare parts can typically comprise a relatively small data volume.Accordingly, this data may have been pre-stored on the mobile device. Alternatively, depending on the situation, this data may be downloaded from an external data source, such as a portable data storage device (e.g., a CD, flash memory, or similar) or a remote data storage device, such as a server or a cloud.

[0020] The list of possible spare parts is then displayed on the mobile device screen, for example, in the form of a list of short written descriptions and / or visual representations for each spare part. The maintenance technician can view the list in its entirety or in parts, or search the list for specific search terms, characteristics, or similar. The technician is explicitly or implicitly prompted to select a specific spare part from the displayed list, for example, one that they believe could replace a defective component.

[0021] Once a specific spare part has been selected in this way, 3D data for this specific spare part is downloaded from an external server over a network. 3D data in this case refers to data that specifies visually recognizable properties of a spare part spatially, i.e. in three spatial directions. Visually recognizable properties are optical properties of the spare part that can be perceived by a person with their eyes. The 3D data therefore specifies, for example, the geometry of an outer surface, i.e. dimensions, curvatures, edges, etc. of the outer surface of the specific spare part. Furthermore, the 3D data can specify which color, colors or color gradients are present on the outer surface or parts thereof. Other visually recognizable properties such as reflection properties (matt, glossy, metallic) can also be specified in the 3D data.

[0022] The 3D data for a spare part may have been created in advance. For example, it is often common practice to specify geometric properties and / or surface properties in the form of CAD (computer-aided design) data when designing or developing components. 3D data for a spare part in the form of CAD data may therefore already be available from a manufacturer of the spare part and stored in a database for download. CAD data can advantageously specify the visually recognizable properties of an object in a way that allows the object to be represented in perspective from different angles without excessive effort in terms of data storage and / or computing capacity. For example, geometric properties of the object can be specified in vector-oriented format.

[0023] Alternatively, 3D data of a spare part can also be obtained in other ways, for example using spatial optical scanning (3D scanning), spatial photography or similar.

[0024] The 3D data can be quite substantial. In particular, the 3D data volume for a spare part can be significantly larger than the data volume of that spare part in the previously presented list of possible spare parts. Furthermore, spare parts can undergo changes in their visual properties over time, for example, due to technical developments, changes in design specifications, etc., so the relevant 3D data should be continuously updated.

[0025] Accordingly, it may be disadvantageous to store the 3D data directly on the mobile device and then read it from a memory when needed. Instead, the 3D data should generally be stored on an external server. Such a server can be part of a data cloud. The server can be located far away from a system or machine currently being serviced. The 3D data can then be provided and / or updated or maintained, for example, by a manufacturer or developer of spare parts.

[0026] The 3D data can then be downloaded from the external server as needed. This can be done over a network such as the Internet. In particular, downloading can be done over a wireless network such as a radio network. Processor-controlled mobile devices typically have wireless data interfaces (e.g., Wi-Fi, 3G / 4G mobile networks, etc.) through which the 3D data can be easily downloaded.

[0027] Once the 3D data is available in the processor-controlled mobile device, the specifically selected spare part with its visually recognizable properties can be displayed in perspective on the screen of this mobile device. A perspective representation can be understood as a representation in which the spare part is visualized on a purely 2-dimensional screen, but in which the spatial, i.e. 3-dimensional, properties of the spare part are reproduced in perspective in a way that would be the case when looking at the actual 3-dimensional spare part. In other words, the perspective representation represents an image, i.e. similar to a photograph, of the 3-dimensional spare part at a predetermined viewing angle.

[0028] However, the maintenance technician should not only be given the opportunity to view the specifically selected spare part from the initial, randomly selected angle. Instead, it can be helpful for the maintenance technician to have the spare part displayed from different angles, for example, to compare it with the actual component to be replaced.

[0029] To enable this in a way that is intuitive and easy for the maintenance technician to perform, it is proposed to record the current orientation of the processor-controlled mobile device, or changes in this current orientation, continuously or at short intervals. For example, the maintenance technician can initially hold the mobile device in a specific orientation, with the spare part displayed on the mobile device screen at the initial viewing angle. If the maintenance technician subsequently pans, rotates, or otherwise changes the orientation of their mobile device, this can be detected by the mobile device itself and interpreted as an indication that the maintenance technician wishes to have the spare part displayed from a different angle.

[0030] For example, modern mobile devices often incorporate integrated acceleration sensors that generate signals indicating the direction in which the mobile device is currently accelerating. Such acceleration sensors can preferably detect acceleration in all spatial directions. By appropriately analyzing the signals from such acceleration sensors, a change in the orientation of the mobile device can be inferred. Furthermore, displacements of the mobile device can also be detected.

[0031] Based on the knowledge of the detected change in the orientation of the mobile device, the selected spare part with its visually recognizable properties can then be displayed in perspective on the mobile device's screen from a changed viewing angle. The changed viewing angle can be selected to correspond to the changed orientation of the mobile device. In other words, the changed viewing angle can behave in the same or similar way to the initial viewing angle as the changed orientation of the mobile device behaves in relation to the initial orientation of the mobile device. Angular changes in the orientation of the mobile device can correspond to angular changes in the viewing angle or at least scale unambiguously with them.

[0032] The maintenance technician can thus obtain different perspectives on the spare part displayed on the screen by deliberately reorienting his mobile device.

[0033] It may be possible to provide for the mobile device to first be brought into a specific initial orientation before changes in the orientation of the mobile device are recorded based on this initial orientation. The initial orientation can, for example, be selected such that the maintenance technician sees the real component from an angle that corresponds to the initial viewing angle of the spare part displayed virtually in perspective on the screen. If the maintenance technician sets this orientation of the mobile device as the initial orientation, they can then, for example, view the real component from different angles, moving and reorienting their mobile device accordingly in order to visualize the selected spare part on its screen in a corresponding perspective view at a corresponding viewing angle.The maintenance technician can therefore easily compare the real component with the selected spare part from different perspectives.

[0034] In order to give the maintenance technician an additional option to change the virtual viewing angle of the spare part displayed on the screen, touches on the screen of the processor-controlled mobile device can be recorded and the size and / or orientation of the perspective display of the selected spare part can be changed depending on the recorded touches.

[0035] For example, the mobile device's screen can be touch-sensitive, i.e., designed as a touchscreen. Using such a screen, touches on the screen, such as those made by a technician with their fingers, can be detected. In particular, finger movements on the screen can be detected. These movements can then be analyzed and recognized as an indication that the maintenance technician desires a perspective view of the selected spare part from a different angle and / or in a different size.

[0036] For example, the maintenance technician can touch a reference point on the screen with their finger and then move it to change the desired viewing angle. Furthermore, the maintenance technician can, for example, mark an area with two fingers and, by moving the two fingers relative to each other, indicate that an enlarged or reduced view of the spare part is desired. This allows the maintenance technician, for example, to change the initial viewing angle from which the spare part is initially displayed in perspective on the screen and to adjust the size of the perspective view to correspond to the maintenance technician's view of the actual component to be replaced, thus simplifying a visual comparison of the actual component and the virtually displayed spare part.

[0037] According to one embodiment, the method presented here for visualizing a spare part can be advantageously supplemented by additionally taking a photo with a camera of the processor-controlled mobile device and displaying the photo together with the perspective representation of the specifically selected spare part on the screen of the processor-controlled mobile device.

[0038] Processor-controlled mobile devices usually have a built-in camera that can be used to take photos. The camera is often located on the opposite side of the mobile device from the screen.

[0039] For the application described here, the mobile device's camera can be pointed toward a component to be replaced, and a photo of the component and, if applicable, its surroundings can be taken. This photo can then be displayed on the mobile device's screen along with a perspective view of the previously selected spare part. This allows the maintenance technician to simultaneously see the photo of the actual component and the perspective view of the selected spare part on the screen, allowing them to easily compare them.

[0040] In particular, in a special embodiment, the photo and the perspective representation of the specifically selected spare part can be displayed superimposed, at least in some areas.

[0041] In other words, the photo and the perspective view do not need to be displayed separately, for example, side by side. Instead, it may be advantageous to overlap the perspective view of the spare part with the photo or to integrate it into the photo. If necessary, the maintenance technician can be given the option of specifying the position where the perspective view of the spare part should be displayed in the photo, for example, by dragging the perspective view to a desired position by touching the screen. This makes it particularly easy to compare the spare part and the image of the actual component.

[0042] It may even be possible to display the perspective view of the spare part and / or the photo partially translucently, and to directly overlay the representation of the spare part and the reproduction of the actual component. This allows, for example, the contours of the spare part and the actual component to be compared particularly well.

[0043] In a further special embodiment, the method can be supplemented by transmitting the photo together with the perspective representation in the changed viewing angle corresponding to the changed orientation to an external server.

[0044] In other words, the maintenance technician can be given the opportunity not only to take a photo and compare its content with the perspective view of the selected spare part, but also, after changing the orientation of the mobile device in a desired manner in order to select a viewing angle for the perspective view of the spare part that seems appropriate to him, to be able to transmit the photo together with the perspective view to an external server.

[0045] For example, if the maintenance technician is unsure whether the selected spare part is actually suitable for replacing a defective component, they can transmit a photo of the defective component directly to the external server, along with the previously selected spare part in a suitable perspective view. There, the transmitted image data can be reviewed by experts from a spare part manufacturer, for example, and the maintenance technician can then receive feedback on whether the spare part can actually replace the defective component. Using the mobile device to capture and transmit the relevant data is particularly intuitive for the maintenance technician.

[0046] The mobile device according to the second aspect of the present invention is a small, portable device that has suitable processor power and a suitable screen to display 3D data of a spare part in perspective. Furthermore, the mobile device preferably has a data memory in which the 3D data and possibly also data relating to the list of possible spare parts can be stored. Furthermore, the mobile device preferably has an interface, preferably a wireless interface, via which the 3D data can be downloaded from an external server. Finally, the mobile device preferably additionally has an acceleration sensor, with the aid of which a current orientation of the mobile device can be detected.

[0047] The mobile device can be programmable such that, using a special computer program product according to an embodiment of the third aspect of the invention or an app, it can be enabled to execute, control, or implement embodiments of the method described herein. The computer program product can be programmed in any computer language understandable by the mobile device.

[0048] The computer program product can be stored on a computer-readable medium according to an embodiment of the fourth aspect of the invention, such as a data storage device. Such a computer-readable medium can be portable. For example, the computer-readable medium can be a CD, a DVD, a flash memory, or the like. Alternatively, the computer program product can be stored on a stationary computer or server from which it can be downloaded. The server can be part of a data cloud. The computer program product can be downloaded via a network, such as the Internet.

[0049] It should be noted that some of the possible features and advantages of the invention are described herein with reference to different embodiments of the method for visualizing spare parts, on the one hand, and a mobile device usable therefor, on the other. A person skilled in the art will recognize that the features can be combined, adapted, or exchanged as appropriate to achieve further embodiments of the invention.

[0050] Embodiments of the invention are described below with reference to the accompanying drawings, wherein neither the drawings nor the description are to be construed as limiting the invention.

[0051] Fign. 1(a) bis (d) illustrate steps of an inventive method for visualizing spare parts.

[0052] The figures are merely schematic and not to scale. The same reference numerals designate identical or equivalent features in the various figures.

[0053] Fig. 1 illustrates various steps (a) to (d) of an embodiment of a method according to the invention for visualizing spare parts.

[0054] In a first step, as he Fig. 1(a) As illustrated, a list 5 of possible spare parts 7 is displayed on the screen 3 of a mobile device 1 controlled by a processor 4. Written information 9 and / or pictorial information 11 can be displayed in the list 5 for each possible spare part 7.

[0055] A maintenance technician who has been entrusted with the maintenance of, for example, a passenger transport system and who wishes to replace a defective component 13 can select a specific spare part 15 from this list 5.

[0056] The mobile device 1 can then contact an external server 19, for example via an interface 17, in which 3D data 33 relating to a plurality of spare parts 7 are stored. The server 19 can be operated, for example, by a manufacturer of spare parts 7. The 3D data 33 can be, for example, CAD data that the manufacturer created as part of the development and / or production of the spare parts 7. The server 19 can be part of a data cloud 21. The mobile device 1 can then download 3D data 33 relating to the specifically selected spare part 15 from the server 19, preferably via wireless data transmission.

[0057] As in Fig. 1(b) As illustrated, the mobile device 1 can then display visually recognizable properties of the selected spare part 15, as defined in the downloaded 3D data 33, in perspective on the screen 3. The perspective display is initially based on an initial viewing angle.

[0058] The maintenance technician can then, as in Fig. 1(c) Illustrates viewing the spare part 15 displayed on the screen 3 of the mobile device 1 from different angles. To do so, the maintenance technician can move the mobile device 1, in particular pivot, rotate, and / or turn it, to change its orientation. The orientation of the mobile device 1 in a changed orientation can be detected using acceleration sensors 25 of the mobile device 1. The specifically selected spare part 15 can then be displayed in perspective at a changed viewing angle corresponding to the changed orientation.

[0059] Optionally, in an additional step as described in Fig. 1(d) As illustrated, a camera 23 of the mobile device 1 can be used to take a photo 27 of the component 13 to be replaced. The photo 27 can then be displayed on the screen 3 together with the perspective view of the previously specifically selected spare part 15. The photo 27 and the perspective view of the spare part 15 can be visualized side by side or in an at least partially overlapping manner (not shown for reasons of clarity).

[0060] If necessary, the photo 27 can be transmitted together with the perspective view of the spare part 15 from the handset 1 to an external server 29, which in turn can be part of a data cloud 31, in order to have it analyzed there to determine whether the spare part 15 can really replace the component 13 in a suitable manner.

[0061] In summary, and with a modified wording, one idea underlying the approach presented here can be seen as representing a kind of virtual hologram for each spare part to make selection easier for a field technician. Source data for the hologram can come from CAD data previously created for spare parts. The hologram, or perspective representation of the spare part, can be generated on the mobile device screen using the integrated camera, accelerometers, and graphics software modules. An existing spare parts catalog or a dedicated app can be extended to access the 3D models of each spare part. The app will then calculate the design and display it on the mobile device screen, for example, as an overlay image over a camera image. When the 3D model is displayed, the user can pan their mobile device.Based on accelerometer values, the app will rotate the 3D model in the corresponding axis. Since the background on the screen displays the current camera image, the user will experience the sensation of a holographic spare part when moving the mobile device in an axis. Overall, this can improve the identification of a required spare part, as the user can obtain a 3D image of the spare part and a 360° view of it. As a result, fewer incorrect spare parts orders can be placed, thus saving costs and / or reducing downtime due to defective passenger transport systems.

[0062] Finally, it should be noted that terms such as "having," "comprising," etc., do not exclude other elements or steps, and terms such as "a" or "an" do not exclude a plurality. Furthermore, it should be noted that features or steps described with reference to one of the above embodiments may also be used in combination with other features or steps of other embodiments described above. Reference signs in the claims are not to be considered as limitations.

Claims

1. Method for visualizing replacement parts (7), in particular for visualizing replacement parts (7) of a passenger transport system, comprising: - displaying a list (5) of possible replacement parts (7) on a screen (3) of a processor-controlled mobile device (1) and prompting for selection of a specific replacement part (15) from the displayed list (5); - downloading 3D data (33) of the specifically selected replacement part (15) from an external server (19) via a network, wherein the 3D data (33) contain spatial information regarding visually discernible properties of the specifically selected replacement part (15); - displaying a perspective view of the specifically selected replacement part (15) with its visually discernible properties on the screen (3) of the processor-controlled mobile device (1) from an initial viewing angle; - detecting a change in the orientation of the processor-controlled mobile device (1) to an altered orientation, wherein the change in the orientation of the processor-controlled mobile device (1) is detected using signals provided by acceleration sensors (25) in the processor-controlled mobile device (1); and - displaying a perspective view of the specifically selected replacement part (15) with its visually discernible properties on the screen (3) of the processor-controlled mobile device (1) from an altered viewing angle corresponding to the altered orientation.

2. Method according to claim 1, further comprising: detecting touches on the screen (3) of the processor-controlled mobile device (1) and changing a size and / or orientation of the perspective view of the specifically selected replacement part (15) on the basis of the detected touches.

3. Method according to either of claims 1 or 2, further comprising: capturing a photograph (27) using a camera (23) of the processor-controlled mobile device (1); and displaying the photograph (27) together with the perspective view of the specifically selected replacement part (15) on the screen (3) of the processor-controlled mobile device (1).

4. Method according to claim 3, wherein the photograph (27) and the perspective view of the specifically selected replacement part (15) are displayed superimposed at least in certain regions.

5. Method according to either of claims 3 and 4, further comprising: transmitting the photograph (27) together with the perspective view of the replacement part (15) from the altered viewing angle corresponding to the altered orientation to an external server (29).

6. Method according to any of the preceding claims, wherein the 3D data (33) are CAD data of the specifically selected replacement part (15).

7. Method according to any of the preceding claims, wherein the 3D data (33) are downloaded from the server (19) via a wireless network.

8. Mobile device (1) having a processor (4), a camera (23), a screen (3), and optionally having at least one acceleration sensor (25), wherein the mobile device (1) is configured to execute, control or implement the method according to any of claims 1 to 7.

9. Computer program product, comprising computer-readable instructions which, when executed on a processor-controlled mobile device (1), cause said mobile device to execute, control or implement the method according to any of claims 1 to 7.

10. Computer-readable medium having a computer program product according to claim 9 stored thereon.