Process of registering a part with its digital twin using a visual marker

The method of using a visual marker on parts to allow angular location under specific light conditions addresses the challenge of registering highly axisymmetric parts with their digital twins, enhancing the accuracy and efficiency of inspections and non-destructive testing.

FR3156905A1Pending Publication Date: 2025-06-20SAFRAN HELICOPTER ENGINES
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
FR2023014308
Authority / Receiving Office
FR · FR
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-12-15
Publication Date
2025-06-20

AI Technical Summary

Technical Problem

Existing methods for registering parts with their digital twins are inadequate, especially for highly axisymmetric parts, as they struggle to accurately determine the angular position of the part, leading to difficulties in superimposing the digital twin onto the physical part, particularly when damage is invisible under natural light.

Method used

A method involving the use of a visual marker on the part, which is configured to allow angular location of the part. This method includes exposing the part to ultraviolet or infrared light sources, capturing the part with the marker under these conditions, and then implementing a computer-aided registration of the captured part with its digital twin using the geometric shape of the visual marker.

Benefits of technology

This method enables precise registration of the part with its digital twin, even for highly axisymmetric parts, by allowing accurate angular location using the visual marker, thereby improving the efficiency and accuracy of visual inspection and non-destructive testing processes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

The present invention relates to a method for registering a digital twin with a part (P) on which is arranged a visual marker configured to allow angular location of the part, the method comprising - an exposure (E3) of said part to at least one light source in the ultraviolet range, - at least one capture (E4) of said part on which the visual marker is arranged, and exposed under said light source, - a registration (E5) implemented by computer of said captured part with a digital twin of said part, from said visual marker present on said part and a digital marker present on the digital twin, the geometric shape of said visual marker positioned on said part allowing said registration between said part and its digital twin. Figure for abstract: [Fig. 3a]
Need to check novelty before this filing date? Find Prior Art

Description

Title of the invention: Method for registering a part with its digital twin using a visual marker Technical field

[0001] The present invention relates to the field of the control of parts, in particular turbomachine parts, in particular in the aeronautical field; this in order to possibly detect design or manufacturing defects, or damage caused by the wear of these parts and for example to assist in repair. Prior art

[0002] The condition of the mechanical components of a machine, of a system, for example a gas turbine, is checked at different stages of its life cycle: during its manufacture, to check compliance with its definition, after its commissioning as part of its maintenance, to check the acceptability of damage suffered during operation and / or repairs. These checks aim to avoid the presence of singularities, damage, likely to impact the mechanical characteristics, safety, availability and / or operating cost. In addition, it may be advantageous to carry out non-destructive testing to check the conformity of the parts.

[0003] These controls may for example require characterizing the type and dimensions of the singularity or damage to a part and evaluating it with regard to an acceptance criterion. The statuses of the various inspections carried out during the life of the parts may contribute to the decision of the action to be taken following a given inspection, and possibly if the part is in use, the term before which this action must be taken: acceptance as is, repair or rejection.

[0004] Such part inspections can be carried out manually, but increasingly, the use of augmented reality can offer the possibility of capitalizing on part damage data and digitizing the inspections. There are currently inspection processes during which specific areas of the parts (such as edges) are identified. However, it can be difficult to identify certain components of the part's position in this way, in particular the azimuthal position of the part when the latter is highly axisymmetric. Digitizing inspections using augmented reality software requires efficient registration of the part to be inspected with its digital twin, which is made complex when the damage is invisible under natural light. There is therefore a need to improve the visual inspection processes for parts that may have damage related to their wear, their use or more generally to their damage. Statement of the invention

[0005] The present invention relates to a method for registering a digital twin with a part on which is arranged a visual marker configured to allow angular location of the part, the method comprising - exposure of said part to at least one light source in the ultraviolet range, - at least one capture of said part on which the visual marker is placed, and exposed under said light source, - a computer-implemented registration of said captured part with a digital twin of said part, from said visual marker present on said part and a digital marker present on the digital twin, the geometric shape of said visual marker positioned on said part allowing said registration between said part and its digital twin.

[0006] According to certain embodiments, said marker is visible upon exposure of said part to ultraviolet light.

[0007] According to certain embodiments, the method comprises at least one exposure of said part to a second light source in the infrared range, said marker being visible during the exposure of said part to infrared light.

[0008] According to this embodiment in which the marker is visible under infrared light, an infrared camera can be used to see the marker and transmit the image of the marker to the computer implementing the registration.

[0009] According to certain embodiments, the method comprises, prior to said exposure of said part to said at least one light source, positioning said visual marker on said part, said part being symmetrical around an axis of symmetry and preferably comprising a keying device configured to position said marker in a single position on said part.

[0010] According to certain embodiments, the method comprises, prior to said exposure: - an engraving of said part so as to form said visual marker in the form of textures capable of retaining a fluid, - filling said textures using a fluid capable of being viewed under ultraviolet light.

[0011] According to certain embodiments, the method comprises, prior to said ex position, a step of sweating of said part.

[0012] According to certain embodiments, said filling is obtained during sweating. of the said part.

[0013] According to certain embodiments, - said light source in the ultraviolet range, to which said part is exposed, has a light intensity of between 1200 pW / cm2 and 5000 pW / cm2, the wavelength of said light source being close to 365 nm - said light intensity in the vicinity of said part is less than 20 Lux.

[0014] According to certain embodiments, the marker comprises a geometric pattern allowing said resetting and a body, and - the contrast between the color of a geometric pattern of the marker and the color of the body of the marker is preferably greater than 0.7 and / or - the contrast between the color of said visual marker and the part on the periphery of the marker is preferably greater than 0.7.

[0015] According to certain embodiments, said filling is a penetrant of said part using a penetrant product configured to be visible upon exposure to ultraviolet light.

[0016] According to certain embodiments, said sweating product is fluorescein.

[0017] According to certain embodiments, the method comprises: - the highlighting of cracks and / or fissures on said part during said penetrant testing of said part, - the reproduction on said digital twin of said cracks and / or fissures highlighted on said part.

[0018] According to certain embodiments, said part is a metal part, preferably a part of an aircraft.

[0019] The present invention relates to a system for registering a digital twin with a part on which is placed a visual marker configured to allow angular location of the part and comprising - at least one light source in the ultraviolet range intended to illuminate said room, - at least one device for capturing said part exposed under said light source, - one or more processors configured together or separately to register said captured part with a digital twin of said part, from said visual marker present on said physical part and a digital marker present on the digital twin of which at least the geometric shape allows said registration between said part and its digital twin.

[0020] The present invention relates to a mechanical part comprising a visual marker, said visual marker being characterized in that it comprises a pattern engraved in said mechanical part in the form of at least one texture capable of retaining a fluid when said part is exposed to said fluid, said fluid being configured to be visible when said part is exposed to ultraviolet light.

[0021] According to certain embodiments, said fluid is configured to create a contrast between said marker and said part at the periphery of said marker or within said marker, of at least 0.7.

[0022] Other characteristics and advantages of the present invention will emerge from the description given below, with reference to the accompanying drawings which illustrate an exemplary embodiment thereof without any limiting character. Brief description of the drawings

[0023] [Fig. 1] [Fig. 1] represents a method according to a first embodiment of the invention,

[0024] [Fig.2] [Fig.2] represents a method according to a second embodiment of the invention,

[0025] [Fig.3b] [Fig.3a] represents a part on which a marker is positioned according to certain embodiments of the invention,

[0026] [Fig.3b]] [Fig.3b] represents a part on which a marker is positioned according to certain embodiments of the invention,

[0027] [Fig.4] [Fig.4] represents a system according to certain embodiments of the invention. Description of the embodiments

[0028] One aspect of the invention relates to marking parts so that the part can be matched with a digital twin of that part. Through the use of digital twins, in augmented reality technologies, it may be desirable to capitalize on data relating to damage on parts by reproducing it on the digital twin of the part.

[0029] By digital twin is meant a virtual representation of a physical object, created using digital data.

[0030] Matching, or even superimposing, a part with its digital twin can be complex when the parts are symmetrical, particularly annular or cylindrical in shape, but also square or rectangular (detecting a rotation of 90 degrees for a square part or 180 degrees for a rectangular part can be difficult to detect). Since an angular rotation of the part around its axis of symmetry cannot be detected on the part, it thus becomes difficult to superimpose the digital twin on the part. However, checks are necessarily carried out to improve the manufacturing and repair processes of parts, particularly in very demanding industries such as aeronautics. Such checks are used, for example, to identify residual indications on a part, to a penetrant or magnetic particle inspection to identify any damage and ensure the conformity of the parts.

[0031] The reproduction on a digital twin of observations made on the real part can in particular allow the capitalization of these indications so as to be able to reuse these data later to study the wear of parts for example. This reproduction can also allow a brazing operator to position the brazing on the part later, using the indications present on the digital twin and positioned for example by a penetrant testing operator.

[0032] Current techniques for superimposing a part on its digital twin are not suitable for parts with high symmetry, particularly when the parts are more than 90% axisymmetric.

[0033] The present invention proposes the use of markers positioned on the part and allowing angular location of the part, making it possible to superimpose the digital twin on the part.

[0034] To this end, the present disclosure proposes to overcome in particular the drawbacks and problems mentioned above. To do this, the invention relates to a method for registering a digital twin with a part on which is placed a visual marker configured to allow angular location of the part, the method comprising - exposure of the part to at least one light source in the ultraviolet range, - at least one capture (E4) of the part on which the visual marker is placed, and exposed under at least one light source, - a computer-implemented registration (E5) of the captured part with a digital twin of the part, from the visual marker present on the part and a digital marker present on the digital twin, the geometric shape of the visual marker positioned on the part allowing said registration between said part and its digital twin.

[0035] [Fig. 1] represents a first embodiment of a registration method for the purpose of controlling a part, according to the present disclosure.

[0036] The parts are preferably made of metal, for example cobalt, nickel, aluminum, but can be made of other types of material. In the present example, the part can be a turbine distributor, in particular a turbine distributor of a turbomachine.

[0037] The condition of the mechanical components of a machine, of a system, for example a gas turbine, is checked at different stages of its life cycle: during its manufacture, to check compliance with its definition, after its commissioning as part of its maintenance, to check the acceptability of the damage suffered during operation and / or repairs. These checks aim to eliminate the presence of singularities, damages, likely to impact the mechanical characteristics, safety, availability and / or operating costs.

[0038] These controls require characterizing (type and dimensions) the singularity / damage and evaluating it with regard to an acceptance criterion. The statuses of the different inspections carried out during the life of the parts can contribute to the decision of the action to be taken following a given inspection, and possibly if the part is in use, the term before which this action must be taken: acceptance as is, repair or rejection.

[0039] The present disclosure can make it possible to carry out these checks, in particular those of the following types: visual inspections, endoscopic inspections, non-destructive testing (fluorescent penetrant testing, infrared thermography, X-ray, magnetic particle testing, US testing, eddy current testing, etc.)

[0040] As mentioned previously, the invention may be of particular interest when applied to penetrant testing. This application is of course not limiting and therefore the method may first comprise a non-essential step, E1, of penetrant testing of the part. The invention may also be of particular interest in magnetic particle testing under ultraviolet light.

[0041] Penetrant testing is generally carried out by illuminating the part using light preferably operating in the ultraviolet range, i.e. with a wavelength between 320 and 400 nm so as to highlight the cracks or fissures revealed during penetrant testing. This complicates the identification of the part and its superposition on its digital twin in the case where one or more black and white optical markers are present on the part. Indeed, the use of black and white optical markers disrupts the penetrant testing carried out by the operator due to the glare it causes.

[0042] During the penetrant testing of the part, step E1, the part is exposed to a fluid, such as fluorescein. This penetrant fluid is left on the surface for a certain time (the penetration time) to allow the substance to infiltrate into any cracks or damage (e.g., cracks or crevices). After the penetration time, the excess liquid is wiped off the surface, but the liquid remaining in the cracks remains unchanged. A powder or aerosol developer is preferably applied to the surface. The developer absorbs the penetrant liquid that has remained in the damage (e.g., cracks or crevices), bringing it to the surface and creating visible marks.

[0043] The part having undergone this penetrant testing process is then inspected by an inspector in order to identify any cracks or fissures.

[0044] Prior to this inspection, in this embodiment, a marker is po located on this part, step E2. The part may include a keying device configured to receive the marker in a single or unique position. In other words, the keying device present on the part and the marker can assemble in a single position. In other words, the marker can be positioned or fitted onto the part in a single configuration. The keying device may consist of a small protrusion or a groove, the marker then including a void to accommodate this protrusion or a protrusion to fit into the groove.

[0045] For this purpose, the marker may also comprise one or more devices configured to allow it to fit or assemble onto the part. In other words, the shape of the marker is configured to allow it to assemble, fit, or be housed in the part in a single position.

[0046] In other words, the marker and the part can be assembled by male-female type devices allowing them to fit together.

[0047] In some embodiments, no keying device is used. The center of the part (or any location on the part where the marker is positioned) and the center of the marker may be aligned, for example using laser technologies, such as imaging, to position the marker at the desired location.

[0048] Preferably, the marker is assembled on the part so as to remain secured to the part when the part is handled in different positions. Thus, the marker or the part, or both, may comprise a locking device making it possible to fix the marker on the part in order to prevent it from moving or in order to prevent any mobility of the marker relative to the part when the part is set in motion, for example during its handling by a control operator.

[0049] According to other embodiments, the marker is simply placed on said part, without being blocked on said part, in the single position and the part is not set in motion by the control operator but blocked in a fixed position and it is the control operator who moves around the part.

[0050] The marker, which can also be characterized as a visual or optical marker, is positioned on the part in a unique position so as to be able to determine or identify an angular position of the part. For this purpose, the marker has a geometric shape or includes a geometric shape, which makes it possible to align the part with a digital twin of the part. When the part is circular or cylindrical, or even square or rectangular, it is necessary to be able to detect its orientation relative to its axis of symmetry. Otherwise, the digital twin and the part may be angularly offset.

[0051] This geometric shape is non-symmetrical with respect to the axis of symmetry, or the axis of rotation, in order to allow this angular location, still considered as an azimuthal location, of the part.

[0052] Preferably, the center of the marker can be positioned on the axis of symmetry of the part.

[0053] When the part has undergone penetrant testing, damage intended to be highlighted on the part, for example cracks and fissures, is visible under ultraviolet light when the part has been exposed to fluorescein.

[0054] Thus, the marker is configured, according to one embodiment, to be visible when said part is exposed to ultraviolet light. Preferably at least one geometric pattern of the marker allowing angular location of the part is visible under ultraviolet light.

[0055] Preferably, the marker is not black and white in color, in order to avoid dazzling the operator, thus making it difficult to detect damage under ultraviolet light, and in particular the areas of the part located near the location of the marker on the part.

[0056] In order to be visible under ultraviolet light, the minimum contrast between the color of a geometric pattern of the marker and the color of the rest of the marker or between the color of the marker and the color of the body of the part is preferably at least 0.7.

[0057] According to some embodiments, the marker or at least one geometric pattern of the marker for angular location of the part is configured to be fluorescent green in color. The main characteristic of fluorescent green is that it emits a bright green light when exposed to ultraviolet light. This property is due to fluorescence, where components of the material absorb UV energy and re-emit it as visible light, generally in the green range. The wavelength of bright greens can be in the wavelength range of 520 to 550 nm.

[0058] In some cases, the wavelengths of the fluorescent green color may be somewhat shorter or longer depending on the color of the specific fluorescent product.

[0059] Thus, the marker positioned on the part can allow angular location of the part, in particular for example when the part is set in motion, for example on a support, during its inspection or visual control, for example under ultraviolet light, by an operator or automatically by software.

[0060] According to certain embodiments, it can be noted that steps E1 and E2 can be carried out in a different order, that is to say that step E2 can be carried out before step E1. In this case, the penetrant testing is carried out on the part comprising the marker. The marker is then integrated and, if it comprises for example grooves, can see the penetrant fluid filling the grooves, in the same way that it fills the cracks or fissures in the part. This can advantageously eliminate the need for a colored marker that must be applied to the part, the color being applied during penetrant testing in the integrated marker. The color of the marker is therefore identical to that of the penetrant fluid. The pattern of the marker then differentiates it from the cracks or fissures to allow registration from the marker. The fluid is configured to create a contrast between the marker and the part at the periphery of the marker or within the marker, of at least 0.7.

[0061] The marker can be made using 3D printing. In such a case, it can for example be made of fluorescent or glossy plastic, known as "glossy" in English, allowing good contrast when exposed to ultraviolet light.

[0062] During a step E3, the part is exposed to light whose wavelength is included in the range corresponding to ultraviolet, namely between 100 nm and 400 nm. Preferably, the wavelength used is that of UV-A whose wavelength is between 315 nm and 400 nm and more particularly around 365 nm, with a tolerance of + / - 5 nm.

[0063] Exposing the part to ultraviolet light allows an operator to visualize damage (e.g. cracks, fissures) that is highlighted by the penetrant testing of the part. Thus, the operator can inspect the part to identify its damage and / or highlight it, for example by adding a mark that could be visible under white light during subsequent steps, in particular when correcting the highlighted damage, for example using brazing techniques performed under natural white light. According to certain embodiments, this mark visible under white light may be a red colored marker.

[0064] According to some embodiments, the lighting conditions may be specified so as to allow optimal viewing of the marker. In other words, the lighting conditions are configured to allow viewing of the marker when the marker is illuminated by ultraviolet light.

[0065] According to certain embodiments, the light intensity can therefore be determined so as to allow visualization of the marker when the latter is illuminated by ultraviolet light. To this end, the light intensity can be between 1200 pW / cm2 and 5000 pW / cm2.

[0066] According to certain embodiments, the visible light intensity is less than 20 Lux at the part to be inspected.

[0067] Thus, exposing the part, on which the marker is positioned, to ultraviolet light can allow visualization of both the marker and the damage highlighted by the penetrant testing, without glare.

[0068] Exposing the part to ultraviolet light may also allow capture of one or more images of the part on which the marker and damage are visible.

[0069] Thus, according to the present disclosure, one or more captures of the part exposed to ultraviolet light are carried out, step E4.

[0070] For this purpose, one or more cameras, or capture devices, are arranged above the part on which the marker is positioned. The camera(s) are configured to take one or more images of the part on which the marker is visible. Thus, if the marker is visible on only one face of the part, the cameras are configured or arranged so as to capture the face of the part where the marker is located.

[0071] It may be noted that the camera(s) and the ultraviolet illumination device may be part of a single device or may be different devices.

[0072] According to another embodiment, the visual marker, on the physical part, can be visible when illuminating the part with infrared light (light whose wavelength is included in the range corresponding to infrared, namely between 0.75 pm and 1 mm) rather than with ultraviolet light. To this end, during step E3 previously described, the part, comprising the visual marker (or on which the visual marker is arranged) is exposed at least to infrared light making it possible to highlight the infrared visual marker. To this end, the marker is configured to be visible under infrared light. The marker must also have sufficient contrast, as described later in the case of a marker visible under ultraviolet light. In an embodiment where the marker is visible under infrared light, a second camera, of the infrared type, can advantageously make it possible to visualize the marker on the part.

[0073] Preferably, the part is exposed both to ultraviolet light making it possible to highlight the cracks containing the penetrant liquid visible under ultraviolet light, and simultaneously to infrared light making it possible to highlight the visual marker. An advantage is to allow both identification of the visual marker for resetting the part, and identification of the penetrant indications.

[0074] The camera(s) are connected to a device configured to receive the images and superimpose them on a digital twin, or a digital copy, of the part, step E5. According to certain embodiments, such a device is a computer, a tablet or an electronic device comprising one or more processors configured to match, or even register or superimpose, the captured image (or an image reconstructed from a plurality of captured images) of the part and a digital image of the part. The digital image of the part represents the part on which a digital representation of the marker, or a digital twin of the marker, is positioned. The digital marker is positioned on the digital twin at the same location as the actual marker is placed on the part. Indeed, since the digital twin of the part is an exact representation of the part, it also includes the keying device configured to receive the digital marker in a single or unique position. The digital marker is integral with the digital twin of the part. In other words, the digital marker is a digital twin of the actual marker.

[0075] The registration of the part with its digital twin is carried out using markers, real and digital. Indeed, in the absence of a marker, when the part is symmetrical, and particularly when the part is circular or cylindrical in shape, there is no difference between an image of the part according to a first position and an image of the part having undergone a rotation of an angle 0, the part being perfectly symmetrical with respect to its center, which is also its axis of symmetry. With the presence of the marker, it is easy to match the part and its digital twin. A rotation of the part causes a rotation of the marker, the latter being integral with the part and of non-symmetrical shape, its change of position makes it possible to detect the angle of rotation.

[0076] Preferably, the capture device can take a video of the part and not one or more still images. Thus, when an operator moves the part, for example to mark indications easily or comfortably, the digital twin undergoes the same movement.

[0077] Preferably, the device receiving the captured images or videos is configured to display the captured images or videos in whole or in part. For this purpose, the device may comprise display means, such as a viewing or display screen.

[0078] [Fig.2] represents a second embodiment of the present invention.

[0079] Several steps are common to [Fig.l] and [Fig.2] and in particular steps E3 to E5 as well as the applications which result from the method.

[0080] In this embodiment, the marker is inseparable from the part and can either be created during the design of the part, or added later but in such a way as to form an integral part of the part.

[0081] To this end, the method comprises, step S1, an etching of the part configured to reproduce a non-symmetrical pattern on the part. This etching may, for example, consist of applying a texture different from the rest of the part for the area(s) constituting the marker. This etching may consist of grooves drawing the pattern of the marker.

[0082] The part with its integrated marker is exposed to penetrant testing, step S2. During the Penetrant testing of the part involves exposing the part to a fluid, such as fluorescein. This penetrant fluid is left on the surface for a certain period of time (the penetration time) to allow the substance to penetrate into any cracks or damage, as well as into grooves or more generally into the marker's pattern or pattern traces. After the penetration time, the excess liquid is wiped off the surface, but the liquid remaining in the cracks and in the marker remains unchanged. A powder or aerosol developer is applied to the surface. The developer absorbs the penetrant liquid that remained in the damage and in the marker, bringing it to the surface and creating visible marks.

[0083] Following step S2, the method proceeds to steps E3 to E5 as described previously and not repeated here.

[0084] Thus, at the end of step E5, the part and its digital twin are perfectly aligned and subsequent steps can be carried out, these steps relating to non-essential applications of the invention.

[0085] Among these applications, mention may in particular be made of the localization of damage revealed by penetrant testing. Indeed, the damage revealed and appearing during exposure of the part to ultraviolet light, appears on the captured image, images or video. Thus, the method may comprise the visualization and localization of the visible damage on the part, at their corresponding location on the digital twin of the part. According to other embodiments, the method may comprise the indication, or even the pointing, for example with a pencil or a stylus or in another manner, automatically for example, of the location of the damage on the part, under ultraviolet lighting, and the reporting of an indication relating to this damage at their corresponding location on the digital twin of the part.In some embodiments, an operator may indicate or point out damage to the part, as previously mentioned.

[0086] These indications reported on the digital twin can make it possible to capitalize on information relating to the presence of defects on the parts, and in particular for example damage linked to wear and their location, and thus improve the design and / or the manufacture of new models of parts. They thus allow a better understanding of the phenomena undergone by the parts and can thus improve the safety of devices integrating such parts, in particular when these parts are integrated into vehicles, for example in aeronautics.

[0087] An application of the present invention may be the digitization of singularities / damages and the exploitation (decision-making and historization) of the results of non-destructive testing in a multi-spectral environment: visual or endoscopic inspections in white light, fluorescent penetrant testing, thermography.

[0088] According to certain applications, following the detection of damage and its marking on the digital twin, a soldering operator, who does not work under ultraviolet light but under white light and who therefore does not detect the damage highlighted under UV light, can use the indications which have been reported by a penetrant testing operator to carry out the soldering of the part. Thus the method can comprise, from the indications reported on the digital twin, a step of soldering or repairing the damage highlighted, on the real part, which can advantageously be illuminated in white light. Thus, the repairs are carried out from the indications present on the digital twin and this avoids having to carry out the soldering on the part exposed to UV light to see where the damage is located, visible mainly in UV light, following the penetrant testing.

[0089] Figures 3a and 3b represent a part on which a marker is positioned according to certain embodiments of the invention.

[0090] As mentioned previously, the marker is a visual pattern that can be used to detect an angular position of a part.

[0091] According to certain embodiments, the visual pattern may be marked or engraved or present on the part, in other words be an integral part of the part. This embodiment is shown in [Fig.3a].

[0092] According to some embodiments, the visual pattern may be present on a device separate from the part and this separate device may be positioned on the part in order to allow angular detection of the position of the part. This embodiment is shown in [Fig.3b].

[0093] The pattern of Figures 3a and 3b preferably comprises colored areas, the characteristic color of which is not visible in black and white figures. These patterns are however indicated in the grayscale figures. The pattern is formed of one or more geometric areas and is non-symmetrical with respect to the axis of symmetry, or the axis of rotation of the part, in order to allow angular identification of the part.

[0094] As mentioned previously, the marker comprises a geometric pattern allowing registration and a body, and - the contrast between the color of a geometric pattern of the marker and the color of the body of the marker is preferably greater than 0.7 and / or - the contrast between the color of the visual marker and the part on the periphery of the marker is preferably greater than 0.7.

[0095] In [Fig.3a], the pattern comprises in particular three points arranged in two squares whose outlines are drawn. The three points as well as the squares are of a color visible when exposed to ultraviolet light.

[0096] Preferably, the contrast between the color of the three points and the squares is 0.7 with the other areas of the pattern, in particular areas other than points and squares when the pattern includes not only the colored areas constituting the geometric pattern allowing angular detection but also one or more other areas which may constitute a colored background.

[0097] Preferably, the contrast between the color of the three points and the squares is 0.7 with the part on which the pattern is engraved. This can be the case when the marker is only made up of the colored visual pattern allowing angular detection of the part and does not include a colored background. The colored pattern then stands out from the background of the part.

[0098] As mentioned previously, according to this embodiment, the pattern can be produced by engraving the part configured to reproduce on the part a non-symmetrical pattern with respect to an axis of symmetry of the part. This engraving can for example consist of applying a texture different from the rest of the part for the zone(s) constituting the marker. This engraving can consist of grooves drawing the pattern of the marker.

[0099] According to certain embodiments, the coloring of the pattern can be carried out during a penetrant testing operation of the part. During penetrant testing of the part, the latter is exposed to a fluid, such as fluorescein. This penetrant fluid is left on the surface for a certain time (the penetration time) to allow the substance to infiltrate into any cracks or damage as well as into grooves or more generally into the pattern or traces of the marker pattern. After the penetration time, the excess liquid is wiped from the surface, but the liquid remaining in the cracks and in the marker remains unchanged. A powder or aerosol developer is applied to the surface. The developer absorbs the penetrant liquid that has remained in the damage and in the marker, bringing it to the surface and creating visible marks.Thus, the marker pattern is colored by the seeping fluid to become visible upon exposure to ultraviolet light in particular. It can be noted that the pattern is also visible under natural light but stands out less visually than under ultraviolet light.

[0100] In [Fig.3b], a marker of cubic geometric shape can be seen with a distinctive pattern on each of its faces. The marker is positioned on the part and allows angular location of the part. As mentioned previously, the marker includes one or more colored areas, indicated in [Fig.3b].

[0101] According to certain embodiments, these areas may have been colored during penetrant testing of the part, if the marker is positioned on the part before the latter undergoes a penetrant testing operation.

[0102] According to certain embodiments, these areas may have been colored during the manufacture of the marker.

[0103] The part may include a keying device configured to receive the marker in a single or unique position. In other words, the keying device on the part and the marker may assemble in a single position. In other words, the marker may be positioned or fitted onto the part in a single configuration. The keying device may consist of a small protrusion or a groove, the marker then including a void to accommodate this protrusion or a protrusion to fit into the groove.

[0104] For this purpose, the marker may also comprise one or more devices configured to allow it to fit or assemble onto the part. In other words, the shape of the marker is configured to allow it to assemble, fit, or be housed in the part in a single position.

[0105] In other words, the marker and the part can be assembled by male-female type devices allowing them to fit together.

[0106] In some embodiments, no keying device is used. The center of the part (or any location on the part where the marker is positioned) and the center of the marker may be aligned, for example using laser technologies, such as imaging, to position the marker at the desired location.

[0107] Preferably, the marker is assembled on the part so as to remain secured to the part when the part is handled in different positions. Thus, the marker or the part, or both, may comprise a locking device making it possible to fix the marker on the part in order to prevent it from moving or in order to prevent any mobility of the marker relative to the part when the part is set in motion, for example during its handling by a control operator.

[0108] According to other embodiments, the marker is simply placed on said part, without being blocked on said part, in the single position and the part is not set in motion by the control operator but blocked in a fixed position and it is the control operator who moves around the part.

[0109] The marker, which can also be characterized as an optical marker, is positioned on the part in a unique position so as to be able to determine or identify an angular position of the part. For this purpose, the marker has a geometric shape or comprises one or more geometric shapes, which makes it possible to align the part with a digital twin of the part. When the part is circular or cylindrical, or even square or rectangular, it is necessary to be able to detect its orientation relative to its axis of symmetry. Otherwise, the digital twin and the part may be angularly offset.

[0110] In [Fig.3b], it can be seen that the marker comprises a geometric shape on each of the faces of the cube, or on at least 5 faces of the cube when the sixth face of the cube is positioned on the room, therefore not visible externally because hidden.

[0111] According to the embodiment of [Fig.3b], at least two of the faces of the cube have a different geometric pattern, each of the geometric patterns allowing angular detection of the part. According to other embodiments, all the faces have different geometric patterns. In addition, the geometric patterns can be colored the same color or a different color, provided that the coloring can allow sufficient contrast to be obtained, with the body of the pattern or with the body of the part at the location of the pattern or at the periphery of the pattern.

[0112] [Fig.4] represents a system capable of implementing the method according to at least one of the embodiments of the invention.

[0113] The system may comprise a support 101 on which the part P is arranged. A visual marker is arranged on the part P and configured to allow angular location of the part. As mentioned previously, the part may be a part to be inspected, for example in the context of damage, wear and other checks. Such checks may for example be carried out using penetrant testing techniques.

[0114] By way of example, the marker may be a marker as illustrated in Figures 3a or 3b. Thus, the marker may have been positioned beforehand on the part P or be an integral part of the part P, as mentioned previously. The marker may in particular be positioned on the part P by an operator who also positions the part P on the support 101 or previously, before the penetrant testing of the part. The embodiments relating to the positioning of the part P described with regard to Figures 1 and 2 apply to the system of [Fig.4].

[0115] According to certain embodiments, the support 101 may for example be a rotating support, allowing an operator to rotate the part in front of him. This is particularly relevant for circular or cylindrical parts, for which precisely the angular detection can be carried out by the present invention but a rotating support can also be used for any type of part, in particular square, rectangular or cubic parts placed on a rotating support.

[0116] The system comprises a lighting device 102 configured to diffuse ultraviolet light into the environment of the room P and more particularly in the direction of the room P so as to illuminate it.

[0117] Preferably, the lighting device is located at a distance greater than 20 cm from the room, for example at a distance of 38 cm from the room. More preferably, the device diffuses a light intensity of between 1200 pW / cm2 and 5000 pW / cm2.

[0118] The lighting device diffuses light whose wavelength is included in the range corresponding to ultraviolet, namely between 100 nm and 400 nm.

[0119] Preferably, the wavelength used is that of UV-A whose wavelength is between 315 nm and 400 nm and more particularly around 365 nm, with a tolerance of + / - 5 nm.

[0120] Preferably the intensity of white light in the vicinity of the room remains less than 20 Lux.

[0121] The system also comprises a capture device 104. The capture device 104 comprises one or more cameras configured to take one or more images of the part P. Preferably, the capture device is a video camera which films the part P.

[0122] According to certain embodiments, a second light source can diffuse light whose wavelength is included in the range corresponding to the infrared, namely between 0.75 pm and 1 mm. This can make it possible to highlight a visual marker which would be visible in the infrared domain and not in the ultraviolet domain as previously described. In other words, this can make it possible to make the marker visible, and can allow the camera(s) 104 to capture an image of the marker so that at least one image can be captured thereof.

[0123] The system also comprises processing means 103 connected to the capture device 104. The capture device and the processing means 103 may for example be connected by a wireless or wired network, for example an ethernet or bluetooth network. The processing means 103 are configured to receive the data from the capture device and more particularly the images or video captured from the part P.

[0124] The processing means 103 are further configured to perform a registration of a digital twin of the part P and the part P, from the images or the video received and the digital twin of the part. When the processing means comprise a screen, for example when the processing means are a computer or a tablet, the part P and its digital twin can appear superimposed on a screen associated with the processing means.

[0125] For this purpose, the processing means may comprise one or more computer programs configured on the one hand to determine a digital twin of the part P and on the other hand to carry out the registration between the part P and the digital twin.

[0126] More precisely, the processing means are capable of carrying out a registration of the captured part P with its digital twin, from the marker present on the part P and visible during the exposure of the part P to ultraviolet light and from a marker present on the digital twin of which at least the geometric shape allows the registration between the part and its digital twin.

[0127] The system of [Fig.4] can in particular be implemented to highlight cracks and / or splits on the part P during the penetrant testing of the part, and to reproduce on the digital twin cracks and / or splits highlighted on the part P.

[0128] According to certain embodiments, an operator can observe the part on which the marker is positioned and identify, under UV light, for example using a pencil, a marker, a stylus, the cracks or fissures or other damage. These marks can be visible in white light unlike the penetrant liquid visible under UV light. These marks can then allow a soldering operator to come and carry out the soldering of the cracks under white light.

[0129] The capture means film the part and therefore the markers positioned on the part. The part P and its digital twin being recalibrated or superimposed, the markers are then reproduced on the digital twin in their exact location, without any problem of angular offset.

[0130] The use of the markers positioned on the digital twin can make it possible to digitize the damage and carry out subsequent analyses.

Claims

Claims

1. Method for registering a digital twin with a part (P) on which is arranged a visual marker configured to allow angular location of the part, the method comprising - an exposure (E3) of said part to at least one light source in the ultraviolet range, - at least one capture (E4) of said part on which the visual marker is arranged, and exposed under said light source, - a registration (E5) implemented by computer of said captured part with a digital twin of said part, from said visual marker present on said part and a digital marker present on the digital twin, the geometric shape of said visual marker positioned on said part allowing said registration between said part and its digital twin.

2. The method of claim 1 wherein said marker is visible upon exposure of said part to ultraviolet light.

3. A method according to claim 1 comprising at least one exposure of said part to a second light source in the infrared range, said marker being visible upon exposure of said part to infrared light.

4. Method according to one of the preceding claims comprising, prior to said exposure of said part to said at least one light source, the positioning (E2) of said visual marker on said part, said part being symmetrical around an axis of symmetry and preferably comprising a keying device configured to position said marker in a single position on said part.

5. Method according to one of claims 1 to 3 comprising, prior to said exposure: - an etching (SI) of said part so as to form said visual marker in the form of textures capable of retaining a fluid, - a filling (S2) of said textures using a fluid capable of being visualized under ultraviolet light.

6. Method according to one of the preceding claims comprising, prior to said exposure, a step of penetrating (El) said part.

7. Method according to claim 5 in which said filling (S2) is obtained during sweating of said part.

8. A method according to claim 5 wherein said filling is a penetrant testing of said part using a penetrant product configured to be visible upon exposure to ultraviolet light.

9. System for registering a digital twin with a part on which is arranged a visual marker configured to allow angular location of the part and comprising - at least one light source in the ultraviolet range intended to illuminate said part, - at least one device for capturing said part exposed under said light source, - one or more processors configured together or separately to register said captured part with a digital twin of said part, from said visual marker present on said physical part and from a digital marker present on the digital twin of which at least the geometric shape allows said registration between said part and its digital twin.

Citation Information

Patent Citations

  • Three-dimensional position / orientation sensing apparatus, information presenting system, and model error detecting system

    US20020052709A1

  • System and method to display maintenance and operational instructions of an apparatus using augmented reality

    US20070273610A1

  • Surface coating for inspection

    US20130214178A1

  • Fluorescent penetrant inspection system and method

    US20200166467A1

  • Machine vision system with a computer generated virtual reference object

    US20200311909A1