Method for realigning a part with its digital twin using a visual marker
The method addresses the challenge of aligning turbomachine parts with their digital twins by using a visual marker visible under ultraviolet light, allowing for accurate registration and enhancing inspection and repair processes.
Patent Information
- Application Number
- PCT/FR2024/051644
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-12-15
- Filing Date
- 2024-12-12
- Publication Date
- 2025-06-19
AI Technical Summary
Existing methods for registering a digital twin with a part, particularly in turbomachine parts with high symmetry, face challenges in accurately aligning the part with its digital twin, especially when damage is invisible under natural light.
A method involving the use of a visual marker on the part, which is visible under ultraviolet light, allows for angular location of the part. This method includes exposing the part to ultraviolet light, capturing the part with the marker, and registering it with its digital twin using a fluorescent penetrant fluid and a digital marker on the digital twin.
The method enables precise registration of the part with its digital twin, even in cases of high symmetry and invisible damage, facilitating efficient inspections and repairs by capitalizing on data from digital twins.
Smart Images

Figure FR2024051644_19062025_PF_FP_ABST
Abstract
Description
! Description Title of the invention: Method for registering a part with its digital twin using a visual marker Technical Field
[0001] The present invention relates to the field of parts inspection, in particular turbomachine parts, in particular in the aeronautical field; this is done in order to possibly detect design or manufacturing defects, or damage caused by wear of these parts and for example to assist in repair. Prior art
[0002] The condition of the mechanical components of a machine or system, such as a gas turbine, is checked at various stages of its life cycle: during its manufacture to verify compliance with its definition, after its commissioning as part of its maintenance to verify the acceptability of damage incurred during operation and / or repairs. These checks aim to eliminate the presence of singularities or damage that could impact the mechanical characteristics, safety, availability and / or operating costs. In addition, it may be advantageous to carry out non-destructive testing to verify the conformity of parts.
[0003] These inspections may, for example, require characterizing the type and dimensions of the singularity or damage to a part and evaluating it against an acceptance criterion. The statuses of the various inspections carried out during the life of the parts may contribute to the decision on the action to be taken following a given inspection, and possibly, if the part is in use, the deadline before which this action must be taken: acceptance as is, repair or scrap.
[0004] Such part inspections can be carried out manually, but increasingly, the use of augmented reality can offer the possibility of capitalizing on part damage data and digitizing inspections. There are currently inspection processes in which specific areas of parts (such as edges) are identified. However, it can be difficult to identify certain components of the part's position in this way, particularly the azimuthal position of the part when the latter is highly axisymmetric. Digitizing inspections ! by augmented reality software requires efficient alignment of the part to be inspected with its digital twin, which is made complex when the damage is invisible under natural light. There is therefore a need to improve the methods for visually inspecting parts that may have damage related to their wear, their use or more generally to their damage. Description of the invention
[0005] The present invention relates to a method for registering a digital twin with a part on which is arranged a visual marker configured to allow angular location of the part, the method comprising - an exposure of said part to at least one light source in the ultraviolet range, - at least one capture of said part on which is arranged the visual marker, and exposed under said light source, - a registration, implemented by computer, under said ultraviolet light, of said captured part with a digital twin of said part, from said visual marker present on said part, configured to be visible under said ultraviolet light, using a fluorescent penetrant fluid, and a digital marker present on the digital twin, the geometric shape of said visual marker positioned on said part allowing said registration between said part and its digital twin.
[0006] According to this embodiment in which the marker is visible under infrared light, an infrared camera can be used to see the marker and transmit the image of the marker to the computer implementing the registration.
[0007] According to certain embodiments, the method comprises, prior to said exposure of said part to said at least one light source, positioning said visual marker on said part, said part being symmetrical around an axis of symmetry and preferably comprising a keying device configured to position said marker in a single position on said part.
[0008] According to certain embodiments, the method comprises, prior to said exposure: - an engraving of said part so as to form said visual marker in the form of textures capable of retaining a fluid, ! - filling of said textures using a fluid capable of being visualized under ultraviolet light.
[0009] According to certain embodiments, the method comprises, prior to said exposure, a step of penetrating said part.
[0010] According to certain embodiments, said filling is obtained during sweating of said part.
[0011] According to certain embodiments, - said light source in the ultraviolet range, to which said part is exposed, has a light intensity of between 1200 µW / cm 2 and 5000 µW / cm 2 , the wavelength of said light source being close to 365 nm - said light intensity in the vicinity of said room is less than 20 Lux.
[0012] According to certain embodiments, the marker comprises a geometric pattern allowing said registration and a body, and - the contrast between the color of a geometric pattern of the marker and the color of the body of the marker is preferably greater than 0.7 and / or - the contrast between the color of said visual marker and the part on the periphery of the marker is preferably greater than 0.7.
[0013] According to certain embodiments, said sweat product is fluorescein.
[0014] According to certain embodiments, the method comprises: - highlighting cracks and / or splits on said part during said penetrant testing of said part, - reproducing on said digital twin said cracks and / or splits highlighted on said part.
[0015] According to some embodiments, the method comprises brazing the part, exposed under white light, from the cracks or damage visible on said digital twin of the part.
[0016] According to some embodiments, the part is circular in shape and the geometric shape of the marker is configured to allow an angular position of said part to be detected.
[0017] According to certain embodiments, said part is a metal part, preferably a part of an aircraft. !
[0018] The present invention relates to a system for registering a digital twin with a part on which is arranged a visual marker configured to allow angular location of the part and comprising - at least one light source in the ultraviolet range intended to illuminate said part, - at least one device for capturing said part exposed under said light source, - one or more processors configured together or separately to register said captured part with a digital twin of said part, under said ultraviolet light using a fluorescent penetrant fluid, from said visual marker present on said physical part, configured to be visible under said ultraviolet light, and a digital marker present on the digital twin whose at least geometric shape allows said registration between said part and its digital twin.
[0019] The present invention relates to a mechanical part comprising a visual marker, said visual marker being characterized in that it comprises a pattern engraved in said mechanical part in the form of at least one texture capable of retaining a fluid when said part is exposed to said fluid, said fluid being configured to be visible when said part is exposed to ultraviolet light.
[0020] According to certain embodiments, said fluid is configured to create a contrast between said marker and said part at the periphery of said marker or within said marker, of at least 0.7.
[0021] Other characteristics and advantages of the present invention will emerge from the description given below, with reference to the accompanying drawings which illustrate an exemplary embodiment thereof without any limiting character. Brief description of the drawings
[0022] [Fig. 1] Figure 1 represents a method according to a first embodiment of the invention,
[0023] [Fig. 2] Figure 2 represents a method according to a second embodiment of the invention,
[0024] [FIG.3a] Figure 3a represents a part on which a marker is positioned according to certain embodiments of the invention, !
[0025] FIG. 3b] Figure 3b represents a part on which a marker is positioned according to certain embodiments of the invention,
[0026] [FIG.4] Figure 4 shows a system according to certain embodiments of the invention. Description of the embodiments
[0027] One aspect of the invention relates to marking parts so that the part can be matched with a digital twin of that part. Through the use of digital twins, in augmented reality technologies, it may be desirable to capitalize on data relating to damage on parts by reproducing it on the digital twin of the part.
[0028] A digital twin is a virtual representation of a physical object, created using digital data.
[0029] Matching or superimposing a part with its digital twin can be complex when the parts are symmetrical, particularly annular or cylindrical, but also square or rectangular (detecting a 90-degree rotation for a square part or a 180-degree rotation for a rectangular part can be difficult to detect). Since an angular rotation of the part around its axis of symmetry cannot be detected on the part, it becomes difficult to superimpose the digital twin on the part. However, checks are necessarily carried out to improve the manufacturing and repair processes of parts, particularly in very demanding industries such as aeronautics. Such checks are used, for example, to identify sweating indications on a part, for a dye penetrant inspection or by magnetic particle inspection in order to identify possible damage and ensure the conformity of the parts.
[0030] Reproducing observations made on the actual part on a digital twin can, in particular, enable the capitalization of these indications so that these data can be reused later to study the wear of parts, for example. This reproduction can also enable a soldering operator to position the solder on the part later, using the indications present on the digital twin and positioned, for example, by a penetrant testing operator.
[0031] Current techniques for superimposing a part on its digital twin are not suitable for parts with high symmetry, particularly when the parts are more than 90% axisymmetric. !
[0032] The present invention proposes the use of markers positioned on the part and allowing angular location of the part, making it possible to superimpose the digital twin on the part.
[0033] To this end, the present disclosure proposes to overcome in particular the drawbacks and problems mentioned above. To this end, the invention relates to a method for registering a digital twin with a part on which is arranged a visual marker configured to allow angular location of the part, the method comprising - an exposure of the part to at least one light source in the ultraviolet range, - at least one capture (E4) of the part on which the visual marker is arranged, and exposed under the at least one light source, - a registration (E5) implemented by computer of the captured part with a digital twin of the part, from the visual marker present on the part and a digital marker present on the digital twin, the geometric shape of the visual marker positioned on the part allowing said registration between said part and its digital twin.
[0034] Figure 1 shows a first embodiment of a registration method for the purpose of controlling a part, according to the present disclosure.
[0035] The parts are preferably made of metal, for example cobalt, nickel, aluminum, but can be made of other types of material. In this example, the part may be a turbine distributor, in particular a turbine distributor of a turbomachine.
[0036] The condition of the mechanical components of a machine, a system, for example a gas turbine, is checked at different stages of its life cycle: during its manufacture, to check compliance with its definition, after its commissioning as part of its maintenance, to check the acceptability of damage suffered during operation and / or repairs. These checks aim to avoid the presence of singularities, damage, likely to impact the mechanical characteristics, safety, availability and / or operating cost.
[0037] These controls require characterizing (type and dimensions) the singularity / damage and evaluating it with regard to an acceptance criterion. The statuses of the various inspections carried out during the life of the parts can contribute to the ! decision on the action to be taken following a given inspection, and possibly if the part is in use, the deadline before which this action must be taken: acceptance as is, repair or rejection.
[0038] This disclosure may enable these checks to be carried out, in particular those of the following types: visual inspections, endoscopic inspections, non-destructive testing (fluorescent penetrant testing, infrared thermography, X-ray, magnetic particle testing, US testing, eddy current testing, etc.)
[0039] As mentioned above, the invention may be of particular interest when applied to penetrant testing. This application is of course not limiting and therefore the method may first include a non-essential step, E1, of penetrant testing of the part. The invention may also be of particular interest in magnetic particle testing under ultraviolet light.
[0040] Penetrant testing is generally carried out by illuminating the part using light preferably operating in the ultraviolet range, i.e. with a wavelength between 320 and 400 nm, in order to highlight the cracks or fissures revealed during penetrant testing. This complicates the identification of the part and its superposition on its digital twin in the case where one or more black and white optical markers are present on the part. Indeed, the use of black and white optical markers disrupts the penetrant testing carried out by the operator due to the glare it causes.
[0041] During penetrant testing of the part, step E1, the part is exposed to a fluid, such as fluorescein. This penetrant fluid is left on the surface for a certain time (the penetration time) to allow the substance to infiltrate any cracks or damage (e.g., fissures or cracks). After the penetration time, the excess liquid is wiped off the surface, but the liquid remaining in the cracks remains unchanged. A powder or aerosol developer is preferably applied to the surface. The developer absorbs the penetrant liquid that has remained in the damage (e.g., fissures or cracks), bringing it to the surface and creating visible marks.
[0042] The part having undergone this penetrant testing process is then inspected by an inspector to identify any cracks or fissures.
[0043] Prior to this inspection, in this embodiment, a marker is positioned on this part, step E2. The part may comprise a device for ! keying configured to receive the marker in a single or unique position. In other words, the keying device present on the part and the marker can assemble in a single position. In other words, the marker can be positioned or fitted on the part in a single configuration. The keying device can consist of a small protrusion or a groove, the marker then comprising a void to receive this protrusion or a protrusion to fit into the groove.
[0044] To this end, the marker may also include one or more devices configured to allow it to fit or assemble onto the part. In other words, the shape of the marker is configured to allow it to fit together, fit into, or be housed in the part in a single position.
[0045] In other words, the marker and the part can be assembled by male-female type devices allowing them to fit together.
[0046] In some embodiments, no keying device is used. The center of the part (or any location on the part where the marker is positioned) and the center of the marker may be aligned, for example using laser technologies, such as imaging, to position the marker at the desired location.
[0047] Preferably, the marker is assembled on the part so as to remain attached to the part when the part is handled in different positions. Thus, the marker or the part, or both, may comprise a locking device for fixing the marker to the part in order to prevent it from moving or in order to prevent any mobility of the marker relative to the part when the part is set in motion, for example when it is handled by a control operator.
[0048] According to other embodiments, the marker is simply placed on said part, without being blocked on said part, in the single position and the part is not set in motion by the control operator but blocked in a fixed position and it is the control operator who moves around the part.
[0049] The marker, which can also be characterized as a visual or optical marker, is positioned on the part in a unique position so that an angular position of the part can be determined or identified. For this purpose, the marker has a geometric shape or includes a geometric shape, which allows the part to be aligned with a digital twin of the part. When the part is circular or ! cylindrical, even square or rectangular, it is necessary to be able to detect its orientation relative to its axis of symmetry. Otherwise the digital twin and the part may be angularly offset.
[0050] This geometric shape is not symmetrical with respect to the axis of symmetry, or the axis of rotation, in order to allow this angular location, still considered as an azimuthal location, of the part.
[0051] Preferably, the center of the marker can be positioned on the axis of symmetry of the part.
[0052] When the part has been penetrant tested, damage intended to be highlighted on the part, such as cracks and fissures, is visible under ultraviolet light when the part has been exposed to fluorescein.
[0053] Thus, the marker is configured, according to one embodiment, to be visible when said part is exposed to ultraviolet light. Preferably at least one geometric pattern of the marker allowing angular location of the part is visible under ultraviolet light.
[0054] Preferably, the marker is not black and white in color, in order to avoid glare of the operator, thus making it difficult to detect damage under ultraviolet light, and in particular areas of the part located near the location of the marker on the part.
[0055] In order to be visible under ultraviolet light, the minimum contrast between the color of a geometric pattern of the marker and the color of the rest of the marker or between the color of the marker and the color of the body of the part is preferably at least 0.7.
[0056] In some embodiments, the marker or at least one geometric pattern of the marker for angular identification of the part is configured to be fluorescent green in color. The primary characteristic of fluorescent green is that it emits a bright green light when exposed to ultraviolet light. This property is due to fluorescence, where components of the material absorb UV energy and re-emit it as visible light, typically in the green range. The wavelength of bright greens may be in the wavelength range of 520 to 550 nm. !
[0057] In some cases, the wavelengths of the fluorescent green color may be a little shorter or longer depending on the color of the specific fluorescent product.
[0058] Thus, the marker positioned on the part can allow angular location of the part, in particular for example when the part is set in motion, for example on a support, during its inspection or visual control, for example under ultraviolet light, by an operator or automatically by software.
[0059] According to certain embodiments, it can be noted that steps E1 and E2 can be carried out in a different order, that is to say that step E2 can be carried out before step E1. In this case, the penetrant testing is carried out on the part comprising the marker. The marker is then integrated and, if it comprises for example grooves, can see the penetrant testing liquid fill the grooves, in the same way as it fills the cracks or fissures of the part. This can advantageously make it possible to not have a colored marker which must be added to the part, the color being applied during the penetrant testing in the integrated marker. The color of the marker is therefore identical to that of the penetrant testing fluid. The pattern of the marker then differentiates it from the cracks or fissures to allow registration from the marker. The fluid is configured to create a contrast between the marker and the part at the periphery of the marker or within the marker, of at least 0.7.
[0060] The marker can be made using 3D printing. In this case, it can, for example, be made of fluorescent or glossy plastic, known as "glossy" in English, allowing good contrast when exposed to ultraviolet light.
[0061] During a step E3, the part is exposed to light whose wavelength is included in the range corresponding to ultraviolet, namely between 100 nm and 400 nm. Preferably, the wavelength used is that of UV-A whose wavelength is between 315 nm and 400 nm and more particularly around 365 nm, with a tolerance of + / - 5 nm.
[0062] Exposing the part to ultraviolet light allows an operator to visualize damage (e.g. cracks, splits) that is highlighted by the penetrant testing of the part. This allows the operator to inspect the part to identify damage and / or highlight it, for example by adding a mark that could be visible under white light in later steps, particularly when correcting the highlighted damage, for example using ! soldering techniques carried out under natural white light. According to certain embodiments, this mark visible under white light may be a red colored marker.
[0063] In some embodiments, the lighting conditions may be specified to allow for optimal viewing of the marker. That is, the lighting conditions are configured to allow viewing of the marker when illuminated by ultraviolet light.
[0064] According to certain embodiments, the light intensity can therefore be determined so as to allow visualization of the marker when the latter is illuminated by ultraviolet light. For this purpose, the light intensity can be between 1200 µW / cm 2 and 5000 µW / cm 2 .
[0065] According to some embodiments, the visible light intensity is less than 20 Lux at the part to be inspected.
[0066] Thus, exposing the part, on which the marker is positioned, to ultraviolet light can allow visualization of both the marker and the damage highlighted by the penetrant testing, without glare.
[0067] Exposing the part to ultraviolet light can also allow capture of one or more images of the part on which the marker and damage are visible.
[0068] Thus, according to the present disclosure, one or more captures of the part exposed to ultraviolet light are carried out, step E4.
[0069] For this purpose, one or more cameras, or capture devices, are arranged above the part on which the marker is positioned. The camera(s) are configured to take one or more images of the part on which the marker is visible. Thus, if the marker is visible on only one side of the part, the cameras are configured or arranged to capture the side of the part where the marker is located.
[0070] It may be noted that the camera(s) and the ultraviolet lighting device may be part of a single device or may be different devices.
[0071] In another embodiment, the visual marker, on the physical part, may be visible when illuminating the part with infrared light (light whose wavelength is in the range corresponding to infrared, namely between ! 0.75 µm and 1 mm) rather than by ultraviolet light. To this end, during step E3 previously described, the part, comprising the visual marker (or on which the visual marker is arranged) is exposed at least to infrared light making it possible to highlight the infrared visual marker. To this end, the marker is configured to be visible under infrared light. The marker must also have sufficient contrast, as described later in the case of a marker visible under ultraviolet light. In an embodiment where the marker is visible under infrared light, a second camera, of the infrared type, can advantageously make it possible to visualize the marker on the part.
[0072] Preferably, the part is exposed both to ultraviolet light to highlight the cracks containing the penetrant liquid visible under ultraviolet light, and simultaneously to infrared light to highlight the visual marker. An advantage is to allow both identification of the visual marker for re-alignment of the part, and identification of the penetrant indications.
[0073] The camera(s) are connected to a device configured to receive the images and superimpose them on a digital twin, or a digital copy, of the part, step E5. According to certain embodiments, such a device is a computer, a tablet or an electronic device comprising one or more processors configured to match, or register or superimpose, the captured image (or an image reconstructed from a plurality of captured images) of the part and a digital image of the part. The digital image of the part represents the part on which a digital representation of the marker, or a digital twin of the marker, is positioned. The digital marker is positioned on the digital twin at the same location as the actual marker is placed on the part.Indeed, the digital twin of the part being an exact representation of the part, it also includes the keying device configured to receive the digital marker in a single or unique position. The digital marker is integral with the digital twin of the part. In other words, the digital marker is a digital twin of the real marker.
[0074] The registration of the part with its digital twin is carried out using markers, both real and digital. Indeed, in the absence of markers, when the part is symmetrical, and particularly when the part is circular or cylindrical, there is no difference between an image of the part in a first position and a ! image of the part having undergone a rotation by an angle θ, the part being perfectly symmetrical with respect to its center, which is also its axis of symmetry. With the presence of the marker, we can easily match the part and its digital twin. A rotation of the part causes a rotation of the marker, the latter being integral with the part and of non-symmetrical shape, its change of position makes it possible to detect the angle of rotation.
[0075] Preferably, the capture device can take a video of the part and not one or more still images. Thus, when an operator moves the part, for example to mark indications easily or comfortably, the digital twin undergoes the same movement.
[0076] Preferably, the device receiving the captured images or videos is configured to display the captured images or videos in whole or in part. For this purpose, the device may comprise display means, such as a viewing or display screen.
[0077] Figure 2 shows a second embodiment of the present invention.
[0078] Several steps are common to Figure 1 and Figure 2, including steps E3 to E5 as well as the applications that result from the method.
[0079] In this embodiment, the marker is inseparable from the part and can either be created during the design of the part or added later but in such a way as to form an integral part of the part.
[0080] To this end, the method comprises, step S1, an engraving of the part configured to reproduce a non-symmetrical pattern on the part. This engraving may, for example, consist of applying a texture different from the rest of the part for the area(s) constituting the marker. This engraving may consist of grooves drawing the pattern of the marker.
[0081] The part with its integrated marker is exposed to penetrant testing, step S2. During penetrant testing, the part is exposed to a fluid, such as fluorescein. This penetrant fluid is left on the surface for a certain time (the penetration time) to allow the substance to seep into any cracks or damage, as well as into grooves or more generally into the pattern or traces of the marker pattern. After the penetration time, the excess liquid is wiped off the surface, but the liquid remaining in the cracks and in the marker remains unchanged. A powder or aerosol developer is applied to the ! surface. The developer absorbs the penetrating liquid that remained in the damage and in the marker, bringing it to the surface and creating visible marks.
[0082] Following step S2, the method proceeds to steps E3 to E5 as described previously and not repeated here.
[0083] Thus, at the end of step E5, the part and its digital twin are perfectly aligned and subsequent steps can be carried out, these steps relating to non-essential applications of the invention.
[0084] Examples of such applications include locating damage revealed by penetrant testing. Indeed, damage revealed and appearing when the part is exposed to ultraviolet light appears in the captured image, images or video. Thus, the method may include viewing and locating visible damage on the part at its corresponding location on the digital twin of the part. In other embodiments, the method may include indicating or pointing, for example with a pencil or stylus or in another manner, automatically for example, the location of damage on the part under ultraviolet illumination, and reporting an indication of this damage at its corresponding location on the digital twin of the part.In some embodiments, an operator may indicate or point out damage to the part, as previously mentioned.
[0085] These indications reported on the digital twin can make it possible to capitalize on information relating to the presence of defects on the parts, and in particular, for example, damage linked to wear and their location, and thus improve the design and / or manufacture of new part models. They thus allow a better understanding of the phenomena undergone by the parts and can thus improve the safety of devices integrating such parts, particularly when these parts are integrated into vehicles, for example in aeronautics.
[0086] An application of the present invention may be the digitization of singularities / damage and the exploitation (decision-making and historization) of the results of non-destructive testing in a multi-spectral environment: visual or endoscopic inspections in white light, fluorescent penetrant testing, thermography. !
[0087] According to certain applications, following the detection of damage and its marking on the digital twin, a soldering operator, who does not work under ultraviolet light but under white light and who therefore does not detect the damage highlighted under UV light, can use the indications which have been reported by a penetrant testing operator to carry out the soldering of the part. Thus the method can comprise, from the indications reported on the digital twin, a step of soldering or repairing the damage highlighted, on the real part, which can advantageously be illuminated in white light. Thus, the repairs are carried out from the indications present on the digital twin and this avoids having to carry out the soldering on the part exposed to UV light to see where the damage, visible mainly in UV light, is located following the penetrant testing.
[0088] Figures 3a and 3b show a part on which a marker is positioned according to certain embodiments of the invention.
[0089] As mentioned earlier, the marker is a visual pattern that can help detect an angular position of a part.
[0090] In some embodiments, the visual pattern may be marked or engraved or present on the part, i.e., be an integral part of the part. This embodiment is shown in Figure 3a.
[0091] In some embodiments, the visual pattern may be present on a device separate from the part and this separate device may be positioned on the part to enable angular detection of the position of the part. This embodiment is shown in Figure 3b.
[0092] The pattern of Figures 3a and 3b preferably comprises colored areas, the characteristic color of which is not visible in black and white figures. These patterns are, however, indicated in the grayscale figures. The pattern is formed of one or more geometric areas and is non-symmetrical with respect to the axis of symmetry, or the axis of rotation of the part, in order to allow angular identification of the part.
[0093] As mentioned above, the marker comprises a geometric pattern allowing registration and a body, and - the contrast between the color of a geometric pattern of the marker and the color of the body of the marker is preferably greater than 0.7 and / or ! - the contrast between the color of the visual marker and the part on the periphery of the marker is preferably greater than 0.7.
[0094] In Figure 3a, the pattern includes three dots arranged in two squares whose outlines are drawn. The three dots and the squares are colored when exposed to ultraviolet light.
[0095] Preferably, the contrast between the color of the three points and the squares is 0.7 with the other areas of the pattern, in particular the areas other than the points and the squares when the pattern includes not only the colored areas constituting the geometric pattern allowing angular detection but also one or more other areas which can constitute a colored background.
[0096] Preferably, the contrast between the color of the three dots and the squares is 0.7 with the part on which the pattern is engraved. This can be the case when the marker consists only of the colored visual pattern allowing angular detection of the part and does not include a colored background. The colored pattern then stands out from the background of the part.
[0097] As mentioned previously, according to this embodiment, the pattern can be produced by engraving the part configured to reproduce on the part a non-symmetrical pattern with respect to an axis of symmetry of the part. This engraving can for example consist of applying a texture different from the rest of the part for the area(s) constituting the marker. This engraving can consist of grooves drawing the pattern of the marker.
[0098] In some embodiments, the coloring of the pattern may be achieved during a penetrant testing operation of the part. During penetrant testing of the part, the part is exposed to a fluid, such as fluorescein. This penetrant fluid is left on the surface for a certain time (the penetration time) to allow the substance to infiltrate into any cracks or damages as well as into grooves or more generally into the pattern or traces of the marker pattern. After the penetration time, the excess liquid is wiped from the surface, but the liquid remaining in the cracks and in the marker remains unchanged. A powder or aerosol developer is applied to the surface. The developer absorbs the penetrant liquid that remained in the damages and in the marker, bringing it to the surface and creating visible marks.Thus, the marker pattern is colored by the seeping fluid to become visible when exposed to light. ! ultraviolet in particular. It can be noted that the pattern is also visible under natural light but stands out less visually than under ultraviolet light.
[0099] In Figure 3b, we can see a cubic geometric marker with a distinctive pattern on each of its faces. The marker is positioned on the part and allows angular location of the part. As mentioned previously, the marker includes one or more colored areas, indicated in Figure 3b.
[0100] In some embodiments, these areas may have been colored during penetrant testing of the part, if the marker is positioned on the part before it undergoes a penetrant testing operation.
[0101] In some embodiments, these areas may have been colored during the manufacture of the marker.
[0102] The part may include a keying device configured to receive the marker in a single or unique position. In other words, the keying device on the part and the marker may assemble in a single position. In other words, the marker may be positioned or nested on the part in a single configuration. The keying device may consist of a small protrusion or a groove, the marker then including a void to receive this protrusion or a protrusion to be housed in the groove.
[0103] To this end, the marker may also include one or more devices configured to allow it to fit or assemble onto the part. In other words, the shape of the marker is configured to allow it to fit together, fit into, or be housed in the part in a single position.
[0104] In other words, the marker and the part can be assembled by male-female type devices allowing them to fit together.
[0105] In some embodiments, no keying device is used. The center of the part (or any location on the part where the marker is positioned) and the center of the marker may be aligned, for example using laser technologies, such as imaging, to position the marker at the desired location.
[0106] Preferably, the marker is assembled on the part so as to remain secured to the part when the part is handled in different positions. Thus, the marker or the part, or both, may comprise a locking device ! allowing the marker to be fixed to the part in order to prevent it from moving or to prevent any mobility of the marker relative to the part when the part is set in motion, for example when it is being handled by a control operator.
[0107] According to other embodiments, the marker is simply placed on said part, without being blocked on said part, in the single position and the part is not set in motion by the control operator but blocked in a fixed position and it is the control operator who moves around the part.
[0108] The marker, which can also be characterized as an optical marker, is positioned on the part in a unique position so that an angular position of the part can be determined or identified. For this purpose, the marker has a geometric shape or includes one or more geometric shapes, which allows the part to be aligned with a digital twin of the part. When the part is circular or cylindrical, or even square or rectangular, its orientation relative to its axis of symmetry must be detected. Otherwise, the digital twin and the part may be angularly offset.
[0109] In Figure 3b, we can see that the marker includes a geometric shape on each of the faces of the cube, or on at least 5 faces of the cube when the sixth face of the cube is positioned on the part, therefore not visible externally because it is hidden.
[0110] According to the embodiment of Figure 3b, at least two of the faces of the cube have a different geometric pattern, each of the geometric patterns allowing angular detection of the part. According to other embodiments, all the faces have different geometric patterns. In addition, the geometric patterns can be colored the same color or a different color, provided that the coloring can provide sufficient contrast with the body of the pattern or with the body of the part at the location of the pattern or at the periphery of the pattern.
[0111] Figure 4 represents a system capable of implementing the method according to at least one of the embodiments of the invention.
[0112] The system may comprise a support 101 on which the part P is arranged. A visual marker is arranged on the part P and configured to allow angular location of the part. As mentioned previously, the part may be a part to be inspected, for example in the context of damage, wear and other checks. Such checks may for example be carried out using penetrant testing techniques. !
[0113] For example, the marker may be a marker as illustrated in Figures 3a or 3b. Thus, the marker may have been positioned beforehand on the part P or be an integral part of the part P, as mentioned previously. The marker may in particular be positioned on the part P by an operator who also positions the part P on the support 101 or previously, before the penetrant testing of the part. The embodiments relating to the positioning of the part P described with regard to Figures 1 and 2 apply to the system of Figure 4.
[0114] According to certain embodiments, the support 101 may for example be a rotating support, allowing an operator to rotate the part in front of him. This is particularly relevant for circular or cylindrical parts, for which precisely the angular detection can be carried out by the present invention but a rotating support can also be used for any type of part, in particular square, rectangular or cubic parts placed on a rotating support.
[0115] The system comprises a lighting device 102 configured to diffuse ultraviolet light into the environment of the room P and more particularly in the direction of the room P so as to illuminate it.
[0116] Preferably, the lighting device is located at a distance greater than 20 cm from the room, for example at a distance of 38 cm from the room. More preferably, the device diffuses a light intensity of between 1200 µW / cm 2 and 5000 µW / cm 2 .
[0117] The lighting device emits light with a wavelength in the ultraviolet range, namely between 100 nm and 400 nm.
[0118] Preferably, the wavelength used is that of UV-A, the wavelength of which is between 315 nm and 400 nm and more particularly around 365 nm, with a tolerance of + / - 5 nm.
[0119] Preferably the intensity of white light in the vicinity of the room remains below 20 Lux.
[0120] The system also comprises a capture device 104. The capture device 104 comprises one or more cameras configured to take one or more images of the part P. Preferably, the capture device is a video camera which films the part P. !
[0121] In some embodiments, a second light source may emit light having a wavelength in the infrared range, namely between 0.75 µm and 1 mm. This may make it possible to highlight a visual marker that would be visible in the infrared range and not in the ultraviolet range as previously described. In other words, this may make the marker visible, and may allow the camera(s) 104 to capture an image of the marker so that at least one image can be captured.
[0122] The system also comprises processing means 103 connected to the capture device 104. The capture device and the processing means 103 may for example be connected by a wireless or wired network, for example an Ethernet or Bluetooth network. The processing means 103 are configured to receive the data from the capture device and more particularly the images or video captured from the part P.
[0123] The processing means 103 are further configured to perform a registration of a digital twin of the part P and the part P, from the images or video received and the digital twin of the part. When the processing means comprise a screen, for example when the processing means are a computer or a tablet, the part P and its digital twin may appear superimposed on a screen associated with the processing means.
[0124] For this purpose, the processing means may comprise one or more computer programs configured on the one hand to determine a digital twin of the part P and on the other hand to carry out the registration between the part P and the digital twin.
[0125] More specifically, the processing means are capable of carrying out a registration of the captured part P with its digital twin, from the marker present on the part P and visible when the part P is exposed to ultraviolet light and from a marker present on the digital twin of which at least the geometric shape allows the registration between the part and its digital twin.
[0126] The system of Figure 4 can in particular be implemented to highlight cracks and / or splits on the part P during the penetrant testing of the part, and to reproduce on the digital twin cracks and / or splits highlighted on the part P. !
[0127] According to certain embodiments, an operator can observe the part on which the marker is positioned and identify, under UV light, for example using a pencil, a marker, a stylus, the cracks or fissures or other damage. These marks can be visible in white light unlike the penetrant liquid visible under UV light. These marks can then allow a soldering operator to come and carry out the soldering of the cracks under white light.
[0128] The capture means film the part and therefore the marks positioned on the part. The part P and its digital twin being recalibrated or superimposed, the marks are then reproduced on the digital twin in their exact location, without any angular offset problem.
[0129] Using the markers positioned on the digital twin can allow damage to be digitized and subsequently analyzed.
Claims
Claims
1. Method for registering a digital twin with a part (P) on which is arranged a visual marker configured to allow angular location of the part, the method comprising - an exposure (E3) of said part to at least one light source in the ultraviolet range, - at least one capture (E4) of said part on which the visual marker is arranged, and exposed under said light source, - a registration (E5) implemented by computer, under said ultraviolet light, of said captured part with a digital twin of said part, from said visual marker present on said part, configured to be visible under said ultraviolet light, using a fluorescent penetrant fluid, and a digital marker present on the digital twin, the geometric shape of said visual marker positioned on said part allowing said registration between said part and its digital twin.
2. Method according to claim 1 comprising, prior to said exposure of said part to said at least one light source, the positioning (E2) of said visual marker on said part, said part being symmetrical around an axis of symmetry and preferably comprising a keying device configured to position said marker in a single position on said part.
3. Method according to claim 1 comprising, prior to said exposure: - an etching (S1) of said part so as to form said visual marker in the form of textures capable of retaining a fluid, - a filling (S2) of said textures using a fluid capable of being visualized under ultraviolet light.
4. Method according to one of the preceding claims comprising, prior to said exposure, a step of penetrant testing (E1) of said part.
5. Method according to claim 3 wherein said filling (S2) is obtained during a penetrant testing of said part.
6. Method according to claim 4 comprising, during the penetrant testing: - an exposure of said part to said penetrant fluid allowing said penetrant fluid to show said filling in said textures and in cracks or damage of said part (P), - said registration allowing a location of said cracks or damage on said digital twin of said part (P).
7. Method according to claim 6 comprising: - a brazing of said part, exposed under white light, from said cracks or damage visible on said digital twin of said part (P). !
8. Method according to one of the preceding claims wherein said part is circular in shape and the geometric shape of said marker is configured to allow an angular position of said part to be detected.
9. Method according to one of the preceding claims in which the marker comprises a geometric pattern allowing said registration and a body and - the contrast between the color of a geometric pattern of the marker and the color of the body of the marker is preferably greater than 0.7 and / or - the contrast between the color of said visual marker and of the part at the periphery of the marker is preferably greater than 0.
7. !
10. Method according to one of the preceding claims in which said light source in the Ultraviolet range, to which said part is exposed, has a light intensity of between 1200 µW / cm. 2 and 5000 µW / cm 2 , the wavelength of said light source being close to 365 nm - said light intensity in the vicinity of said part is less than 20 Lux.
11. Method according to one of the preceding claims in which said part is a metal part of an aircraft.!
12. Method according to one of the preceding claims comprising - highlighting cracks and / or splits on said part during said penetrant testing of said part, - reproducing on said digital twin said cracks and / or splits highlighted on said part. !
13. Method according to one of the preceding claims wherein said penetrant product is fluorescein
14. System for registering a digital twin with a part on which is arranged a visual marker configured to allow angular location of the part and comprising - at least one light source in the ultraviolet range intended to illuminate said part, - at least one device for capturing said part exposed under said light source, - one or more processors configured together or separately to register said captured part with a digital twin of said part,under said ultraviolet light using a fluorescent penetrant fluid, from said visual marker present on said physical part, configured to be visible under said ultraviolet light, and a digital marker present on the digital twin of which at least the geometric shape allows said registration between said part and its digital twin.,
Citation Information
Patent Citations
Three-dimensional position / orientation sensing apparatus, information presenting system, and model error detecting system
US20020052709A1
System and method to display maintenance and operational instructions of an apparatus using augmented reality
US20070273610A1
Surface coating for inspection
US20130214178A1
Fluorescent penetrant inspection system and method
US20200166467A1
Machine vision system with a computer generated virtual reference object
US20200311909A1