An imaging device and method

Abstract

The present invention relates to a mobile, portable, automated and modular device (1) which uses Reflectance Transformation Imaging (RTI) method that is a digital photography method for bringing out t

Description

[0001] DESCRIPTION

[0002] AN IMAGING DEVICE AND METHOD

[0003] Technical Field

[0004] The present invention relates to a mobile, portable, automated and modular device which uses Reflectance Transformation Imaging (RTI) method that is a digital photography method for bringing out the micro-topography of an object’s surface by using the reflectance values synthesized from the image data obtained upon an object’s surface is illuminated from different angles and which is based on photometric stereo (triangulation) technology, and an imaging method thereof.

[0005] Background of the Invention

[0006] In Reflectance Transformation Imaging (RTI) technique, images are obtained upon the light reaching a fixed camera, a fixed object and an object’s surface from different routes and directions is reflected. Highlights and shadows varying in an image obtained in each shot occur. Upon these images are combined, the varying interaction of light and dark bring out the surface information and fine details which are not visible under normal examination.

[0007] A black or red sphere with a shiny surface is placed close to the subject while taking a photo and the route and direction of the light reaching the sphere are determined by calculating the route and direction of the light reflected from the sphere, by means of a software (RTIBuilder). The route and direction information of the light reaching the sphere from LED lamps is processed by means of a related software and then it is saved as a RTI or optionally PTM (an image processing algorithm known as Polynomial Texture Mapping) file, and RGB values are saved for each pixel (except for lighting conditions) in the RTI or PTM file. The use of light sources placed in hemispherical or geodesic domes in imaging ensures that the process is performed much faster and with higher accuracy. The light source is moved by hand (manually) for each photograph in this method wherein the camera is fixed. The spheres with a black or red shiny surface are placed close to the object so as to fit into the frame. Light sources are positioned such that they are located equidistantly from the center. In addition, imaging can be performed on a microscopic scale by using optical microscope instead of a camera in RTI method. In the images obtained, there is information about the reflection of the light reaching the surface of the object -being examined- from LED bulbs from different routes and directions and the intensity of the light. A processing software (RTIViewer) processes this information and then ensures that detailed information is obtained about the surface upon the change of the light on the surface. The software (RTIViewer) provides different reflection characteristics by setting RGB color information and surface normals. Thereby, more details can be displayed in comparison to software that perform filtering by means of color data. Depth perception can be enhanced by changing the surface slope in the related processing software (RTIViewer). Also, surface deformations -which are hardly visible on vivid or matte surfaces due to color information- become visible by removing the RGB information from the image and moving the light in a desired direction.

[0008] Cultural assets (heritage) are subjected to aging as of their construction. The aging process and environmental and chemical factors affecting this process cause cultural assets to get damaged and then destroyed in time. Corrosion, discoloration and loss of parts, abrasion, scratch, cavitation, blistering and crack may occur on the surfaces of cultural assets as a result of deterioration. In RTI method, surface characteristics of a work (artifact) being examined are determined by examining the changes of light and shadow on their surface in detail. Thereby, deteriorations and changes of form occurred in cultural assets are detected. Thus, the life of the work is extended by preventing potential deteriorations. RTI method may provide information about deterioration forms of movable and immovable cultural assets such as oil paintings, mural paintings, icons, textiles, papers, ceramics, metals, stones and woods. For example, in an oil painting with complex surfaces, it is ensured that the color information are extracted from the image and the change of light on the surface, abrasions, cracks, brush strokes and information included in invisible layers are revealed. Besides, valuable information about both the processes in the construction period of the work and the tools used is reached from the traces and forms of deterioration on the surfaces of works (having layered and rough texture) such as stone, ceramic and wood. Therefore, RTI method plays a significant role in determining construction technologies of cultural assets, planning and carrying out their conservation and restoration practices. The fact that a plurality of light sources required to obtain visual information cannot be placed correctly and a system suitable for the work being examined cannot be set up correctly is the most important reason for the failure experienced in the application of RTI method which can be used for imaging movable and immovable cultural assets. In addition, systems to be used in application of RTI method are fixed and they are not suitable for transportation. User errors in application of the method affect the process in a negative way and the requested information cannot be obtained. In general, method is applied manually when examining a work. However, needing too many people, the length of shooting time, the high incidence of errors in retrieving correct image depending on the person and calculations, low accuracy in this application require the process to be repeated. Measuring the camera and light distance in manual RTI shootings increases the personnel requirement. At least two persons are needed for distance measurement and at least one person is needed to control the images. Besides, the sensitivity of the human hand reduces the accuracy of shooting as well. The distance between the light source and the center point of the work visible from the camera lens must be fixed in each direction. Since it is necessary to shoot in a dark environment, it is quite difficult to darken the environment.

[0009] Therefore, considering the studies and the deficiencies included in the state of the art, it is understood that there is need for a portable imaging device which can be integrated into a camera or digital microscope, can automatically illuminate the surface area of the work to be shot with less light source, brings out invisible details in works by means of imaging to be obtained upon light sources having different wavelengths are included in the system, provides ease of transport with its foldable structure and enables to obtain high-accuracy results for documentation of immovable works in excavation / land areas or shooting of movable works due to its full-automatic structure and an imaging method thereof.

[0010] The Korean patent document no. KR101817756B1, an application included in the state of the art, discloses a system for performing digital studies of cultural assets by using 3D scanning technology and PTM (Polynomial Texture Mapping) image processing algorithm. In the system included in the said invention, a 3D model based PTM generating system capable of the interactive viewpoint control comprises a 3D model obtaining unit in order to obtain a 3D model for a specific object. A camera for photographing an object in a vertical direction and a photographing viewpoint setting unit configured to set the point of view of the camera are included in the invention. Virtual lamps are set according to the obtained 3D model and the texture information and depth information of the object included in the 3D model, which is obtained by using virtual lamps, are used. Accordingly, an orthographic image of a 3D model is obtained on computer graphic data to be applied to shape information of the 3D model obtained by scanning the object.

[0011] Summary of the Invention

[0012] An objective of the present invention is to realize a mobile, portable, automated and modular device which uses Reflectance Transformation Imaging (RTI) method that is a digital photography method for bringing out the micro-topography of an object’s surface by using the reflectance values synthesized from the image data obtained upon an object’s surface is illuminated from different angles and which is based on photometric stereo (triangulation) technology, and an imaging method thereof. Another objective of the present invention is to realize a system which enables to obtain the surface reflection information of the changes occurring on the surface of cultural assets -which are subjected to aging, undergo environmental and chemical factors, have distortions and on the surface of which corrosion, discoloration and loss of parts, abrasion, scratch, cavitation, blistering and crack occur- by using a three-dimensional geometry method, wherein the camera and the subject used in reflectance transformation imaging technique are fixed whereas the light is mobile, by means of comparison of photos taken with different light angles; to carry out the process much faster and with higher accuracy by using light sources placed in hemispherical or geodesic domes during imaging and thus to extend the life of the work by preventing potential deteriorations.

[0013] Detailed Description of the Invention

[0014] The “Imaging Device and Method” realized to fulfil the objectives of the present invention is shown in the figures attached, in which:

[0015] Figure l is a perspective view of the inventive imaging device.

[0016] Figure l is a view of the pieces of the inventive imaging device. Figure 3 is a view of the pieces of the inventive imaging device.

[0017] Figure 4 is a view of the pieces of the inventive imaging device.

[0018] Figure 5 is a view of the pieces of the inventive imaging device.

[0019] Figure 6 is a view of the pieces of the inventive imaging device.

[0020] Figure 7 is a flow chart of the inventive imaging method.

[0021] The components illustrated in the figures are individually numbered, where the numbers refer to the following:

[0022] 1. Imaging device

[0023] 2. Body

[0024] 3. First piece 4. Second piece

[0025] 5. LED lighting arm

[0026] 6. Connection element

[0027] 7. Power module

[0028] 8. Hinge

[0029] 9. Coating apparatus

[0030] 10. Imaging device

[0031] 11. Movement channel

[0032] The inventive imaging device (1) for reflecting light onto objects and obtaining their images comprises: at least one body (2); a first piece (3) which forms half of the base part the body (2) and a second piece (4) which forms the other half of the base part; at least one LED lighting arm (5) which is positioned in the space between the first piece (3) and the second piece (4), and can move; at least one connection element (6) which provides the motion of the LED lighting arm (5) by combining with the LED lighting arm (5) and has at least one threaded and at least one cylindrical extension; at least one power module (7) whereon at least one charging socket, at least one microcontroller, at least one microcontroller socket, at least one power supply and motor driving circuit is located; at least one hinge (8) which enables the first piece (3) and the second piece (4) to move; at least one coating apparatus (9) which surrounds the first piece (3) and the second piece (4), is placed on the LED lighting arm (5) in the form of a dome, and enables to create a dark environment; and at least one imaging device (10) which is integrated into the LED lighting arm (5) and present as a device in the form of a camera and / or microscope. The first piece (3) and the second piece (4) included in the inventive imaging device (1) have a semi-annular shape and a structure so as to form a circle when they are combined. The said first piece (3) and the second piece (4) have gears for providing the motion and enable the wheel of the connection element (6) to rotate.

[0033] The body (2) included in the inventive imaging device (1) reaches a closed position upon the first piece (3) and the second piece (4) fold onto each other by means of the hinges (8).

[0034] The connection element (6) included in the inventive imaging device (1) and has a wheel structure is combined with the LED lighting arm (5) and can move in the inner part of the first piece (3) and the second piece (4) in the open position with an angle 360 degrees by means of the step motor it has. The LED lighting arm (5) can perform a rotational motion of 360 degrees by combining (locking) with the connection element (6).

[0035] The connection element (6) included in the inventive imaging device (1) is positioned on the junction point of the LED lighting arm (5) and the first piece (3) and has a gear on the part that faces the center of the circle occurring upon the first piece (3) and the second piece (4) with a semi-annular shape combine and a cylindrical extension on the part that faces outwards. The cylindrical extension of the connection element (6) provides the stabilization during rotation of the body (2) upon being placed into the hollow part located inside the first piece (3) and the second piece (4). The gear wheel of the connection element (6) is directed and moved by the stepper motor and the control circuit. A wheel, which is located on the connection element (6), is fixed by means of a metal cylinder that is an extension of the motor and it can move on the gears included on the first piece (3) and the second piece (4).

[0036] In the inventive imaging device (1), the step motor moves on the body (2) preferably with an angle of 45 degrees for 8 times in total and returns back to its position. The LED lights included on the LED lighting arm (5) flash everytime the step motor stops and the delay times of the LEDs and the number of axes when the motor will pause can be coded according to the periodical serial shooting set in the camera.

[0037] The power module (7) included in the inventive imaging device (1) is positioned on the LED lighting arm (5). A charging socket and a microcontroller socket are included on the hollow part of the said power module (7). The power module (7) enables the LED lighting arm (5) and the step motor to be coded by establishing a connection with remote computers. The said power module (7) has at least one nano microcontroller, at least one charging socket, at least one power supply, and at least one step motor driving circuit. The motor driving circuit included on the power module (7) transmits electricity and commands to the stepper motor by means of socket connections located on the LED lighting arm (5) and the connection element (6) and it enables the LED lighting arm (5) to move on an axis.

[0038] The inventive imaging device (1) has a coating apparatus (9) where a light-proof (opaque) piece of cloth can be positioned on the body (2) such that it will surround the first piece (3) and the second piece (4) from the upper part of the LED lighting arm (5) and create a dark environment. The coating apparatus (9) is manufactured from thin copper wire in the form of a skeleton so as to avoid the rotation of the LED lighting arm (5) and to maintain the volume of the cover during the shooting.

[0039] The imaging device (10) which is positioned on the end part of the LED lighting arm (5) facing the center of the circle on the body (2) of the inventive imaging device (1) is a device in the form of a camera configured to take a photo of objects to be monitored or analysed. In one embodiment of the invention, the imaging device (10) is a device in the form of a digital microscope.

[0040] In the inventive imaging device (1), the LED lighting arm (5) moves on a movement channel (11) located in the base part. The inventive imaging device (1) automatically illuminates the surface area of the work to be shot and it provides ease of transport with its foldable structure.

[0041] The inventive imaging method (100) comprises steps of positioning the imaging device (1) according to the object to be imaged and / or examined (101); setting the angle of the LED lighting arm (5) included in the imaging device (1), according to the object to be viewed and reflecting the light from the LED lights (102); imaging by means of the imaging device (10) included in the imaging device (l) (103); reflecting the light, that is received from LED bulbs in different routes and directions, to the surface of the object being examined in the obtained images and processing the information included related to the intensity of the light by means of a software (104); obtaining detailed information about the object’s surface upon the change of light on the object’s surface as a result of processing the obtained images (105).

[0042] Industrial application of the invention

[0043] The inventive imaging device (1) automatically illuminates the surface area of the work to be shot and it provides ease of transport with its foldable structure. Few light sources (preferably 5 LEDs) are needed and even, shootings can be performed with the set motorized movement of only one LED on the LED lighting arm. Imaging to be obtained by including light sources with different wavelengths may bring out invisible details in works. The camera and digital microscope required for performing shootings in accordance with the wavelength of the light sources used and carrying out microscopic examinations can be integrated into the imaging device (1). Lion-ion batteries are used as the power source in the imaging device (1) and the electronic circuit elements and the motorized parts ensure that the shootings are performed independently of the operator and automatically entirely. Considering the number of equipment required in difficult field and environmental conditions in known systems and the difficulty of transportation, the inventive imaging device (1) enables to access the information aimed to be obtained, by means of applications which are automated, easy and has short shooting time. The inventive imaging device (1), which is fully automated, enables to obtain results with high accuracy for documentation of immovable works in excavation / land areas or shooting of movable works. The inventive imaging device (1) does not require an additional power supply due to its low power consumption, the few light sources included on the LED lighting arm (5) meet all the light need in the rotary assembly, can increase the number of shootings by reflecting the light in a desired angle by means of its 360° rotatable structure, can be transported due to its foldable structure, ensures an easy installation and the dark environment required for the shhoting can be provided by means of a light-proof black cloth.

[0044] Within these basic concepts; it is possible to develop various embodiments of the inventive “Imaging Device (1) and Method (100)”; the invention cannot be limited to examples disclosed herein and it is essentially according to claims.

Claims

CLAIMS1. An imaging device (1) for reflecting light onto objects and obtaining their images; comprising at least one body (2); a first piece (3) which forms half of the base part the body (2) and a second piece (4) which forms the other half of the base part; at least one LED lighting arm (5) which is positioned in the space between the first piece (3) and the second piece (4), and can move; and characterized by at least one connection element (6) which provides the motion of the LED lighting arm (5) by combining with the LED lighting arm (5) and has at least one threaded and at least one cylindrical extension; at least one power module (7) whereon at least one charging socket, at least one microcontroller, at least one microcontroller socket, at least one power supply and motor driving circuit is located; at least one hinge (8) which enables the first piece (3) and the second piece (4) to move; at least one coating apparatus (9) which surrounds the first piece (3) and the second piece (4), is placed on the LED lighting arm (5) in the form of a dome, and enables to create a dark environment; and at least one imaging device (10) which is integrated into the LED lighting arm (5) and present as a device in the form of a camera and / or microscope.

2. An imaging device (1) according to Claim 1; characterized by the first piece (3) and the second piece (4) which have a semi-annular shape and a structure so as to form a circle when they are combined.

3. An imaging device (1) according to Claim 1 or 2; characterized by the first piece (3) and the second piece (4) which have gears for providing the motion and enable the wheel of the connection element (6) to rotate.

4. An imaging device (1) according to any of the preceding claims; characterized by the body (2) which reaches a closed position upon the first piece (3) and the second piece (4) fold onto each other by means of the hinges (8).

5. An imaging device (1) according to any of the preceding claims; characterized by the connection element (6) which has a wheel structure and moves in the inner part of the first piece (3) and the second piece (4) in the open position with an angle 360 degrees by means of the step motor it has, upon combining with the LED lighting arm (5).

6. An imaging device (1) according to any of the preceding claims; characterized by the LED lighting arm (5) which can perform a rotational motion of 360 degrees by combining with the connection element (6).

7. An imaging device (1) according to any of the preceding claims; characterized by the connection element (6) which is positioned on the junction point of the LED lighting arm (5) and the first piece (3) and has a gear on the part that faces the center of the circle occurring upon the first piece (3) and the second piece (4) with a semi-annular shape combine and a cylindrical extension on the part that faces outwards.

8. An imaging device (1) according to any of the preceding claims; characterized by the connection element (6) which has a cylindrical extension for providing the stabilization during rotation of the body (2) upon being placed into the hollow part located inside the first piece (3) and the second piece (4).

9. An imaging device (1) according to any of the preceding claims; characterized by the connection element (6) which has a gear wheel directed and moved by the stepper motor and the control circuit.

10. An imaging device (1) according to any of the preceding claims; characterized by the connection element (6) which has a wheel fixed by means of a metal cylinder that is an extension of the motor and which can move on the gears included on the first piece (3) and the second piece (4).

11. An imaging device (1) according to any of the preceding claims; characterized by the power module (7) which has a step motor that moves on the body (2) with an angle of 45 degrees for 8 times in total and returns back to its position.

12. An imaging device (1) according to any of the preceding claims; characterized by the LED lighting arm (5) which has LED lights that flash everytime the step motor stops.

13. An imaging device (1) according to any of the preceding claims; characterized by the power module (7) which is positioned on the LED lighting arm (5).

14. An imaging device (1) according to any of the preceding claims; characterized by the power module (7) which includes a charging socket and a microcontroller socket on a hollow part located on itself.

15. An imaging device (1) according to any of the preceding claims; characterized by the power module (7) which enables the LED lighting arm (5) and the step motor to be coded by establishing a connection with remote computers.

16. An imaging device (1) according to any of the preceding claims; characterized by the power module (7) which has at least one nanomicrocontroller, at least one charging socket, at least one power supply, and at least one step motor driving circuit.

17. An imaging device (1) according to any of the preceding claims; characterized by the power module (7) which has a motor driving circuit that transmits electricity and commands to the stepper motor by means of socket connections located on the LED lighting arm (5) and the connection element (6), and enables the LED lighting arm (5) to move on an axis.

18. An imaging device (1) according to any of the preceding claims; characterized by the coating apparatus (9) where a light-proof (opaque) piece of cloth can be positioned on the body (2) such that it will surround the first piece (3) and the second piece (4) from the upper part of the LED lighting arm (5) and create a dark environment.

19. An imaging device (1) according to any of the preceding claims; characterized by the coating apparatus (9) which is preferably manufactured from thin copper wire in the form of a skeleton so as to avoid the rotation of the LED lighting arm (5) and to maintain the volume of the cover during the shooting.

20. An imaging device (1) according to any of the preceding claims; characterized by the imaging device (10) which is a device in the form of a camera positioned on the end part of the LED lighting arm (5) facing the center of the circle on the body (2) and configured to take a photo of objects to be monitored or analysed.

21. An imaging device (1) according to any of Claim 1-19; characterized by the imaging device (10) which is a device in the form of a digital microscope.

22. An imaging device (1) according to any of the preceding claims; characterized by the movement channel (11) wherein the LED lighting arm (5) moves on the base part the body (2).

23. An imaging method (100) for reflecting light onto objects and obtaining their images comprises; characterized by the steps of positioning the imaging device (1) according to the object to be imaged and / or examined (101); setting the angle of the LED lighting arm (5) included in the imaging device (1), according to the object to be viewed and reflecting the light from the LED lights (102); imaging by means of the imaging device (10) included in the imaging device (1) (103); reflecting the light, that is received from LED bulbs in different routes and directions, to the surface of the object being examined in the obtained images and processing the information included related to the intensity of the light by means of a software (104); obtaining detailed information about the object’s surface upon the change of light on the object’s surface as a result of processing the obtained images (105).

Images