Information processing device and program

Abstract

To generate image data representing texture of an object while making the number of times of rescanning less than when two scans are always made again twice after two scans is made twice if the object shifts in position during the two scans in generating image data representing the texture of the object by putting together two pieces of image data generated by scanning a surface of the object at least twice with different light sources.SOLUTION: If a result of collation between first image data generated by a first scan using a first light source and second image data generated by a second scan using a second light source is not included in an allowable range, third image data generated by a third scan using the first light source is collated with the second image data, and the second image data and third image data are put together according to the result of the collation.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to an information processing device and a program. [Background technology]

[0002] As described in Patent Document 1, there is known a technology (for example, a texture scanner) that expresses the surface texture (for example, glossiness, unevenness, etc.) of an object using an image. In this technology, two scans are performed, that is, a scan using a diffuse reflection light source and a scan using a specular reflection light source, and the two image data generated by these scans are combined to generate image data that expresses the surface texture of the object. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-71964 Summary of the Invention [Problem to be solved by the invention]

[0004] As mentioned above, two scans are required to generate image data that represents the surface texture of an object. If the position of the object being scanned changes between the two scans, the reproducibility of the texture expressed by combining the two image data will decrease compared to when the object's position remains unchanged. In this case, it is possible to redo the two scans, but as a result, at least four scans will be required in total.

[0005] The object of the present invention is to generate image data that expresses the texture of an object by combining two sets of image data generated by scanning the surface of the object at least twice with different light sources, and when the position of the object changes between the two scans, to generate image data that expresses the texture of the object by reducing the number of rescans that must be performed compared to always performing two new scans after the two scans. [Means for solving the problem]

[0006] The invention of claim 1 is an information processing device having a processor that acquires multiple image data generated by scanning the surface of an object at least twice using different light sources, and if the result of matching first image data generated by a first scan using a first light source with second image data generated by a second scan using a second light source different from the first light source is within an acceptable range, combines the first image data with the second image data, and if the result of matching the first image data with the second image data is not within the acceptable range, compares the second image data with third image data generated by a third scan using the first light source, and if the result of matching is within the acceptable range, combines the second image data with the third image data.

[0007] The invention of claim 2 is an information processing device having a processor, which acquires multiple image data generated by performing at least three scans using different light sources, and if the result of comparing first image data generated by a first scan using a first light source with third image data generated by a third scan using the first light source is within an acceptable range, combines second image data generated by a second scan using a second light source different from the first light source with either the first image data or the third image data.

[0008] The invention of claim 3 is an information processing device having a processor that acquires multiple image data generated by performing at least two scans using different light sources, and if the result of matching first image data generated by a first scan using a first light source with second image data generated by a second scan using a second light source different from the first light source is within an acceptable range, combines the first image data with the second image data, and if the result of matching the first image data with the second image data is not within the acceptable range, and if the result of matching third image data generated by a third scan using the first light source with the first image data is within the acceptable range, combines the second image data with either the first image data or the third image data.

[0009] The invention of claim 4 is an information processing device described in any one of claims 1 to 3, wherein the processor, when the result of the comparison is not within the acceptable range, displays information on a display indicating that the result of the comparison is not within the acceptable range.

[0010] The invention according to claim 5 is characterized in that the processor displays the result of the synthesis on a display and controls the execution of a scan of the object according to a user's instruction. 1 to The information processing device is described.

[0011] The invention of claim 6 is a program for causing a computer to acquire multiple image data generated by scanning the surface of an object at least twice using different light sources, and if the result of matching first image data generated by a first scan using a first light source with second image data generated by a second scan using a second light source different from the first light source is within an acceptable range, combine the first image data with the second image data, and if the result of matching the first image data with the second image data is not within the acceptable range, compare the second image data with third image data generated by a third scan using the first light source, and if the result of matching is within the acceptable range, combine the second image data with the third image data.

[0012] The invention of claim 7 is a program for causing a computer to acquire multiple image data generated by performing at least three scans using different light sources, and if the result of comparing first image data generated by a first scan using a first light source with third image data generated by a third scan using the first light source is within an acceptable range, combine second image data generated by a second scan using a second light source different from the first light source with either the first image data or the third image data.

[0013] The invention of claim 8 is a program for causing a computer to acquire multiple image data generated by performing at least two scans using different light sources, and if the result of comparing first image data generated by a first scan using a first light source with second image data generated by a second scan using a second light source different from the first light source is within an acceptable range, combine the first image data with the second image data, and if the result of comparing the first image data with the second image data is not within the acceptable range, combine the second image data with either the first image data or the third image data if the result of comparing the first image data with third image data generated by a third scan using the first light source is within the acceptable range. [Effects of the Invention]

[0014] According to the inventions of claims 1, 2, 3, 6, 7, and 8, when image data expressing the texture of an object is generated by synthesizing two pieces of image data generated by scanning the surface of the object at least twice with different light sources, if the position of the object changes between the two scans, it is possible to generate image data expressing the texture of the object with fewer rescans than when two scans are always performed again after the first two scans.

[0015] According to the inventions set forth in claims 2 and 7, it is further possible to prevent erroneous determination as to whether or not the position of an object has changed.

[0016] According to the inventions of claims 3 and 8, it is possible to prevent erroneous determination as to whether the position of an object has changed, and further, depending on the result of the comparison, it is possible to limit the number of scans to two.

[0017] According to the invention of claim 4, the result of the collation can be notified to the user.

[0018] According to the invention of claim 5, the user can decide for himself whether or not to perform a scan. [Brief explanation of the drawings]

[0019] [Figure 1] FIG. 1 is a diagram illustrating a configuration of a scanner. [Figure 2] FIG. 2 is a block diagram showing functions of the image processing apparatus according to the embodiment. [Figure 3] 1 is a block diagram showing a hardware configuration of an image processing apparatus according to an embodiment; [Figure 4] FIG. 2 is a diagram showing image data generated in the first embodiment. [Figure 5] 10A and 10B are diagrams illustrating image data generated in the second and third embodiments. DETAILED DESCRIPTION OF THE INVENTION

[0020] A scanner 10 according to an embodiment will be described with reference to Fig. 1. Fig. 1 shows an example of the configuration of the scanner 10 according to an embodiment. The scanner 10 is a scanner for acquiring image data representing the surface of an object 12, and is sometimes referred to as a texture scanner.

[0021] Scanner 10 optically reads the surface characteristics of object 12 and generates image data representing the results of the reading. The image data generated by scanner 10 includes image data based on diffuse reflected light (hereinafter referred to as "diffuse reflected image data") and image data based on specular reflected light (hereinafter referred to as "specular reflected image data").

[0022] The diffuse reflection image data is image data that represents the light components that are diffusely reflected from the surface of the object 12. The specular reflection image data is image data that represents the light components that are specularly reflected from the surface of the object 12.

[0023] Specular reflection is a reflection in which the angle of incidence and the angle of reflection of light are the same with respect to the reflecting surface, and is also called specular reflection. Therefore, specular reflection image data is the same as regular reflection image data.

[0024] The scanner 10 includes a platen glass 14 , a carriage 16 , light sources 18 , 20 , and 22 , and a sensor 24 .

[0025] Scanner 10 has each of the components shown in the figure with a predetermined width in the direction perpendicular to the paper surface (X direction). The X direction is the main scanning direction of scanner 10. The direction indicated by the arrow in FIG. 1 (Y direction) is the sub-scanning direction of scanner 10.

[0026] The platen glass 14 is not limited to a glass plate, and may be, for example, an acrylic plate, etc. Although not shown in Fig. 1, a platen cover may be provided to cover the platen glass 14 and sandwich the object 12 therebetween so as to block external light.

[0027] The carriage 16 is configured to move in the sub-scanning direction at a predetermined speed when optically reading the surface characteristics of the object 12. Hereinafter, the direction in which the carriage 16 moves (Y direction) will be referred to as the front direction, and the opposite direction will be referred to as the rear direction. Light sources 18, 20, and 22 are provided inside the carriage 16.

[0028] Light source 18 is a light source provided on the front side, and irradiates object 12 with light for detecting diffusely reflected light from object 12. Specifically, light source 18 irradiates object 12 with light having a first incident angle (e.g., 45°) with respect to the normal direction of object 12.

[0029] The light source 20 is a light source provided on the rear side, and irradiates the object 12 with light for detecting diffusely reflected light from the object 12. Specifically, the light source 20 irradiates the object 12 with light having a first incident angle (for example, 45°) with respect to the normal direction of the object 12.

[0030] The light source 22 is a light source provided on the rear side, and irradiates the object 12 with light for detecting specularly reflected light from the object 12. Specifically, the light source 22 irradiates the object 12 with light having an incident angle of a second incident angle (for example, 10°) with respect to the normal direction of the object 12.

[0031] Light source 22 is provided at a position that does not block the chief ray of light reflected from object 12. The angle of incidence of light emitted by light source 22 may be approximately 5° to 10°. Of the reflected light of light emitted from light source 22, the component that travels in the normal direction of object 12 is detected.

[0032] For example, a fluorescent lamp or a rare gas fluorescent lamp (such as a xenon fluorescent lamp) is used as the light source 22. The light source 22 may be a light source made up of a plurality of white LEDs (Light Emitting Diodes) arranged in the main scanning direction. In this case, a diffuser or the like may be used to make the luminance distribution in the main scanning direction uniform.

[0033] In the example shown in FIG. 1, three light sources (i.e., light sources 18, 20, and 22) are provided within carriage 16, but it is also possible to provide one light source within carriage 16 and generate each light by branching the light from that one light source.

[0034] Also provided within carriage 16 are imaging optics and a sensor 24. The imaging optics includes a reflecting mirror and a coupling lens, and couples diffusely reflected light and specularly reflected light from object 12 onto sensor 24.

[0035] The sensor 24 receives the diffusely reflected light and specularly reflected light formed by the imaging optical system and generates image data corresponding to the received light. The sensor 24 is composed of light-receiving elements such as a CCD (Charge Coupled Device) linear image sensor or a CMOS (Complementary MOS) image sensor, and converts the received light into data representing its intensity. The sensor 24 also has a color filter and generates data representing the color of the object 12. The sensor 24 outputs diffuse reflection image data obtained by receiving the diffusely reflected light and specular reflection image data obtained by receiving the specularly reflected light. For example, the diffuse reflection image data and specular reflection image data are output to an image processing device 26, which will be described later.

[0036] When scanner 10 is not used as a texture scanner, light having an incident angle of 45° with respect to the normal direction of object 12 is irradiated onto object 12 from light source 18 or light source 20, and diffuse reflected light from object 12 is detected. When scanner 10 is used as a texture scanner, in addition to this, light having an incident angle of 10° with respect to the normal direction of object 12 is irradiated onto object 12 from light source 22, and specular reflected light from object 12 is detected.

[0037] The diffuse reflection image data and specular reflection image data are output to an image processing device 26, which is an example of an information processing device. The image processing device 26 calculates the difference between the diffuse reflection image data and the specular reflection image data, thereby generating information indicating the texture (e.g., gloss) of the surface of the object 12.

[0038] A configuration for generating image data that reproduces the surface characteristics of the object 12 will be described below with reference to Fig. 2. Fig. 2 shows an example of the configuration.

[0039] The image processing device 26 includes a diffuse reflection image acquisition unit 28, a specular reflection image acquisition unit 30, a difference image generation unit 32, a diffuse reflectance distribution function calculation unit 34, a specular reflectance distribution function calculation unit 36, a parameter adjustment unit 38, a reflectance distribution function calculation unit 40, a light source information acquisition unit 42, a camera information acquisition unit 44, and a rendering unit 46.

[0040] The diffuse reflection image acquisition unit acquires the diffuse reflection image data output from the sensor 24. The specular reflection image acquisition unit 30 acquires the specular reflection image data output from the sensor .

[0041] The differential image generation unit 32 generates differential image data by calculating the difference between the diffuse reflection image data and the specular reflection image data. There are two types of differential image data: (specular reflection image data - diffuse reflection image data) and (diffuse reflection image data - specular reflection image data), and the differential image generation unit 32 calculates at least one of these differential image data.

[0042] The diffuse reflectance distribution function calculation unit 34 uses the diffuse reflection image data to calculate the diffuse reflectance distribution function of the object 12. For example, in accordance with a Lambert reflection model, the diffuse reflectance distribution function calculation unit 34 calculates the diffuse reflectance ρd as a parameter from the diffuse reflection image using the diffuse reflectance distribution function ρd·cosθi, where ρd is the diffuse reflectance for incident light and θi is the angle of incidence.

[0043] The specular reflectance distribution function calculation unit 36 ​​uses the differential image data to calculate the specular reflectance distribution function of the object 12. For example, in accordance with the Phong reflection model, the specular reflectance distribution function calculation unit 36 ​​calculates the specular reflectance distribution function as ρs·cos nγ, and calculates the specular reflectance ρs,n as a parameter from the differential image data. When two differential image data are acquired by the differential image generation unit 32 and the specular reflectance distribution function is calculated using these two differential image data, the specular reflectance distribution function calculation unit 36 ​​calculates the specular reflectance distribution function for the differential image data (specular reflection image data - diffuse reflection image data) as ρs1·cos n1 γ, and for the differential image data (diffuse reflection image data - specular reflection image data), the specular reflectance distribution function is ρs2·cos n2 γ, and calculate ρs1, ρs2, n1, and n2 as parameters from the respective differential image data.

[0044] The reflectance distribution function calculation unit 40 calculates the reflectance distribution function for each pixel of the object 12 using the diffuse reflectance distribution function calculated by the diffuse reflectance distribution function calculation unit 34 and the specular reflectance distribution function calculated by the specular reflectance distribution function calculation unit 36. For example, the reflectance distribution function calculation unit 40 calculates the reflectance distribution function according to the formula "reflectance distribution function = diffuse reflectance distribution function + specular reflectance distribution function" in accordance with the Lambert reflection model and the Phong reflection model.

[0045] The rendering unit 46 renders a three-dimensional model on a virtual screen set in the virtual three-dimensional space based on the reflectance distribution function calculated by the reflectance distribution function calculation unit 40, the various parameters set by the parameter adjustment unit 38, the light source information (e.g., information indicating the light source direction) acquired by the light source information acquisition unit 42, and the camera information (e.g., information indicating the line of sight direction) acquired by the camera information acquisition unit 44, thereby reproducing the surface texture of the object 12 as CG and displaying it on the display. In other words, an image based on image data capable of reproducing the surface texture of the object 12 is displayed on the display. The rendering process is well known, and the rendering process may be performed using, for example, a radiosity method or a ray tracing method that takes interreflection into consideration.

[0046] The hardware configuration of the image processing device 26 will be described below with reference to Fig. 3. Fig. 3 shows an example of the hardware configuration of the image processing device 26.

[0047] The image processing device 26 includes, as its hardware configuration, a communication device 48, a user interface (hereinafter referred to as "UI") 50, a memory 52, and a processor 54.

[0048] The communication device 48 includes one or more communication interfaces having a communication chip, a communication circuit, etc., and has a function of transmitting information to other devices and a function of receiving information from other devices. The communication device 48 may have a wireless communication function or a wired communication function.

[0049] The UI 50 is a user interface and includes a display and an input device. The display is a liquid crystal display, an EL display, or the like. The input device is a keyboard, a mouse, input keys, an operation panel, or the like. The UI 50 may be a UI such as a touch panel that combines a display and an input device.

[0050] The memory 52 is a device that configures one or more storage areas for storing data. The memory 52 is, for example, a hard disk drive (HDD), a solid state drive (SSD), various types of memory (e.g., RAM, DRAM, NVRAM, ROM, etc.), other storage devices (e.g., optical disks, etc.), or a combination thereof.

[0051] The processor 54 controls the operation of each part of the image processing device 26 .

[0052] For example, memory 52 stores diffuse reflection image data and specular reflection image data.

[0053] Processor 54 functions as differential image generation unit 32, diffuse reflectance distribution function calculation unit 34, specular reflectance distribution function calculation unit 36, reflectance distribution function calculation unit 40, and rendering unit 46. Processor 54 reads diffuse reflection image data and specular reflection image data stored in memory 52, calculates the difference between them, and stores the generated differential image data in memory 52. ​​Processor 54 reads diffuse reflection image data stored in memory 52, calculates a diffuse reflectance distribution function, and stores its parameters in memory 52, and reads differential image data stored in memory 52, calculates a specular reflectance distribution function, and stores its parameters in memory 52. ​​Processor 54 calculates a reflectance distribution function, for example, as the sum of the diffuse reflectance distribution function and the specular reflectance distribution function, and uses the reflectance distribution function to display on a display changes in the reflected color of object 12 due to differences in viewing angle and incident angle of light.

[0054] The image processing device 26 may be included in the scanner 10, and the information indicating the texture may be generated by the scanner 10. Of course, the image processing device 26 may not be included in the scanner 10, and may be used as a device separate from the scanner 10.

[0055] Hereinafter, optically reading the characteristics of the surface of object 12 will be referred to as "scanning." Diffuse reflection image data is generated by irradiating the surface of object 12 with light from light source 18 or light source 20 and scanning the surface of object 12. Specular reflection image data is generated by irradiating the surface of object 12 with light from light source 22 and scanning the surface of object 12.

[0056] In this embodiment, the scanner 10 generates multiple image data by scanning the surface of the object 12 at least two or three times while changing the light source. The processor 54 of the image processing device 26 receives the multiple image data and determines, based on the multiple image data, whether the position of the object 12 has changed between scans. Depending on the result of this determination, the processor 54 combines two sets of image data (i.e., diffuse reflection image data and specular reflection image data) acquired using different light sources, or does not combine the two sets of image data. Combining the two sets of image data means generating image data that reproduces the texture of the surface of the object 12 through the process described with reference to FIG. 2. Examples of the embodiment are described below.

[0057] Example 1 In the first embodiment, scanner 10 generates multiple image data by scanning the surface of object 12 at least twice with different light sources. Specifically, in the first scan, scanner 10 generates diffuse reflection image data by irradiating object 12 with light from light source 18 or light source 20, and in the second scan, scanner 10 generates specular reflection image data by irradiating object 12 with light from light source 22. In this example, light source 18 or light source 20 corresponds to an example of a first light source, and light source 22 corresponds to an example of a second light source.

[0058] In the first scan, specular reflection image data may be generated by illuminating object 12 with light from light source 20, and in the second scan, diffuse reflection image data may be generated by illuminating object 12 with light from light source 18 or light source 20. In this example scan, light source 22 corresponds to an example of a first light source, and light source 18 or light source 20 corresponds to an example of a second light source.

[0059] Furthermore, when the third scan is performed, the scanner 10 generates image data by irradiating the object 12 with light from the light source used in the first scan.

[0060] If the light source used in the first scan is light source 18 or light source 20, scanner 10 generates diffuse reflection image data in the third scan by irradiating light from light source 18 or light source 20 onto object 12.

[0061] If the light source used in the first scan is light source 22, scanner 10 generates specular reflection image data by irradiating light from light source 22 onto object 12 in the third scan.

[0062] The processor 54 of the image processing device 26 receives multiple image data (e.g., diffuse reflection image data and specular reflection image data) generated by at least two scans, and determines whether the position of the object 12 has changed between scans based on the multiple image data. Note that the concept of the position of the object 12 also includes the tilt of the object 12.

[0063] In the following, the image data generated by the first scan will be referred to as "first image data," the image data generated by the second scan will be referred to as "second image data," and the image data generated by the third scan will be referred to as "third image data."

[0064] For example, if light source 18 or light source 20 is used in the first scan and light source 22 is used in the second scan, the first image data will be diffuse reflection image data and the second image data will be specular reflection image data. If a third scan is performed under these conditions, the third image data will be diffuse reflection image data.

[0065] As another example, if a first scan uses light source 22 and a second scan uses light source 18 or light source 20, the first image data will be specular reflection image data and the second image data will be diffuse reflection image data. If a third scan is performed under these conditions, the third image data will be specular reflection image data.

[0066] For example, the processor 54 compares first image data (e.g., diffuse reflection image data) generated by a first scan with second image data (e.g., specular reflection image data) generated by a second scan, and determines whether the result of the comparison is within an acceptable range.

[0067] Matching the first image data with the second image data means, for example, matching the edge of the object 12 represented in the first image data with the edge of the object 12 represented in the second image data, and more specifically, comparing the position of the edge of the object 12 represented in the first image data with the position of the edge of the object 12 represented in the second image data.

[0068] The processor 54 extracts edges of the object 12 from the first image data and extracts edges of the object 12 from the second image data. A known edge extraction process, for example, is used as the process for extracting edges from image data. For example, if the object 12 is a document such as paper, the processor 54 extracts edges of the document from each of the first image data and the second image data. The edges extracted may be contours, vertices, etc. of the document.

[0069] The processor 54 calculates the difference between the positions of both edges extracted from the first image data and the second image data, and determines whether the difference is within an allowable range.

[0070] The acceptable range is determined in advance. For example, when image data reproducing the surface texture of object 12 is generated based on diffuse reflection image data and specular reflection image data by the process described with reference to Fig. 2, the acceptable range is determined from the perspective of whether or not the image data is acceptable as image data reproducing the surface texture of object 12. For example, the acceptable range is determined from the perspective of whether or not the image data accurately reproduces the surface texture of object 12.

[0071] The presence of a difference in the positions of both edges means that the position of the object 12 has changed between the first and second scans. The larger the difference, the greater the change in the position of the object 12. The greater the change in the position of the object 12, the less image data that accurately reproduces the surface texture of the object 12 will be generated; conversely, the smaller the change in the position of the object 12, the more image data that accurately reproduces the surface texture of the object 12 will be generated. If the difference in the positions of both edges is within the tolerance range, it is assumed that image data that accurately reproduces the surface texture of the object 12 will be generated; if the difference in the positions of both edges is not within the tolerance range, it is assumed that image data that accurately reproduces the surface texture of the object 12 will not be generated.

[0072] Even if the object 12 being scanned is the same object in the first and second scans, the first image data and the second image data are different in the strict sense because the first light source and the second light source are different light sources. Therefore, the processor 54 extracts the edges of the object 12 represented in each of the first image data and the second image data, and compares the extracted edges with each other.

[0073] If the result of comparing the first image data with the second image data is within the tolerance, that is, if the difference in the positions of both edges is within the tolerance, the processor 54 combines the first image data with the second image data. That is, the processor 54 generates image data that reproduces the surface characteristics of the object 12 from the first image data and the second image data by the process described with reference to FIG.

[0074] If the result of comparing the first image data with the second image data is not within the tolerance range, i.e., if the difference in the positions of both edges is not within the tolerance range, the processor 54 compares the second image data with the third image data. That is, the processor 54 extracts the edges of the object 12 from the second image data, extracts the edges of the object 12 from the third image data, calculates the difference in the positions of the extracted edges, and determines whether the difference is within the tolerance range. If the difference is within the tolerance range, the processor 54 combines the second image data with the third image data. That is, the processor 54 generates image data that reproduces the surface characteristics of the object 12 from the second image data and the third image data by the process described with reference to FIG. 2.

[0075] If the third scan has not been performed and the third image data has not been generated, the processor 54 instructs the scanner 10 to perform a third scan. The scanner 10 generates the third image data by performing the third scan in accordance with the instruction. That is, the scanner 10 generates the third image data by irradiating the object 12 with light from the first light source used in the first scan. The processor 54 receives the third image data and compares the second image data with the third image data.

[0076] The first embodiment will be described in detail below with reference to Fig. 4. Fig. 4 shows image data generated in the first embodiment.

[0077] Image 56 is first image data (e.g., diffuse reflection image data) generated by the first scan. Image 58 is second image data (e.g., specular reflection image data) generated by the second scan. Image 60 is third image data (e.g., diffuse reflection image data) generated by the third scan.

[0078] In this example, object 12 is an original such as paper, which is placed on platen glass 14 and scanned. Images 56, 58, and 60 are image data representing the original. If the results of matching images 56 and 58 are within the acceptable range, a third scan is not performed.

[0079] Processor 54 compares image 56 with image 58. Specifically, processor 54 extracts the edges of object 12 shown in image 56 and extracts the edges of object 12 shown in image 58. Processor 54 determines whether the difference between the position of the edge extracted from image 56 and the position of the edge extracted from image 58 is within an acceptable range.

[0080] In the example shown in FIG. 4, object 12 shown in image 58 is tilted relative to object 12 shown in image 56. In other words, the edge extracted from image 58 is tilted relative to the edge extracted from image 56. In this example, processor 54 determines that the difference between the position of the edge extracted from image 56 and the position of the edge extracted from image 58 is not within the acceptable range ("(1) Matching NG" in FIG. 4). For example, the position of object 12 has changed between the first and second scans, and this change in position is reflected in image 58, which is thought to be why matching is NG.

[0081] If the matching between image 56 and image 58 is not successful, that is, if the matching result is not within the acceptable range, processor 54 may display information indicating that the matching result is not within the acceptable range on the display. For example, processor 54 may display a message, such as a string of characters, indicating that the matching result is not successful on the display of UI 50. Processor 54 may also display a message on the display urging the user not to move object 12 while scanning is being performed.

[0082] If the comparison between image 56 and image 58 is unsuccessful, processor 54 compares image 58 with image 60. Specifically, processor 54 extracts the edges of object 12 shown in image 60 and determines whether the difference between the position of the edge extracted from image 58 and the position of the edge extracted from image 60 is within an acceptable range. Note that if the third scan has not been performed and image 60 has not been generated, processor 54 acquires image 60 by instructing scanner 10 to perform a third scan.

[0083] In the example shown in Fig. 4, processor 54 determines that the difference between the position of the edge extracted from image 58 and the position of the edge extracted from image 60 is within the tolerance range ("(2) Match OK" in Fig. 4). For example, the position of object 12 has not changed between the second and third scans, or even if the position has changed, the change (i.e., positional deviation) is within the tolerance range, and it is determined from images 58 and 60 that the difference in position is also within the tolerance range.

[0084] If the images 58 and 60 match, the processor 54 combines the images 58 and 60 to generate image data that reproduces the surface characteristics of the object 12.

[0085] If the comparison is successful, the processor 54 may display information indicating that the comparison result is within an acceptable range on the display of the UI 50. For example, the processor 54 may display a message, such as a character string, indicating that the comparison is successful on the display of the UI 50. The processor 54 may also display a message, such as a message indicating that the object 12 (e.g., a document) may be removed from the platen glass 14, on the display.

[0086] If the images 56 and 58 match, the processor 54 combines the images 56 and 58 to generate image data that reproduces the surface characteristics of the object 12. In this case, the third scan is not performed.

[0087] As described above, even if the comparison of images 56 and 58 is unsuccessful, if the comparison of images 58 and 60 is successful, image data that reproduces the surface characteristics of object 12 is generated using images 58 and 60. In other words, even if the position of object 12 changes between the first and second scans and the difference in position is no longer within the tolerance, if the comparison of the results of the second and third scans is successful, image data that reproduces the surface characteristics of object 12 is generated using images 58 and 60. Because image data that reproduces the surface characteristics of object 12 is generated using the results of the third scan, the number of rescans can be reduced to one.

[0088] A possible rescanning step is to perform two more scans (for example, one scan using light source 18 or light source 20 and one scan using light source 22) after the second scan. In this case, a total of at least four scans must be performed.

[0089] In contrast to this, in the first embodiment, if the third scan is performed and the comparison between the images 58 and 60 is successful, there is no need to perform a fourth scan, so the number of rescans can be reduced to one.

[0090] If the comparison between the second image data and the third image data is unsuccessful (for example, if the comparison between images 58 and 60 is unsuccessful), processor 54 may instruct scanner 10 to perform a fourth scan. The fourth scan is a scan using the second light source used in the second scan.

[0091] The processor 54 compares the third image data generated by the third scan with the fourth image data generated by the fourth scan. If the comparison is successful, the processor 54 combines the third image data with the fourth image data to generate image data that reproduces the surface characteristics of the object 12.

[0092] If the match is unsuccessful, the processor 54 may cause an error message to be displayed on the display of the UI 50.

[0093] Note that the fifth and subsequent scans may be performed. In this case, the light source is alternately switched between the first light source and the second light source for each scan. The number of scans may be determined in advance or may be set by the user.

[0094] Example 2 In the second embodiment, scanner 10 generates multiple image data by scanning at least three times with different light sources. Specifically, in the first scan, scanner 10 generates diffuse reflection image data by irradiating object 12 with light from light source 18 or light source 20, in the second scan, generates specular reflection image data by irradiating object 12 with light from light source 22, and in the third scan, generates diffuse reflection image data by irradiating object 12 with light from light source 18 or light source 20. In this example, light source 18 or light source 20 corresponds to an example of a first light source, and light source 22 corresponds to an example of a second light source.

[0095] As in the first embodiment, the light source 22 may be used in the first and third scans, and the light source 18 or the light source 20 may be used in the second scan.

[0096] The processor 54 compares the first image data (e.g., diffuse reflection image data) generated by a first scan using the first light source with the third image data (e.g., diffuse reflection image data) generated by a third scan using the same first light source, and determines whether the result of the comparison is within an acceptable range.

[0097] If the result of the comparison is within the acceptable range, the processor 54 generates image data that reproduces the surface characteristics of the object 12 by combining second image data (e.g., specular reflection image data) generated by a second scan using a second light source with either the first image data or the third image data.

[0098] The second embodiment will be described in detail below with reference to Fig. 5. Fig. 5 shows image data generated in the second embodiment.

[0099] Image 62 is first image data (e.g., diffuse reflection image data) generated by the first scan. Image 64 is second image data (e.g., specular reflection image data) generated by the second scan. Image 66 is third image data (e.g., diffuse reflection image data) generated by the third scan.

[0100] In this example, the object 12 is an original such as a sheet of paper, and each scan is performed while the original is placed on the platen glass 14. Images 62, 64, and 66 are image data representing the original.

[0101] Processor 54 compares image 62 generated by the first scan with image 66 generated by the third scan. Specifically, processor 54 extracts the edges of object 12 represented in image 62 and extracts the edges of object 12 represented in image 66. Processor 54 determines whether the difference between the position of the edge extracted from image 62 and the position of the edge extracted from image 66 is within an acceptable range.

[0102] 5, processor 54 determines that the difference between the position of the edge extracted from image 62 and the position of the edge extracted from image 66 is within the tolerance range ("(3) Match OK" in FIG. 5). For example, the position of object 12 has not changed between the first and third scans, or if the position has changed, the change (i.e., positional deviation) is within the tolerance range, and it is determined that the difference in position is also within the tolerance range from images 62 and 66.

[0103] If the match between images 62 and 66 is successful, processor 54 combines image 64 with either image 62 or image 66. This generates image data that reproduces the surface characteristics of object 12. In this case, processor 54 may display a message on the display of UI 50 indicating that the match is successful and a message indicating that object 12 may be removed.

[0104] If the comparison of the images 62 and 66 is not successful, the processor 54 displays a message indicating that the comparison is not successful or an error message on the display of the UI 50.

[0105] If the comparison of images 62 and 66 is unsuccessful, a fourth scan using a second light source may be performed, and the second image data generated by the second scan may be compared with the fourth image data generated by the fourth scan.

[0106] If the match is successful, the processor 54 may generate image data that reproduces the surface characteristics of the object 12 by combining the third image data with either the second image data or the fourth image data.

[0107] If the comparison is unsuccessful, the processor 54 may display an error message on the display of the UI 50. As in the first embodiment, the fifth and subsequent scans may be performed.

[0108] Even when comparing edges, if the object 12 is a manuscript such as a hologram, different light sources may result in completely different generated image data. For example, when comparing image data generated using a first light source with image data generated using a second light source, the comparison may fail even if the position of the object 12 has not changed between scans. This is due to the difference in light sources.

[0109] For example, object 12 shown in image 64 generated by the second scan is positioned at an angle to object 12 shown in image 62 generated by the first scan. Therefore, if image 62 and image 64 are compared, the match will be NG ("(1) Matching NG" in FIG. 5). Even if the actual position of object 12 has not changed between the first and second scans, when image 62 and image 64 are compared, the position of object 12 appears to have changed in the images, and therefore the match will be NG. This is due to differences in light sources. The same is true when image 64 and image 66 are compared ("(2) Matching NG" in FIG. 5).

[0110] In the second embodiment, the first image data and the third image data are compared, which are generated using the same light source (e.g., the first light source), so that the comparison does not fail due to differences in the light source. If the comparison between the first image data and the third image data is successful, it can be assumed that the position of the object 12 has not changed between the first scan and the third scan, or that even if the position has changed, the change is within an acceptable range. If the comparison between the first image data and the third image data is unsuccessful, it can be assumed that the position of the object 12 has changed between the first scan and the third scan, and that the change is not within an acceptable range. In this way, in the second embodiment, it is possible to prevent an erroneous determination that the comparison is unsuccessful due to differences in the light source, and to determine whether the position of the object 12 has changed.

[0111] Example 3 In the third embodiment, scanner 10 generates multiple image data by scanning at least twice with different light sources. Specifically, in the first scan, scanner 10 generates diffuse reflection image data by irradiating object 12 with light from light source 18 or light source 20, and in the second scan, scanner 10 generates specular reflection image data by irradiating object 12 with light from light source 22. In this example, light source 18 or light source 20 corresponds to an example of a first light source, and light source 22 corresponds to an example of a second light source.

[0112] As in the first embodiment, the light source 22 may be used in the first scan, and the light source 18 or the light source 20 may be used in the second scan.

[0113] The processor 54 compares the first image data generated by the first scan using the first light source with the second image data generated by the second scan using the second light source, and determines whether the result of the comparison is within an acceptable range.

[0114] If the result of comparing the first image data with the second image data is within the acceptable range, the processor 54 combines the first image data with the second image data to generate image data that reproduces the surface characteristics of the object 12.

[0115] If the result of comparing the first image data with the second image data is not within the tolerance range, the processor 54 instructs the scanner 10 to perform a third scan. The third scan is a scan using the first light source, just like the first scan. The processor 54 compares the third image data generated by the third scan using the first light source with the first image data.

[0116] If the result of matching the first image data with the third image data is within the acceptable range, as in Example 2, the processor 54 generates image data that reproduces the surface characteristics of the object 12 by combining the second image data with either the first light source data or the third image data.

[0117] If the result of comparing the first image data with the third image data is not within the allowable range, the subsequent processing may be executed as in the second embodiment.

[0118] Hereinafter, the third embodiment will be described in detail with reference to FIG.

[0119] First, processor 54 compares image 62 generated by the first scan with image 64 generated by the second scan. If the comparison is successful, processor 54 combines image 62 and image 64 to generate image data that reproduces the surface characteristics of object 12. In this case, a third scan is not performed.

[0120] In the example shown in FIG. 5, the comparison between image 62 and image 64 is NG ("(1) Comparison NG" in FIG. 5). In this case, processor 54 instructs scanner 10 to perform a third scan. This causes a third scan to be performed, and image 66 is generated. Processor 54 compares image 62 generated by the first scan with image 66 generated by the third scan.

[0121] 5, the comparison between image 62 and image 66 is successful ("(3) Comparison successful" in FIG. 5). In this case, processor 54 generates image data that reproduces the surface characteristics of object 12 by combining image 64 with image 62 or image 66.

[0122] As described in the second embodiment, the first light source for acquiring the images 62 and 66 is different from the second light source for acquiring the image 64, and therefore, even if the actual position of the object 12 has not changed, it may be determined that the position of the object 12 has changed in the image. By comparing the images 62 and 66 acquired using the same first light source, it is possible to prevent erroneous determinations due to differences in light sources.

[0123] Furthermore, in the third embodiment, if the comparison between the image 62 generated by the first scan and the image 64 generated by the second scan is successful, image data that reproduces the surface characteristics of the object 12 is generated based on the images 62 and 64. In this case, the third scan is not performed, and therefore, depending on the comparison result, the number of scans can be reduced to two.

[0124] In the third embodiment as well, information indicating the result of the matching may be displayed on the display.

[0125] In the above-described first to third embodiments, the processor 54 may display the result of combining the image data on the display of the UI 50, and control the execution of the scan on the object 12 according to the user's instructions.

[0126] For example, processor 54 may cause the display of UI 50 to display an image based on image data that reproduces the surface characteristics of object 12 and that is generated by combining the first image data and the second image data. Processor 54 may also cause the display of UI 50 to display an image based on image data that reproduces the surface characteristics of object 12 and that is generated by combining the second image data and the third image data.

[0127] The user refers to the image displayed on the display and uses the UI 50 to instruct whether or not to rescan. When the user instructs rescanning, the processor 54 receives the instruction and instructs the scanner 10 to perform a rescan. The scanner 10 performs a scan in accordance with the rescan instruction. For example, the scanner 10 performs a scan using a first light source and a scan using a second light source. The processor 54 compares the two image data generated by these scans, and if the comparison is successful, combines the two image data.

[0128] The user may also specify a light source and instruct rescanning. In this case, scanner 10 performs a scan using the light source specified by the user. Processor 54 compares the image data generated by the scan with image data generated by a scan using a different light source than the light source used in the scan. If the comparison is successful, processor 54 combines the image data.

[0129] The functions of the image processing device 26 are realized, for example, by a combination of hardware and software. For example, the functions of each device are realized by a processor reading and executing a program stored in the memory of each device. The program is stored in the memory via a recording medium such as a CD or DVD, or via a communication path such as a network.

[0130] In the above embodiments, the term "processor" refers to a processor in a broad sense, and includes general-purpose processors (e.g., CPU: Central Processing Unit, etc.) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.). Furthermore, the operations of the processor in the above embodiments may not only be performed by a single processor, but may also be performed by multiple processors located in physically separate locations working together. Furthermore, the order of the operations of the processor is not limited to the order described in the above embodiments, and may be changed as appropriate. [Explanation of symbols]

[0131] 10 scanners, 26 image processing units, 54 processors.

Claims

1. a processor; The processor: acquiring a plurality of image data generated by scanning the surface of the object at least twice with different light sources; If a result of comparing first image data generated by a first scan using a first light source with second image data generated by a second scan using a second light source different from the first light source is within an acceptable range, the first image data and the second image data are combined; If the result of the comparison between the first image data and the second image data is not within the tolerance range, the second image data is compared with third image data generated by a third scan performed using the first light source, and if the result of the comparison is within the tolerance range, the second image data is combined with the third image data. Information processing device.

2. a processor; The processor: acquiring a plurality of image data generated by performing at least three scans using different light sources; If the result of comparing first image data generated by a first scan using a first light source with third image data generated by a third scan using the first light source is within an acceptable range, second image data generated by a second scan using a second light source different from the first light source is combined with either the first image data or the third image data. Information processing device.

3. a processor; The processor: acquiring a plurality of image data generated by performing at least two scans using different light sources; If a result of comparing first image data generated by a first scan using a first light source with second image data generated by a second scan using a second light source different from the first light source is within an acceptable range, the first image data and the second image data are combined; If the result of matching the first image data with the second image data is not within the allowable range, and the result of matching the third image data generated by the third scan using the first light source with the first image data is within the allowable range, the second image data is combined with either the first image data or the third image data. Information processing device.

4. The processor: If the result of the comparison is not within the acceptable range, displaying information indicating that the result of the comparison is not within the acceptable range on a display. The information processing device according to claim 1 .

5. The processor: Displaying the result of the synthesis on a display; Controlling the execution of a scan on the object in accordance with a user's instructions; The information processing device according to claim 1 .

6. The computer acquiring a plurality of image data generated by scanning the surface of the object at least twice with different light sources; If a result of comparing first image data generated by a first scan using a first light source with second image data generated by a second scan using a second light source different from the first light source is within an acceptable range, the first image data and the second image data are combined; If the result of the comparison between the first image data and the second image data is not within the tolerance range, the second image data is compared with third image data generated by a third scan performed using the first light source, and if the result of the comparison is within the tolerance range, the second image data is combined with the third image data. A program to make it work like this.

7. The computer acquiring a plurality of image data generated by performing at least three scans using different light sources; If the result of comparing first image data generated by a first scan using a first light source with third image data generated by a third scan using the first light source is within an acceptable range, second image data generated by a second scan using a second light source different from the first light source is combined with either the first image data or the third image data. A program to make it work like this.

8. The computer acquiring a plurality of image data generated by performing at least two scans using different light sources; If a result of comparing first image data generated by a first scan using a first light source with second image data generated by a second scan using a second light source different from the first light source is within an acceptable range, the first image data and the second image data are combined; If the result of matching the first image data with the second image data is not within the allowable range, and the result of matching the third image data generated by the third scan using the first light source with the first image data is within the allowable range, the second image data is combined with either the first image data or the third image data. A program to make it work like this.

Images