Information processing system, gloss read system and program

Abstract

To make it easier to capture an image including a mirror reflection component from a subject in an arbitrary shape as compared with a technique for acquiring the mirror reflection component of the subject through relative movement of lighting to a camera.SOLUTION: There is provided an information system that has one or more processors which images a subject from a plurality of directions by rotating an imaging system including a light source for lighting or the subject around the position where the subject is fitted as a center point, wherein the one or more processors control the rotation of the imaging system or the subject based upon an angle range around the center point in which the mirror reflection component can be captured at the spot of the largest distance from the center point to a surface of the subject within an observation range of the subject.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention relates to an information processing system, a gloss reading system, and a program.

Background Art

[0002] There is a reading technique in which a plurality of images with different illumination directions are captured with the positions of the subject and the camera fixed, and the maximum luminance value of each pixel among these is adopted as the specular reflection component.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] As described above, acquisition of the specular reflection component is necessary for reproduction of the glossiness. However, the positional relationship that satisfies the specular reflection conditions also varies depending on the part and placement of the subject. For this reason, with the current technology, the reproduction accuracy of the glossiness may be low depending on the observation direction of the subject.

[0005] An object of the present invention is to facilitate imaging of an image including a specular reflection component from a subject having an arbitrary shape as compared with a method of acquiring the specular reflection component of the subject through relative movement of illumination with respect to the camera.

Means for Solving the Problems

[0006] The invention according to claim 1 has one or more processors that image a subject from multiple directions by rotating an imaging system including a light source for illumination or the subject around a position where the subject is attached as a center point, and the one or more processors are capable of imaging a specular reflection component at a point of the maximum distance from the center point to the surface of the subject within the observation range of the subject, and control the rotation of the imaging system or the subject based on an angular range centered on the center point. It is an information processing system. The invention according to claim 2 is the information processing system according to claim 1, wherein the rotation angle of the subject or the imaging system by the one or more processors is smaller than the angular range. The invention according to claim 3 is the information processing system according to claim 2, wherein when the one or more processors image an image of a subject as a still image, the rotation angle is indicated as the rotation amount to the next imaging position for the subject or the imaging system. The invention according to claim 4 is the information processing system according to claim 2, wherein when the one or more processors image an image of a subject as a still image, when the rotation amount from the previous imaging position reaches the rotation angle, an instruction to capture the next still image is given. The invention according to claim 5 is the information processing system according to claim 2, wherein when the one or more processors image an image of a subject as a moving image, when the rotation amount reaches the rotation angle from the capture position of the previous still image, an instruction to capture the next still image is given. The invention according to claim 6 is the information processing system according to claim 1, wherein the one or more processors calculate a gloss value based on a plurality of luminance values corresponding to regions where features regarding the shape match among a plurality of images acquired by the imaging system. The invention according to claim 7 is the information processing system according to claim 6, wherein the one or more processors use the difference between the maximum luminance value of the region where the features regarding the shape match and the diffuse reflection luminance value as the gloss value. The invention according to claim 8 is the information processing system according to claim 1, wherein the subject is attached to a turntable that rotates around the center point as a rotation center. The invention according to claim 9 is the information processing system according to claim 1, wherein the imaging system is attached to a turntable that rotates about the center point as a rotation center. The invention according to claim 10 includes an imaging system including a light source for illumination, a turntable that rotates the imaging system or the subject about a center point which is the position where the subject is attached, and one or more processors. The one or more processors control the rotation of the imaging system or the subject based on an angular range centered on the center point that enables imaging of a specular reflection component at a point of the maximum distance from the center point to the surface of the subject within the observation range of the subject, and is a gloss reading system. The invention according to claim 11 is a program for causing a computer that controls a gloss reading system including an imaging system including a light source for illumination and a turntable that rotates the imaging system or the subject about a center point which is the position where the subject is attached, to realize a function of controlling the rotation of the imaging system or the subject based on an angular range centered on the center point that enables imaging of a specular reflection component at a point of the maximum distance from the center point to the surface of the subject within the observation range of the subject.

Advantages of the Invention

[0007] According to the invention described in claim 1, imaging of an image including a specular reflection component from a subject of any shape can be facilitated as compared with a method of acquiring a specular reflection component of a subject through relative movement of illumination with respect to a camera. According to the invention described in claim 2, a specular reflection component can be acquired regardless of the shape or mounting position of the subject. According to the invention described in claim 3, a still image including a specular reflection component can be continuously imaged. According to the invention described in claim 4, a still image including a specular reflection component can be continuously imaged. According to the invention described in claim 5, a still image including a specular reflection component can be continuously acquired from a moving image. According to the invention described in claim 6, a gloss value can be calculated with high accuracy. According to the invention described in claim 7, a gloss value can be calculated with high accuracy. According to the invention described in claim 8, it is possible to capture an image including a specular reflection component while relatively rotating a subject with respect to the imaging system. According to the invention described in claim 9, it is possible to capture an image including a specular reflection component while relatively rotating the imaging system with respect to the subject. According to the invention described in claim 10, compared with a method of obtaining a specular reflection component of a subject through relative movement of illumination with respect to a camera, it is possible to facilitate capturing an image including a specular reflection component from a subject of any shape. According to the invention described in claim 11, compared with a method of obtaining a specular reflection component of a subject through relative movement of illumination with respect to a camera, it is possible to facilitate capturing an image including a specular reflection component from a subject of any shape.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Embodiments for Carrying Out the Invention

[0009] Hereinafter, embodiments of the present invention will be described with reference to the drawings. <Embodiment 1> <System Configuration> FIG. 1 is a diagram for explaining the schematic configuration of the gloss reading system 1 assumed in Embodiment 1. The gloss reading system 1 shown in FIG. 1 is composed of an imaging system 10, a turntable 20, and a control device 30. The imaging system 10 is composed of a light source 11 for illuminating the subject S and a camera 12 for imaging the subject S. In Embodiment 1, the subject S is detachably attached to the turntable 20.

[0010] The subject S shown in FIG. 1 has an ellipsoidal shape. However, the ellipsoid is only an example, and the subject S may have any three-dimensional shape. The turntable 20 is composed of, for example, a disk-shaped pedestal and a motor (not shown) for rotationally driving the pedestal. In FIG. 1, the rotation center of the turntable 20 is O, and the rotation axis of the turntable 20 passing through the rotation center O is represented by a dashed line. In the case of FIG. 1, the pedestal surface of the rotating turntable 20 is defined by the XY plane defined by the X-axis and the Y-axis. Note that the normal line of the XY plane is the Z-axis. The Z-axis is parallel to the rotation axis.

[0011] In the case of FIG. 1, the turntable 20 is rotated counterclockwise by a motor (not shown). The turntable 20 in the present embodiment rotates 360° in conjunction with the imaging of the subject S. Note that the rotation center O is the target position when attaching the subject S to the turntable 20. However, since the shape of the subject S to be imaged is arbitrary, strict positioning between the subject S and the rotation center O is not required. In FIG. 1, the subject S is shown attached in a state offset from the rotation center O.

[0012] In the present embodiment, a surface light source is used for the light source 11. The light source 11 may be a parallel light source or a non-parallel light source (i.e., a diffused light source). The light source 11 is positioned in a direction to illuminate the surface of the subject S attached to the turntable 20. The camera 12 is a device that images the surface of the subject S attached to the turntable 20 and is composed of, for example, a CMOS (= Complementary Metal - Oxide Semiconductor) sensor. The camera 12 is an example of an imaging unit. The imaging direction of the camera 12 is positioned in the direction illuminated by the illumination light. In the case of the present embodiment, the positional relationship between the imaging system 10 and the turntable 20 is invariant. Note that the distance between the surface of the subject S and the imaging system 10 varies with the rotation of the turntable 20.

[0013] The control device 30 has at least a function of controlling the rotation of the motor constituting the turntable 20, a function of controlling the lighting and extinguishing of the light source 11, a function of capturing an image from the camera 12, and a function of generating a three - dimensional model including the gloss information (hereinafter also referred to as "gloss value") of the subject S from the captured image. The control device 30 is an example of an information processing system. The gloss information corresponds to the luminance value of the light component specularly reflected on the surface of the subject S. For the control device 30 in the present embodiment, for example, a desktop computer or a notebook computer is used. However, the control device 30 may also be a cloud server or a tablet computer connected to the imaging system 10 via a network.

[0014] FIG. 2 is a diagram for explaining the positional relationship between the imaging system 10 and the turntable 20. In FIG. 2, the same reference numerals as the corresponding parts in FIG. 1 are shown. The positional relationship shown in FIG. 2 is the positional relationship in the XY plane. The subject S shown in FIG. 2 is an ellipse and is arranged in a state offset with respect to the rotation center O of the turntable 20. When the turntable 20 rotates 360° in this state, images of the subject S captured from a plurality of directions are captured by the imaging system 10. In other words, images of the subject S captured from positions corresponding to multiple points on the circumference centered on the rotation center O are captured. In FIG. 2, the illumination light irradiated from the light source 11 toward the subject S is indicated by L1, and the reflected light reflected by the surface of the subject S and incident on the camera 12 is indicated by L2.

[0015] <Hardware Configuration of the Control Device> FIG. 3 is a diagram for explaining an example of the hardware configuration of the control device 30. The control device 30 shown in FIG. 3 includes a processor 31, a ROM (= Read Only Memory) 32 in which a BIOS (= Basic Input Output System) or the like is stored, a RAM (= Random Access Memory) 33 used as a work area of the processor 31, an auxiliary storage device 34, a communication interface 35, a display 36, and an input reception device 37. Each device is connected through a bus or other signal lines 38.

[0016] The processor 31 is a device that realizes various functions through the execution of programs. The processor 31, the ROM 32, and the RAM 23 function as a computer. The auxiliary storage device 34 is composed of, for example, a hard disk device or a semiconductor storage. Programs and various data are stored in the auxiliary storage device 34. Here, the program is used as a general term for the OS (=Operating System) and application programs. Here, the application programs include, for example, a program for controlling the generation of a three-dimensional model with specular information.

[0017] The communication interface 35 is an interface for communicating with the imaging system 10 and the turntable 20 through a network (not shown). The communication interface 35 supports various communication standards. Here, the communication standards include, for example, Ethernet (registered trademark), Wi-Fi (registered trademark), wireless LAN (=Local Area Network), and mobile communication systems. The display 36 is, for example, a liquid crystal display or an organic EL (=Electro Luminescence) display. A three-dimensional model generated from an image obtained by imaging the subject S is displayed on the display 36. The three-dimensional model generated in this embodiment includes specular information.

[0018] The input reception device 37 is, for example, a mouse or a keyboard. Incidentally, when the control device 30 is a notebook computer or a tablet computer, the input reception device 37 is composed of a capacitive touch sensor having a transparency that does not obstruct the viewing of the image displayed on the display 36. A device combining this type of touch sensor and a display is called a touch panel.

[0019] <Overview of the processing operation> FIG. 4 is a flowchart for explaining an example of the process for generating a three-dimensional model in the first embodiment. Note that the symbol "S# (# is a number)" shown in FIG. 4 means a step. The processing operation shown in FIG. 4 is executed by the processor 31 (see FIG. 3) of the control device 30. Upon the start of the generation process, the processor 31 determines an angular range Θ within which an image including a specular reflection component can be captured from an arbitrary part of the outer peripheral surface of the subject S (step 1).

[0020] The angular range Θ here is given as a central angle θ with respect to the rotation center O. One of the reasons for using the central angle θ is that the shape and surface state of the subject S to be imaged are arbitrary. Information defining the shape of the subject S includes dimensions, overall structures such as spheres and cylinders, and partial structures such as unevenness and steps. Information defining the surface state includes types of processing such as mirror finish, with gloss, and without gloss. The detailed operation of step 1 will be described later.

[0021] Next, the processor 31 determines an increment angle equal to or less than the angular range Θ determined in step 1 (step 2). The increment angle here is also given as a central angle θ with respect to the rotation center O (see FIG. 2). In the case of this embodiment, the increment angle gives the rotation angle from the imaging start position or the current imaging position to the next imaging position. The increment angle here is also referred to as the step angle. In this embodiment, the increment angle is set to, for example, 60% to 80% of the angular range. Next, the processor 31 rotates the turntable 20 by the increment angle determined in step 2 and images the subject S (step 3).

[0022] When the image is captured, the processor 31 determines whether imaging of the entire circumference of the subject has been completed (step 4). In other words, the processor 31 determines whether the rotation amount of the turntable 20 from the start of imaging has reached 360°. The rotation amount can be calculated by multiplying the step angle by the number of imaging times. If the entire circumference of the subject has not been imaged, a negative result is obtained in step 4. In this case, the processor 31 returns to step 3.

[0023] On the other hand, if the entire circumference of the subject has been imaged, a positive result is obtained in step 4. In this case, the processor 31 generates a three-dimensional model including specular reflection information (step 5). Subsequently, the processor 31 displays the generated three-dimensional model on the display 36 (see FIG. 3) (step 6).

[0024] <Details of the processing operation> Subsequently, the details of the processing operation described with reference to FIG. 4 will be described.

[0025] <Details of step 1> FIG. 5 is a flowchart for explaining the detailed processing operation of step 1 in FIG. 4. First, the processor 31 sets the position coordinates of the light source 11 (see FIG. 2) and the camera 12 (see FIG. 2) (step 11). These position coordinates are given as coordinate points on the XY plane. These position coordinates are given as initial values. Since the light source 11 is an area light source, the position coordinates of the light source 11 are given by the position coordinates of two end points of the area light source on the XY plane.

[0026] Next, the processor 31 sets the maximum outer diameter r0 of the subject S (step 12). Here, the maximum outer diameter r0 refers to the maximum distance from the rotation center O to the surface of the subject S. The maximum outer diameter r0 may be input by the user to the control device 30 (see FIG. 1), or a value obtained by measuring the distance to the surface of the subject S may be input. For measuring the distance, for example, TOF (= Time Of Flight) or other measurement techniques may be used. Incidentally, the maximum outer diameter r0 is calculated as the maximum value of the difference value between the distance from the measurement point to the rotation center O and the distance to the surface of the subject S. This calculation process is an example of the process of obtaining the maximum distance, and the calculated maximum value is set as the aforementioned maximum outer diameter r0.

[0027] FIG. 6 is a diagram for explaining the maximum outer diameter r0 of the subject S. Also in the case of FIG. 6, the subject S is an ellipse. Further, the subject S is attached at a position offset from the rotation center O. Incidentally, when the subject S is a cylinder and the position of its rotation axis coincides with the rotation center O, the maximum outer diameter r0 of the subject S coincides with the radius of the cylinder. FIG. 6 shows a circle representing the locus through which the maximum outer diameter r0 passes as the turntable 20 (see FIG. 1) rotates. As shown in FIG. 6, this circle gives the maximum outer periphery of the subject S to be imaged.

[0028] Return to the description of FIG. 5. Subsequently, the processor 31 sets the surface normal angle Nθ of the subject S to 0° (step 13). The surface normal angle Nθ here refers to the angle formed by the line segment passing through the rotation center O and the normal N of the surface of the subject S. FIG. 7 is a diagram for explaining the surface normal angle Nθ. In FIG. 7, the tangent line and the normal N representing the inclination of the surface on the maximum outer periphery are shown in thick lines. Note that the normal N is indicated by an arrow. The surface normal angle Nθ1 shown in FIG. 7 is the case where the normal N and the line segment passing through the rotation center O overlap. In this case, the angle formed by the two line segments is 0°. On the other hand, the surface normal angle Nθ2 shown in FIG. 7 is the case where the angle formed by the normal N and the line segment passing through the rotation center O is 30°.

[0029] FIG. 8 is a diagram for explaining the relationship between the combination of the distance from the rotation center O and the surface normal angle Nθ and the angular range Θ in which the specular reflection condition is satisfied. The horizontal axis in FIG. 8 is the surface normal angle Nθ, and the vertical axis is the distance from the rotation center O. Note that the unit of distance is millimeters. In FIG. 8, it is shown that the darker the color, the smaller the angular range Θ that satisfies the specular reflection condition.

[0030] Therefore, the most severe condition for obtaining the specular reflection component from the surface of the subject S is at the upper left corner with the darkest density. That is, the surface normal angle Nθ = 0° and the distance from the rotation center O is 500 mm. For this reason, in step 13, the surface normal angle Nθ is set to 0°. This is because if the most severe specular reflection condition is satisfied, it becomes possible to image an image including the specular reflection component from all surfaces of the subject S.

[0031] For reference, FIGS. 9 and 10 are used to explain the difference in the angular range Θ in which the specular reflection condition is satisfied. FIG. 9 is a diagram for explaining an angular range Θ1 when the surface normal angle Nθ is 0°. FIG. 10 is a diagram for explaining an angular range Θ2 when the surface normal angle Nθ is 30°. As shown in FIGS. 9 and 10, the positional relationship enabling imaging of an image including a specular reflection component is determined according to the surface normal angle Nθ of the light source 11, the camera 12, and the subject S. As also described in FIG. 8, the angular range Θ2 when the surface normal angle Nθ is 30° is larger than the angular range Θ1 when the surface normal angle Nθ is 0°.

[0032] Return to the description of FIG. 5. When the process of step 13 ends, the processor 31 executes a process of detecting a condition in which the illumination light L1 output from each of the two end points of the surface light source is specularly reflected on the surface of the subject S and input to the camera 12 (steps 14 to 17). First, the processor 31 sets the position coordinates of one end point P1 (see FIG. 9) of the surface light source (step 14). Next, the processor 31 detects, for example, an angle θ1 at which the incident angle s1 and the reflection angle s2 become the same by varying the angle θ formed with the Y-axis (step 15).

[0033] FIG. 11 is a diagram for explaining the processing operation shown in step 15. In FIG. 11, the relationship between the incident angle s1 and the reflection angle s2 at a point Q on the maximum outer diameter r0 specified by the angle θ formed with the Y-axis is shown. Note that the position of the point Q on the maximum outer diameter r0 specified by the angle θ is indicated by a vector r. Incidentally, as set in step 13 (see FIG. 5), the surface normal angle Nθ is 0°. Also, in FIG. 11, the position of the light source 11 is represented by a vector i, and the position of the camera 12 is represented by a vector c.

[0034] At this time, the vector r representing the point Q where the illumination light is incident is given by the following equation. r = [r0·sinθ, r0·cosθ] Here, the vector giving the illumination light is expressed as i - r, and the vector giving the reflected light is expressed as c - r. At this time, the incident angle s1 and the reflection angle s2 are expressed by the following equations. s1(r0,Nθ = 0°,θ)=arg(i - r,r) s2(r0,Nθ = 0°,θ)=arg(c - r,r)

[0035] Figure 12 is a diagram for explaining the angle θi that satisfies the specular reflection condition (i.e., s1 = s2). The horizontal axis is the angle θ with the Y-axis (see Figure 11), and the vertical axis represents the magnitude S of the incident angle or the reflection angle. The magnitude S of the incident angle s1 increases as the angle θ approaches 0° and decreases as the angle θ increases. Conversely, the magnitude S of the reflection angle s2 decreases as the angle θ approaches 0° and increases as the angle θ increases. From Figure 12, the angle θi when the magnitudes S of the incident angle s1 and the reflection angle s2 are the same is specified. In Step 15 (see Figure 5), for the end point P1, the angle θi that satisfies the specular reflection condition is set as θ1 (see Figure 9).

[0036] Return to the description of Figure 5. Next, the processor 31 sets the position coordinates of the other end point P2 (see Figure 9) of the surface light source (Step 16). Subsequently, the processor 31, for example, varies the angle θ with the Y-axis and detects the angle θ2 at which the incident angle s1 and the reflection angle s2 become the same (Step 17). The processing operation here is the same as in Steps 14 and 15. The angle θi that satisfies the specular reflection condition for the end point P2 is set as θ2 (see Figure 9).

[0037] When θ1 and θ2 in Figure 9 are detected by the processing from Step 14 to Step 17, the processor 31 determines |θ1 - θ2| as the angular range Θ that satisfies the specular reflection condition (Step 18). The angular range Θ here gives the conditions for the illumination lights L11 and L12 output from the two end points P1 and P2 of the surface light source to be specularly reflected on the maximum outer periphery of the subject S and incident on the center of the aperture of the camera 12, as shown in Figure 9. The angular range Θ (Θ1 in Figure 9) here corresponds to the angular range near the upper left corner in Figure 8. As described above, an angular range in which imaging of the specular reflection component is possible is determined under the maximum outer diameter r0 that is uniquely determined according to the dimensions and shape of the subject S to be imaged and the misalignment when the subject S is attached to the turntable 20.

[0038] <Detailed processing of Step 5> FIG. 13 is a flowchart for explaining the detailed processing operation of Step 5 (see FIG. 4). First, the processor 31 (see FIG. 3) simultaneously acquires the diffuse reflection component and the specular reflection component from the captured image (Step 51). The diffuse reflection component is calculated as the average value, the mode value, the median value, and the minimum value of the luminance values in the region where the shape features match among the plurality of images captured from different directions. The average value, the mode value, the median value, and the minimum value here are examples of statistical values. Also, the specular reflection component is calculated as a value obtained by subtracting the luminance value of the diffuse reflection component (hereinafter also referred to as the "diffuse reflection luminance value") from the maximum luminance value in the region where the features match.

[0039] Next, the processor 31 generates a three-dimensional model using the diffuse reflection component (Step 52). Subsequently, the processor 31 generates a color and gloss texture using the specular reflection component (Step 53). Finally, the processor 31 synthesizes the color and gloss texture onto the three-dimensional model (Step 54). Thereby, a three-dimensional model including gloss information is generated.

[0040] <Parentheses> By adopting the gloss reading system 1 (see FIG. 1) used in the present embodiment, it is possible to acquire the specular reflection component of the subject S without omission while having a simple system configuration. As a result, it is possible to generate a three-dimensional model with high reproducibility of the glossiness.

[0041] <Embodiment 2> In the case of Embodiment 2 as well, the system configuration is the same as that of Embodiment 1. That is, the gloss reading system 1 having the system configuration shown in FIG. 1 is used. The difference between the gloss reading system 1 in this embodiment and the gloss reading system 1 in Embodiment 1 lies in the method for generating a 3D model with gloss information. Specifically, in the case of this embodiment, the subject S is imaged twice to generate a 3D model with gloss information. One of the two imaging operations is for obtaining the diffuse reflection component, and the other is for obtaining the specular reflection component.

[0042] Note that the processing operations up to Step 2 shown in FIG. 4 are the same as those in Embodiment 1. FIG. 14 is a diagram for explaining another example of the processing operation corresponding to Steps 3 to 5 (see FIG. 4). First, the processor 31 determines whether it is the first imaging of the subject S (Step 31). In the case of the first imaging, an affirmative result is obtained in Step 31. In this case, the processor 31 rotates the turntable 20 (see FIG. 1) step by step in order and images the diffuse reflection component image of the subject S (Step 32).

[0043] For imaging the diffuse reflection component image, for example, a linear polarizing filter is used. For example, a linear polarizing filter F1 is inserted on the optical path of the light source 11, and another linear polarizing filter F2 is inserted in front of the camera 12. At this time, the polarization plane of the linear polarizing filter F2 is positioned in a direction orthogonal to the polarization plane of the linear polarizing filter F1. Thereby, only the diffuse reflection component of the subject S is incident on the camera 12.

[0044] After executing Step 32, the processor 31 generates a 3D model from the captured image (Step 51A). Here, the processor 31 aligns the regions where the shape features match among a plurality of images captured from different directions and generates a 3D model giving the appearance shape of the subject S. In the case of this embodiment, since the images used for generating the 3D model do not include the specular reflection component, it is possible to generate a 3D model with higher accuracy compared to the case of generating a 3D model using an image including the specular reflection component. After that, the processor 31 generates a color texture from the captured image (Step 52A).

[0045] Next, the processor 31 returns to step 31 and determines again whether it is the first imaging of the subject S. In the case of the second imaging, a negative result is obtained in step 31. In this case, the processor 31 rotates the turntable 20 step by step in order and captures an image of the specular reflection component of the subject S (step 33). The image of the specular reflection component can be acquired by, for example, the same method as in step 51 (see FIG. 13). Next, the processor 31 generates a specular texture from the captured image (i.e., the image of the specular reflection component) (step 53A). After that, the processor 31 synthesizes the color texture and the specular texture into the 3D model (step 54A). Thereby, a 3D model including specular information is generated.

[0046] <Parentheses> By adopting the specular reading system 1 (see FIG. 1) used in this embodiment, the same effects as in the first embodiment are realized. Furthermore, in the case of this embodiment, it is possible to generate a 3D model with higher accuracy than in the first embodiment.

[0047] <Embodiment 3> <System Configuration> FIG. 15 is a diagram for explaining the schematic configuration of the specular reading system 1 assumed in the third embodiment. In FIG. 15, the corresponding parts to those in FIG. 1 are denoted by the corresponding reference numerals. The specular reading system 1 shown in FIG. 15 is also composed of an imaging system 10, a turntable 20, and a control device 30. However, a light source 11 and a camera 12 are fixedly attached to the turntable 20. That is, in the case of the specular reading system 1 in this embodiment, the light source 11 and the camera 12 image the subject S while making one round around the subject S.

[0048] The turntable 20 in FIG. 15 has an O shape with a hole formed near the center of the disk. The subject S is attached to the space of this hole. The subject S may be attached to a fixed pedestal. Note that the turntable 20 only needs to have a mechanism capable of imaging the subject S from multiple points on the circumference centered on the position where the subject S is attached. Therefore, for example, the turntable 20 may be composed of a pedestal to which the light source 11 and the camera 12 are attached, a circular rail for guiding the pedestal, and a self-propelled mechanism for moving the pedestal along the rail.

[0049] FIG. 16 is a diagram for explaining the positional relationship between the imaging system 10 and the turntable 20. In FIG. 16, the reference numerals corresponding to the corresponding parts in FIGS. 2 and 15 are shown. Similar to FIG. 2, FIG. 16 also shows the positional relationship in the XY plane. Also in the case of FIG. 16, the elliptical subject S is arranged in a state offset with respect to the rotation center O.

[0050] <Overview of processing operation> FIG. 17 is a flowchart for explaining an example of the generation process of the three-dimensional model in the third embodiment. In FIG. 17, the reference numerals corresponding to the corresponding parts in FIG. 4 are shown. In the case of the processing operation shown in FIG. 17, when the step angle is determined in step 2, the processor 31 rotates the turntable 20 to which the light source 11 and the camera 12 are fixed at the step angle determined in step 2, and images the subject S (step 3A). The processing operation after imaging the image of the subject S is the same as that in FIG. 4.

[0051] <Parentheses> Even when imaging the outer peripheral surface of the subject S while relatively moving the imaging system 10 with respect to the subject S as in the gloss reading system 1 (see FIG. 15) used in the present embodiment, it is possible to obtain the same effect as in the first embodiment.

[0052] <Other embodiments> (1) Although the embodiments of the present invention have been described above, the technical scope of the present invention is not limited to the scope described in the above-described embodiments. It is obvious from the description of the claims that those obtained by making various changes or improvements to the above-described embodiments are also included in the technical scope of the present invention.

[0053] (2) In the description of the above-described embodiment, the case where the rotation angle of the turntable 20 is set to the step angle determined in step 2 (see FIG. 4), and after rotating by the step angle, a still image of the subject S is captured has been described. However, a method may be adopted in which the camera 12 is instructed to capture a still image every time the rotation amount of the turntable 20 from the previous imaging position reaches the step angle determined in step 2. Further, when a moving image is output from the camera 12, a method may be adopted in which the capture of a still image is instructed every time the rotation amount of the turntable 20 from the capture position of the previous still image reaches the step angle determined in step 2.

[0054] (3) In the description of the above-described embodiment, the entire circumference of the subject S is set as the range to be observed (hereinafter referred to as the "observation range"). However, only a partial range of the subject S may be set as the observation range. For example, a range of 180° with respect to the rotation center may be set as the observation range. In this case, the maximum outer diameter r0 is determined by limiting it to the observation range instead of the entire circumference of the subject S, and an angular range Θ in which an image including a specular reflection component can be captured may be determined based on the determined maximum outer diameter r0.

[0055] (4) In the description of the above-described embodiment, it is assumed that the light source 11 is a surface light source, but it may be a point light source. Note that the surface light source may be configured as an aggregate of point light sources.

[0056] (5) The processor in the above-described embodiment refers to a processor in a broad sense, and includes a general-purpose processor (for example, a CPU (= Central Processing Unit)) and a dedicated processor (for example, a GPU (= Graphical Processing Unit), an ASIC (= Application Specific Integrated Circuit), an FPGA (= Field Programmable Gate Array), a programmable logic device, etc.). In addition, the operations of the processor in each of the above-described embodiments may be executed by a single processor alone, or may be executed in cooperation by a plurality of processors located at physically separated positions. Also, the order of execution of each operation in the processor is not limited to the order described in each of the above-described embodiments, and may be individually changed.

[0057] <Supplementary Note> (((1))) An information processing system having one or more processors that image a subject from a plurality of directions by rotating an imaging system including a light source for illumination or the subject around a position where the subject is attached as a center point, wherein the one or more processors control the rotation of the imaging system or the subject based on an angular range centered on the center point that enables imaging of a specular reflection component at a point of the maximum distance from the center point to the surface of the subject within the observation range of the subject. (((2))) The information processing system according to (((1))), wherein the rotation angle of the subject or the imaging system by the one or more processors is smaller than the angular range. (((3))) The information processing system according to (((2))), wherein when the one or more processors image an image of the subject as a still image, the one or more processors instruct the rotation angle as the rotation amount of the subject or the imaging system to the next imaging position. (((4))) The information processing system according to (((2))), wherein when the one or more processors image an image of the subject as a still image, when the rotation amount from the previous imaging position reaches the rotation angle, the one or more processors instruct imaging of the next still image. (((5))) The information processing system according to (((2))), wherein when the one or more processors image an image of the subject as a moving image, when the rotation amount from the capture position of the previous still image reaches the rotation angle, the one or more processors instruct capture of the next still image. (((6))) The one or more processors calculate a gloss value based on a plurality of luminance values corresponding to regions in which features related to the shape match among a plurality of images acquired by the imaging system, the information processing system according to any one of ((1)) to ((5)). (((7))) The one or more processors use, as the gloss value, a difference between a maximum luminance value and a diffuse reflection luminance value of a region in which the features related to the shape match, the information processing system according to ((6)). (((8))) The information processing system according to any one of ((1)) to ((7)), wherein a subject is attached to a turntable that rotates about the center point as a rotation center. (((9))) The information processing system according to any one of ((1)) to ((7)), wherein the imaging system is attached to a turntable that rotates about the center point as a rotation center. (((10))) A gloss reading system having an imaging system including a light source for illumination, a turntable that rotates the imaging system or a subject about a center point which is a position where the subject is attached, and one or more processors, wherein the one or more processors control rotation of the imaging system or the subject based on an angular range centered on the center point in which specular reflection components can be imaged at a point of the maximum distance from the center point to the surface of the subject within the observation range of the subject. (((11))) A program for causing a computer that controls a gloss reading system having an imaging system including a light source for illumination and a turntable that rotates the imaging system or a subject about a center point which is a position where the subject is attached to realize a function of controlling rotation of the imaging system or the subject based on an angular range centered on the center point in which specular reflection components can be imaged at a point of the maximum distance from the center point to the surface of the subject within the observation range of the subject.

[0058] According to the information processing system according to ((1)), imaging of an image including a specular reflection component from a subject having an arbitrary shape can be facilitated. According to the information processing system according to ((2)), the specular reflection component can be acquired regardless of the shape and mounting position of the subject. According to the information processing system according to ((3)), a still image including the specular reflection component can be continuously captured. According to the information processing system according to ((4)), a still image including the specular reflection component can be continuously captured. According to the information processing system according to ((5)), a still image including the specular reflection component can be continuously acquired from a moving image. According to the information processing system according to ((6)), the gloss value can be calculated with high precision. According to the information processing system according to ((7)), the gloss value can be calculated with high precision. According to the information processing system according to ((8)), an image including the specular reflection component can be captured while relatively rotating the subject with respect to the imaging system. According to the information processing system according to ((9)), an image including the specular reflection component can be captured while relatively rotating the imaging system with respect to the subject. According to the gloss reading system according to ((10)), compared with the method of acquiring the specular reflection component of the subject through the relative movement of the illumination with respect to the camera, imaging of an image including the specular reflection component from a subject of an arbitrary shape can be facilitated. According to the program according to ((11)), imaging of an image including the specular reflection component from a subject of an arbitrary shape can be facilitated.

Description of Signs

[0059] 1... Gloss reading system, 10... Imaging system, 11... Light source, 12... Camera, 20... Turntable, 30... Control device, 31... Processor, 32... ROM, 33... RAM, 34... Auxiliary storage device, 35... Communication interface, 36... Display, 37... Input receiving device

Claims

1. One or more processors that image a subject from multiple directions by rotating an imaging system including a light source for illumination or the subject, with the position where the subject is attached as the center point, wherein the one or more processors control the rotation of the imaging system or the subject based on an angular range centered on the center point, within which the specular reflection component can be imaged at the point of the maximum distance from the center point to the surface of the subject within the observation range of the subject, an information processing system.

2. wherein the one or more processors rotate the subject or the imaging system by an angle smaller than the angular range, the information processing system according to Claim 1.

3. wherein the one or more processors when imaging an image of the subject as a still image, instruct the rotation angle as the rotation amount to the next imaging position for the subject or the imaging system, the information processing system according to Claim 2.

4. wherein the one or more processors when imaging an image of the subject as a still image, when the rotation amount from the previous imaging position reaches the rotation angle, instruct the imaging of the next still image, the information processing system according to Claim 2.

5. wherein the one or more processors when imaging an image of the subject as a moving image, when the rotation amount from the capture position of the previous still image reaches the rotation angle, instruct the capture of the next still image, the information processing system according to Claim 2.

6. wherein the one or more processors calculate a gloss value based on a plurality of luminance values corresponding to regions where features related to the shape match among a plurality of images acquired by the imaging system, the information processing system according to Claim 1.

7. wherein the one or more processors set the gloss value as the difference between the maximum luminance value and the diffuse reflection luminance value of the region where the features related to the shape match, the information processing system according to Claim 6.

8. wherein the subject is attached to a turntable that rotates about the center point as the center of rotation, the information processing system according to Claim 1.

9. wherein the imaging system is attached to a turntable that rotates about the center point as the center of rotation, the information processing system according to Claim 1.

10. an imaging system including a light source for illumination; a turntable that rotates the imaging system or the subject about the position where the subject is attached as the center point; one or more processors; and having wherein the one or more processors Based on an angular range centered on the center point that enables imaging of the specular reflection component at the point of the maximum distance from the center point to the surface of the subject within the observation range of the subject, controlling the rotation of the imaging system or the subject. A gloss reading system. **Claim 11** In a computer that controls a gloss reading system having an imaging system including a light source for illumination and a turntable that rotates the imaging system or the subject with the position where the subject is attached as the center point, Based on an angular range centered on the center point that enables imaging of the specular reflection component at the point of the maximum distance from the center point to the surface of the subject within the observation range of the subject, a function of controlling the rotation of the imaging system or the subject, A program for realizing the above.

Images