Reflection characteristic recording system, reflection characteristic recording method, and program

Abstract

To provide a reflection characteristic recording system, a reflection characteristic recording method, and a program capable of further reducing a work burden when recording a reflection characteristic.SOLUTION: A reflection characteristic recording system that records a reflection characteristic of a subject from a plurality of captured images in which an irradiation direction of light to the subject is different under a situation where there is ambient light, the reflection characteristic recording system comprising an imaging device that captures the subject, a light source device that irradiates the subject with light of a light source, and a control unit that is provided in the light source device and controls turning on or off of the light source at the time of imaging, the control unit outputs an imaging instruction to the imaging device after the light source is turned on or off, estimates the reflection characteristic of the subject from an image captured by the imaging device, and stores the estimated reflection characteristic in a storage unit.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a reflection characteristic recording system, a reflection characteristic recording method, and a program. [Background technology]

[0002] Conventionally, techniques for reproducing real objects using computer graphics (CG) images have been known. In this regard, Patent Document 1 discloses an apparatus for illuminating a target object from different lighting directions and measuring reflected light in order to record the reflection characteristics of the target object. With this apparatus, photography is performed in a darkroom to obtain only reflected light contributed by illumination from a light source under conditions free from the influence of ambient light. Meanwhile, Patent Document 2 discloses a technique for calculating a flash component image based on an image taken with and without flash light, in order to obtain images equivalent to those taken in a darkroom free from the influence of ambient light in photography environments where it is difficult to create a darkroom. In Patent Document 2, when measuring reflected light, the light source is fixed for each light source position, and two images are taken, one with flash light and one without flash light. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2023-100441 [Patent Document 2] Japanese Patent Application Laid-Open No. 2003-296720 Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, in conventional technology, when a jig or device is used to fix a light source, it becomes difficult to adaptively position the light source according to the size of the subject, the size of the unevenness, the extent of the gloss, etc. Furthermore, although adaptive light source positioning is possible if the user manually moves the light source by holding it in their hand, there is a problem in that manual lighting requires repeated light source operations such as positioning, moving, and fixing the light source, photographing by operating the camera, and checking the photographed results, which can increase the workload of the user.

[0005] In view of the above-mentioned problems, an object of the present invention is to provide a reflection characteristic recording system, a reflection characteristic recording method, and a program that can further reduce the workload when recording reflection characteristics. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems, one aspect of the present invention provides a reflection characteristic recording system that records the reflection characteristics of a subject from multiple captured images in which light is irradiated from different directions onto the subject under conditions of ambient light, and includes a photographing device that photographs the subject, a light source device that irradiates the subject with light from a light source, and a control unit that is provided in the light source device and controls the light source to be turned on or off during photographing, and the control unit outputs a photographing instruction to the photographing device after the light source is turned on or off, and estimates the reflection characteristics of the subject from the images photographed by the photographing device and stores the estimated reflection characteristics in a memory unit.

[0007] Another aspect of the present invention is a reflection characteristic recording system that records the reflection characteristics of a subject from multiple captured images in which light is irradiated from different directions onto the subject under conditions of ambient light, and includes a photographing device that photographs the subject, a light source device that irradiates the subject with light from a light source, and a control unit that is provided in the photographing device and controls the turning on or off of the light source of the light source device during photographing, wherein when a photographing instruction is received, the control unit sends an instruction to the light source device regarding the turning on or off of the light source, and after the light source is turned on or off, the control unit estimates the reflection characteristics of the subject from the images photographed by the photographing device and stores the estimated reflection characteristics in a memory unit.

[0008] A reflection characteristic recording method according to one aspect of the present invention is a reflection characteristic recording method that records the reflection characteristics of a subject from multiple captured images in which light is irradiated from different directions onto the subject under conditions of ambient light, in which an imaging device captures the subject, a light source device irradiates the subject with light from a light source, a control unit of the light source device controls the light source to be turned on or off during imaging, and the control unit outputs an imaging instruction to the imaging device after the light source is turned on or off, and the reflection characteristics of the subject are estimated from the images captured by the imaging device and stored in a memory unit.

[0009] Another aspect of the present invention is a reflection characteristic recording method for recording the reflection characteristics of a subject from a plurality of captured images in which light is irradiated from different directions onto the subject under conditions of ambient light, in which an imaging device captures the subject, a light source device irradiates the subject with light from a light source, a control unit provided in the imaging device controls the turning on or off of a light source of the light source device during imaging, and when an imaging instruction is accepted, the control unit sends an instruction to the light source device regarding the turning on or off of the light source, and after the light source is turned on or off, the reflection characteristics of the subject are estimated from the images captured by the imaging device and stored in a memory unit.

[0010] A program according to one aspect of the present invention is a program for recording the reflection characteristics of a subject from a plurality of images taken in which the direction of light illumination onto the subject is different under conditions of ambient light, and causes a computer to function as an imaging device that images the subject, a light source device that irradiates the subject with light from a light source, and a control unit provided in the light source device that controls the light source to be turned on or off during imaging, wherein the control unit outputs an imaging instruction to the imaging device after the light source is turned on or off, and estimates the reflection characteristics of the subject from the images taken by the imaging device and stores the estimated characteristics in a memory unit.

[0011] Another aspect of the present invention is a program for recording the reflection characteristics of a subject from a plurality of captured images in which the direction of light illumination onto the subject is different under conditions of ambient light, and causes a computer to function as a photographing device that photographs the subject, a light source device that illuminates the subject with light from a light source, and a control unit provided in the photographing device that controls the turning on or off of the light source of the light source device during photographing, wherein the control unit, when receiving a photographing instruction, sends an instruction to the light source device regarding the turning on or off of the light source, and after the light source is turned on or off, estimates the reflection characteristics of the subject from the images photographed by the photographing device and stores the estimated reflection characteristics in a memory unit. [Effects of the Invention]

[0012] According to the present invention, the workload involved in recording reflection characteristics can be further reduced. [Brief explanation of the drawings]

[0013] [Figure 1] FIG. 1 is a diagram illustrating an example of a system configuration of a reflection characteristic recording system 1 according to a first embodiment. [Figure 2] FIG. 2 is a diagram illustrating an example of a functional configuration of the camera device 100 according to the first embodiment. [Figure 3] FIG. 2 is a diagram illustrating an example of a functional configuration of a light source device 200 according to the first embodiment. [Figure 4]FIG. 2 is a sequence diagram showing an example of processing executed by the reflection characteristic recording system 1 of the first embodiment. [Figure 5] FIG. 10 is a diagram illustrating an example of a functional configuration of a camera device 100A according to a second embodiment. [Figure 6] FIG. 10 is a sequence diagram showing an example of processing executed by the reflection characteristic recording system 1 of the second embodiment. [Figure 7] FIG. 10 is a diagram showing an example of the system configuration of a reflection characteristic recording system 1A according to a third embodiment. [Figure 8] FIG. 11 is a sequence diagram showing an example of a first process executed by a reflection characteristic recording system 1A according to a third embodiment. [Figure 9] FIG. 11 is a sequence diagram showing an example of a second process executed by the reflection characteristic recording system 1A of the third embodiment. [Figure 10] FIG. 10 is a diagram showing an example of the system configuration of a reflection characteristic recording system 1B according to a fourth embodiment. [Figure 11] FIG. 2 is a diagram illustrating an example of a functional configuration of an image processing device 300. [Figure 12] FIG. 11 is a sequence diagram showing an example of processing executed by a reflection characteristic recording system 1B according to a fourth embodiment. [Figure 13] FIG. 10 is a diagram illustrating the second image processing. [Figure 14] FIG. 10 is a diagram illustrating the third image processing. [Figure 15] FIG. 10 is a diagram illustrating a fourth image processing. [Figure 16] FIG. 13 is a diagram showing an example of the system configuration of a reflection characteristic recording system 1C according to a fifth embodiment. [Figure 17] FIG. 13 is a diagram illustrating an example of a functional configuration of a camera device 100B according to a fifth embodiment. [Figure 18] FIG. 10 is a diagram illustrating an example of a functional configuration of a light source device 200A according to a fifth embodiment. [Figure 19] FIG. 10 is a diagram showing an example of an image displayed on a light source device 200A according to a fifth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0014] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of a reflection characteristic recording system, a reflection characteristic recording method, and a program according to the present invention will be described in detail with reference to the accompanying drawings.

[0015] First Embodiment Fig. 1 is a diagram showing an example of the system configuration of a reflection characteristic recording system 1 according to the first embodiment. The reflection characteristic recording system 1 shown in Fig. 1 includes a camera device (photographing device) 100 and a light source device (illumination device) 200. The camera device 100 and the light source device 200 can communicate with each other via a network NW. The network NW includes, for example, a Wi-Fi network, Bluetooth (registered trademark), the Internet, a cellular network, a LAN (Local Area Network), a WAN (Wide Area Network), etc.

[0016] In the first embodiment, the camera device 100 is installed in a position directly facing (in front of) the subject OB1. The subject OB1 is an object from which information on the reflection characteristics of light (reflection characteristic information) is to be acquired, and may be a planar or three-dimensional object. The reflection characteristic information includes, for example, specular reflectance, diffuse reflectance, normal, and the like. The reflection characteristics differ depending on, for example, the material and shape of the subject, the degree of surface irregularity, and the like.

[0017] In the first embodiment, camera device 100 receives an instruction from light source device 200 with which it can communicate, captures an image of a predetermined area including subject OB1 in front of it, and stores the captured image in a storage unit. Note that camera device 100 captures images of subject OB1 in two states: one in which light source light LG1 is irradiated from light source device 200 onto subject OB1, and one in which light LG1 is not irradiated, under ambient light conditions, for example. Camera device 100 also captures multiple images in which light LG1 is irradiated onto subject OB1 in different directions.

[0018] The light source device 200 has a light source unit that emits a predetermined light LG1. The light source device 200 irradiates the light LG1 onto the subject OB1 from a plurality of different directions, mainly as the user moves. In the reflection characteristic recording system 1, the camera device 100 and the light source device 200 communicate with each other via a communication unit, and the camera device 100 captures an image according to the irradiation state of the light LG1.

[0019] Next, the functional configurations of the camera device 100 and the light source device 200 in the first embodiment will be described. Fig. 2 is a diagram showing an example of the functional configuration of the camera device 100 in the first embodiment. The camera device 100 shown in Fig. 2 includes, for example, a communication unit 110, an imaging unit 120, a display unit 130, a reflection characteristic estimation unit 140, a control unit 150, and a storage unit 160.

[0020] The communication unit 110 communicates with the light source device 200 and other external devices via the network NW. The photographing unit 120 is, for example, a digital camera that uses a solid-state image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). The photographing unit 120 may also be a stereo camera. The photographing unit 120 photographs an image including an object OB1 present within the angle of view under the control of the control unit 150. The image photographed by the photographing unit 120 is stored in the storage unit 160 as image information 162.

[0021] The display unit 130 is, for example, any of various display devices such as an LCD (Liquid Crystal Display), an organic EL (Electro Luminescence) display, etc. Under the control of the control unit 150, the display unit 130 displays an image (preview image) that exists within the angle of view before being captured by the capturing unit 120, or a captured image (captured image).

[0022] The reflection characteristic estimation unit 140 estimates the reflection characteristics of the object OB1 using a known method based on the image information 162 captured by the image capturing unit 120. For example, the reflection characteristic estimation unit 140 captures a reflected light image of light emitted by the light source device 200 (illumination unit) and reflected by the object OB1, and estimates the diffuse reflectance from the reflected light image using a Lambertian reflection model and the specular reflectance from the Phong reflection model. The reflection characteristic estimation unit 140 also estimates the normal (surface normal) of the object OB1 and the normal distribution of the entire object region based on the physical behavior of the light reflected by the object OB1 obtained from the reflected light image. The reflection characteristic estimation unit 140 may also estimate brightness and glossiness from the reflected light image. The reflection characteristic estimation unit 140 estimates each piece of estimated information as reflection characteristic information.

[0023] Furthermore, the reflection characteristic estimation unit 140 may estimate the reflection characteristics using the method of Patent Document 1 (JP 2023-100441 A). In this case, the reflection characteristic estimation unit 140 estimates, as reflection characteristic information, the glitter reflectance due to the luminous material, the clear coat reflectance due to the clear coat layer applied on the surface of the luminous material, color shift information indicating flip-flop due to the luminous material, and the like, based on the reflection components obtained from the reflected light image.

[0024] The reflection characteristic estimation unit 140 can obtain more accurate reflection characteristic information by subtracting images of the object OB1 captured when the light source is on and when it is off, and using a reflected light image from which the effects of light sources other than the light source, such as ambient light, have been removed. The reflection characteristic estimation unit 140 may also estimate the reflection characteristics using a method other than the above-described method. The reflection characteristics estimated by the reflection characteristic estimation unit 140 are stored in the storage unit 160 as reflection characteristic information 164, thereby recording the reflection characteristics of the object OB1. This reflection characteristic information 164 is used, for example, when reproducing the object OB1 as a three-dimensional CG image.

[0025] The control unit 150 controls the overall components of the camera device 100. For example, the control unit 150 operates the image capturing unit 120 based on information received via the communication unit 110, causes the display unit 130 to display an image (for example, the captured image IM10 shown in FIG. 1 ), and causes the reflection characteristic estimation unit 140 to estimate reflection characteristics. The control unit 150 also stores the acquired information in a storage unit and transmits it to an external device via the communication unit 110.

[0026] The storage unit 160 may be realized by, for example, a hard disk drive (HDD), a solid state drive (SSD), an electrically erasable programmable read only memory (EEPROM), a read only memory (ROM), or a random access memory (RAM), etc. The storage unit 160 stores, for example, image information 162, reflection property information 164, programs, and various other information.

[0027] 3 is a diagram showing an example of the functional configuration of the light source device 200 of the first embodiment. The light source device 200 shown in FIG. 3 includes, for example, a communication unit 210, a light source unit 220, an instruction receiving unit 230, a notification unit 240, and a control unit 250.

[0028] The communication unit 210 communicates with the camera device 100 and other external devices via the network NW. The light source unit 220 turns on (emits light) or off (does not emit light) in response to an instruction from the user or an instruction from the camera device 100. The light source is, for example, an LED (Light Emitting Diode), but may also be a strobe light source (flash light).

[0029] The instruction receiving unit 230 receives an instruction from the user to turn on (or turn off) the light source, or an instruction to capture an image to the camera device 100. The instruction receiving unit 230 may receive an instruction via a switch, button, or the like provided on the light source device 200, or may receive an instruction via a GUI (Graphical User Interface) switch or the like displayed on the display unit 242 of the light source device 200. The instruction receiving unit 230 may also be provided with a microphone or the like capable of receiving voice instructions.

[0030] The notification unit 240 notifies the user of information indicating that image capture has been completed by the camera device 100. The notification unit 240 includes, for example, a display unit 242 and a speaker 244. The display unit 242 is, for example, any of various display devices such as an LCD or an organic EL display. The display unit 242 may also be a touch panel that also has the function of the instruction receiving unit 230. For example, under the control of the control unit 250, the notification unit 240 notifies the user by causing the display unit 242 to display an image or the like indicating that image capture has been completed, or by causing the speaker 244 or the like to output a sound indicating that image capture has been completed.

[0031] The control unit 250 controls the overall components of the light source device 200. For example, based on information received by the communication unit 210 and information accepted by the instruction acceptance unit 230, the control unit 250 controls the light source unit 220 to turn on or off the light source, causes the display unit 242 to display an image, causes the speaker 244 to output sound, and transmits predetermined information to an external device via the communication unit 110.

[0032] <Processing sequence in the first embodiment> FIG. 4 is a sequence diagram showing an example of processing executed by the reflection characteristic recording system 1 of the first embodiment. The example of FIG. 4 shows the flow of processing in the camera device 100 and the light source device 200. In the example of FIG. 4, when the instruction receiving unit 230 of the light source device 200 receives a shooting instruction from a user (step S100), it turns off the light source of the light source unit 220 (step S102). Note that if the light source has already been turned off before the shooting instruction is received, the processing of step S102 does not need to be executed. Next, the control unit 250 of the light source device 200 transmits a shooting instruction to the camera device 100 via the communication unit 210 after turning off the light (step S104).

[0033] When the camera device 100 receives a shooting instruction from the light source device 200, it shoots an image including the subject OB1 (step S106). Next, the control unit 150 transmits information indicating that shooting has been completed (shooting completion notification) to the light source device 200 (step S108). When the control unit 250 of the light source device 200 receives the shooting completion notification from the camera device 100, it turns on the light source of the light source unit 220 (step S110), irradiates the subject OB1 with light LG1 from the light source, and after turning on the light, transmits a shooting instruction to the camera device 100 via the communication unit 210 (step S112).

[0034] The control unit 150 of the camera device 100 captures an image of an area including the object OB1 (step S114) and transmits an image capture completion notification to the light source device 200 (step S116). Next, the notification unit 240 of the light source device 200 notifies the user by outputting information (at least one of an image and a sound) indicating that image capture has been completed (step S118). Note that the processes of steps S100 to S118 are repeatedly performed while the user moves the light source device 200, thereby capturing images of the object OB1 irradiated with light LG1 from a plurality of different directions.

[0035] Next, the reflection characteristic estimation unit 140 of the camera device 100 estimates reflection characteristics using a difference image between the two images captured in the processes of steps S106 and S114 (step S120). Specifically, in the process of step S120, an image without ambient light (equivalent to a darkroom) is obtained from the difference image between the image with the light source turned off and the image with the light source turned on for each position (each illumination direction) of the light LG1, and reflection characteristics such as specular reflectance, diffuse reflectance, normal, etc. of the entire area of ​​the subject OB1 are estimated based on the difference images at different light positions. In addition, the reflection characteristic estimation unit 140 stores and records the estimated reflection characteristic information 164 in the storage unit 160 (step S122). This completes the sequence process shown in FIG. 4.

[0036] In the first embodiment, the user may issue a shooting instruction by voice, rather than by a switch, button, or the like. In this case, the control unit 250 of the light source device 200 performs a known voice recognition process on voice data input via the microphone of the instruction receiving unit 230, and when predetermined characters such as "start shooting" are extracted from the character analysis results after the voice recognition process, the control unit 250 controls other components, etc., regarding the shooting instruction as having been accepted. By accepting a voice instruction, it is possible to suppress hand shake of the light source caused by operating a switch, button, etc., and therefore it is possible to take a picture while holding the light source device 200 in an appropriate position.

[0037] 4, the order of turning off and on may be reversed. In the first embodiment, instead of photographing with light source device 200 turned off and on for each light source position, photographing of subject OB1 with light source device 200 turned off may be performed in advance, and then photographing may be performed while changing the position (illumination direction) of the light source with light source device 200 always turned on.

[0038] According to the first embodiment described above, the user can issue a shooting instruction to the light source device 200 at hand, and can therefore shoot the subject OB1 with the light source turned off and on while holding the light source device 200 by finely adjusting the position and angle of the light source device 200. Furthermore, according to the first embodiment, the user can shoot without moving to the position of the camera device 100 and issuing an instruction. This further reduces the workload involved in recording the reflection characteristics of the subject OB1.

[0039] Second Embodiment Next, a second embodiment of the reflection characteristic recording system will be described. The second embodiment differs from the first embodiment in that the user's shooting instructions are received by the camera device 100, not by the light source device 200. In this case, since the user is likely to be located far away from the camera device 100, the camera device 100 receives the shooting instructions by voice. The following description will mainly focus on the differences from the first embodiment.

[0040] Fig. 5 is a diagram showing an example of the functional configuration of camera device 100A of the second embodiment. Camera device 100A shown in Fig. 5 includes, for example, communication unit 110, image capturing unit 120, display unit 130, reflection characteristic estimation unit 140, control unit 150A, storage unit 160, and voice reception unit 170. Camera device 100A differs from camera device 100 of the first embodiment in that it has control unit 150A instead of control unit 150, and further has voice reception unit 170. Therefore, the following description will mainly focus on control unit 150A and voice reception unit 170.

[0041] The voice receiving unit 170 is, for example, a microphone, and collects surrounding sounds using the microphone. In addition to performing the same processing as the control unit 150 of the first embodiment, the control unit 150A also performs known voice recognition processing on the voice data collected by the voice receiving unit 170. Furthermore, when predetermined characters such as "start shooting" are extracted from the character analysis results after the voice recognition processing, the control unit 150A communicates with the light source device 200 and photographs the subject OB1 with the light source device 200 in an off state and an on state.

[0042] In the second embodiment, the light source device 200 may have the same functional configuration as the light source device 200 of the first embodiment, and may not have the instruction receiving unit 230.

[0043] <Processing sequence in the second embodiment> Fig. 6 is a sequence diagram showing an example of processing executed by the reflection characteristic recording system 1 of the second embodiment. The processing in Fig. 6 differs from that of steps S100 to S122 in the reflection characteristic recording system 1 of the first embodiment described above in that steps S200 to S204 are included instead of step S100. Therefore, the following description will mainly focus on the processing of steps S200 to S204.

[0044] In the example of FIG. 6, when the user utters a voice corresponding to a shooting instruction such as "start shooting," the voice receiving unit 170 of the camera device 100A receives the voice uttered by the user (step S200). Next, the control unit 150A performs a voice recognition process on the received voice (step S202). Next, when the control unit 150A recognizes a shooting instruction from the voice recognition process result, it issues a light source device 200 an extinguishing instruction (step S204). The light source device 200 receives the extinguishing instruction from the camera device 100A and turns off the light source of the light source unit 220 (step S102), and then executes the processes from step S104 onwards described above.

[0045] 6, the order of turning the light on and off may be reversed, as in the first embodiment. Furthermore, in the second embodiment, camera device 100A notifies the user that image capture has been completed through light source device 200. However, if camera device 100A has a speaker (not shown) or the like within it, camera device 100A may notify the user that image capture has been completed by outputting a sound from camera device 100A notifying the user that image capture has been completed, or by displaying an image indicating the end of image capture on display unit 242. Furthermore, in the second embodiment, image capture is performed with light source device 200 in an off state or an on state for each light source position. However, image capture may be performed in advance with light source device 200 in an off state, and then image capture may be performed while changing the position (illumination direction) of the light source with light source device 200 always on.

[0046] As described above, according to the second embodiment, the user can give voice instructions to the camera device 100A to take a photograph, and after the instruction is given, the camera device 100A and the light source device 200 communicate (link) with each other to take photographs of the subject OB1 in both the off state and the on state, thereby reducing the workload on the user when recording the reflection characteristics.

[0047] <Third embodiment> Next, a third embodiment of the reflection characteristic recording system will be described. The third embodiment differs from the first and second embodiments in that an image acquired from camera device 100 (or 100A) is displayed on display unit 242 on light source device 200 side. The image acquired from camera device 100 (or 100A) includes, for example, at least one of a preview image, a captured image, and a processed image.

[0048] FIG. 7 is a diagram illustrating an example of a system configuration of a reflection characteristic recording system 1A according to a third embodiment. In the third embodiment, as illustrated in FIG. 7, an image IM10 related to the image capture is displayed on the display unit 130 of the camera device 100, and an image IM20 acquired from the camera device 100 is also displayed on the display unit 242 of the light source device 200. The images IM10 and IM20 may be preview images before the image capture (more specifically, before the image for estimating the reflection characteristic is captured), captured images (images for estimating the reflection characteristic), or processed images after various image processing operations described below have been performed. The reflection characteristic recording system 1A according to the third embodiment may use the same camera device 100 and light source device 200 as those in the first embodiment, or the same camera device 100 and light source device 200 as those in the second embodiment.

[0049] In the third embodiment, when an instruction to acquire a preview image is accepted by the instruction accepting unit 230, the control unit 250 of the light source device 200 communicates with the camera device 100 to acquire the preview image and provide (notify) the user. The instruction to acquire the preview image may be an instruction from a switch (including a GUI switch) or a button, or may be an audio instruction such as "get preview." Furthermore, when an instruction to capture a picture is accepted by the instruction accepting unit 230, the control unit 250 communicates with the camera device 100 to acquire the captured image and provide (notify) the user.

[0050] <Processing sequence in the third embodiment> Fig. 8 is a sequence diagram showing an example of a first process executed by reflection characteristic recording system 1A of the third embodiment. The example of Fig. 8 shows a flow of processes by camera device 100 and light source device 200. In the first process, a preview image in the third embodiment is displayed on light source device 200. In the example of Fig. 8, control unit 250 of light source device 200 receives an instruction to display a preview image from a user (step S300), turns on the light source using light source unit 220 (step S302), and then transmits an instruction to acquire the preview image to camera device 100 via communication unit 210 (step S304).

[0051] Next, upon receiving the instruction to acquire a preview image from light source device 200, control unit 150 of camera device 100 performs preview shooting of subject OB1 (step S306) and transmits the preview image of the photographed subject OB1 to light source device 200 (step S308). Light source device 200 receives the preview image transmitted from camera device 100 and displays the received preview image on display unit 242 (step S310), thereby notifying (providing) the preview image to the user (step S312). This allows the user to irradiate a desired position with light LG1 and perform shooting while checking the preview image.

[0052] FIG. 9 is a sequence diagram illustrating an example of a second process executed by the reflection characteristic recording system 1A of the third embodiment. In the second process, an image captured by the camera device 100 is displayed on the light source device 200. In the example of FIG. 9, the processes of steps S320 to S334 are similar to the processes of steps S100 to S114 in the first embodiment described above, and therefore, a description of the processes of steps S320 to S334 will be omitted. After capturing an image in the process of step S334, the camera device 100 transmits the captured image and a capture completion notice to the light source device 200 (step S336). Note that the captured image may be an image captured in a lit state in the process of step S334, an image captured in an unlit state in the process of step S326, or both, or a differential image obtained by taking the difference between the two images. Furthermore, the captured image may be an image captured repeatedly while the user moves the light source device 200.

[0053] When light source device 200 acquires a captured image, it displays the captured image on display unit 242 (step S338) and provides the image to the user (step S340). Note that in the example of FIG. 9, camera device 100 may perform a process of estimating reflection characteristics and storing and recording estimated reflection characteristic information 164 in storage unit 160, similar to the processes of steps S120 to S122 in the first embodiment. Furthermore, when performing the second process, the display of the preview image displayed on display unit 242 by the first process is terminated. This makes it possible to prevent light (display light) emitted when the preview image is displayed from affecting the image capture.

[0054] In the examples of FIGS. 9 and 10 described above, the light source device 200 receives preview instructions and shooting instructions, but the camera device 100 may receive them as in the second embodiment.

[0055] According to the third embodiment, by displaying a preview image on the light source device 200, it is possible to confirm the position (reflection area) of gloss generated on the surface of the subject OB1 by the light source unit 220 of the light source device 200. This makes it possible to grasp the difference between the position of gloss according to the line of sight when actually viewing the subject OB1 from the user's position and the position of gloss as seen from the camera device 100, and therefore it is possible to change the position and orientation of the light source device 200 to capture a more desired gloss position. Furthermore, according to the third embodiment, it is possible to confirm on the display unit 242 of the light source device 200 at hand, without having to go to the camera device 100 to confirm, that the captured image has been obtained at the desired gloss position, thereby reducing the burden on the user due to movement, etc.

[0056] <Fourth embodiment> Next, a fourth embodiment of the reflection characteristic recording system will be described. In the fourth embodiment, an image obtained from the camera device 100 is subjected to predetermined image processing by another device (for example, an image processing device), and the processed image is provided to a user.

[0057] Fig. 10 is a diagram showing an example of a system configuration of a reflection characteristic recording system 1B according to the fourth embodiment. The reflection characteristic recording system 1B includes, for example, a camera device 100, a light source device 200, and an image processing device 300. In the example of Fig. 10, the camera device 100 and the image processing device 300 are communicably connected via a network NW, but the light source device 200 and the image processing device 300 may also be connected via the network NW. The image processing device 300 may be, for example, a general-purpose server device or a PC (Personal Computer), or may be a cloud server configured by cloud computing including one or more information processing devices.

[0058] The image processing device 300 receives images captured by the camera device 100 via the network NW, performs various image processing to assist the user in capturing images, and provides the images to the user. FIG. 11 is a diagram showing an example of the functional configuration of the image processing device 300. The image processing device 300 shown in FIG. 11 includes, for example, a communication unit 310, an image processing unit 320, an image generation unit 330, a provision unit 340, a control unit 350, and a storage unit 360. The communication unit 310 communicates with, for example, the camera device 100 or other external devices via the network NW. The communication unit 310 may also communicate with the light source device 200 via the network NW.

[0059] The image processing unit 320 stores images acquired from the camera device 100 via the network NW in the storage unit 360 as image information 362. The image processing unit 320 also acquires a plurality of images of the subject OB1 captured by the camera device 100 in different irradiation directions of the light LG1 emitted by the light source device 200, and generates various processed images based on the acquired images. Specific examples of image processing by the image processing unit 320 will be described later.

[0060] Based on the processed image processed by the image processing unit and other information, the image generation unit 330 generates an image to be displayed on the light source device 200. The image generated by the image generation unit 330 is stored in the storage unit 360 as a processed image 364.

[0061] The providing unit 340 transmits the image generated by the image generating unit 330 to at least one of the camera device 100 and the light source device 200 via the network NW, and provides it to the user.

[0062] The control unit 350 controls the overall components of the image processing device 300. For example, based on information received via the communication unit 310, the control unit 350 controls image processing by the image processing unit 320, image generation by the image generation unit 330, and information provision by the provision unit 340. The control unit 350 also controls transmission of information to an external device via the communication unit 310 and storage of information in the storage unit 360.

[0063] The storage unit 360 may be realized by, for example, an HDD, an SSD, an EEPROM, a ROM, or a RAM, etc. The storage unit 360 stores, for example, image information 362, a processed image 364, a program, and various other information.

[0064] <Processing sequence in the fourth embodiment> FIG. 12 is a sequence diagram illustrating an example of processing executed by the reflection characteristic recording system 1B of the fourth embodiment. The example of FIG. 12 illustrates a processing flow by the camera device 100, the light source device 200, and the image processing device 300. In the example of FIG. 12, when the light source device 200 receives a shooting instruction from a user (step S400), it turns off the light source of the light source unit 220 (step S402), and after turning off the light source, it issues a shooting instruction to the camera device 100 (step S404). The camera device 100 receives the shooting instruction from the light source device 200, captures an image including the subject OB1 (step S406), and transmits the captured image to the image processing device 300 (step S408). The camera device 100 also transmits a shooting completion notification to the light source device 200 (step S410).

[0065] Next, the light source device 200 receives a shooting instruction from the camera device 100, turns on the light source unit 220 (step S412), and after turning on, transmits the shooting instruction to the camera device 100 (step S414). The camera device 100 receives the shooting instruction, captures an image including the subject OB1 (step S416), and transmits the captured image to the image processing device 300 (step S418).

[0066] Next, the image processing unit 320 of the image processing device 300 performs predetermined image processing, which will be described later (step S420). Next, the image generation unit 330 generates a processed image (step S422). Next, the provision unit 340 transmits the generated processed image to the camera device 100 (step S424). The camera device 100 receives the processed image from the image processing device 300, and transmits the received image and a shooting completion notice to the light source device 200 (step S426). Note that the camera device 100 may display the received processed image on the display unit 130 of the camera device 100. The light source device 200 receives the processed image and shooting completion notice from the camera device 100, and displays the processed image on the display unit 242 (step S428), thereby notifying the user (and providing the image) (step S430). This ends the processing of this sequence.

[0067] In the example of FIG. 12 described above, the light source device 200 receives the shooting instruction, but the camera device 100 may receive the instruction as in the second embodiment.

[0068] <Image processing content> Next, the image processing by the image processing unit 320 and the image generating unit 330 of the fourth embodiment will be explained using several specific examples.

[0069] (First image processing) For example, as the first image processing, the image processing unit 320 acquires an image in an off state by the light source device 200 and an image in an on state, and generates a differential image by subtracting each pixel from each image. The image processing unit 320 also estimates the reflection characteristics in the same way as the reflection characteristic estimation unit 140. In this case, the camera device 100 does not need to have the function of the reflection characteristic estimation unit 140.

[0070] As a first image processing, the image generation unit 330 may generate an image for providing the user with reflection property information. The image generation unit 330 may generate an image showing past reflection property information using reflection property information stored in the storage unit, or may perform statistical processing on past reflection properties to generate an image showing the statistical results. This allows the user to compare the reflection property of the subject OB1 obtained from the captured image in the current environment with the past reflection property or the reflection property obtained from the statistical results, and identify areas (locations) with low accuracy. The user may also obtain more accurate reflection property information by irradiating a light source onto the area with low accuracy and capturing an image, and then estimating the reflection property using the captured image. This also allows for more efficient recording of reflection properties.

[0071] (Second image processing) For example, as the second image processing, the image processing unit 320 performs an enhancement process in which only pixels whose pixel values ​​are equal to or greater than a threshold value (first threshold value) are enhanced in the above-mentioned difference image or the image captured with the light source turned on. The image generating unit 330 generates an image (enhanced image) after the enhancement process. FIG. 13 is a diagram for explaining the second image processing. The example of FIG. 13 shows a group of multiple captured images captured while the user manually moves the light source device 200 with respect to the subject OB1 and irradiates the subject OB1 with light LG1 from different positions and directions. This group of captured images may also be a group of differential images. The image processing unit 320 performs an enhancement process on each of the captured images, in which pixels whose pixel values ​​(e.g., luminance) are equal to or greater than a threshold value (first threshold value) are expressed in binary, with pixels whose pixel values ​​are less than the threshold value expressed as white and black, respectively, for each pixel in the color image. The image generating unit 330 generates the images after the enhancement process as a group of enhanced images. This makes it possible to generate a group of enhanced images in which areas where the light source reflects and appears glossy (glossy areas) are more clearly expressed. This reflective area (white area) reflects a large amount of light, making it easier to estimate the reflective characteristics more accurately.

[0072] (Third Image Processing) Furthermore, as a third image processing, in addition to the second image processing described above, the image processing unit 320 synthesizes (superimposes on each pixel) the highlighted images to extract areas where a glossy area has not been acquired (or areas where a glossy area has been acquired). Furthermore, the image generating unit 330 generates an image that allows discrimination between areas where a glossy area has not been acquired and areas where a glossy area has been acquired.

[0073] FIG. 14 is a diagram illustrating the third image processing. In the example of FIG. 14, glossy areas GA obtained from a group of enhanced images including multiple enhanced images are superimposed to generate a composite image IM30. Using the composite image IM30, areas where pixel values ​​(e.g., average pixel value or maximum pixel value) are less than a threshold (second threshold) are designated as areas where glossiness has not been captured (gloss-uncaptured areas), and images IM31 and IM32 are superimposed on the areas in a display manner (shaded areas in the example of FIG. 14) that can be distinguished from other areas. Displaying this composite image IM30 (processed image) on the display unit of the camera device 100 or the light source device 200 allows the user to more clearly recognize the gloss-uncaptured areas (or gloss-captured areas). This allows the user to move the light source device 200 to capture glossy images of areas where glossiness has not been captured, thereby more efficiently acquiring glossy images of the entire object OB1 and further reducing the user's workload when recording reflection characteristics.

[0074] In the third image processing, a group of photographed images may be used instead of the group of highlighted images. Furthermore, in the third image processing, instead of displaying the glossy unphotographed area so as to be distinguishable from other areas, a glossy photographed area may be displayed so as to be distinguishable from other areas.

[0075] (4th Image Processing) Furthermore, as a fourth image processing, the image processing unit 320 estimates the extent of gloss in the shooting environment from the glossy area of ​​the highlighted image, and estimates the remaining number of times to shoot the glossy unphotographed area based on the estimated extent of gloss.

[0076] Fig. 15 is a diagram for explaining the fourth image processing. As shown in Fig. 15, the image processing unit 320 acquires, for example, a circular shape CC that surrounds (covers) the glossy area GA of the enhanced image IM40. This circular shape CC is a reference shape for the glossy area GA and is an index value that indicates the size of the glossy area GA (extent of gloss spread) that can be acquired in one shooting under the same shooting environment. Then, the image processing unit 320 places the acquired circular shape CC in the glossy unphotographed area (images IM31 and IM32) of the composite image IM30, and estimates how many more times shooting is required to capture the glossy area over substantially the entire surface of the subject OB1.

[0077] Specifically, the image processing unit 320 arranges circular CCs on the composite image IM30 so that the overlapping area is equal to or less than a predetermined amount, and estimates the number of times to capture images so that the glossy unphotographed area is equal to or less than the processing amount. The image generation unit 330 generates an image IM50 based on the estimation result (for example, an image showing the number of remaining images to be captured in the glossy unphotographed area as shown in FIG. 15, or an image in which circular CCs are arranged in the glossy unphotographed area). By displaying this image on the display unit 242 of the camera device 100 or the light source device 200, the remaining number of images to be captured can be displayed, thereby improving work time management and efficiency.

[0078] In the fourth image processing described above, the glossy area not yet photographed and the number of photographs were estimated from multiple enhanced images, but they may also be estimated for a single enhanced image. Also, the glossy area not yet photographed and the remaining number of photographs were estimated from the enhanced image, but they may also be estimated from the photographed image. Furthermore, the shape surrounding the glossy area is not limited to a circle, and other shapes such as a rectangle or an ellipse may also be used.

[0079] At least a part of the functions of the image processing device 300 in the fourth embodiment may be provided in the camera device 100 or the light source device 200.

[0080] According to the fourth embodiment, it is possible to provide images that assist the user in their work with captured images. For example, by performing image processing on a group of images captured by the camera device 100 in different lighting directions and providing the processed images to the user, it is possible to help the user recognize from which direction the light LG1 should be irradiated onto the subject OB1, and to help the user understand how many more captures are required. This further reduces the workload on the user when recording reflection characteristics.

[0081] Fifth Embodiment Next, a fifth embodiment of the reflection characteristic recording system will be described. In the fifth embodiment, camera device 100 (100A) or light source device 200 generates an image that assists a user in a task and provides the image to light source device 200.

[0082] Fig. 16 is a diagram illustrating an example of a system configuration of a reflection characteristic recording system 1C according to a fifth embodiment. The reflection characteristic recording system 1C illustrated in Fig. 16 includes, for example, a camera device 100B and a light source device 200A. In the example of Fig. 16, the light source device 200A is provided with a posture sensor, and when displaying an image on the display unit 242, the light source device 200A displays an image of the subject OB1 (for example, the preview image, captured image, or processed image) that corresponds to the posture of the camera device 100B. For example, the light source device 200A displays an image IM60 that has been rotated so that its orientation matches the orientation (direction) of the subject OB1 in the image IM10 captured by the camera device 100B.

[0083] Fig. 17 is a diagram showing an example of the functional configuration of camera device 100B according to the fifth embodiment. Camera device 100B shown in Fig. 17 includes, for example, communication unit 110, image capturing unit 120, display unit 130, reflection property estimation unit 140, control unit 150B, storage unit 160, and attitude sensor 180. Camera device 100B differs from camera device 100 according to the first embodiment in that it includes control unit 150B instead of control unit 150, and further includes attitude sensor 180. Therefore, the following description will mainly focus on control unit 150B and attitude sensor 180.

[0084] The attitude sensor 180 is a sensor for detecting information related to the attitude of the fixed camera device 100B. The attitude sensor 180 includes, for example, an orientation sensor that detects the orientation of the front direction of the camera device 100B, and an inclination sensor that detects the inclination of the camera device 100B. The attitude sensor 180 detects information related to the direction and inclination of the camera device 100B as information related to the attitude.

[0085] The control unit 150B performs the same control as the control unit 150 described above, and also transmits information relating to the attitude of the camera device 100B detected by the attitude sensor 180 to the light source device 200A.

[0086] Fig. 18 is a diagram showing an example of the functional configuration of a light source device 200A according to the fifth embodiment. The light source device 200A shown in Fig. 18 includes, for example, a communication unit 210, a light source unit 220, an instruction receiving unit 230, a notification unit 240, and a control unit 250A. The light source device 200A differs from the light source device 200 according to the first embodiment in that it includes a control unit 250A instead of the control unit 250, and further includes an attitude sensor 260. Therefore, the following description will mainly focus on the control unit 250A and the attitude sensor 260.

[0087] The attitude sensor 260 is a sensor for detecting information relating to the attitude of the light source device 200A. The attitude sensor 260 includes, for example, an orientation sensor for detecting the orientation of the front direction of the light source device 200A, an inclination sensor for detecting the inclination, etc. The attitude sensor 260 detects information relating to the direction and inclination of the light source device 200A as information relating to the attitude.

[0088] In addition to performing the same control as the control unit 250 described above, the control unit 250A compares information about the attitude of the camera device 100B received from the camera device 100B with information about the attitude of the light source device 200A detected by the attitude sensor 260, and performs adjustments such as image rotation so that the image displayed on the display unit 242 has the same orientation (attitude) as the image captured by the camera device 100B, regardless of the attitude of the light source device 200A. For example, the control unit 250A performs adjustments so that the upper side (upper side in the XZ plane) of the subject OB1 included in the image captured by the camera device 100B is always the upper side (upper side in the XZ plane) of the image IM60 displayed on the display unit 242, even if the light source device 200A is rotated. The rotation of the image IM60 to be displayed may be a rotation on a two-dimensional plane based on the direction of the camera device 100B as described above, a rotation in three-dimensional space according to the tilt of the camera device 100B in three-dimensional space, or a rotation when the tilt in three-dimensional space is projected onto a two-dimensional plane.

[0089] This allows the shooting direction of the camera device 100B to be grasped more accurately, even if, for example, the light source device 200A is moved to change the irradiation direction of the light LG1 from the light source device 200A while a preview image is displayed on the display unit 242.

[0090] Furthermore, the control unit 250A may display an image indicating the orientation of the subject OB1 corresponding to the shooting direction of the camera device 100B (or the orientation of the subject OB1 in real space). FIG. 19 is a diagram showing an example of an image displayed on the light source device 200A of the fifth embodiment. The control unit 250A further superimposes and displays images IM61 to IM64 indicating the up, down, left, and right orientations (directions) on the image IM60 whose orientation and tilt have been adjusted based on the information about the posture described above. Note that the control unit 250A may also display only the images IM61 to IM64 indicating the orientations on the display unit 242 without including the subject OB1 in the image. Note that the display format of the images indicating the orientations is not limited to the example of FIG. 19, and may be a display format other than an arrow mark. Furthermore, the control unit 250A may only display at least one of the images IM61 to IM64.

[0091] 19, the display of images IM61 to IM64 notifies the user that even when light source device 200A is rotated, the upper side of image IM60 displayed on display unit 242 as seen from the user is displayed above image IM10 captured by camera device 100B, and that other directions are also displayed in association with the directions at the time of capture. This makes it possible to more accurately notify the user in which direction (orientation) subject OB1 displayed on light source device 200A is facing relative to the capturing direction of camera device 100B.

[0092] In the fifth embodiment, instead of the control unit 250A of the light source device 200A, the control unit 150B of the camera device 100B may acquire information regarding the attitude from the light source device 200A, compare it with the attitude of the camera device 100B, and rotate the captured image in correspondence with each attitude, or generate an image including an orientation corresponding to the attitude and provide it to the light source device 200A.

[0093] According to the fifth embodiment described above, even when the attitude of the light source device 200A for irradiating the light LG1 at a desired position is changed, the direction of the subject OB1 as seen from the camera device 100B can be provided to the user more accurately. This allows the user to intuitively grasp the direction in which to move the light source device 200A, making it easier to move the light source device 200A. This is particularly suitable for a user facing a different direction from the camera device 100B.

[0094] <Modification> Each of the first to fifth embodiments described above may be combined with at least a part of the other embodiments. In the above-described embodiments, the camera device 100 (100A, 100B) and the light source device 200 (200A) transmit and receive information related to shooting instructions and the like several times, but after the first instruction is given, control related to turning the light on and off and shooting may be performed independently for a preset operating time.

[0095] In addition, in the embodiment, for example, camera device 100A may perform preview shooting, detect the off state or on state from a change in brightness of the preview image due to turning off or on of light source device 200, and perform shooting in each state. In this case, there is no need for light source device 200 to issue a shooting instruction to camera device 100A after turning off or on the light.

[0096] In the embodiment, when the light LG1 is irradiated from the front of the subject OB1, the light may be irradiated from a light source provided in the camera device 100 instead of the light source of the light source device 200.

[0097] In the embodiments, the camera device 100 (100A, 100B) and the light source device 200 (200A) may each have the same functional configuration. In this case, a general-purpose terminal device such as a smartphone or a tablet terminal is used as each of the camera device 100 and the light source device 200. The general-purpose terminal device has similar functions to the functional configurations of the camera device 100 (100A, 100B) and the light source device 200 (200A) described above, and executes an application program (software) already installed on the general-purpose terminal device to perform the shooting control of each of the above-described embodiments, thereby realizing predetermined processing through cooperation between software and hardware.

[0098] According to the above-described embodiments, even when photographing under ambient light (bright room environment), it is possible to obtain an image equivalent to that obtained when photographing under no ambient light (dark room environment), thereby enabling more accurate acquisition of the reflection characteristics of the subject OB1. Furthermore, according to the embodiments, the user manually moves the light source device 200, eliminating the need for a jig or device for fixing the light source. This makes it possible to easily irradiate the light source light LG1 from a desired position regardless of the size of the subject OB1. Furthermore, in the embodiments, the camera device 100 and the light source device 200 communicate with each other, enabling coordinated operation control, thereby further reducing the workload of the user in positioning and moving the light source when recording the reflection characteristics of the subject OB1.

[0099] Note that a program for implementing all or part of the functions of the reflection characteristic recording system 1 (1A, 1B, 1C), camera device 100 (100A, 100B), light source device 200 (200A), and image processing device 300 of the present invention may be recorded on a computer-readable recording medium, and the program may be loaded into a computer system and executed to perform processing. Note that the term "computer system" as used herein includes hardware such as an operating system (OS) and peripheral devices. The term "computer system" also includes a WWW system equipped with a website provision environment (or display environment). The term "computer-readable recording medium" refers to portable media such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, and a storage device such as a hard disk built into a computer system. The term "computer-readable recording medium" also refers to a device that stores a program for a certain period of time, such as volatile memory (RAM) within a computer system that acts as a server or client when the program is transmitted via a network such as the Internet or a communication line such as a telephone line.

[0100] The program may also be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by transmission waves in the transmission medium. Here, the "transmission medium" that transmits the program refers to a medium that has the function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. The program may also be a program that realizes part of the above-mentioned functions. Furthermore, the program may be a so-called differential file (differential program) that can realize the above-mentioned functions in combination with a program already recorded in the computer system.

[0101] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, as well as within the scope of the invention described in the claims and their equivalents. [Explanation of symbols]

[0102] 1, 1A, 1B, 1C Reflection Characteristics Recording System 100, 100A, 100B camera equipment 110, 210, 310 Communications Department 120 Photography Department 130 Display section 140 Reflection characteristic estimation section 150, 150A, 250, 250A, 350 control unit 160, 360 storage section 170 Voice Reception Department 180, 260 attitude sensor 200, 200A light source device 220 Light source section 230 Instruction Reception Department 240 Notification Department 300 Image processing device 320 Image Processing Unit 330 Image Generation Unit 340 Provision Department

Claims

1. A reflection characteristic recording system that records reflection characteristics of a subject from a plurality of images captured under ambient light conditions with different light irradiation directions on the subject, comprising: an imaging device that captures an image of the subject; a light source device that irradiates the subject with light from a light source; a control unit provided in the light source device and controlling the turning on and off of the light source during photography; the control unit outputs a photographing instruction to the photographing device after turning on or off the light source, estimates the reflection characteristics of the subject from the image photographed by the photographing device, and stores the estimated reflection characteristics in a storage unit. Reflectance characteristics recording system.

2. A reflection characteristic recording system that records reflection characteristics of a subject from a plurality of images captured under ambient light conditions with different light irradiation directions on the subject, comprising: an imaging device that captures an image of the subject; a light source device that irradiates the subject with light from a light source; a control unit provided in the photographing device and controlling turning on or off of a light source of the light source device during photographing; When a photographing instruction is received, the control unit transmits an instruction to the light source device regarding turning on or off the light source; After the light source is turned on or off, the reflection characteristics of the subject are estimated from the image captured by the image capturing device and stored in a storage unit. Reflectance characteristics recording system.

3. The light source device further includes a display unit that displays at least one image selected from a preview image captured by the image capture device, a captured image, and a processed image obtained by performing predetermined image processing on the captured image. The reflection characteristic recording system according to claim 1 or 2.

4. the control unit causes the display unit to display an image of the subject according to the attitude of the photographing device. The reflection characteristic recording system according to claim 3 .

5. The image processing device further includes: extracting glossy regions from the plurality of captured images; superimposing the extracted regions; and providing a region from which a glossy region has not been extracted as an uncaptured region to a user. The reflection characteristic recording system according to claim 1 or 2.

6. the image processing device extracts a shape of a size surrounding the glossy area, estimates the number of times of photographing based on the extracted shape and the unphotographed area, and provides the estimated number of times of photographing to a user; The reflection characteristic recording system according to claim 5 .

7. A reflection characteristic recording method for recording reflection characteristics of a subject from a plurality of images captured under ambient light conditions with different light irradiation directions on the subject, comprising: an imaging device photographs the subject; a light source device that irradiates the subject with light from a light source; a control unit of the light source device controls turning on or off the light source during shooting; the control unit outputs a photographing instruction to the photographing device after turning on or off the light source, estimates the reflection characteristics of the subject from the image photographed by the photographing device, and stores the estimated reflection characteristics in a storage unit; Reflectance characteristics recording method.

8. A reflection characteristic recording method for recording reflection characteristics of a subject from a plurality of images captured under ambient light conditions with different light irradiation directions on the subject, comprising: an imaging device photographs the subject; a light source device that irradiates the subject with light from a light source; a control unit provided in the photographing device controls turning on or off a light source of the light source device during photographing; when a photographing instruction is received, the control unit transmits an instruction to the light source device regarding turning on or off the light source; After the light source is turned on or off, the reflection characteristics of the subject are estimated from the image captured by the image capturing device and stored in a storage unit. Reflectance characteristics recording method.

9. A program for recording reflection characteristics of a subject from a plurality of captured images taken under a certain ambient light condition with different light irradiation directions on the subject, the program comprising: Computer, an imaging device that captures an image of the subject; a light source device that irradiates the subject with light from a light source; a control unit provided in the light source device that controls turning on or off the light source during photography; the control unit outputs a photographing instruction to the photographing device after turning on or off the light source, estimates the reflection characteristics of the subject from the image photographed by the photographing device, and stores the estimated reflection characteristics in a storage unit. program.

10. A program for recording reflection characteristics of a subject from a plurality of captured images taken under a certain ambient light condition with different light irradiation directions on the subject, the program comprising: Computer, an imaging device that captures an image of the subject; a light source device that irradiates the subject with light from a light source; a control unit provided in the photographing device, which controls turning on or off the light source of the light source device during photographing; When a photographing instruction is received, the control unit transmits an instruction to the light source device regarding turning on or off the light source; After the light source is turned on or off, the reflection characteristics of the subject are estimated from the image captured by the image capturing device and stored in a storage unit. program.

Images