Information processing apparatus, information processing method, and program

Abstract

To match the lighting timing of a light source and an imaging timing even when using an imaging device in which a release time lag varies in each imaging.SOLUTION: An imaging instruction signal for instructing imaging is output to an imaging device. An imaging timing signal indicating a timing for the imaging is obtained from the imaging device. In response to acquisition of the image timing signal, control of lighting of a light source is performed.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing method, and a program.

Background Art

[0002] A technique is known in which an object is imaged while individually lighting a plurality of light sources constituting multi-lighting, and a plurality of captured images having different illumination directions are acquired. Patent Document 1 discloses a technique for performing lighting of a light source and imaging of an object based on a common trigger signal in order to match the lighting timing of the light source and the imaging timing.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, when using an imaging device in which the release time lag varies for each imaging, the imaging timing after the trigger is transmitted varies for each imaging. On the other hand, the lighting timing of the light source after the trigger is transmitted is constant for each imaging. Therefore, when using an imaging device in which the release time lag varies for each imaging, there are cases where the lighting timing of the light source and the imaging timing do not match.

[0005] An object of the present invention is to match the lighting timing of a light source and the imaging timing even when using an imaging device in which the release time lag varies for each imaging.

Means for Solving the Problems

[0006] In order to achieve the object of the present invention, for example, an information processing apparatus according to an embodiment includes the following configuration. That is, an output unit that outputs an imaging instruction signal for instructing imaging to an imaging device, an acquisition unit that acquires an imaging timing signal indicating a timing for performing imaging from the imaging device, and a control unit that controls lighting of a light source in response to acquisition of the imaging timing signal.

Advantages of the Invention

[0007] Even when using an imaging device in which the release time lag varies for each imaging, the lighting timing of the light source is matched with the imaging timing.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Embodiments for Carrying Out the Invention

[0009] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the invention according to the claims. Although a plurality of features are described in the embodiments, all of these plurality of features are not necessarily essential for the invention, and the plurality of features may be arbitrarily combined. Further, in the accompanying drawings, the same or similar configurations are denoted by the same reference numerals, and redundant descriptions are omitted.

[0010] [Prior Example] Before explaining the information processing apparatus according to the present embodiment, a conventional imaging system will be described. FIG. 6(a) is a block diagram showing the configuration of the conventional imaging system. In the conventional imaging system shown in FIG. 6(a), the lighting control of the light sources 603-1 to 603-4 by the lighting signal generation device 602 and the imaging control by the imaging device 604 are performed based on a common trigger signal transmitted from the trigger signal generation device 601.

[0011] FIG. 6(b) is a side view showing the appearance of the conventional imaging system. Further, FIG. 6(c) is a top view showing the appearance of the conventional imaging system. In this conventional example, by imaging the surface of the object 605 while individually lighting four light sources (from 603-1 to 603-4), four captured images with different illumination directions are acquired.

[0012] In the conventional example, in order to match the lighting timing and the imaging timing of each light source, the lighting of the light source and the imaging of the object are performed based on a common trigger signal. Specifically, first, the trigger signal generation device 601 generates the trigger signal shown in FIG. 6(d) and transmits it to the lighting signal generation device 602 and the imaging device 604. This trigger signal consists of a number of pulses corresponding to the number of light sources (here, four). The lighting signal generation device 602 generates the lighting signals 1 to 4 shown in FIG. 6(d) based on the received trigger signal and individually lights the four light sources 603-1 to 603-4. The imaging device 604 images the surface of the object 605 based on the received trigger signal. The imaging signal shown in FIG. 6(d) corresponds to the exposure period in the imaging device 604.

[0013] When using an industrial camera as the imaging device 604 that does not have (or has an extremely small) release time lag, as shown in Fig. 6(d), the timing when the trigger signal rises coincides with the timing when the imaging signal rises. Also, here, no delay occurs in the lighting signal generation device 602, and the timing when the trigger signal rises coincides with the lighting timing of each light source. Therefore, when using an industrial camera as the imaging device 604 that does not have a release time lag, the lighting timing of each light source coincides with the imaging timing.

[0014] On the other hand, industrial cameras are often more expensive than consumer cameras, which are assumed to have a larger release time lag. Therefore, it is assumed that a consumer camera is used as the imaging device 604. Here, the consumer camera has a release time lag of several tens of milliseconds, and as shown by Δt1 to Δt2 in Fig. 6(e), it is a camera in which the release time lag varies for each imaging. That is, the consumer camera described here has a variable imaging timing after the trigger is sent for each imaging. On the other hand, also in this consumer camera, the lighting timing of the light source after the trigger is sent is constant for each imaging. Therefore, when using an imaging device such as a consumer camera in which the release time lag varies for each imaging, the lighting timing of the light source and the imaging timing may not match.

[0015] FIG. 6(e) is a diagram showing a lighting signal and an imaging signal with respect to a trigger signal in the case of using an imaging device in which such a release time lag varies for each imaging. For example, in FIG. 6(e), in the first imaging and the fourth imaging, the exposure period of the imaging device is included in the lighting period of the light source, and the lighting timing of the light source and the imaging timing match. On the other hand, in the second imaging, the exposure period of the imaging device is not included in the lighting period of the light source. In this case, a completely dark image is obtained as the captured image. Also, in the third imaging, although the exposure period of the imaging device is partially included in the lighting period of the light source, the lighting period ends during the exposure period. In this case, the captured image becomes darker compared to the case where the lighting timing of the light source and the imaging timing match. On the other hand, according to the embodiment described below, even in the case of using an imaging device in which the release time lag varies for each imaging, such as a consumer camera, the lighting timing of the light source and the imaging timing can be matched. Hereinafter, when referring to a "consumer camera", it refers to such an imaging device in which the release time lag varies for each imaging, and when referring to an "industrial camera", it refers to an imaging device in which no (extremely small) release time lag occurs.

[0016] [Embodiment 1] <Hardware Configuration> FIG. 1(a) is a block diagram showing an example of the hardware configuration of an image processing system 1 including an information processing apparatus 102 according to the present embodiment. FIG. 1(b) is a side view showing the appearance of the hardware of the image processing system 1. FIG. 1(c) is a top view showing the appearance of the hardware of the image processing system 1.

[0017] The image processing system 1 according to the present embodiment includes an information processing apparatus 102, an imaging device 103, an image processing apparatus 104, a display 105, a mouse 106, a keyboard 107, and a lighting device 108. The image processing system 1 is communicably connected to a start signal output interface (start output I / F) 101 and a transfer control device 111.

[0018] The information processing apparatus 102 outputs an imaging instruction signal for instructing imaging to the imaging apparatus 103, and acquires an imaging timing signal indicating the timing of performing imaging from the imaging apparatus 103. Further, the information processing apparatus 102 performs lighting control of at least one of the light sources 109 in response to acquiring the imaging timing signal. The information processing apparatus 102 according to the present embodiment controls the lighting device 108 so that a plurality of light sources 109 are lit individually or simultaneously in a predetermined order for a predetermined time, and simultaneously causes the imaging apparatus 103 to continuously image the object 113-2. Thereby, the information processing apparatus 102 can acquire a plurality of imaging images with different lighting directions.

[0019] At this time, the information processing apparatus 102 acquires, as the imaging timing signal, a sync signal output by the imaging apparatus 103 at the imaging timing, and lights the light source 109 in response to the acquisition of the sync signal. According to such processing, even when an imaging apparatus in which the release time lag varies for each imaging is used as the imaging apparatus 103, the lighting timing of the light source and the imaging timing can be matched. Further, for example, the information processing apparatus 102 can stop the output of the release signal based on the number of times the sync signal is acquired. In such a case, even when an imaging apparatus in which the imaging timing during continuous imaging becomes uneven is used as the imaging apparatus 103, the continuous imaging can be stopped at a predetermined number of sheets.

[0020] <Hardware Configuration of Image Processing Apparatus> The image processing apparatus 104 is, for example, a personal computer, and performs image processing on the image acquired from the imaging apparatus 103. The image processing apparatus 104 includes a RAM 126, a ROM 127, a CPU 128, a GPU 129, and a USB interface (USB I / F) 130. These functional units are communicably connected to each other via an internal bus. Data for executing the processing shown in the flowchart described in FIG. 4 to be described later is stored in the ROM 127 as program code. This program code is expanded in the RAM 126 and executed by the CPU 128 or the GPU 129.

[0021] Each of the mouse 106 and the keyboard 107 is communicably connected to the image processing apparatus 104 via the USB I / F 130 and receives an input from the user. Note that the image processing apparatus 104 according to the present embodiment will be described as being connected to the mouse 106 and the keyboard 107 as input units that receive an input from the user. However, for example, it may have different input units such as a touch panel or a mechanical switch. The display 105 is connected to the GPU 129 and presents information to the user. The information processing apparatus 102, the imaging apparatus 103, and the conveyance control apparatus 111 are communicably connected to the image processing apparatus 104 via the USB I / F 130.

[0022] <Hardware configuration around the conveyance device> The conveyance device 112 is a belt conveyor that conveys the object 113. The conveyance device 112 is controlled by the image processing apparatus 104 via the conveyance control apparatus 111. The conveyance control apparatus 111 is a one-board microcomputer having a GPIO (General-purpose input / output) and a USB I / F. The conveyance control apparatus 111 acquires the state of the conveyance device 112 via the GPIO. The image processing apparatus 104 acquires the state of the conveyance device 112 from the conveyance control apparatus 111 via the USB I / F 130. Further, the image processing apparatus 104 outputs a conveyance control command to the conveyance control apparatus 111 via the USB I / F 130. The conveyance control apparatus 111 controls the conveyance device 112 via the GPIO based on the conveyance control command. Note that a PLC (Programmable Logic Controller) may be used as the conveyance control apparatus 111.

[0023] The start output I / F is the GPIO included in the one-board microcomputer that constitutes the conveyance control apparatus 111. The conveyance control apparatus 111 outputs an imaging start signal to the information processing apparatus 102 via the start output I / F based on the imaging control command output from the image processing apparatus 104. As described above, the image processing apparatus 104 according to the present embodiment performs acquisition of the state of the transport apparatus 112, output of a transport control command, and output of an imaging control command via the transport control apparatus 111. Note that these three processes may be executed based on program codes executed by the transport control apparatus 111.

[0024] <Hardware Configuration of Information Processing Apparatus> In the following description, the information processing apparatus 102 according to the present embodiment is assumed to be a one-board microcomputer equipped with GPIO. However, the information processing apparatus 102 may have a configuration different from that described below as long as it can execute similar processes. For example, the information processing apparatus 102 may be a server that communicates with the imaging apparatus 103 and the lighting apparatus 108, a personal computer equipped with a device control board having GPIO, or a device incorporated in either the imaging apparatus 103 or the lighting apparatus 108.

[0025] The information processing apparatus 102 controls the imaging apparatus 103 and the lighting apparatus 108. Thereby, the information processing apparatus 102 causes the information processing apparatus 102 to image the object 113-2 while turning on a plurality of light sources 109 constituting multi-light illumination individually or simultaneously in a predetermined order for a predetermined time, and acquires a plurality of imaging images with different illumination directions. The information processing apparatus 102 includes a control unit 114, a start signal input interface (start input I / F) 115, a release signal output interface (release output I / F) 116, a sync signal input interface (sync input I / F), a USB I / F 118, and a lighting signal output interface (lighting output I / F) 119. These functional units are connected to be communicable with each other via an internal bus.

[0026] The control unit 114 is a microcomputer including a RAM, a ROM, and a CPU. Data for executing the processes shown in the flowchart described in FIG. 4 to be described later is stored as program codes in the ROM included in the control unit 114. These program codes are expanded in the RAM included in the control unit 114 and executed by the CPU included in the control unit 114.

[0027] The USBI / F118 is connected to the image processing apparatus 104 via the USBI / F130. The image processing apparatus 104 stores the program code executed in the control unit 114 in the ROM included in the control unit 114 via the USBI / F130 and the USBI / F118.

[0028] The start input I / F 115 is a GPIO included in the on-board microcomputer that constitutes the information processing apparatus 102. Also, the release output I / F 116, the sync input I / F, and the lighting output I / F 119 are connected to the GPIO included in the on-board microcomputer that constitutes the information processing apparatus 102. Details thereof will be described later with reference to FIG. 2.

[0029] The start input I / F 115 acquires the imaging start signal output from the start output I / F 101. The control unit 114 starts executing the program code stored in the ROM included in the control unit 114 at the timing when the imaging start signal is input. Note that the image processing apparatus 104 may issue commands related to the execution or stop of the program code in the control unit 114 to the control unit 114 via the USBI / F130 and the USBI / F118.

[0030] The release output I / F 116 outputs a release signal (imaging instruction signal) for instructing imaging of an object (subject) to the release input I / F 120 provided in the imaging device 103. The release signal according to the present embodiment is an electrical signal composed of two states, ON and OFF. The release signal is not limited to an electrical signal as long as it is a signal capable of instructing imaging in the same manner, and may be a wireless signal or an optical signal. The imaging device 103 starts continuous imaging at the timing when the input release signal becomes ON. Next, the imaging device 103 continues continuous imaging while the release signal is ON, and stops continuous imaging at the timing when the release signal becomes OFF. The imaging device 103 may be configured to receive both a signal for instructing ON of continuous imaging and a signal for instructing OFF, or may be configured to turn OFF after a predetermined period after receiving the signal for instructing ON of continuous imaging.

[0031] The sync input I / F 117 acquires an imaging timing signal (hereinafter referred to as a sync signal) output from the imaging device 103 in accordance with the timing of imaging each still image during continuous imaging from the sync signal output interface (sync output I / F) 122 provided in the imaging device 103. Note that the sync signal is an electrical signal composed of two states, ON and OFF. The sync signal is not limited to an electrical signal as long as it is a signal indicating the timing of performing imaging in the same manner, and may be a wireless signal or an optical signal.

[0032] The lighting output I / F 119 outputs a lighting signal for controlling lighting of each light source 109 provided in the lighting device 108 to the lighting device 108. Each time the input sync signal becomes ON, the control unit 114 outputs a lighting signal to the lighting device 108 via the lighting output I / F 119, and causes each light source 109 to light for a predetermined time in a predetermined order, individually or simultaneously. In the present embodiment, since the sync signal becomes ON in accordance with the timing of imaging each still image during continuous imaging, each light source 109 lights in accordance with the timing of imaging each still image during continuous imaging.

[0033] As described above, by controlling the imaging device 103 and the lighting device 108, the information processing device 102 continuously images the object 113-2 while turning on a plurality of light sources constituting multi-lamp illumination individually or simultaneously in a predetermined order for a predetermined time. Thereby, the information processing device 102 can acquire a plurality of imaging images with different illumination directions.

[0034] In addition, in the present embodiment, it is described that continuous imaging is performed when the state in which the release signal is ON continues and a plurality of imaging images are acquired. However, for example, by performing a plurality of individual imaging operations by repeating the ON and OFF of the release signal a plurality of times, a plurality of imaging images may be acquired. However, for example, in the case of using a consumer camera, in the case of performing a plurality of individual imaging operations by repeating the ON and OFF of the release signal a plurality of times, it is considered that the number of images taken per second is limited to a certain extent (for example, about 5 images). On the other hand, compared with the case of performing such a plurality of individual imaging operations, in the case of performing continuous imaging, more (for example, several tens of) images can be taken per second. Therefore, by performing continuous imaging, it is possible to ensure the number of images taken per second even when using a camera in which the number of images taken per second is insufficient when performing a plurality of individual imaging operations.

[0035] <Hardware Configuration of Imaging Device> The imaging device 103 is a digital camera that images the object 113-2. In the present embodiment, a consumer interchangeable-lens single-lens reflex camera is used as the imaging device 103, but the imaging device 103 may be a consumer camera or an industrial camera.

[0036] The imaging device 103 includes a release input I / F 120, an imaging optical system 121, a sync signal output interface, an image processing engine 123, a USB I / F 124, and a control unit 125. These functional units are connected to each other via an internal bus so as to be communicable.

[0037] The control unit 125 is a microcomputer equipped with a RAM, a ROM, and a CPU. Data for executing the processes shown in the flowchart described in FIG. 4 to be described later is stored as program code in the ROM included in the control unit 125. This program code is expanded in the RAM included in the control unit 125 and executed by the CPU included in the control unit 125.

[0038] The release input I / F 120 acquires a release signal output from the release output I / F 116 included in the information processing apparatus 102. The control unit 125 controls the imaging optical system 121 including a lens or an imaging sensor at the timing when the release signal is input, and images the object 113-2. Specifically, the control unit 125 starts continuous imaging at the timing when the release signal becomes ON. Next, the control unit 125 continues continuous imaging while the release signal is ON, and stops continuous imaging at the timing when the release signal becomes OFF. The function of continuing continuous imaging while the release signal is ON is a generally provided function in consumer lens interchangeable single-lens cameras.

[0039] During continuous imaging, the control unit 125 outputs a sync signal in accordance with the timing of imaging each still image. Specifically, the control unit 125 outputs a sync signal to the sync input I / F 117 included in the information processing apparatus 102 via the sync output I / F 122. The function of outputting a sync signal in accordance with the timing of imaging each still image during continuous imaging is a generally provided function in consumer lens interchangeable single-lens cameras. The sync signal according to the present embodiment is a signal generally used to turn on an external strobe light source in synchronization with imaging.

[0040] The image processing engine 123 generates digital image data based on the optical image on the imaging sensor and stores it as a captured image in the RAM or ROM included in the control unit 125. The USB I / F 124 is connected to the image processing apparatus 104 via the USB I / F 130.

[0041] The image processing apparatus 104 acquires the captured image stored in the RAM or ROM included in the control unit 125 of the imaging apparatus 103 via the USB I / Fs 124 and 130. The image processing apparatus 104 stores the acquired captured image in the RAM 126 or ROM 127 included in the image processing apparatus 104. Further, the image processing apparatus 104 sets the imaging mode (such as ISO sensitivity, shutter speed, aperture, continuous shooting mode, imaging area, or image format) of the imaging apparatus 103 via the USB I / Fs 130 and 124.

[0042] Note that some or all of the processes described below as being executed by the image processing apparatus 104 may be executed by the information processing apparatus 102. Also, some of the processes executed by the imaging apparatus 103 may be executed by the information processing apparatus 102. Further, if the same processes can be executed by the image processing system 1, some of the processes executed by the information processing apparatus 102 may be executed by the imaging apparatus 103 or the image processing apparatus 104.

[0043] <Hardware Configuration of Lighting Device> The lighting device 108 is a dome-shaped multi-lighting that includes a plurality of light sources. In the image processing system 1 according to the present embodiment, the imaging apparatus 103 is disposed at the apex of the dome as shown in Fig. 1(b). The lighting device 108 irradiates the object 113-2 with light from a plurality of directions.

[0044] FIG. 1(d) is a side view showing an example of the arrangement of the light sources 109 in the lighting device 108. FIG. 1(e) is a top view showing an example of the arrangement of the light sources 109 in the lighting device 108. In FIGS. 1(d) and 1(e), each light source 109 is indicated by a black square. As shown in FIG. 1(e), the lighting device 108 according to the present embodiment includes 40 light sources as the light sources 109. As shown in FIG. 1(d), these 40 light sources are respectively arranged at positions with five types of zenith angles of 10°, 30°, 45°, 60°, and 80°. Further, as shown in FIG. 1(e), these 40 light sources are arranged at positions with 24 types of azimuth angles from 0° to 345° at intervals of 15°. The information processing device 102 controls the imaging device 103 and the lighting device 108 to continuously image the object 113-2 while turning on a plurality of light sources 109 constituting multi-lamp lighting individually or simultaneously in a predetermined order for a predetermined time. Thereby, the information processing device 102 can acquire a plurality of imaging images with different lighting directions.

[0045] Note that, as will be described later, in the present embodiment, eight light sources with a zenith angle of 10° are turned on simultaneously, and the light sources with zenith angles from 30° to 80° are turned on individually. In the case where the power consumption of each light source is the same, when turning on simultaneously, the total power consumption is larger than when turning on individually. When the total power consumption increases, the power supply device becomes costly. Also, the luminous flux of the light source is almost proportional to the power consumption. Therefore, in the case of simultaneous lighting, the image may become too bright and the pixels may be saturated compared to individual lighting. Therefore, for the light sources to be turned on simultaneously, a light emitting device with a lower power consumption is used than for the light sources to be turned on individually. That is, since the light sources with a zenith angle of 10° are assumed to be turned on simultaneously, a light emitting device with a lower power consumption is used than the light sources with other zenith angles. Therefore, in FIGS. 1(d) and 1(e), when representing each light source by a black square, the light sources with a zenith angle of 10° are represented by smaller squares than the other light sources.

[0046] <Circuit Configuration> FIG. 2(a) is a diagram showing an example of the circuit of the hardware of the image processing system 1 according to the present embodiment. FIG. 2(b) is an explanatory diagram showing the correspondence between the lighting signal and each light source 109. FIG. 2(c) is a circuit diagram of the switching modules (209-1 to 209-34).

[0047] <Circuit Configuration of Information Processing Device> The information processing device 102 according to the present embodiment can transmit a release signal to the imaging device 103 by controlling the energization state of the terminal that transmits the release signal. Further, the information processing device 102 can receive a sync signal from the imaging device 103 by controlling the energization state of the terminal that receives the sync signal. Hereinafter, the energization state of each such terminal will be described.

[0048] The control unit 114 in the information processing device 102 includes R_out, X_in, and L_out_1 to L_out_33 as GPIOs. Further, it includes a ground terminal GND having a reference potential. The potential of the GPIO is controlled by the program code executed by the control unit 114. The control unit 114 switches the potential of the GPIO from a LOW potential to a HIGH potential or from a HIGH potential to a LOW potential. Thereby, the control unit 114 outputs a release signal from R_out. Further, the control unit 114 outputs a lighting signal using L_out_1 to L_out_33. Further, the control unit 114 can acquire the potential of the GPIO. That is, the control unit 114 determines whether the potential of the GPIO is at a HIGH potential or a LOW potential. Thereby, the control unit 114 acquires a sync signal from X_in. In the following description, the HIGH potential is 5V and the LOW potential is 0V as the potential with respect to the ground.

[0049] Among the GPIOs, R_out outputs a release signal to the imaging device 103 via the remote control terminal 201 provided in the release output I / F 116. X_in acquires a sync signal from the imaging device 103 via the sync terminal 203 provided in the sync input I / F 117. L_out_1 to L_out_33 output lighting signals to the lighting device 108 via the terminal 206 provided in the lighting output I / F 119. Each GPIO (L_out_1 to L_out_33) that outputs a lighting signal lights the light source connected to each GPIO for a predetermined time by outputting a HIGH potential for a predetermined period in accordance with the timing of acquiring the sync signal, as shown in, for example, FIG. 5(b). On the other hand, each GPIO that outputs a lighting signal turns off the light source connected to each GPIO by outputting a LOW potential. Note that each GPIO that outputs a lighting signal may output a PWM signal as the lighting signal. When using a PWM signal as the lighting signal, the GPIO can individually adjust the light emission amount for each light source connected to the GPIO by adjusting the duty ratio of the PWM signal.

[0050] The release output I / F 116 in the information processing apparatus 102 controls the energization state between the two terminals of the remote control terminal 201 based on the potential of R_out. Thereby, a release signal is output to the imaging apparatus 103. The release output I / F 116 includes an N-channel MOSFET (T1), a gate resistor R1, a gate-source resistor R2, and a remote control terminal 201. The gate of the MOSFET (T1) is connected to R_out of the control unit 114 via the gate resistor R1. Also, the gate of the MOSFET (T1) is connected to the ground via the gate-source resistor R2. The source of the MOSFET (T1) is connected to the ground. The drain and the source of the MOSFET (T1) are respectively connected to the two terminals of the remote control terminal 201. The drain-source of the MOSFET (T1) conducts when R_out of the control unit 114 is at a HIGH potential and is interrupted when R_out is at a LOW potential. The control unit 114 controls the energization state between the drain and the source of the MOSFET (T1) by switching the potential of R_out. That is, the control unit 114 controls the energization state between the two terminals of the remote control terminal 201 by switching the potential of R_out. Thereby, the control unit 114 outputs a release signal to the imaging apparatus 103. Specifically, when the release signal is ON, the control unit 114 sets R_out to a HIGH potential to energize between the two terminals of the remote control terminal 201. On the other hand, when the release signal is OFF, the control unit 114 sets R_out to a LOW potential to interrupt between the two terminals of the remote control terminal 201. Note that a known switching element may be used instead of the MOSFET to control the energization state between the two terminals of the remote control terminal 201.

[0051] The sync input I / F 117 in the information processing apparatus 102 converts the energization state between the two terminals of the sync terminal 203 into the potential of X_in. The two terminals of the sync terminal 203 are connected to the remote control terminal 202 provided in the imaging apparatus 103, and further connected to the semiconductor switching element 205 provided in the imaging apparatus 103. That is, the sync input I / F 117 converts the energization state of the semiconductor switching element 205 into the potential of X_in. The semiconductor switching element 205 is energized at the timing when the imaging apparatus 103 captures each still image, and is cut off at other timings. Therefore, the potential of X_in changes at the timing of capturing a still image. The control unit 114 acquires the sync signal output at the timing when the imaging apparatus 103 captures each still image during continuous imaging by acquiring the potential of X_in. The sync input I / F 117 includes a pull-up resistor R4 and the sync terminal 203. X_in of the control unit 114 is connected to one terminal of the sync terminal 203. The other terminal of the sync terminal 203 is connected to the ground. X_in of the control unit 114 is connected to the power supply Vdd2 via the pull-up resistor R4. The power supply Vdd2 is at a HIGH potential, and the potential with respect to the ground is 5V. Therefore, X_in becomes HIGH potential when the two terminals of the sync terminal 203 are disconnected, and becomes LOW potential when the two terminals of the sync terminal 203 are energized. The two terminals of the sync terminal 203 are in an energized state at the timing when the imaging apparatus 103 captures a still image, and are in a disconnected state at other timings. Therefore, the control unit 114 can acquire the timing when the imaging apparatus 103 captures a still image by acquiring the potential of X_in. That is, the control unit 114 can acquire the sync signal output at the timing when the imaging apparatus 103 captures each still image during continuous imaging by acquiring the potential of X_in. Specifically, when the sync signal is ON, the two terminals of the sync terminal 203 are energized, and X_in becomes LOW potential. On the other hand, when the sync signal is OFF, the two terminals of the sync terminal 203 are disconnected, and X_in becomes HIGH potential.

[0052] <Circuit Configuration of Imaging Device> The control unit 125 in the imaging device 103 includes R_in and X_out as GPIOs. R_in acquires a release signal from the information processing device 102 via the remote control terminal 202 provided in the release input I / F 120. X_out outputs a synchronization signal to the information processing device 102 via the synchronization terminal 204 provided in the synchronization output I / F 122. Note that the remote control terminal 202 is connected to the remote control terminal 201. Also, the synchronization terminal 204 is connected to the synchronization terminal 203.

[0053] The release input I / F 120 in the imaging device 103 converts the energization state between the drain and source of the MOSFET (T1) provided in the release output I / F 116 into the potential of R_in. The energization state between the drain and source of the MOSFET (T1) is controlled by the potential of R_out as described above. Therefore, the potential of R_in is controlled by the potential of R_out. Thereby, the release signal output from the control unit 114 of the information processing device 102 is transmitted to the control unit 125 of the imaging device 103. As shown in FIG. 5(b), the potential of R_in becomes the potential obtained by inverting the potential of R_out. The release input I / F 120 includes a pull-up resistor R3 and a remote control terminal 202. R_in of the control unit 125 is connected to one terminal of the remote control terminal 202. The other terminal of the remote control terminal 202 is connected to the ground. R_in of the control unit 125 is connected to the power supply Vdd1 via the pull-up resistor R3. The power supply Vdd1 is at a HIGH potential, and the potential with respect to the ground is 5V. Therefore, R_in becomes HIGH potential when the two terminals of the remote control terminal 202 are disconnected, and becomes LOW potential when the two terminals of the remote control terminal 202 are energized. As described above, the energization state between the two terminals of the remote control terminal 201 is switched by the release signal output from the control unit 114. Also, the remote control terminal 202 is connected to the remote control terminal 201. Therefore, the control unit 125 can acquire the release signal output from the information processing device 102 by acquiring the potential of R_in. Specifically, when the release signal is ON, the two terminals of the remote control terminal 201 are energized, so R_in becomes LOW potential. On the other hand, when the release signal is OFF, the two terminals of the remote control terminal 201 are disconnected, so R_in becomes HIGH potential. The control unit 125 starts continuous imaging at the timing when R_in becomes LOW potential. Then, the control unit 125 continues continuous imaging while R_in is LOW potential, and stops continuous imaging at the timing when R_in becomes HIGH potential.

[0054] The sync output I / F 122 in the imaging device 103 controls the energization state between the two terminals of the semiconductor switching element 205 based on the potential of X_out. The energization state of the semiconductor switching element 205 is converted into the potential of X_in by the sync input I / F 117 provided in the information processing device 102. Therefore, the potential of X_in is controlled by the potential of X_out. As a result, the sync signal output by the control unit 125 of the imaging device 102 is transmitted to the control unit 114 of the information processing device 102. As shown in FIG. 5(b), the potential of X_in becomes the potential obtained by inverting the potential of X_out. The sync output I / F 122 includes a semiconductor switching element 205 and a sync terminal 204. The semiconductor switching element 205 is connected to X_out of the control unit 125. The control unit 125 controls the energization state of the semiconductor switching element 205 by switching the potential of X_out. The semiconductor switching element 205 is connected to the sync terminal 204, and one of the two terminals is connected to the ground. Therefore, the two terminals of the sync terminal 204 are energized when X_out of the control unit 125 is at the HIGH potential and are cut off when X_out is at the LOW potential. That is, the control unit 125 controls the energization state between the two terminals of the sync terminal 204 by switching the potential of X_out. As a result, the control unit 125 outputs the sync signal to the information processing device 102. Specifically, when the sync signal is ON, the control unit 125 sets X_out to the HIGH potential to energize between the two terminals of the sync terminal 204. On the other hand, when the sync signal is OFF, the control unit 125 sets X_out to the LOW potential to cut off between the two terminals of the sync terminal 204. As described above, the sync terminal 203 is connected to the sync terminal 204. Also, as described above, the potential of X_in of the control unit 114 in the information processing device 102 is switched according to the energization state of the sync terminal 203. Therefore, the control unit 114 in the information processing device 102 can acquire the sync signal output by the imaging device 103 by acquiring the potential of X_in.

[0055] Note that the remote control terminals 201 and 202 according to this embodiment are the remote control terminals generally provided in a lens - interchangeable single - lens camera. The remote control terminals provided in a lens - interchangeable single - lens camera are generally used to connect a remote control for remote release. Similarly, the sync terminals 203 and 204 according to this embodiment are the sync terminals generally provided in a lens - interchangeable single - lens camera. The sync terminals provided in a lens - interchangeable single - lens camera are generally used to connect an external strobe light source to the camera. Note that there are models of lens - interchangeable single - lens cameras that do not have sync terminals. When using such a lens - interchangeable single - lens camera, the sync signal may be output to the information processing device 102 by attaching a hot - shoe adapter equipped with a sync terminal to the camera body and using it.

[0056] <Circuit configuration of the lighting device> The lighting device 108 includes a terminal 207, switching modules (209 - 1 to 209 - 34), and 40 light sources (L1 to L40). Here, all the light sources are LEDs. The terminal 207 receives the lighting signal output from the GPIO (L_out_1 to L_out_33) of the control unit 114 via the terminal 206. Also, the terminal 207 is connected to the ground terminal GND of the control unit 114. The switching modules (209 - 1 to 209 - 34) amplify the lighting signal input from the terminal 207 and turn on each light source (L1 to L40).

[0057] FIG. 2(b) is an explanatory diagram showing the correspondence between the lighting signal and each light source 109. Among the light sources, L1 to L32 are connected to each GPIO (L_out_1 to L_out_32) in a one-to-one manner. Therefore, the control unit 114 can individually control the lighting and extinguishing of L1 to L32. On the other hand, among the light sources, L33 to L40 are connected to one GPIO (L_out_33). Therefore, the control unit 114 simultaneously lights and extinguishes L33 to L40. Among L33 to L40, L33 to L36 are connected in series and are connected to the switching module 209-33. Similarly, L37 to L40 are connected in series and are connected to the switching module 209-34. Note that the light source is not limited to an LED as long as the lighting can be controlled in the same way. For example, a xenon lamp may be used as the light source.

[0058] FIG. 2(c) is a circuit diagram of the switching modules (209-1 to 209-34). In the present embodiment, since it is assumed that all the switching modules (209-1 to 209-34) have the same configuration, the configuration will be described below using the switching module 209-1 as an example.

[0059] The switching module 209-1 amplifies the lighting signal output by the control unit 114 to turn on the light source L1. The switching module 209-1 includes two N-channel MOSFETs (T3 and T4), a gate resistor R5, a gate-source resistor R6, and a diode D1. The MOSFETs (T3 and T4) are connected in parallel to allow a large current to flow through the light source L1. Note that a known switching element may be arbitrarily adopted instead of the MOSFETs (T3 and T4).

[0060] The gates of the MOSFETs (T3 and T4) are connected to the TRIG terminal to which the lighting signal is input via the gate resistor R5. Also, the gates of the MOSFETs (T3 and T4) are connected to the ground via the gate-source resistor R6. Also, the sources of the MOSFETs (T3 and T4) are connected to the ground. The drain-source of the MOSFETs (T3 and T4) conducts when the TRIG terminal is at a HIGH potential and is cut off when the TRIG terminal is at a LOW potential. The control unit 114 according to this embodiment can control the conduction state between the drain and source of the MOSFETs (T3 and T4) by switching the potential of the lighting signal. Thereby, the lighting and extinguishing of the light source are controlled.

[0061] The light source lights up when the lighting signal is at a HIGH potential and goes out when the lighting signal is at a LOW potential. The drains of the MOSFETs (T3 and T4) are connected to the cathode of the light source L1 via the Out- terminal. The V_in terminal is a terminal connected to the power supply Vdd3. This V_in terminal is connected to the anode of the light source L1 via the Out+ terminal. Therefore, when the drain-source of the MOSFETs (T3 and T4) conducts, the light source L1 lights up, and when the drain-source of the MOSFETs (T3 and T4) is cut off, the light source L1 goes out. A diode D1 for preventing surge current is connected between the Out+ terminal and the Out- terminal. Specifically, the cathode of the diode D1 is connected to the Out+ terminal. Also, the anode of the diode D1 is connected to the Out- terminal. Normally, the potential of the Out+ terminal is higher than that of the Out- terminal due to the load of the light source L1, so the diode D1 does not conduct current.

[0062] Note that the light emission amount of the light source may change due to temperature changes in each circuit element. Therefore, in this embodiment, a constant current power supply is used as the power supply Vdd3. The power supply Vdd3 has a current value of 0.6 A and a potential with respect to the ground of up to 36 V. When an LED is used as the light source, the light emission amount greatly depends on the current value. In this case, by stabilizing the current value with a constant current power supply, the light emission amount of the light source can be kept constant regardless of temperature changes in each circuit element. Also, by adjusting the current value with a constant current power supply, the light emission amount of the light source can be adjusted. Furthermore, by connecting different constant current power supplies for each light source, the light emission intensity can be adjusted for each light source.

[0063] <Functional Configuration and Processing Flow> FIG. 3 is a block diagram showing an example of the functional configuration in the image processing system 1 according to this embodiment. The image processing system 1 according to this embodiment includes a start signal output unit 301, an imaging control unit 302, an imaging unit 303, an image processing unit 304, an illumination unit 305, and a conveyance unit 306. The imaging control unit 302 includes a release signal output unit 307, a sync signal input unit 308, a count unit 309, and a lighting signal output unit 310. The imaging unit 303 includes a release signal input unit 311, a control unit 312, a sync signal output unit 313, and an image acquisition unit 314. The image processing unit 304 includes an inspection image acquisition unit 315, a color / shape inspection unit 316, a gloss inspection unit 317, and an output unit 318.

[0064] The functional units shown in FIG. 3 are realized by the hardware shown in FIG. 1 and the circuit shown in FIG. 2. Specifically, the function of the start signal output unit 301 is realized by the start output I / F 101, the conveyance control device 111, and the image processing device 104. The function of the imaging control unit 302 is realized by the information processing device 102. The function of the imaging unit 303 is realized by the imaging device 103. The function of the image processing unit 304 is realized by the image processing device 104. The function of the illumination unit 305 is realized by the illumination device 108. The function of the conveyance unit 306 is realized by the conveyance control device 111, the conveyance device 112, and the image processing device 104.

[0065] FIG. 4 is a flowchart showing an example of information processing executed in the image processing system 1 according to the present embodiment. FIG. 5 is a diagram for explaining the information processing.

[0066] <Overall processing> First, an overview of the overall processing will be described. FIG. 4(a) is a flowchart showing an example of the conveyance and imaging processing of the object. The processing illustrated in FIG. 4(a) is processing for imaging the object while intermittently operating the conveyance device 112. That is, here, the conveyance device 112 alternately repeats operation and stop. Further, the object is conveyed to the imaging position by the operation of the conveyance device 112 and imaged while the conveyance device 112 is stopped. When the imaging is completed, the object is conveyed from the imaging position to another location by the operation of the conveyance device 112.

[0067] The processing shown in FIG. 4(a) starts when an instruction to start the overall operation is given (for example, by a user operation in the information processing device 102). In S401, the conveyance unit 306 operates the conveyance device 112 to start the conveyance of the object. In S402, the conveyance unit 306 determines whether the object has been conveyed to the imaging position (the position of the object 113-2). For example, the conveyance unit 306 may use an optical sensor installed near the imaging position to determine whether the object has been conveyed to the imaging position. If it is determined that the object has been conveyed to the imaging position, the process proceeds to S403; otherwise, the process repeats S402. In S403, the conveyance unit 306 stops the conveyance device 112 to stop the conveyance of the object.

[0068] In the processing shown in FIG. 4(a), the conveyance device 112 is stopped between S403 and S407. During that time, the object is transported by a robot arm from the outside and placed at the position of the object 113-1 in the conveyance device 112. The control of the robot arm is performed by the image processing device 104 via the conveyance control device 111.

[0069] In S404, the imaging control unit 302 controls the imaging unit 303 and the illumination unit 305 to image the object at the imaging position. Specifically, the imaging control unit 302 images the surface of the object while turning on a plurality of light sources (L1 to L40 shown in FIG. 2) constituting multi-light illumination, individually or simultaneously in a plurality, in a predetermined order, for a predetermined time. Thereby, the imaging control unit 302 acquires a plurality of imaging images with different illumination directions. Here, the process of sending the imaging start signal is performed by a device different from the device (information processing device 102) that controls the lighting of the light source and imaging. For example, the process of sending the imaging start signal may be performed using the image processing device 104 or the conveyance control device 111 or the like. Thereby, since the processing delay of the program code executed by the information processing device 102 is reduced, the lighting timing of the light source and the imaging timing can be made to coincide more accurately. Here, the imaging of the object is executed by the start signal output unit 301 sending an imaging start signal to the release signal output unit 307 provided in the imaging control unit 302.

[0070] In S405 to S406, the image processing unit 304 performs an appearance inspection process of the object based on the imaging image captured in S404. Here, in S405, the color / shape inspection unit 316 performs a color / shape inspection of the object based on the imaging image captured in S404. Next, in S406, the gloss inspection unit 317 performs a gloss inspection process of the object based on the imaging image captured in S404. Here, when the imaging process in S404 is completed, the plurality of imaging images stored in the image acquisition unit 314 are sent to the inspection image acquisition unit 315. The image processing unit 304 in the image processing device 104 performs image processing based on the acquired imaging image. In the present embodiment, industrial products such as home appliances or cosmetics are assumed as the object 113-2. Here, the image processing unit 304 performs an appearance inspection process of the surface of the object 113-2 based on the plurality of acquired imaging images. Next, the output unit 318 presents the result of the inspection to the user via the display 105. Further, the output unit 318 notifies the conveyance unit 306 of the result of the inspection.

[0071] Here, in S405 to S406, the description is given assuming that the appearance inspection is performed based on the captured image. However, the processing executed using the captured image here is not limited in this way. For example, in S405, the color / shape inspection unit 316 may estimate the normal distribution of the surface of the object 113-2 by the illuminance difference stereo method based on a plurality of acquired captured images.

[0072] Hereinafter, such appearance inspection processing will be described with reference to FIG. 5. FIG. 5(a) shows an example of parameter setting values when capturing an image of one object and performing appearance inspection processing. FIG. 5(b) shows an example of the waveform of each signal when capturing an image based on the parameter setting values shown in FIG. 5(a). The parameter setting values shown in FIG. 5(a) are assumed to be set by the user via the mouse 106 and the keyboard 107. The parameter setting values in FIG. 5(a) associate the GPIO (L_out_1 to L_out8 and L_out_33) that outputs the lighting signal, the lighting time, the light source to be lit, and the use of the captured image for each count from 1 to 9. In the case of FIG. 5(a), nine captured images are acquired corresponding to the counts from 1 to 9. The lighting time in FIG. 5(a) corresponds to the period during which the lighting signal is turned ON. For example, in the example of FIG. 5(a), when the count is 1, the lighting signal L_out_1 is turned ON for 30 milliseconds, and thereby the light source L1 is lit for 30 milliseconds. Also, when the count is 2, the lighting signal L_out_2 is turned ON for 30 milliseconds, and thereby the light source L2 is lit for 30 milliseconds. Similarly, when the count is 9, the lighting signal L_out_33 is turned ON for 30 milliseconds, and thereby a plurality of light sources from L33 to L40 are lit simultaneously for 30 milliseconds. Here, as shown in FIG. 5(a), between counts 1 to 8, eight light sources from L1 to L8 are lit individually in sequence. On the other hand, when the count is 9, eight light sources from L33 to L40 are lit simultaneously.

[0073] The information processing apparatus 102 according to this embodiment can perform inspection of the color or shape of an object, or inspection of gloss, as an appearance inspection process of the object, based on a plurality of captured images. When performing the appearance inspection process on the surface of the object 113-2, first, the inspection image acquisition unit 315 distributes a plurality of captured images to the color / shape inspection unit 316 and the gloss inspection unit 317. The eight light sources L1 to L8 that are lit while the count is from 1 to 8 have a zenith angle of 80°, and as shown in FIG. 1(d), can irradiate light on the object 113-2 from a relatively low angle. The captured image obtained at this time hardly contains a specular reflection component, and thus is considered suitable for the color / shape inspection of the surface of the object 113-2. Also, when irradiating light from a low angle, the contrast of the shadow caused by the shape of the surface of the object 113-2 is emphasized, and thus the captured image obtained at this time is considered suitable for the shape inspection. Therefore, as the use of the eight captured images obtained while the count is from 1 to 8, in the example of FIG. 5(a), color / shape inspection is set. The inspection image acquisition unit 315 outputs the eight captured images obtained while the count is from 1 to 8 to the color / shape inspection unit 316 based on this setting.

[0074] On the other hand, the eight light sources L33 to L40 that are lit simultaneously when the count is 9 have a zenith angle of 10°, and as shown in FIG. 1(d), can irradiate light on the object 113-2 from a relatively high angle. The captured image obtained at this time contains a large amount of specular reflection components, and thus is considered suitable for the gloss inspection of the surface of the object 113-2. Therefore, as the use of the one captured image obtained when the count is 9, in the example of FIG. 5(a), gloss inspection is set. The inspection image acquisition unit 315 outputs the one captured image obtained when the count is 9 to the gloss inspection unit 317 based on this setting.

[0075] Then, in S405, the color / shape inspection unit 316 performs a color / shape inspection on the surface of the object based on the captured image distributed by the inspection image acquisition unit 315, and outputs the result to the output unit 318. Similarly, in S406, the gloss inspection unit 317 performs a gloss inspection on the surface of the object based on the captured image distributed by the inspection image acquisition unit 315, and outputs the result to the output unit 318.

[0076] Specifically, the color / shape inspection unit 316 and the gloss inspection unit 317 extract the defective region on the surface of the object 113-2 by applying a predetermined spatial filtering process to each captured image. For example, as the spatial filter, a DoG (Difference of two Gaussian) filter corresponding to the spatial scale to be extracted is used. Then, threshold processing is applied to the image to which the spatial filtering process has been applied. If there are no pixels exceeding a predetermined threshold, the inspection is considered passed, and if there are pixels exceeding the predetermined threshold, the inspection is considered failed. In this way, the color / shape inspection unit 316 and the gloss inspection unit 317 perform pass / fail determination for each captured image. When all captured images pass the inspection (here, when both the color / shape inspection and the gloss inspection pass), a passed inspection is output as the final result. On the other hand, if there is even one captured image that fails the inspection, a failed inspection is output as the final result.

[0077] Note that the inspection process performed here is not limited to this, and any known inspection process using the captured image may be adopted. For example, as a method of the inspection process, the process described in Patent Document 1 may be executed.

[0078] In S407, the conveyance unit 306 determines whether the imaging of all objects has been completed. If the imaging of all objects has been completed, the process shown in FIG. 5(a) ends, and if not, the process returns to S401. Here, it is assumed that the object for which imaging has been completed is conveyed to the position of the object 113-2 at the timing when the conveyance device 112 operates and is carried out externally by the robot arm.

[0079] In this embodiment, the control of the robotic arm is performed by the image processing device 104 via the conveyance control device 111. Specifically, when the inspection result is qualified, the image processing device 104 conveys the object 113-2 to a tray for storing qualified products by controlling the robotic arm. On the other hand, when the inspection result is unqualified, the image processing device 104 conveys the object 113-2 to a tray for storing unqualified products by controlling the robotic arm. Thus, in this embodiment, the post-process treatment implemented based on the inspection result is performed by a device different from the device (information processing device 102) that controls the lighting of the light source and imaging. Thereby, since the processing delay of the program code executed by the information processing device 102 is reduced, the lighting timing of the light source and the imaging timing can be made to match more accurately.

[0080] <Details of the processing in S404> Next, with reference to FIG. 4(b), S404 will be described in detail. In S404, the imaging control unit 302 controls the imaging unit 303 and the illumination unit 305 to image the object at the imaging position. FIG. 4(b) shows the processing flow by the imaging control unit 302. It is assumed that the processing of S409 to S420 shown in FIG. 4(b) is executed by the program code read in the information processing device 102.

[0081] First, after stopping the conveyance of the object in S403, the start signal output unit 301 sends an imaging start signal to the release signal output unit 307 included in the imaging control unit 302. When the imaging start signal is input, in S409, the imaging control unit 302 sets the count of the sync signal to 0. In FIG. 5(b), at time t0, the state where the count is set to 0 is shown.

[0082] Next, at S410, the release signal output unit 307 sends a release signal to the release signal input unit 311. In Fig. 5(b), at time tR, the state where the release signal switches from OFF to ON is shown. At time tR, R_out of the control unit 114 included in the information processing apparatus 102 switches from the LOW potential to the HIGH potential at the timing when the release signal switches from OFF to ON. On the other hand, R_in of the control unit 125 included in the imaging apparatus 103 switches from the HIGH potential to the LOW potential at the timing when the release signal switches from OFF to ON at time tR. Then, the state where the release signal is ON continues during the period from time tR to time t9. During this period, the imaging unit 303 performs continuous imaging and acquires nine imaging images.

[0083] In this embodiment, the ON / OFF of the release signal is controlled based on the number of acquisition times of the sync signal output from the imaging unit 303. Here, the imaging control unit 302 counts the number of acquisition times of the sync signal output from the imaging unit 303, and when the count reaches a predetermined number, the release signal can be turned OFF. For example, in the case of Fig. 5(a), the imaging control unit 302 turns OFF the release signal when the count of the sync signal reaches 9. According to such processing, it becomes possible to stop continuous imaging when the number of acquired still images reaches a predetermined number.

[0084] Also, with reference to Fig. 4(c), the imaging process according to the sync signal by the imaging unit 303 will be described. Fig. 4(c) is a flowchart showing an example of the imaging process in the imaging unit 303. Each process of S421 to S424 shown in Fig. 4(c) is executed by the program code read in the imaging apparatus 103.

[0085] First, at time tR shown in FIG. 5(b), the release signal input unit 311 acquires a release signal from the release signal output unit 307. When the release signal becomes ON, the control unit 312 controls the image acquisition unit 314 and the sync signal output unit 313 to start continuous imaging, continues continuous imaging while the release signal is ON, and stops continuous imaging when the release signal becomes OFF.

[0086] When the release signal becomes ON at time tR, the image acquisition unit 314 starts imaging at the timing of time t1. The period from time tR to time t1 is the release time lag, and when a consumer camera is used as the imaging device 103, the period from time tR to time t1 varies depending on the situation.

[0087] In S421, at the same time as the imaging started at the timing of time t1, the sync signal output unit 313 turns ON the sync signal at the timing of time t1 when the imaging starts. That is, in S421, the sync signal output unit 313 outputs a sync signal to the sync signal input unit 308 provided in the imaging control unit 302 at the timing of time t1. Here, the timing to start imaging is the timing to start exposure. <s

[0088] In S422, the image acquisition unit 314 performs exposure for a period corresponding to the set value of the shutter speed and images the object. Next, in S423, the sync signal output unit 313 turns OFF the sync signal at the timing of ending the imaging. That is, in the process of FIG. 4(c), the sync signal is ON during the period of exposure and OFF during the period without exposure. In this embodiment, it is assumed that the set value of the shutter speed is 1 / 60 second.

[0089] In S424, the release signal input unit 311 determines whether the release signal is ON. If the release signal is ON, the process returns to S401 to continue continuous imaging; otherwise (when the release signal becomes OFF), the process of FIG. 4(c) ends and continuous imaging stops.

[0090] The state in which the sync signal changes in continuous imaging is shown in Fig. 5(b). In the example of Fig. 5(b), the period during which the release signal is ON is from time tR to time t9. During this period, continuous imaging is performed and nine still images are captured. When each still image is captured, X_out of the control unit 125 provided in the imaging device 103 switches from the LOW potential to the HIGH potential at the timing when the sync signal switches from OFF to ON at the start of imaging. On the other hand, X_in of the control unit 114 provided in the information processing device 102 switches from the HIGH potential to the LOW potential at the timing when the sync signal switches from OFF to ON at the start of imaging. Each lighting signal switches from OFF to ON in synchronization with the timing when the sync signal switches from OFF to ON, and the ON state continues for a predetermined time. In the case of Fig. 5(a), since the lighting time is uniformly set to 30 milliseconds, each light source lights up for 30 milliseconds in accordance with the imaging timing.

[0091] Here, the lighting time is described as being set to 30 milliseconds for each light source, but the setting of the lighting time is not particularly limited in this way. The information processing device 102 can set the lighting time for each light source individually or as the same value.

[0092] In general, in a consumer camera, the pulse width of the sync signal, that is, the period during which the sync signal is ON, cannot be freely set. For example, in a certain consumer camera, the pulse width of the sync signal changes depending on the set value of the shutter speed. Therefore, when a consumer camera is used as the imaging device 103, if the sync signal is used directly as the lighting signal of the light source, the lighting time of the light source may not be freely set.

[0093] For example, the captured image may be too bright and white blooming may occur. Conversely, the captured image may be too dark and black crush may occur. In that case, by adjusting the lighting time of the light source, white blooming and black crush can be eliminated. However, if the sync signal is used as it is as the lighting signal of the light source as described above and the lighting time of the light source cannot be freely set, it is difficult to eliminate white blooming or black crush by adjusting the lighting time of such a light source. On the other hand, according to the configuration according to the present embodiment, the pulse width of the lighting signal, that is, the period during which the lighting of the light source continues, can be set for each lighting signal. Thereby, the lighting time of the light source can be individually adjusted for each light source, and white blooming or black crush can also be eliminated.

[0094] For example, in multi-lamp lighting, the luminous flux of some light sources may decrease due to changes over time. Even in such a case, according to the configuration according to the present embodiment, by individually adjusting the lighting time of the light source for each light source, the influence of changes over time can be reduced.

[0095] For example, due to the accumulation of delays in each process, the timing of imaging and the lighting of the light source may not match. In that case, by setting the lighting time longer than the exposure time, that is, by setting the shutter speed in the imaging device, the influence of the timing deviation due to the accumulation of delays in each process can be reduced. For example, when the shutter speed is 1 / 60 second, the lighting time is set to about 2 times that, 30 milliseconds. Also, depending on the imaging device, the timing of the exposure start may be delayed with respect to the timing of outputting the sync signal. In that case, the lighting timing of the light source may be delayed by setting a predetermined light emission delay time for each lighting signal. The light emission delay time according to the present embodiment is a delay time provided before light emission control, which is set with respect to the input or output of the lighting signal.

[0096] Here, return to the description of the processing flow (Fig. 4(b)) by the imaging control unit 302. In the processing after S410, the imaging control unit 302 images the surface of the object while turning on a plurality of light sources (here, L1 to L40 shown in Fig. 2) constituting multi-light illumination, either individually or simultaneously in a plurality, in a predetermined order, for a predetermined time. Thereby, a plurality of captured images with different illumination directions are acquired.

[0097] S411 to S420 are loop processes that are repeatedly performed. Here, in S420, the end determination of the loop process is performed. The imaging control unit 302 always executes S411 and S418 in each loop of this loop process.

[0098] In S411, the imaging control unit 302 determines whether the sync signal has changed from OFF to ON. As described above, in this embodiment, the sync signal changes from OFF to ON at the timing when the imaging of the still image is started. If the determination in S411 is YES, the process proceeds to S412; otherwise, the process proceeds to S418.

[0099] In order to determine whether the sync signal has changed from OFF to ON, for example, in S411, the imaging control unit 302 acquires and stores the potential of X_in of the control unit 114. Then, when the imaging control unit 302 executes S411 in the next loop process, it compares the potential of X_in stored in the past with the current potential of X_in. At this time, when the potential of X_in stored in the past is HIGH potential and the current potential of X_in is LOW potential, it is determined that the sync signal has changed from OFF to ON. Note that the change of the sync signal may be determined using the interrupt function of the control unit 114. In that case, instead of executing S411 in the flow of Fig. 4(b), an interrupt is generated when the potential of X_in changes from LOW potential to HIGH potential. Then, when the interrupt occurs, the processes from S412 to S417 are executed.

[0100] By constantly executing S411, the imaging control unit 302 constantly monitors whether a sync signal is input from the imaging unit 303. Next, at the timing when the sync signal is input, the imaging control unit 302 executes the processes from S412 to S417. According to such processes, it becomes possible to switch the lighting signal from OFF to ON and switch the release signal from ON to OFF based on the count of the sync signal.

[0101] In S412, the count unit 309 included in the imaging control unit 302 increments the count of the sync signal. The count of the sync signal corresponds to the count of the number of still images captured in continuous imaging. In FIG. 5(b), the state in which the count of the sync signal changes from 0 to 9 is shown. Hereinafter, when simply referred to as "count", it refers to the count of this sync signal.

[0102] In S413, the count unit 309 determines whether the count of the sync signal has reached a predetermined count. In the present embodiment, as shown in FIG. 5(a), nine captured images are acquired corresponding to the counts from 1 to 9. Therefore, the predetermined count used in S413 is 9. If the determination in S413 is YES, the process proceeds to S414, and if not, the process proceeds to S415.

[0103] In S414, the count unit 309 sends an imaging stop command to the release signal output unit 307 and advances the process to S415. When the release signal output unit 307 receives the imaging stop command, it turns off the release signal. For example, as shown in FIG. 5(b), at time t9, at the timing when the sync signal changes from OFF to ON, the count of the sync signal becomes 9. At this timing, the count unit 3 serves as 09 to send an imaging stop command to the release signal output unit 307. Next, the release signal output unit 307 turns off the release signal according to the imaging stop command. At this timing, the imaging unit 303 stops continuous imaging.

[0104] When using a consumer camera as the imaging device 103, the intervals between the timings of capturing each still image in continuous imaging may become uneven as shown in Fig. 5(b). If the intervals between the timings of capturing each still image in continuous imaging were equal, continuous imaging could be stopped at a predetermined number of images by adjusting the period during which the release signal is turned ON. For example, in this embodiment, it is assumed that the number of images captured per second during continuous imaging is 30, and the imaging device 103 has set a continuous imaging mode corresponding to this assumption. In this case, if the intervals between the imaging timings of each still image are equal, the period for which the release signal should be turned ON can be calculated by multiplying 1 / 30 second by the desired number of images. For example, when the desired number of images is 9, the period for which the release signal should be turned ON is 3 / 10 second. However, in reality, since the intervals between the timings of capturing each still image become uneven as shown in Fig. 5(b), the number of captured images may become 8 or 10.

[0105] Thus, in the case of using an imaging device in which the intervals between imaging timings during continuous imaging are uneven, continuous imaging could not be stopped at a predetermined number of images within a predetermined time. On the other hand, the imaging control unit 302 in this embodiment stops the output of the release signal based on the number of acquisition times of the sync signal (particularly when the number of acquisition times of the sync signal exceeds a predetermined number). Therefore, even in the case of using an imaging device (e.g., a consumer camera) in which the intervals between imaging timings during continuous imaging are uneven, continuous imaging can be stopped at a predetermined number of images within a predetermined time. In particular, in a case where, as in this embodiment, an appearance inspection of an industrial product is performed based on a plurality of images acquired by continuous imaging, accurate inspection results may not be obtained if the number of captured images fluctuates. Also, if the number of captured images exceeds the predetermined number, the data transfer time may increase, resulting in exceeding the time required for the appearance inspection. Therefore, in particular, in appearance inspection, it is important that continuous imaging can be stopped at a predetermined number of images. Note that when using an imaging device in which the intervals between imaging timings during continuous imaging are equal, the output of the release signal may be stopped based on the time predicted from the imaging interval.

[0106] Before explaining S415, S416 will be explained. In S416, the lighting signal output unit 310 turns on the lighting signal corresponding to the count to turn on the light source. At this time, if the light source lit in the previous count is in the lit state, an imaging image in the desired illumination direction cannot be obtained. For example, due to a user's setting mistake, if the lighting time shown in FIG. 5(a) is set longer than the interval of continuous imaging of the imaging device 103, the light source lit in the previous count will be in the lit state. For example, when the number of imaging frames per second during continuous imaging is about 30, although the interval of continuous imaging varies with each imaging, it is approximately 1 / 30 second. At this time, if a value longer than 1 / 30 second is set as the set value of the lighting time, the previously lit light source and the next lit light source will be in the state of being lit simultaneously. Therefore, before executing S416, in S415, the lighting signal output unit 310 turns off all the lighting signals. As a result, all the light sources included in the lighting unit 305 are turned off. That is, the lighting signal output unit 310 turns off the light source lit in the previous loop before starting the lighting in the new count. Here, the lighting signal output unit 310 can control the lighting of the light source so that the continuous lighting time of the light source does not exceed the interval between imaging in multiple imaging operations. In this way, by controlling the lighting and extinguishing of the light source so as not to exceed the time interval of each imaging in continuous imaging, the influence of setting mistakes can be prevented.

[0107] After executing S415, at S416, the lighting signal output unit 310 turns on the lighting signal corresponding to the count. For example, in the case where the setting shown in FIG. 5(a) is made, when the count is 1, the lighting signal output unit 310 turns on the lighting signal L_out_1; when the count is 2, it turns on the lighting signal L_out_2; and when the count is 9, it turns on the lighting signal L_out_33. Next, the lighting unit 305 turns on the light source corresponding to the lighting signal. For example, when the count is 1, the lighting unit 305 turns on the light source L1; when the count is 2, it turns on the light source L2; and when the count is 9, it turns on a plurality of light sources from L33 to L40 simultaneously. That is, the lighting unit 305 sequentially turns on the eight light sources from L1 to L8 individually when the count is from 1 to 8, and turns on the eight light sources from L33 to L40 simultaneously when the count is 9.

[0108] Note that the microcomputer of the control unit 114 operates at a clock frequency of several tens of megahertz. Therefore, the processing from S412 to S415 is completed in the order of microseconds. That is, the time from the timing when the sync signal changes from OFF to ON until S416 is executed is on the order of microseconds. On the other hand, the exposure time in the imaging device 103 is from several milliseconds to several tens of milliseconds depending on the setting of the shutter speed. Therefore, the imaging start timing at which the sync signal is output and the lighting timing of the light source can be regarded as being practically coincident.

[0109] Next, in S417, in order for the lighting signal output unit 310 to continue the state where the lighting signal is ON for a predetermined period, for the lighting signal turned ON in S416, it starts measuring the elapsed time since the lighting signal was turned ON. For example, the control unit 114 provided in the information processing apparatus 102 of the lighting signal output unit 310 can measure the elapsed time by counting the clock for operating the microcomputer. Here, the measurement of the elapsed time is performed for each lighting signal. Note that the period during which the lighting signal is turned ON corresponds to the lighting time of the light source, and is set by the user for each lighting signal. In the example of Fig. 5(a), the same lighting time (30 milliseconds) is set for all lighting signals (from L_out_1 to L_out_8 and L_out_33). However, it is not necessary to unify the lighting time of the light sources. For example, the lighting time may be controlled for each light source, or for the same light source, the lighting time may be controlled for each lighting timing. The lighting time for each lighting signal is set as a parameter in the program code operating in the control unit 114 provided in the information processing apparatus 102. Note that the same applies to the light emission delay time for each lighting signal described above. When S417 ends, the process proceeds to S418.

[0110] In S418, the lighting signal output unit 310 determines whether there is a lighting signal for which the elapsed time when ON has reached the predetermined time. If the determination in S418 is YES, the process proceeds to S419, and if not, the process proceeds to S420.

[0111] By constantly executing S418, the imaging control unit 302 constantly monitors the elapsed time since the lighting signal was switched from OFF to ON for each lighting signal. Next, when the monitored elapsed time reaches the predetermined elapsed time set for each lighting signal, the imaging control unit 302 switches the corresponding lighting signal to OFF in S419.

[0112] In S419, the lighting signal output unit 310 turns off the lighting signal that is determined in S418 to have reached the predetermined time with the ON elapsed time. According to such processing, the period during which the lighting signal is ON is controlled for each lighting signal. In FIG. 5(b), it is shown that all the lighting signals (L_out_1 to L_out_8 and L_out_33) are ON only for a period of 30 milliseconds, which is the uniform lighting time set in FIG. 5(a).

[0113] In S420, the imaging control unit 302 determines whether the release signal is OFF and whether all the lighting signals are OFF. If the determination in S420 is YES, the process in FIG. 4(c) ends; otherwise, the process returns to S411.

[0114] <Effect of this embodiment> According to such a configuration, even when using an imaging device in which the release time lag varies for each imaging, the lighting of the light source can be controlled in response to acquiring the sync signal output by the imaging device at the imaging timing. Therefore, it is possible to match the lighting timing of the light source with the imaging timing.

[0115] Also, since the lighting signal output unit 310 measures the elapsed time after the start of lighting for each lighting signal, the lighting time can be individually controlled for each light source. Therefore, even when the light emission amount of some light sources decreases due to changes over time of the device, the influence of changes over time can be reduced by individually adjusting the lighting time for each light source.

[0116] In the image processing system 1, means for outputting an imaging instruction signal to the imaging device 103, means for acquiring an imaging timing signal from the imaging device 103, and means for controlling the lighting of the light source can be operated within the same device (particularly, the information processing device 102). Further, the image processing, the process of outputting an imaging start signal, and the post-process implemented based on the inspection result described in the present embodiment may be executed by a device (CPU) different from the information processing device 102 that controls the lighting of the light source and imaging. According to such a configuration, the processing delay of the program code being executed by the information processing device 102 can be reduced. Thereby, the lighting timing of the light source and the imaging timing can be made to coincide more accurately.

[0117] Also, even when using an imaging device in which the intervals of the imaging timing during continuous imaging are uneven, since the output of the release signal is stopped based on the number of acquisitions of the sync signal, continuous imaging can be stopped at a predetermined number of images. Thereby, in a case where an appearance inspection of an industrial product is performed based on a plurality of images acquired by continuous imaging, a more accurate inspection result can be obtained.

[0118] [Modification Example] Note that even if the output of the release signal is stopped based on the number of acquisitions of the sync signal, depending on the model of the imaging device, due to the processing delay, the stop of continuous imaging may be delayed and the number of captured images may exceed the predetermined number. Therefore, the information processing device 102 prepares to turn off the release signal when the number of captured images reaches a point before the predetermined number of default images. Specifically, the information processing device 102 starts measuring the elapsed time when it reaches a point before the predetermined number of default images (N images), and turns off the release signal at the timing when the time predicted to reach the predetermined number of images by continuous imaging has elapsed. Note that the time when the number of images captured by continuous imaging reaches the predetermined number is predicted based on the number of images captured per second during continuous imaging.

[0119] In Embodiment 1, 30 images per second are assumed as the number of images captured per second during continuous imaging, and the imaging device 103 sets a continuous imaging mode corresponding to this assumption. In this case, the imaging time per image is approximately 1 / 30 second. Therefore, when the information processing device 102 starts preparing to turn off the release signal one image before the predetermined number of images, the information processing device 102 turns off the release signal at the timing when 1 / 30 second has elapsed since the number of captured images reached one image before the predetermined number. Similarly, when the information processing device 102 starts preparing to turn off the release signal three images before the predetermined number of images, the information processing device 102 turns off the release signal at the timing when 1 / 10 second has elapsed since the number of captured images reached three images before the predetermined number.

[0120] FIG. 7 is a flowchart showing an example of information processing by the information processing device 102 in a case where preparation to turn off such a release signal is started from a predetermined number of images before the default number of images. The process shown in FIG. 7 is performed in the same manner as FIG. 4(b) except that S701 to S702 are performed instead of S413 to S414, and S703 to S704 are added as subsequent processes to S418 or S419, so duplicate explanations are omitted.

[0121] In S701, the count unit 309 determines whether the count has reached before a predetermined number (hereinafter referred to as N images) of the default count. If the determination in S701 is YES, the process proceeds to S702, and if not, the process proceeds to S415.

[0122] In S702, the count unit 309 starts measuring the elapsed time until the release signal is turned off. This elapsed time is constantly monitored in S703. Specifically, in S703, the count unit 309 determines whether the elapsed time until the release signal is turned off has reached a predetermined time. S703 is a process performed when the determination in S418 is NO, or when S419 is completed. Here, the predetermined time is the time predicted when the number of images captured by continuous imaging reaches the predetermined number. If the determination in S703 is YES, the process proceeds to S704, and if not, the process proceeds to S420.

[0123] At S704, the counting unit 309 sends an imaging stop command to the release signal output unit 307. When the release signal output unit 307 receives the imaging stop command, it turns off the release signal. As a result, the imaging unit 303 stops continuous imaging. As described above, according to the configuration shown in FIG. 7, even when using an imaging device in which the stop of continuous imaging is delayed due to processing delay, it is possible to stop continuous imaging at a predetermined number of sheets.

[0124] Also, when the emission amounts of the 32 light sources from L1 to L32 are the same, the brightness of the captured images obtained by individually lighting them will vary depending on the zenith angle of the light sources. This is because the larger the zenith angle, the larger the angular difference between the normal of the surface of the object and the light ray, and the smaller the vertical illuminance on the surface of the object. Therefore, the emission amount is individually set for each light source by changing the lighting time or the duty ratio of the PWM signal for each light source. Specifically, the information processing device 102 increases the emission amount for the light sources with a larger angular difference between the normal of the surface of the object and the light ray (the light sources with a larger zenith angle). Thereby, the brightness of the captured image can be made uniform regardless of the zenith angle of the light source. Also, among a plurality of light sources with the same zenith angle, the emission amount may vary depending on the azimuth angle. In that case as well, by individually setting the emission amount for each light source, the variation in the emission amount due to the azimuth angle can be reduced. In this way, the information processing device 102 can control the emission intensity of the lighting of the light sources included in the plurality of light sources for each light source.

[0125] Also, when individually lighting a plurality of light sources, the emission colors may vary depending on the light source. In that case, by adjusting the emission color for each light source, the influence of the variation in the emission color can be reduced. In this way, the information processing device 102 can control the emission color of the lighting of the light sources included in the plurality of light sources for each light source.

[0126] In addition, in Embodiment 1, when simultaneously lighting eight light sources from L33 to L40, one lighting signal (L_out_33) was used. However, multiple light sources may be simultaneously lit by turning on multiple lighting signals at the same time. For example, when simultaneously lighting eight light sources from L1 to L8, turn on L_out_1 to L_out8 simultaneously. At this time, as described above, the information processing apparatus may individually set the lighting time for each of the lighting signals from L_out_1 to L_out8. For example, the luminous fluxes of the light sources from L1 to L8 may vary. In that case, unevenness in the brightness of the captured image will occur when these are lit simultaneously. At this time, by individually setting the lighting times of L1 to L8, unevenness in the brightness of the captured image can be reduced. For example, the lighting times of L1 to L8 may be individually adjusted based on the captured image when imaging a surface with uniform reflection characteristics. Alternatively, when outputting a PWM waveform as the lighting signal, the duty ratio may be adjusted for each lighting signal to individually control the luminous flux.

[0127] Also, in accordance with the sync signal, the same light source may be lit multiple times. For example, by turning on L_out_1 at count 1 and count 2, the light source L1 may be lit twice to obtain two captured images with the same illumination direction. In this case, the information processing apparatus 102 may reduce the noise in the captured image by averaging these two captured images.

[0128] Also, when the information processing apparatus 102 lights the same light source multiple times, it may control the emission intensity of the light at each lighting timing. For example, when turning on L_out_1 in both Count 1 and Count 2 to light the light source L1 twice, the emission intensity may be changed by changing the lighting time or the duty ratio of the PWM signal between Count 1 and Count 2. Thereby, it is possible to acquire a plurality of captured images with the same lighting direction but different brightnesses, and perform HDR synthesis on those images. By acquiring a plurality of captured images with the same lighting direction but different brightnesses and synthesizing those images, it becomes possible to generate a multi-band image.

[0129] Similarly, when the information processing apparatus 102 lights the same light source multiple times, it may control the emission color of the light at each lighting timing. Similarly, when the same light source is lit multiple times, the lighting time may be controlled at each lighting timing.

[0130] In the present embodiment, the object has been described as a stationary object, but the object is not particularly limited in such a way. For example, it may be moving. For example, when continuously imaging a rotating object, a plurality of captured images with different rotation angles can be obtained. In that case, the information processing apparatus 102 may keep the light source lit all the time during continuous imaging, and turn off the light source at the timing when the acquisition count of the sync signal reaches a predetermined number. As described above, in the case of lighting the same light source multiple times, the lighting device 108 may be a device having only one light source. That is, the lighting device 108 is not limited to the multi-light source as described above.

[0131] Also, when sequentially lighting the light sources in accordance with the synchronization signal, the lighting pattern may be switched according to user settings, the type of the object, or the like. For example, when performing an appearance inspection of an industrial product as in Embodiment 1, the information processing apparatus 102 can switch the lighting pattern according to the type of the object, the required tact time, or the number of objects to be imaged simultaneously. For example, when a precise inspection is required, when there is a margin in the tact time, or when there are many objects to be imaged simultaneously, the information processing apparatus 102 may sequentially light 32 light sources from L1 to L32 individually, and then simultaneously light L33 to L40. On the other hand, when a precise inspection is not required, when there is no margin in the tact time, or when there are few objects to be imaged simultaneously, the information processing apparatus 102 may sequentially light 8 light sources from L1 to L8 individually. Thus, by switching the lighting pattern according to the situation, it becomes possible to perform imaging in accordance with the user's requirements.

[0132] The disclosure of this specification includes the following information processing apparatus, information processing method, and program. (Item 1) Output means for outputting an imaging instruction signal for instructing imaging to an imaging apparatus; Acquisition means for acquiring an imaging timing signal indicating the timing of performing imaging from the imaging apparatus; Control means for controlling the lighting of the light source in response to acquiring the imaging timing signal; An information processing apparatus comprising: (Item 2) Further comprising setting means for setting the lighting time of the light source, The information processing apparatus according to Item 1, wherein the control means controls the lighting of the light source based on the set lighting time. (Item 3) The information processing apparatus according to Item 1 or 2, wherein the control means controls the lighting of the light source so as to light for a time longer than the exposure time in the imaging. (Item 4) The information processing apparatus according to any one of items 1 to 3, wherein the output means outputs the imaging instruction signal to the imaging apparatus by controlling the energization state of the terminal for transmitting the imaging instruction signal. (Item 5) The information processing apparatus according to any one of items 1 to 4, wherein the acquisition means acquires the imaging timing signal by controlling the energization state of the terminal for receiving the imaging timing signal. (Item 6) The information processing apparatus according to any one of items 1 to 5, wherein the output means, the acquisition means, and the control means operate within the same apparatus. (Item 7) The output means outputs a continuous imaging instruction signal for instructing imaging a plurality of times as the imaging instruction signal. The information processing apparatus according to any one of items 1 to 6, wherein the acquisition means acquires the imaging timing signal for each imaging in the plurality of times of imaging from the imaging apparatus. (Item 8) The information processing apparatus according to item 7, wherein the control means controls the lighting of the light source so that the continuous lighting time of the light source does not exceed the interval between imaging in the plurality of times of imaging. (Item 9) The information processing apparatus according to item 7 or 8, wherein the output means outputs the imaging instruction signal to the imaging apparatus by controlling the energization state of the terminal for transmitting the continuous imaging instruction signal. (Item 10) The information processing apparatus according to any one of items 7 to 9, further characterized in that the output means outputs a signal for stopping the imaging to the imaging apparatus according to the number of times the acquisition means has acquired the imaging timing signal. (Item 11) The information processing apparatus according to item 10, wherein the output means outputs a signal for stopping the imaging when the number of times the acquisition means has acquired the imaging timing signal exceeds a predetermined number of times. (Item 12) The output means outputs a signal for stopping the imaging at a timing when a predetermined time has elapsed since the number of times the acquisition means has acquired the imaging timing signal exceeds a predetermined number of times. The information processing apparatus according to item 10 or 11. (Item 13) The control means controls each light source included in the plurality of light sources to light up in a predetermined order. The output means outputs the imaging instruction signal for the imaging apparatus to perform imaging a plurality of times according to the control of the lighting order of the light sources. The information processing apparatus according to any one of items 1 to 12. (Item 14) The control means causes the light sources of the first group included in the plurality of light sources to fall down at different timings, and causes the light sources of the second group included in the plurality of light sources to light up simultaneously. The information processing apparatus according to item 13. (Item 15) The control means controls the lighting time of each light source included in the plurality of light sources for each light source. The information processing apparatus according to item 13 or 14. (Item 16) The control means controls the emission intensity of the lighting of each light source included in the plurality of light sources for each light source. The information processing apparatus according to any one of items 13 to 15. (Item 17) The control means controls the emission color of the lighting of each light source included in the plurality of light sources for each light source. The information processing apparatus according to any one of items 13 to 16. (Item 18) The control means controls the delay time in the emission of each light source included in the plurality of light sources for each light source. The information processing apparatus according to any one of items 13 to 17. (Item 19) The information processing apparatus further includes setting means for setting the predetermined order of lighting of the plurality of light sources. The information processing apparatus according to any one of items 13 to 18. (Item 20) The information processing apparatus according to any one of items 13 to 19, further comprising first inspection means for inspecting the color or shape of a subject based on a plurality of captured images obtained by the plurality of times of imaging. (Item 21) The information processing apparatus according to any one of items 13 to 20, further comprising second inspection means for inspecting the gloss of a subject based on a plurality of captured images obtained by the plurality of times of imaging. (Item 22) The information processing apparatus according to any one of items 13 to 21, wherein the control means further controls a light source to be lit among the plurality of light sources according to the number of times the acquisition means has acquired the imaging timing signal. (Item 23) The information processing apparatus according to item 22, wherein the control means controls the lighting of the light source by controlling the output of a signal from a terminal corresponding to the light source to be lit among the plurality of light sources. (Item 24) The control means performs control so that the same light source lights up a plurality of times, The information processing apparatus according to any one of items 1 to 23, wherein the output means outputs the imaging instruction signal for the imaging device to perform imaging a plurality of times according to the control of the same light source lighting up a plurality of times. (Item 25) The information processing apparatus according to item 24, wherein the control means performs control of lighting up the same light source a plurality of times so as to control the lighting time for each lighting timing. (Item 26) The information processing apparatus according to item 24 or 25, wherein the control means performs control of lighting up the same light source a plurality of times so as to control the emission intensity of the light for each lighting timing. (Item 27) The information processing apparatus according to any one of items 24 to 26, wherein the control means performs control of lighting up the same light source a plurality of times so as to control the emission color of the light for each lighting timing. (Item 28) A step of outputting an imaging instruction signal for instructing imaging to an imaging device; A step of acquiring an imaging timing signal indicating the timing of performing imaging from the imaging device; A step of controlling the lighting of a light source in response to acquiring the imaging timing signal; An information processing method comprising the above. (Item 29) A program for causing a computer to function as each means of the information processing apparatus according to any one of Items 1 to 27.

[0133] (Other embodiments) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and causing one or more processors in the computer of the system or apparatus to read and execute the program. Further, it can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

[0134] The invention is not limited to the above-described embodiments, and various changes and modifications are possible without departing from the spirit and scope of the invention. Therefore, claims are attached to disclose the scope of the invention.

Explanation of reference numerals

[0135] [[ID=

Claims

1. Output means for outputting an imaging instruction signal for instructing imaging to an imaging device; Acquisition means for acquiring an imaging timing signal indicating the timing of performing imaging from the imaging device; Control means for controlling the lighting of a light source in response to acquiring the imaging timing signal; An information processing apparatus comprising the above.

2. Further comprising setting means for setting the lighting time of the light source, The information processing apparatus according to claim 1, wherein the control means controls the lighting of the light source based on the set lighting time.

3. The information processing apparatus according to claim 1, wherein the control means controls the lighting of the light source so as to light for a time longer than the exposure time in the imaging.

4. The information processing apparatus according to claim 1, wherein the output means outputs the imaging instruction signal to the imaging device by controlling the energization state of a terminal for transmitting the imaging instruction signal.

5. The information processing apparatus according to claim 1, wherein the acquisition means acquires the imaging timing signal by controlling the energization state of a terminal for receiving the imaging timing signal.

6. The information processing apparatus according to claim 1, wherein the output means, the acquisition means, and the control means operate within the same device.

7. The output means outputs a continuous imaging instruction signal for instructing imaging a plurality of times as the imaging instruction signal, The information processing apparatus according to claim 1, wherein the acquisition means acquires the imaging timing signal for each imaging in the plurality of times of imaging from the imaging device.

8. The information processing apparatus according to claim 7, wherein the control means controls the lighting of the light source so that the continuous lighting time of the light source does not exceed the interval between the imagings in the plurality of times of imaging.

9. The information processing apparatus according to claim 7, wherein the output means outputs the imaging instruction signal to the imaging device by controlling the energization state of a terminal for transmitting the continuous imaging instruction signal.

10. The information processing apparatus according to claim 7, further characterized in that the output means outputs a signal for stopping the imaging to the imaging device according to the number of times the acquisition means has acquired the imaging timing signal.

11. The information processing apparatus according to claim 10, wherein the output means outputs a signal for stopping the imaging when the number of times the acquisition means has acquired the imaging timing signal exceeds a predetermined number of times.

12. The information processing apparatus according to claim 10, wherein the output means outputs a signal for stopping the imaging at a timing when a predetermined time has elapsed since the number of times the acquisition means has acquired the imaging timing signal exceeded a predetermined number of times.

13. The control means controls each light source included in the plurality of light sources to light up in a predetermined order. The information processing apparatus according to claim 1, wherein the output means outputs the imaging instruction signal for the imaging apparatus to perform imaging a plurality of times according to the control of the lighting order of the light sources.

14. The information processing apparatus according to claim 13, wherein the control means causes the light sources in the first group included in the plurality of light sources to fall down at different timings and causes the light sources in the second group included in the plurality of light sources to light up simultaneously.

15. The information processing apparatus according to claim 13, wherein the control means controls the lighting time of each light source included in the plurality of light sources for each light source.

16. The information processing apparatus according to claim 13, wherein the control means controls the emission intensity of the lighting of each light source included in the plurality of light sources for each light source.

17. The information processing apparatus according to claim 13, wherein the control means controls the emission color of the lighting of each light source included in the plurality of light sources for each light source.

18. The information processing apparatus according to claim 13, wherein the control means controls the delay time in the emission of each light source included in the plurality of light sources for each light source.

19. The information processing apparatus according to claim 13, further comprising setting means for setting the predetermined order of the lighting of the plurality of light sources.

20. The information processing apparatus according to claim 13, further comprising first inspection means for inspecting the color or shape of a subject based on a plurality of captured images obtained by the plurality of times of imaging.

21. The information processing apparatus according to claim 13, further comprising second inspection means for inspecting the gloss of a subject based on a plurality of captured images obtained by the plurality of times of imaging.

22. The information processing apparatus according to claim 13, wherein the control means further controls a light source to be lit among the plurality of light sources according to the number of times the acquisition means has acquired the imaging timing signal.

23. The information processing apparatus according to claim 22, wherein the control means controls the lighting of the light source by controlling the output of a signal from a terminal corresponding to the light source to be lit among the plurality of light sources.

24. The control means performs control so that the same light source is lit a plurality of times, The output means outputs the imaging instruction signal for the imaging device to perform imaging a plurality of times according to the control of the same light source being lit a plurality of times, according to claim 1 of the information processing apparatus.

25. The information processing apparatus according to claim 24, wherein the control means performs control of lighting the same light source a plurality of times so as to control the lighting time for each lighting timing.

26. The information processing apparatus according to claim 24, wherein the control means performs control of lighting the same light source a plurality of times so as to control the emission intensity of the light for each lighting timing.

27. The information processing apparatus according to claim 24, wherein the control means performs control of lighting the same light source a plurality of times so as to control the emission color of the light for each lighting timing.

28. A step of outputting an imaging instruction signal for instructing imaging to an imaging device; A step of acquiring an imaging timing signal indicating a timing for performing imaging from the imaging device; A step of controlling the lighting of a light source in response to acquiring the imaging timing signal; An information processing method comprising:

29. A program for causing a computer to function as each means of the information processing apparatus according to any one of claims 1 to 27.

Images