Synthesis image generating device and method, and image acquiring device and method

Abstract

This synthesis image generating device comprises: a lighting part (40) that illuminates a subject by using light from a light source (42); a photographing part (24) that photographs the subject lighted in a plurality of lighting states by the lighting part (40) and that generates a plurality of images; and a synthesis image generating part (70) that synthesizes the plurality of images including a subject form photographed by the photographing part (24). The synthesis image generating part (70) synthesizes portions the plurality of images, said portions not including the form of the light source in the images.

Claims

1. A composite image generation device comprising: an illumination unit that illuminates a subject with light from a light source; an imaging unit that photographs the subject illuminated by the illumination unit in multiple illumination states and generates multiple images; and a composite image generation unit that synthesizes multiple images including the subject image captured by the imaging unit, wherein the composite image generation unit synthesizes multiple images of the portion of the image that does not include the image of the light source.

2. The composite image generating apparatus according to claim 1, wherein the image of the light source in the image is an image of the light source formed by reflection by the subject.

3. The composite image generation device according to claim 1 or 2, wherein the composite image generation unit includes an image portion selection unit that selects portions of the plurality of images that do not contain the image of the light source, and the portions selected by the image portion selection unit are combined.

4. The composite image generation device according to any one of claims 1 to 3, wherein the composite image generation unit synthesizes images of a predetermined partial region of the subject.

5. The composite image generation apparatus according to claim 4, wherein the illumination unit changes the illumination state according to the partial region.

6. A composite image generation apparatus according to any one of claims 1 to 5, comprising a rotating platform on which the subject can be placed and rotated, and a control unit that controls the rotating platform, the lighting unit, and the shooting unit.

7. A composite image generation device comprising: an illumination unit that illuminates a subject by irradiating it with illumination light from at least one light source; an illumination state changing unit that changes the illumination state of the subject by the illumination unit; an imaging unit that photographs the subject in a plurality of illumination states changed by the illumination state changing unit and generates a plurality of images; an image portion selection unit that, for each portion of the image, selects an image portion from the corresponding image portions in the plurality of images generated in each of the plurality of illumination states that the imaging unit determines does not include a specular reflection portion that photographs the specular reflection light of the illumination light; and an image synthesis unit that synthesizes the image portions selected by the image portion selection unit for each portion of the image.

8. The composite image generation apparatus according to claim 7, wherein the image portion selection unit selects an image portion from corresponding image portions in the plurality of images based on the brightness of that image portion.

9. The composite image generation apparatus according to claim 7, wherein the image portion selection unit selects an image portion from corresponding image portions in the plurality of images based on the size of a specific color component that is a color component of the image portion and is identified based on the properties of the light source or the subject.

10. The composite image generation apparatus according to claim 8 or 9, wherein the image portion selection unit selects an image portion from corresponding image portions in the plurality of images by excluding image portions in which the brightness of at least a part of the image portion is saturated.

11. The composite image generation apparatus according to claim 8 or 9, wherein the image portion selection unit selects an image portion from corresponding image portions in the plurality of images by excluding an image portion in which at least one part of the color component of the image portion is saturated.

12. The composite image generation apparatus according to any one of claims 7 to 11, wherein the illumination unit has a plurality of light sources, and the illumination state changing unit selects a light source from among the plurality of light sources to irradiate the subject with illumination light.

13. The composite image generation apparatus according to any one of claims 7 to 11, wherein the illumination state changing unit has a light source moving mechanism for moving the light source.

14. The composite image generation apparatus according to any one of claims 7 to 11, wherein the illumination state changing unit has a subject moving mechanism for moving the subject.

15. A composite image generating apparatus according to any one of claims 7 to 14, further comprising a shooting storage unit capable of housing the subject and photographing the subject, wherein the illumination unit transmits the illumination light through the shooting storage unit and irradiates the subject housed in the shooting storage unit, and the inner portion of the shooting storage unit is composed of similar colors throughout.

16. The composite image generation apparatus according to any one of claims 7 to 14, further comprising a shooting storage unit capable of housing the subject and photographing the subject, wherein the illumination unit transmits illumination light through the shooting storage unit and irradiates the subject housed in the shooting storage unit, and the inner portion of the shooting storage unit is configured to suppress the reflection of illumination light transmitted through the shooting storage unit and irradiated onto the inner portion.

17. A composite image generation apparatus according to any one of claims 7 to 16, wherein a texture image generation apparatus generates a texture image that is applied to a three-dimensional shape model to generate a three-dimensional model.

18. A three-dimensional model generation apparatus comprising: a three-dimensional shape model generation apparatus for generating a three-dimensional shape model of a subject; a texture image generation apparatus according to claim 17; and a three-dimensional model generation unit for generating a three-dimensional model by applying a texture image generated by the texture image generation apparatus to the three-dimensional shape model generated by the three-dimensional shape model generation apparatus.

19. A composite image generation method comprising: an illumination step of illuminating a subject by irradiating it with illumination light from at least one light source; an illumination state change step of changing the illumination state of the subject in the illumination step; a shooting step of photographing the subject in the multiple illumination states changed in the illumination state change step to generate multiple images; an image portion selection step of selecting, for each portion of the image, an image portion from the corresponding image portions in the multiple images generated in each of the multiple illumination states that is determined not to include the specular reflection portion captured in the shooting step of the specular reflection light of the illumination light; and an image synthesis step of synthesizing the image portions selected in the image portion selection step for each portion of the image.

20. An image acquisition device comprising: an illumination unit that illuminates a subject by irradiating it with illumination light from at least one light source; an illumination state changing unit that changes the illumination state of the subject by the illumination unit; an imaging unit that photographs the subject in a plurality of illumination states changed by the illumination state changing unit and generates a plurality of images; an image acquisition range setting unit that sets an image acquisition range for acquiring an image of the subject; an image portion selection unit that, with respect to the image acquisition range set by the image acquisition range setting unit, selects an image portion from the corresponding image portions of the plurality of images generated in each of the plurality of illumination states that the imaging unit determines does not include a specular reflection portion that photographs the specular reflection light of the illumination light; and a range image acquisition unit that acquires the image portion selected by the image portion selection unit with respect to the image acquisition range set by the image acquisition range setting unit.

21. The image acquisition apparatus according to claim 20, wherein the image portion selection unit selects an image portion from corresponding image portions in the plurality of images based on the brightness of that image portion.

22. The image acquisition apparatus according to claim 20, wherein the image portion selection unit selects an image portion from corresponding image portions in the plurality of images based on the size of a specific color component that is a color component of the image portion and is identified based on the properties of the light source or the subject.

23. The image acquisition apparatus according to claim 21 or 22, wherein the image portion selection unit selects an image portion from corresponding image portions in the plurality of images by excluding image portions in which the brightness of at least a part of the image portion is saturated.

24. The image acquisition apparatus according to claim 21 or 22, wherein the image portion selection unit selects an image portion from corresponding image portions in the plurality of images by excluding image portions in which at least one part of the color components of the image portion is saturated.

25. The image acquisition apparatus according to any one of claims 20 to 24, wherein the illumination unit has a plurality of light sources, and the illumination state changing unit selects a light source from among the plurality of light sources to irradiate the subject with illumination light.

26. The image acquisition apparatus according to any one of claims 20 to 24, wherein the illumination state changing unit has a light source moving mechanism for moving the light source.

27. The image acquisition apparatus according to any one of claims 20 to 24, wherein the illumination state changing unit has a subject moving mechanism for moving the subject.

28. An image acquisition method comprising: an illumination step of illuminating a subject by irradiating it with illumination light from at least one light source; an illumination state change step of changing the illumination state of the subject in the illumination step; a shooting step of photographing the subject in the multiple illumination states changed in the illumination state change step to generate multiple images; an image acquisition range setting step of setting an image acquisition range for acquiring an image of the subject; an image portion selection step of selecting an image portion from the corresponding image portions of the multiple images generated in each of the multiple illumination states within the image acquisition range set in the image acquisition range setting step, which is determined not to include the specular reflection portion captured in the shooting step of the specular reflection light of the illumination light; and a range image acquisition step of acquiring the image portion selected in the image portion selection step within the image acquisition range set in the image acquisition range setting step.

29. An image acquisition device comprising: an illumination unit that illuminates a subject by irradiating it with illumination light from at least one light source; an imaging unit that generates an image by photographing the subject illuminated by the illumination unit from a predetermined shooting position; an image acquisition range setting unit that sets an image acquisition range for acquiring an image of the subject; a relative arrangement adjustment unit that adjusts the relative arrangement of the light source, the subject, and the shooting position such that a specular reflection portion that photographs specularly reflected light of the illumination light is located outside the image acquisition range set by the image acquisition range setting unit; and a range image acquisition unit that acquires an image portion of the image acquisition range set by the image acquisition range setting unit from the image generated by the imaging unit.

30. The image acquisition apparatus according to claim 29, wherein the relative arrangement adjustment unit adjusts the relative arrangement of the light source, the subject, and the shooting position such that the specular reflection portion is located near the outside of the image acquisition range in the subject.

31. The image acquisition apparatus according to claim 29 or 30, wherein the illumination unit has a plurality of light sources, and the relative arrangement adjustment unit selects a light source from among the plurality of light sources to illuminate the subject.

32. The image acquisition apparatus according to claim 29 or 30, wherein the relative arrangement adjustment unit has a light source movement mechanism for moving the light source.

33. An image acquisition device according to any one of claims 20 to 27 and 29 to 32, wherein a texture image acquisition device acquires a texture image that is applied to a three-dimensional shape model to generate a three-dimensional model.

34. A three-dimensional shape model generation device comprising: a three-dimensional shape model generation device for generating a three-dimensional shape model of a subject; a texture image acquisition device according to claim 33; and a three-dimensional model generation unit for generating a three-dimensional model by applying a texture image acquired by the texture image acquisition device to the three-dimensional shape model generated by the three-dimensional shape model generation device.

35. An image acquisition method comprising: an image acquisition range setting step for setting an image acquisition range for acquiring an image of a subject; a relative arrangement adjustment step for adjusting the relative arrangement of at least one light source for illuminating the subject with illumination light, the subject, and a shooting position for photographing the subject; an illumination step for illuminating the subject by illuminating light from the light source; a shooting step for generating an image by photographing the subject illuminated in the illumination step from the shooting position; and a range image acquisition step for acquiring an image portion of the image acquisition range set in the image acquisition range setting step from the image generated in the shooting step, wherein the relative arrangement adjustment step adjusts the relative arrangement of the light source, the subject, and the shooting position such that a specular reflection portion for photographing specularly reflected light of the illumination light is located outside the image acquisition range set in the image acquisition range setting step.

Images