Information processing system, information processing method, and recording medium

Abstract

This information processing system S1 comprises: a change unit 11 that moves at least a part of a support tool for supporting the orientation of an object and changes the orientation of the object; an acquisition unit 12 that acquires a first image obtained by imaging the object of which the orientation has been changed from a first side of the object and a second image obtained by imaging the object of which the orientation has been changed from a second side different from the first side of the object; and a generation unit 13 that generates a three-dimensional shape of the object on the basis of the first image and the second image.

Description

Information processing system, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing system, an information processing method, and a recording medium.

[0002] Patent Document 1 describes a technology for generating a three-dimensional shape model of a three-dimensional object by irradiating a predetermined surface of the three-dimensional object with light simultaneously from the front, lower left, and lower right of the predetermined surface to uniformly illuminate the predetermined surface, photographing the light-irradiated surface of the three-dimensional object from at least one direction to obtain an image of the predetermined surface of the three-dimensional object without shadows or shading, and obtaining luminance values ​​at each point of the three-dimensional shape of the three-dimensional object as visual information based on three-dimensional shape data representing the three-dimensional shape of the predetermined surface of the three-dimensional object and the photographed image. Other prior art documents related to the present disclosure include Patent Documents 2 to 5.

[0003] JP 2003-208601 A JP 2004-295813 A JP 2005-284775 A JP 2020-088557 A JP 2020-107038 A

[0004] An object of this disclosure is to provide an information processing system, an information processing method, and a recording medium that aim to improve upon the techniques described in prior art documents.

[0005] One aspect of the information processing system includes a change means for changing the posture of an object by moving at least a portion of a support that supports the posture of the object, an acquisition means for acquiring a first image of the object whose posture has been changed taken from a first side of the object, and a second image of the object whose posture has been changed taken from a second side different from the first side of the object, and a generation means for generating a three-dimensional shape of the object based on the first image and the second image.

[0006] One aspect of the information processing method involves moving at least a portion of a support device that supports the posture of an object to change the posture of the object, obtaining a first image of the object with the changed posture photographed from a first side of the object, and a second image of the object with the changed posture photographed from a second side different from the first side of the object, and generating a three-dimensional shape of the object based on the first image and the second image.

[0007] One aspect of the recording medium has recorded thereon a computer program for causing a computer to execute an information processing method that involves moving at least a portion of a support device that supports the posture of an object to change the posture of the object, obtaining a first image of the object whose posture has been changed taken from a first side of the object, and a second image of the object whose posture has been changed taken from a second side different from the first side of the object, and generating a three-dimensional shape of the object based on the first image and the second image.

[0008] FIG. 1 is a block diagram showing the configuration of an information processing system in a first embodiment. FIG. 2 is a schematic diagram showing the configuration of an information processing system in a second embodiment. FIG. 3 is a block diagram showing the configuration of an information processing device in the second embodiment. FIG. 4 is a flowchart showing the flow of information processing operations of the information processing device in the second embodiment. FIG. 5 is a block diagram showing the configuration of an information processing device in a third embodiment. FIG. 6 is a flowchart showing the flow of information processing operations of the information processing device in the third embodiment. FIG. 7 is a schematic diagram showing the configuration of an information processing system in a fourth embodiment. FIG. 8 is a block diagram showing the configuration of an information processing device in the fourth embodiment.

[0009] Hereinafter, an information processing system, an information processing method, and a recording medium according to an embodiment will be described with reference to the drawings. [1: First Embodiment]

[0010] A first embodiment of an information processing system, an information processing method, and a recording medium will be described below. Hereinafter, the first embodiment of the information processing system, the information processing method, and the recording medium will be described using an information processing system S1 to which the first embodiment of the information processing system, the information processing method, and the recording medium is applied. [1-1: Configuration of Information Processing System S1]

[0011] FIG. 1 is a block diagram showing the configuration of an information processing system S1 according to the first embodiment. As shown in FIG. 1, the information processing system S1 includes a change unit 11, an acquisition unit 12, and a generation unit 13. The change unit 11 changes the posture of the object by moving at least a portion of a support that supports the posture of the object. The posture of the object includes at least one of the tilt of the object and the position of the object in the vertical direction. The acquisition unit 12 acquires a first image of the object whose posture has been changed, taken from a first side of the object, and a second image of the object whose posture has been changed, taken from a second side different from the first side of the object. The generation unit 13 generates a three-dimensional shape of the object based on the first image and the second image. [1-2: Technical Effects of the Information Processing System S1]

[0012] The information processing system S1 according to the first embodiment generates a three-dimensional shape of an object based on an image of the object whose posture has been changed, and therefore can generate a three-dimensional shape including a desired part. [2: Second Embodiment]

[0013] Next, a second embodiment of the information processing system, the information processing method, and the recording medium will be described. Hereinafter, the second embodiment of the information processing system, the information processing method, and the recording medium will be described using an information processing device 2 to which the second embodiment of the information processing system, the information processing method, and the recording medium is applied. [2-1: Configuration of the information processing system S2]

[0014] The overall configuration of an information processing system S2 to which the second embodiment is applied will be described with reference to Fig. 2. Fig. 2 is an external view showing the external appearance of the information processing system S2 to which the second embodiment is applied.

[0015] As shown in Fig. 2, the information processing system S2 in the second embodiment includes an imaging device 100, a support 200, and an information processing device 2. Fig. 2 illustrates an example in which the object whose three-dimensional shape is to be measured is the head and neck of a person, but the object whose three-dimensional shape is to be measured may be a part of the body other than the head and neck of a person. Furthermore, the object whose three-dimensional shape is to be measured may be an animal other than a human, such as a dog or a snake.

[0016] The image capturing device 100 captures an image of a person's head and neck, with the person's face at the center. The image capturing device 100 is equipped with a first illuminator P1, a second illuminator P2, a first camera C1, a second camera C2, and a third camera C3. However, the image capturing device 100 does not necessarily have to include the third camera C3.

[0017] The first illuminator P1 illuminates the target from a first side of the target. In this embodiment, the first side may be the left side of the target. The first camera C1 captures an image of the target illuminated by the first illuminator P1 from the first side.

[0018] The second illuminator P2 illuminates the target from a second side different from the first side. The second side may be the right side of the target. The second camera C2 captures an image of the target illuminated by the second illuminator P2 from the second side. The third camera C3 captures an image of the target from the front.

[0019] The first illuminator P1 and the second illuminator P2 are not particularly limited, and may be, for example, a DLP (Digital Light Processing) projector, a liquid crystal projector, or the like. DLP projectors, liquid crystal projectors, and the like are capable of projecting any light pattern at high speed, which is preferable for shortening the time required to measure the shape of an object. The shortened measurement time is particularly advantageous when measuring the three-dimensional shape of a moving object (moving body), such as when performing face recognition of a person.

[0020] The first camera C1, the second camera C2, and the third camera C3 are configured to be able to capture images of a target. The first camera C1, the second camera C2, and the third camera C3 may include a solid-state imaging element such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor. The first camera C1, the second camera C2, and the third camera C3 may also include an optical system that forms an image of the subject on the imaging surface of the solid-state imaging element, a signal processing circuit that processes the output of the solid-state imaging element to obtain a luminance value for each pixel, and the like.

[0021] The support device 200 supports the posture of the subject. The support device 200 may support the posture of the person so that the subject maintains a posture appropriate for authentication. The support device 200 includes a seat portion 201, a back panel 202, and a headrest 203.

[0022] The seat 201 supports the thighs of the person whose three-dimensional shape is to be measured. The seat 201 is provided so that its position in the vertical direction can be changed. The seat 201 may also be provided so that its position in a horizontal plane can be changed. For example, the seat 201 may be provided so that it can rotate in a horizontal plane around the connection part with the back panel 202 as the center of rotation.

[0023] The back board 202 supports the back of the person whose three-dimensional shape is to be measured. The back board 202 is provided so that the inclination angle of the back board 202 relative to the vertical line can be changed.

[0024] The headrest 203 supports the head of the person whose three-dimensional shape is to be measured. The headrest 203 may be provided so that the inclination angle of the headrest 203 relative to the backboard 202 can be changed.

[0025] The support 200 is positioned relative to the image capturing device 100 so that the person sitting on the seat 201 faces the front of the image capturing device 100. In other words, the support 200 is positioned so that the third camera C3 can capture an image of the front of the subject.

[0026] The information processing device 2 measures the three-dimensional shape of the first side of the target based on a first image captured from the first side by the first camera C1. The information processing device 2 measures the three-dimensional shape of the second side of the target based on a second image captured from the second side by the second camera C2. The information processing device 2 generates a single three-dimensional shape (hereinafter, sometimes referred to as a "face shape") by combining the three-dimensional shape of the first side and the three-dimensional shape of the second side.

[0027] The facial shape includes the three-dimensional shape of an object that can be seen from the front of the object as well as the three-dimensional shape of an object that is difficult to see from the front of the object. For example, by projecting the facial shape onto the front, an image of the object captured from the front can be obtained. Furthermore, by projecting the facial shape onto any surface, an image of the object captured from a direction perpendicular to the surface can be obtained. In other words, the facial shape can be used to obtain an image of the object captured from the front, or an image of the object captured from any side other than the front, including a first side and a second side. Therefore, by using the facial shape, it is possible to match an object captured from any direction.

[0028] As described above, the facial shape is measured based on the first image captured by the first camera C1 from the first side and the second image captured by the second camera C2 from the second side. Therefore, the facial shape includes the shapes of parts included in at least one of the first image and the second image. In other words, it is difficult for the facial shape to include the shapes of parts not included in either the first image or the second image.

[0029] When the positional relationship between the first camera C1 and the second camera C2 and the target is fixed, the portions included in at least one of the first image and the second image, as well as the portions not included in either the first image or the second image, are also fixed. Therefore, the information processing device 2 according to the second embodiment operates to change the positional relationship between the first camera C1 and the second camera C2 and the target, thereby changing the portions that can be included in the facial shape. [2-2: Configuration of the information processing device 2]

[0030] 3 is a block diagram showing the configuration of an information processing device 2 in the second embodiment. As shown in FIG. 3, the information processing device 2 includes a calculation device 21 and a storage device 22. The information processing device 2 may further include a communication device 23, an input device 24, and an output device 25. However, the information processing device 2 does not necessarily have to include at least one of the communication device 23, the input device 24, and the output device 25. The calculation device 21, the storage device 22, the communication device 23, the input device 24, and the output device 25 may be connected via a data bus 26.

[0031] The arithmetic device 21 includes, for example, at least one of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), and an FPGA (Field Programmable Gate Array). The arithmetic device 21 reads a computer program. For example, the arithmetic device 21 may read a computer program stored in the storage device 22. For example, the arithmetic device 21 may read a computer program stored in a computer-readable, non-transitory recording medium using a recording medium reading device (e.g., an input device 24 described later) not shown in the drawings that is included in the information processing device 2. The arithmetic device 21 may acquire (i.e., download or read) the computer program from a device (not shown) located outside the information processing device 2 via the communication device 23 (or another communication device). The arithmetic device 21 executes the read computer program. As a result, logical functional blocks for executing the operations to be performed by the information processing device 2 are realized within the arithmetic device 21. In other words, the arithmetic device 21 can function as a controller for realizing logical functional blocks for executing the operations (in other words, processing) to be performed by the information processing device 2.

[0032] 3 shows an example of logical functional blocks implemented within the arithmetic device 21 to execute information processing operations. As shown in FIG. 3, implemented within the arithmetic device 21 are a change unit 211, which is a specific example of a "change means" described in the appendix to be described later, an acquisition unit 212, which is a specific example of an "acquisition means" described in the appendix to be described later, a generation unit 213, which is a specific example of a "generation means" described in the appendix to be described later, and an illumination control unit 214. However, the illumination control unit 214 does not have to be implemented within the arithmetic device 21. Details of the operations of the change unit 211, the acquisition unit 212, the generation unit 213, and the illumination control unit 214 will be described later with reference to FIG. 4.

[0033] The storage device 22 can store desired data. For example, the storage device 22 may temporarily store a computer program executed by the arithmetic device 21. The storage device 22 may temporarily store data that the arithmetic device 21 temporarily uses when the arithmetic device 21 is executing a computer program. The storage device 22 may store data that the information processing device 2 stores long-term. The storage device 22 may include at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device. In other words, the storage device 22 may include a non-temporary recording medium.

[0034] The communication device 23 is capable of communicating with devices external to the information processing device 2 via a communication network (not shown). The communication device 23 may be a communication interface based on standards such as Ethernet (registered trademark), Wi-Fi (registered trademark), Bluetooth (registered trademark), or USB (Universal Serial Bus).

[0035] The input device 24 is a device that accepts information input to the information processing device 2 from outside the information processing device 2. For example, the input device 24 may include an operation device (e.g., at least one of a keyboard, a mouse, and a touch panel) that can be operated by an operator of the information processing device 2. For example, the input device 24 may include a reading device that can read information recorded as data on a recording medium that can be externally attached to the information processing device 2.

[0036] The output device 25 is a device that outputs information to the outside of the information processing device 2. For example, the output device 25 may output information as an image. That is, the output device 25 may include a display device (a so-called display) that can display an image showing the information to be output. For example, the output device 25 may output information as sound. That is, the output device 25 may include an audio device (a so-called speaker) that can output sound. For example, the output device 25 may output information on paper. That is, the output device 25 may include a printing device (a so-called printer) that can print desired information on paper. [2-3: Information Processing Operation Performed by the Information Processing Device 2]

[0037] As shown in FIG. 4 , the change unit 211 changes the posture of the target (step S20). The change unit 211 moves at least a portion of the support 200 to change the posture of the target. The change in posture of the target includes at least one of changing the tilt of the target and changing the vertical position of the target. The tilt of the target may be the tilt of an axis parallel to the midline of the target with respect to the vertical axis. The change in posture of the target may include changing the rotation angle of the target. The change unit 211 may change the distance from at least one of the first camera C1, the second camera C2, the first light P1, and the second light P2 to the support 200 to change the position of the target in the horizontal plane. That is, the change unit 211 may change the depth position of the target from the image capture device 100, the left-right position of the target relative to the image capture device 100, etc. The change unit 211 changes the posture of the target so that a desired part is included in at least one of the capture range of the first camera C1 and the capture range of the second camera C2.

[0038] For example, if a three-dimensional shape such as a chin or Adam's apple is required and the subject is to be photographed from below, the modification unit 211 may change the tilt of the subject. To change the tilt of the subject, the modification unit 211 may move the backboard 202 so that the tilt of the backboard 202 increases, as indicated by arrow A1. The modification unit 211 may also move the headrest 203 so that the tilt of the headrest 203 increases. The degree to which at least one of the backboard 202 and the headrest 203 is tilted may be instructed, for example, by an operator. For example, the modification unit 211 may change the tilt of the subject to a desired tilt in response to an operator's input instruction for the tilt angle via the input device 24. Changing the tilt of the backboard 202 changes the subject's vertical position, so the modification unit 211 may change the height of the seat 201 as indicated by arrow A2 to adjust the positional relationship between the first camera C1, the second camera C2, and the subject appropriately.

[0039] For example, when a three-dimensional shape such as an ear is required and the object is to be photographed from at least one of the right and left sides, the change unit 211 may change the rotation angle of the object as indicated by arrow A3. When changing the rotation angle of the object, the change unit 211 may move the seat 201 so that the rotation state changes within a horizontal plane with the connection part of the seat 201 with the back panel 202 as the center of rotation. The amount of rotation of the seat 201 may be instructed, for example, by an operator. For example, the change unit 211 may change the rotation angle of the object to a desired rotation angle in response to an input instruction of the angle of rotation by the operator via the input device 24.

[0040] The change unit 211 may also change the positional relationship between the imaging device 100 and the support 200 so that a desired part can be photographed. The change unit 211 may change the position of the support 200 itself and adjust the positional relationship between the first camera C1 and the second camera C2 and the target so that it is appropriate. The change unit 211 may also move not only the support 200 but also at least a part of the imaging device 100. For example, the change unit 211 may adjust the direction of the optical axis of at least one of the first camera C1 and the second camera C2. The change unit 211 may also adjust the direction of light emitted by at least one of the first light P1 and the second light P2.

[0041] The acquisition unit 212 acquires an image of the target whose posture has been changed (step S21). The lighting control unit 214 controls the first lighting P1 and the second lighting P2 to irradiate the target with light. The acquisition unit 212 controls the first camera C1 and the second camera C2 to photograph the target. The acquisition unit 212 acquires a first image of the target whose posture has been changed, photographed by the first camera C1, and a second image of the target whose posture has been changed, photographed by the second camera C2.

[0042] The generation unit 213 generates a facial shape of the target based on the first image and the second image (step S22). Specifically, the generation unit 213 measures the three-dimensional shape of the first side of the target based on the first image. The generation unit 213 also measures the three-dimensional shape of the second side of the target based on the second image. The generation unit 213 generates a facial shape by combining the three-dimensional shape of the first side and the three-dimensional shape of the second side. The generation unit 213 can generate a facial shape that includes a portion not included in the three-dimensional shape generated before changing the posture. Furthermore, the generation unit 213 may generate a facial shape by further using a three-dimensional shape measured based on an image of the target captured in a different posture. That is, the generation unit 213 may generate a facial shape based on one or more first images and one or more second images captured in different postures. In other words, the generation unit 213 may generate a facial shape by combining two or more three-dimensional shapes of the target captured from two or more directions, including the first side and the second side.

[0043] The generation unit 213 may measure the three-dimensional shape of the object using, for example, a sinusoidal grating phase shift method. The sinusoidal grating phase shift method projects a sinusoidal pattern onto the object while gradually shifting the phase, and identifies the three-dimensional shape of the object based on an image of the object onto which the light pattern is projected. The sinusoidal grating phase shift method calculates a phase value for each part of the object corresponding to each pixel based on the brightness value of each pixel in the image, and calculates three-dimensional coordinates based on the phase value. [Uses and Application Examples]

[0044] For example, suppose that a requirement is to identify a person in an image, and the image contains a person photographed from a predetermined direction. In this case, the person in the image can be identified by generating a projection image in which the facial shape is projected onto a plane perpendicular to the predetermined direction and comparing it with the image. If a facial shape is used that combines three-dimensional shapes captured from various directions, it becomes more likely that people photographed from various directions can be matched. For example, if the facial shape includes the shape behind the ears, it is useful for matching a person photographed from diagonally behind. Furthermore, since the shape of the Adam's apple under the chin differs from person to person and has its own characteristics, if the facial shape includes the Adam's apple under the chin, it is useful for identifying the person. [2-4: Technical Effects of Information Processing Device 2]

[0045] The information processing device 2 generates a facial shape based on images captured while changing the posture of the subject, and can therefore acquire a facial shape that includes the three-dimensional shape of a desired part. Furthermore, the information processing device 2 can acquire a facial shape that includes the three-dimensional shape of a desired part by adjusting the positional relationship between the first camera C1, the second camera C2, and the support 200. [3: Third Embodiment]

[0046] Next, a third embodiment of an information processing system, an information processing method, and a recording medium will be described. Hereinafter, the third embodiment of the information processing system, the information processing method, and the recording medium will be described using an information processing system S3 to which the third embodiment of the information processing system, the information processing method, and the recording medium is applied. The information processing system S3 in the third embodiment includes an imaging device 100, a support 200, and an information processing device 3. [3-1: Configuration of the information processing device 3]

[0047] The configuration of the information processing device 3 in the third embodiment will be described with reference to Fig. 5. Fig. 5 is a block diagram showing the configuration of the information processing device 3 in the third embodiment.

[0048] As shown in FIG. 5 , the information processing device 3 in the third embodiment includes a calculation device 21 and a storage device 22, similar to the information processing device 3 in the second embodiment. Furthermore, the information processing device 3 in the third embodiment may include a communication device 23, an input device 24, and an output device 25, similar to the information processing device 2 in the second embodiment. However, the information processing device 3 does not necessarily include at least one of the communication device 23, the input device 24, and the output device 25. The information processing device 3 in the third embodiment differs from the information processing device 2 in the second embodiment in that the calculation device 21 further includes a shadow determination unit 315, which is a specific example of the "shadow determination means" described in the appendix below. Furthermore, the operation of the change unit 311 differs from that of the information processing device 2 in the second embodiment. Other features of the information processing device 3 may be the same as those of the information processing device 2. Therefore, the following will describe in detail the differences from the previously described embodiments, and will omit appropriate descriptions of other overlapping features. [3-2: Information Processing Operation Performed by Information Processing Device 3]

[0049] 6 , the change unit 311 changes the posture of the target (step S30). The acquisition unit 212 acquires an image of the target whose posture has been changed (step S31). The generation unit 213 generates a facial shape of the target based on the first image and the second image (step S32).

[0050] The shadow determination unit 315 determines whether or not there is a shadow whose brightness is less than a predetermined value in at least one of the first image and the second image. If there is a shadow, the shadow determination unit 315 determines whether or not the face shape has a defect corresponding to the shadow (step S33).

[0051] If the facial shape has a defect corresponding to the shadow (step S33: Yes), the process returns to step S30. When the facial shape has a defect, the change unit 311 changes the posture of the subject so that the brightness of the shadow corresponding to the defect becomes equal to or greater than a predetermined value. The change unit 311 may also change the positional relationship between the imaging device 100 and the support tool 200 so that the brightness of the shadow corresponding to the defect becomes equal to or greater than a predetermined value. The change unit 311 may also adjust the direction of light emitted by at least one of the first light P1 and the second light P2. The change unit 311 may also change the posture of the subject so that the camera and the light are positioned directly in front of the shadow corresponding to the defect.

[0052] Like the information processing device 2, the information processing device 3 generates a facial shape based on a first image captured by the first camera C1 from the first side and a second image captured by the second camera C2 from the second side. Therefore, it is difficult for the facial shape to include the shapes of parts not included in either the first image or the second image. First, it is difficult for the facial shape to include parts outside the capture range of the first image and parts outside the capture range of the second image. Furthermore, it may be difficult for the facial shape to include parts that are too dark in the image, even if they are within the capture range of the first image or the second image. For example, when calculating three-dimensional coordinates based on the luminance values ​​of each pixel in the image, as in the above-mentioned sinusoidal grating phase shift method, the information processing device 3 may have difficulty calculating three-dimensional coordinates corresponding to pixels that are too dark. Alternatively, the information processing device 3 may have difficulty calculating three-dimensional coordinates corresponding to pixels that are too dark. If it is not possible to calculate three-dimensional coordinates corresponding to pixels, gaps may occur in the three-dimensional shape. Alternatively, the three-dimensional shape may include an inaccurate shape.

[0053] When a shadow is the cause of the inability to obtain a desired three-dimensional shape, the problem can often be solved by changing the direction of illumination. For example, a shadow caused by a nose may or may not appear depending on the direction from which light is irradiated. Therefore, when a shadow is the cause of a problem in the three-dimensional shape, the desired three-dimensional shape can be obtained by changing the posture of the object. In the third embodiment, the modification unit 311 changes the posture of the object according to the shadow that has appeared so that the shadow does not appear.

[0054] Depending on the shape of each part of the object, shadows may or may not be generated. In other words, whether shadows are generated or not varies from person to person, and the effect on the measurement of the three-dimensional shape also varies. Therefore, in the third embodiment, the facial shape is remeasured as needed based on the generated facial shape. [3-4: Technical Effects of Information Processing System S3]

[0055] The information processing device 3 can acquire a face shape with fewer defects by adjusting the positional relationship between the target and the first and second illuminators P1 and P2. Furthermore, if the face shape has defects, the information processing device 3 performs the face shape generation operation again, thereby suppressing the execution of unnecessary operations. [4: Fourth Embodiment]

[0056] Next, a fourth embodiment of an information processing system, an information processing method, and a recording medium will be described. Hereinafter, the fourth embodiment of the information processing system, the information processing method, and the recording medium will be described using an information processing system S4 to which the fourth embodiment of the information processing system, the information processing method, and the recording medium is applied. [4-1: Configuration of Information Processing System S4]

[0057] The overall configuration of an information processing system S4 to which the fourth embodiment is applied will be described using Fig. 7. Fig. 7 is an external view showing the appearance of the information processing system S4 to which the fourth embodiment is applied. As shown in Fig. 7, the information processing system S4 in the fourth embodiment includes a first mirror M1 and a second mirror M2 in addition to an imaging device 100, a support 200, and an information processing device 4.

[0058] The first mirror M1 reflects light from the target toward the first camera C1. That is, the first camera C1 captures an image in front of the target via the first mirror M1 provided between the first camera C1 and the target. The first mirror M1 may also reflect light output by the first illuminator P1 and irradiate it onto the target. That is, the first illuminator P1 may irradiate light onto the target via the first mirror M1 provided between the first camera C1 and the target.

[0059] The second mirror M2 reflects light from the target and directs it toward the second camera C2. That is, the second camera C2 captures an image in front of the target via the second mirror M2 provided between the second camera C2 and the target. The second mirror M2 may also reflect light output by the second illuminator P2 and irradiate it onto the target. That is, the second illuminator P2 may irradiate light onto the target via the second mirror M2 provided between the second camera C2 and the target. [4-2: Configuration of the Information Processing Device 4]

[0060] The configuration of the information processing device 4 in the fourth embodiment will be described with reference to Fig. 8. Fig. 8 is a block diagram showing the configuration of the information processing device 4 in the fourth embodiment.

[0061] As shown in FIG. 8 , the information processing device 4 of the fourth embodiment includes a calculation device 21 and a storage device 22, similar to the information processing device 2 of the second embodiment and the information processing device 3 of the third embodiment. Furthermore, the information processing device 4 of the fourth embodiment may include a communication device 23, an input device 24, and an output device 25, similar to the information processing device 2 of the second embodiment and the information processing device 3 of the third embodiment. However, the information processing device 4 does not necessarily include at least one of the communication device 23, the input device 24, and the output device 25. The information processing device 4 of the fourth embodiment differs from the information processing device 2 of the second embodiment and the information processing device 3 of the third embodiment in that a mirror control unit 416 is further implemented within the calculation device 21. Furthermore, the operation of the change unit 411 differs from the information processing device 2 of the second embodiment and the information processing device 3 of the third embodiment. Other features may be the same as those of at least one of the information processing device 2 and the information processing device 3. Therefore, the following will describe in detail the differences from the previously described embodiments, and will omit appropriate descriptions of other overlapping features. [4-3: Operation performed by information processing system S4]

[0062] The mirror control unit 416 changes the vertical positions of the first mirror M1 and the second mirror M2, the rotation angles around the vertical line, and the rotation angles around the horizontal line. The mirror control unit 416 operates so that a desired position of the target is within the angle of view of at least one of the first camera C1 and the second camera C2. The change unit 411 also moves at least one of the imaging device 100 and the support 200 so that the distance from the first camera C1 to the target via the first mirror M1 and the distance from the second camera C2 to the target via the second mirror M2 are distances that allow the first camera C1 and the second camera C2 to take appropriate images.

[0063] While the first mirror M1 has been described as relaying light from the first illuminator P1 to the target and from the target to the first camera C1, the mirror that relays light from the first illuminator P1 to the target and the mirror that relays light from the target to the first camera C1 may be separate components. Similarly, the second mirror M2 has been described as relaying light from the second illuminator P2 to the target and from the target to the second camera C2, but the mirror that relays light from the second illuminator P2 to the target and the mirror that relays light from the target to the second camera C2 may be separate components. [4-3: Technical Effects of Information Processing System S4]

[0064] The information processing system S4 has the first mirror M1 and the second mirror M2, and can capture an image of a desired part. Furthermore, since the information processing system S4 irradiates light onto the target and captures an image of the target via the first mirror M1 and the second mirror M2, the linear distance between the imaging device 100 and the support tool 200 can be shortened, and the space required for imaging can be reduced. [5: Supplementary Note]

[0065] The following supplementary notes are further disclosed with respect to the above-described embodiments. [Supplementary Note 1] An information processing system comprising: a change unit that changes the posture of an object by moving at least a part of a support that supports the posture of the object; an acquisition unit that acquires a first image of the object whose posture has been changed, taken from a first side of the object, and a second image of the object whose posture has been changed, taken from a second side different from the first side of the object; and a generation unit that generates a three-dimensional shape of the object based on the first image and the second image. [Supplementary Note 2] The information processing system described in Supplementary Note 1, wherein the change unit changes the posture of the object, including at least one of the tilt of the object and the position of the object in the vertical direction. [Supplementary Note 3] The information processing system described in Supplementary Note 1 or 2, wherein the change unit changes the posture of the object, including the rotation angle of the object. [Supplementary Note 4] The information processing system according to Supplementary Note 1 or 2, further comprising: a shadow determination means for determining whether the three-dimensional shape has a defect corresponding to a shadow whose brightness in at least one of the first image and the second image is less than a predetermined value; and the change means, if the defect is present, changes the posture of the object so that the brightness of the shadow corresponding to the defect becomes equal to or greater than a predetermined value. [Supplementary Note 5] The information processing system according to Supplementary Note 1 or 2, further comprising: a first camera for photographing the object from the first side; a second camera for photographing the object from the second side; and the support. [Supplementary Note 6] The information processing system according to Supplementary Note 5, further comprising: a first illuminator for irradiating light onto the object from the first side; and a second illuminator for irradiating light onto the object from the second side; [Supplementary Note 7] The information processing system according to Supplementary Note 5, wherein at least one of the first camera and the second camera photographs the object via a mirror provided between the camera and the object. [Supplementary Note 8] The information processing system according to Supplementary Note 6, wherein at least one of the first lighting and the second lighting irradiates light onto the object via a mirror provided between the camera and the object.[Supplementary Note 9] The information processing system according to Supplementary Note 6, wherein the change means changes a distance from at least one of the first camera, the second camera, the first lighting, and the second lighting to the support to change the position of the object in a horizontal plane. [Supplementary Note 10] An information processing method comprising: moving at least a part of a support that supports a posture of the object to change the posture of the object; acquiring a first image obtained by photographing the object whose posture has been changed from a first side of the object and a second image obtained by photographing the object whose posture has been changed from a second side different from the first side of the object; and generating a three-dimensional shape of the object based on the first image and the second image. [Supplementary Note 11] A recording medium having recorded thereon a computer program for causing a computer to execute an information processing method of: changing the posture of an object by moving at least a part of a support that supports the posture of the object; acquiring a first image of the object whose posture has been changed, taken from a first side of the object, and a second image of the object whose posture has been changed, taken from a second side different from the first side of the object; and generating a three-dimensional shape of the object based on the first image and the second image.

[0066] This disclosure may be modified as appropriate within the scope of the claims and the technical idea that can be read from the entire specification. Information processing systems, information processing methods, and recording media incorporating such modifications are also included in the technical idea of ​​this disclosure.

[0067] S1, S2, S3, S4 Information processing system 11, 211, 311, 411 Change unit 12, 212 Acquisition unit 13, 213 Generation unit 2, 3, 4 Information processing device 100 Photography device P1 First lighting P2 Second lighting C1 First camera C2 Second camera C3 Third camera 200 Support 201 Seat 202 Back panel 203 Headrest 214 Lighting control unit 315 Shadow determination unit M1 First mirror M2 Second mirror 416 Mirror control unit

Claims

1. An information processing system comprising: a change means for changing the posture of an object by moving at least a part of a support device that supports the posture of the object; an acquisition means for acquiring a first image of the object whose posture has been changed, taken from a first side of the object, and a second image of the object whose posture has been changed, taken from a second side different from the first side of the object; and a generation means for generating a three-dimensional shape of the object based on the first image and the second image.

2. The information processing system according to claim 1, wherein said modification means modifies the posture of said object including at least one of the inclination of said object and the position of said object in the vertical direction.

3. An information processing system according to claim 1 or 2, wherein the modification means modifies the attitude of the object including a rotation angle of the object.

4. An information processing system as described in claim 1 or 2, further comprising a shadow determination means for determining whether or not the three-dimensional shape has a defect corresponding to a shadow in at least one of the first image and the second image whose brightness is less than a predetermined value, and wherein the modification means, if there is a defect, modifies the posture of the object so that the brightness of the shadow corresponding to the defect becomes greater than or equal to a predetermined value.

5. An information processing system as described in claim 1 or 2, comprising: a first camera that photographs the object from the first side; a second camera that photographs the object from the second side; and the support device.

6. An information processing system as described in claim 5, comprising a first light that irradiates light onto the object from the first side, and a second light that irradiates light onto the object from the second side, wherein the first camera photographs the object irradiated with light from the first light from the first side, and the second camera photographs the object irradiated with light from the second side from the second side.

7. The information processing system according to claim 5, wherein at least one of the first camera and the second camera photographs the object via a mirror provided between the first camera and the object.

8. The information processing system according to claim 6, wherein at least one of the first lighting and the second lighting irradiates light onto the object via a mirror provided between the object and the first lighting.

9. An information processing system as described in claim 6, wherein the change means changes a distance from at least one of the first camera, the second camera, the first lighting, and the second lighting to the support, thereby changing the position of the object in the horizontal plane.

10. An information processing method comprising: changing the posture of an object by moving at least a part of a support device that supports the posture of the object; obtaining a first image of the object whose posture has been changed taken from a first side of the object; and obtaining a second image of the object whose posture has been changed taken from a second side different from the first side of the object; and generating a three-dimensional shape of the object based on the first image and the second image.

11. A recording medium having recorded thereon a computer program for causing a computer to execute an information processing method of: changing the posture of an object by moving at least a part of a support device that supports the posture of the object; acquiring a first image of the object whose posture has been changed taken from a first side of the object and a second image of the object whose posture has been changed taken from a second side different from the first side of the object; and generating a three-dimensional shape of the object based on the first image and the second image.

Images